WO2017000781A1

WO2017000781A1 - Video communication method and apparatus

Info

Publication number: WO2017000781A1
Application number: PCT/CN2016/085854
Authority: WO
Inventors: 储成; 谭耀峰
Original assignee: 华为技术有限公司
Priority date: 2015-06-30
Filing date: 2016-06-15
Publication date: 2017-01-05
Also published as: CN106331567A

Abstract

A video communication method and apparatus are provided in the present invention. The method comprises that: an audio device obtains a first video parameter of a first electronic device connected with the audio device, the first video parameter comprises the video media format supported by the first electronic device, the IP address and port of the first electronic device; the audio device sends a video call request to a second electronic device; the video call request comprises a first audio parameter of the audio device and the first video parameter; the audio device receives a response message sent by the second electronic device; the response message comprises a second audio parameter and a second video parameter of the second electronic device, and the second video parameter comprises the video media format supported by the second electronic device, the IP address and port of the second electronic device; the audio device sends a reply message to the second electronic device; and the audio device sends a call indication to the first electronic device to instruct the first electronic device to send video data to the second electronic device and initiate monitoring the video data sent by the second electronic device.

Description

Video communication method and device

The present application claims priority to Chinese Patent Application No. 201510374698.8, entitled "A Video Communication Method and Apparatus", filed on June 30, 2015, the entire contents of .

Technical field

The present invention relates to the field of communications technologies, and in particular, to a video communication method and apparatus.

Background technique

Desktop audio devices have been widely used in enterprises. Generally, low-end devices are deployed in enterprises, which can meet the daily voice interaction needs of the office. Nowadays, video is becoming more and more popular, and people no longer have to meet ordinary audio calls, but have the need for face-to-face video communication.

There are various ways to meet the needs of video communication in the prior art. One is to replace the existing audio device with a video device. This method completely eliminates the existing audio equipment and requires replacement of hardware equipment, which is costly. The other is to install a video camera on the audio device, such as an external Universal Serial Bus (USB) camera. However, this method requires the integration of a specific manufacturer's camera driver on the audio device. Because there are many external USB camera manufacturers, each camera can only be used with a specific camera driver. Therefore, there are many technical limitations of this method.

Summary of the invention

The embodiment of the invention provides a video communication method and device, which are used to add video capability to an audio device without replacing hardware.

A first aspect of the present invention provides a video communication method, including:

Obtaining, by the audio device, a first video parameter of the first electronic device, where the first video parameter includes a video media format supported by the first electronic device, a network protocol IP address and a port of the first electronic device, and the first The electronic device is paired with the audio device;

Transmitting, by the audio device, a video call request to the second electronic device, where the video call request includes a first audio parameter of the audio device and the first video parameter;

Receiving, by the audio device, a response message sent by the second electronic device; the response message includes a second audio parameter and a second video parameter of the second electronic device; and the second video parameter includes the second a video media format supported by the electronic device, an IP address and a port of the second electronic device;

Transmitting, by the audio device, a call indication including the second video parameter to the first electronic device to indicate the The first electronic device sends video data to an IP address and a port of the second electronic device, and starts monitoring video data sent by the second electronic device to an IP address and a port of the first electronic device.

In conjunction with the first aspect, in a first possible implementation of the first aspect, the method further includes:

After the call ends, the audio device sends a call end indication to the first electronic device to instruct the first electronic device to stop sending video data to the IP address and port of the second electronic device and to listen to the first Video data transmitted by the second electronic device to the IP address and port of the first electronic device.

With reference to the first aspect, or the first possible implementation manner of the first aspect, in a second possible implementation manner of the first aspect, the video call request is a request for conforming to a Session Initiation Protocol (SIP), in the video call In the request, the IP address of the first electronic device is defined by the c line, the port of the first electronic device is defined by m lines, and the video media format supported by the first electronic device is defined by a line;

The response message is a message conforming to the SIP, in the response message, the IP address of the second electronic device is defined by c lines, and the port of the second electronic device is defined by m lines, defined by a line a video media format supported by the second electronic device.

A second aspect of the present invention provides a video communication method, including:

Obtaining, by the audio device, a first video parameter of the first electronic device, where the first video parameter includes a video media format supported by the first electronic device; the first electronic device is paired with the audio device;

Transmitting, by the audio device, a video call request to a second electronic device, where the video call request includes a first audio parameter of the audio device, the first video parameter, and a network protocol IP address of the audio device port;

Receiving, by the audio device, a response message sent by the second electronic device; the response message includes a second audio parameter and a second video parameter of the second electronic device, where the second video parameter includes the second a video media format supported by the electronic device, an IP address and a port of the second electronic device;

Transmitting, by the audio device, a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send video data to the audio device;

Transmitting, by the audio device, video data received from the first electronic device to the second electronic device;

The audio device monitors video data sent by the second electronic device to an IP address and a port of the audio device;

The audio device forwards video data sent by the second electronic device to the first electronic device.

With reference to the second aspect, in a first possible implementation manner of the second aspect, the method further includes:

After the call ends, the audio device transmits a call end indication to the first electronic device to instruct the first electronic device to stop transmitting video data to the audio device.

With reference to the second aspect, or the first possible implementation manner of the second aspect, in a second possible implementation manner of the second aspect, the video call request is a request for conforming to a Session Initiation Protocol (SIP), in the video call In the request, the IP address of the audio device is defined by the c line, the port of the audio device is defined by m lines, and the video media format supported by the first electronic device is defined by a line.

A third aspect of the present invention provides a video communication method, including:

Transmitting, by the audio device, a video call request to the second electronic device, where the video call request includes a first audio parameter of the audio device, the first video parameter, and an IP address and a port of the audio device;

Transmitting, by the audio device, a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send video data to an IP address and a port of the second electronic device;

The audio device listens to video data sent by the second electronic device to an IP address and port of the audio device.

In conjunction with the third aspect, in a first possible implementation manner of the third aspect, the method further includes:

After the call ends, the audio device sends a call end indication to the first electronic device to instruct the first electronic device to stop transmitting video data to the second electronic device.

With reference to the third aspect, or the first possible implementation manner of the third aspect, in a second possible implementation manner of the third aspect, the video call request is a request for conforming to a Session Initiation Protocol SIP, in the video call In the request, the IP address and port of the audio device are defined by one row, and the IP address and port of the first electronic device are defined by another row of a;

The response message is a message conforming to the SIP, and in the response message, the IP address of the second electronic device is defined by c lines, and the port of the second electronic device is defined by m lines.

A fourth aspect of the present invention provides a video communication apparatus, including:

An acquiring unit, configured to acquire a first video parameter of the first electronic device, where the first video parameter includes a video media format supported by the first electronic device, a network protocol IP address and a port of the first electronic device; The first electronic device and the audio device are paired and connected;

a sending unit, configured to send a video call request to the second electronic device, where the video call request includes a first audio parameter of the audio device and the first video parameter;

a receiving unit, configured to receive a response message sent by the second electronic device, where the response message includes a second audio parameter and a second video parameter of the second electronic device;

The sending unit is further configured to: send a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send video data to an IP address and a port of the second electronic device And initiating monitoring of video data sent by the second electronic device to an IP address and a port of the first electronic device.

With reference to the fourth aspect, in a first possible implementation manner of the fourth aspect, the sending unit is further configured to: after the end of the call, send a call end indication to the first electronic device, to indicate the first The electronic device stops transmitting video data to the IP address and port of the second electronic device and listens to the second electronic device to the first electronic device The IP address and port sent by the video data.

With reference to the fourth aspect, or the first possible implementation manner of the fourth aspect, in a second possible implementation manner of the fourth aspect, the video call request is a request for conforming to a Session Initiation Protocol SIP, in the video call In the request, the IP address of the first electronic device is defined by the c line, the port of the first electronic device is defined by m lines, and the video media format supported by the first electronic device is defined by a line;

A fifth aspect of the present invention provides a video communication apparatus, including:

An acquiring unit, configured to acquire a first video parameter of the first electronic device, where the first video parameter includes a video media format supported by the first electronic device; the first electronic device and the audio device are paired with each other;

a sending unit, configured to send a video call request to the second electronic device, where the video call request includes a first audio parameter of the audio device, the first video parameter, and a network protocol IP address of the audio device And port;

a receiving unit, configured to receive a response message sent by the second electronic device, where the response message includes a second audio parameter and a second video parameter of the second electronic device, where the second video parameter includes the a video media format supported by the second electronic device, an IP address and a port of the second electronic device;

The sending unit is further configured to: send a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send video data to the audio device; to the second electronic The device transmits video data received from the first electronic device;

The receiving unit is further configured to: monitor video data sent by the second electronic device to an IP address and a port of the audio device;

The sending unit is further configured to: forward the video data sent by the second electronic device to the first electronic device.

With reference to the fifth aspect, in a first possible implementation manner of the fifth aspect, the sending unit is further configured to: after the end of the call, send a call end indication to the first electronic device, to indicate the first The electronic device stops transmitting video data to the audio device.

With reference to the fifth aspect, or the first possible implementation manner of the fifth aspect, in a second possible implementation manner of the fifth aspect, the video call request is a request that meets a session initiation protocol SIP, in the video call In the request, the IP address of the audio device is defined by the c line, the port of the audio device is defined by m lines, and the video media format supported by the first electronic device is defined by a line.

A sixth aspect of the present invention provides a video communication apparatus, including:

a sending unit, configured to send a video call request to the second electronic device, where the video call request includes Determining a first audio parameter of the audio device, the first video parameter, and an IP address and port of the audio device;

The sending unit is further configured to: send a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send video data to an IP address and a port of the second electronic device ;

The receiving unit is further configured to: monitor video data sent by the second electronic device to an IP address and a port of the audio device.

With reference to the sixth aspect, in a first possible implementation manner of the sixth aspect, the sending unit is further configured to: after the end of the call, send a call end indication to the first electronic device, to indicate the first The electronic device stops transmitting video data to the second electronic device.

With reference to the sixth aspect, or the first possible implementation manner of the sixth aspect, in a second possible implementation manner of the sixth aspect, the video call request is a request that meets a session initiation protocol SIP, in the video call In the request, the IP address and port of the audio device are defined by one row, and the IP address and port of the first electronic device are defined by another row of a;

A seventh aspect of the present invention provides an audio device, including:

a receiver, configured to acquire a first video parameter of the first electronic device, where the first video parameter includes a video media format supported by the first electronic device, a network protocol IP address and a port of the first electronic device; The first electronic device and the audio device are paired and connected;

a transmitter, configured to send a video call request to the second electronic device, where the video call request includes a first audio parameter of the audio device and the first video parameter;

The receiver is further configured to: receive a response message sent by the second electronic device; the response message includes a second audio parameter and a second video parameter of the second electronic device; and the second video parameter includes a video media format supported by the second electronic device, an IP address and a port of the second electronic device;

The transmitter is further configured to: send a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send video data to an IP address and a port of the second electronic device And initiating monitoring of video data sent by the second electronic device to an IP address and a port of the first electronic device.

With reference to the seventh aspect, in a first possible implementation manner of the seventh aspect, the transmitter is further configured to: after the end of the call, send a call end indication to the first electronic device, to indicate the first The electronic device stops transmitting video data to the IP address and port of the second electronic device and listens to video data sent by the second electronic device to the IP address and port of the first electronic device.

In conjunction with the seventh aspect or the first possible implementation of the seventh aspect, the second possible implementation of the seventh aspect Wherein the video call request is a request conforming to a Session Initiation Protocol (SIP), in which the IP address of the first electronic device is defined by c lines, and the first electronic device is defined by m lines. a port, the video media format supported by the first electronic device is defined by a line;

An eighth aspect of the present invention provides an audio device, including:

a receiver, configured to acquire a first video parameter of the first electronic device, where the first video parameter includes a video media format supported by the first electronic device; the first electronic device and the audio device are paired with each other;

a transmitter, configured to send a video call request to the second electronic device, where the video call request includes a first audio parameter of the audio device, the first video parameter, and a network protocol IP address of the audio device And port;

The receiver is further configured to: receive a response message sent by the second electronic device; the response message includes a second audio parameter and a second video parameter of the second electronic device, where the second video parameter includes a video media format supported by the second electronic device, an IP address and a port of the second electronic device;

The transmitter is further configured to: send a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send video data to the audio device; to the second electronic The device transmits video data received from the first electronic device;

The receiver is further configured to: monitor video data sent by the second electronic device to an IP address and a port of the audio device;

The transmitter is further configured to: forward the video data sent by the second electronic device to the first electronic device.

In conjunction with the eighth aspect, in a first possible implementation manner of the eighth aspect, the transmitter is further configured to: after the end of the call, send a call end indication to the first electronic device, to indicate the first The electronic device stops transmitting video data to the audio device.

With reference to the eighth aspect, or the first possible implementation manner of the eighth aspect, in a second possible implementation manner of the eighth aspect, the video call request is a request that meets a session initiation protocol SIP, in the video call In the request, the IP address of the audio device is defined by the c line, the port of the audio device is defined by m lines, and the video media format supported by the first electronic device is defined by a line.

A ninth aspect of the present invention provides an audio device, including:

a transmitter, configured to send a video call request to the second electronic device, where the video call request includes a first audio parameter of the audio device, the first video parameter, and an IP address and port of the audio device ;

The receiver is further configured to: receive a response message sent by the second electronic device; the response message includes the a second audio parameter and a second video parameter of the second electronic device, where the second video parameter includes a video media format supported by the second electronic device, an IP address and a port of the second electronic device;

The transmitter is further configured to: send a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send video data to an IP address and a port of the second electronic device ;

The receiver is further configured to: monitor video data sent by the second electronic device to an IP address and a port of the audio device.

With reference to the ninth aspect, in a first possible implementation manner of the ninth aspect, the transmitter is further configured to: after the end of the call, send a call end indication to the first electronic device, to indicate the first The electronic device stops transmitting video data to the second electronic device.

With reference to the ninth aspect, or the first possible implementation manner of the ninth aspect, in a second possible implementation manner of the ninth aspect, the video call request is a request for conforming to a session initiation protocol SIP, in the video call In the request, the IP address and port of the audio device are defined by one row, and the IP address and port of the first electronic device are defined by another row of a;

One or more technical solutions provided in the embodiments of the present invention have at least the following technical effects or advantages:

In the embodiment of the present invention, the audio device is paired with the first electronic device, and the first electronic device has the capability of acquiring a video image. The audio device uses the video parameters of the first electronic device to communicate with the call peer (ie, the second electronic device) to establish a video call. The audio device controls the first electronic device to collect the video image and send the video image to the second electronic device, and control the first electronic device to start monitoring the video data sent by the second electronic device, thereby implementing the audio without changing the hardware of the audio device. The device increases video capabilities.

DRAWINGS

1 is a schematic diagram of a network connection between an audio device and a first electronic device according to an embodiment of the present invention;

2 is a schematic diagram of a pairing connection between an audio device and a first electronic device according to an embodiment of the present invention;

FIG. 3 is a flowchart of a video communication method according to an embodiment of the present invention;

4 is a schematic diagram of a specific example of the video communication method shown in FIG. 3;

FIG. 5 is a flowchart of another video communication method according to an embodiment of the present invention;

6 is a schematic diagram of a specific example of the video communication method shown in FIG. 5;

FIG. 7 is a flowchart of still another video communication method according to an embodiment of the present invention;

8 is a schematic diagram of a specific example of the video communication method shown in FIG. 7;

FIG. 9 is a functional block diagram of a video communication apparatus according to an embodiment of the present invention;

FIG. 10 is a structural block diagram of an audio device according to an embodiment of the present invention.

detailed description

To achieve the above object, the general idea of the technical solution in the embodiment of the present invention is as follows:

The audio device is paired with the first electronic device, the first electronic device having the ability to capture video images. The audio device uses the video parameters of the first electronic device to communicate with the call peer, that is, the second electronic device, to establish a video call. The audio device controls the first electronic device to collect the video image and send the video image to the second electronic device, and control the first electronic device to start monitoring the video data sent by the second electronic device, thereby implementing the audio without changing the hardware of the audio device. The device increases video capabilities.

The technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the drawings in the embodiments of the present invention. It is a partial embodiment of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

The term "and/or" in this context is merely an association describing the associated object, indicating that there may be three relationships, for example, A and / or B, which may indicate that A exists separately, and both A and B exist, respectively. B these three situations. In addition, the character "/" in this article generally indicates that the contextual object is an "or" relationship.

For ease of understanding, the connection process between the audio device and the first electronic device will be described below. Specifically, the audio device is, for example, a desktop audio telephone. The first electronic device is, for example, a mobile phone, a tablet computer, or a wearable device. The first electronic device can be any manufacturer's device.

The audio device and the first electronic device can be connected through a network (wired or wireless), or through a Bluetooth connection, a USB interface, or a cellular connection. As long as the connection between the audio device and the first electronic device is reachable.

Please refer to FIG. 1 , which is a schematic diagram of a network connection between an audio device and a first electronic device.

The network shown in Figure 1 uses Ethernet + Wireless Fidelity (English: Wireless Fidelity, referred to as: WiFi) deployment, which is also the most common way of corporate network planning. The switch, the user-level switch (Private Branch Exchange, PBX for short), and the access point (English: Access Point, AP for short) are connected to the Ethernet. The audio device and the first electronic device access the AP. Therefore, the audio protocol and the network protocol (English: Internet Protocol, IP address) of the first electronic device are interoperable. Control signaling or video data transmission can be performed between the two.

Referring again to FIG. 2, a possible schematic diagram of a paired connection between the audio device and the first electronic device. Specifically, the user fills in the information of the paired audio device on the first electronic device. This information is for example the telephone number and IP address of the audio device. Further, the information may also include a mask and a gateway address. Of course, in actual use, according to the connection manner of the first electronic device and the audio device, the information of the filled audio device may be different.

Next, when the user triggers or automatically triggers the pairing connection, the first electronic device sends a connection request to the audio device, such as a Discover() message, which contains the phone number and IP address of the audio device. After the first electronic device sends a connection request and searches for the audio device, the paired connection can be automatically confirmed or confirmed by the user. For the connection, the first electronic device and the audio device are successfully connected. When the audio device receives the connection request, the paired connection can be automatically confirmed or the paired connection is determined by the user, and then the audio device is successfully paired with the first electronic device.

After the audio device and the first electronic device are successfully paired, the audio device may send a request for acquiring the first video parameter of the first electronic device to the first electronic device. The request is for example a GetParam() message. The first electronic device then acquires and records the first video parameter of the first electronic device. The first video parameter includes, for example, a video media format supported by the first electronic device, a codec capability of the first electronic device, an IP address and port of the first electronic device, and camera information of the first electronic device. Codec capabilities include, for example, maximum decoding capability, maximum encoding capability, maximum frame rate, minimum encoding capability, and maximum bandwidth. The camera information includes information such as the front camera, rear camera, and flash.

Optionally, the audio device may save the first video parameter in a configuration file of the audio device.

Optionally, after the audio device and the first electronic device are successfully paired, the audio device can perform video communication with the second electronic device by using the video capability of the first electronic device. According to whether the audio device side forwards and/or receives video data, there are various implementation manners in practical applications, for example, the first type, the first electronic device directly sends video data to the second electronic device, and directly from the second electronic device Receive video data. Second, the first electronic device first transmits the video data to the audio device, and then the audio device forwards the video data to the second electronic device, and the audio device directly receives the video data sent by the second electronic device. Third, the first electronic device directly transmits the video data to the second electronic device, but the audio data directly received by the second electronic device is received by the audio device. The specific implementation process of the first case will be described below.

For details, please refer to FIG. 3, which is a flowchart of a video communication method in the first case. As shown in Figure 3, the method includes the following:

Step 101: The audio device acquires a first video parameter of the first electronic device, where the first video parameter includes a video media format supported by the first electronic device, an IP address and a port of the first electronic device,

Step 102: The audio device sends a video call request to the second electronic device, where the video call request includes a first audio parameter and a first video parameter of the audio device, and the IP address and port of the first electronic device are used to notify the first The IP address and port of the electronic device audio device for transmitting and receiving video data;

Step 103: The audio device receives a response message sent by the second electronic device, where the response message includes a second audio parameter and a second video parameter of the second electronic device, where the second video parameter includes a video media format supported by the second electronic device. The IP address and port of the second electronic device; the IP address and port of the second electronic device are used to indicate the IP address and port of the second electronic device to send and receive video data; and the video media format supported by the second electronic device included in the response message The second electronic device may be determined according to the video media format supported by the first electronic device and the video media format supported by the first electronic device, so the video media format in the response message is a video media format supported by the first electronic device and the second electronic device. ;

Step 104: The audio device sends a response message to the second electronic device to notify the second electronic device that the audio device has received the response message. This step is an optional step, that is, the method in step 101-step 103 and step 105 may also be performed. Implementation

Step 105: The audio device sends a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send video data to the IP address and port of the second electronic device, and initiate monitoring the second electronic device to the first Electronics The device's IP address and video data sent by the port.

Specifically, the first electronic device monitors the IP address of the second electronic device and the video data sent by the port to the IP address and port of the first electronic device.

It is convenient to explain the implementation process of the video communication method in the embodiment of the present invention, and the specific implementation manner of each step will be described in detail below.

In step 101, the audio device acquires a first video parameter of the first electronic device. Specifically, the first video parameter may be obtained according to the process described above, and the obtained first video parameter may be saved. When the audio device needs to perform video communication, the saved first video parameter can be obtained. Of course, in a practical application, the first video parameter of the first electronic device may be obtained by other means. For example, the audio device and the first electronic device are both connected to one server, and the first video parameter may be sent by the server. Audio device, then the audio device receives the first video parameter.

When the user wants to make a video call to other users through the audio device, the user can dial the other party's phone number, and then the audio device sends a video call request to the second electronic device. The first audio parameter and the first video parameter of the audio device are included in the video call request. The first audio parameter includes, for example, an encoding scheme supported by the audio device, an encoding method, and the like. In this embodiment, the IP address and port for transmitting and receiving audio data are the IP address and port of the audio device.

In this embodiment, the first video parameter may include a video media format supported by the first electronic device, an IP address and a port of the first electronic device. Certainly, the first video parameter may further include other content, which is not specifically limited by the present invention.

In actual use, the video call request can be sent through multiple protocols, such as the Session Initiation Protocol (SIP). The negotiation process of the audio device and the second electronic device and the transmission process of the video data will be described below by taking SIP as an example. As shown in FIG. 4, in the SIP, the video call request is, for example, an INVITE message, and the body type of the message is, for example, a Session Description Protocol (SDP) message, as follows.

INVITE sip:*125@192.169.1.136 SIP/2.0//Message type is INVITE

Via: SIP/2.0/UDP 192.166.1.252:5062;branch=z9hG4bK88078094//Specify SIP version 2.0, the transport protocol is UDP, and the server address that receives the send request

From:"556614"<sip:556614@192.169.1.136>;tag=564377066//Session Initiator

To:sip:*125@192.169.1.136//session recipient

Call-ID: 577212191@192.166.1.252//Global unique flag used to uniquely mark this call

CSeq: 1 INVITE//call serial number

Contact:sip:556614@192.166.1.252:5062//IP address and port of the server

Content-Type: application/sdp// indicates that the message body type carried by the SIP message is SDP packet.

Allow: INVITE, INFO, PRACK, ACK, BYE, CANCEL, OPTIONS, NOTIFY, REGISTER, SUBSCRIBE, REFER, PUBLISH, UPDATE, MESSAGE//Allowed message types

Max-Forwards: 70//Maximum number of forwards

User-Agent: Huawei eSpace 7850 2.60.94.24//Description of audio equipment

Supported:replaces//support is replaced

Allow-Events: talk, hold, conference, refer, check-sync//allowed events

Content-Length: xxx / / message content length

V=0// protocol version

o=huawei 23293 18 IN IP4 10.38.111.220// Parameters related to the session owner, the first parameter indicates the name of the session initiator, the second parameter indicates the caller's session identifier, and the third parameter is the primary parameter. The version of the called session, when the session data changes, the version number is incremented, the fourth parameter defines the network type, IN represents the Internet network type, the fifth parameter is the address type, and the sixth parameter is the address: indicates the session initiator IP address, in this embodiment, the IP address of the audio device

s=-//The topic of this session

t=0 0//the start time and end time of the session

m=audio 11792 RTP/AVP 0 8 18 9 101//The first parameter is the media type, which is audio in this embodiment, the second parameter is port, which indicates the port for transmitting and receiving audio data, and the third parameter is the transmission protocol. In this implementation, the RTP/AVP protocol, the fourth to seventh parameters indicate the five payload type numbers supported by the audio device.

c=IN IP4 10.38.111.220//The first parameter is the network type, IN is the Internet network type, and the second parameter is the address type. In this embodiment, it is an IP4 type, and the third parameter is an address. Medium is the IP address of the audio device, indicating the IP address of the audio data.

a=rtpmap:0 PCMU/8000//payload type 0, the corresponding audio code name is PCMU, the sampling rate is 8000Hz

a=rtpmap:8 PCMA/8000//payload type 8, the corresponding audio code name is PCMA, which is dynamically allocated.

a=rtpmap:18 G729/8000//payload type 18, the corresponding audio code name is G729, the sampling rate is 8000Hz

a=rtpmap:9 G722/8000//payload type 9, the corresponding audio code name is G722, the sampling rate is 8000Hz

a=fmtp:101 0-15//

a=rtpmap:101 telephone-event/8000//Support 2833 receiving method

a=ptime: packing length of 20//20ms

m=video 10002 RTP/AVP 106//The first parameter indicates that the media type is video, the second parameter indicates the port for transmitting and receiving video data, in this embodiment is the port of the first electronic device, and the third parameter indicates the transmission. The protocol is RTP or AVP protocol, and the fourth parameter indicates the payload type number.

c=IN IP4 10.174.5.56//The first parameter and the second parameter have the same meaning as the first C line, and the third parameter represents the transceiving address of the video data, which in this embodiment is the first electronic device. IP address

b=AS: 512 / / bandwidth that the audio device can support

a=rtpmap:106 H264/90000//payload type 106, the corresponding video encoding type is H.264

a=fmtp:106 profile-level-id=428028//payload type 106

a=sendrecv// indicates that the IP address of the first electronic device transmits video data bidirectionally and the IP address of the audio electronic device transmits audio data bidirectionally

a=label:11

The first C line indicates the IP address of the audio device for transmitting and receiving audio data, which is the IP address of the audio device in this embodiment. The m=video parameter indicates that the audio device has video capabilities. 11792 in the first m row represents a port for transmitting and receiving audio data, which is a port of the audio device in this embodiment. The second C line indicates the IP address of the audio device that transmits and receives video data, which is the IP address of the first electronic device in this embodiment. 10002 in the second m row represents a port on which the audio device transmits and receives video data, and in this embodiment, is a port of the first electronic device. 106 indicates that the payload type is 106, and the value can be set and negotiated according to actual capabilities. The profile-level-id indicates the detailed codec capability of the audio device, and the capability parameter may be the maximum decoding capability, maximum coding capability, and the like described above.

When the second electronic device receives the video call request sent by the audio device, the response message may be replied according to its own video capability. Accordingly, the response message can be sent using the same protocol as the video call request. For example, the SIP message is used as an example. The response message may be a 200 OK message, and the body content of the message is an SDP message, as follows.

SIP/2.0/UDP 10.174.4.63:5060;branch=z9hG4bK7x71w7bbx090rr9oiw37aw22yT01351

Record-Route:sip:10.174.4.63:5060;transport=udp;lr// is used to keep the SIP server in every request, not bypassed

Call-ID: asbchr1axxvxva1j2hjgja8aj3zz10jvvj2l@ATS.ats-2.home1.com.5

From:"02"<sip:+96628950006@home1.com>;tag=sbc0403ixg3hg0x-CC-5

To:<sip:+96628950005@home1.com>;tag=45vp5pvp

CSeq: 1 INVITE

Contact:<sip:+96628950005@10.174.198.171:5060;transport=udp>

Supported:replaces

Allow:

MESSAGE, REFER, INFO, NOTIFY, SUBSCRIBE, UPDATE, PRACK, PUBLISH, CANCEL, BYE, OPTIONS, ACK, INVITE

User-Agent: Huawei eSpace 8950 V200R003C00

Content-Length:700

Content-Type: application/sdp

V=0

o=huawei 23293 35 IN IP4 10.174.198.171

s=SBC call//session topic

t=0 0

c=IN IP4 10.174.198.171//The IP address of the second electronic device, used to send and receive audio data and video data

m=audio 10000 RTP/SAVP 112 9 8 0 18 97 101//The port for sending and receiving audio data is 10000

a=rtpmap:112 opus/48000

a=fmtp:112 maxcodedaudiobandwidth=48000

a=rtpmap:9 G722/16000

a=rtpmap:8 PCMA/8000

a=rtpmap:0 PCMU/8000

a=rtpmap:18 G729/8000

a=rtpmap:97 iLBC/8000

a=fmtp:97 mode=30

a=rtpmap:101 telephone-event/8000

a=fmtp:101 0-15

a=ptime:20

a=sendrecv//the communication address of the video data and the audio data, that is, the IP address of the second electronic device is two-way communication

a=crypto:1 AES_CM_128_HMAC_SHA1_80inline: WFhzKzVTeUNsWURVZ0xOSU1yVHhDdDBsUkNwUTd0

m=video 10002 RTP/SAVP 106

b=AS: 2048

a=rtpmap:106 H264/90000

a=fmtp:106 profile-level-id=428028

a=sendrecv// indicates that the IP address of the second electronic device transmits video data bidirectionally

a=label:11

a=crypto:1 AES_CM_128_HMAC_SHA1_80inline: UDU4cW1pWmUzWENjTHVsbmUyNyt3RFF1WlYrOHRH

The contents of the same code in the code as in the preceding code segment will not be described again.

After the audio device receives the 200 OK message, a response message, such as a correct answer response (ACK), is sent to the second electronic device to inform the second electronic device that the audio device has received the 200 OK message. At this point, the audio device and the second electronic device establish a video communication.

Next, the audio device sends a call indication including the second video parameter to the first electronic device, for example, an OpenVideo message that opens the video stream, and the parameter of the message is the second video parameter. After receiving the call indication, the second electronic device opens the camera to collect video data, and sends the collected video data to the IP address and port of the second electronic device, and starts to monitor the IP of the second electronic device to the first electronic device. The data sent by the address and port. In this way, the audio device can perform video communication by means of the video capability of the first electronic device without requiring hardware improvement. The program can Applicable to scenes where the audio device does not have video playback function. Of course, it is not excluded to be applied to other scenes.

Optionally, the first electronic device may also perform processing, such as data compression, before the video data is sent out. The compressed format is a video media format supported by both parties in the foregoing

steps

102 and 103. For example, the video data is compressed by the H.264 video codec standard, and then the compressed H264 video data is transmitted. The second electronic device can also compress the video data and then send it to the first electronic device.

Correspondingly, after receiving the compressed video data, the receiver of the video data may perform decoding and playing according to the video media format supported by both parties.

For the case of transmission of audio data, the audio device transmits to the IP address and audio port of the second electronic device, and the second electronic device transmits to the IP address and port of the audio device.

Similarly, before the audio data is sent, the audio processing can be performed according to the audio formats supported by both parties. After receiving the compressed audio data, the audio data receiver can decode and play according to the audio format.

Optionally, after the call ends, the audio device further sends a call end indication to the first electronic device, to instruct the first electronic device to stop sending video data to the IP address and port of the second electronic device, and to monitor the second electronic device. The video data sent by the IP address and port of an electronic device.

The implementation process of the video communication method in the foregoing second case will be described in detail below. Referring to FIG. 5, the method includes:

Step 201: The audio device acquires a first video parameter of the first electronic device, where the first video parameter includes a video media format supported by the first electronic device.

Step 202: The audio device sends a video call request to the second electronic device. The video call request includes a first audio parameter of the audio device, a first video parameter, and an IP address and port of the audio device, and a network protocol IP address of the audio device. And an IP address and a port used by the port to notify the second electronic device audio device to send and receive video data;

Step 203: The audio device receives a response message sent by the second electronic device, where the response message includes a second audio parameter and a second video parameter of the second electronic device, where the second video parameter includes a video media format supported by the second electronic device, The IP address and port of the second electronic device; the IP address and port of the second electronic device are used to indicate the IP address and port of the second electronic device to send and receive video data;

Step 204: The audio device sends a response message to the second electronic device to notify the second electronic device that the audio device has received the response message; the step is an optional step;

Step 205: The audio device sends a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send the video data to the audio device.

Step 206: The audio device sends the video data received from the first electronic device to the second electronic device.

Step 207: The audio device monitors video data sent by the second electronic device to the IP address and port of the audio device.

Step 208: The audio device forwards the video data sent by the second electronic device to the first electronic device.

In this embodiment, the first video parameter may include only the video media format supported by the first electronic device. of course, Optionally, the first video parameter may further include other parameters, such as a codec capability of the first electronic device.

Different from the first case, in this embodiment, the IP address and port used by the audio device to send and receive video data are the IP address and port of the audio device itself, so the audio device needs to send itself in step 202. The IP address and port are given to the second electronic device to inform the second electronic device that the audio device transmits and receives the IP address and port of the video data. Correspondingly, in step 203, in the response message sent by the second electronic device, the IP address and port of the second electronic device can be used to notify the audio device of the IP address and port of the second electronic device to send and receive video data. Next, the audio device may send a call indication to the first electronic device to instruct the first electronic device to transmit audio data to the audio device, and then the audio device forwards the received video data to the second electronic device. Further, the audio device monitors the IP address of the second electronic device and the video data sent by the port to the IP address and port of the audio device, and forwards the video data sent by the second electronic device to the first electronic device. In this way, the second electronic device can perform video communication with the audio device without any change, and the audio device can realize and utilize the video capability of the first electronic device without performing hardware improvement. Two electronic devices for video communication.

The scheme in this embodiment is applicable to an audio device that does not have video capability but has video playback capability. Of course, the case where the solution in this embodiment is applied to other scenarios is not excluded.

It should be noted that the same content as the first case in this embodiment will not be described again.

Similarly, video call request and response messages can also be sent over the SIP protocol. The negotiation process and the transmission process of the video data between the audio device and the second electronic device in the present embodiment will be exemplified below with reference to FIG.

As shown in FIG. 6, the audio device sends an INVITE message to the second electronic device, where the INVITE message includes the following content:

INVITE sip:*125@192.169.1.136 SIP/2.0

Via: SIP/2.0/UDP 192.166.1.252:5062;branch=z9hG4bK88078094

From:"556614"<sip:556614@192.169.1.136>;tag=564377066

To:<sip:*125@192.169.1.136>

Call-ID: 577212191@192.166.1.252

CSeq: 1 INVITE

Contact:<sip:556614@192.166.1.252:5062>

Content-Type: application/sdp

Allow: INVITE, INFO, PRACK, ACK, BYE, CANCEL, OPTIONS, NOTIFY, REGISTER, SUBSCRIBE, REFER, PUBLISH, UPDATE, MESSAGE

Max-Forwards: 70

User-Agent: Huawei eSpace 7850 2.60.94.24

Supported:replaces

Allow-Events: talk, hold, conference, refer, check-sync

Content-Length: xxx

V=0

o=huawei 23293 18 IN IP4 10.38.111.220

s=-

c=IN IP4 10.38.111.220//IP address of the audio device, indicating the IP address of the audio and video data

t=0 0

m=audio 11792 RTP/AVP 0 8 18 9 101//The port that sends and receives audio data is 11792, which is the port of the audio device.

a=rtpmap:0 PCMU/8000

a=rtpmap:8 PCMA/8000

a=rtpmap:18 G729/8000

a=fmtp:18 annexb=no

a=rtpmap:9 G722/8000

a=fmtp:101 0-15

a=rtpmap:101 telephone-event/8000

a=ptime:20

m=video 10002 RTP/AVP 106// indicates that the port for sending and receiving video data is 10002, which is the port of the audio device.

b=AS: 512

a=rtpmap:106 H264/90000

a=fmtp:106 profile-level-id=428028

a=sendrecv// indicates that both audio and video are two-way communication

a=label:11

As can be seen from the above code segment, the audio device notifies the second electronic device audio device of the IP address of the audio data and the video data through the c line, and the IP address is the IP address of the audio device. The port for notifying the second electronic device itself to send and receive audio data through the first m line, and notifying the port of the second electronic device audio device for transmitting and receiving video data through the second m line, the port being the port of the audio device.

For the meaning of other code segments, please refer to the code segment described above, and details are not described herein.

Next, the second electronic device sends a 200 OK message to the audio device according to its own video capability, and the content of the message is as follows:

SIP/2.0/UDP

10.174.4.63:5060;branch=z9hG4bK7x71w7bbx090rr9oiw37aw22yT01351

Record-Route:<sip:10.174.4.63:5060;transport=udp;lr>

Call-ID: asbchr1axxvxva1j2hjgja8aj3zz10jvvj2l@ATS.ats-2.home1.com.5

From:"02"<sip:+96628950006@home1.com>;tag=sbc0403ixg3hg0x-CC-5

To:<sip:+96628950005@home1.com>;tag=45vp5pvp

CSeq: 1 INVITE

Contact:<sip:+96628950005@10.174.198.171:5060;transport=udp>

Supported:replaces

Allow:

User-Agent: Huawei eSpace 8950 V200R003C00

Content-Length:700

Content-Type: application/sdp

V=0

o=huawei 23293 35 IN IP4 10.174.198.171

s=SBC call

c=IN IP4 10.174.198.171//IP address of the second electronic device, indicating the IP address of the audio and video data

t=0 0

m=audio 10000 RTP/SAVP 112 9 8 0 18 97 101//10000 indicates the port for sending and receiving audio data.

a=rtpmap:112 opus/48000

a=fmtp:112 maxcodedaudiobandwidth=48000

a=rtpmap:9 G722/16000

a=rtpmap:8 PCMA/8000

a=rtpmap:0 PCMU/8000

a=rtpmap:18 G729/8000

a=rtpmap:97 iLBC/8000

a=fmtp:97 mode=30

a=rtpmap:101 telephone-event/8000

a=fmtp:101 0-15

a=ptime:20

a=sendrecv

m=video 10002 RTP/SAVP 106//10002 indicates the port for sending and receiving video data.

b=AS: 2048

a=rtpmap:106 H264/90000

a=fmtp:106 profile-level-id=428028

a=sendrecv

a=label:11

a=crypto:1 AES_CM_128_HMAC_SHA1_80inline: UDU4cW1pWmUzWENjTHVsbmUyNyt3RFF1WlYrOHRH.

Next, the audio device sends an ACK message to the second electronic device to notify the second electronic device that the audio device has received the 200 OK message. At this point, the audio device and the second electronic device establish a video call.

Next, the audio device instructs the first electronic device to transmit the video data to itself, and then forwards to the second electronic device, and forwards the video data received from the second electronic device to the first electronic device.

Optionally, similar to the first case, before the video data is sent, the video data may be compressed by a video media format supported by both parties, for example, by the compression processing of the H.264 codec standard, so the video transmitted between the devices is The data is compressed H264 video data.

Optionally, after receiving the video data sent by the first electronic device, the audio device may further display the video data on the display screen for image preview. Similarly, after receiving the video data sent by the second electronic device, the audio device can also display the video data on the display screen. In this way, the video data can be viewed through both the audio device and the first electronic device, and can be applied to a scene in which multiple people are together with the video.

Optionally, after the call ends, the audio device further sends a call end indication to the first electronic device to instruct the first electronic device to stop sending video data to the audio device. Then, after receiving the indication, the first electronic device turns off the camera and stops transmitting video data to the audio device.

Next, the execution process of the video communication method in the foregoing third case will be described. As shown in FIG. 7, it is a flowchart of the video communication method in this embodiment. As shown in FIG. 7, the method includes:

Step 301: The audio device acquires a first video parameter of the first electronic device, where the first video parameter includes the first The video media format supported by the child device, the IP address and port of the first electronic device;

Step 302: The audio device sends a video call request to the second electronic device, where the video call request includes a first audio parameter of the audio device, a first video parameter, and an IP address and port of the audio device, and an IP address of the audio device. And the port is configured to notify the second electronic device audio device of the IP address and port of the video data; the IP address and port of the first electronic device are used to notify the second electronic device audio device to send the IP address and port of the video data;

Step 303: The audio device receives a response message sent by the second electronic device, where the response message includes a second audio parameter and a second video parameter of the second electronic device, where the second video parameter includes a video media format supported by the second electronic device, The IP address and port of the second electronic device; the IP address and port of the second electronic device are used to indicate the IP address and port of the second electronic device to send and receive video data;

Step 304: The audio device sends a response message to the second electronic device to notify the second electronic device that the audio device has received the response message; the step is an optional step;

Step 305: The audio device sends a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send video data to the IP address and port of the second electronic device.

Step 306: The audio device monitors video data sent by the second electronic device to the IP address and port of the audio device.

Different from the foregoing first case, in the embodiment, the video data is directly transmitted by the first electronic device to the second electronic device, but the video data sent by the second electronic device is directly received by the audio device. Therefore, in step 302, the video call request needs to include the IP address and port of the audio device, and the IP address and port of the first electronic device. The IP address and port of the audio device are used to notify the second electronic device that the audio device receives the IP address and port of the audio data. The IP address and port of the first electronic device are used to notify the second electronic device that the audio device transmits the IP address and port of the audio data. Therefore, in step 306, the audio device itself listens for video data transmitted by the second electronic device to the IP address and port of the audio device. The implementation of the other parts is the same as the first case, and details are not described herein again.

As can be seen from the above description, in the present embodiment, the audio device can implement video communication by means of the video capability of the first electronic device. Further, since the first electronic device directly transmits the video data to the second electronic device, the first electronic device generally has a higher codec capability than the audio device, so the quality of the video data received by the second electronic device is higher. .

Optionally, after step 306, the audio device further forwards the received video data to the first electronic device, so that the video data sent by the second electronic device can also be displayed on the first electronic device. In this way, the video picture can be viewed through the audio device and the first electronic device at the same time.

Optionally, after the call ends, the audio device sends a call end indication to the first electronic device to instruct the first electronic device to stop sending the video data to the second electronic device.

The process of performing communication negotiation and video data transmission between the audio device and the second electronic device in this embodiment will be described below with reference to FIG.

First, the audio device sends an INVITE message to the second electronic device, the content of the message is as follows:

INVITE sip:*125@192.169.1.136 SIP/2.0

Via: SIP/2.0/UDP 192.166.1.252:5062;branch=z9hG4bK88078094

From:"556614"<sip:556614@192.169.1.136>;tag=564377066

To:<sip:*125@192.169.1.136>

Call-ID: 577212191@192.166.1.252

CSeq: 1 INVITE

Contact:<sip:556614@192.166.1.252:5062>

Content-Type: application/sdp

Max-Forwards: 70

User-Agent: Huawei eSpace 7850 2.60.94.24

Supported:replaces

Allow-Events: talk, hold, conference, refer, check-sync

Content-Length: xxx

V=0

o=huawei 23293 18 IN IP4 10.38.111.220

s=-

c=IN IP4 10.38.111.220

t=0 0

m=audio 11792 RTP/AVP 0 8 18 9 101

a=rtpmap:0 PCMU/8000

a=rtpmap:8 PCMA/8000

a=rtpmap:18 G729/8000

a=fmtp:18 annexb=no

a=rtpmap:9 G722/8000

a=fmtp:101 0-15

a=rtpmap:101 telephone-event/8000

a=ptime:20

m=video 10002 RTP/AVP 106

a=sendaddr: 10.174.5.56:10002//The IP address and port of the first electronic device, indicating the IP address and port of the audio device to send video data, and the video data is sent in one direction.

a=recvaddr: 10.38.111.220:10002//The IP address and port of the audio device, indicating the IP address and port of the audio device receiving video data, and one-way receiving of video data.

b=AS: 512

a=rtpmap:106 H264/90000

a=fmtp:106 profile-level-id=428028

a=label:11

As can be seen from the code segment, the IP address and port of the audio device receiving the video data are defined by a line a, which is the IP address and port of the audio device. The other line a defines the IP address and port of the audio device that sends the video data, which is the IP address and port of the first electronic device. The audio device notifies the second electronic device audio device of the IP address and port for transmitting and receiving video data by the two a lines.

After receiving the INVITE message, the second electronic device replies with a 200 OK message according to its own capabilities, and the content of the message is as follows:

SIP/2.0/UDP

10.174.4.63:5060;branch=z9hG4bK7x71w7bbx090rr9oiw37aw22yT01351

Record-Route:<sip:10.174.4.63:5060;transport=udp;lr>

Call-ID: asbchr1axxvxva1j2hjgja8aj3zz10jvvj2l@ATS.ats-2.home1.com.5

From:"02"<sip:+96628950006@home1.com>;tag=sbc0403ixg3hg0x-CC-5

To:<sip:+96628950005@home1.com>;tag=45vp5pvp

CSeq: 1 INVITE

Contact:<sip:+96628950005@10.174.198.171:5060;transport=udp>

Supported:replaces

Allow:

User-Agent: Huawei eSpace 8950 V200R003C00

Content-Length:700

Content-Type: application/sdp

V=0

o=huawei 23293 35 IN IP4 10.174.198.171

s=SBC call

c=IN IP4 10.174.198.171

t=0 0

m=audio 10000 RTP/SAVP 112 9 8 0 18 97 101

a=rtpmap:112 opus/48000

a=fmtp:112 maxcodedaudiobandwidth=48000

a=rtpmap:9 G722/16000

a=rtpmap:8 PCMA/8000

a=rtpmap:0 PCMU/8000

a=rtpmap:18 G729/8000

a=rtpmap:97 iLBC/8000

a=fmtp:97 mode=30

a=rtpmap:101 telephone-event/8000

a=fmtp:101 0-15

a=ptime:20

a=sendrecv

m=video 10002 RTP/SAVP 106

b=AS: 2048

a=rtpmap:106 H264/90000

a=fmtp:106 profile-level-id=428028

a=sendrecv//The IP address of the second electronic device is a two-way communication address, including communication of audio data and communication of video data

a=label:11

As can be seen from the code segment, in the 200 OK message, the IP address of the second electronic device is defined by the c line, and the port of the second electronic device is defined by the m line.

Optionally, when the second electronic device does not support directly receiving video data from the first electronic device, the second electronic device may reply the response message in the foregoing second case to the audio device.

After the audio device receives the 200 OK message in this embodiment, the ACK message may be sent to the second electronic device. So far, video communication has been established between the audio device and the second electronic device. Next, the audio device sends an OpenVideo message to the first electronic device according to the negotiated rule, to instruct the first electronic device to open the camera and collect the video data, and directly send the collected video data to the second electronic device. The audio device then listens to the video data sent by the second electronic device to the IP address and port of the audio device. Specifically, the audio device listens to the IP address of the second electronic device and the video data sent by the port to the IP address and port of the audio device.

Optionally, the audio device further forwards the received video data to the first electronic device.

Optionally, the video data may be H264 video data compressed by the H.264 standard supported by both parties.

Based on the same inventive concept, with reference to FIG. 9, a functional block diagram of a video communication apparatus according to an embodiment of the present application is provided. The video communication device includes an acquisition unit 401, a transmission unit 402, and a reception unit 403.

Optionally, the video communication device can be used to implement at least one of the video communication methods shown in FIG. 3, FIG. 5, and FIG. The specific configuration can be determined according to actual needs.

Optionally, when the video communication device is implemented by using software, it may be a stand-alone application or a module of other applications.

Specifically, when the video communication device is used to implement the video communication method of FIG. 3, the acquiring unit may be used to implement step 101 of the method shown in FIG. The transmitting unit 402 can be used to implement step 102, step 104, and step 105 of the method shown in FIG. The receiving unit 403 can be used to implement step 103 of the method shown in FIG.

Optionally, the sending unit 402 is further configured to send a call end indication to the first electronic device after the end of the call, to instruct the first electronic device to stop sending video to the IP address and port of the second electronic device. And monitoring video data sent by the second electronic device to an IP address and port of the first electronic device.

Specifically, when the video communication device is used to implement the video communication method of FIG. 5, the acquiring unit may be used to implement step 201 of the method shown in FIG. 5. The sending unit 402 can be used to implement step 202, step 204 to step 206, and step 208 of the method shown in FIG. The receiving unit 403 can be used to implement

steps

203 and 207 of the method shown in FIG.

Optionally, the sending unit 402 is further configured to: after the end of the call, send a call end indication to the first electronic device, to instruct the first electronic device to stop sending video data to the audio device.

Specifically, when the video communication device is used to implement the video communication method of the present invention, the acquiring unit may be used to implement step 301 of the method shown in FIG. 7. The sending unit 402 can be used to implement step 302, step 304 and step 305 of the method shown in FIG. The receiving unit 403 can be used to implement

steps

303 and 306 of the method shown in FIG.

Optionally, the sending unit 402 is further configured to: after the end of the call, send a call end indication to the first electronic device, to instruct the first electronic device to stop sending video data to the second electronic device.

The various changes and specific examples in the video communication method in the foregoing embodiments shown in FIG. 3, FIG. 5 and FIG. 7 are also applicable to the video communication device of the present embodiment. Through the foregoing detailed description of the video communication method, Field technician The implementation method of the video communication apparatus in this embodiment can be clearly understood, so that the details of the description will not be described in detail herein.

Based on the same inventive concept, with reference to FIG. 10, it is a structural block diagram of an audio device according to an embodiment of the present application. The audio device includes a processor 501, a transmitter 502, a receiver 503, a memory 504, and an audio component 505. The processor 501 may be a general-purpose central processing unit (CPU), may be an application specific integrated circuit (ASIC), and may be one or more integrated circuits for controlling program execution. The number of memories 504 can be one or more. The memory 504 may include a read only memory (English: Read Only Memory, ROM for short), a random access memory (English: Random Access Memory, RAM for short), and a disk storage. The memory 504, the receiver 503, and the transmitter 502 are connected to the processor 501 via a bus. The receiver 503 and the transmitter 502 are configured to perform network communication with an external device, and specifically communicate with an external device through a network such as an Ethernet, a wireless access network, or a wireless local area network. Receiver 503 and transmitter 502 may be physically separate components or may be physically identical components. The audio component 505 can include an earpiece, a speaker, a microphone, and the like.

Optionally, the processor 501 is configured to process daily transactions of the audio device, and the memory 504 is configured to store data required by the processor 501. Further, the memory 504 is also used to store the address book.

Optionally, the processor 501 is further configured to perform video data encoding and decoding and audio data encoding and decoding.

Optionally, the audio device may be used to implement at least one of the video communication methods shown in FIG. 3, FIG. 5, and FIG. The specific configuration can be determined according to actual needs.

Specifically, when the audio device is used to implement the video communication method of FIG. 3, the receiver 503 is configured to acquire a first video parameter of the first electronic device, where the first video parameter includes the first electronic component. a video media format supported by the device, a network protocol IP address and a port of the first electronic device; the first electronic device and the audio device are paired.

The transmitter 502 is configured to send a video call request to the second electronic device, where the video call request includes the first audio parameter of the audio device and the first video parameter.

The receiver 503 is further configured to: receive a response message sent by the second electronic device, where the response message includes a second audio parameter and a second video parameter of the second electronic device, where the second video parameter includes The video media format supported by the second electronic device, the IP address and port of the second electronic device.

Optionally, the sender 502 is further configured to: send a response message to the second electronic device, to notify the second electronic device that the audio device has received the response message;

The transmitter 502 is further configured to: send a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send video data to an IP address and a port of the second electronic device, And starting to monitor video data sent by the second electronic device to the IP address and port of the first electronic device.

Optionally, the transmitter 502 is further configured to send a call end indication to the first electronic device after the end of the call, to instruct the first electronic device to stop sending video to the IP address and port of the second electronic device. And monitoring video data sent by the second electronic device to an IP address and port of the first electronic device.

Specifically, when the audio device is used to implement the video communication method of the present invention, the receiver 503 is configured to acquire a first video parameter of the first electronic device, where the first video parameter includes the first a video media format supported by the electronic device; the first electronic device and the audio device are paired.

a transmitter 502, configured to send a video call request to the second electronic device, where the video call request includes a first audio parameter of the audio device, the first video parameter, and a network protocol IP of the audio device Address and port.

The transmitter 502 is further configured to: send a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send video data to the audio device; to the second electronic device Transmitting video data received from the first electronic device.

The receiver 503 is further configured to: monitor video data sent by the second electronic device to an IP address and a port of the audio device.

The transmitter 502 is further configured to: forward the video data sent by the second electronic device to the first electronic device.

Optionally, the transmitter 502 is further configured to: after the end of the call, send a call end indication to the first electronic device, to instruct the first electronic device to stop sending video data to the audio device.

Specifically, when the audio device is used to implement the video communication method of the present invention, the receiver 503 is configured to acquire a first video parameter of the first electronic device, where the first video parameter includes the first a video media format supported by the electronic device, a network protocol IP address and a port of the first electronic device; the first electronic device and the audio device are paired.

a transmitter 502, configured to send a video call request to the second electronic device, where the video call request includes a first audio parameter of the audio device, the first video parameter, and an IP address of the audio device port.

The transmitter 502 is further configured to: send a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send video data to an IP address and a port of the second electronic device.

Optionally, the transmitter 502 is further configured to: after the end of the call, send a call end indication to the first electronic device, Instructing the first electronic device to stop transmitting video data to the second electronic device.

The various changes and specific examples in the video communication method in the foregoing embodiments shown in FIG. 3, FIG. 5 and FIG. 7 are also applicable to the audio device of the embodiment, and the foregoing detailed description of the video communication method is in the field. The implementation method of the audio device in this embodiment can be clearly understood by the skilled person, so that the details of the specification will not be described in detail herein.

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.

The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

It is apparent that those skilled in the art can make various modifications and variations to the invention without departing from the spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and modifications of the invention

Claims

A video communication method, comprising:

Obtaining, by the audio device, a first video parameter of the first electronic device, where the first video parameter includes a video media format supported by the first electronic device, a network protocol IP address and a port of the first electronic device, and the first The electronic device is paired with the audio device;

Transmitting, by the audio device, a video call request to the second electronic device, where the video call request includes a first audio parameter of the audio device and the first video parameter;

Receiving, by the audio device, a response message sent by the second electronic device; the response message includes a second audio parameter and a second video parameter of the second electronic device; and the second video parameter includes the second a video media format supported by the electronic device, an IP address and a port of the second electronic device;

Transmitting, by the audio device, a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send video data to an IP address and a port of the second electronic device, and start monitoring Video data sent by the second electronic device to an IP address and a port of the first electronic device.
The method of claim 1 wherein the method further comprises:

After the call ends, the audio device sends a call end indication to the first electronic device to instruct the first electronic device to stop sending video data to the IP address and port of the second electronic device and to listen to the first Video data transmitted by the second electronic device to the IP address and port of the first electronic device.
The method according to claim 1 or 2, wherein the video call request is a request conforming to a Session Initiation Protocol SIP, and in the video call request, the IP address of the first electronic device is defined by c lines. Defining a port of the first electronic device by m rows, and defining a video media format supported by the first electronic device by a row;

The response message is a message conforming to the SIP, in the response message, the IP address of the second electronic device is defined by c lines, and the port of the second electronic device is defined by m lines, defined by a line a video media format supported by the second electronic device.
A video communication method, comprising:

Obtaining, by the audio device, a first video parameter of the first electronic device, where the first video parameter includes a video media format supported by the first electronic device; the first electronic device is paired with the audio device;

Transmitting, by the audio device, a video call request to a second electronic device, where the video call request includes a first audio parameter of the audio device, the first video parameter, and a network protocol IP address of the audio device port;

Receiving, by the audio device, a response message sent by the second electronic device; the response message includes a second audio parameter and a second video parameter of the second electronic device, where the second video parameter includes the second a video media format supported by the electronic device, an IP address and a port of the second electronic device;

Transmitting, by the audio device, a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send video data to the audio device;

Transmitting, by the audio device, video data received from the first electronic device to the second electronic device;

The audio device monitors video data sent by the second electronic device to an IP address and a port of the audio device;

The audio device forwards video data sent by the second electronic device to the first electronic device.
The method of claim 4, wherein the method further comprises:

After the call ends, the audio device transmits a call end indication to the first electronic device to instruct the first electronic device to stop transmitting video data to the audio device.
The method according to claim 4 or 5, wherein the video call request is a request conforming to a Session Initiation Protocol (SIP), in which the IP address of the audio device is defined by c lines, The m line defines the port of the audio device, and the video media format supported by the first electronic device is defined by a line.
A video communication method, comprising:

Obtaining, by the audio device, a first video parameter of the first electronic device, where the first video parameter includes a video media format supported by the first electronic device, a network protocol IP address and a port of the first electronic device, and the first The electronic device is paired with the audio device;

Transmitting, by the audio device, a video call request to the second electronic device, where the video call request includes a first audio parameter of the audio device, the first video parameter, and an IP address and a port of the audio device;

Receiving, by the audio device, a response message sent by the second electronic device; the response message includes a second audio parameter and a second video parameter of the second electronic device, where the second video parameter includes the second a video media format supported by the electronic device, an IP address and a port of the second electronic device;

Transmitting, by the audio device, a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send video data to an IP address and a port of the second electronic device;

The audio device listens to video data sent by the second electronic device to an IP address and port of the audio device.
The method of claim 7 wherein the method further comprises:

After the call ends, the audio device sends a call end indication to the first electronic device to instruct the first electronic device to stop transmitting video data to the second electronic device.
The method according to claim 7 or 8, wherein the video call request is a request conforming to a Session Initiation Protocol SIP, and in the video call request, an IP address of the audio device is defined by a line a and a port, defining an IP address and a port of the first electronic device by another a line;

The response message is a message conforming to the SIP, and in the response message, the IP address of the second electronic device is defined by c lines, and the port of the second electronic device is defined by m lines.
A video communication device, comprising:

An acquiring unit, configured to acquire a first video parameter of the first electronic device, where the first video parameter includes a video media format supported by the first electronic device, a network protocol IP address and a port of the first electronic device; The first electronic device and the audio device are paired and connected;

a sending unit, configured to send a video call request to the second electronic device, where the video call request includes Determining a first audio parameter of the audio device and the first video parameter;

a receiving unit, configured to receive a response message sent by the second electronic device, where the response message includes a second audio parameter and a second video parameter of the second electronic device;

The sending unit is further configured to: send a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send video data to an IP address and a port of the second electronic device And initiating monitoring of video data sent by the second electronic device to an IP address and a port of the first electronic device.
The device according to claim 10, wherein the sending unit is further configured to: after the end of the call, send a call end indication to the first electronic device to instruct the first electronic device to stop The IP address and port of the second electronic device transmit video data and listen to video data sent by the second electronic device to an IP address and port of the first electronic device.
The apparatus according to claim 10 or 11, wherein the video call request is a request conforming to a Session Initiation Protocol SIP, and in the video call request, the IP address of the first electronic device is defined by c lines. Defining a port of the first electronic device by m rows, and defining a video media format supported by the first electronic device by a row;

The response message is a message conforming to the SIP, in the response message, the IP address of the second electronic device is defined by c lines, and the port of the second electronic device is defined by m lines, defined by a line a video media format supported by the second electronic device.
A video communication device, comprising:

An acquiring unit, configured to acquire a first video parameter of the first electronic device, where the first video parameter includes a video media format supported by the first electronic device; the first electronic device and the audio device are paired with each other;

a sending unit, configured to send a video call request to the second electronic device, where the video call request includes a first audio parameter of the audio device, the first video parameter, and a network protocol IP address of the audio device And port;

a receiving unit, configured to receive a response message sent by the second electronic device, where the response message includes a second audio parameter and a second video parameter of the second electronic device, where the second video parameter includes the a video media format supported by the second electronic device, an IP address and a port of the second electronic device;

The sending unit is further configured to: send a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send video data to the audio device; to the second electronic The device transmits video data received from the first electronic device;

The receiving unit is further configured to: monitor video data sent by the second electronic device to an IP address and a port of the audio device;

The sending unit is further configured to: forward the video data sent by the second electronic device to the first electronic device.
The device according to claim 13, wherein the sending unit is further configured to: after the call ends, send a call end indication to the first electronic device to instruct the first electronic device to stop The audio device sends video data.
The apparatus according to claim 13 or 14, wherein said video call request is in accordance with a session initial a request of the protocol SIP, in the video call request, the IP address of the audio device is defined by c lines, the port of the audio device is defined by m lines, and the video media supported by the first electronic device is defined by a line format.
A video communication device, comprising:

An acquiring unit, configured to acquire a first video parameter of the first electronic device, where the first video parameter includes a video media format supported by the first electronic device, a network protocol IP address and a port of the first electronic device; The first electronic device and the audio device are paired and connected;

a sending unit, configured to send a video call request to the second electronic device, where the video call request includes a first audio parameter of the audio device, the first video parameter, and an IP address and port of the audio device ;

a receiving unit, configured to receive a response message sent by the second electronic device, where the response message includes a second audio parameter and a second video parameter of the second electronic device, where the second video parameter includes the a video media format supported by the second electronic device, an IP address and a port of the second electronic device;

The sending unit is further configured to: send a call indication including the second video parameter to the first electronic device, to instruct the first electronic device to send video data to an IP address and a port of the second electronic device ;

The receiving unit is further configured to: monitor video data sent by the second electronic device to an IP address and a port of the audio device.
The device according to claim 16, wherein the sending unit is further configured to: after the end of the call, send a call end indication to the first electronic device to instruct the first electronic device to stop The second electronic device transmits the video data.
The apparatus according to claim 16 or 17, wherein said video call request is a request conforming to a Session Initiation Protocol SIP, and in said video call request, an IP address of said audio device is defined by a line a and a port, defining an IP address and a port of the first electronic device by another a line;

The response message is a message conforming to the SIP, and in the response message, the IP address of the second electronic device is defined by c lines, and the port of the second electronic device is defined by m lines.