CN115150369A - Audio and video proxy method and audio and video proxy container - Google Patents
Audio and video proxy method and audio and video proxy container Download PDFInfo
- Publication number
- CN115150369A CN115150369A CN202210764128.XA CN202210764128A CN115150369A CN 115150369 A CN115150369 A CN 115150369A CN 202210764128 A CN202210764128 A CN 202210764128A CN 115150369 A CN115150369 A CN 115150369A
- Authority
- CN
- China
- Prior art keywords
- audio
- video
- transmission channel
- container
- proxy container
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 73
- 230000005540 biological transmission Effects 0.000 claims abstract description 271
- 238000013507 mapping Methods 0.000 claims description 36
- 238000004590 computer program Methods 0.000 claims description 8
- 238000011161 development Methods 0.000 abstract description 7
- 238000012423 maintenance Methods 0.000 abstract description 7
- 230000008569 process Effects 0.000 description 23
- 238000012544 monitoring process Methods 0.000 description 20
- 238000004891 communication Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 230000011664 signaling Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000012806 monitoring device Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Security & Cryptography (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application provides an audio and video proxy method, an audio and video proxy container, a system, a gateway device and a computer readable storage medium, wherein the method is applied to the audio and video proxy container deployed on the gateway device, a plurality of transmission channel protocols and data transmission protocols are preset in the audio and video proxy container, and the method comprises the following steps: acquiring an audio and video acquisition request initiated to a second device by a first device; establishing a transmission channel based on the audio and video acquisition request and a transmission channel protocol supported by the audio and video proxy container; the transmission channel is used for realizing data transmission between the first device and the second device; and audio and video stream transmission is carried out according to the data transmission protocols supported by the transmission channel and the audio and video agent container, so that the problems of higher development and operation and maintenance cost and higher difficulty in realizing audio and video stream transmission due to difference of the transmission protocols supported by different equipment are solved.
Description
Technical Field
The present application relates to the field of multimedia data processing, and in particular, to an audio/video proxy method, an audio/video proxy container, a system, a gateway device, and a computer-readable storage medium.
Background
In practical application scenarios, audio and Video stream transmission mainly occurs between a monitoring platform and a monitoring device (such as a camera, a Network Video Recorder (Network Video Recorder, NVR), etc.), between the monitoring platform and the monitoring platform, and between the terminal device (e.g., mobile phone terminal, smart watch, tablet computer, etc.) and the monitoring platform. Due to the difference of transmission protocols supported by different types of monitoring platforms, monitoring devices and terminal devices, corresponding codes need to be developed independently for each application scene in the process of audio/video stream transmission to realize audio/video stream transmission, so that the development, operation and maintenance costs are high, and the difficulty is high.
Disclosure of Invention
An object of the embodiments of the present application is to provide an audio/video proxy method, an audio/video proxy container, a system, a gateway device, and a computer-readable storage medium, so as to solve the problems of high development and operation and maintenance costs and high difficulty in implementing audio/video stream transmission due to differences in transmission protocols supported by different devices.
In a first aspect, the present invention provides an audio/video proxy method, which is applied to an audio/video proxy container deployed on a gateway device, where multiple transmission channel protocols and data transmission protocols are preset in the audio/video proxy container, and the method includes: acquiring an audio and video acquisition request initiated to a second device by a first device; establishing a transmission channel based on the audio and video acquisition request and a transmission channel protocol supported by the audio and video proxy container; the transmission channel is used for realizing data transmission between the first device and the second device; and transmitting audio and video stream according to the transmission channel and the data transmission protocol supported by the audio and video proxy container.
In the implementation process, because a plurality of transmission channel protocols and data transmission protocols are preset in the audio/video proxy container, the audio/video proxy container is deployed on the gateway device, and the transmission channel protocols and the data transmission protocols are determined by the audio/video proxy container according to the audio/video acquisition request, so that the transmission of audio/video streams between the first device and the second device is realized, the transmission of the audio/video streams can be realized without independently developing and maintaining corresponding codes for various application scenes, and the problems of high development and operation and maintenance cost and high difficulty are solved.
In an optional embodiment, a first mapping relationship between different port numbers and multiple transmission channel protocols is preset in the audio/video proxy container, and the establishing a transmission channel based on the audio/video acquisition request and the transmission channel protocol supported by the audio/video proxy container includes: determining a target transmission channel protocol according to the port number corresponding to the audio and video acquisition request and the first mapping relation; according to the target transmission channel and protocol establishing the transmission channel.
In the implementation process, the audio/video proxy container determines a target transmission channel protocol supported by the first device according to the port number corresponding to the audio/video acquisition request and the first mapping relation, and then establishes a transmission channel according to the target transmission channel protocol. By the method, the target transmission channel protocol supported by the first device can be determined by analyzing the port number corresponding to the audio and video acquisition request without the need of pre-designating the target transmission channel protocol supported by the first device by a user, and the applicability of the audio and video proxy method is improved.
In an optional embodiment, a second mapping relationship between different values of a first field and multiple data transmission protocols is preset in the audio/video proxy container, and the audio/video stream transmission according to the transmission channel and the data transmission protocols supported by the audio/video proxy container includes: determining a target data transmission protocol according to the value of the first field in the audio and video acquisition request and the second mapping relation; and transmitting the audio and video stream based on the target data transmission protocol according to the transmission channel.
In the implementation process, the audio/video proxy container determines a target data transmission protocol according to the value of the first field in the audio/video acquisition request and the second mapping relation, and then transmits the audio/video stream based on the target data transmission protocol according to the transmission channel. By the method, a user does not need to specify a target data transmission protocol supported by the first device in advance, the target data transmission protocol supported by the first device can be determined by analyzing the value of the first field in the audio and video acquisition request, and the applicability of the audio and video proxy method is improved.
In an optional embodiment, before the establishing a transmission channel based on the audio/video acquisition request and a transmission channel protocol supported by the audio/video proxy container, the method further includes: and performing identity authentication on the first equipment according to an identity authentication protocol preset in the audio/video proxy container, and determining that the first equipment passes the identity authentication.
In the implementation process, before the transmission channel is established, the identity authentication is carried out on the first device according to an identity authentication protocol preset in the audio/video proxy container, and when the first device passes the identity authentication, the transmission channel is established. By the method, malicious access or network attack can be effectively avoided, and the safety of audio and video stream data exchange is improved.
In a second aspect, the present invention provides an audio/video proxy container, where the audio/video proxy container is deployed on a gateway device, multiple transmission channel protocols and data transmission protocols are preset in the audio/video proxy container, and the audio/video proxy container is used to obtain an audio/video acquisition request initiated by a first device to a second device; establishing a transmission channel based on the audio and video acquisition request and a transmission channel protocol supported by the audio and video proxy container; the transmission channel is used for realizing data transmission between the first device and the second device; and audio and video stream transmission is carried out according to the data transmission protocol supported by the transmission channel and the audio and video proxy container.
In an optional embodiment, the audio-video proxy container includes: the acquisition module is used for acquiring an audio and video acquisition request initiated by the first equipment to the second equipment; the establishing module is used for establishing a transmission channel based on the audio and video acquisition request; the transmission channel is used for realizing data transmission between the first device and the second device; and the transmission module is used for transmitting audio and video stream according to the transmission channel.
In an optional embodiment, a first mapping relationship between different port numbers and multiple transmission channel protocols is preset in the audio/video proxy container, and the establishing module is specifically configured to determine a target transmission channel protocol according to the port number corresponding to the audio/video acquisition request and the first mapping relationship; and establishing the transmission channel according to the target transmission channel protocol.
In an optional embodiment, a second mapping relationship between different values of the first field and multiple data transmission protocols is preset in the audio/video proxy container, and the transmission module is specifically configured to determine a target data transmission protocol according to the value of the first field in the audio/video acquisition request and the second mapping relationship; and transmitting the audio and video stream based on the target data transmission protocol according to the transmission channel.
In an optional embodiment, the audio/video proxy container further includes an authentication module, configured to perform identity authentication on the first device according to an identity authentication protocol preset in the audio/video proxy container before the transmission channel is established based on the audio/video acquisition request and a transmission channel protocol supported by the audio/video proxy container, and determine that the first device passes the identity authentication.
In an optional embodiment, the audio-video proxy container includes: the first sub-container is configured to acquire an audio and video acquisition request initiated by the first device to the second device; the second sub-container is configured to establish a transmission channel based on the audio and video acquisition request; the transmission channel is used for realizing data transmission between the first device and the second device; the third sub-container is configured to carry out audio and video stream transmission according to the transmission channel; wherein the second sub-container is configured to invoke the first sub-container and the third sub-container is configured to invoke the second sub-container.
In an optional embodiment, a first mapping relationship between different port numbers and multiple transmission channel protocols is preset in the audio/video proxy container, and the second sub-container is specifically configured to determine a target transmission channel protocol according to the port number corresponding to the audio/video acquisition request and the first mapping relationship; and establishing the transmission channel according to the target transmission channel protocol.
In an optional embodiment, a second mapping relationship between different values of the first field and multiple data transmission protocols is preset in the audio/video proxy container, and the third sub-container is specifically configured to determine a target data transmission protocol according to the value of the first field in the audio/video acquisition request and the second mapping relationship; and transmitting the audio and video stream based on the target data transmission protocol according to the transmission channel.
In an optional embodiment, the audio/video proxy container further includes a fourth sub-container configured to perform, before the transmission channel is established based on the audio/video acquisition request and a transmission channel protocol supported by the audio/video proxy container, identity authentication on the first device according to an identity authentication protocol preset in the audio/video proxy container, and determine that the first device passes the identity authentication.
In the implementation process, the audio/video agent container is composed of a plurality of sub-containers, and the problem that when the audio/video agent container needs to realize more functions, the image file corresponding to the audio/video agent container is very large, and the audio/video agent container is inconvenient to expand subsequently is solved. By the method, the expansibility of the audio and video proxy container can be effectively improved.
In a third aspect, the present invention provides an audio/video proxy system, including: a first device; a second device; the gateway device is arranged between the first device and the second device and is respectively connected with the first device and the second device, and an audio and video proxy container is deployed on the gateway device and used for executing the method according to any one of the preceding embodiments.
In a fourth aspect, the present invention provides a gateway device, where an audio and video proxy container is deployed on the gateway device, and the gateway device includes: a processor, a memory, and a bus; the processor and the memory are communicated with each other through the bus; the memory stores computer program instructions executable by the processor, the processor invoking the computer program instructions to perform the method of any of the preceding embodiments.
In a fifth aspect, the present invention provides a computer readable storage medium storing computer program instructions which, when executed by a computer, cause the computer to perform a method according to any one of the preceding embodiments.
Drawings
To more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
Fig. 1 is a block diagram of a structure of an audio/video proxy system according to an embodiment of the present disclosure;
fig. 2 is a flowchart of an audio/video proxy method according to an embodiment of the present application;
fig. 3 is a block diagram illustrating a structure of an audio/video proxy container according to an embodiment of the present disclosure;
fig. 4 is a block diagram of another structure of an audio/video proxy container according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of a gateway device 500 according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.
The embodiment of the application provides an audio and video proxy method, an audio and video proxy container, a system, a gateway device and a computer readable storage medium, which are used for solving the problems of higher development and operation and maintenance costs and higher difficulty in realizing audio and video stream transmission due to the difference of transmission protocols supported by different devices.
Referring to fig. 1, fig. 1 is a block diagram of an audio/video proxy system according to an embodiment of the present disclosure. The audio/video proxy system 100 may include: a first device 101, a second device 102 and a gateway device 103. The gateway device 103 is disposed between the first device 101 and the second device 102, and is connected to both of them.
The first device 101 sends an audio/video acquisition request to the second device 102, the audio/video acquisition request is forwarded to the second device 102 through the gateway device 103, and after receiving the audio/video acquisition request forwarded by the gateway device 103, the second device 102 forwards the corresponding audio/video stream to the first device 101 through the gateway device 103.
It is understood that in different application scenarios, the first device 101 and the second device 102 are different devices.
In some embodiments, the first device 101 is a monitoring platform, and the monitoring platform may be a computer terminal, a cloud platform, a server, or the like; the second device 102 is a monitoring device, which may be: cameras, network video recorders and the like. And the user sends an audio and video acquisition request to the monitoring equipment through the monitoring platform to acquire the audio and video stream information acquired by the monitoring equipment.
In other embodiments, the first device 101 is a mobile terminal, such as: a mobile phone terminal, a smart watch, a tablet computer, and the like, and the second device 102 is a monitoring platform. In the application scenario, the monitoring platform stores audio and video stream information, and a user sends an audio and video acquisition request to the monitoring platform through the mobile terminal to acquire the audio and video stream information stored in the monitoring platform.
In other embodiments, the first device 101 and the second device 102 are both monitoring platforms. It can be understood that in this application scenario, the information intercommunication of the audio and video streams is required between different monitoring platforms. For example, the first device 101 is a provincial road information monitoring platform, the second device 102 is a city road information monitoring platform, and a user sends an audio/video acquisition request on the provincial road information monitoring platform to acquire audio/video stream information stored in the city road information monitoring platform.
It should be noted that the foregoing is only illustrative of some specific examples provided by the embodiments of the present application, and the present application is not limited thereto.
Gateway device 103 may be a firewall, a VPN server, a hyper-convergence server, etc.
Due to the difference between the transmission protocols supported by the first device 101 and the second device 102 of different types, in the process of transmitting the audio/video stream, corresponding codes need to be separately developed for each application scenario to realize the audio/video stream transmission, which results in higher development, operation and maintenance costs and higher difficulty. Based on this, the embodiment of the present application provides an audio/video proxy method to solve the above problem.
Referring to fig. 2, fig. 2 is a flowchart of an audio/video proxy method provided in an embodiment of the present application, where the audio/video proxy method is applied to an audio/video proxy container deployed on a gateway device, and the audio/video proxy method includes:
step S201: and acquiring an audio and video acquisition request initiated to the second equipment by the first equipment.
Step S202: and establishing a transmission channel based on the audio and video acquisition request and the transmission channel protocol supported by the audio and video proxy container.
Step S203: and audio and video stream transmission is carried out according to the data transmission protocol supported by the transmission channel and the audio and video proxy container.
In the embodiment of the application, a plurality of transmission channel protocols and data transmission protocols are preset in the audio/video proxy container, and the preset transmission channel protocols and data transmission protocols can be configured in advance according to an application scene. The method comprises the steps that an audio and video proxy container is deployed on a gateway device between a first device and a second device, the audio and video proxy container firstly obtains an audio and video obtaining request initiated by the first device to the second device from the gateway device, a transmission channel is established from a transmission channel protocol supported by the audio and video proxy container based on the audio and video obtaining request, and then audio and video stream transmission is carried out according to the established transmission channel and a data transmission protocol supported by the audio and video proxy container.
In summary, because a plurality of transmission channel protocols and data transmission protocols are preset in the audio/video proxy container, the audio/video proxy container is deployed on the gateway device, and the transmission channel protocols and the data transmission protocols are determined by the audio/video proxy container according to the audio/video acquisition request, so that the audio/video stream is transmitted between the first device and the second device, the audio/video stream transmission can be realized without independently developing and maintaining corresponding codes for various application scenes, and the problems of high development and operation and maintenance cost and high difficulty are solved.
The above steps are described in detail below.
Step S201: and acquiring an audio and video acquisition request initiated by the first device to the second device.
In this embodiment of the application, the gateway device 103 has an operating environment of the container, and the operating environment may be: docker, runC, etc., which the present application does not specifically limit. And installing an image file for realizing the audio/video proxy in the operating environment of the container to generate an audio/video proxy container.
When the first device 101 sends an audio/video acquisition request to the second device 102, the first device 101 first sends the audio/video acquisition request to the gateway device 103. After receiving the audio/video acquisition request, the gateway device 103 sends the audio/video acquisition request to the audio/video proxy container.
Step S202: and establishing a transmission channel based on the audio and video acquisition request and a transmission channel protocol supported by the audio and video proxy container.
In the embodiment of the application, after receiving the audio and video acquisition request, the audio and video proxy container can determine a transmission channel protocol supported by the first device which sends the audio and video acquisition request according to the identification information in the audio and video acquisition request. Because a plurality of transmission channel protocols are preset in the audio/video proxy container in advance, and selecting a transmission channel protocol supported by the first equipment from a plurality of preset transmission channel protocols to establish the transmission channel. The transmission channel is used for realizing data transmission between the first device and the second device.
The transmission channel protocol may be: SIP protocol, RTSP protocol, h.225 protocol, h.245 protocol, etc., which should not be construed as a limitation herein.
As an alternative implementation, step S202 may include the following steps:
determining a target transmission channel protocol according to the port number corresponding to the audio/video acquisition request and the first mapping relation;
and establishing a transmission channel according to the target transmission channel protocol.
In the embodiment of the application, a first mapping relation between different port numbers and multiple transmission channel protocols is preset in the audio/video proxy container. For example, the first mapping relationship is: the port number A corresponds to the transmission channel protocol X, the port number B corresponds to the transmission channel protocol Y, and the port number C corresponds to the transmission channel protocol Z.
And the audio and video proxy container determines a target transmission channel protocol supported by the first equipment according to the port number corresponding to the audio and video acquisition request and the first mapping relation, and further establishes a transmission channel according to the target transmission channel protocol.
It can be understood that the specific ways of establishing a transmission channel according to different transmission channel protocols are different, the specific ways of establishing a transmission channel according to a target transmission channel protocol are not limited in the present application, and the specific process of establishing a transmission channel according to a target transmission channel protocol may refer to the prior art, which is not described herein in detail.
In some other embodiments, a transmission channel protocol field may be set in the audio/video acquisition request, where the transmission channel protocol field represents, by different values, a transmission channel protocol supported by the first device. The audio/video proxy container is preset with the mapping relation between different values in the transmission channel protocol field and various transmission channel protocols, determines the target transmission channel protocol according to the mapping relation, and further establishes the transmission channel according to the target transmission channel protocol.
Step S203: and audio and video stream transmission is carried out according to the data transmission protocol supported by the transmission channel and the audio and video proxy container.
In the embodiment of the application, because different data transmission protocols supported by different first devices are different, in order to support different data transmission protocols, multiple data transmission protocols are preset in the audio/video proxy container. After the transmission channel is established, a data transmission protocol supported by the first device is selected from a plurality of preset data transmission protocols in the audio/video proxy container, and audio/video stream transmission is carried out according to the transmission channel and the data transmission protocol supported by the first device, so that the audio/video proxy is realized.
The data transmission protocol may be: RTP/RTCP protocol, RTMP protocol, etc., which should not be construed as a limitation.
As an alternative implementation, step S203 may include the following steps:
determining a target data transmission protocol according to the value of the first field in the audio/video acquisition request and the second mapping relation;
and transmitting the audio and video stream based on a target data transmission protocol according to the transmission channel.
In the embodiment of the application, the audio and video acquisition request sent by the first device comprises a first field. The first field is used to characterize a data transmission protocol supported by the first device. And a second mapping relation between different values of the first field and various data transmission protocols is preset in the audio/video proxy container. For example, the second mapping relationship is: the value of the first field is D corresponding to the data transmission protocol M, the value of the first field is E corresponding to the data transmission protocol N, and the value of the first field is F corresponding to the data transmission protocol O.
And the audio and video proxy container determines a target data transmission protocol supported by the first device according to the value of the first field in the audio and video acquisition request and the second mapping relation, and then transmits the audio and video stream based on the target data transmission protocol according to the transmission channel.
It can be understood that the specific manner of transmitting the audio/video stream based on different data transmission protocols is different, the specific manner of transmitting the audio/video stream based on different data transmission protocols is not limited in the present application, and the specific process of transmitting the audio/video stream based on the target data transmission protocol according to the transmission channel may refer to the prior art, which is not described herein in detail.
Further, the audio/video proxy method provided by the embodiment of the present application further includes:
in the process of transmitting the audio and video stream, the SDP protocol is called to describe the information of the format, the quantity, the length, the coding information and the like of the media file of the audio and video stream.
It should be noted that, in the actual audio stream transmission process, the media file format of the audio/video stream, the number of the audio/video stream, the length of the audio/video stream, the encoding information of the audio/video stream, and other contents may be described in association with each other by using the SDP protocol. Therefore, the audio/video proxy container can also be pre-configured with an SDP protocol, and the SDP protocol is called to describe information such as the format, the quantity, the length, the coding information and the like of the media file of the audio/video stream in the process of transmitting the audio/video stream.
Further, before the step S202, the audio/video proxy method provided in the embodiment of the present application further includes:
and performing identity authentication on the first equipment according to an identity authentication protocol preset in the audio/video proxy container, and determining that the first equipment passes the identity authentication.
In the embodiment of the application, in order to avoid malicious access or network attack and improve the security of audio and video stream data exchange, an identity authentication protocol is preset in the audio and video proxy container. Before a transmission channel is established based on the audio/video acquisition request and a transmission channel protocol supported by the audio/video proxy container (step S202), the audio/video proxy container performs identity authentication on first equipment according to a preset identity authentication protocol, and if the first equipment passes the identity authentication, the steps S202-S203 are executed; and if the first equipment does not pass the identity authentication, not responding to the audio and video acquisition request initiated by the first equipment to the second equipment.
Alternatively, the authentication protocol may be Secure Sockets Layer (SSL), transport Layer Security (TLS), or the like. It should be noted that the SSL protocol and the TLS protocol are only two examples provided in the embodiment of the present application, and the identity authentication protocol may also be other secure transmission protocols, which is not specifically limited in the present application.
Based on the same inventive concept, the embodiment of the application also provides an audio and video proxy container. The audio and video proxy container is deployed on the gateway equipment, and a plurality of transmission channel protocols and data transmission protocols are preset in the audio and video proxy container. The audio proxy container is used for realizing the audio and video proxy method.
It should be noted that there are various implementations of the audio/video proxy container, and two implementations of the audio/video proxy container are provided below.
The first method comprises the following steps:
referring to fig. 3, fig. 3 is a block diagram of an audio/video proxy container according to an embodiment of the present disclosure. The audio-video proxy container 300 may include:
an obtaining module 301, configured to obtain an audio/video obtaining request initiated by a first device to a second device;
an establishing module 302, configured to establish a transmission channel based on the audio/video acquisition request; the transmission channel is used for realizing data transmission between the first device and the second device;
and the transmission module 303 is configured to perform audio/video stream transmission according to the transmission channel.
In an optional embodiment, a first mapping relationship between different port numbers and multiple transmission channel protocols is preset in the audio/video proxy container, and the establishing module 302 is specifically configured to determine a target transmission channel protocol according to the port number corresponding to the audio/video acquisition request and the first mapping relationship; and establishing the transmission channel according to the target transmission channel protocol.
In an optional embodiment, a second mapping relationship between different values of the first field and multiple data transmission protocols is preset in the audio/video proxy container, and the transmission module 303 is specifically configured to determine a target data transmission protocol according to the value of the first field in the audio/video acquisition request and the second mapping relationship; and transmitting the audio and video stream based on the target data transmission protocol according to the transmission channel.
In an optional embodiment, the audio/video proxy container further includes an authentication module 304, configured to perform, before the transmission channel is established based on the audio/video acquisition request and a transmission channel protocol supported by the audio/video proxy container, identity authentication on the first device according to an identity authentication protocol preset in the audio/video proxy container, and determine that the first device passes the identity authentication.
It should be noted that, as those skilled in the art can clearly understand, for convenience and brevity of description, the specific working processes of the modules described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
It can be understood that, in the embodiment of the present application, an audio/video proxy container is provided on the gateway device, and the audio/video proxy container is composed of a plurality of modules.
It should be noted that the obtaining module 301 may be a socket interface module. And the audio and video proxy container runs in the container environment process, and the container environment runs in the bottom layer system of the gateway equipment. Therefore, the bottom layer system of the gateway device cannot directly communicate with the audio/video proxy container, and the communication between the bottom layer system of the gateway device and the audio/video proxy container needs to be realized through the socket interface module, so that the audio/video proxy container obtains an audio/video obtaining request sent by the first device to the second device, which is received by the gateway device, through the socket interface module.
The establishing module 302 may be a signaling control module. In the audio and video service, the communication between devices is to establish a session (i.e. the aforementioned transmission channel) through some signaling type messages. The signaling control protocols (i.e. the above-mentioned transport channel protocol) used in the present application are SIP, RTSP, h.225, h.245, etc. The signaling control module mainly provides the function of identifying the protocol. Identifying protocols is typically done through the contents of protocol ports (which can be customized on the device), IP (implementing proxy), protocol fields, and providing the functionality of identifying records for fields in the protocol that are needed to maintain session communication (e.g., call-ID field in SIP protocol).
The transmission module 303 is configured to perform audio/video stream transmission according to a data transmission protocol. The specific working process of the transmission module 303 may refer to the corresponding process in the foregoing method embodiment, and is not described herein again.
The authentication module 304 is preset with an identity authentication protocol for performing identity authentication on the first device according to the preset identity authentication protocol, and for a specific working process, reference may be made to a corresponding process in the foregoing method embodiment, which is not described herein again.
In addition, an SDP protocol may also be preset in the authentication module 304, and in the process of transmitting the audio/video stream, the SDP protocol is called to describe information such as the format, the number, the length, and the coding information of the media file of the audio/video stream. For a specific working process, reference may be made to a corresponding process in the foregoing method embodiment, which is not described herein again.
Further, the audio/video proxy container 300 may further include a service selection module 305, where the service selection module 305 is configured to provide a service selection interface on an operating system of the gateway device 103, and a user may configure a service extended by the audio/video proxy container 300 in the service selection interface provided by the service selection module 305, for example, may select whether to perform identity security authentication when performing audio/video proxy.
And the second method comprises the following steps:
referring to fig. 4, fig. 4 is a block diagram of another structure of an audio/video proxy container according to an embodiment of the present application. The audio-video proxy container 400 may include:
a first sub-container 401 configured to acquire an audio/video acquisition request initiated by a first device to a second device;
a second sub-container 402 configured to establish a transmission channel based on the audio/video acquisition request; the transmission channel is used for realizing data transmission between the first device and the second device;
a third sub-container 403 configured to perform audio/video stream transmission according to the transmission channel;
wherein the second sub-container 402 is configured to call the first sub-container 401, and the third sub-container 403 is configured to call the second sub-container 402.
In an optional embodiment, a first mapping relationship between different port numbers and multiple transmission channel protocols is preset in the audio/video proxy container, and the second sub-container 402 is specifically configured to determine a target transmission channel protocol according to the port number corresponding to the audio/video acquisition request and the first mapping relationship; and establishing the transmission channel according to the target transmission channel protocol.
In an optional embodiment, a second mapping relationship between different values of the first field and multiple data transmission protocols is preset in the audio/video proxy container, and the third sub-container 403 is specifically configured to determine a target data transmission protocol according to the value of the first field in the audio/video acquisition request and the second mapping relationship; and transmitting the audio and video stream based on the target data transmission protocol according to the transmission channel.
In an optional embodiment, the audio/video proxy container further includes a fourth sub-container 404, configured to perform, before the transmission channel is established based on the audio/video acquisition request and the transmission channel protocol supported by the audio/video proxy container, identity authentication on the first device according to an identity authentication protocol preset in the audio/video proxy container, and determine that the first device passes the identity authentication.
Further, the audio/video proxy container may further include a fifth sub-container 405, where the fifth sub-container 405 is configured to provide a service selection interface on an operating system of the gateway device 103, and a user may configure a service extended by the audio/video proxy container in the service selection interface provided by the fifth sub-container 405, for example, may select whether to perform identity security authentication when performing audio/video proxy.
It can be understood that, if the functions to be implemented by each module in the audio/video proxy container are multiple, the image file corresponding to the audio/video proxy container is very large, and in order to facilitate subsequent expansion of the audio/video proxy container, the audio/video proxy container provided in the embodiment of the present application is composed of a plurality of sub-containers, and each sub-container corresponds to one module in the foregoing first embodiment.
The specific working process of each sub-container described above corresponds to the specific working process of each module in the first embodiment, and for the sake of brevity, details are not described here again.
It should be noted that, because the audio/video proxy container in the embodiment of the present application is composed of a plurality of sub containers, a bridge network is configured in each container to ensure communication between the sub containers. The audio and video proxy method is realized among the sub-containers in a mutual calling mode.
Referring to fig. 5, fig. 5 is a schematic structural diagram of a gateway device 500 according to an embodiment of the present application, where the gateway device 500 is deployed with an audio/video proxy container, and the gateway device 500 includes: at least one processor 501, at least one communication interface 502, at least one memory 503, and at least one bus 504. Wherein the bus 504 is used for realizing direct connection communication of the components, the communication interface 502 is used for communicating signaling or data with other node devices, and the memory 503 stores machine readable instructions executable by the processor 501. When the gateway device 500 is in operation, the processor 501 communicates with the memory 503 via the bus 504, and the machine-readable instructions, when invoked by the processor 501, perform the audiovisual proxy method as described above.
The processor 501 may be an integrated circuit chip having signal processing capabilities. The Processor 501 may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), application Specific Integrated Circuits (ASICs), field-Programmable Gate arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components. Which may implement or perform the various methods, steps, and logic blocks disclosed in the embodiments of the present application. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The Memory 503 may include, but is not limited to, random Access Memory (RAM), read Only Memory (ROM), programmable Read Only Memory (PROM), erasable Read Only Memory (EPROM), electrically Erasable Read Only Memory (EEPROM), and the like.
In addition, an embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a computer, the steps of the audio/video proxy method in the foregoing embodiment are performed.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
In addition, units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
Furthermore, the functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
It should be noted that the functions, if implemented in the form of software functional modules and sold or used as independent products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (10)
1. An audio/video proxy method is applied to an audio/video proxy container deployed on a gateway device, wherein multiple transmission channel protocols and data transmission protocols are preset in the audio/video proxy container, and the method comprises the following steps:
acquiring an audio and video acquisition request initiated to a second device by a first device;
establishing a transmission channel based on the audio and video acquisition request and a transmission channel protocol supported by the audio and video proxy container; the transmission channel is used for realizing data transmission between the first device and the second device;
and audio and video stream transmission is carried out according to the data transmission protocol supported by the transmission channel and the audio and video proxy container.
2. The method according to claim 1, wherein a first mapping relationship between different port numbers and a plurality of transmission channel protocols is preset in the audio/video proxy container, and the establishing of the transmission channel based on the audio/video acquisition request and the transmission channel protocol supported by the audio/video proxy container includes:
determining a target transmission channel protocol according to the port number corresponding to the audio and video acquisition request and the first mapping relation;
and establishing the transmission channel according to the target transmission channel protocol.
3. The method according to claim 2, wherein a second mapping relationship between different values of a first field and a plurality of data transmission protocols is preset in the audio/video proxy container, and the audio/video stream transmission according to the transmission channel and the data transmission protocols supported by the audio/video proxy container includes:
determining a target data transmission protocol according to the value of the first field in the audio and video acquisition request and the second mapping relation;
and transmitting the audio and video stream based on the target data transmission protocol according to the transmission channel.
4. A method according to any of claims 1-3, wherein prior to said establishing a transmission channel based on said audiovisual acquisition request and a transmission channel protocol supported by said audiovisual proxy container, the method further comprises:
and performing identity authentication on the first equipment according to an identity authentication protocol preset in the audio/video proxy container, and determining that the first equipment passes the identity authentication.
5. An audio and video proxy container is characterized in that the audio and video proxy container is deployed on gateway equipment, a plurality of transmission channel protocols and data transmission protocols are preset in the audio and video proxy container, and the audio and video proxy container is used for acquiring an audio and video acquisition request initiated by first equipment to second equipment; establishing a transmission channel based on the audio and video acquisition request and a transmission channel protocol supported by the audio and video proxy container; the transmission channel is used for realizing data transmission between the first device and the second device; and audio and video stream transmission is carried out according to the data transmission protocol supported by the transmission channel and the audio and video proxy container.
6. The audiovisual proxy container of claim 5, wherein the audiovisual proxy container comprises:
the acquisition module is used for acquiring an audio and video acquisition request initiated by the first equipment to the second equipment;
the establishing module is used for establishing a transmission channel based on the audio and video acquisition request and a transmission channel protocol supported by the audio and video proxy container; the transmission channel is used for realizing data transmission between the first device and the second device;
and the transmission module is used for transmitting audio and video streams according to the data transmission protocols supported by the transmission channel and the audio and video proxy container.
7. The audiovisual proxy container of claim 5, wherein the audiovisual proxy container comprises:
the first sub-container is configured to acquire an audio and video acquisition request initiated by the first device to the second device;
the second sub-container is configured to establish a transmission channel based on the audio and video acquisition request; the transmission channel is used for realizing data transmission between the first device and the second device;
the third sub-container is configured to carry out audio and video stream transmission according to the transmission channel;
wherein the second sub-container is configured to invoke the first sub-container and the third sub-container is configured to invoke the second sub-container.
8. An audio-visual proxy system, the system comprising:
a first device;
a second device;
a gateway device disposed between and connected to the first device and the second device, the gateway device having an audio/video proxy container deployed thereon, the audio/video proxy container being configured to perform the method of any one of claims 1 to 4.
9. A gateway device, wherein an audio and video proxy container is deployed on the gateway device, the gateway device comprising: a processor, memory, and a bus;
the processor and the memory are communicated with each other through the bus;
the memory stores computer program instructions executable by the processor, the processor invoking the computer program instructions to perform the method of any of claims 1-4.
10. A computer-readable storage medium, storing computer program instructions which, when executed by a computer, cause the computer to perform the method of any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210764128.XA CN115150369A (en) | 2022-06-29 | 2022-06-29 | Audio and video proxy method and audio and video proxy container |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210764128.XA CN115150369A (en) | 2022-06-29 | 2022-06-29 | Audio and video proxy method and audio and video proxy container |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115150369A true CN115150369A (en) | 2022-10-04 |
Family
ID=83410208
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210764128.XA Pending CN115150369A (en) | 2022-06-29 | 2022-06-29 | Audio and video proxy method and audio and video proxy container |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115150369A (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8170123B1 (en) * | 2008-04-15 | 2012-05-01 | Desktone, Inc. | Media acceleration for virtual computing services |
| CN103455698A (en) * | 2012-05-31 | 2013-12-18 | 中国联合网络通信集团有限公司 | Medical monitoring method, device and system |
| CN103607663A (en) * | 2013-11-27 | 2014-02-26 | 福建星网锐捷网络有限公司 | Identification method, device and equipment for multimedia streams |
| WO2015032277A1 (en) * | 2013-09-05 | 2015-03-12 | 华为终端有限公司 | Transmission method and device for media stream in video conference |
| WO2017084467A1 (en) * | 2015-11-18 | 2017-05-26 | 腾讯科技（深圳）有限公司 | Method for processing video stream, device, and system |
| CN109257344A (en) * | 2018-09-06 | 2019-01-22 | 广州高清视信数码科技股份有限公司 | A kind of WebRTC Media Gateway and its interoperability methods based on Docker container technique |
| CN110611843A (en) * | 2019-10-18 | 2019-12-24 | 成都中航信虹科技股份有限公司 | Video processing method and device, video access gateway and storage medium |
| CN111010445A (en) * | 2019-12-20 | 2020-04-14 | 北京邮电大学 | Intelligent medical information system supporting multiple communication protocols, and acquisition method and device |
| CN111786879A (en) * | 2020-07-01 | 2020-10-16 | 内蒙古显鸿科技股份有限公司 | Intelligent fusion terminal gateway supporting containerization |
| CN112367525A (en) * | 2020-10-20 | 2021-02-12 | 北京大学 | Online classroom video live broadcasting system and method based on classroom old equipment |
| CN112953899A (en) * | 2021-01-26 | 2021-06-11 | 四川天翼网络服务有限公司 | Streaming media distribution system and method supporting multi-audio video streaming protocol |
| WO2022127232A1 (en) * | 2020-12-17 | 2022-06-23 | 深圳Tcl数字技术有限公司 | Ip camera control method and apparatus, and storage medium and smart television |
-
2022
- 2022-06-29 CN CN202210764128.XA patent/CN115150369A/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8170123B1 (en) * | 2008-04-15 | 2012-05-01 | Desktone, Inc. | Media acceleration for virtual computing services |
| CN103455698A (en) * | 2012-05-31 | 2013-12-18 | 中国联合网络通信集团有限公司 | Medical monitoring method, device and system |
| WO2015032277A1 (en) * | 2013-09-05 | 2015-03-12 | 华为终端有限公司 | Transmission method and device for media stream in video conference |
| CN103607663A (en) * | 2013-11-27 | 2014-02-26 | 福建星网锐捷网络有限公司 | Identification method, device and equipment for multimedia streams |
| WO2017084467A1 (en) * | 2015-11-18 | 2017-05-26 | 腾讯科技（深圳）有限公司 | Method for processing video stream, device, and system |
| CN109257344A (en) * | 2018-09-06 | 2019-01-22 | 广州高清视信数码科技股份有限公司 | A kind of WebRTC Media Gateway and its interoperability methods based on Docker container technique |
| CN110611843A (en) * | 2019-10-18 | 2019-12-24 | 成都中航信虹科技股份有限公司 | Video processing method and device, video access gateway and storage medium |
| CN111010445A (en) * | 2019-12-20 | 2020-04-14 | 北京邮电大学 | Intelligent medical information system supporting multiple communication protocols, and acquisition method and device |
| CN111786879A (en) * | 2020-07-01 | 2020-10-16 | 内蒙古显鸿科技股份有限公司 | Intelligent fusion terminal gateway supporting containerization |
| CN112367525A (en) * | 2020-10-20 | 2021-02-12 | 北京大学 | Online classroom video live broadcasting system and method based on classroom old equipment |
| WO2022127232A1 (en) * | 2020-12-17 | 2022-06-23 | 深圳Tcl数字技术有限公司 | Ip camera control method and apparatus, and storage medium and smart television |
| CN112953899A (en) * | 2021-01-26 | 2021-06-11 | 四川天翼网络服务有限公司 | Streaming media distribution system and method supporting multi-audio video streaming protocol |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2019184987A1 (en) | Method for accessing ims, and communication apparatus | |
| CN111314646B (en) | Image acquisition method, image acquisition device, terminal device and readable storage medium | |
| US20090225153A1 (en) | Apparatus For Synthesizing Information, Apparatus For Controlling Information, And Computer Program Product | |
| CN108235111B (en) | Information sharing method and intelligent set top box | |
| US20160277246A1 (en) | Method and device for media multiplexing negotiation | |
| JP6701377B2 (en) | SIP information analysis method, device, server and medium | |
| CN115001846A (en) | Method, isolation device, device and medium for cross-network data transmission | |
| CN110798651A (en) | Video conference method, device, equipment and storage medium | |
| CN106550493B (en) | Media resource sharing method and mobile terminal | |
| CN110750206A (en) | Data processing method, device and system | |
| CN110825797B (en) | Data exchange method and device | |
| CN115150369A (en) | Audio and video proxy method and audio and video proxy container | |
| CN112383617B (en) | Method, device, terminal equipment and medium for performing long connection | |
| US20220321420A1 (en) | System and method for sharing media resources for network based communication | |
| WO2023011057A1 (en) | Communication method and apparatus | |
| CN108616760B (en) | Live broadcasting method based on browser, server, anchor terminal and user terminal | |
| CN106358008B (en) | Method for avoiding repeated call access and conference television terminal equipment | |
| CN113660290A (en) | Signaling transmission method, device, equipment and storage medium | |
| CN109962962B (en) | Socket connection method and device | |
| CN115002081B (en) | Media stream transmission method and related device | |
| CN113973089B (en) | Streaming media transmission method, system, equipment and storage medium | |
| CN115529375B (en) | Interface display method and device and electronic equipment | |
| KR102565468B1 (en) | LoRaWAN NETWORK ROAMING METHOD USING oneM2M INTERNET-OF-THINGS PLATFORM | |
| CN116074469B (en) | Method and device for joining conference, storage medium and electronic device | |
| CN113037698B (en) | Video manufacturer adaptation method, device, equipment and medium based on configuration file |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |