CN110417877B

CN110417877B - Audio and video service processing method and device

Info

Publication number: CN110417877B
Application number: CN201910647613.7A
Authority: CN
Inventors: 安玉; 王晓辉; 吴芳华; 王艳辉
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2019-07-17
Filing date: 2019-07-17
Publication date: 2022-05-31
Anticipated expiration: 2039-07-17
Also published as: CN110417877A

Abstract

The embodiment of the invention provides a processing method, a device and a storage medium of an audio and video service, wherein the method is applied to any one terminal of a plurality of terminals in an audio and video service system, a web client and a soft terminal are installed on the terminal, the soft terminal is in communication connection with a streaming media server, the web client is in communication connection with a bridging server, the bridging server and the streaming media server are both in communication connection with a video network server, and the method comprises the following steps: generating service parameter information according to audio and video service operation performed by a user on a web client, wherein the service parameter information comprises user information; responding to the operation of the audio and video service, starting a soft terminal through a web client, and logging in the started soft terminal by adopting user information; the method comprises the steps that service parameter information is sent to a streaming media server through a web client through a bridging server and a video network server; and receiving at least one first audio/video stream data sent by the streaming media server according to the user information through the soft terminal. Thereby improving the audio and video decoding speed.

Description

Audio and video service processing method and device

Technical Field

The present invention relates to the technical field of audio/video services, and in particular, to a method and an apparatus for processing an audio/video service, and a computer-readable storage medium.

Background

In the existing video networking network, a Web client is generally adopted to display, manage and control related audio and video services, and a user can perform video call, live broadcast, viewing monitoring and other related services related to audio and video streams through the Web client.

Disclosure of Invention

In view of the above problems, embodiments of the present invention are provided to provide a processing method of an audio/video service, a processing apparatus of an audio/video service, an apparatus and a computer readable storage medium, which overcome or at least partially solve the above problems.

In a first aspect of the embodiments of the present invention, a method for processing an audio/video service is provided, where the method is applied to any one of a plurality of terminals in an audio/video service system, where a web client and a soft terminal are installed on the terminal, the soft terminal is in communication connection with a streaming media server, the web client is in communication connection with a bridge server, and both the bridge server and the streaming media server are in communication connection with a video network server, and the method includes:

generating service parameter information according to audio and video service operation performed by a user on the web client, wherein the service parameter information comprises user information, and the user information is user information logged in the web client at present;

responding to the audio and video service operation, starting the soft terminal through the web client, and logging in the started soft terminal by adopting the user information;

sending service parameter information to the bridge server through the web client, wherein the bridge server is used for sending the service parameter information to the streaming media server through the video networking server;

receiving at least one first audio/video stream data sent by the streaming media server according to the user information through the soft terminal; the first audio and video stream data is collected by at least one terminal which establishes a communication path with the streaming media server in advance and is sent to the streaming media server.

Optionally, in response to the audio/video service operation, starting the soft terminal through the web client, and logging in the started soft terminal by using the user information, includes:

responding to the audio and video service operation, and triggering a preset hyperlink on the web client through the web client;

according to the clicking operation of the user on the hyperlink, the web client side obtains and processes the operation

The interface identification corresponding to the hyperlink;

and starting the soft terminal according to the interface identifier, and logging in the started soft terminal by adopting the user information.

Optionally, the video network server is connected with a plurality of video network terminals: generating service parameter information according to audio and video service operation performed by a user on the web client, wherein the service parameter information comprises:

acquiring at least one video networking number associated with the audio and video service operation according to the audio and video service operation;

generating first service parameter information conforming to an internet protocol; the first service parameter information comprises the user information and the video network number;

sending service parameter information to the bridge server through the web client, including:

the first service parameter information is sent to the bridge server through the web client, and the bridge server is used for converting the first service parameter information into second service parameter information conforming to a video networking protocol and sending the second service parameter information to the video networking server; the video network server is used for establishing a video network communication path between video network terminals corresponding to each video network number and establishing communication with the streaming media server based on the second service parameter information;

the method further comprises the following steps:

and the soft terminal sends second audio and video stream data acquired by the soft terminal to the streaming media server, the streaming media server is used for sending the second audio and video stream data to the video networking server, and the video networking server is used for sending the second audio and video stream data to the video networking terminal based on the video networking communication path.

Optionally, the web client is further in communication connection with a web server, and before the step of generating service parameter information according to an audio/video service operation performed by a user on the web client, the method further includes:

sending first service invitation information to the web server through the web client; wherein the first service invitation information comprises a plurality of user identifications; the web server is used for sending the first service invitation information to a first web client corresponding to the user identification and receiving a confirmation signaling returned by the first web client aiming at the first service invitation information; the confirmation signaling comprises a terminal identifier of a terminal according to the first web client;

receiving the confirmation signaling returned by the web server through the web client;

generating service parameter information according to audio and video service operation performed by a user on the web client, wherein the service parameter information comprises:

according to the audio and video service starting operation of a user on the web client aiming at the confirmation signaling, acquiring the terminal identification in the confirmation signaling, and generating service parameter information comprising the user information and the terminal identification;

responding to the audio and video service operation, starting the soft terminal through the web client, and logging in the started soft terminal by adopting the user information, wherein the method comprises the following steps:

responding to the start of the audio and video service, starting the soft terminal through the web client, and logging in the started soft terminal by adopting the user information;

sending service parameter information to the bridge server through the web client, where the bridge server is configured to send the service parameter information to the streaming server, and the method includes:

and sending service parameter information to the bridge server through the web client, wherein the bridge server is used for sending the service parameter information to the streaming media server, and the streaming media server is used for establishing a first audio/video communication path of a terminal corresponding to each terminal identifier and receiving first audio/video stream data acquired by the terminal corresponding to each terminal identifier based on the first audio/video communication path.

Optionally, before the step of generating service parameter information according to the audio/video service operation performed by the user on the web client, the method further includes:

receiving a service starting instruction sent by the web server through the web client; the business instruction is generated and sent by the second web client; the service starting instruction comprises a terminal identifier of a terminal for installing the second web client;

acquiring the terminal identifier of the service starting instruction according to service confirmation operation aiming at the service starting instruction performed on the web client by a user, and generating service parameter information comprising the user information and the terminal identifier;

responding to the audio and video service operation, starting the soft terminal through the web client, and the method comprises the following steps:

and responding to the service confirmation operation, and starting the soft terminal through the web client.

In a second aspect of this embodiment, a device for processing an audio/video service is provided, where the device is applied to any one of multiple terminals in a video service system, a web client and a soft terminal are installed on the terminal, the soft terminal is in communication connection with a streaming media server, the web client is in communication connection with a bridge server, and the device includes:

the service information generation module is used for generating service parameter information by audio and video service operation performed by a user on the web client, wherein the service parameter information comprises user information, and the user information is user information currently logged in the web client;

the soft terminal starting module responds to the audio and video service operation, starts the soft terminal through the web client, and adopts the user information to log in the started soft terminal;

the parameter information sending module is used for sending service parameter information to the bridging server through the web client, and the bridging server is used for sending the service parameter information to the streaming media server;

the video receiving module is used for receiving at least one first audio and video stream data sent by the streaming media server according to the user information through the soft terminal; the first audio and video stream data is collected by at least one terminal which establishes a communication path with the streaming media server in advance and is sent to the streaming media server.

Optionally, the soft terminal starting module includes:

the triggering module is used for responding to the video service operation and triggering a dialog box preset on the web client through the web client;

the interface determining module is used for acquiring an interface identifier bound with the dialog box through the web client according to the confirmation operation of the user on the dialog box;

the starting module is used for starting the soft terminal according to the interface identifier;

and the login module is used for logging in the started soft terminal by adopting the user information.

Optionally, the multiple terminals are in communication connection with a video networking server, and the service information generating module includes:

the number acquisition unit is used for acquiring at least one video networking number associated with the audio and video service operation according to the audio and video service operation;

the service parameter information generating unit is used for generating first service parameter information which accords with an internet protocol; the first service parameter information comprises the user information and the video network number;

the parameter information sending module is specifically configured to send the first service parameter information to the bridge server through the web client, where the bridge server is configured to convert the first service parameter information into second service parameter information conforming to an internet of view protocol, and send the second service parameter information to the internet of view server; the video network server is used for establishing a video network communication path between video network terminals corresponding to the video network numbers and establishing communication with the streaming media server based on the second service parameter information;

the device further comprises:

the video sending module is used for sending second audio and video streaming data acquired by the soft terminal to the streaming media server through the soft terminal, the streaming media server is used for sending the second audio and video streaming data to the video networking server, and the video networking server is used for sending the second audio and video streaming data to the video networking terminal based on the video networking communication path.

In a third aspect of the embodiments of the present invention, an apparatus is provided, including: one or more processors; and

one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform the illustrated method of processing of audiovisual services.

In a third aspect of the embodiments of the present invention, a computer-readable storage medium is provided, in which a stored computer program causes a processor to execute the processing method of the audio/video service

The embodiment of the invention has the following advantages:

in the embodiment of the invention, a web client and a soft terminal are simultaneously installed on a terminal, service parameter information is generated according to audio and video service operation performed by a user on the web client, the installed soft terminal is started through the web client in response to the audio and video service operation performed on the web client, the started soft terminal is logged in through user information logged in the web client, the service parameter information is further sent to a streaming media server, the streaming media server returns first audio and video streaming data acquired through a pre-established communication path to the soft terminal according to the user information, and then the terminal can perform video call, live broadcast or view monitoring video through the soft terminal. The management and control of the audio and video services are realized through the web client, and the receiving, decoding and playing of the audio and video are performed on the soft terminal, so that the occupation of the web client on the memory space is reduced. And because the soft terminal is logged in through the user information logged in on the web client, the account numbers between the soft terminal and the web client are unified, so that the switching time from the audio and video service operation to the receiving of the first audio and video stream data by the soft terminal started by the web client can be reduced, and the seamless switching between audio and video management and audio and video watching is realized.

Drawings

FIG. 1 is a schematic networking diagram of a video network of the present invention;

FIG. 2 is a schematic diagram of a hardware architecture of a node server according to the present invention;

fig. 3 is a schematic diagram of a hardware structure of an access switch of the present invention;

fig. 4 is a schematic diagram of a hardware structure of an ethernet protocol conversion gateway according to the present invention;

fig. 5 is an application environment diagram of a processing method of an audio/video service according to an embodiment of the present invention;

fig. 6 is a schematic flowchart of a method for processing an audio/video service according to an embodiment of the present invention;

fig. 7 is a schematic flowchart of step 602 in a method for processing an audio/video service according to an embodiment of the present invention;

fig. 8 is a diagram illustrating an example of a processing method of an audio/video service according to an embodiment of the present invention;

fig. 9 is a block diagram of an apparatus for processing an audio/video service according to an embodiment of the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

The video networking is an important milestone for network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of internet applications to high-definition video, and high-definition faces each other.

The video networking adopts a real-time high-definition video exchange technology, can integrate required services such as dozens of services of video, voice, pictures, characters, communication, data and the like on a system platform on a network platform, such as high-definition video service, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast, VOD on demand, television mail, Personal Video Recorder (PVR), intranet (self-office) channels, intelligent video broadcast control, information distribution and the like, and realizes high-definition quality video broadcast through a television or a computer.

To better understand the embodiments of the present invention, the following description refers to the internet of view:

some of the technologies applied in the video networking are as follows:

network technology (network technology)

Network technology innovation in video networking has improved the traditional Ethernet (Ethernet) to face the potentially huge first video traffic on the network. Unlike pure network Packet Switching (Packet Switching) or network Circuit Switching (Circuit Switching), the Packet Switching is adopted by the technology of the video networking to meet the Streaming requirement. The video networking technology has the advantages of flexibility, simplicity and low price of packet switching, and simultaneously has the quality and safety guarantee of circuit switching, thereby realizing the seamless connection of the whole network switching type virtual circuit and the data format.

Switching Technology (Switching Technology)

The video network adopts two advantages of asynchronism and packet switching of the Ethernet, eliminates the defects of the Ethernet on the premise of full compatibility, has end-to-end seamless connection of the whole network, is directly communicated with a user terminal, and directly bears an IP data packet. The user data does not require any format conversion across the entire network. The video networking is a higher-level form of the Ethernet, is a real-time exchange platform, can realize the real-time transmission of the whole-network large-scale high-definition video which cannot be realized by the existing Internet, and pushes a plurality of network video applications to high-definition and unification.

Server technology (Servertechnology)

The server technology on the video networking and unified video platform is different from the traditional server, the streaming media transmission of the video networking and unified video platform is established on the basis of connection orientation, the data processing capacity of the video networking and unified video platform is independent of flow and communication time, and a single network layer can contain signaling and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than that of data processing, and the efficiency is greatly improved by more than one hundred times compared with that of a traditional server.

Storage Technology (Storage Technology)

The super-high speed storage technology of the unified video platform adopts the most advanced real-time operating system in order to adapt to the media content with super-large capacity and super-large flow, the program information in the server instruction is mapped to the specific hard disk space, the media content is not passed through the server any more, and is directly sent to the user terminal instantly, and the general waiting time of the user is less than 0.2 second. The optimized sector distribution greatly reduces the mechanical motion of the magnetic head track seeking of the hard disk, the resource consumption only accounts for 20% of that of the IP internet of the same grade, but concurrent flow which is 3 times larger than that of the traditional hard disk array is generated, and the comprehensive efficiency is improved by more than 10 times.

Network Security Technology (Network Security Technology)

The structural design of the video network completely eliminates the network security problem troubling the internet structurally by the modes of independent service permission control each time, complete isolation of equipment and user data and the like, generally does not need antivirus programs and firewalls, avoids the attack of hackers and viruses, and provides a structural carefree security network for users.

Service Innovation Technology (Service Innovation Technology)

The unified video platform integrates services and transmission, and is not only automatically connected once whether a single user, a private network user or a network aggregate. The user terminal, the set-top box or the PC are directly connected to the unified video platform to obtain various multimedia video services in various forms. The unified video platform adopts a menu type configuration table mode to replace the traditional complex application programming, can realize complex application by using very few codes, and realizes infinite new service innovation.

Networking of the video network is as follows:

the video network is a centralized control network structure, and the network can be a tree network, a star network, a ring network and the like, but on the basis of the centralized control node, the whole network is controlled by the centralized control node in the network.

As shown in fig. 1, the video network is divided into an access network and a metropolitan network.

The devices of the access network part can be mainly classified into 3 types: node server, access switch, terminal (including various set-top boxes, coding boards, memories, etc.). The node server is connected to an access switch, which may be connected to a plurality of terminals and may be connected to an ethernet network.

The node server is a node which plays a centralized control function in the access network and can control the access switch and the terminal. The node server can be directly connected with the access switch or directly connected with the terminal.

Similarly, devices of the metropolitan network portion may also be classified into 3 types: a metropolitan area server, a node switch and a node server. The metro server is connected to a node switch, which may be connected to a plurality of node servers.

The node server is a node server of the access network part, namely the node server belongs to both the access network part and the metropolitan area network part.

The metropolitan area server is a node which plays a central control function in the metropolitan area network and can control the node switch and the node server. The metropolitan area server can be directly connected with the node switch or directly connected with the node server.

Therefore, the whole video network is a network structure with layered centralized control, and the network controlled by the node server and the metropolitan area server can be in various structures such as tree, star and ring.

The access network part can form a unified video platform (the part in the dotted circle), and a plurality of unified video platforms can form a video network; each unified video platform may interconnect and interwork via metropolitan and wide area video networks.

Video networking device classification

1.1 devices in the video network of the embodiment of the present invention can be mainly classified into 3 types: server, exchanger (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, code board, memory, etc.). The video network as a whole can be divided into a metropolitan area network (or national network, global network, etc.) and an access network.

1.2 wherein the devices of the access network part can be mainly classified into 3 types: node server, access exchanger (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, coding board, memory, etc.).

The specific hardware structure of each access network device is as follows:

a node server:

as shown in fig. 2, the system mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;

the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of looking up the address table 205 on the incoming packet, thereby obtaining the direction information of the packet; and stores the packet in a queue of the corresponding packet buffer 206 based on the packet's steering information; if the queue of the packet buffer 206 is nearly full, it is discarded; the switching engine module 202 polls all packet buffer queues for forwarding if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 204 mainly implements control over the hard disk, including initialization, read-write, and other operations on the hard disk; the CPU module 203 is mainly responsible for protocol processing with an access switch and a terminal (not shown in the figure), configuring an address table 205 (including a downlink protocol packet address table, an uplink protocol packet address table, and a data packet address table), and configuring the disk array module 204.

The access switch:

as shown in fig. 3, the network interface module mainly includes a network interface module (a downlink network interface module 301 and an uplink network interface module 302), a switching engine module 303 and a CPU module 304;

wherein, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the Destination Address (DA), the Source Address (SA), the packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id) and enters the switching engine module 303, otherwise, discards the stream identifier; the packet (downstream data) coming from the upstream network interface module 302 enters the switching engine module 303; the incoming data packet of the CPU module 304 enters the switching engine module 303; the switching engine module 303 performs an operation of looking up the address table 306 on the incoming packet, thereby obtaining the direction information of the packet; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in association with the stream-id; if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downlink network interface to the uplink network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the guiding information of the packet; if the queue of the packet buffer 307 is nearly full, it is discarded.

The switching engine module 303 polls all packet buffer queues and may include two cases:

if the queue is from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queued packet counter is greater than zero; 3) obtaining a token generated by a code rate control module;

if the queue is not from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.

The rate control module 308 is configured by the CPU module 304, and generates tokens for packet buffer queues from all downstream network interfaces to upstream network interfaces at programmable intervals to control the rate of upstream forwarding.

The CPU module 304 is mainly responsible for protocol processing with the node server, configuration of the address table 306, and configuration of the code rate control module 308.

Ethernet protocol conversion gateway：

As shown in fig. 4, the apparatus mainly includes a network interface module (a downlink network interface module 401 and an uplink network interface module 402), a switching engine module 403, a CPU module 404, a packet detection module 405, a rate control module 408, an address table 406, a packet buffer 407, a MAC adding module 409, and a MAC deleting module 410.

Wherein, the data packet coming from the downlink network interface module 401 enters the packet detection module 405; the packet detection module 405 detects whether the ethernet MAC DA, the ethernet MAC SA, the ethernet length or frame type, the video network destination address DA, the video network source address SA, the video network packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id); then, the MAC deletion module 410 subtracts MAC DA, MAC SA, length or frame type (2byte) and enters the corresponding receiving buffer, otherwise, discards it;

the downlink network interface module 401 detects the sending buffer of the port, if there is a packet, the ethernet MAC DA of the corresponding terminal is known according to the destination address DA of the packet in the video network, the ethernet MAC DA of the terminal, the MAC SA of the ethernet protocol gateway, and the ethernet length or frame type are added, and the packet is sent.

The other modules in the ethernet protocol gateway function similarly to the access switch.

A terminal:

the system mainly comprises a network interface module, a service processing module and a CPU module; for example, the set-top box mainly comprises a network interface module, a video and audio coding and decoding engine module and a CPU module; the coding board mainly comprises a network interface module, a video and audio coding engine module and a CPU module; the memory mainly comprises a network interface module, a CPU module and a disk array module.

1.3 devices of the metropolitan area network part can be mainly classified into 2 types: node server, node exchanger, metropolitan area server. The node switch mainly comprises a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly comprises a network interface module, a switching engine module and a CPU module.

2. Video networking packet definition

2.1 Access network packet definition

The data packet of the access network mainly comprises the following parts: destination Address (DA), Source Address (SA), reserved bytes, payload (pdu), CRC.

As shown in the following table, the data packet of the access network mainly includes the following parts:

DA

SA

Reserved

Payload

CRC

wherein:

the Destination Address (DA) is composed of 8 bytes (byte), the first byte represents the type of the data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), there are 256 possibilities at most, the second byte to the sixth byte are metropolitan area network addresses, and the seventh byte and the eighth byte are access network addresses;

the Source Address (SA) is also composed of 8 bytes (byte), defined as the same as the Destination Address (DA);

the reserved byte consists of 2 bytes;

the payload part has different lengths according to different types of datagrams, and is 64 bytes if the datagram is various types of protocol packets, and is 32+1024 or 1056 bytes if the datagram is a unicast packet, of course, the length is not limited to the above 2 types;

the CRC consists of 4 bytes and is calculated in accordance with the standard ethernet CRC algorithm.

2.2 metropolitan area network packet definition

The topology of a metropolitan area network is a graph and there may be 2, or even more than 2, connections between two devices, i.e., there may be more than 2 connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metro network address of the metro network device is unique, and in order to accurately describe the connection relationship between the metro network devices, parameters are introduced in the embodiment of the present invention: a label to uniquely describe a metropolitan area network device.

In this specification, the definition of the Label is similar to that of the Label of MPLS (Multi-Protocol Label Switch), and assuming that there are two connections between the device a and the device B, there are 2 labels for the packet from the device a to the device B, and 2 labels for the packet from the device B to the device a. The label is classified into an incoming label and an outgoing label, and assuming that the label (incoming label) of the packet entering the device a is 0x0000, the label (outgoing label) of the packet leaving the device a may become 0x 0001. The network access process of the metro network is a network access process under centralized control, that is, address allocation and label allocation of the metro network are both dominated by the metro server, and the node switch and the node server are both passively executed, which is different from label allocation of MPLS, and label allocation of MPLS is a result of mutual negotiation between the switch and the server.

As shown in the following table, the data packet of the metro network mainly includes the following parts:

DA

SA

Reserved

label (R)

Payload

CRC

Namely Destination Address (DA), Source Address (SA), Reserved byte (Reserved), tag, payload (pdu), CRC. The format of the tag may be defined by reference to the following: the tag is 32 bits with the upper 16 bits reserved and only the lower 16 bits used, and its position is between the reserved bytes and payload of the packet.

Based on the characteristics of the video networking, one of the core concepts of the embodiment of the application is provided, when the audio and video service operation is performed on the web client, the soft terminal is started through the web client, the soft terminal is logged in by using the user information logged in the web client, and the audio and video streaming data returned by the streaming media server is received through the soft terminal.

Referring to fig. 5, a schematic view of a communication environment applied to a method for processing an audio/video service according to an embodiment of the present invention is shown, in fig. 5, the method is applied to an audio/video service system, the audio/video service system may include a plurality of terminals, a streaming media server, and a bridge server, and a web client and a soft terminal are installed on the terminals, where the soft terminal communicates with the streaming media server, the web client communicates with the bridge server, and the bridge server is in communication connection with a video networking server.

In the embodiment of the invention, the streaming media server, the bridging server and each terminal can be registered in the video networking server in advance so as to carry out video networking service communication. The streaming media server can be understood as a server providing audio and video services for the soft terminal, and the bridge server can be understood as a server providing audio and video management, operation and other services for the web client, and can play a role in bridging between the internet and the video network.

The terminal in the embodiment of the present invention may be, but is not limited to, the following devices: smart phones, computers, notebook computers, tablet computers, network televisions, and the like. A web client and a soft terminal may be installed on the terminal at the same time.

In practice, a user can access the Web client through a browser and then log in the Web client to manage and control the audio/video service. The soft terminal can be understood as a desktop application program which can be directly accessed to a video network server or accessed to the video network server through a streaming media server, and can provide services such as encoding and decoding of audio and video, video presentation, audio playing, camera pulling and the like.

Referring to fig. 6, a schematic flow diagram of a method for processing an audio/video service according to an embodiment of the present invention is shown, where the method may be applied to any terminal in the audio/video service system, and specifically includes the following steps:

step 601, generating service parameter information according to the audio and video service operation performed by the user on the web client.

In the embodiment of the invention, the video service operation can comprise the service operation of carrying out a video conference, the service operation of calling and monitoring videos and the service operation of watching live videos, a user can log in a web client to carry out the operations, and the web client can generate service parameter information according to the audio and video service operation carried out by the user. The service parameter information may include user information currently logged in the web client, and in practice, the service parameter information may further include other information, such as an address of a terminal, port information of the web client, identification information representing a type of the audio/video service, and the like.

Step 602, responding to the audio/video service operation, starting the soft terminal through the web client, and logging in the started soft terminal by using the user information.

In the embodiment of the invention, when the web client detects that the user performs audio/video service operation, the web client can trigger the soft terminal to start, and after the soft terminal is started, the user information logged in the web client can be automatically transmitted to the soft terminal, so that the automatic logging in of the soft terminal is realized. The user information may include a user name, a user password, and other information.

During specific implementation, the registration user name and the registration password used by the user when the user registers on the soft terminal can be consistent with the user name and the password used by the user on the web client, so that the user can use consistent user information when the soft terminal is started and logged in through the web client, and further the soft terminal can be successfully logged in.

Step 603, sending the service parameter information to the bridge server through the web client, where the bridge server is configured to send the service parameter information to the streaming server through the video network server.

In the embodiment of the invention, the service parameter information generated by the terminal is information conforming to the video networking protocol, the terminal can send the service parameter information to the bridging server based on the Internet protocol, and the bridging server registers in the video networking server in advance to realize the bridging effect of the network between the Internet and the video networking, so that the bridging server can convert the service parameter information into the service parameter information conforming to the video networking protocol and then send the service parameter information to the video networking server.

Because the streaming media server is registered in the video network server in advance, the video network server can send the service parameter information to the streaming media server according to the service type carried in the service parameter information, so that the streaming media server provides audio and video service for the terminal according to the service parameter information. After the video network server sends the service parameter information to the streaming media server, the streaming media server can provide audio and video streaming service based on internet protocol transmission for the terminal according to the service parameter information so as to meet the requirement that the soft terminal can watch audio and video by adopting a commonly used internet protocol. For example, a video stream sent by the soft terminal may be received and forwarded to other soft terminals indicated in the service parameter information or web clients installed on other terminals.

Step 604, receiving at least one first audio/video stream data sent by the streaming media server according to the user information through the soft terminal; the first audio and video stream data is collected by at least one terminal which establishes a communication path with the streaming media server in advance and is sent to the streaming media server.

In the embodiment of the invention, because the service parameter information received by the streaming media server comprises the user information of the soft terminal, the streaming media server can determine that the object providing the audio and video service is the soft terminal according to the user information, and further can send the received audio and video streams sent by other terminals to the soft terminal and also can receive the audio and video streams sent by the soft terminal.

The first audio/video stream data described in this embodiment may be understood as first audio/video stream data that is collected by other terminals and sent to a streaming media server, and in specific implementation, the streaming media server may establish a communication path with a plurality of terminals in advance, and the service parameter information may also carry an address of a target terminal where the audio/video stream that needs to be obtained is located, so that the streaming media server may receive the first audio/video stream data that is collected and sent by the target terminal through the communication path corresponding to the address of the target terminal, and forward the first audio/video stream data to a soft terminal on the terminal.

The first audio/video stream data may be audio/video stream data conforming to an internet protocol, and the audio/video transmission protocol used in the first audio/video stream data may be an RTP protocol or an RTSP protocol. When the first audio and video stream data is received through the soft terminal, a user can watch videos on the soft terminal, so that the problems that when the first audio and video stream data is received through the web client, and the web client decodes the audio and video stream data, a browser of the web client occupies a large amount of memory, and audio and video blockage and serious delay are caused are solved.

And the Web client directly and automatically starts the soft terminal through the Web client according to the operation of the audio and video service, so that the problem of delayed audio and video stream receiving caused by the fact that the soft terminal is started for 30s or 40s after the audio and video service is started by conventionally adopting a manual soft terminal can be avoided.

In the embodiment of the invention, the terminal generates the service parameter information comprising the user information logged in the web client according to the audio and video service operation performed on the web client, the soft terminal is started through the web client, the user information is used for logging in the soft terminal, and the service parameter information is sent to the streaming media server through the bridging server and the video network server, so that the streaming media server can provide audio and video service for the soft terminal according to the user information, and the terminal can receive the first audio and video stream data sent by the streaming media server through the logged-in soft terminal.

By adopting the technical scheme, the web client can respond to the operation of the audio and video service, start and log in the soft terminal, and receive the first audio and video stream data through the soft terminal, so that the information display, the instruction sending and the service control of the audio and video service are realized on the web client of the terminal, the audio and video playing is carried out on the soft terminal, the soft terminal is fully utilized to support the video decoding and playing of the web client, the load distribution of the audio and video service is further realized on the terminal, the memory occupation of a browser of the web client is reduced, and the audio and video decoding efficiency is improved.

In combination with the above embodiments, in one implementation, referring to fig. 7, a flowchart of steps of step 602 is shown, and step 602 may include the following steps:

step 6021, responding to the audio/video service operation, triggering a preset hyperlink on the web client through the web client.

In this embodiment, the user-defined URL Protocol may be written in the registry where the soft terminal is installed and the registry of the web client in advance, and the URL Protocol may be written in the HTML file where the web client is located, so that the web client responds to the pop-up hyperlink when performing the audio/video service operation.

Step 6022, according to the click operation of the user on the hyperlink, the interface identifier corresponding to the hyperlink is obtained through the web client.

In this embodiment, when the user clicks the hyperlink, the URL Protocol of the hyperlink may be analyzed through the web client, generally speaking, the URL Protocol corresponds to an interface identifier of the soft terminal, which may be understood as that the URL Protocol includes the interface identifier of the soft terminal, and the soft terminal may be determined according to the interface identifier.

Step 6023, starting the soft terminal according to the interface mark, and logging in the started soft terminal by adopting the user information.

After determining that the interface identifier corresponds to the soft terminal, determining a registry of the soft terminal where the URL Protocol is located, and starting the soft terminal through the registry of the soft terminal, and when starting the soft terminal, transmitting user information to the soft terminal through the URL Protocol to realize automatic login of the soft terminal.

By adopting the technical scheme, the terminal can respond to the operation of the audio and video service, and the hyperlink is popped up for the user to click so as to start the soft terminal, so that the user can conveniently select whether to start the soft terminal to watch the video when the audio and video service is carried out, and the user experience is optimized.

With reference to the foregoing embodiment, in an implementation manner, the video network server is connected with a plurality of video network terminals, and step 601 may include the following steps:

step 6011, according to the audio/video service operation, at least one video networking number associated with the audio/video service operation is acquired.

In this embodiment, the audio/video service performed by the terminal may also be an audio/video service that interacts with the terminal of the video network. Specifically, the video network terminal may be, but is not limited to, an aurora series terminal in the video network, and the aurora series terminal is a device dedicated to functions of playing, collecting and the like of audio and video in the video network, and can decode the audio and video and transmit the decoded audio and video to a display for playing. In the embodiment, when the user performs the audio and video service operation on the web client, at least one video networking number input or selected by the user can be obtained, wherein the video networking number can uniquely identify the video networking terminal.

Step 6012, generating first service parameter information conforming to the internet protocol.

The first service parameter information comprises the user information and the video network number.

Accordingly, step 603 may comprise the steps of:

the first service parameter information is sent to the bridge server through the web client, and the bridge server is used for converting the first service parameter information into second service parameter information conforming to a video networking protocol and sending the second service parameter information to the video networking server; the video network server is used for establishing a video network communication path between video network terminals corresponding to the video network numbers and establishing communication with the streaming media server based on the second service parameter information.

In this embodiment, the bridge server may be configured to send the second service parameter information to the video networking server, and the video networking server may be configured to establish a video networking communication path with the video networking terminal for the second service parameter information, so that an audio/video service may be provided for the video networking terminal, where the streaming media server may also establish a communication path with the video networking server, so as to enable the terminal to be connected to the video networking server through the streaming media server, and further interact with the video networking terminal for the audio/video service.

Accordingly, the method may further comprise the steps of:

step 605, sending second audio/video stream data acquired by the soft terminal to the streaming media server through the soft terminal, where the streaming media server is configured to send the second audio/video stream data to the video networking server, and the video networking server is configured to send the second audio/video stream data to the video networking terminal based on the video networking communication path.

In this embodiment, after the soft terminal successfully logs in, the soft terminal may automatically start the camera of the terminal to collect a video, and send the collected second audio/video stream data to the streaming media server through the soft terminal, where the second audio/video stream data is the audio/video stream data conforming to the internet protocol, and the streaming media server may be configured to convert the audio/video data conforming to the internet protocol into a video networking data packet conforming to the video networking protocol, and send the video networking data packet to the video networking terminal through a video networking communication path.

By adopting the embodiment, the audio and video service interaction with the video network terminal is established through the audio and video service operation of the web client, and the audio and video data transmission is carried out through the soft terminal and the video network terminal. And further, data interaction between the terminal and the video network terminal is realized.

With reference to the above embodiment, in an implementation manner, the web client is further communicatively connected to a web server, and before step 601, the following steps may be further included:

step 600a, sending a first service invitation message to the web server through the web client.

Wherein the first service invitation information comprises a plurality of user identifications; the web server is used for sending the first service invitation information to a first web client corresponding to the user identification and receiving a confirmation signaling returned by the first web client aiming at the first service invitation information; wherein the confirmation signaling comprises a terminal identifier of the terminal according to the first web client.

In this embodiment, the user may send out an offer of the audio/video service to another terminal at the web client, for example, in a video conference, the user may send out a conference offer to another user through the web client, and in a live broadcast, the user may publish own live broadcast information through the web client. Specifically, the user may select a user name of a target user to invite to participate in the audio/video service on the web client, and further generate first service invitation information through the web client, and send the first service invitation information to the web server. Wherein the user identification may uniquely identify the user registered on the web client.

The web server may be configured to send the first service invitation information to a first web client (hereinafter referred to as a target user) corresponding to the user identifier. The first web client may display the first service invitation information to facilitate the user to confirm the first service invitation information, and may return a confirmation signaling when the user confirms the first service invitation information.

In practice, the terminal identifier carried in the confirmation signaling may be an address uniquely identifying the terminal where the first web client is installed, or may be an identifier uniquely identifying the user information that logs in the first web client.

Step 600b, receiving the acknowledgement signaling returned by the web server through the web client.

Accordingly, step 601 may include the steps of:

step 6011', according to an audio/video service start operation performed by a user on the web client for the confirmation signaling, the terminal identifier in the confirmation signaling is obtained, and service parameter information including the user information and the terminal identifier is generated.

Accordingly, step 602 may include the steps of:

step 602', in response to the start of the audio/video service, starting the soft terminal through the web client, and logging in the started soft terminal by using the user information.

In this embodiment, when the terminal obtains the confirmation signaling fed back by the target user after sending the first service invitation information to the target user, the terminal may generate the service parameter information according to the audio/video service start operation performed by the user on the web client for the confirmation signaling, and start the soft terminal when obtaining the audio/video service start operation performed by the user for the confirmation signaling. The service parameter information may include a terminal identifier fed back by the acknowledgement signaling.

Accordingly, step 603 may comprise the steps of:

step 603', sending service parameter information to the bridge server through the web client, where the bridge server is configured to send the service parameter information to the streaming media server, and the streaming media server is configured to establish a first audio/video communication path of a terminal corresponding to each terminal identifier, and is configured to receive the first audio/video stream data collected by the terminal corresponding to each terminal identifier based on the first audio/video communication path.

In this embodiment, when the terminal obtains the confirmation signaling of the target user, the terminal starts to operate according to the video service of the confirmation signaling by the user, and sends service parameter information to the streaming media server, so that the streaming media server establishes the first audio/video communication path of the terminal corresponding to the terminal identifier, and thus, the streaming media server can provide audio/video service for the terminal and the terminal corresponding to the terminal identifier. In specific implementation, the terminal can receive video stream data which is sent by the streaming media server and is acquired and coded by the terminal corresponding to the terminal identifier through the soft terminal.

By adopting the embodiment, the terminal can send the service invitation to the target user, and can start the soft terminal according to the operation of the user on the confirmation signaling under the condition of obtaining the confirmation signaling of the target user aiming at the service invitation, and receive the audio and video stream collected and sent by the terminal of the target user through the soft terminal, thereby widening the application scene of the terminal in the audio and video service, and enabling the terminal to start the soft terminal through a web client when the terminal is used as an initiator of the audio and video service.

In combination with the above embodiment, in an implementation manner, the web client is further communicatively connected to a web server, and before step 601, the method may further include the following steps:

step 600', receiving, by the web client, a service start instruction sent by the web server.

The business instruction is generated and sent by the second web client; and the service starting instruction comprises a terminal identifier of a terminal for installing the second web client.

In this embodiment, when another user logs in on the web client, the web client is referred to as a second web client, and the web client installed on the terminal may also receive a service start instruction sent by the second web client and forwarded via the web server, that is, the web client may send service request information to another target user, and may also receive a service start instruction from another user, so as to serve as an invited party to participate in the audio/video service.

The service start instruction may include a terminal identifier of a terminal where the second web client is located, where the terminal identifier may be an address identifier uniquely identifying the terminal, or an identifier of a user logging in the second web client, for example, a user ID. And when the user ID is the user ID, the terminal provided with the second web client can also adopt the soft terminal to receive and send audio and video stream data.

Accordingly, step 601 may include the steps of:

step 6011 ", according to a service confirmation operation performed by a user on the web client for the service start instruction, acquiring the terminal identifier of the service start instruction, and generating service parameter information including the user information and the terminal identifier.

Accordingly, step 602 may include the steps of:

step 602', in response to the service confirmation operation, starting the soft terminal through the web client.

In this embodiment, the terminal may start the soft terminal according to a service confirmation operation of the user on the service start instruction, and feed back service parameter information to the streaming media server, so that the streaming media server establishes a communication path with the terminal according to the service parameter information, and confirms that the terminal and the terminal equipped with the second web client are in a bilateral relationship for performing audio/video service interaction according to the terminal identifier in the service parameter information, thereby providing a service for audio/video interaction between the terminal and the terminal equipped with the second web client.

By adopting the embodiment, the terminal can also receive the service starting instruction from the second web client, the soft terminal can be started according to the service confirmation operation of the user on the service starting instruction, and the audio and video stream collected and sent by the terminal where the second web client is located is received by the soft terminal, so that the application scene of the terminal in the audio and video service is widened, and the soft terminal can be started by the web client when the terminal is used as an invited party of the audio and video service.

As shown in fig. 8, the example of the processing method of the audio/video service provided in this embodiment in combination with a specific application scenario of the audio/video service is shown, where the audio/video service is a video conference service, and the method completely includes the following steps:

the first step is that the android mobile phone generates meeting invitation information which accords with an internet protocol according to video meeting initiating operation of a user A on a web client, wherein the meeting invitation information comprises a user identification of a user B.

And secondly, the web server sends the meeting invitation information to a web client which is logged in by the user B on the apple cellphone.

And thirdly, when the user B confirms the conference invitation information, the apple mobile phone returns a confirmation signaling to the web server through the web client, and starts the soft terminal B installed on the apple through the web client according to the confirmation operation. Wherein, the confirmation signaling comprises a user ID according to the user B;

and fourthly, the android mobile phone receives a confirmation signaling returned by the web server through the web client, automatically starts a soft terminal A installed on the android mobile phone through the web client when the user A starts operation of the video conference aiming at the confirmation signaling, and sends conference parameter information to the bridge server, wherein the conference parameter information comprises the user ID of the user B and the user ID of the user A.

And fifthly, the bridge server sends the conference parameter information to a video network server, the video network server sends the conference parameter information to a pre-registered streaming media server, and the streaming media server respectively establishes a first communication path between the streaming media server and a soft terminal A on the android mobile phone and a second communication path between the streaming media server and a soft terminal B on the apple mobile phone according to the conference parameter information.

And sixthly, the android mobile phone sends the video stream collected and coded by the android mobile phone to a streaming media server through the soft terminal A, and receives the video stream sent by the apple mobile phone through the soft terminal B through the streaming media server so as to realize the video conference.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

Referring to fig. 9, a block diagram of a processing apparatus for audio and video services according to an embodiment of the present invention is shown, where the apparatus is applied to any one of a plurality of terminals in a video service system, the terminal is installed with a web client and a soft terminal, the soft terminal is in communication connection with a streaming media server, the web client is in communication connection with a bridge server, and the apparatus includes:

a service information generating module 901, configured to perform an audio/video service operation on the web client by a user to generate service parameter information, where the service parameter information includes user information, and the user information is user information currently logged in the web client;

a soft terminal starting module 902, which responds to the audio/video service operation, starts the soft terminal through the web client, and logs in the started soft terminal by using the user information;

a parameter information sending module 903, configured to send service parameter information to the bridge server through the web client, where the bridge server is configured to send the service parameter information to the streaming server;

a video receiving module 904, configured to receive, by the soft terminal, at least one first audio/video stream data sent by the streaming media server according to the user information; the first audio and video stream data are collected by at least one terminal which establishes a communication path with the streaming media server in advance and are sent to the streaming media server.

Optionally, the soft terminal starting module includes:

Optionally, the video network server is connected with a plurality of video network terminals: the service information generation module comprises:

the parameter information sending module is specifically configured to send the first service parameter information to the bridge server through the web client, where the bridge server is configured to convert the first service parameter information into second service parameter information conforming to an internet of view protocol, and send the second service parameter information to the internet of view server; the video network server is used for establishing a video network communication path between video network terminals corresponding to each video network number and establishing communication with the streaming media server based on the second service parameter information;

the device further comprises:

Optionally, the web client is further communicatively connected to a web server, and the apparatus further includes:

the invitation information sending module is used for sending first service invitation information to the web server through the web client; wherein the first service invitation information comprises a plurality of user identifications; the web server is used for sending the first service invitation information to a first web client corresponding to the user identification and receiving a confirmation signaling returned by the first web client aiming at the first service invitation information; wherein the confirmation signaling comprises a terminal identifier of the terminal according to the first web client;

the confirmation signaling receiving module is used for receiving the confirmation signaling returned by the web server through the web client;

the service information generating module is specifically configured to start operating according to an audio/video service performed by a user on the web client for the confirmation signaling, acquire the terminal identifier in the confirmation signaling, and generate service parameter information including the user information and the terminal identifier;

the soft terminal starting module is specifically used for starting the soft terminal through the web client in response to the start of the operation of the audio and video service, and logging in the started soft terminal by adopting the user information;

the parameter information sending module is specifically configured to send service parameter information to the bridge server through the web client, the bridge server is configured to send the service parameter information to the streaming media server, and the streaming media server is configured to establish a first audio/video communication path of a terminal corresponding to each terminal identifier and receive first audio/video stream data acquired by the terminal corresponding to each terminal identifier based on the first audio/video communication path.

Optionally, the apparatus further comprises:

a service start instruction receiving module, configured to receive, by the web client, a service start instruction sent by the web server; the business instruction is generated and sent by the second web client; the service starting instruction comprises a terminal identifier of a terminal for installing the second web client;

the service information generating module is specifically configured to obtain the terminal identifier of the service start instruction according to a service confirmation operation performed by a user on the web client for the service start instruction, and generate service parameter information including the user information and the terminal identifier;

and the soft terminal starting module is specifically used for responding to the service confirmation operation and starting the soft terminal through the web client.

For the embodiment of the processing device of the audio and video service, because the embodiment is basically similar to the embodiment of the processing method of the audio and video service, the description is relatively simple, and relevant points can be referred to only by partial description of the embodiment of the processing method of the audio and video service.

An embodiment of the present invention further provides an apparatus, including:

one or more processors; and

one or more machine readable media having instructions stored thereon, which when executed by the one or more processors, cause the apparatus to perform one or more methods of processing audiovisual services in accordance with embodiments of the present invention.

The embodiment of the invention also provides a computer-readable storage medium, and a stored computer program enables a processor to execute the processing method of the audio and video service according to the embodiment of the invention.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one of skill in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The method for processing an audio/video service, the device for processing an audio/video service, and the computer-readable storage medium provided by the present invention are described in detail above, and specific examples are applied herein to illustrate the principles and embodiments of the present invention, and the description of the above embodiments is only used to help understand the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A processing method of audio and video services is characterized in that the method is applied to any one of a plurality of terminals in an audio and video service system, a web client and a soft terminal are installed on the terminal, the soft terminal is in communication connection with a streaming media server, the web client is in communication connection with a bridging server, the bridging server and the streaming media server are both in communication connection with a video network server, and the method comprises the following steps:

receiving at least one first audio/video stream data sent by the streaming media server according to the user information through the soft terminal; the first audio and video stream data is collected by at least one terminal which establishes a communication path with the streaming media server in advance and is sent to the streaming media server;

the video network server is used for establishing video network communication paths between video network terminals corresponding to the video network numbers and establishing communication with the streaming media server based on second service parameter information; the second service parameter information is converted from the first service parameter information through the bridging server; the first service parameter information comprises the user information and a video networking number; the video networking number uniquely identifies the video networking terminal.

2. The method of claim 1, wherein in response to the audio/video service operation, starting the soft terminal through the web client, and logging in the started soft terminal with the user information comprises:

acquiring an interface identifier corresponding to the hyperlink through the web client according to clicking operation of a user on the hyperlink;

3. The method of claim 1, wherein a plurality of video networking terminals are connected to the video networking server: generating service parameter information according to audio and video service operation performed by a user on the web client, wherein the service parameter information comprises:

generating first service parameter information conforming to an internet protocol;

the first service parameter information is sent to the bridge server through the web client, and the bridge server is used for converting the first service parameter information into second service parameter information conforming to a video networking protocol and sending the second service parameter information to the video networking server;

the method further comprises the following steps:

4. The method according to claim 1, wherein the web client is further communicatively connected to a web server, and before the step of generating the service parameter information according to the audio/video service operation performed by the user on the web client, the method further comprises:

sending first service invitation information to the web server through the web client; wherein the first service invitation information comprises a plurality of user identifications; the web server is used for sending the first service invitation information to a first web client corresponding to the user identification and receiving a confirmation signaling returned by the first web client aiming at the first service invitation information; wherein the confirmation signaling comprises a terminal identifier of the terminal according to the first web client;

sending service parameter information to the bridge server through the web client, wherein the bridge server is used for sending the service parameter information to the streaming media server, and the method comprises the following steps:

5. The method according to claim 4, wherein before the step of generating service parameter information according to the audio/video service operation performed by the user on the web client, the method further comprises:

acquiring the terminal identification of the service starting instruction according to service confirmation operation aiming at the service starting instruction on the web client by a user, and generating service parameter information comprising the user information and the terminal identification;

6. The utility model provides a processing apparatus of audio frequency and video business, its characterized in that, the device is applied to any one terminal in a plurality of terminals in the video service system, install web client and soft terminal on the terminal, soft terminal and streaming media server communication connection, web client and bridging server communication connection, the device includes:

the service information generation module is used for performing audio and video service operation on the web client by a user to generate service parameter information, wherein the service parameter information comprises user information, and the user information is user information currently logged in the web client;

the video receiving module is used for receiving at least one first audio and video stream data sent by the streaming media server according to the user information through the soft terminal; the first audio and video stream data is collected by at least one terminal which establishes a communication path with the streaming media server in advance and is sent to the streaming media server;

the video network server is used for establishing video network communication paths between video network terminals corresponding to the video network numbers and establishing communication with the streaming media server based on the second service parameter information; the second service parameter information is converted from the first service parameter information through the bridging server; the first service parameter information comprises the user information and a video networking number; the video networking number uniquely identifies the video networking terminal.

7. The apparatus of claim 6, wherein the soft terminal start module comprises:

8. The apparatus of claim 6, wherein the plurality of terminals are communicatively connected to a video networking server, and the service information generating module comprises:

the service parameter information generating unit is used for generating first service parameter information which accords with an internet protocol;

the parameter information sending module is specifically configured to send the first service parameter information to the bridge server through the web client, where the bridge server is configured to convert the first service parameter information into second service parameter information conforming to an internet of view protocol, and send the second service parameter information to the internet of view server;

the device further comprises:

9. An apparatus, comprising:

one or more processors; and

one or more machine readable media having instructions stored thereon, which when executed by the one or more processors, cause the apparatus to perform a method of processing audiovisual services according to one or more of claims 1 to 5.

10. A computer-readable storage medium, characterized in that it stores a computer program causing a processor to execute the processing method of an audio-visual service according to any one of claims 1 to 5.