CN114884924A - Audio and video channel selection method and device, electronic equipment and storage medium - Google Patents
Audio and video channel selection method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN114884924A CN114884924A CN202210434941.0A CN202210434941A CN114884924A CN 114884924 A CN114884924 A CN 114884924A CN 202210434941 A CN202210434941 A CN 202210434941A CN 114884924 A CN114884924 A CN 114884924A
- Authority
- CN
- China
- Prior art keywords
- audio
- video channel
- video
- participant
- multimedia conference
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000010187 selection method Methods 0.000 title description 6
- 238000000034 method Methods 0.000 claims abstract description 51
- 238000004364 calculation method Methods 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 2
- 239000000126 substance Substances 0.000 claims 1
- 238000011161 development Methods 0.000 abstract description 8
- 230000006870 function Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 7
- 238000004891 communication Methods 0.000 description 3
- 238000003745 diagnosis Methods 0.000 description 3
- 239000003999 initiator Substances 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000037361 pathway Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1069—Session establishment or de-establishment
Abstract
The embodiment of the invention discloses a method and a device for selecting an audio/video channel, electronic equipment and a storage medium. Acquiring a multimedia conference creating request reported by an application user side, wherein the multimedia conference creating request comprises a first audio and video channel set, participant identifications and participant types, and the participant types comprise necessary participation and non-necessary participation; sending a channel report notice to a participant user side corresponding to the participant identifier, acquiring a second audio and video channel set of which all participant types are the types of participation users needing to participate, and calculating the intersection of the first audio and video channel set and the second audio and video channel set; and determining a target audio and video channel adopted by the multimedia conference according to the number and the priority of the audio and video channels contained in the intersection. The embodiment of the invention can reduce the complexity of the development of the video related function and improve the portability of the program for realizing the audio and video related function.
Description
Technical Field
The embodiment of the invention relates to the field of communication, in particular to a method and a device for selecting an audio/video channel, electronic equipment and a storage medium.
Background
With the development of the mobile internet, the traffic cost is lower and lower, and a lot of real-time audio and video software or APPs (applications) are bred for providing new types of services, for example, for implementing remote consultation or intelligent diagnosis and the like.
In the Development of real-time audio and video Software or APP, the Development period and system operation cost of a product are generally reduced by integrating a third-party audio and video SDK (Software Development Kit). However, there are many types of third-party audio/video SDKs, different types of audio/video SDKs may be integrated according to different application scenarios, and versions of the third-party audio/video SDKs are also continuously improved and iterated, and it may occur that clients of different users integrate different versions of the same type of audio/video SDKs. In practical application, the client needs to judge the channel type and version of the audio/video SDK and decide whether a multimedia conference can be established, so that the complexity of development of audio/video related functions is improved, the portability of programs for realizing the audio/video related functions is reduced, and the use experience of the client is seriously influenced.
Disclosure of Invention
Embodiments of the present invention provide a method and an apparatus for selecting an audio/video channel, an electronic device, and a storage medium, which enable a client to be better compatible with an application program in terms of audio and video, solve the problems of unfixed audio channel and poor network communication experience caused by continuous update of an application program version, reduce the complexity of development of related audio/video functions, and improve the portability of a program for implementing related audio/video functions.
In a first aspect, an embodiment of the present invention provides a method for selecting an audio/video channel, where the method includes: acquiring a multimedia conference creation request reported by an application client, wherein the multimedia conference creation request comprises a first audio and video channel set, participant identifications and participant types, and the participant types comprise necessary participation and non-necessary participation;
sending a channel report notice to a participating user side corresponding to the participant identifier, acquiring a second audio and video channel set of which all participant types are the participating user sides needing to participate, and calculating the intersection of the first audio and video channel set and the second audio and video channel set;
and determining a target audio and video channel adopted by the multimedia conference according to the number and the priority of the audio and video channels contained in the intersection.
In a second aspect, an embodiment of the present invention further provides a device for selecting an audio/video channel, where the device includes:
the request acquisition module is used for executing and acquiring a multimedia conference creation request reported by an application user side, wherein the multimedia conference creation request comprises a first audio and video channel set, participant identifications and participant types, and the participant types comprise necessary participation and non-necessary participation;
the channel calculation module is used for executing sending of a channel report notification to a participating user side corresponding to the participant identifier, acquiring a second audio and video channel set reported by the participating user side of which all participating types are necessary to participate, and calculating an intersection of the first audio and video channel set and the second audio and video channel set;
and the channel determining module is used for determining a target audio and video channel adopted by the multimedia conference according to the number and the priority of the audio and video channels contained in the intersection.
In a third aspect, an embodiment of the present invention further provides an electronic device, where the electronic device includes:
one or more processors;
a memory for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement the method for selecting an audio-video channel according to the first aspect.
In a fourth aspect, the embodiment of the present invention further provides a computer readable medium, and when being executed by a processor, the computer program implements the method for selecting an audio/video channel according to the first aspect.
The embodiment of the invention provides a method and a device for selecting audio and video channels, electronic equipment and a storage medium, wherein a multimedia conference creating request reported by an application user side is obtained, wherein the multimedia conference creating request comprises a first audio and video channel set, participant identifications and participant types, and the participant types comprise necessary participation and non-necessary participation; sending a channel report notice to a participant user side corresponding to the participant identifier, acquiring a second audio and video channel set of which all participant types are the types of participation users needing to participate, and calculating the intersection of the first audio and video channel set and the second audio and video channel set; and determining a target audio and video channel adopted by the multimedia conference according to the number and the priority of the audio and video channels contained in the intersection. By the embodiment of the invention, the intersection of the acquired first audio and video channel set and the second audio and video channel set is calculated, and the final target audio and video channel is determined according to the number and the priority of the audio and video channels contained in the intersection, so that the problems of unfixed audio channel and poor network conversation experience caused by the continuous updating process of the application program version are solved, the complexity of video related function development can be reduced, and the portability of the program for realizing the audio and video related functions is improved.
Drawings
Fig. 1 is a schematic flow chart of a method for selecting an audio/video channel according to a first embodiment of the present invention;
fig. 2 is a service architecture diagram of a method for selecting an audio/video channel, to which an embodiment of the present invention is applicable;
fig. 3 is a system flow diagram of a method for selecting an audio/video channel, which is applicable to the embodiment of the present invention;
fig. 4 is a flowchart of a decision algorithm of an audio/video channel selection method applicable to the embodiment of the present application;
fig. 5 is a schematic flow chart of a method for selecting an audio/video channel according to a third embodiment of the present invention;
fig. 6 is a schematic flow chart of a method for selecting an audio/video channel according to a fourth embodiment of the present invention;
fig. 7 is a schematic structural diagram of a selection device of an audio/video channel in a fifth embodiment of the present invention;
fig. 8 is a diagram illustrating a result of an electronic device according to a sixth embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example one
Fig. 1 is a flowchart of a method for selecting an audio/video channel according to an embodiment of the present invention, where this embodiment is applicable to a scenario of performing remote consultation or intelligent diagnosis through audio/video, and the method may be implemented by using the architecture shown in fig. 2, and as shown in fig. 2, a service architecture for implementing audio/video channel selection includes modules shown in the diagram, such as an audio/video SDK module, a service module, a third-party audio/video room service module, and a basic service module, where the basic service module provides basic services supported by services for the service module, the basic services specifically include a distributed cache, a message MQ, a session message IM, a database, a configuration service, a user service, a service framework, an RPC framework, a gateway service, a delay task, and the like, and the services that the service module can implement specifically include event reporting, a monitoring platform, event distribution, room management, and the like, Channel decision and channel management, etc.
The method provided by the embodiment of the invention can be executed by a selection device of an audio/video channel, the selection device of the audio/video channel can be realized by software and/or hardware, and the selection device of the audio/video channel can be configured in electronic equipment under normal conditions. For example, the electronic device may be a server. As shown in fig. 1, the method includes:
s101, a multimedia conference creating request reported by an application user side is obtained, wherein the multimedia conference creating request comprises a first audio and video channel set, participant identifications and participant types, and the participant types comprise necessary participation and non-necessary participation.
In the multimedia conference, the members participating in the conference can communicate with each other through audio and video. The application client can be a client of a multimedia conference initiator, and the participation client can be a client of a multimedia conference participant. Third-party audio and video SDKs are integrated in the application client and the participation client. For example, the third-party audio/video SDK includes Native SDKs, H5 SDKs, and other channel types, and further, the third-party audio/video SDK of each channel type includes a first version (version1.0, abbreviated as V1.0), a second version (version2.0, abbreviated as V2.0), a third version (version3.0, abbreviated as V3.0), … …, and other channel versions. If the multimedia conference is to be created successfully, the application user side needs to report the audio/video channel information supported by the application user side to the server, the participation user side also needs to report the audio/video channel information supported by the participation user side to the server, and the multimedia conference can be created only when the audio/video channels of the application user side and the participation user side meet set conditions. For example, when the channel types and the channel versions of the audio and video channels of the two channels are consistent, the two channels are determined to meet the set condition. The form of the multimedia conference may be a real-time conference or a live broadcast, and the application is not limited in this respect. In this embodiment, a multimedia conference creation request of an application client is obtained by a server, and the server obtains a first audio/video channel set, a participant identifier, and a participant type in the multimedia conference creation request. The first audio/video channel set is a set of audio/video SDK channel information supported by the application user side. Specifically, the audio/video SDK channel information includes type and version information of the audio/video SDK, and the like. The participant identification is used to identify a participant of the multimedia conference. The participant type information comprises necessary participation and non-necessary participation, and is configured by the multimedia conference initiator through the application user terminal. In an alternative embodiment, a specific flag may be set for the identification of the required participants to distinguish between the required participants and the non-required participants.
In this embodiment, a multimedia conference creation request of an application client is obtained through a server, wherein the multimedia conference request may further include a service identifier and a service type; the service identification can be a unique mark for service data generated in a service processing process, wherein the service identification can be a string of random number sequences embodied in an ID form; the service type may be various service parties, which may include but are not limited to internal doctors, external doctors, internet doctors, home care and good welfare. Based on the service identification and the service type, a corresponding room number list can be inquired, each room corresponds to one virtual number, and rooms of each multimedia conference can be distinguished through the room virtual numbers.
And S102, sending a channel report notice to a participating user terminal corresponding to the participant identifier, acquiring a second audio and video channel set reported by the participating user terminal with all participating types being necessary, and calculating the intersection of the first audio and video channel set and the second audio and video channel set.
And the channel reporting notice is used for informing the participating user terminals of reporting the audio/video SDK channel information. The participating clients include clients of essential participants and clients of non-essential participants. The second set of audio/video channels is a set of audio/video SDK channel information that the participating client side must support. Specifically, the audio/video SDK channel information includes an audio/video SDK type, version information, and the like.
For example, obtaining the second set of audio/video channels reported by the participating clients that all participant types must participate may include: determining the number of necessary participants based on the participant identification and the participant type, and setting a counter according to the number of necessary participants; acquiring a second audio/video channel set of which the participant type is the type of the participant needing to participate and reported by a participant user side, calculating a union set of the second audio/video channel sets reported by the same participant through different participant user sides, and taking the union set of the second audio/video channel sets as a second audio/video channel set corresponding to the participant needing to participate; updating a counter according to the number of necessary participants reporting the second audio and video channel set; and when the counter is cleared, determining to acquire a second audio and video channel set reported by the participating user terminals of which all the participant types are necessary.
For example, if the type of the necessary participant is 5, the server sets a counter with a count value of 5. When the server acquires the channel information reported by a participating user side, whether the acquired channel information is a second audio/video channel set, the participant type of which is the type that the participant needs to participate in, reported by the participating user side is judged based on whether the participant identifier corresponding to the participating user side has a specific mark. If so, subtracting 1 from the count value of the counter, otherwise, keeping the count value unchanged. In addition, the server determines whether the participants report the channel information through different participating clients based on the corresponding relationship between the participating clients and the participants, if so, calculates the union of the channel information reported by different participating clients of the same participant, and takes the union of the channel information reported by different participating clients of the same participant as the channel information of the corresponding participant. When the server acquires channel information reported by a participating user side, whether the acquired channel information is a second audio/video channel set which needs to participate in the reporting of the participating user side is judged in the same way. And if so, decrementing the count value of the counter by 1, and determining to acquire all the second audio and video channel sets which need to participate and are reported by the participating user terminals when the count value of the counter is zero. And when the server acquires the channel information reported by one participating user terminal, judging whether the acquired channel information is the channel information reported by the same participant through different participating user terminals. And for the same participant, acquiring channel information of the corresponding participant through a channel information union set reported by different participant user sides.
In this embodiment, the server queries the database based on the participant identifier reported by the application client to obtain the corresponding participant client identifier, and sends a notification of reporting the audio/video channel information to the corresponding participant client. Acquiring the report Message of the participating user terminal, and storing the report Message to be processed of the participating user terminal into MQ (Message Queue) and/or IM (Instant Messaging). Fig. 3 is a system flowchart for selecting an audio/video channel according to an embodiment of the present invention, and as shown in fig. 3, an application client serves as an initiator to send a multimedia conference creation request to a server, and manages the multimedia conference creation requests reported by each application client through a session message IM. The server sends channel report notice to the user terminal of the necessary participant and the user terminal of the unnecessary participant. For convenience of description, the user sides of essential participants and the user sides of non-essential participants are denoted by P1, P2, and P3. And the user sides of the necessary participants and the user sides of the unnecessary participants receive the channel report notification and actively report the audio and video SDK channel information to the server. And the server respectively sends the audio and video SDK channel information sent by the P1, the P2 and the P3 to a message queue MQ. It should be noted that, for the audio/video SDK channel information with the same service identifier, service type, and participant identifier in the message queue, the audio/video SDK channel information reported by the same participant user side belongs to the audio/video SDK channel information. And only one piece of audio and video SDK channel information is stored for the audio and video SDK channel information reported by the user side of the same participant. And analyzing the report message to be processed to obtain a participant identifier and an audio/video channel set. Determining a participant type according to a participant identification, determining the number of necessary participants based on the participant identification and the participant type, starting a counter based on the number of necessary participants set by an application user terminal in advance, wherein the number starting counter can be the total number of the necessary participants set by the application user terminal, and subtracting 1 from the total number of the counter when determining that an audio/video channel set is a second audio/video channel set reported by the necessary participating user terminal according to the participant type. And when the number of the counters is 0, determining to acquire all the second audio and video channel sets which must participate and are reported by the participating user terminals.
For example, calculating the intersection of the first set of audiovisual channels and the second set of audiovisual channels may include: and if the preset time is exceeded and the participating user terminals which must participate do not report the second audio/video channel set, determining that the establishment fails due to overtime. And if all participating user terminals which need to participate report the second audio and video channel sets within the preset time, calculating the intersection of the first audio and video channel set and all the second audio and video channel sets. If the intersection is empty, the creation fails.
Specifically, the first audio/video channel set is { (Native SDK, V2.0), (H5SDK, V1.0), (H5SDK, V2.0) }, the second audio/video channel set reported by P1 is { (Native SDK, V1.0) }, the second audio/video channel set reported by P2 is { (Native SDK, V2.0), (H5SDK, V1.0) }, and the second audio/video channel set reported by P3 is { (Native SDK, V2.0), (H5SDK, V1.0) }. Calculating { (Native SDK, V2.0), (H5SDK, V1.0), (H5SDK, V2.0) } { (Native SDK, V1.0) } { (Native SDK, V2.0), (H5SDK, V1.0), (H5SDK, V2.0) }, and determining that the creation fails because the calculation result is an empty set.
Continuing with the above example, assuming that the second audio/video channel set reported by P1 becomes { (Native SDK, V2.0) }, and other second audio/video channel sets are not changed, then { (Native SDK, V2.0), (H5SDK, V1.0), (H5SDK, V2.0) } { (Native SDK, V2.0), (H5SDK, V1.0), (H5SDK, V2.0) }, and the calculation result is { (Native SDK, V2.0) }.
Continuing with the above example, assuming that the second set of audio/video channels reported by P1 becomes { (Native SDK, V2.0), (H5SDK, V1.0) }, and the other second sets of audio/video channels are unchanged, then { (Native SDK, V2.0), (H5SDK, V1.0), (H5SDK, V2.0) } { (Native SDK, V2.0), (H5SDK, V1.0), (H5SDK, V2.0) }, and the calculation result is { (Native SDK, V2.0), (H5SDK, V1.0) }.
And S103, determining a target audio and video channel adopted for creating the multimedia conference according to the number and the priority of the audio and video channels contained in the intersection.
The priority of the audio and video channel can be determined based on the channel quality, transmission rate and other attribute characteristics of the audio and video channel. The priority list of each audio/video channel is recorded in the server in advance, and the priority of the audio/video channels with different channel types, different channel versions and different channel types and different channel versions is stored through the priority list.
Exemplarily, S103 may include: and if the number of the audio and video channels contained in the intersection is at least two, determining the audio and video channel with the highest priority in the at least two audio and video channels as a target audio and video channel, and establishing the multimedia conference through the target audio and video channel. The multimedia conference can be applied to intelligent diagnosis, remote consultation and the like, and intelligent medical treatment is realized.
In one case, if one of the at least two audio/video channels has the highest priority, the audio/video channel with the highest priority is used as a target audio/video channel, and a multimedia conference is created through the target audio/video channel.
In another case, if there are at least two audio/video channels with the highest priority, a third audio/video channel set reported by a participating user terminal with a participant type of unnecessary participation is obtained. Optionally, a union set is taken for a third audio-video channel set reported by the same participant through different participating clients, and the union set is used as the third audio-video channel set reported by the corresponding participant. And determining a first number of each audio-video channel with the highest priority in the third audio-video channel set, determining a second number of each audio-video channel with the highest priority in the second audio-video channel set, and calculating the number of the audio-video channels with the highest corresponding priority according to the first number and the second number of each audio-video channel with the highest priority. And taking the audio and video channel with the largest number in the at least two audio and video channels with the highest priority as a target audio and video channel so as to establish the multimedia conference through the target audio and video channel. Continuing to use the above example, assuming that the priorities of the audio/video channels (Native SDK, V2.0) and (H5SDK, V1.0) are the same, then the numbers of (Native SDK, V2.0) and (H5SDK, V1.0) in the second audio/video channel set and the numbers of (Native SDK, V2.0) and (H5SDK, V1.0) in the third audio/video channel set, which are reported by the participating user end, are counted respectively, so as to calculate the statistics of (Native SDK, V2.0) and (H5SDK, V1.0) respectively, and the audio/video channel with the largest statistics is used as the target audio/video channel, so as to create the multimedia conference through the target audio/video channel.
Fig. 4 is a flowchart of a decision algorithm of an audio/video channel selection method applicable to the embodiment of the present application, and as shown in fig. 4, the flowchart shows a process in which after a second audio/video channel set is reported at all clients that must participate, the first audio/video channel set and the second audio/video communication set are sent to a decision module, the decision module determines whether there is an optimal channel, and a multimedia conference is created based on the optimal channel.
Exemplarily, the determining, as the target audio/video channel, an audio/video channel with the highest priority in the at least two audio/video channels may include: determining an audio/video channel with the highest priority in at least two audio/video channels; if the number of the at least two audio and video channels with the highest priority is available, respectively determining the first number of each audio and video channel with the highest priority in a third audio and video channel set reported by a participant user side, wherein the participant type is not necessary to participate, respectively determining the second number of each audio and video channel with the highest priority in a second audio and video channel set, and calculating the number of the audio and video channels with the highest corresponding priority according to the first number and the second number of each audio and video channel with the highest priority; judging whether the number of at least two audio/video channels with the highest priority is equal or not; if so, randomly selecting one of the at least two audio/video channels with the highest priority as a target audio/video channel; otherwise, the audio/video channel with the largest number in the at least two audio/video channels with the highest priority is taken as the target audio/video channel.
The method comprises the steps of establishing a multimedia conference through a target audio and video channel, determining a room virtual number of the multimedia conference, sending a room establishing success message carrying the room virtual number to a message queue MQ, and sending the room establishing success message to each participating user terminal through the message queue MQ.
It should be noted that, if the creation fails, a create room failure message is sent to the message queue MQ, and the create room failure message is sent to each participating user end through the message queue MQ.
According to the technical scheme, a multimedia conference creating request reported by an application user side is obtained, wherein the multimedia conference creating request comprises a first audio and video channel set, participant identifications and participant types, and the participant types comprise necessary participation and non-necessary participation; sending a channel report notice to a participating user terminal corresponding to the participant identifier, acquiring a second audio and video channel set reported by all participating user terminals which need to participate, and calculating the intersection of the first audio and video channel set and the second audio and video channel set; and determining a target audio and video channel adopted by the multimedia conference according to the number and the priority of the audio and video channels contained in the intersection. According to the embodiment of the invention, the final target audio and video channel is determined according to the quantity and priority of the audio and video channels contained in the intersection of the first audio and video channel set and the second audio and video channel set, so that the problems of unfixed audio channel and poor network conversation experience caused by the continuous updating process of the application program version are solved, the complexity of video related function development can be reduced, and the portability of the program for realizing the audio and video related functions can be improved.
Example two
Fig. 5 is a flowchart of a method for selecting an audio/video channel according to a second embodiment of the present invention, which is based on the foregoing embodiments. And further optimizing the multimedia conference request reported by the application client. Wherein explanations of the same or corresponding terms as those of the above embodiments are omitted. Referring to fig. 5, the method for selecting an audio/video channel provided in this embodiment specifically includes the following steps:
s201, taking any multimedia conference creating request acquired within the set timeout time as a current multimedia conference creating request, and generating a key value of the current multimedia conference creating request according to a service identifier and a service type in the current multimedia conference creating request.
The method comprises the steps of presetting the waiting overtime time of a conference creating request, wherein the overtime time can be flexibly set according to needs, and if the set overtime time is exceeded, the creating failure due to overtime is determined. If any multimedia conference creation request can be acquired within the set timeout period as the current multimedia conference creation request; the key value may be a unique identifier for identifying the multimedia conference creation request, and may be obtained by splicing the service identifier and the service type, or may be obtained by calculating an information entropy of the service identifier and the service type.
For example, each multimedia conference creation request acquired within the set timeout period may be used as a current multimedia conference creation request, and a service identifier and a key value of a service type in the current multimedia conference creation request are calculated.
S202, generating key values of other multimedia conference creating requests based on the service identifications and the service types in the other multimedia conference creating requests within the set timeout time.
Wherein, the other multimedia conference can be the multimedia conference creation request left in addition to the current multimedia conference creation request within the set timeout. And calculating key values of the requests of other multimedia conferences based on the service identifications and the service types in the requests of other multimedia conferences.
S203, judging whether the key value of at least one other multimedia conference creating request is the same as the key value of the current multimedia conference creating request, if so, executing S205, otherwise, executing S206.
S204, abandoning the execution of other multimedia conference creation requests with at least one key value same as that of the current multimedia conference creation request.
In this embodiment, the key value of the current multimedia conference creation request is compared with the key values of at least one other multimedia conference creation request, and according to the comparison result, if the key values are the same, all other multimedia conference creation requests with the key values being the same as the key value of the current multimedia conference creation request are abandoned. If not, at least one other multimedia conference creation request continues to be processed.
And S205, sending a channel report notice to the participating user terminals corresponding to the participant identifiers, acquiring all second audio and video channel sets which need to participate in the reporting of the participating user terminals, and calculating the intersection of the first audio and video channel set and the second audio and video channel set.
And S206, determining a target audio and video channel adopted by the multimedia conference according to the number and the priority of the audio and video channels contained in the intersection.
According to the technical scheme of the embodiment, the key values of the multimedia conference creating requests in the set timeout period are compared, so that only one multimedia conference is allowed to be created for the multimedia conference creating requests of the same business identifier of the same applicant, and the problem that the applicant repeatedly sends the multimedia conference creating requests for the same business to waste computing resources is solved.
Optionally, after obtaining the multimedia conference creation request reported by the application client, the method may further include: inquiring a multimedia conference list according to the service identification and the service type in the multimedia conference establishing request; and if the corresponding target multimedia conference is inquired, sending the created prompt information of the multimedia conference to the application user side.
In this embodiment, in a case where a query has created multimedia conference information, a search page may be displayed on the application client, so that the user may input a search term, and the application client sends the search term to the server. Specifically, the search term may include a service identifier, a service type, a participant identifier, and the like.
Exemplarily, one or more of a service identifier, a service type and a participant identifier sent by an application user side are obtained; and inquiring the multimedia conference list according to one or more of the service identifier, the service type and the participant identifier, and sending the inquired target multimedia conference information to the application user side.
Specifically, the server can accurately query the corresponding target multimedia conference information in the multimedia conference list through the service identifier and the service type, and send the target multimedia conference information to the application client. Or, the server performs fuzzy query based on the participant identification or the service type, and sends the queried multi-media conference information to the application client.
EXAMPLE III
Fig. 6 is a flowchart of a method for selecting an audio/video channel according to a third embodiment of the present invention, where this embodiment specifically defines a method for selecting an audio/video channel that participates in reporting by a user terminal in the foregoing embodiment. As shown in fig. 6, the method includes:
s301, acquiring audio and video channels reported by necessary participants and unnecessary participants.
And S302, for the same participant, acquiring a union set through audio and video channels reported by different participant clients.
The different participating clients may be a main client, an applet client, and the like on the same user equipment.
And S303, judging whether audio and video channels reported by all the participating clients of the participants are acquired, if so, executing S304, and otherwise, executing S313.
S304, the audio-video channel in the multimedia conference creating request and the audio-video channels reported by the participating user terminals of all the necessary participants are intersected.
And S305, judging whether the intersection is an empty set, if not, executing S306, and otherwise, executing S313.
And S306, judging whether the number of the audio and video channels in the intersection is equal to 1, if so, executing S307, and otherwise, executing S308.
And if only one audio-video channel exists in the intersection, taking the audio-video channel as the optimal audio-video channel.
And S307, establishing the multimedia conference based on the optimal audio and video channel.
And S308, taking at least two audio and video channels in the intersection as candidate audio and video channels.
And S309, judging whether only one candidate audio/video channel with the highest priority exists, if so, executing S307, and otherwise, executing S310.
And if only one audio/video channel with the highest priority is available in the candidate audio/video channels, taking the candidate audio/video channel with the highest priority as the optimal audio/video channel.
And S310, respectively counting the number of at least two candidate audio/video channels with the highest priority in the audio/video channels reported by the necessary participants and the unnecessary participants.
And S311, judging whether the candidate audio/video channels with the largest number and the highest priority exist, if so, executing S307, and otherwise, executing S312.
And if the candidate audio/video channels with the maximum number and the highest priority exist, taking the candidate audio/video channels with the maximum number and the highest priority as the optimal audio/video channels.
And S312, randomly selecting one of at least two candidate audio and video channels with highest priority and maximum number as an optimal audio and video channel, and then executing S307.
S313, a prompt message of failure in establishing the multimedia conference is sent to the application user side.
According to the technical scheme of the embodiment, the audio and video channels are selected based on the participant types and the channel priorities, so that all necessary participants can be ensured to join the multimedia conference, and more unnecessary participants can be allowed to join the multimedia conference.
Example four
Fig. 7 is a schematic structural diagram of a device for selecting an audio/video channel according to a fourth embodiment of the present invention. The selection device of the audio/video channel may be implemented by software and/or hardware, and in general, the selection device of the audio/video channel may be configured in an electronic device. For example, the electronic device may be a server.
The selection device for an audio/video channel provided by the fourth embodiment of the present invention may execute the selection method for an audio/video channel provided by any embodiment of the present invention, and the device may specifically include the following modules:
a request obtaining module 401, configured to execute obtaining a multimedia conference creation request reported by an application user side, where the multimedia conference creation request includes a first audio/video channel set, a participant identifier, and a participant type, and the participant type includes an essential participation type and a non-essential participation type;
a channel calculation module 402, configured to execute sending a channel report notification to a participating user side corresponding to a participant identifier, obtain a second audio/video channel set reported by the participating user side for which all participant types need to participate, and calculate an intersection of the first audio/video channel set and the second audio/video channel set;
and a channel determining module 403, configured to determine, according to the number and priority of the audio/video channels included in the intersection, a target audio/video channel used for creating the multimedia conference.
In an embodiment of the present invention, after the request obtaining module 401, the method further includes:
a key value creating unit, configured to execute any multimedia conference creating request obtained within a set timeout period as a current multimedia conference creating request, and generate a key value of the current multimedia conference creating request according to a service identifier and a service type in the current multimedia conference creating request;
the key value calculation unit is used for executing the generation of the key value of each other multimedia conference creation request based on the service identifier and the service type in the other multimedia conference creation request within the set overtime;
and the key value judging unit is used for executing that if the key value of at least one other multimedia conference creating request is the same as the key value of the current multimedia conference creating request, the execution of the at least one other multimedia conference creating request is abandoned.
In one embodiment of the invention, the apparatus further comprises:
the list query unit is used for querying a multimedia conference list according to the service identifier and the service type in the multimedia conference creation request after the multimedia conference creation request reported by the application user side is acquired;
and the prompt information sending unit is used for sending the established prompt information of the multimedia conference to the application user side if the corresponding target multimedia conference is inquired.
In one embodiment of the invention, the channel calculation module 402 includes:
a counter setting unit for performing determination of the necessary participant number based on the participant identification and the participant type, and setting a counter according to the necessary participant number;
the channel calculation unit is used for executing the steps of acquiring a second audio and video channel set reported by a participant user terminal with a participant type of necessary participation, calculating a union set of the second audio and video channel sets reported by the same participant through different participant user terminals, and taking the union set of the second audio and video channel sets as a second audio and video channel set corresponding to the necessary participant;
the counter updating unit is used for updating the counter according to the number of necessary participants reporting the second audio and video channel set;
and the counter zero clearing unit is used for determining and acquiring a second audio and video channel set reported by the participating user terminals of which all the participant types are necessary to participate when the counter is cleared.
In one embodiment of the present invention, the channel determination module 303 comprises:
and the target channel determining unit is used for determining the audio and video channel with the highest priority in the at least two audio and video channels as a target audio and video channel if the number of the audio and video channels contained in the intersection is at least two, and establishing the multimedia conference through the target audio and video channel.
In one embodiment of the present invention, the target pathway determination unit includes:
the priority determining subunit is used for determining the audio/video channel with the highest priority in the at least two audio/video channels;
the channel number counting operator unit is used for respectively determining the first number of each audio and video channel with the highest priority in a third audio and video channel set reported by a participant type non-necessarily participating user terminal if the number of at least two audio and video channels with the highest priority exists, respectively determining the second number of each audio and video channel with the highest priority in a second audio and video channel set, and calculating the number of the audio and video channels with the highest corresponding priority according to the first number and the second number of each audio and video channel with the highest priority;
the channel number judging subunit is used for executing judgment on whether the number of the at least two audio/video channels with the highest priority is equal or not; if so, randomly selecting one of the at least two audio/video channels with the highest priority as a target audio/video channel; otherwise, the audio and video channel with the largest quantity in the at least two audio and video channels with the highest priority is taken as the target audio and video channel.
In one embodiment of the present invention, the target passage determining unit includes:
the target audio and video channel determination subunit is used for determining that the audio and video channels in the intersection are the target audio and video channels if the intersection comprises one audio and video channel; and if the intersection set is an empty set, determining that the multimedia conference is failed to be created.
The selection device of the audio and video channel provided by the embodiment of the invention can execute the selection method of the audio and video channel provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method.
EXAMPLE five
Fig. 8 is a schematic structural diagram of an electronic device according to a fifth embodiment of the present invention, as shown in fig. 8, the electronic device includes a processor 500, a memory 510, an input device 520, and an output device 530; the number of the processors 500 in the device may be one or more, and one processor 500 is taken as an example in fig. 8; the processor 500, the memory 510, the input device 520 and the output device 530 may be connected by a bus or other means, and fig. 8 illustrates an example of a connection by a bus.
The memory 510 is a computer-readable storage medium, and can be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to a method for selecting an audio/video channel in an embodiment of the present invention (for example, the request obtaining module 410, the channel calculating module 420, and the channel determining module 430 in a device for selecting an audio/video channel). The processor 500 executes software programs, instructions and modules stored in the memory 510, so as to execute various functional applications of the device and select an audio/video channel, that is, implement the above-mentioned method for selecting an audio/video channel.
The memory 510 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Further, the memory 510 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, memory 510 may further include memory located remotely from processor 500, which may be connected to devices through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 520 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function controls of the apparatus. The output device 530 may include a display device such as a display screen.
EXAMPLE six
An embodiment of the present invention further provides a storage medium containing computer-executable instructions, which when executed by a computer processor, perform a method for selecting an audio-video channel, the method including:
acquiring a multimedia conference creating request reported by an application user side, wherein the multimedia conference creating request comprises a first audio and video channel set, participant identifications and participant types, and the participant types comprise necessary participation and non-necessary participation;
sending a channel report notice to a participant user side corresponding to the participant identifier, acquiring a second audio and video channel set of which all participant types are the types of participation users needing to participate, and calculating the intersection of the first audio and video channel set and the second audio and video channel set;
and determining a target audio and video channel adopted by the multimedia conference according to the number and the priority of the audio and video channels contained in the intersection.
Of course, the storage medium provided in the embodiment of the present invention includes computer-executable instructions, and the computer-executable instructions are not limited to the method operations described above, and may also perform related operations in a method for selecting an audio/video channel provided in any embodiment of the present invention.
From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the methods according to the embodiments of the present invention.
It should be noted that, in the embodiment of the selection device for an audio/video channel, each unit and each module included in the selection device are only divided according to functional logic, but are not limited to the above division, as long as corresponding functions can be realized; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. A method for selecting an audio/video channel is characterized by comprising the following steps:
acquiring a multimedia conference creating request reported by an application user side, wherein the multimedia conference creating request comprises a first audio and video channel set, participant identifications and participant types, and the participant types comprise necessary participation and non-necessary participation;
sending a channel report notice to a participating user side corresponding to the participant identifier, acquiring a second audio and video channel set of which all participant types are the participating user sides needing to participate, and calculating the intersection of the first audio and video channel set and the second audio and video channel set;
and determining a target audio and video channel adopted by the multimedia conference according to the number and the priority of the audio and video channels contained in the intersection.
2. The method of claim 1, further comprising, after obtaining the multimedia conference creation request reported by the application client:
taking any multimedia conference creation request acquired within a set timeout period as a current multimedia conference creation request, and generating a key value of the current multimedia conference creation request according to a service identifier and a service type in the current multimedia conference creation request;
generating key values of other multimedia conference creating requests based on the service identifications and the service types in the other multimedia conference creating requests within the set timeout time;
and if the key value of at least one other multimedia conference creation request is the same as that of the current multimedia conference creation request, giving up the execution of the at least one other multimedia conference creation request.
3. The method of claim 1, further comprising, after obtaining the multimedia conference creation request reported by the application client:
inquiring a multimedia conference list according to the service identification and the service type in the multimedia conference establishing request;
and if the corresponding target multimedia conference is inquired, sending the multimedia conference created prompt information to the application user side.
4. The method according to claim 1, wherein the obtaining the second set of audio/video channels reported by the participating clients that all participant types must participate comprises:
determining the number of necessary participants based on the participant identification and the participant type, and setting a counter according to the number of necessary participants;
acquiring a second audio/video channel set which is reported by a participant user terminal and the participant type of which is necessary to participate, calculating a union set of the second audio/video channel sets reported by the same participant through different participant user terminals, and taking the union set of the second audio/video channel sets as a second audio/video channel set corresponding to the necessary participant;
updating the counter according to the number of necessary participants reporting the second audio and video channel set;
and when the counter is cleared, determining to acquire a second audio and video channel set reported by the participating user terminals of which all the participant types are necessary.
5. The method according to claim 1, wherein the determining a target audio/video channel used for creating a multimedia conference according to the number and priority of the audio/video channels included in the intersection comprises:
and if the number of the audio and video channels contained in the intersection is at least two, determining the audio and video channel with the highest priority in the at least two audio and video channels as the target audio and video channel, and establishing the multimedia conference through the target audio and video channel.
6. The method according to claim 5, wherein the determining that the audio/video channel with the highest priority in the at least two audio/video channels is the target audio/video channel comprises:
determining the audio/video channel with the highest priority in the at least two audio/video channels;
if at least two audio/video channels with the highest priority exist, respectively determining a first number of each audio/video channel with the highest priority in a third audio/video channel set reported by a participant user end with the participant type of unnecessary participation, respectively determining a second number of each audio/video channel with the highest priority in a second audio/video channel set, and calculating the number of the audio/video channels with the highest corresponding priority according to the first number and the second number of each audio/video channel with the highest priority;
judging whether the number of at least two audio/video channels with the highest priority is equal or not;
if so, randomly selecting one of the at least two audio/video channels with the highest priority as a target audio/video channel;
otherwise, the audio/video channel with the largest number in the at least two audio/video channels with the highest priority is used as the target audio/video channel.
7. The method according to claim 1, wherein the determining a target audio/video channel used for creating a multimedia conference according to the number and priority of the audio/video channels included in the intersection comprises:
if the intersection comprises an audio and video channel, determining the audio and video channel in the intersection as a target audio and video channel;
and if the intersection set is an empty set, determining that the multimedia conference is failed to be established.
8. An apparatus for selecting an audio/video channel, comprising:
the request acquisition module is used for executing and acquiring a multimedia conference creation request reported by an application user side, wherein the multimedia conference creation request comprises a first audio and video channel set, participant identifications and participant types, and the participant types comprise necessary participation and non-necessary participation;
the channel calculation module is used for executing sending of a channel report notification to a participating user side corresponding to the participant identifier, acquiring a second audio and video channel set reported by the participating user side of which all participant types are necessary to participate, and calculating an intersection of the first audio and video channel set and the second audio and video channel set;
and the channel determining module is used for determining a target audio and video channel adopted by the multimedia conference according to the number and the priority of the audio and video channels contained in the intersection.
9. An electronic device, characterized in that the electronic device comprises:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the method of selecting an audiovisual channel of any of claims 1-7.
10. A computer-readable storage medium, having stored thereon computer instructions for causing a processor, when executing the computer instructions, to implement the method for selecting an audio-visual channel according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210434941.0A CN114884924A (en) | 2022-04-24 | 2022-04-24 | Audio and video channel selection method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210434941.0A CN114884924A (en) | 2022-04-24 | 2022-04-24 | Audio and video channel selection method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114884924A true CN114884924A (en) | 2022-08-09 |
Family
ID=82672638
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210434941.0A Pending CN114884924A (en) | 2022-04-24 | 2022-04-24 | Audio and video channel selection method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114884924A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116582639A (en) * | 2023-07-13 | 2023-08-11 | 深圳星网信通科技股份有限公司 | Conference control method, terminal device and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090316872A1 (en) * | 2008-06-20 | 2009-12-24 | International Business Machines Corporation | Descriptive audio channel for use with multimedia conferencing |
| US20160227161A1 (en) * | 2013-09-05 | 2016-08-04 | Huawei Device Co., Ltd. | Method and Apparatus for Transmitting Media Stream in Video Conference |
| CN107707868A (en) * | 2016-08-08 | 2018-02-16 | 中国电信股份有限公司 | Video conference Adding Way, multiple access Conference server and video conferencing system |
| CN111245851A (en) * | 2020-01-13 | 2020-06-05 | 广州视源电子科技股份有限公司 | Multi-terminal audio transmission method and device, terminal equipment and storage medium |
| CN114040192A (en) * | 2021-11-08 | 2022-02-11 | 中国工商银行股份有限公司 | Method, device, equipment, medium and program product for pressure measurement of audio and video conference |
-
2022
- 2022-04-24 CN CN202210434941.0A patent/CN114884924A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090316872A1 (en) * | 2008-06-20 | 2009-12-24 | International Business Machines Corporation | Descriptive audio channel for use with multimedia conferencing |
| US20160227161A1 (en) * | 2013-09-05 | 2016-08-04 | Huawei Device Co., Ltd. | Method and Apparatus for Transmitting Media Stream in Video Conference |
| CN107707868A (en) * | 2016-08-08 | 2018-02-16 | 中国电信股份有限公司 | Video conference Adding Way, multiple access Conference server and video conferencing system |
| CN111245851A (en) * | 2020-01-13 | 2020-06-05 | 广州视源电子科技股份有限公司 | Multi-terminal audio transmission method and device, terminal equipment and storage medium |
| CN114040192A (en) * | 2021-11-08 | 2022-02-11 | 中国工商银行股份有限公司 | Method, device, equipment, medium and program product for pressure measurement of audio and video conference |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116582639A (en) * | 2023-07-13 | 2023-08-11 | 深圳星网信通科技股份有限公司 | Conference control method, terminal device and storage medium |
| CN116582639B (en) * | 2023-07-13 | 2023-11-07 | 深圳星网信通科技股份有限公司 | Conference control method, terminal device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9055155B2 (en) | Collaborative conference experience improvement | |
| WO2018133306A1 (en) | Dispatching method and device in content delivery network | |
| CN109561320B (en) | Server switching method, device, equipment and medium | |
| KR20070005690A (en) | System and method for chat load management in a network chat environment | |
| CN110545327B (en) | Information pushing method and system | |
| CN105635180A (en) | Message pushing method and device | |
| CN111679916B (en) | Video recommendation method, target service providing terminal, service calling terminal and system | |
| WO2021227785A1 (en) | Indicator collection processing method and apparatus for streaming media, computer and storage medium | |
| CN109446204B (en) | Data storage method and device for instant messaging, electronic equipment and medium | |
| CN114884924A (en) | Audio and video channel selection method and device, electronic equipment and storage medium | |
| CN112689202A (en) | Live broadcast room message processing method and device, server and storage medium | |
| CN113573093A (en) | Live broadcast data analysis method and device, electronic equipment and storage medium | |
| US20160182440A1 (en) | Terminal Status Subscription Method, Apparatus, and System | |
| CN110784517B (en) | Service application integration method, system, terminal and storage medium based on block chain | |
| CN106789913B (en) | User account management method and device | |
| CN113794939B (en) | Data processing method, device, electronic equipment and computer readable storage medium | |
| CN105898596B (en) | Direct broadcasting room display control method and device | |
| CN114697282B (en) | Message processing method and system, storage medium and electronic device | |
| CN112169312A (en) | Queuing scheduling method, device, equipment and storage medium for cloud game service | |
| CN113132745B (en) | Live broadcast service system, method and server | |
| CN103391481A (en) | Data interaction method, device and system based on real-time messaging protocol | |
| CN114697281B (en) | Text message processing method and device, storage medium and electronic device | |
| CN114554230B (en) | Method, device, terminal, computer equipment and storage medium for processing wheat connecting state | |
| CN112019791A (en) | Multi-party audio and video call method and system based on education examination | |
| KR102134552B1 (en) | System and method for transmitting message capable of seperate accounting |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |