CN115914539A - Method and system for scheduling resources of audio and video equipment - Google Patents
Method and system for scheduling resources of audio and video equipment Download PDFInfo
- Publication number
- CN115914539A CN115914539A CN202211212949.9A CN202211212949A CN115914539A CN 115914539 A CN115914539 A CN 115914539A CN 202211212949 A CN202211212949 A CN 202211212949A CN 115914539 A CN115914539 A CN 115914539A
- Authority
- CN
- China
- Prior art keywords
- mcu
- instruction
- conference
- equipment
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 68
- 230000006854 communication Effects 0.000 claims description 17
- 238000004891 communication Methods 0.000 claims description 17
- 238000012545 processing Methods 0.000 claims description 14
- 238000012544 monitoring process Methods 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 11
- 238000011156 evaluation Methods 0.000 claims description 10
- 238000003860 storage Methods 0.000 claims description 9
- 238000012795 verification Methods 0.000 claims description 7
- 238000004458 analytical method Methods 0.000 claims description 6
- 238000006243 chemical reaction Methods 0.000 claims description 5
- 230000036541 health Effects 0.000 claims description 4
- 238000009826 distribution Methods 0.000 claims description 3
- 230000000977 initiatory effect Effects 0.000 claims description 3
- 238000003032 molecular docking Methods 0.000 abstract description 4
- 230000008569 process Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 238000005304 joining Methods 0.000 description 4
- 240000007087 Apium graveolens Species 0.000 description 3
- 235000015849 Apium graveolens Dulce Group Nutrition 0.000 description 3
- 235000010591 Appio Nutrition 0.000 description 3
- 238000012423 maintenance Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000001174 ascending effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007175 bidirectional communication Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Abstract
The embodiment of the invention relates to the technical field of equipment management, and discloses a method for scheduling audio and video equipment resources, which comprises the following steps: receiving an conference entering request instruction sent by a conference session end through a call control gateway; performing call interception on the conference entering request instruction at the call control gateway based on a preset call rule and a preset forwarding rule to judge whether the corresponding terminal meets the access requirement; when the meeting entering request instruction is judged to meet the calling rule, all MCU concurrent resources in the MCU resource pool are obtained; the method comprises the steps that an instruction distribution center communicates with an MCU of a corresponding type through sending an instruction or calling an application program interface; and if the threshold value is exceeded, feeding back alarm information to the request end. The method for scheduling the resources of the audio and video equipment in the embodiment of the invention can be used for docking MCUs of various different brands by presetting various different application program interfaces, so that the allowed resources of the audio and video media equipment can be intelligently scheduled, and the self supporting capability of the equipment and the allowed utilization rate of the equipment can be effectively controlled.
Description
Technical Field
The invention relates to the technical field of equipment management, in particular to a method and a system for scheduling audio and video equipment resources.
Background
At present, video conference technology is more and more mature; and meetings in different areas are also widely applied; however, there are many MCUs (multipoint control units) of different brands on the market, and the MCUs of different brands may involve the effective utilization of resources, the MCU resource status and the safety problem during the conference; how to efficiently perform resource management and call on MCUs of different brands and ensure information security in the whole conference process becomes a technical problem to be urgently solved by technical personnel in the field.
Disclosure of Invention
Aiming at the defects, the embodiment of the invention discloses a method for scheduling resources of audio and video equipment, which can realize efficient resource utilization and effectively control the self supporting capability of the equipment and the permitted utilization rate of the equipment.
The first aspect of the embodiments of the present invention discloses a method for scheduling resources of an audio/video device, including:
receiving an conference entering request instruction sent by a conference session end through a call control gateway; the session terminal comprises one or more of an IP telephone, a mobile terminal, a computer terminal or an integrated terminal;
performing call interception on the conference entering request instruction at the call control gateway based on a preset call rule and a preset forwarding rule to judge whether the corresponding terminal meets the access requirement;
when the conference entering request instruction is judged to meet the calling rule, acquiring all MCU concurrent resources in an MCU resource pool, wherein the MCU resource pool comprises a plurality of MCU units, and the MCU units are provided with different application program interfaces;
determining state information of all concurrent resources; if the concurrent resources are lower than a threshold value, allowing to increase a corresponding number of communication lines, and communicating with the MCU of a corresponding type in a form of sending an instruction or calling a corresponding application program interface in the instruction distribution center; and if the threshold value is exceeded, feeding back alarm information to the request end.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the performing, at the call control gateway, call interception on the conference entry request instruction based on a preset call rule and a preset forwarding rule to determine whether a corresponding terminal meets an access requirement includes:
analyzing the conference entering request instruction sent by each conference site end to determine the equipment information, the position information and the executable operation of the corresponding conference site end; the equipment information comprises a camera, a sound pickup device, a display device and a playing device; the position information comprises first position information, second position information and third position information; the executable operation comprises conference initiating, conference connecting, picture display selection and conference control;
judging the position information and the executable operation of each session terminal based on a preset calling rule and a preset forwarding rule to determine whether to intercept the call, wherein the calling rule comprises equipment information, equipment direction information associated with the equipment information and the executable operation; and the position information in the calling rule corresponds to the executable operation at the corresponding position information one by one;
and when the position information and the executable operation information both meet the calling rule, executing the next step.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after receiving, by the call control gateway, the conference entry request instruction sent by the breakout site, the method further includes:
analyzing whether the conference entering request instruction is an effective instruction, and when the conference entering request instruction is the effective instruction, performing instruction analysis conversion on the conference entering request instruction;
converting the conference entering request instruction into a target instruction which can be recognized by target equipment;
and sending the target instruction to a corresponding target MCU or target equipment.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the analyzing whether the conference entry request instruction is a valid instruction includes:
acquiring control instruction information of each MCU device in an MCU resource pool;
carrying out duplicate removal processing on the control instruction information to obtain an instruction verification set;
analyzing the conference entering request instruction to obtain instruction content;
and matching the instruction content with the instruction content in the verification set, wherein the conference entering request instruction is valid when a matching item exists.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the communicating, by the instruction distribution center, with the MCU of a corresponding type through a form of sending an instruction or invoking a corresponding application program interface includes:
configuring a corresponding decoder for each branch meeting place in the MCU unit; the decoder corresponds to each meeting place one by one;
the video meeting transmitted by each branch meeting place is transmitted to a combined picture controller, different display pictures are set for different branch meeting places based on preset distribution logic, a first picture is displayed at a first branch meeting place end, a second picture is displayed at a second branch meeting place end, and a third picture is displayed at a third branch meeting place end; the first picture is a picture of a second meeting place, the second picture is a picture of a first meeting place, and the third picture is a combined picture of the first meeting place, the second meeting place and the third meeting place;
and sending all the display picture information to a corresponding decoder for decoding and distributing to corresponding session terminals to realize mutual communication.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the method for scheduling resources further includes:
by adopting a queue task mode for sequential processing, when the request is allowed to pass, the call control gateway can reasonably forward the request to the MCU with sufficient resources in the MCU resource pool; the queue task mode is a celery task scheduling queue;
and/or, the method for resource scheduling further comprises:
when monitoring that the MCU occupancy in the MCU resource pool reaches a first threshold value, performing primary alarm;
and when the occupation amount of the MCU in the MCU resource pool is monitored to reach a second threshold value, performing secondary alarm, and automatically generating an equipment alarm record when the occupation permission of the MCU reaches a set threshold value.
As an optional implementation manner, in a first aspect of the embodiment of the present invention, the method for scheduling a device resource further includes:
performing dynamic resource monitoring once every preset time to determine resource occupation information in specific time;
and determining resource release information based on the resource occupation information and historical data conditions, and determining whether to perform alarm operation based on the resource occupation information and the resource release information.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the method for scheduling resources further includes:
acquiring current equipment state information;
performing state evaluation on the current equipment state based on the equipment state information and an equipment evaluation formula to determine a current equipment state index; the equipment evaluation formula is as follows:
wherein ,Hm Is an index of the state of the apparatus, H j For the performance index health value, I =1,2,3,4,5 is the CPU load, memory, disk I/O, network I/O and admission conditions, respectively; w is a i Is a weight value of the corresponding index, w j For alarm level, N j Identifying the alarm number under the corresponding level, wherein N is the total alarm number;
and determining whether to allow adding a new communication line according to the equipment state index.
The second aspect of the embodiments of the present invention discloses a system for scheduling resources of audio/video devices, which is characterized by comprising:
a receiving module: the conference access control gateway is used for receiving a conference access request instruction sent by the conference site end through the call control gateway; the session terminal comprises one or more of an IP telephone, a mobile terminal, a computer terminal or an integrated terminal;
an interception judgment module: the call control gateway is used for carrying out call interception on the conference entering request instruction on the basis of preset call rules and forwarding rules so as to judge whether the corresponding terminal meets the access requirement or not;
a concurrency acquisition module: the MCU resource pool comprises a plurality of MCU units, and the MCU units are provided with different application program interfaces;
a determination module: state information for determining all concurrent resources; if the concurrent resources are lower than the threshold value, the corresponding number of communication lines is allowed to be increased, and the instruction distribution center communicates with the MCU of the corresponding type by sending an instruction or calling a corresponding application program interface; and if the threshold value is exceeded, feeding back alarm information to the request end.
A third aspect of an embodiment of the present invention discloses an electronic device, including: a memory storing executable program code; a processor coupled with the memory; the processor calls the executable program code stored in the memory for executing the method for scheduling the resources of the audio and video device disclosed by the first aspect of the embodiment of the present invention.
A fourth aspect of the embodiments of the present invention discloses a computer-readable storage medium, which stores a computer program, where the computer program enables a computer to execute the method for scheduling resources of an audio and video device disclosed in the first aspect of the embodiments of the present invention.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
the method for scheduling the resources of the audio and video equipment in the embodiment of the invention can be used for docking MCUs of various different brands by presetting various different application program interfaces, so that the allowed resources of the audio and video media equipment can be intelligently scheduled, and the self supporting capability of the equipment and the allowed utilization rate of the equipment can be effectively controlled.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic flow chart of a method for scheduling resources of an audio/video device, disclosed in an embodiment of the present invention;
fig. 2 is a schematic specific flow chart of a method for scheduling resources of an audio/video device, disclosed in an embodiment of the present invention;
fig. 3 is a schematic diagram of another specific flow of a method for scheduling resources of an audio/video device, disclosed in an embodiment of the present invention;
FIG. 4 is a schematic flowchart of call interception according to an embodiment of the present invention;
FIG. 5 is a schematic flowchart of a communication connection between a terminal and an MCU according to an embodiment of the present invention;
FIG. 6 is a schematic structural diagram of interaction between a terminal and an MCU according to the embodiment of the present invention;
FIG. 7 is a schematic structural diagram of an output alarm disclosed in an embodiment of the present invention;
fig. 8 is a schematic structural diagram of an apparatus for scheduling resources of an audio/video device according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first", "second", "third", "fourth", and the like in the description and the claims of the present invention are used for distinguishing different objects, and are not used for describing a specific order. The terms "comprises," "comprising," and any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
There are many different brands of MCUs (multipoint control units) on the market today, and the many different brands of MCUs may involve efficient use of resources, MCU resource status, and security issues during the conference. Based on the above, the embodiment of the invention discloses a method and a device for scheduling resources of audio and video equipment, electronic equipment and a storage medium, wherein various different application program interfaces are preset so as to be capable of being connected with MCUs of various different brands, so that the allowed resources of the audio and video media equipment can be intelligently scheduled, and the self supporting capability of the equipment and the allowed utilization rate of the equipment are effectively controlled.
Example one
Referring to fig. 1, fig. 1 is a schematic flowchart of a method for scheduling resources of an audio/video device according to an embodiment of the present invention. The execution main body of the method described in the embodiment of the present invention is an execution main body composed of software or/and hardware, and the execution main body may receive related information in a wired or/and wireless manner and may send a certain instruction. Of course, it may also have certain processing and storage functions. The execution body may control a plurality of devices, such as a remote physical server or a cloud server and related software, or may be a local host or a server and related software for performing related operations on a device installed somewhere. In some scenarios, multiple storage devices may also be controlled, which may be co-located with the device or located in a different location. As shown in fig. 1 to fig. 3, the method for scheduling resources based on audio/video devices includes the following steps:
s101: receiving an conference entering request instruction sent by a conference session terminal through a call control gateway; the session terminal comprises one or more of an IP telephone, a mobile terminal, a computer terminal or an integrated terminal;
s102: performing call interception on the conference entering request instruction at the call control gateway based on a preset call rule and a preset forwarding rule to judge whether the corresponding terminal meets the access requirement;
when the conference system is implemented, the conference control gateway can receive conference joining request instructions sent by all the conference branch terminals, and determine whether the conference branches in different areas are qualified to enter the conference or not based on the conference joining request instructions.
In specific implementation, as shown in fig. 6, a bidirectional communication mode is adopted, a terminal actively joins in a conference and an MCU actively calls the terminal to enter the conference, all joining and disconnecting operations pass through a call control gateway, the gateway sets a call rule in advance, and forwards the rule, after a communication instruction meeting the call rule is intercepted, the inside is verified, and the current concurrent resource of the MCU is obtained, if the current concurrent resource does not reach a threshold, one-way call joining is allowed, and if the current concurrent resource does reach the threshold, the current concurrent resource is directly fed back to a request end, and no available resource exists. In the processing process, request interception is effectively carried out, the request sequence is controlled, and the queue task mode is adopted for sequential processing. When the request is allowed to pass, the call control gateway reasonably forwards the request to an MCU with sufficient resources in the MCU resource pool.
Except for the control instruction of the equipment, providing a calling gateway control unit of the audio and video equipment to intercept the communication between the client and the server of the equipment, verifying all instructions (calling and hanging) of the audio and video equipment influencing the permission by the calling gateway control unit, and allowing the instructions to be issued after the verification is passed.
More preferably, fig. 4 is a schematic flowchart of a call interception process disclosed in the embodiment of the present invention, and as shown in fig. 4, the performing call interception on the conference entering request instruction at the call control gateway based on a preset call rule and a preset forwarding rule to determine whether a corresponding terminal meets an access requirement includes:
s1021: analyzing the conference entering request instruction sent by each conference site end to determine the equipment information, the position information and the executable operation of the corresponding conference site end; the equipment information comprises a camera, a sound pickup device, a display device and a playing device; the position information comprises first position information, second position information and third position information; the executable operation comprises conference initiation, conference connection, picture display selection and conference control;
s1022: judging the position information and the executable operation of each branch session terminal based on a preset calling rule and a preset forwarding rule to determine whether to intercept the call, wherein the calling rule comprises equipment information, equipment direction information associated with the equipment information and the executable operation; and the position information in the calling rule is in one-to-one correspondence with the executable operation at the corresponding position information;
s1023: and when the position information and the executable operation information both meet the calling rule, executing the next step.
Specifically, different meeting place ends have different rule settings, for example, some meeting places can initiate a meeting, some meeting places cannot initiate a meeting, some meeting places can perform microphone closing or forced exit or video display on other meeting place ends, while some meeting place ends do not have such a function, different rules are set for different meeting place ends, and at different meeting place ends, the devices are allowed to be used, and are not allowed to be called, and also need to be set, and how to adjust instructions for multiple different brands of devices, for example, cameras, sound pickup devices, display devices, and playing devices all adopt different brands of devices, and because the meeting function needs to be provided, the instructions of various different matched devices need to be stored in advance, and the final instruction output needs to be detected to determine that each meeting place end device can accept a specific control signal. The adopted interception rules are regions, IP number sections and the like.
At the time of setting, the function division may be performed for the regions, such as in a first location region, which sets of operations it can perform are those, and in a second location region, which sets of operations it can perform are those; in the third location area there are those operations that it can perform, and when all these matches are completed, the next operation can be performed.
More preferably, after receiving the conference entry request command sent by the breakout site through the call control gateway, the method further includes:
analyzing whether the conference entering request instruction is an effective instruction, and when the conference entering request instruction is the effective instruction, performing instruction analysis conversion on the conference entering request instruction;
converting the conference entering request instruction into a target instruction which can be recognized by target equipment;
and sending the target instruction to a corresponding target MCU or target equipment.
More preferably, the analyzing whether the conference entry request instruction is a valid instruction includes:
acquiring control instruction information of each MCU device in the MCU resource pool;
carrying out duplicate removal processing on the control instruction information to obtain an instruction verification set;
analyzing the conference entering request instruction to obtain instruction content;
and matching the instruction content with the instruction content in the verification set, wherein the conference entering request instruction is valid when a matching item exists.
When the conference entering request instruction is an effective instruction, performing secondary analysis on the instruction, and converting the instruction into a target request instruction acceptable by target equipment; sending the target request instruction to the target MCU; the analysis and conversion of the instruction can be realized through the steps, and the data subjected to the analysis and conversion of the instruction is the instruction which can be realized by the target MCU or the target equipment.
S103: when the conference entering request instruction is judged to meet the calling rule, all MCU concurrent resources in an MCU resource pool are obtained, wherein the MCU resource pool comprises a plurality of MCU units, and the MCU units have different application program interfaces;
s104: determining state information of all concurrent resources; if the concurrent resources are lower than the threshold value, the corresponding number of communication lines is allowed to be increased, and the instruction distribution center communicates with the MCU of the corresponding type by sending an instruction or calling a corresponding application program interface; and if the threshold value is exceeded, feeding back alarm information to the request end.
According to different working modes of brands, an instruction distribution center communicates with large-brand equipment (such as meeting establishment, roll calling, mute, hang-up and monitoring states) through an instruction sending or Api calling mode, all instructions/interfaces are provided by an official party, notification and feedback data are cached in a Redis cache database through an active reading or passive receiving mode, logic processing, data acquisition, user pushing and the like are carried out through a multi-channel queue, and all brands are efficiently and stably managed and controlled in an integrated platform. Because different brands have different application program interfaces (API interfaces), a plurality of different API interfaces need to be stored in advance during implementation, so that during implementation, instructions are directly analyzed to determine which API interface needs to be called to implement corresponding communication connection.
Specifically, when the conference system is implemented, MCU resource use rules are configured, and equipment suitable for meeting participant resources and brands is automatically selected according to the number of participants of the conference. Then arranging the MCUs brought into the resource pool management in an ascending order according to the application occupancy rate; checking whether the MCU directly meeting the requirements exists, and if so, returning the MCU closest to the requirements; the invocation of resources can be realized.
More preferably, fig. 5 is a schematic flowchart of a communication connection between a terminal and an MCU, as shown in fig. 5, where the instruction distribution center communicates with the MCU of a corresponding type by sending an instruction or calling a corresponding application program interface, and the method includes:
s1041: configuring a corresponding decoder for each branch meeting place in the MCU unit; the decoder corresponds to each branch meeting place one by one;
s1042: the video meeting transmitted by each branch meeting place is transmitted to a combined picture controller, different display pictures are set for different branch meeting places based on preset distribution logic, a first picture is displayed at a first branch meeting place end, a second picture is displayed at a second branch meeting place end, and a third picture is displayed at a third branch meeting place end; the first picture is a picture of a second meeting place, the second picture is a picture of a first meeting place, and the third picture is a combined picture of the first meeting place, the second meeting place and the third meeting place;
s1043: and sending all the display picture information to a corresponding decoder for decoding and distributing to corresponding meeting field terminals to realize mutual communication.
The MCU allocates encoders for all meeting places, decodes and secondarily encodes each road code, and combines the lens combined picture controller into a plurality of picture forms, so that picture sharing of all meeting places can be realized, the single meeting place picture is not limited to be selected to be watched, the MCU coordinates resources, and the MCU can realize full-encoding and full-decoding; the adaptability of the conference system setting is greatly improved.
More preferably, the method for scheduling resources further includes:
by adopting the queue task mode for sequential processing, when the request is allowed to pass, the call control gateway can reasonably forward the request to the MCU with sufficient resources in the MCU resource pool; the queue task mode is a queue task scheduling queue;
in an embodiment of the invention, a task producer configures tasks in an annotated manner, which are added to a queue via a task scheduler; the message middleware is responsible for receiving and sending task progress messages and allocating tasks and sending the tasks to consumers; the maintenance management tool calls a monitoring task registered in the back end by using the autotask of the celery, and when the task is scheduled, a message is generated firstly, wherein the message comprises a function name of the task; after the message is distributed to the current idle consumer by the Redis task scheduler, monitoring that the scheduling of the alarm task is controlled by the celery; executing a starting command on an execution machine to generate a main process for managing tasks, and uniformly processing progress messages of a queue, restarting the tasks, registering the tasks and performing overtime processing by the main process; the monitoring alarm task is executed by a plurality of corresponding sub-processes to realize the monitoring alarm of the system. By means of the distributed queue, the distributed queue has higher performance, high availability and expandability, and the overall performance is more excellent.
And/or, the method for resource scheduling further comprises:
when monitoring that the MCU occupancy in the MCU resource pool reaches a first threshold value, performing primary alarm;
and when the occupation amount of the MCU in the MCU resource pool is monitored to reach a second threshold value, performing secondary alarm, and automatically generating an equipment alarm record when the occupation permission on the MCU reaches a set threshold value.
As shown in fig. 7, the alarm level of the MCU device is set, and when the allowable occupancy on the MCU reaches the set threshold, an device alarm record is automatically generated to notify the user that the device has been warned to make an early warning, so as to prevent the occurrence of an unexpected event on the device, which may result in too high concurrency on the device, and the running condition of the device may not be known in time. For example: setting the MCU device to concurrently permit 70 percent of the secondary alarms and more than 80 percent of the primary alarms. Through the alarm setting, the user can know the service condition of the equipment in time.
More preferably, the method for scheduling device resources further includes:
carrying out dynamic resource monitoring once every other preset time to determine resource occupation information in specific time;
and determining resource release information based on the resource occupation information and historical data conditions, and determining whether to perform alarm operation based on the resource occupation information and the resource release information.
Sometimes, although the resource occupation exceeds 70% and is not yet 80%, it is predicted that within the next half hour, the resource which may be released is 10%, that is, the final resource occupation may be less than 70% in a reasonable interval, and when such a situation occurs, no alarm operation may be performed. When the acquired data has a large basis, dynamic prediction can be performed on the acquired data, that is, the occupation amount of MCU resources in a future period of time is determined based on the number of the currently acquired conferences, and the resources can be more effectively and reasonably utilized through the dynamic prediction.
More preferably, the method for scheduling resources further includes:
acquiring current equipment state information;
performing state evaluation on the current equipment state based on the equipment state information and an equipment evaluation formula to determine a current equipment state index; the equipment evaluation formula is as follows:
wherein ,Hm Is an index of the state of the apparatus, H j For the performance index health value, I =1,2,3,4,5 is the CPU load, memory, disk I/O, network I/O and admission conditions, respectively; w is a i Is a weight value of the corresponding index, w j For alarm level, N j Identifying the alarm number under the corresponding level, wherein N is the total alarm number;
and determining whether to allow adding a new communication line according to the equipment state index.
In the implementation, the CPU state values are: h 1 ＝(1-v 1 ) 100, wherein v 1 The average load of the CPU every 5 minutes is the value after the total number of the cores of the multipoint control unit.
The state values of the memory are: h 2 ＝(1-v 2 ) 100, wherein v 2 Is the memory usage rate. The state values of the disk I/O are: h is a total of 3 ＝(1-v 3 130) × 100, where v 3 Real-time reading and writing rate for the MCU disk; the state value of the network I/O is H 4 ＝(1-v 4 10) × 100, wherein v 4 An implementation rate value for network I/O; the state values for the admission case are: h 5 ＝(1-v 5 2000) 100, wherein v 5 Is the number of conferences. Through the steps, the performance index health value of the integrated meeting condition of the CPU load, the memory, the disk I/O and the network I/O can be calculated, and thus, the corresponding calculation can be completed.
Specifically, in a production environment, the influence of CPU load, memory, disk I/O and network I/O on the conference condition is large, and the alarm levels are graded the same; the weights of the 5 indices at the time of setting are 0.225,0.1, respectively. The purpose of more accurate monitoring can be achieved through the weight setting.
Then, corresponding scores can be obtained through calculation according to an equipment evaluation formula, and the specific score grades comprise four grades, namely a first risk grade, a second risk grade, a third risk grade and a fourth risk grade; different state value intervals are set according to different grades, and different value intervals correspond to different maintenance strategies.
The equipment state is detected, and then a proper maintenance strategy is determined, so that the running stability of the whole system can be greatly improved. By the method, the MCU and each terminal under different networking environments can be fused into a multi-level cross-network-segment system, various conference capabilities are provided by combining cloud services, and the conference quality is ensured.
In the embodiment of the present invention, various items of detection data may be displayed in an imaging manner: video resources, audio resources, IP resources; the method is more visual through imaging display; the alarm record comprises an alarm name, alarm content and a host IP.
The method for scheduling the resources of the audio and video equipment in the embodiment of the invention can be used for docking MCUs of various different brands by presetting various different application program interfaces, so that the allowed resources of the audio and video media equipment can be intelligently scheduled, and the self supporting capability of the equipment and the allowed utilization rate of the equipment can be effectively controlled.
Example two
Referring to fig. 8, fig. 8 is a schematic structural diagram of an apparatus for scheduling resources of an audio/video device according to an embodiment of the present invention. As shown in fig. 8, the apparatus for scheduling resources of an audio-video device may include:
the receiving module 21: the conference entrance request command is used for receiving the conference entrance request command sent by the conference session terminal through the call control gateway; the session terminal comprises one or more of an IP telephone, a mobile terminal, a computer terminal or an integrated terminal;
the interception judgment module 22: the call control gateway is used for carrying out call interception on the conference entering request instruction on the basis of preset call rules and forwarding rules so as to judge whether the corresponding terminal meets the access requirement or not;
the concurrency acquisition module 23: the MCU resource pool comprises a plurality of MCU units, and the MCU units are provided with different application program interfaces;
the determination module 24: state information for determining all concurrent resources; if the concurrent resources are lower than a threshold value, allowing to increase a corresponding number of communication lines, and communicating with the MCU of a corresponding type in a form of sending an instruction or calling a corresponding application program interface in the instruction distribution center; and if the threshold value is exceeded, feeding back alarm information to the request end.
The method for scheduling the resources of the audio and video equipment in the embodiment of the invention can be used for docking MCUs of various different brands by presetting various different application program interfaces, so that the allowed resources of the audio and video media equipment can be intelligently scheduled, and the self supporting capability of the equipment and the allowed utilization rate of the equipment can be effectively controlled.
EXAMPLE III
Referring to fig. 9, fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure. The electronic device may be a computer, a server, or the like, and may also be an intelligent device such as a mobile phone, a tablet computer, a monitoring terminal, or the like, and an image acquisition device having a processing function. As shown in fig. 9, the electronic device may include:
a memory 510 storing executable program code;
a processor 520 coupled to the memory 510;
the processor 520 calls the executable program code stored in the memory 510 to execute part or all of the steps in the method for scheduling resources of an audio/video device in the first embodiment.
The embodiment of the invention discloses a computer-readable storage medium which stores a computer program, wherein the computer program enables a computer to execute part or all of the steps in the method for scheduling the resources of audio and video equipment in the first embodiment.
The embodiment of the invention also discloses a computer program product, wherein when the computer program product runs on a computer, the computer is enabled to execute part or all of the steps in the method for scheduling the resources of the audio and video equipment in the first embodiment.
The embodiment of the invention also discloses an application publishing platform, wherein the application publishing platform is used for publishing the computer program product, and when the computer program product runs on a computer, the computer is enabled to execute part or all of the steps in the method for scheduling the resources of the audio and video device in the first embodiment.
In various embodiments of the present invention, it should be understood that the sequence numbers of the processes do not mean the execution sequence necessarily in order, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be implemented in the form of hardware, and can also be implemented in the form of a software functional unit.
The integrated units, if implemented as software functional units and sold or used as a stand-alone product, may be stored in a computer accessible memory. Based on such understanding, the technical solution of the present invention, which is a part of or contributes to the prior art in essence, or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a memory and includes several requests for causing a computer device (which may be a personal computer, a server, a network device, or the like, and may specifically be a processor in the computer device) to execute part or all of the steps of the method according to the embodiments of the present invention.
In the embodiments provided herein, it should be understood that "B corresponding to a" means that B is associated with a, from which B can be determined. It should also be understood that determining B from a does not mean determining B from a alone, but may also be determined from a and/or other information.
Those of ordinary skill in the art will appreciate that some or all of the steps in the methods of the embodiments described herein may be implemented by hardware associated with a program that may be stored in a computer-readable storage medium, including a Read-Only Memory (ROM), a Random Access Memory (RAM), a Programmable Read-Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), a One-time Programmable Read-Only Memory (OTPROM), an electronically Erasable Programmable Read-Only Memory (EEPROM), an optical Disc-Read-Only Memory (CD-ROM) or other storage medium capable of storing data, a magnetic tape, or any other computer-readable medium capable of carrying a computer program or computer-readable data.
The method, the apparatus, the electronic device and the storage medium for scheduling resources of an audio and video device disclosed in the embodiments of the present invention are described in detail above, and specific examples are applied herein to explain the principle and the implementation of the present invention, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. A method for scheduling resources of audio and video equipment is characterized by comprising the following steps:
receiving an conference entering request instruction sent by a conference session end through a call control gateway; the session terminal comprises one or more of an IP telephone, a mobile terminal, a computer terminal or an integrated terminal;
performing call interception on the conference entering request instruction at the call control gateway based on a preset call rule and a preset forwarding rule to judge whether the corresponding terminal meets the access requirement;
when the conference entering request instruction is judged to meet the calling rule, acquiring all MCU concurrent resources in an MCU resource pool, wherein the MCU resource pool comprises a plurality of MCU units, and the MCU units are provided with different application program interfaces;
determining state information of all concurrent resources; if the concurrent resources are lower than a threshold value, allowing to increase a corresponding number of communication lines, and communicating with the MCU of a corresponding type in a form of sending an instruction or calling a corresponding application program interface in the instruction distribution center; and if the threshold value is exceeded, feeding back alarm information to the request end.
2. The method for scheduling resources of audio and video equipment according to claim 1, wherein the intercepting the call to the conference entering request instruction at the call control gateway based on the preset call rule and forwarding rule to determine whether the corresponding terminal meets the access requirement includes:
analyzing the conference entering request instruction sent by each conference site end to determine the equipment information, the position information and the executable operation of the corresponding conference site end; the equipment information comprises a camera, a sound pickup device, a display device and a playing device; the position information comprises first position information, second position information and third position information; the executable operation comprises conference initiation, conference connection, picture display selection and conference control;
judging the position information and the executable operation of each branch session terminal based on a preset calling rule and a preset forwarding rule to determine whether to intercept the call, wherein the calling rule comprises equipment information, equipment direction information associated with the equipment information and the executable operation; and the position information in the calling rule is in one-to-one correspondence with the executable operation at the corresponding position information;
and when the position information and the executable operation information both meet the calling rule, executing the next step.
3. The method for scheduling resources of an audio-video device according to claim 1, wherein after receiving, by the call control gateway, the conference entry request instruction sent by the session side, the method further includes:
analyzing whether the conference entering request instruction is an effective instruction, and when the conference entering request instruction is the effective instruction, performing instruction analysis conversion on the conference entering request instruction;
converting the conference entering request instruction into a target instruction which can be recognized by target equipment;
and sending the target instruction to a corresponding target MCU or target equipment.
4. The method for scheduling resources of an audio-visual device according to claim 3, wherein the analyzing whether the conference entry request command is a valid command includes:
acquiring control instruction information of each MCU device in the MCU resource pool;
carrying out duplication removal processing on the control instruction information to obtain an instruction verification set;
analyzing the conference entering request instruction to obtain instruction content;
and matching the instruction content with the instruction content in the verification set, wherein the conference entering request instruction is valid when a matching item exists.
5. The method for scheduling resources of an audio-video device according to claim 1, wherein the step of communicating with the MCU of the corresponding type by sending an instruction or calling a corresponding application program interface at the instruction distribution center comprises:
configuring a corresponding decoder for each branch meeting place in the MCU unit; the decoder corresponds to each branch meeting place one by one;
the video meeting transmitted by each branch meeting place is transmitted to a combined picture controller, different display pictures are set for different branch meeting places based on preset distribution logic, a first picture is displayed at a first branch meeting place end, a second picture is displayed at a second branch meeting place end, and a third picture is displayed at a third branch meeting place end; the first picture is a second meeting place picture, the second picture is a first meeting place picture, and the third picture is a combined picture of the first meeting place, the second meeting place and the third meeting place;
and sending all the display picture information to a corresponding decoder for decoding and distributing to corresponding meeting field terminals to realize mutual communication.
6. The method for resource scheduling for audio-visual devices according to claim 1, wherein the method for resource scheduling further comprises:
by adopting the queue task mode for sequential processing, when the request is allowed to pass, the call control gateway can reasonably forward the request to the MCU with sufficient resources in the MCU resource pool; the queue task mode is a queue task scheduling queue;
and/or, the method for resource scheduling further includes:
when monitoring that the MCU occupancy in the MCU resource pool reaches a first threshold value, performing primary alarm;
and when the occupation amount of the MCU in the MCU resource pool is monitored to reach a second threshold value, performing secondary alarm, and automatically generating an equipment alarm record when the occupation permission on the MCU reaches a set threshold value.
7. The method of audio video device resource scheduling of claim 6, wherein the method of device resource scheduling further comprises:
carrying out dynamic resource monitoring once every other preset time to determine resource occupation information in specific time;
and determining resource release information based on the resource occupation information and historical data conditions, and determining whether to perform alarm operation based on the resource occupation information and the resource release information.
8. The method for resource scheduling of audio-video equipment according to claim 6, wherein the method for resource scheduling further comprises:
acquiring current equipment state information;
performing state evaluation on the current equipment state based on the equipment state information and an equipment evaluation formula to determine a current equipment state index; the equipment evaluation formula is as follows:
wherein ,Hm Is an index of the state of the apparatus, H j For the performance index health value, I =1,2,3,4,5 is the CPU load, memory, disk I/O, network I/O and admission conditions, respectively; w is a i Is a weight value of the corresponding index, w j For alarm level, N j Identifying the alarm number under the corresponding level, wherein N is the total alarm number;
and determining whether to allow adding a new communication line according to the equipment state index.
9. A system for scheduling audio and video device resources, comprising:
a receiving module: the conference access control gateway is used for receiving a conference access request instruction sent by the conference site end through the call control gateway; the session terminal comprises one or more of an IP telephone, a mobile terminal, a computer terminal or an integrated terminal;
an interception judgment module: the system is used for carrying out call interception on the conference entering request instruction at the call control gateway based on a preset call rule and a preset forwarding rule so as to judge whether a corresponding terminal meets an access requirement or not;
a concurrency acquisition module: the MCU resource pool comprises a plurality of MCU units, and the MCU units are provided with different application program interfaces;
a determination module: state information for determining all concurrent resources; if the concurrent resources are lower than the threshold value, the corresponding number of communication lines is allowed to be increased, and the instruction distribution center communicates with the MCU of the corresponding type by sending an instruction or calling a corresponding application program interface; and if the threshold value is exceeded, feeding back alarm information to the request end.
10. A computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute the method for resource scheduling of an audio-video device according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211212949.9A CN115914539B (en) | 2022-09-30 | 2022-09-30 | Method and system for scheduling audio and video equipment resources |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211212949.9A CN115914539B (en) | 2022-09-30 | 2022-09-30 | Method and system for scheduling audio and video equipment resources |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115914539A true CN115914539A (en) | 2023-04-04 |
| CN115914539B CN115914539B (en) | 2023-11-03 |
Family
ID=86473345
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211212949.9A Active CN115914539B (en) | 2022-09-30 | 2022-09-30 | Method and system for scheduling audio and video equipment resources |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115914539B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116886318A (en) * | 2023-09-07 | 2023-10-13 | 广州云视通科技有限公司 | Control method for concurrent permission of audio and video equipment |
| CN117579705A (en) * | 2024-01-16 | 2024-02-20 | 四川并济科技有限公司 | System and method for dynamically scheduling servers based on batch data requests |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060233120A1 (en) * | 2005-04-19 | 2006-10-19 | Polycom Inc. | Multi-site conferencing system and method |
| US7174365B1 (en) * | 2000-11-08 | 2007-02-06 | Polycom Israel Ltd. | System and method for controlling one or more multipoint control units as one multipoint control unit |
| US20080084470A1 (en) * | 2006-09-27 | 2008-04-10 | Tandberg Telecom As | System, method and computer program for providing scalability in two or more streaming and/or archiving systems for video conference calls |
| CN106303360A (en) * | 2015-06-10 | 2017-01-04 | 中兴通讯股份有限公司 | Terminal meeting load-balancing method, Apparatus and system |
| CN106534759A (en) * | 2015-09-09 | 2017-03-22 | 中兴通讯股份有限公司 | Method and device for accessing multimedia conference system |
| CN109391794A (en) * | 2017-08-10 | 2019-02-26 | 中兴通讯股份有限公司 | Video conference multiparty control method, apparatus, storage medium and computer equipment |
| CN110536098A (en) * | 2019-07-30 | 2019-12-03 | 平安科技（深圳）有限公司 | Method, apparatus, equipment and the storage medium of multi-brand terminal accessing conference |
| CN113132396A (en) * | 2021-04-23 | 2021-07-16 | 广州云视通科技有限公司 | Intelligent scheduling method and system for multiple video conference resources |
| CN113489687A (en) * | 2021-06-21 | 2021-10-08 | 深圳震有科技股份有限公司 | Audio and video information intercommunication method and client across multiple networks |
| CN114125360A (en) * | 2021-11-23 | 2022-03-01 | 广州迷听科技有限公司 | Information fusion method and device for different platforms |
| CN114338616A (en) * | 2021-12-21 | 2022-04-12 | 深圳市宝视达光电有限公司 | Multi-platform wireless conference multi-screen sharing method, device, equipment and storage medium |
-
2022
- 2022-09-30 CN CN202211212949.9A patent/CN115914539B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7174365B1 (en) * | 2000-11-08 | 2007-02-06 | Polycom Israel Ltd. | System and method for controlling one or more multipoint control units as one multipoint control unit |
| US20060233120A1 (en) * | 2005-04-19 | 2006-10-19 | Polycom Inc. | Multi-site conferencing system and method |
| US20080084470A1 (en) * | 2006-09-27 | 2008-04-10 | Tandberg Telecom As | System, method and computer program for providing scalability in two or more streaming and/or archiving systems for video conference calls |
| CN106303360A (en) * | 2015-06-10 | 2017-01-04 | 中兴通讯股份有限公司 | Terminal meeting load-balancing method, Apparatus and system |
| CN106534759A (en) * | 2015-09-09 | 2017-03-22 | 中兴通讯股份有限公司 | Method and device for accessing multimedia conference system |
| CN109391794A (en) * | 2017-08-10 | 2019-02-26 | 中兴通讯股份有限公司 | Video conference multiparty control method, apparatus, storage medium and computer equipment |
| US20200169695A1 (en) * | 2017-08-10 | 2020-05-28 | Zte Corporation | Video conference multi-point control method and device, storage medium and computer apparatus |
| CN110536098A (en) * | 2019-07-30 | 2019-12-03 | 平安科技（深圳）有限公司 | Method, apparatus, equipment and the storage medium of multi-brand terminal accessing conference |
| CN113132396A (en) * | 2021-04-23 | 2021-07-16 | 广州云视通科技有限公司 | Intelligent scheduling method and system for multiple video conference resources |
| CN113489687A (en) * | 2021-06-21 | 2021-10-08 | 深圳震有科技股份有限公司 | Audio and video information intercommunication method and client across multiple networks |
| CN114125360A (en) * | 2021-11-23 | 2022-03-01 | 广州迷听科技有限公司 | Information fusion method and device for different platforms |
| CN114338616A (en) * | 2021-12-21 | 2022-04-12 | 深圳市宝视达光电有限公司 | Multi-platform wireless conference multi-screen sharing method, device, equipment and storage medium |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116886318A (en) * | 2023-09-07 | 2023-10-13 | 广州云视通科技有限公司 | Control method for concurrent permission of audio and video equipment |
| CN116886318B (en) * | 2023-09-07 | 2024-03-12 | 广州云视通科技有限公司 | Control method for concurrent permission of audio and video equipment |
| CN117579705A (en) * | 2024-01-16 | 2024-02-20 | 四川并济科技有限公司 | System and method for dynamically scheduling servers based on batch data requests |
| CN117579705B (en) * | 2024-01-16 | 2024-04-02 | 四川并济科技有限公司 | System and method for dynamically scheduling servers based on batch data requests |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115914539B (en) | 2023-11-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115914539B (en) | Method and system for scheduling audio and video equipment resources | |
| AU2016333974B2 (en) | Video management defined embedded voice communication groups | |
| US8239525B2 (en) | Server apparatus and communication system | |
| US9521262B2 (en) | Method and apparatus for calling terminal to join conference | |
| US8780162B2 (en) | Method and system for locating an individual | |
| US20120033026A1 (en) | Method and system for making video calls | |
| US20090109961A1 (en) | Multiple simultaneous call management using voice over internet protocol | |
| RU2012147842A (en) | METHOD FOR MANAGING CONFERENCE COMMUNICATION AND RELATED DEVICE AND SYSTEM | |
| CN107481175A (en) | Emergent case processing method, device and city integrated emergency response system | |
| US9813496B2 (en) | Method and apparatus for collaborating in a work environment | |
| US11816311B2 (en) | Automatically detecting need for breakout virtual meeting | |
| CN105592042A (en) | Information Processing Apparatus, Information Processing System, And Non-Transitory Computer Readable Medium | |
| CN114851210B (en) | Robot scheduling method based on cloud platform and scheduling cloud platform | |
| US10084924B2 (en) | Intercom system for collective housing | |
| CN111131750A (en) | Scheduling method, device and system | |
| US20230370509A1 (en) | Systems and methods for selecting a local device in a collaborative environment | |
| CN108234658B (en) | Method and device for sensing health condition of server cluster and server | |
| JP2012195863A (en) | Call center system, call center server, call center program, and automatic incoming call distribution apparatus | |
| CN115689096A (en) | Method and system for emergency group construction management | |
| CN115499713A (en) | Remote video scheduling method, system and server based on video coding and decoding | |
| KR102237079B1 (en) | Wall pad for providing function of data sharing and continuous monitoring based on 5G or LTE and operating method of the same | |
| CN102291572A (en) | Online video monitoring system based on call response mode and realizing method of network video monitoring system | |
| CN114501044B (en) | Live broadcast data processing method, device, equipment and storage medium | |
| US11233834B2 (en) | Streaming click-to-talk with video capability | |
| US11356437B2 (en) | Method for handling feedback within a security system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |