CN114979687A - Edge calculation-based wheat connection control method and device - Google Patents
Edge calculation-based wheat connection control method and device Download PDFInfo
- Publication number
- CN114979687A CN114979687A CN202210505171.4A CN202210505171A CN114979687A CN 114979687 A CN114979687 A CN 114979687A CN 202210505171 A CN202210505171 A CN 202210505171A CN 114979687 A CN114979687 A CN 114979687A
- Authority
- CN
- China
- Prior art keywords
- microphone
- wheat
- current state
- state
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 241000209140 Triticum Species 0.000 title claims abstract description 106
- 235000021307 Triticum Nutrition 0.000 title claims abstract description 106
- 238000000034 method Methods 0.000 title claims abstract description 68
- 238000004364 calculation method Methods 0.000 title claims abstract description 30
- 230000000977 initiatory effect Effects 0.000 claims abstract description 31
- 230000005856 abnormality Effects 0.000 claims abstract description 13
- 230000004044 response Effects 0.000 claims description 34
- 230000002159 abnormal effect Effects 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 11
- 230000006378 damage Effects 0.000 claims description 10
- 240000005979 Hordeum vulgare Species 0.000 claims description 2
- 235000007340 Hordeum vulgare Nutrition 0.000 claims description 2
- 230000007246 mechanism Effects 0.000 description 15
- 238000004891 communication Methods 0.000 description 14
- 230000008569 process Effects 0.000 description 13
- 238000012545 processing Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 8
- 238000011084 recovery Methods 0.000 description 8
- 238000001514 detection method Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 230000011664 signaling Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 3
- 230000015556 catabolic process Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000008094 contradictory effect Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000003801 milling Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000004083 survival effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44227—Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/4424—Monitoring of the internal components or processes of the client device, e.g. CPU or memory load, processing speed, timer, counter or percentage of the hard disk space used
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Engineering & Computer Science (AREA)
- Telephonic Communication Services (AREA)
- Hardware Redundancy (AREA)
Abstract
The application discloses a connecting wheat control method based on edge calculation, which is used in an edge server of a built-in connecting wheat system, and comprises the following steps: responding to a microphone connecting initiation request of target equipment, and determining the current state of a target state machine associated with the target equipment; responding to the current state being idle, switching the current state from idle to being initiated to connect the microphone, and creating a microphone connecting resource; responding to the establishment of abnormality of the microphone connection, and switching the current state from the microphone connection being initiated to the abnormality so as to indicate that the microphone connection fails; and responding to successful establishment of the microphone connection, and switching the current state from the microphone connection being initiated to the microphone connection to indicate successful microphone connection. The application also provides a wheat connecting control device based on edge calculation, computer equipment and a computer readable storage medium. According to the technical scheme, the state machine of the edge server is used for controlling the wheat connecting state, and further controlling the wheat connecting time sequence, so that the time sequence confusion caused by SDK collapse can be avoided, and the time sequence confusion caused by network problems of the central server can be avoided.
Description
Technical Field
The present application relates to the field of communications, and in particular, to a method and an apparatus for controlling a microphone connection based on edge computing, a computer device, and a computer-readable storage medium.
Background
The network live broadcast is widely accepted and applied, and the application of live broadcast and live broadcast with wheat increases more interestingness for the network live broadcast. For example, in live broadcasting, the interaction effect and the user experience of live broadcasting services can be effectively improved through the connection of the live broadcasting between the anchor broadcasters or the connection of the live broadcasting between the anchor broadcasters and audiences, so that the method and the system are widely applied to numerous live broadcasting services.
The live broadcast wheat connection relates to links, such as initiating a wheat connection link, closing the wheat connection link and the like. In the related art, the time sequence of each link is guaranteed through the traditional signaling, and the abnormal time sequence may occur, which causes the abnormal connection service.
Disclosure of Invention
An object of the embodiments of the present application is to provide a method, an apparatus, a computer device, and a computer-readable storage medium for controlling a microphone connection based on edge calculation, which may be used to solve at least some of the problems provided above.
One aspect of the embodiments of the present application provides a connecting wheat control method based on edge calculation, which is used in an edge server of a built-in connecting wheat system, and the method includes:
responding to a microphone connecting initiation request of target equipment, and determining the current state of a target state machine associated with the target equipment;
responding to the current state being idle, switching the current state from idle to be initiating connecting the microphone, and creating connecting microphone resources;
responding to the establishment of abnormality of the microphone connection, and switching the current state from the microphone connection being initiated to the abnormality so as to indicate that the microphone connection fails; and
and responding to successful establishment of the microphone connecting, and switching the current state from the microphone connecting being initiated to the microphone connected to indicate successful microphone connecting.
Optionally, the method further includes:
and responding to the microphone connecting initiation request, and returning an exception under the condition that the current state is not determined to be idle.
Optionally, the method further includes:
responding to the microphone connecting initiation request, and determining that the target state machine exists in the microphone connecting system;
and if the target state machine does not exist, creating the target state machine, and associating the target state machine with the target equipment.
Optionally, the method further includes:
and refusing the connecting microphone initiating request sent again by the target equipment under the condition that the current state is connected with the microphone.
Optionally, the method further includes:
responding to a connecting wheat closing request of target equipment, and determining the current state of the target state machine;
responding to the current state of connected wheat, switching the current state from connected wheat to closing connected wheat, and destroying connected wheat resources;
responding to the failure of the continuous wheat resource destruction, and switching the current state from closing continuous wheat to abnormal to indicate the failure of the destruction; and
and responding to successful destruction of the connecting microphone resources, and switching the current state from the closing of the connecting microphone to the idle state, or destroying the target state machine.
Optionally, the edge server is connected to a plurality of devices including the target device, and each device is associated with a state machine;
the method further comprises the following steps:
detecting a current state of a state machine of each of the plurality of devices at a predetermined frequency;
acquiring a plurality of devices which accord with a preset state condition according to the current states of the state machines of the devices;
respectively sending a sounding packet to each of the plurality of devices;
obtaining feedback conditions of each device in the plurality of devices for the sounding packets, and determining devices to be removed from the plurality of devices; and
and disconnecting the connection between the wheat connection system and the equipment to be eliminated, and releasing wheat connection resources related to the equipment to be eliminated.
Optionally, the method further includes:
when the current state of the target state machine is abnormal, the following operations are executed:
disconnecting the connection between the wheat connecting system and the target equipment;
destroying the wheat connecting resource associated with the target equipment;
switching the current state of the target state machine from abnormal state to idle state, or destroying the target state machine; and
and recovering the wheat connecting system.
An aspect of the embodiments of the present application further provides a connecting microphone control apparatus, for use in an edge server of a built-in connecting microphone system, the apparatus including:
the first response module is used for responding to a microphone connecting initiation request of target equipment and determining the current state of a target state machine associated with the target equipment;
the second response module is used for responding to the fact that the current state is idle, switching the current state from idle to the state that the microphone connecting is initiated, and creating microphone connecting resources;
the third response module is used for responding to the establishment of abnormality of the microphone connection, and switching the current state from the microphone connection initiation state to the abnormality state so as to indicate that the microphone connection fails; and
and the fourth response module is used for responding to successful establishment of the microphone connection, and switching the current state from the microphone connection being initiated to the microphone connection to indicate that the microphone connection is successful.
An aspect of the embodiments of the present application further provides a computer device, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the computer program, the computer program is used to implement the steps of the edge-computing-based microphone connecting control method as described above.
An aspect of the embodiments of the present application further provides a computer-readable storage medium, in which a computer program is stored, where the computer program is executable by at least one processor, so as to cause the at least one processor to execute the steps of the above-mentioned edge-computing-based microphone connecting control method.
The edge-computing-based microphone connecting control method, device and equipment and the computer-readable storage medium provided by the embodiment of the application have the advantages that:
the continuous wheat state is controlled through the state machine of the edge server, so that the continuous wheat time sequence is controlled to be normal, the time sequence disorder caused by SDK breakdown can not occur, and the time sequence disorder caused by the network problem and the like of the central server is effectively solved.
Drawings
Fig. 1 schematically illustrates an application environment diagram of a microphone connecting control method based on edge calculation according to an embodiment of the present application;
fig. 2 schematically shows a flowchart of a wheat-connecting control method based on edge calculation according to a first embodiment of the present application;
FIG. 3 is a state flow diagram of a state machine;
fig. 4 schematically shows a flowchart of a new adding step of the edge calculation-based microphone connecting control method according to an embodiment of the present application
Fig. 5 schematically shows a flowchart of a newly added step of a wheat-connecting control method based on edge calculation according to a first embodiment of the present application;
fig. 6 schematically shows a microphone connection initiation flow;
fig. 7 schematically shows a flowchart of a newly added step of a wheat-connecting control method based on edge calculation according to a first embodiment of the present application;
fig. 8 is a flowchart schematically illustrating a new step of a wheat-connecting control method based on edge calculation according to a first embodiment of the present application;
fig. 9 schematically shows a microphone connection shutdown procedure;
fig. 10 is a flowchart schematically illustrating a new step of a wheat-connecting control method based on edge calculation according to a first embodiment of the present application;
FIG. 11 schematically illustrates a campaign discovery process;
fig. 12 is a flowchart schematically illustrating a new step of a microphone connecting control method based on edge calculation according to an embodiment of the present application;
FIG. 13 schematically illustrates an automatic recovery flow;
fig. 14 schematically shows a block diagram of a microphone connecting control device based on edge calculation according to a second embodiment of the present application;
fig. 15 schematically shows a hardware architecture diagram of a computer device suitable for implementing the edge-computing-based microphone connecting control method according to a third embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that the descriptions relating to "first", "second", etc. in the embodiments of the present application are only for descriptive purposes and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In addition, technical solutions between various embodiments may be combined with each other, but must be realized by a person skilled in the art, and when the technical solutions are contradictory or cannot be realized, such a combination should not be considered to exist, and is not within the protection scope of the present application.
In the description of the present application, it should be understood that the numerical references before the steps do not identify the sequence of executing the steps, but merely serve to facilitate the description of the present application and to distinguish each step, and thus should not be construed as limiting the present application.
In order to facilitate those skilled in the art to understand the technical solutions provided in the embodiments of the present application, the following description is provided for the related technologies:
when the network is broadcast directly, the interaction effect and the user experience of the live broadcast service can be effectively improved through the connection between the anchor and the anchor or the connection between the anchor and the audience, so that the method is widely applied to a plurality of live broadcast services.
The time sequence needs to be maintained because how many links the live broadcast is connected to the wheat, such as initiating the wheat connection link and closing the wheat connection link. In the design scheme of the microphone connection known by the inventor, the traditional signaling call is basically used, the system is in disorder due to inconsistent states caused by the abnormal timing, and the following two schemes can be adopted for processing the timing problem:
1. the method is processed by a user end (SDK end), and the time sequence is ensured by the SDK (software development kit), such as the sequence of joining the connected wheat, quitting the connected wheat and the like.
2. The central server (central scheduling) guarantees the time sequence;
and the SDK end interacts with the central server and issues messages to the edge server for processing, so that the time sequence is ensured.
However, the above problem of ensuring the timing has the following problems:
the SDK has the disadvantage of ensuring the time sequence, for example, after the wheat is connected, the SDK is broken down or abnormally exits, a signal for exiting the wheat connection is not sent, the state of the edge server is always in the state of the wheat connection, and when a user joins the wheat connection again, the state of the service end is not changed, and the abnormality occurs at the moment, so that the wheat connection fails.
2. The disadvantage of central scheduling to guarantee timing: on one hand, the network problem is solved, because the communication between the edge server and the center is basically a public network, the network environment is relatively complex, and the network is relatively congested in the peak period, so that the congestion is easily caused, and the information sequence is disordered when the edge node is issued, and the state of the edge server is abnormal; the second aspect of the SDK necessarily interacts with the central service, and still causes exception because the SDK end crashes.
In view of the above problems, the present application aims to provide a barley state machine design scheme based on edge calculation. Specifically, a state machine mechanism is used, the system state is automatically maintained by the edge server, due to the fact that the state of the state machine is a recyclable mechanism during state processing, if the server is ended or the service is abnormal, the system can be restored to a normal serviceable state through an activity detection mechanism and the processing capacity is automatically restored of the state machine, the next time service is enabled, the service is also enabled to be high, and the problem that the system depends on central scheduling and time sequence guarantee on an SDK end is solved.
The following are the term explanations of the present application:
WebRTC: the full name of Web Real-Time Communications is a Real-Time communication technology, which allows network applications or sites to establish point-to-point (Peer-to-Peer) connections between browsers without the aid of an intermediate medium, so as to realize transmission of video streams and/or audio streams or other arbitrary data.
SFU (Selective Forward Unit): the WebRTC client audio and video data stream routing and forwarding server program is a server program for routing and forwarding the WebRTC client audio and video data stream.
Signaling (signaling), used in a wireless communication system, includes control signals for guaranteeing normal communication. The control signals may be used to determine communication protocols, channels, media codecs and formats, and data transmission methods, etc.
Edge nodes (also called edge compute nodes) are logical abstractions of basic commonality capabilities of edge side multiple product forms such as edge gateways, edge controllers, edge servers, etc., and these product forms have commonality capabilities such as edge side real-time data analysis, local data storage, real-time network connectivity, etc. It can be understood that the edge computing node is close to the side of the object or data source, and an open platform integrating network, computing, storage and application core capabilities is adopted to provide the nearest-end service nearby. An edge server is a server that interacts with the user nearby.
A state machine (state machine) defines a plurality of states and transitions between the states. The state machine operates in response to a series of events that, when satisfied by certain trigger conditions, cause the state machine to migrate from a current state to a next state.
The plurality of states include the following:
idle (idle) which indicates that the current wheat connecting system is in a normal state;
starting wheat connecting (calling), which means that the wheat connecting is currently started;
connected wheat (called) which indicates that the current flow for initiating the connected wheat is finished and is successfully in a connected wheat state;
closing means that exiting means that a connected microphone is currently being initiated;
and an exception (error) which represents that the components and operations in the microphone connecting system which are associated with the corresponding state machine are abnormal.
The pull stream refers to a process of acquiring a data stream by specifying an IP address, such as pulling a live stream.
The push streaming refers to a process of pushing a data stream by specifying an IP address, such as pushing a live stream.
The technical solutions provided by the embodiments of the present application are described below by way of exemplary application environments.
As shown in fig. 1, the environment application diagram includes:
a source station (source station server) 2 for storing stream data.
The web services platform 4 includes a central server 40 and a plurality of edge servers 42A, 42B, … 42N, …. The central server 40 is responsible for central scheduling, and each edge server is responsible for direct communication with the terminal. The servers may be a single server, a cluster of servers, and may be configured to provide live services and interactive services, such as a web service, for the anchor terminal 6 and the viewer terminals (e.g., 8A, 8B, …, 8N).
And the anchor terminal 6 is used for generating live broadcast data in real time and carrying out stream pushing operation on the live broadcast data. The live data may include audio data or video data. The anchor terminal 6 may be an electronic device such as a smart phone, a tablet computer, or the like. The anchor terminal 6 may comprise an anchor APP 10 for pushing live data and receiving interactive information. Wherein the anchor terminal 6 and the edge server (e.g., 42A) establish a WebRTC connection for the push streaming.
The viewer terminals (e.g., 8A, 8B, …, 8N) may be configured to receive live data in real-time. Each viewer terminal may be any type of computing device, such as a smart phone, tablet device, laptop computer, Virtual Reality (VR), smart television, and the like. Each viewer terminal may have a browser or specialized program built therein through which the live data is received for output to the user. The content may include video, audio, commentary, textual data, and/or the like. Each viewer terminal may include a viewer App 12. The viewer App 12 outputs (e.g., presents) the content to the user. The content may be presented in pages that may include video, audio, commentary, textual data, and/or the like. Each viewer terminal may include an interface, which may include an input element. For example, the input element may be configured to receive user instructions that may cause the viewer terminal to perform various types of operations, such as sending a virtual gift, etc. Wherein each viewer terminal and an edge server (e.g., 42B) establish a WebRTC connection for streaming.
The communication between the devices can be realized through a network. In an exemplary application, the network may include various network devices, such as routers, switches, multiplexers, hubs, modems, bridges, repeaters, firewalls, proxy devices, and/or the like. The network may include physical links, such as coaxial cable links, twisted pair cable links, fiber optic links, combinations thereof, and/or the like. The network may include wireless links, such as cellular links, satellite links, Wi-Fi links, and/or the like.
In the live broadcast process, the anchor terminal 6 generates live broadcast data in real time and pushes the live broadcast data to the edge server 42A. Thereafter, the received live data is pushed to the source station server 2 by the edge server 42A.
The viewer terminal may pull the stream from a nearby edge server. Taking the viewer terminal 8A as an example, the viewer terminal 8A requests the edge server 42B to pull the real-time data pushed by the anchor terminal 6. When there is no real-time data pushed by the anchor terminal 6, the edge server 42B retrieves the real-time data from the source station server 2 and provides the retrieved real-time data to the viewer terminal 8A.
Each edge server is provided with a connecting service to realize the connection between the anchor terminal 6 and each audience terminal. The connection with the wheat means that the anchor and the anchor or the anchor and audiences carry out audio-video communication simultaneously so as to realize multi-person interaction.
Each edge server is described below.
Taking the edge server 42A as an example, it may adopt various connection architectures such as SFU, MESH, MCU (multipoint Control Unit), and the like. Among them, the edge server 42A may include:
(1) and the live broadcast system is used for providing live broadcast service.
When the anchor terminal 6 initiates a live request to the edge server 42A, a Websocket connection is established between the anchor terminal 6 and the edge server 42A, and through the Websocket connection, the anchor terminal 6 can push a live stream to a live system. It should be noted that the live system may include various additional functions, such as format conversion functions.
(2) And the connecting system is used for providing the connecting service.
In the live broadcast, when the anchor terminal 6 starts to connect to the broadcast, if a viewer terminal (e.g. 8A) wants to connect to the anchor terminal 6, the following operations need to be performed: the viewer terminal 8A initiates a connect-to-talk request to an edge server 42B in its vicinity; in response to the connect-to-go request, the connect-to-go system of the edge server 42B notifies the central server 40 of the connect-to-go information; in response to the connection information, the central server 40 sends connection information (e.g., IP address) of the edge server 42B to the edge server 42A, and sends connection information of the edge server 42A to the edge server 42B; after obtaining the information of each other, the edge server 42A and the edge server 42B may perform pull streaming, that is, the edge server 42A pulls the stream pushed by the viewer terminal 8A from the edge server 42B, and the edge server 42B pulls the stream pushed by the anchor terminal 6 from the edge server 42A, so as to implement push streaming and pull streaming between the anchor terminal 6 and the viewer terminal 8A, and further implement connection between the two.
The connection between two parties is only introduced, and in specific application, the connection between more than two parties can be realized by utilizing technologies such as SFU (Small form-factor pluggable) and the like.
Through the above-mentioned connecting process, the connecting involves "initiate connecting the microphone", "close connecting the microphone", and the like, of two or more parties, and these events should be controlled to ensure the time sequence, thereby ensuring the normal operation of the connecting service. The following describes a connection control scheme based on edge calculation by several embodiments, taking the edge server 42A as an execution subject.
Example one
The method provided by the embodiment can be executed in the edge server 42A in the form of software code.
Fig. 2 schematically shows a flowchart of a wheat-connecting control method based on edge calculation according to a first embodiment of the present application. As shown in fig. 2, the method for controlling continuous wheat based on edge calculation may include steps S200 to S206, wherein:
step S200, responding to a connecting microphone initiating request of target equipment, and determining the current state of a target state machine associated with the target equipment.
The embodiment can be used for connecting the microphone in a live scene as shown in fig. 1, or used for connecting the microphone in a common scene, such as a web conference. For convenience of description, the present embodiment takes connecting wheat in a live broadcast scene as an example for explanation.
As shown in fig. 1, the edge server 42A serves a target device (anchor terminal 6) through its built-in live system.
The target device 6 may record video via one or more signal acquisition devices (e.g., camera, microphone) to generate a video stream and push the generated video stream to the edge server 42A. After receiving the video stream, the edge server 42A may push the video stream or the processed video stream into the source station server 2. Of course, if the edge server 42A also serves other terminals and the other terminals need to pull the video stream, the edge server 42A may push the video stream or the processed video stream to the other terminals.
In the live broadcast process, the anchor can trigger a microphone connecting button on the interactive interface of the target device 6. In response to the locate key being triggered, anchor terminal 6 generates a "locate initiate request" and sends it to edge server 42A.
After receiving the "locate initiate request," edge server 42A may perform the following operations: the anchor terminal 6 is connected to the party system in the edge server 42A and waits for party information of the other party to the party.
Haymaking involves the sequential control of multiple states, and in this embodiment, the individual states of haymaking are controlled by the edge server.
As shown in the state flow diagram of fig. 3, the plurality of states include: idle, loading, dead, closing, error.
Continuing with the example of edge server 42A, it may manage the connection status of multiple devices (e.g., target device 6) that are nearby and connected to it. Through the control of the continuous wheat state of each device, the time sequence of continuous wheat is ensured, and the continuous wheat disorder is prevented.
Taking the connected state of the control target device 6 as an example: a state machine (i.e., a target state machine) associated with the target device 6 is configured in the edge server 42A, and the connected state of the target device 6 is controlled by controlling the state of the target state machine.
In this step S200, after receiving the "microphone connection initiation request" sent by the target device 6, the edge server 42A needs to know whether the target device 6 is currently suitable for microphone connection or the like. Thus, the following embodiments may be implemented:
in an exemplary embodiment, as shown in fig. 4, the method may further include: step S400, responding to the connecting wheat initiating request, and determining that the target state machine exists in the connecting wheat system; step S402, if the target state machine does not exist, the target state machine is created, and the target state machine is associated with the target equipment. In the present exemplary embodiment, by temporarily creating a target state machine for the target device 6, various states are managed by the target state machine, thereby achieving effective control of the connected state of the target device 6.
In an exemplary embodiment, if a target state machine is created in the edge server 42A, the edge server 42A may obtain a current state of the target state machine, and then perform a corresponding operation based on the current state.
Step S202, responding to the fact that the current state is idle, switching the current state from idle to trapping, and creating a microphone connecting resource.
The target state machine is configured in the edge server 42A for implementing the connected state control for the target device 6.
When the target state machine is newly created based on the 'connected wheat initiation request', the current state is an initial state (idle).
If the target device 6 has established a connection with the mic-to-mic system in the edge server 42A before the "mic-to-mic initiation request" this time, the edge server 42A stores the target state machine without re-creation. Since the target state machine is used for controlling the microphone connecting state of the target device 6 before, various states may occur, and therefore, the current state of the target state machine needs to be read, and whether microphone connection is possible is determined according to the current state.
For example, the current state of the target state machine may be any one of idle, milling, clamped, closing, and error.
If the current state is not idle, the current state indicates that the microphone cannot be connected.
If the current state is idle, the current state indicates that the connected wheat can be connected, and the following establishment stage of connected wheat is entered:
1. switching the current state from idle to trapping to indicate that the target device 6 is currently establishing microphone connection;
2. and creating a connecting wheat resource. The microphone connecting resource comprises some components for microphone connecting, such as a stream pulling component, a stream forwarding component, an SFU component and the like.
And step S204, responding to the abnormal situation of the microphone connection establishment, and switching the current state from the calling state to the error state to indicate that the microphone connection fails.
In creating a link between the destination device 6 and the link system of the edge server 42A, various problems may arise, such as:
1. conflict with one user;
2. network failure between edge server 42A and central server 40;
3. the central server 40 itself fails.
It should be noted that, when the edge server 42A establishes a connection with the target device 6, the edge server 42A needs to report the relevant information (such as the IP address) of the target device 6 to the central server 40 to notify the central server 40.
When the continuous microphone creation fails based on various problems, the target state machine is automatically switched to error. If the target state machine is error, the link-to-wheat system in the edge server 42A performs exception handling. For example, after the exception handling of the microphone connecting system is completed, the current state of the target state machine is restored to idle, so that the exception occurring in the last microphone connecting process is ensured not to influence the creation and use of the next microphone connecting. Wherein. The term "connected wheat system performs exception processing" refers to processing components and the like associated with the target state machine.
And step S206, responding to successful establishment of the microphone connection, and switching the current state from the calling state to the called state to indicate successful microphone connection.
If the link establishment is successful, it indicates that the connection between the target device 6 and the link system of the edge server 42A is successfully established, and the relevant information of the target device 6 is successfully reported to the central server 40 via the edge server 42A.
In this embodiment, after successful connection with the edge server 42A, the anchor terminal 6 may perform the following operations: 1. actively inviting a connected object (i.e., a spectator terminal, another anchor terminal); 2. and waiting for the joining connecting request of the connecting object. Taking the audience terminal 8A as an example, after the connection between the anchor terminal 6 and the audience terminal 8A is successfully established, the audience terminal 8A and the anchor terminal 6 may pull the stream through the edge servers 42A and 42B.
In the method for controlling connected wheat based on edge computing provided by the embodiment of the application, a state machine mechanism is provided by an edge server, a state machine is respectively set for each nearby device in the edge server (for example, a target state machine is set for a target device), and the connected wheat state of the target device is controlled by the target state machine in the edge server.
1. The continuous wheat state is controlled through the state machine of the edge server, and then the continuous wheat time sequence is controlled, so that time sequence disorder caused by SDK breakdown can not occur, and the time sequence disorder caused by network problems and the like of the central server is effectively solved.
2. The state machine mechanism is adopted to control the state of the microphone, and because the state processing of the state machine is a circulative mechanism, if the microphone is connected or abnormal, the state machine can also utilize the activity detection mechanism and the automatic recovery processing capability to recover the system to a normal service-available state, thereby ensuring that the next service is available and the service is also highly available.
Several alternative embodiments are provided further below.
In the process of establishing the connecting wheat:
in an exemplary embodiment, as shown in fig. 5, the method may further include: step S500, responding to the connecting microphone initiating request, and returning to an exception under the condition that the current state is determined not to be idle. In the above exemplary embodiment, if the current state of the target state machine is not idle, it indicates that the target device 6 is requesting to connect to the microphone or has connected to the microphone, or the microphone connecting system is in a recovery state, and so on. In order to prevent invalid microphone connection and guarantee the time sequence of microphone connection, an exception is returned to prevent microphone connection and conduct exception handling.
For ease of understanding, an exemplary flow of tandem initiation is provided below, as shown in fig. 6:
step S600, receiving the "microphone connection initiation request" of the target device 6, and starting creation.
Step S602 determines whether the current state of the target state machine associated with the target device 6 is idle.
If yes, go to step S604, otherwise return to the exception.
And step S604, setting the current state as the trapping, and connecting the wheat.
Step S606, determining whether an abnormality occurs during the course of initiating the wheat connection.
If an abnormality occurs, the process proceeds to step S608, otherwise, the process proceeds to step S612.
Step S608, set the current state as error.
And step S610, exception handling, namely, carrying out automatic fault handling on the component associated with the target state machine in the wheat connecting system.
And step S612, setting the current state as called. The wheat connection is successful.
After successful wheat connection:
in an exemplary embodiment, as shown in fig. 7, to guarantee the time sequence, the method may further include: step S700, rejecting the request for initiating the connection to the microphone, which is sent again by the target device, when the current state is called.
When wheat connection needs to be finished:
in an exemplary embodiment, as shown in fig. 8, a microphone connecting exit procedure is further provided, which may specifically include: step S800, responding to a connecting wheat closing request of target equipment, and determining the current state of the target state machine; step S802, responding to the fact that the current state is called, switching the current state from called to closing, and destroying wheat connecting resources; step S804, responding to the failure of destroying the continuous wheat resources, and switching the current state from closing to error to indicate the failure of destroying; and step S806, responding to successful destruction of the connected wheat resources, and switching the current state from closing to idle or destroying the target state machine.
To facilitate understanding, an exemplary application of logout is provided below, as shown in FIG. 9:
in step S900, the "close request to connect to the microphone" of the target device 6 is received.
Step S902, determine whether the current state of the target state machine associated with the target device 6 is a called.
If yes, go to step S904, otherwise return to step S900.
And step S904, setting the current state to closing, and indicating that the microphone is closed.
Step S906, destroying resources, such as destroying components for pulling flow and stopping the pulling flow operation.
Step S908, whether the destruction operation failed.
If the exception occurs, it indicates that the destruction is failed and step S910 is entered, otherwise step S914 is entered.
Step S910, set the current state as error. Namely, if an exception occurs in the destroying process, the current state is updated to error.
Step S912, exception handling, which performs automatic fault handling on the component associated with the target state machine in the wheat connecting system.
And step S914, setting the current state as idle or destroying the target state machine.
After the continuous wheat is successfully closed, the next continuous wheat can be allowed.
From the above, the timing of the continuous-microphone exit can be ensured by controlling the continuous-microphone state through the target state machine in the edge server.
It should be noted that an edge server (e.g., 42A) may serve a large number of devices nearby simultaneously. That is, edge server 42A connects a plurality of devices, each associated with a state machine, including the target device. Continuing with the example of edge server 42A, it controls multiple state machines, one for each device.
To enable automatic maintenance of the edge server 42A, a liveness mechanism may also be provided.
As shown in fig. 10, the method further includes: step S1000, detecting the current state of the state machine of each of the plurality of devices at a preset frequency; step S1002, acquiring a plurality of devices which accord with preset state conditions according to the current states of the state machines of the devices; step S1004, respectively sending a survival packet to each of the plurality of devices; step S1006, obtaining feedback conditions of each of the plurality of devices for the sounding packets, and determining devices to be removed from the plurality of devices; and step S1008, disconnecting the connection between the wheat connection system and the equipment to be eliminated, and releasing wheat connection resources related to the equipment to be eliminated.
To facilitate understanding, as shown in FIG. 11, an exemplary application implementing the mechanism for snooping is provided below:
step S1100, acquiring the current state of the state machine of each device.
All the devices (ID or associated user ID) are obtained through the memory record, and the state of the state machine of each device is traversed.
Step S1102, determining whether the current state of each state machine is a detectable state.
The preset state conditions are as follows: if the current state is called, calling or closing, it is a detectable state.
In step S1104, a keep alive packet is sent to the device whose corresponding state machine is detectable.
The alive detection packet is a data packet and is sent to the opposite end, and whether normal communication can be performed or not is tested according to the response of the opposite end.
In step S1106, response packets returned by the devices that sent the sounding packet in step S1004 are acquired.
In step S1108, if a response packet returned by a device is received, the current state of the state machine of the device is recorded.
In step S1110, if a response packet returned by a device is not received, the edge server is disconnected from the device. In an exemplary application, taking the target device 6 as an example, if the edge server 42A does not receive the response packet of the target device 6 within a preset time after probing the alive packet to the target device 6, the probing packet is sent again, and thus after repeatedly sending three probing packets, the edge server 42A may disconnect from the target device 6 and save resources of the edge server 42A if the response packet of the target device 6 is not received yet.
According to the above contents, the equipment which needs to send the detection alive packet can be effectively screened out through the current state of each state machine in the edge server, the invalid equipment which needs to be screened out is determined by using the detection alive packet, and the server resources are saved.
To enable automatic maintenance of edge server 42A, an automatic recovery mechanism may also be provided.
As shown in fig. 12, in the case that the current state of the target state machine is error, the following operations may be performed: step S1200, disconnecting the connection between the wheat connecting system and the target equipment; step S1202, destroying the connected wheat resource associated with the target device; step S1204, switch over the present state of the said goal state machine from error to idle, or destroy the said goal state machine; and step S1206, restoring the wheat connecting system.
The automatic recovery mechanism is to process the components associated with the target state machine by the microphone connecting system when the current state is error, so as to reset the target state machine and reset/recover the associated components to enter a normal state.
For ease of understanding, an exemplary application implementing the auto-recovery mechanism is provided below, taking the target state machine as an example, as shown in FIG. 13:
step 1300, acquiring the current state of the target state machine.
Step S1302, determining whether the current state is error.
If yes, go to step S1304, otherwise return to step S1300.
In step S1304, the target device 6 is notified and the connection with the target device 6 is disconnected.
In step S1306, the resource is destroyed, for example, various components associated with the target device 6, such as the pull component, are destroyed.
Step S1308, set the current state of the target state machine to idle, or directly destroy the target state machine.
From the above, the edge server automatically maintains the connected state by using the state machine mechanism, and since the state processing of the state machine is a recyclable mechanism, if the server is finished or abnormal, the automatic recovery mechanism of the state machine can recover the state machine to the normal serviceable state, so as to ensure that the next service is available and the service becomes highly available. Because the state machine is automatically recovered to be normal at the moment, the old user is connected again, which is equivalent to that a new user can use the resources of the state machine and work normally, and the robustness of the microphone connecting system is effectively improved.
Example two
Fig. 14 schematically shows a block diagram of a microphone connecting control device based on edge calculation according to the second embodiment of the present application. The edge-computing-based microphone connecting control device can be divided into one or more program modules, and the one or more program modules are stored in a storage medium and executed by one or more processors to complete the embodiment of the application. The program modules referred to in the embodiments of the present application refer to a series of computer program instruction segments that can perform specific functions, and the following description will specifically describe the functions of the program modules in the embodiments. As shown in fig. 14, the edge-computing-based microphone connecting control apparatus 1400 may include a first response module 1410, a second response module 1420, a third response module 1430, and a fourth response module 1440, wherein:
a first response module 1410, configured to determine, in response to a request initiated by a target device for connecting to a microphone, a current state of a target state machine associated with the target device;
a second response module 1420, configured to switch the current state from idle to trapping in response to that the current state is idle, and create a microphone connecting resource;
a third response module 1430, configured to switch the current state from the calling to an error in response to the establishment of an exception to connect the microphone, so as to indicate that the microphone fails to connect; and
a fourth responding module 1440, configured to, in response to successful creation of a microphone connection, switch the current state from calling to called to indicate that the microphone connection is successful.
In an alternative embodiment, the apparatus further comprises a fifth response module (not identified) for:
and responding to the microphone connecting initiation request, and returning an exception under the condition that the current state is not idle.
In an alternative embodiment, the apparatus further comprises a sixth response module (not identified) for:
responding to the connecting microphone initiating request, and determining that the target state machine exists in the connecting microphone system;
and if the target state machine does not exist, creating the target state machine, and associating the target state machine with the target equipment.
In an alternative embodiment, the apparatus further comprises a rejection module (not identified) for:
and rejecting the connected wheat initiation request sent again by the target equipment under the condition that the current state is called.
In an alternative embodiment, the apparatus further comprises a microphone connecting shutdown module (not identified) for:
responding to a connecting wheat closing request of target equipment, and determining the current state of the target state machine;
responding to the fact that the current state is called, switching the current state from called to closing, and destroying wheat connecting resources;
responding to the destroy failure of the microphone connecting resources, and switching the current state from closing to error to indicate the destroy failure; and
and responding to successful destruction of the microphone connecting resources, switching the current state from closing to idle, or destroying the target state machine.
In an alternative embodiment, the edge server is connected to a plurality of devices including the target device, each device being associated with a state machine;
the apparatus further comprises an activity detection module (not identified) for:
detecting a current state of a state machine of each of the plurality of devices at a predetermined frequency;
acquiring a plurality of devices which accord with a preset state condition according to the current states of the state machines of the devices;
respectively sending a sounding packet to each of the plurality of devices;
obtaining feedback conditions of each device in the plurality of devices for the sounding packets, and determining devices to be removed from the plurality of devices; and
and disconnecting the connection between the wheat connection system and the equipment to be eliminated, and releasing wheat connection resources related to the equipment to be eliminated.
In an alternative embodiment, the apparatus further comprises a recovery module (not identified) for:
and in the case that the current state of the target state machine is error, executing the following operations:
disconnecting the connection between the wheat connecting system and the target equipment;
destroying the wheat connecting resource associated with the target equipment;
switching the current state of the target state machine from error to idle, or destroying the target state machine; and
and recovering the wheat connecting system.
EXAMPLE III
Fig. 15 schematically shows a hardware architecture diagram of a computer device 10000, which is suitable for implementing the edge-computing-based microphone connecting control method according to the third embodiment of the present application. In this embodiment, the computer device 10000 is a device capable of automatically performing numerical calculation and/or information processing according to a command set or stored in advance. For example, the server may be a rack server, a blade server, a tower server, or a rack server (including an independent server or a server cluster composed of a plurality of servers). As shown in fig. 15, computer device 10000 includes at least, but is not limited to: the memory 10010, processor 10020, and network interface 10030 may be communicatively linked to each other via a system bus. Wherein:
the memory 10010 includes at least one type of computer-readable storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. In some embodiments, the storage 10010 may be an internal storage module of the computer device 10000, such as a hard disk or a memory of the computer device 10000. In other embodiments, the memory 10010 may also be an external storage device of the computer device 10000, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), or the like, provided on the computer device 10000. Of course, the memory 10010 may also include both internal and external memory modules of the computer device 10000. In this embodiment, the memory 10010 is generally configured to store an operating system installed in the computer device 10000 and various types of application software, such as a program code of a link control method based on edge calculation. In addition, the memory 10010 may also be used to temporarily store various types of data that have been output or are to be output.
Processor 10020 may be a Central Processing Unit (CPU), a controller, a microcontroller, a microprocessor, or other data Processing chip in some embodiments. The processor 10020 is generally configured to control overall operations of the computer device 10000, such as performing control and processing related to data interaction or communication with the computer device 10000. In this embodiment, the processor 10020 is configured to execute the program code stored in the memory 10010 or process data.
Network interface 10030 may comprise a wireless network interface or a wired network interface, and network interface 10030 is generally used to establish a communication link between computer device 10000 and other computer devices. For example, the network interface 10030 is used to connect the computer device 10000 to an external terminal through a network, establish a data transmission channel and a communication link between the computer device 10000 and the external terminal, and the like. The network may be a wireless or wired network such as an Intranet (Intranet), the Internet (Internet), a Global System of Mobile communication (GSM), Wideband Code Division Multiple Access (WCDMA), a 4G network, a 5G network, Bluetooth (Bluetooth), or Wi-Fi.
It should be noted that fig. 15 only shows a computer device having the components 10010 and 10030, but it should be understood that not all of the shown components are required to be implemented, and more or less components may be implemented instead.
In this embodiment, the edge-calculation-based microphone connecting control method stored in the memory 10010 may be further divided into one or more program modules and executed by one or more processors (in this embodiment, the processor 10020) to complete the embodiment of the present application.
Example four
The present application also provides a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the steps of the edge-computation-based microphone connecting control method in the embodiments.
In this embodiment, the computer-readable storage medium includes a flash memory, a hard disk, a multimedia card, a card type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Read Only Memory (ROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a Programmable Read Only Memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. In some embodiments, the computer readable storage medium may be an internal storage unit of the computer device, such as a hard disk or a memory of the computer device. In other embodiments, the computer readable storage medium may be an external storage device of the computer device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like provided on the computer device. Of course, the computer-readable storage medium may also include both internal and external storage devices of the computer device. In this embodiment, the computer-readable storage medium is generally used to store an operating system and various types of application software installed in the computer device, for example, the program code of the connection control method based on edge calculation in the embodiment, and the like. Further, the computer-readable storage medium may also be used to temporarily store various types of data that have been output or are to be output.
It will be apparent to those skilled in the art that the modules or steps of the embodiments of the present application described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different from that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, embodiments of the present application are not limited to any specific combination of hardware and software.
It should be noted that the above mentioned embodiments are only preferred embodiments of the present application, and not intended to limit the scope of the present application, and all the equivalent structures or equivalent flow transformations made by the contents of the specification and the drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present application.
Claims (10)
1. A connecting wheat control method based on edge calculation is used in an edge server of a built-in connecting wheat system, and the method comprises the following steps:
responding to a microphone connecting initiation request of target equipment, and determining the current state of a target state machine associated with the target equipment;
responding to the current state being idle, switching the current state from idle to being initiated to connect the microphone, and creating a microphone connecting resource;
responding to the establishment of abnormality of the microphone connection, and switching the current state from the microphone connection being initiated to the abnormality so as to indicate that the microphone connection fails; and
and responding to successful establishment of the microphone connecting, and switching the current state from the microphone connecting being initiated to the microphone connected to indicate successful microphone connecting.
2. The wheat connecting control method based on the edge calculation as claimed in claim 1, further comprising:
and responding to the microphone connecting initiation request, and returning an exception under the condition that the current state is not determined to be idle.
3. The wheat connecting control method based on the edge calculation as claimed in claim 1, further comprising:
responding to the connecting microphone initiating request, and determining that the target state machine exists in the connecting microphone system;
and if the target state machine does not exist, creating the target state machine, and associating the target state machine with the target equipment.
4. The wheat connecting control method based on the edge calculation as claimed in claim 1, further comprising:
and under the condition that the current state is connected, rejecting a connected microphone initiating request sent again by the target equipment.
5. The wheat connecting control method based on the edge calculation as claimed in claim 1, further comprising:
responding to a connecting wheat closing request of target equipment, and determining the current state of the target state machine;
responding to the current state of connected wheat, switching the current state from connected wheat to closing connected wheat, and destroying connected wheat resources;
responding to the failure of the continuous wheat resource destruction, and switching the current state from closing continuous wheat to abnormal to indicate the failure of the destruction; and
and responding to successful destruction of the connecting microphone resources, and switching the current state from the closing of the connecting microphone to the idle state, or destroying the target state machine.
6. The edge computing-based microphone connecting control method according to any one of claims 1 to 5, characterized in that the edge server is connected with a plurality of devices including the target device, and each device is associated with a state machine;
the method further comprises the following steps:
detecting a current state of a state machine of each of the plurality of devices at a predetermined frequency;
acquiring a plurality of devices which accord with a preset state condition according to the current states of the state machines of the devices;
respectively sending a sounding packet to each of the plurality of devices;
obtaining feedback conditions of each device in the plurality of devices for the sounding packets, and determining devices to be removed from the plurality of devices; and
and disconnecting the connection between the wheat connection system and the equipment to be removed, and releasing wheat connection resources related to the equipment to be removed.
7. The wheat connecting control method based on the edge calculation according to any one of claims 1 to 5, characterized by further comprising:
when the current state of the target state machine is abnormal, the following operations are executed:
disconnecting the connection between the wheat connecting system and the target equipment;
destroying the wheat connecting resource associated with the target equipment;
switching the current state of the target state machine from abnormal state to idle state, or destroying the target state machine; and
and recovering the wheat connecting system.
8. An edge computing-based microphone connecting control device, which is used in an edge server of a built-in microphone connecting system, and comprises:
the device comprises a first response module, a second response module and a third response module, wherein the first response module is used for responding to a microphone connecting initiation request of target equipment and determining the current state of a target state machine associated with the target equipment;
the second response module is used for responding to the fact that the current state is idle, switching the current state from idle to the state that the microphone connecting is initiated, and creating microphone connecting resources;
the third response module is used for responding to the establishment of abnormality of the microphone connection, and switching the current state from the microphone connection initiation state to the abnormality state so as to indicate that the microphone connection fails; and
and the fourth response module is used for responding to successful establishment of the microphone connecting, and switching the current state from the microphone connecting being initiated to the microphone connected so as to indicate that the microphone connecting is successful.
9. A computer arrangement comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor is configured to carry out the steps of the edge computing based microphone connecting control method according to any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, having stored thereon a computer program, the computer program being executable by at least one processor to cause the at least one processor to perform the steps of the edge-computing-based barley connecting control method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210505171.4A CN114979687B (en) | 2022-05-10 | 2022-05-10 | Wheat connecting control method and device based on edge calculation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210505171.4A CN114979687B (en) | 2022-05-10 | 2022-05-10 | Wheat connecting control method and device based on edge calculation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114979687A true CN114979687A (en) | 2022-08-30 |
| CN114979687B CN114979687B (en) | 2024-03-15 |
Family
ID=82980880
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210505171.4A Active CN114979687B (en) | 2022-05-10 | 2022-05-10 | Wheat connecting control method and device based on edge calculation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114979687B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120072961A1 (en) * | 2010-04-23 | 2012-03-22 | Orange Vallee | Process and system for management of a continuous broadcast session of a posted direct video stream |
| CN108306942A (en) * | 2018-01-09 | 2018-07-20 | 武汉斗鱼网络科技有限公司 | Communication means, storage medium, electronic equipment and the system that multi-user is broadcast live simultaneously |
| CN111273969A (en) * | 2020-01-20 | 2020-06-12 | 腾讯科技（深圳）有限公司 | State switching method, device, equipment and storage medium |
| CN112291583A (en) * | 2020-10-29 | 2021-01-29 | 北京达佳互联信息技术有限公司 | Live broadcast wheat connecting method and device, server, terminal and storage medium |
| CN114205633A (en) * | 2020-08-31 | 2022-03-18 | 腾讯科技（深圳）有限公司 | Live broadcast interaction method and device, storage medium and electronic equipment |
-
2022
- 2022-05-10 CN CN202210505171.4A patent/CN114979687B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120072961A1 (en) * | 2010-04-23 | 2012-03-22 | Orange Vallee | Process and system for management of a continuous broadcast session of a posted direct video stream |
| CN108306942A (en) * | 2018-01-09 | 2018-07-20 | 武汉斗鱼网络科技有限公司 | Communication means, storage medium, electronic equipment and the system that multi-user is broadcast live simultaneously |
| CN111273969A (en) * | 2020-01-20 | 2020-06-12 | 腾讯科技（深圳）有限公司 | State switching method, device, equipment and storage medium |
| CN114205633A (en) * | 2020-08-31 | 2022-03-18 | 腾讯科技（深圳）有限公司 | Live broadcast interaction method and device, storage medium and electronic equipment |
| CN112291583A (en) * | 2020-10-29 | 2021-01-29 | 北京达佳互联信息技术有限公司 | Live broadcast wheat connecting method and device, server, terminal and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114979687B (en) | 2024-03-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109889762B (en) | Conference control method and device | |
| CN111246152B (en) | Video conference automatic recovery method and device, storage medium and electronic device | |
| CN109428864B (en) | Method and device for improving quality of nginx-rtmp pull flow service | |
| CN112702559B (en) | Recorded broadcast abnormity feedback method, system, equipment and readable storage medium | |
| CN109379209B (en) | Method and device for upgrading storage service of video network | |
| CA2951525A1 (en) | Communication apparatus, communication system, communication management system, and communication control method | |
| US11163827B2 (en) | Video processing method, device, terminal and storage medium | |
| CN112333529B (en) | Live streaming loading method and device, equipment and medium thereof | |
| US20070220162A1 (en) | Media processing abstraction model | |
| CN110493022B (en) | Method, device and system for establishing three-party session | |
| CN114979687B (en) | Wheat connecting control method and device based on edge calculation | |
| CN110768816B (en) | Multimedia service exception protection method and device | |
| EP3284243A1 (en) | Methods, devices and system for obtaining http message statuses | |
| CN115720193A (en) | Multicast-based software deployment method and device | |
| CN110011891A (en) | A kind of method for processing business and system of across a network | |
| CN113329080B (en) | Video playing method and device based on WebSocket, electronic equipment and storage medium | |
| CN115379279A (en) | Multi-screen linkage interaction method, device and system, storage medium and electronic equipment | |
| CN113014615B (en) | Data synchronization method, device and system | |
| CN113810775A (en) | Voice and video connection system and method | |
| CN110309105B (en) | Data processing method, system and equipment | |
| CN114374682B (en) | Data sharing method and system, storage medium and terminal equipment | |
| CN111212052A (en) | Service processing method and device, electronic equipment and storage medium | |
| CN111787418B (en) | Audio and video stream docking processing method based on artificial intelligence AI and related equipment | |
| CN114363665B (en) | Multi-service code stream pushing method, system, computer equipment and storage medium | |
| JP6753480B2 (en) | Terminal and display method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |