CN114095108A

CN114095108A - Smart broadcasting method applied to client

Info

Publication number: CN114095108A
Application number: CN202111175901.0A
Authority: CN
Inventors: 王闽
Original assignee: Fujian Newland Communication Science Technologies Co ltd
Current assignee: Fujian Newland Communication Science Technologies Co ltd
Priority date: 2021-10-09
Filing date: 2021-10-09
Publication date: 2022-02-25
Anticipated expiration: 2041-10-09
Also published as: CN114095108B

Abstract

The invention provides an intelligent broadcasting method applied to a client in the technical field of broadcasting, which comprises the following steps: step S10, after the client is initialized, acquiring the equipment parameters of each remote equipment; step S20, the client acquires the audio data to be broadcasted; step S30, after the audio data is verified by the client, the broadcast parameters are obtained through analysis; step S40, the client adds the audio data into the broadcast task queue based on the broadcast parameters; step S50, the client side encodes the audio data in the broadcast task queue by using the ffmpeg software and outputs stream media data; step S60, the client sends the streaming media data to the remote device for broadcasting based on the device parameters and the broadcasting parameters; and step S70, the client side records and verifies the broadcast task information of each audio data in sequence based on the broadcast task queue, and stores the broadcast log after the broadcast is finished. The invention has the advantages that: realize carrying out lightweight wisdom broadcast on the client, very big promotion wisdom broadcast's stability.

Description

Smart broadcasting method applied to client

Technical Field

The invention relates to the technical field of broadcasting, in particular to an intelligent broadcasting method applied to a client.

Background

At present, a service end of smart broadcasting is basically a B/S (browser/server) architecture, streaming media adopts a streaming media server such as EasyDarwin, and media broadcasting is performed through a broadcasting terminal; although this architecture can support a large number of broadcast terminals and control broadcast terminals over the internet, and has a wide coverage, it has the following disadvantages:

the B/S architecture needs to deploy a server, relies on various plug-ins/software (streaming media, databases, etc.), and in a small-sized local area network, the B/S architecture is too bulky to meet the minimum requirement (light weight requirement) of a user, and due to the large amount of associated software, an abnormality easily occurs in the operation process.

Therefore, how to provide an intelligent broadcasting method applied to a client to implement lightweight intelligent broadcasting on the client and improve the stability of the intelligent broadcasting is a technical problem to be solved urgently.

Disclosure of Invention

The technical problem to be solved by the present invention is to provide a smart broadcasting method applied to a client, so as to implement lightweight smart broadcasting on the client and improve the stability of smart broadcasting.

The invention is realized by the following steps: a smart broadcasting method applied to a client comprises the following steps:

step S10, after the client is initialized, acquiring the equipment parameters of each remote equipment;

step S20, the client acquires audio data to be broadcasted, wherein the audio data comprises network data and local data;

step S30, after the audio data is verified by the client, the audio data is analyzed to obtain broadcast parameters;

step S40, the client adds the audio data into the broadcast task queue based on the broadcast parameters;

step S50, the client side encodes the audio data in the broadcast task queue by using ffmpeg software and outputs stream media data;

step S60, the client sends the streaming media data to the corresponding remote device for intelligent broadcasting based on the device parameters and the broadcast parameters;

and step S70, the client side records and verifies the broadcast task information of each audio data in sequence based on the broadcast task queue, and stores the broadcast log of each audio data after the intelligent broadcast is completed.

Further, the step S10 specifically includes:

step S11, after the client is started, the monitoring function of the port is started to complete the initialization of the client;

step S12, the client maintains heartbeat connection with each remote device through the port based on the TCP protocol;

step S13, the client acquires the IP data of each remote device through the port;

step S14, the client analyzes the acquired IP data to obtain a packet header, a packet body and verification data, and the verification data is used for verifying the packet body;

step S15, the client acquires the equipment parameters of each remote equipment through the bag body and instantiates the equipment parameters;

step S16, the client establishes a backhaul connection with each remote device based on the backhaul data protocol, and further feeds back a response instruction of receiving the device parameter to each remote device, and disconnects the backhaul connection after the feedback is completed.

Further, in step S10, the device parameters at least include a device IP, a device port, and a device serial number.

Further, in step S20, the step of acquiring, by the client, the network data to be broadcasted specifically includes:

the client establishes a return connection with each remote device based on a return data protocol, further acquires the network data to be broadcasted, and disconnects the return connection after the acquisition is completed.

Further, in step S20, the step of obtaining, by the client, the local data to be broadcasted specifically includes:

the method comprises the steps that a client acquires local audio to be broadcasted through a preset file path or a microphone, sets broadcasting parameters of the local audio, calculates the local audio and the broadcasting parameters by using a verification algorithm to obtain a verification code, and generates local data based on the local audio, the broadcasting parameters and the verification code.

Further, the step S30 is specifically:

after the client checks the audio data by using the check code carried by the audio data, the client analyzes the audio data to obtain a broadcast parameter;

the broadcast parameters at least comprise an equipment serial number, a broadcast type, a broadcast level, volume, an input sound source, a play type, a play frequency, play time, end time, audio time and a stream pushing mode;

the broadcast type is daily broadcast, emergency broadcast or emergency drilling; the input sound source is local audio, a microphone or mixed sound; the playing type is immediate playing or timing playing; the stream pushing mode is RTP multicast or UDP unicast.

Further, the step S40 is specifically:

the client generates corresponding configuration parameters based on the broadcast parameters, and expands the configuration parameters into the broadcast parameters; the configuration parameters at least comprise a broadcast message identification number, a streaming media address, a general parameter, an audio coding parameter, a specified output format, a microphone input parameter and a sound mixing parameter; the general parameter is used for identifying whether to reduce the input reading speed to the local frame rate; the microphone input parameters are used for specifying a microphone to carry out coding input;

and the client adds the audio data into a broadcast task queue based on the expanded broadcast parameters.

Further, the step S60 is specifically:

the client binds the streaming media data with the corresponding remote equipment based on the equipment parameters and the broadcast parameters, and sends the streaming media data to the bound remote equipment in the format of auxiliary data for intelligent broadcast.

Further, the step S70 is specifically:

the client sequentially records the broadcast task information of each audio data based on the broadcast task queue; the broadcast task information at least comprises a file path, a sampling rate, audio time, current playing time and current playing times;

and the client verifies whether the intelligent broadcasting is finished or not based on the broadcasting task information and the broadcasting parameters, and stores the broadcasting logs of the audio data into a log4net log library after the intelligent broadcasting is finished.

Further, in step S70, the broadcast log is stored in a rolling manner based on a preset number of days of storage, and the broadcast log, the error log, and the operation log storing different audio data are distinguished by a folder.

The invention has the advantages that:

the method comprises the steps of obtaining audio data to be broadcasted through a client and analyzing the audio data to obtain broadcasting parameters, adding the audio data into a broadcasting task queue based on the broadcasting parameters, coding the audio data in the broadcasting task queue by utilizing ffmpeg software installed on the client, outputting stream media data, and sending the stream media data to corresponding remote equipment for intelligent broadcasting, namely integrating the functions of a server on the client, wherein interaction with the server is not needed in the broadcasting process, the dependence degree on various software is greatly reduced, the possibility of abnormity occurring in the software operation process is reduced, finally, light-weight intelligent broadcasting is carried out on the client, and the stability of the intelligent broadcasting is greatly improved.

Drawings

The invention will be further described with reference to the following examples with reference to the accompanying drawings.

Fig. 1 is a flow chart of a smart broadcasting method applied to a client according to the present invention.

Fig. 2 is a hardware architecture diagram of a smart broadcasting method applied to a client according to the present invention.

Detailed Description

The technical scheme in the embodiment of the application has the following general idea: the functions of the server side are integrated on the client side, namely, various functions of broadcasting are achieved through the client side, interaction with the server is not needed, the degree of dependence on various software is reduced, the possibility of abnormity occurring in the software running process is reduced, light-weight intelligent broadcasting is achieved on the client side, and the stability of the intelligent broadcasting is improved.

Referring to fig. 1 to 2, a preferred embodiment of an intelligent broadcasting method applied to a client according to the present invention includes the following steps:

step S10, after the client (client) is initialized, acquiring the device parameters of each remote device;

step S50, the client side encodes the audio data in the broadcast task queue by using ffmpeg software and outputs stream media data; when a plurality of pieces of audio data need to be played in sequence, the audio data are spliced into complete streaming media data in sequence, so that the influence on user experience caused by the occurrence of intervals during playing of remote equipment is avoided;

step S60, the client sends the streaming media data to the corresponding remote device for intelligent broadcasting based on the device parameters and the broadcast parameters; before broadcasting, initializing the task state to be a stop state to avoid repeated broadcasting;

The ultra-light deployment and broadcasting are carried out by integrating the functions of the server side through the client side, namely, the functions of broadcasting, recording, monitoring, configuring and the like are complete. According to the method for notifying the remote equipment to monitor the port through broadcasting, the problem that the monitoring port of the client needs to be configured after the equipment is installed in a network formed by WIFI, a router, a switch and other equipment in a small local area network is solved, the equipment is convenient to install and use without configuration, and the broadcasting application of a small scene is greatly simplified; the multi-tone frequency division time interval timing broadcast, the microphone and the audio mixed-tone broadcast are very suitable for the campus broadcasting scene; the networking requirements of various local area networks are met by adopting two streaming media distribution modes of RTP multicast and UDP unicast.

The step S10 specifically includes:

step S15, the client acquires the device parameters of each remote device through the bag body, and instantiates the device parameters, namely, the device parameters are converted into objects, so that the program calling is facilitated;

step S16, the client establishes a backhaul connection with each remote device based on the backhaul data protocol, and further feeds back a response instruction of receiving the device parameter to each remote device, and disconnects the backhaul connection after the feedback is completed, and maintains the heartbeat connection. The step of disconnecting the backhaul connection is: and clearing the connection parameters of the remote equipment, setting the equipment state of the remote equipment to be offline, and reserving the instantiated object. The heartbeat connection is a long connection, the return connection is a short connection, and resources are prevented from being occupied for a long time by disconnecting the return connection in time. Since the heartbeat in the backhaul traffic data and the data in the IP protocol are redundant, it is not backhauled.

JSON format is adopted for data interacted between the client and the remote device, JSON data is analyzed and stored through a Newtonsoft. And receiving and processing data interacted between the client and the remote device through the IOCP architecture.

When the system is implemented specifically, the client can send a broadcasting command, a broadcasting stopping command, a device state query command and a device parameter setting command to the remote device and receive a general response fed back by the remote device; and reporting the data fed back by the equipment state query instruction and the equipment parameter setting instruction through a return data protocol, wherein the service data type of the start-up instruction is 0x1, the service data type of the stop-broadcast instruction is 0x2, the service data type of the equipment state query instruction is 0x11, and the service data type of the equipment parameter setting instruction is 0x 12.

In step S10, the device parameters at least include a device IP, a device port, and a device serial number. In specific implementation, the device parameter may further include a device status, a resource code, and a registration identifier for identifying whether to register for the first time.

In step S20, the step of acquiring, by the client, the network data to be broadcasted specifically includes:

In step S20, the step of acquiring, by the client, the local data to be broadcasted specifically includes:

the method comprises the steps that a client acquires local audio to be broadcasted through a preset file path or a microphone, sets broadcast parameters of the local audio, calculates the local audio and the broadcast parameters by using a verification algorithm to obtain a verification code, and generates local data based on the local audio, the broadcast parameters and the verification code; the checking algorithm is CRC-32 or MPEG-2.

The step S30 specifically includes:

the audio data are signed in advance through a national secret SM2 algorithm or a national secret SM3 algorithm, a client checks the audio data by using the national secret SM2 algorithm or the national secret SM3 algorithm, and the client checks the audio data by using a check code carried by the audio data and analyzes the audio data to obtain broadcast parameters;

The RTP multicast has the advantages of high speed and small network bandwidth, and is suitable for switch equipment with a multicast distribution function in a network. The UDP unicast can be sent to only one address, if UDP data needs to be sent to a plurality of remote devices, port forwarding is needed to be carried out on a client.

The audio data is signed and checked, and the check code is used for checking, so that the safety of the audio data is guaranteed, and the integrity of the audio data is also guaranteed.

The step S40 specifically includes:

the client generates corresponding configuration parameters based on the broadcast parameters, and expands the configuration parameters into the broadcast parameters; the configuration parameters at least comprise a broadcast message identification number (EBMID), a streaming media address, a general parameter, an audio coding parameter, a specified output format, a microphone input parameter and a sound mixing parameter; the general parameter is used for identifying whether to reduce the input reading speed to the local frame rate; the microphone input parameters are used for specifying a microphone to carry out coding input;

The broadcast message identification number is used as an index of a broadcast parameter and is used for inquiring the parameter; the generation rule of the broadcast message identification number is to take the sequence code of the last task in a broadcast task queue and add one, and if no task exists in the broadcast task queue, the sequence code of the last task and one are obtained from a historical record; the stream media address is formed by combining the fixed parameter configuration and the dynamically acquired equipment information and parameter information.

Examples of the mixing parameters are as follows: -filter _ complete "[ 0] volume ═ {0} [ a ]; [1] volume ═ {1} [ b ]; [a] taking a microphone as a first path, taking local audio as a second path for inputting codes, and respectively adjusting the two paths of audio through volume parameters; the first path is designated as a main channel, and the second path can be circularly played as background music.

The step S60 specifically includes:

The data quantity of the auxiliary data is 1, and the data type is 61, that is, a plurality of streaming media data are packaged into 1 file for transmission.

The step S70 specifically includes:

In step S70, the broadcast log is stored in a rolling manner based on preset storage days, and the broadcast log, the error log, and the operation log storing different audio data are distinguished by a folder.

The following example illustrates a monitoring process in which the playback type is a timed playback:

A. the timing broadcast is recorded in a broadcast task queue after being started, and the timing broadcast carries broadcast parameters of the playing times, the playing time and the ending time; when the end time does not exist, the playing times take effect, namely, the playing times are ended after reaching the preset playing times from the playing time.

B. Scanning the broadcast task queue every second, if the broadcast task queue does not have the end time, judging whether the current time exceeds the playing time, if so, starting the timing broadcast, marking the starting of the timing broadcast, and avoiding restarting; if not, not starting the timing broadcast;

if the end time exists, judging whether the current time is greater than the playing time and less than the end time, if so, starting timing broadcast; if not, the timing broadcast is not started.

C. Scanning the broadcast task queue every second, if the broadcast task queue does not have the end time, judging whether the current playing times reach the preset playing times, if so, stopping playing; if not, continuing playing;

if the end time exists, judging whether the current time is greater than the end time, if so, stopping playing; if not, the playing is continued.

D. And scanning the broadcast task queue every second, if all the tasks played according to the times are started and the tasks with the ending time are expired, deleting the task and adding the task into the history record for storage.

E. When the broadcast task is in a starting state, scanning a broadcast task queue every second, if the equipment is in an idle state, sending a broadcast command, controlling the times and intervals of broadcast by recording the repeated sending times and the last sending time, and solving the problem of re-broadcast after the equipment is disconnected midway or abnormally recovered.

The process of stopping broadcasting is as follows: searching related tasks from the broadcast task queue according to the EBMID, traversing all remote equipment related to the tasks, sending a broadcasting stop instruction to each remote equipment, deleting the association relation between the remote equipment and the tasks, deleting task information, storing the stopped task information into historical task information, and refreshing the broadcast task queue.

In specific implementation, the parameter query and setting can be performed on the remote device, and the process is as follows:

A. and entering an equipment detailed information interface through the equipment list, wherein the unique identifier is an equipment serial number.

B. Sending a device parameter query instruction or a device parameter setting instruction through the socket, wherein the query and setting type comprises 1 and the terminal volume; 2. a local address; 3. returning an address; 4. encoding terminal resources; 5. encoding a physical address; 6. working state; 7. a fault code; 8. a device type; 9. a hardware version number; 10. a software version number; 11. a power amplifier switch; 12. timing the terminal; 13. and a return cycle, which is used for conveniently recording address information by equipment and expanding the installation address, wherein the parameter is not in a standard and is only used for displaying.

C. After receiving the returned communication data through the network parameters of the remote equipment, searching the related equipment information through the resource codes, updating the parameters of the remote equipment and refreshing.

In summary, the invention has the advantages that:

Although specific embodiments of the invention have been described above, it will be understood by those skilled in the art that the specific embodiments described are illustrative only and are not limiting upon the scope of the invention, and that equivalent modifications and variations can be made by those skilled in the art without departing from the spirit of the invention, which is to be limited only by the appended claims.

Claims

1. A smart broadcasting method applied to a client is characterized in that: the method comprises the following steps:

2. The intelligent broadcasting method applied to the client as claimed in claim 1, wherein: the step S10 specifically includes:

3. The intelligent broadcasting method applied to the client as claimed in claim 1, wherein: in step S10, the device parameters at least include a device IP, a device port, and a device serial number.

4. The intelligent broadcasting method applied to the client as claimed in claim 1, wherein: in step S20, the step of acquiring, by the client, the network data to be broadcasted specifically includes:

5. The intelligent broadcasting method applied to the client as claimed in claim 1, wherein: in step S20, the step of acquiring, by the client, the local data to be broadcasted specifically includes:

6. The intelligent broadcasting method applied to the client as claimed in claim 1, wherein: the step S30 specifically includes:

7. The intelligent broadcasting method applied to the client as claimed in claim 1, wherein: the step S40 specifically includes:

8. The intelligent broadcasting method applied to the client as claimed in claim 1, wherein: the step S60 specifically includes:

9. The intelligent broadcasting method applied to the client as claimed in claim 1, wherein: the step S70 specifically includes:

10. The intelligent broadcasting method applied to the client as claimed in claim 1, wherein: in step S70, the broadcast log is stored in a rolling manner based on preset storage days, and the broadcast log, the error log, and the operation log storing different audio data are distinguished by a folder.