CN114095108B

CN114095108B - Intelligent broadcasting method applied to client

Info

Publication number: CN114095108B
Application number: CN202111175901.0A
Authority: CN
Inventors: 王闽
Original assignee: Fujian Newland Communication Science Technologies Co ltd
Current assignee: Fujian Newland Communication Science Technologies Co ltd
Priority date: 2021-10-09
Filing date: 2021-10-09
Publication date: 2023-05-30
Anticipated expiration: 2041-10-09
Also published as: CN114095108A

Abstract

The invention provides a smart broadcasting method applied to a client in the technical field of broadcasting, which comprises the following steps: step S10, after the client is initialized, acquiring the equipment parameters of each remote equipment; step S20, the client acquires audio data to be broadcasted; step S30, after checking the audio data, the client analyzes the audio data to obtain broadcasting parameters; step S40, the client adds the audio data into a broadcasting task queue based on the broadcasting parameters; s50, the client encodes the audio data in the broadcasting task queue by using ffmpeg software and outputs streaming media data; step S60, the client side sends the streaming media data to the remote equipment for broadcasting based on the equipment parameters and the broadcasting parameters; step S70, the client side sequentially records and verifies the broadcasting task information of each audio data based on the broadcasting task queue, and stores the broadcasting log after broadcasting is completed. The invention has the advantages that: the smart broadcasting of light weight is realized on the client, and the stability of the smart broadcasting is greatly improved.

Description

Intelligent broadcasting method applied to client

Technical Field

The invention relates to the technical field of broadcasting, in particular to an intelligent broadcasting method applied to a client.

Background

At present, a service end of intelligent broadcasting is basically of a B/S (browser/server) architecture, streaming media adopts an easy Darwin streaming media server and the like, and the broadcasting terminal is used for broadcasting media; although the architecture can support a large number of broadcasting terminals, support the management and control of the broadcasting terminals on the internet, and has a wide coverage, the architecture also has the following disadvantages:

the B/S architecture needs to deploy a server, relies on various plug-ins/software (streaming media, database, etc.), and in a small local area network, the B/S architecture is too large to meet the minimum requirement (light-weight requirement) of a user, and due to the large amount of associated software, an abnormality easily occurs in the running process.

Therefore, how to provide a smart broadcasting method applied to a client to implement light smart broadcasting on the client and improve the stability of smart broadcasting is a technical problem to be solved.

Disclosure of Invention

The technical problem to be solved by the invention is to provide a smart broadcasting method applied to a client, so that the smart broadcasting on the client is realized to be light, and the stability of the smart broadcasting is improved.

The invention is realized in the following way: a smart broadcasting method applied to a client comprises the following steps:

step S10, after the client is initialized, acquiring the equipment parameters of each remote equipment;

step S20, the client acquires audio data to be broadcasted, wherein the audio data comprises network data and local data;

step S30, after the client verifies the audio data, analyzing the audio data to obtain broadcast parameters;

step S40, the client adds the audio data into a broadcasting task queue based on the broadcasting parameters;

s50, the client encodes the audio data in the broadcasting task queue by using ffmpeg software and outputs streaming media data;

step S60, the client sends the streaming media data to the corresponding remote equipment for intelligent broadcasting based on the equipment parameters and the broadcasting parameters;

step S70, the client sequentially records and verifies the broadcasting task information of each audio data based on the broadcasting task queue, and stores the broadcasting log of each audio data after the intelligent broadcasting is completed.

Further, the step S10 specifically includes:

step S11, after the client is started, starting a monitoring function of a port to finish the initialization of the client;

step S12, the client keeps heartbeat connection with each remote device based on TCP through the port;

step S13, the client acquires IP data of each remote device through the port;

s14, the client analyzes the acquired IP data to obtain a packet header, a packet body and verification data, and the packet body is verified by the verification data;

step S15, the client acquires the equipment parameters of each remote equipment through the bag body and instantiates the equipment parameters;

and S16, the client establishes backhaul connection with each remote device based on a backhaul data protocol, and then feeds back a response instruction for receiving the device parameters to each remote device, and disconnects the backhaul connection after the feedback is completed.

Further, in the step S10, the device parameter includes at least a device IP, a device port, and a device serial number.

Further, in the step S20, the obtaining, by the client, the network data to be broadcasted specifically includes:

the client establishes backhaul connection with each remote device based on a backhaul data protocol, further obtains network data to be broadcasted, and disconnects the backhaul connection after the obtaining is completed.

Further, in the step S20, the obtaining, by the client, the local data to be broadcasted specifically includes:

the client acquires local audio to be broadcasted through a preset file path or a microphone, sets broadcasting parameters of the local audio, calculates the local audio and the broadcasting parameters by using a verification algorithm to obtain a verification code, and generates local data based on the local audio, the broadcasting parameters and the verification code.

Further, the step S30 specifically includes:

the client side checks the audio data by using the check code carried by the audio data and then analyzes the audio data to obtain broadcast parameters;

the broadcast parameters at least comprise equipment serial numbers, broadcast types, broadcast levels, volume, input sound sources, play types, play times, play time, end time, audio time duration and push stream modes;

the broadcast type is daily broadcast, emergency broadcast or emergency exercise; the input sound source is local audio, a microphone or a mixed sound; the play type is immediate play or timed play; the push mode is RTP multicast or UDP unicast.

Further, the step S40 specifically includes:

the client generates corresponding configuration parameters based on the broadcast parameters and expands the configuration parameters into the broadcast parameters; the configuration parameters at least comprise a broadcast message identification number, a streaming media address, a general parameter, an audio coding parameter, a designated output format, a microphone input parameter and a mixing parameter; the general parameter is used for identifying whether the input reading speed is reduced to the local frame rate; the microphone input parameters are used for designating a microphone to carry out coding input;

the client adds the audio data into a broadcasting task queue based on the extended broadcasting parameters.

Further, the step S60 specifically includes:

and the client binds the streaming media data with the corresponding remote equipment based on the equipment parameters and the broadcasting parameters, and sends the streaming media data to the bound remote equipment in an auxiliary data format for intelligent broadcasting.

Further, the step S70 specifically includes:

the client side sequentially records the broadcasting task information of each audio data based on the broadcasting task queue; the broadcasting task information at least comprises a file path, a sampling rate, an audio time length, a current playing time and a current playing frequency;

and the client verifies whether the intelligent broadcasting is finished based on the broadcasting task information and the broadcasting parameters, and stores broadcasting logs of the audio data into a log4net log library after the intelligent broadcasting is finished.

Further, in the step S70, the broadcast log is scrolled and stored based on a preset number of days of storage, and the broadcast log, the error log and the running log for storing different audio data are distinguished by a folder.

The invention has the advantages that:

the method comprises the steps that audio data to be broadcasted are obtained through a client and analyzed to obtain broadcasting parameters, the audio data are added into a broadcasting task queue based on the broadcasting parameters, then the audio data in the broadcasting task queue are encoded by utilizing ffmpeg software installed by the client, the streaming media data are output, the streaming media data are sent to corresponding remote equipment to conduct intelligent broadcasting, namely, the function of a server is integrated on the client, interaction with the server is not needed in the broadcasting process, the dependence on various software is greatly reduced, the possibility of abnormality in the software operation process is reduced, light intelligent broadcasting on the client is finally achieved, and the stability of intelligent broadcasting is greatly improved.

Drawings

The invention will be further described with reference to examples of embodiments with reference to the accompanying drawings.

Fig. 1 is a flowchart of a smart broadcasting method applied to a client according to the present invention.

Fig. 2 is a hardware architecture diagram of a smart broadcasting method applied to a client according to the present invention.

Detailed Description

According to the technical scheme in the embodiment of the application, the overall thought is as follows: the functions of the server are integrated on the client, namely, various functions of broadcasting are realized through the client, interaction with a server is not needed, the degree of dependence on various software is reduced, the possibility of abnormality in the running process of the software is reduced, light intelligent broadcasting is realized on the client, and the stability of the intelligent broadcasting is improved.

Referring to fig. 1 to 2, a preferred embodiment of a smart broadcasting method applied to a client according to the present invention includes the following steps:

step S10, after initializing a client (client), acquiring equipment parameters of each remote equipment;

s50, the client encodes the audio data in the broadcasting task queue by using ffmpeg software and outputs streaming media data; when a plurality of audio data are required to be played sequentially, the audio data are spliced into a complete streaming media data in sequence, so that intervals are avoided when the remote equipment plays, and user experience is prevented from being influenced;

step S60, the client sends the streaming media data to the corresponding remote equipment for intelligent broadcasting based on the equipment parameters and the broadcasting parameters; before the start of the broadcasting, initializing the task state to be a stop state, so as to avoid repeated broadcasting;

The client integrates the functions of the server, namely, has complete functions of broadcasting, recording, monitoring, configuration and the like, and performs ultra-light deployment and broadcasting. The invention solves the problem that the monitoring port of the client needs to be configured after the equipment is installed by a network formed by equipment such as WIFI, a router, a switch and the like in the small local area network by broadcasting the monitoring port of the remote equipment, is convenient for the non-configuration installation and use of the equipment, and greatly simplifies the broadcasting application of the small scene; the multi-audio time-sharing timing broadcasting, the microphone and the audio mixing broadcasting are very suitable for scenes of campus broadcasting; the networking requirements of various local area networks are met by adopting two streaming media distribution modes of RTP multicast and UDP unicast.

The step S10 specifically includes:

step S13, the client acquires IP data of each remote device through the port;

step S15, the client acquires the equipment parameters of each remote equipment through the bag body, and instantiates the equipment parameters, namely, converts the equipment parameters into objects, so that the program is convenient to call;

and S16, the client establishes backhaul connection with each remote device based on a backhaul data protocol, and further feeds back a response instruction of the received device parameters to each remote device, and breaks the backhaul connection after the feedback is completed, so as to keep heartbeat connection. The step of disconnecting the backhaul connection is: the connection parameters of the remote equipment are cleared, the equipment state of the remote equipment is set to be off-line, and the instantiated object is reserved. The heartbeat connection is long connection, the return connection is short connection, and the resource is prevented from being occupied for a long time by timely disconnecting the return connection. Since the heartbeat in the backhaul traffic data and the data in the IP protocol are redundant, they are not backhauled.

The data interacted between the client and the remote equipment adopts a JSON format, and the analysis and the storage of the JSON data are carried out through a Newtonsft. JSON library, so that the data do not need to be additionally installed in a database for storage and interaction, the degree of dependence on software is reduced, and the stability of intelligent broadcasting is improved; data interacted by the client and the remote device is received and processed through the IOCP architecture.

In specific implementation, the client can send an on-air instruction, an off-air instruction, an equipment state query instruction and an equipment parameter setting instruction to the remote equipment and receive a general response fed back by the remote equipment; the data fed back by the equipment state query instruction and the equipment parameter setting instruction are reported through a return data protocol, the service data type of the on-air instruction is 0x1, the service data type of the off-air instruction is 0x2, the service data type of the equipment state query instruction is 0x11, and the service data type of the equipment parameter setting instruction is 0x12.

In the step S10, the device parameter includes at least a device IP, a device port, and a device serial number. In specific implementation, the device parameters may further include a device state, a resource code, and a registration identifier for identifying whether to register for the first time.

In the step S20, the obtaining, by the client, the network data to be broadcasted specifically includes:

In the step S20, the obtaining, by the client, the local data to be broadcasted specifically includes:

the method comprises the steps that a client obtains local audio to be broadcasted through a preset file path or a microphone, the broadcasting parameters of the local audio are set, a verification algorithm is utilized to calculate the local audio and the broadcasting parameters to obtain verification codes, and local data are generated based on the local audio, the broadcasting parameters and the verification codes; the checking algorithm is CRC-32 or MPEG-2.

The step S30 specifically includes:

the audio data is signed in advance through a national secret SM2 algorithm or a national secret SM3 algorithm, a client firstly uses the national secret SM2 algorithm or the national secret SM3 algorithm to check the audio data, and after the client checks the audio data by using a check code carried by the audio data, the client analyzes the audio data to obtain broadcasting parameters;

RTP multicast has the advantages of high speed and small network bandwidth, and is suitable for switch equipment with a multicast distribution function in a network. The UDP unicast can only be sent to one address, if the UDP data needs to be sent to a plurality of remote devices, the port forwarding is needed to be carried out on the client.

By signing and checking the audio data and checking by using the check code, the safety of the audio data is ensured, and the integrity of the audio data is also ensured.

The step S40 specifically includes:

the client generates corresponding configuration parameters based on the broadcast parameters and expands the configuration parameters into the broadcast parameters; the configuration parameters at least comprise a broadcast message identification number (EBMID), a streaming media address, general parameters, audio coding parameters, a designated output format, microphone input parameters and mixing parameters; the general parameter is used for identifying whether the input reading speed is reduced to the local frame rate; the microphone input parameters are used for designating a microphone to carry out coding input;

The broadcast message identification number is used as an index of the broadcast parameter and used for inquiring the parameter; the generation rule of the broadcast message identification number is to add one to the sequence code of the last task in the broadcast task queue, and if no task exists in the broadcast task queue, the sequence code of the last task is obtained from the history record and added one; the stream media address is formed by combining the fixed parameter configuration with the dynamically acquired equipment information and parameter information.

The mixing parameters are exemplified as follows: -filter_complex "[0] volume = {0} [ a ]; [1] volume= {1} [ b ]; [a] the microphone is used as a first path, the local audio is used as a second path for input encoding, and the two paths of audio are respectively adjusted through volume=parameters; duration=first designates the first path as the main channel, and the second path can be played back as background music loop.

The step S60 specifically includes:

The number of the auxiliary data is 1, the data type is 61, and the auxiliary data is transmitted by packing a plurality of streaming media data into 1 file.

The step S70 specifically includes:

In the step S70, the broadcast log is scrolled and stored based on a preset number of days of storage, and the broadcast log, the error log and the running log for storing different audio data are distinguished by a folder.

The following illustrates a monitoring flow with a play type of timed play:

A. after the timing broadcast is started, the timing broadcast is recorded in a broadcast task queue, and the timing broadcast carries broadcast parameters of the playing times, the playing time and the ending time; and when the time is not finished, the playing times are effective, namely, the playing times are started from the playing time, and the playing times are finished after the preset playing times are reached.

B. Scanning a broadcasting task queue every second, judging whether the current time exceeds the playing time if the broadcasting task queue does not have the ending time, if so, starting timing broadcasting, and marking that the timing broadcasting is started, so as to avoid restarting; if not, not starting the timing broadcast;

if the time is the ending time, judging whether the current time is greater than the playing time and less than the ending time, if so, starting timing broadcasting; if not, the timing broadcast is not started.

C. Scanning a broadcasting task queue every second, if no end time exists, judging whether the current playing times reach the preset playing times, and if yes, stopping playing; if not, continuing to play;

if the end time exists, judging whether the current time is greater than the end time, if so, stopping playing; if not, continuing playing.

D. And scanning a broadcast task queue every second, deleting the task when all the tasks played according to times are started and the tasks with the end time are expired, and adding the tasks into a history record for storage.

E. When the broadcasting task is in a starting state, the broadcasting task queue is scanned every second, if the equipment is in an idle state, a broadcasting instruction is sent, the times and intervals of broadcasting are controlled by recording the repeated sending times and the last sending time, and the problem that the equipment is disconnected midway or is restarted after abnormal recovery is solved.

The broadcasting stopping process comprises the following steps: searching related tasks from the broadcast task queue according to the EBMID, traversing all remote devices associated with the tasks, sending a shutdown instruction to each remote device, deleting the association relation between the remote device and the tasks, deleting task information, storing the stopped task information into historical task information, and refreshing the broadcast task queue.

In specific implementation, the remote device can be subjected to parameter query and setting, and the flow is as follows:

A. and entering a device detailed information interface through a device list, wherein the device is uniquely identified as a device serial number.

B. The method comprises the steps of sending a device parameter query instruction or a device parameter setting instruction through a socket, wherein the query and setting types are 1 and the terminal volume; 2. a local address; 3. returning an address; 4. terminal resource coding; 5. physical address coding; 6. a working state; 7. a fault code; 8. a device type; 9. a hardware version number; 10. a software version number; 11. a power amplifier switch; 12. timing at a terminal; 13. and the return period is used for conveniently recording address information by the equipment, expanding the installation address, and the parameter is not in the standard, but is just displayed.

C. And after receiving the returned communication data through the network parameters of the remote equipment, searching the related equipment information through the resource codes, updating the parameters of the remote equipment and refreshing.

In summary, the invention has the advantages that:

While specific embodiments of the invention have been described above, it will be appreciated by those skilled in the art that the specific embodiments described are illustrative only and not intended to limit the scope of the invention, and that equivalent modifications and variations of the invention in light of the spirit of the invention will be covered by the claims of the present invention.

Claims

1. An intelligent broadcasting method applied to a client side is characterized in that: the method comprises the following steps:

step S60, the client sends the streaming media data to the corresponding remote equipment for intelligent broadcasting based on the equipment parameters and the broadcasting parameters, namely, the function of the server is integrated on the client, and interaction with the server is not needed in the broadcasting process;

2. The smart broadcasting method for a client as claimed in claim 1, wherein: the step S10 specifically includes:

step S13, the client acquires IP data of each remote device through the port;

3. The smart broadcasting method for a client as claimed in claim 1, wherein: in the step S10, the device parameter includes at least a device IP, a device port, and a device serial number.

4. The smart broadcasting method for a client as claimed in claim 1, wherein: in the step S20, the obtaining, by the client, the network data to be broadcasted specifically includes:

5. The smart broadcasting method for a client as claimed in claim 1, wherein: in the step S20, the obtaining, by the client, the local data to be broadcasted specifically includes:

6. The smart broadcasting method for a client as claimed in claim 1, wherein: the step S30 specifically includes:

7. The smart broadcasting method for a client as claimed in claim 1, wherein: the step S40 specifically includes:

8. The smart broadcasting method for a client as claimed in claim 1, wherein: the step S60 specifically includes:

9. The smart broadcasting method for a client as claimed in claim 1, wherein: the step S70 specifically includes:

10. The smart broadcasting method for a client as claimed in claim 1, wherein: in the step S70, the broadcast log is scrolled and stored based on a preset number of days of storage, and the broadcast log, the error log and the running log for storing different audio data are distinguished by a folder.