CN110933469A - Multimedia method and device based on ONU integrated audio, video and broadcast - Google Patents
Multimedia method and device based on ONU integrated audio, video and broadcast Download PDFInfo
- Publication number
- CN110933469A CN110933469A CN201911174682.7A CN201911174682A CN110933469A CN 110933469 A CN110933469 A CN 110933469A CN 201911174682 A CN201911174682 A CN 201911174682A CN 110933469 A CN110933469 A CN 110933469A
- Authority
- CN
- China
- Prior art keywords
- onu
- data
- equipment
- video
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
- H04N21/2387—Stream processing in response to a playback request from an end-user, e.g. for trick-play
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26258—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for program selection
- H04N21/4825—End-user interface for program selection using a list of items to be played back in a given order, e.g. playlists
Abstract
The invention discloses a multimedia method and a multimedia device based on ONU integrated audio, video and broadcast.A service end establishes TCP connection with equipment, and selects to play music in a broadcast mode or a streaming media mode and sends a corresponding control instruction; after receiving the initialization instruction, the equipment configures a UDP port for receiving data or a streaming media playing list; after the equipment completes initialization, feeding back a result to the server, and after the server receives correct feedback, sending a playing instruction; the equipment receives a playing instruction, starts to analyze a message received from a UDP port or a playing list, writes the message into an audio driver through a function, and plays sound; and after the ending instruction is sent, the equipment closes the UDP port and the playlist request and stops writing data. The invention overcomes the defects of the prior ONU equipment in the application of multimedia audio and video, and provides a multimedia audio and video application scheme with higher cost performance and more convenient management.
Description
Technical Field
The invention belongs to the technical field of communication, and particularly relates to a multimedia method and device based on ONU integrated audio, video and broadcast.
Background
A gigabit passive optical network (abbreviated as GPON) is a broadband access technology which adopts a point-to-multipoint network structure, a passive optical fiber transmission mode, frame encapsulation based on a GPON encapsulation method (abbreviated as GEM) and provides various comprehensive services. Fig. 1 is a schematic diagram of a network architecture for GPON access according to the related art. As shown in fig. 1, the network architecture of the GPON access may include: the optical network system comprises three parts, namely a local side equipment optical line terminal (OLT for short), a user side equipment optical network unit (ONU for short) and a connecting line optical distribution network (O DN for short); an optical network terminal management and control interface (abbreviated as OMCI) provides a management and control channel for the OLT to the ONUs.
At present, other ONU equipment mostly takes data transmission as a main part, has no audio circuit, and does not support the functions of broadcasting, voice talkback, camera video transcoding streaming, screenshot and the like.
Disclosure of Invention
In order to overcome the defects in the prior art, the invention aims to overcome the defects in the prior art and provide a method and a device for integrating audio, video and broadcast based on an ONU (optical network unit), which support audio circuits, broadcast, voice talkback, camera video transcoding and streaming, screenshot and other functions.
The invention discloses a multimedia method for integrating audio, video and broadcast based on an ONU (optical network unit), which comprises the following steps:
performing data communication of a setting area through the multimedia device;
and acquiring the acquired data stream, performing data transmission based on the ONU equipment integrating audio, video and broadcast, and performing data uplink communication on the acquired audio stream data and video stream data.
As a further optimization of the above scheme, the transmission of the audio stream data comprises the following steps:
data initialization, namely connecting a server end and an ONU (optical network unit) equipment end based on a TCP (Transmission control protocol), and sending a control instruction for music playing by the server end in a broadcasting or streaming media mode;
acquiring a control instruction of music playing of a server end, and configuring a UDP (user Datagram protocol) port or a play list of streaming media for receiving data of an ONU (optical network Unit) equipment end;
completing the configuration of a play list based on a UDP port or streaming media, and transmitting an operation instruction in an uplink manner;
acquiring a correct feedback operation instruction sent by an ONU (optical network unit) equipment end, transmitting a playing instruction based on the operation instruction, analyzing an acquired message from a UDP (user datagram protocol) port or a playing list, and playing sound based on an audio drive of a function write-in device;
and after the operation ending instruction of the server end is acquired, the operation of a UDP port or a play list of the streaming media for receiving data of the ONU equipment end is carried out, the corresponding UDP port and the play list request are closed, and the data writing into the ONU equipment end is stopped.
As a further optimization of the above scheme, the transmission of the video stream data comprises the following steps:
data initialization, namely connecting a server end and an equipment end based on a TCP protocol, and sending a request instruction for checking all ONU equipment resources by the server end according to each period T;
acquiring an operation instruction of downlink transmission, and transmitting the CPU occupancy rate and the memory occupancy rate to the server side by all the ONU equipment in a feedback manner;
matching and selecting the ONU equipment with the lowest resource occupancy rate on the basis of the fed back CPU occupancy rate and memory occupancy rate data information of the ONU equipment end;
editing a task list to be subjected to transcoding operation and video stream pushing, performing transcoding and stream pushing of transmission data, and after completing resource matching of ONU equipment at a server end, distributing tasks one by one according to the edited task list;
and continuously acquiring an operation instruction of the server, and stopping the current video stream transcoding and stream pushing operation if the task ending operation instruction of the ONU equipment is detected.
As a further optimization of the above scheme, if the data to be transcoded and distributed is larger than the maximum processable number of the ONU devices that complete resource matching, the current ONU device resource is checked again, and the task is distributed again based on the check result.
As a further optimization of the above scheme, the resource occupancy rate alarm detection of the ONU device is continuously performed, and if it is detected that the resource occupancy rate is greater than the set threshold, the current video stream transcoding and stream pushing operation are stopped.
As a further optimization of the above scheme, the video stream transcoding and the stream pushing are performed by pulling, analyzing and recombining based on video stream data of the video acquisition device, and the stream pushing is to push the transcoded video stream to the video stream server.
The invention also discloses a multimedia device based on ONU integrated audio, video and broadcast, the device comprises the following parts:
the first setting module is used for carrying out data communication of a setting area through the multimedia equipment;
and the second setting module is used for acquiring the acquired data stream, carrying out data transmission based on the ONU equipment integrating audio, video and broadcast, and carrying out data uplink communication on the acquired audio stream data and video stream data.
As a further optimization of the above scheme, the second setting module includes the following:
the first initialization unit is used for initializing data, connecting the server end with the ONU equipment end based on a TCP (transmission control protocol), and sending a control instruction for playing music by the server end in a broadcasting or streaming media mode;
the first acquisition unit is used for acquiring a control instruction of music playing of the server side and configuring a UDP port for receiving data or a play list of streaming media of the ONU equipment side;
the first feedback unit is used for finishing the configuration of a play list based on a UDP port or streaming media and transmitting an operation instruction in an uplink way;
the second acquisition unit is used for acquiring a correct feedback operation instruction sent by the ONU equipment end, carrying out playing instruction transmission based on the operation instruction, carrying out acquisition message analysis from a UDP port or a play list, and carrying out sound playing based on the audio drive of the function write-in equipment;
and the third acquisition unit is used for performing the operation of a UDP port or a playlist of the streaming media for receiving the data at the ONU equipment end after acquiring the operation ending instruction of the server end, closing the corresponding UDP port and playlist request, and stopping writing the data into the ONU equipment end.
As a further optimization of the above scheme, the second setting module further includes the following:
the second initialization unit is used for initializing data, connecting the server side and the equipment side based on a TCP protocol, and sending a request instruction for checking all ONU equipment resources by the server side according to each period T;
the second feedback unit is used for acquiring the operation instruction of downlink transmission, and all the ONU equipment transmits the CPU occupancy rate and the memory occupancy rate to the server side in a feedback manner;
the equipment selection unit is used for matching and selecting the ONU equipment with the lowest resource occupancy rate on the basis of the fed back CPU occupancy rate and memory occupancy rate data information of the ONU equipment end;
the task configuration unit is used for editing a task list to be subjected to transcoding operation and video stream pushing, transcoding and stream pushing of transmission data are carried out, and after the ONU equipment resources at the server end are matched, tasks are distributed one by one according to the edited task list;
and the first stopping unit is used for continuously acquiring the operating instruction of the server side, and stopping the current video stream transcoding and stream pushing operation if the task ending operating instruction of the ONU equipment is detected.
And the second stopping unit is used for continuously carrying out resource occupancy rate alarm detection on the ONU equipment, and stopping the current video stream transcoding and stream pushing operation if the resource occupancy rate is detected to be greater than the set threshold value.
By adopting the technical scheme, compared with the prior art, the invention discloses a multimedia method and device based on ONU integrated audio, video and broadcast, which has the following technical effects:
1. the invention discloses a multimedia method for integrating audio, video and broadcast based on ONU, which integrates audio, video and broadcast for ONU equipment, overcomes the defects of the existing ONU equipment in the application of multimedia audio and video, and provides a multimedia audio and video application design with higher cost performance and more convenient management.
2. According to the ONU-based audio, video and broadcast integrated multimedia method, the playing process of the ONU equipment is subjected to diversified operation and control, so that the adaptability adjustment to various conditions in practical application is facilitated, more playing selection control is provided, the audio application scene of the ONU equipment is facilitated, and the utilization rate of the ONU equipment is improved.
3. According to the embodiment of the invention, through the resource occupation detection of the global ONU equipment controlled by the server side and the resource occupation detection results of all the ONU equipment, the tasks can be distributed to the ONU equipment with lower occupancy rates, so that the resource surplus of part of the ONU equipment is avoided, and the resource waste is avoided.
Drawings
Other features, objects and advantages of the present application will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, made with reference to the accompanying drawings in which:
fig. 1 is a schematic flow chart of a multimedia method for integrating audio, video and broadcast based on ONU in accordance with the present invention;
FIG. 2 is a schematic diagram of an audio transmission process according to the present invention;
FIG. 3 is an audio circuit diagram of the present invention;
FIG. 4 is a schematic diagram of an audio device of the present invention;
FIG. 5 is a schematic diagram of another audio transmission process according to the present invention;
FIG. 6 is a schematic view of a video transmission process according to the present invention;
FIG. 7 is a schematic diagram of an audio transmission structure according to the present invention;
fig. 8 is a schematic view of a video transmission structure according to the present invention.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
As shown in fig. 1 to 8, an embodiment of the present invention discloses a multimedia method based on ONU integrated audio, video and broadcast, which includes the following steps:
specifically, the embodiment of the invention provides a multimedia method for integrating audio, video and broadcast based on an ONU, which mainly integrates audio, video and broadcast for ONU devices, overcomes the defects of the existing ONU devices in multimedia audio and video application, and provides a multimedia audio and video application scheme with higher cost performance and more convenient management;
it should be particularly noted that, since the present invention is further improved only for the conventional method for integrating the ONU device, the embodiments of the present invention are described in detail for the OLT and the ODN
The transmission of the audio stream data comprises the following steps:
specifically, in order to implement the transmission method of the audio stream data, the embodiment of the present invention further provides an embodiment, which is to support audio by an ONU device, and specifically provides an audio conversion chip WM8960, where WM8960 is a low-power consumption and high-quality stereo codec, and is designed for portable digital audio applications;
moreover, the embodiment of the invention preferably adopts the following sound card part, namely, the sound card is butted through the McASP audio communication bus of the AM335X, and 1-channel audio output and 1-channel microphone input are carried by the development board;
in addition, in the embodiment of the invention, preferably, a 24-bit sigma-delta analog-to-digital converter and a digital-to-analog converter are adopted for stereo, and a low-power consumption oversampling digital interpolation and decimation filter and a flexible digital audio interface are adopted; the master clock can be directly input or internally generated by a built-in phase-locked loop, and supports the most common clock mode;
more specifically, the analog power voltage of the audio conversion chip is as low as 2.7V, and the digital core can operate at the lowest voltage of 1.7V to save electric quantity;
the maximum power supply voltage of the loudspeaker is 5.5V, 1W to 8W of load can be output per sound channel, the maximum power supply voltage of the rest is 3.6V, different parts of the chip can be closed by software control, and QFN packaging is carried out by adopting 32 pins of 5 multiplied by 5 mm;
by integrating the units of the ONU equipment, the PNU equipment can overcome the defects of multimedia audio application, and a multimedia audio application scheme with higher cost performance and more convenient management is provided;
specifically, the ONU device side and the background server side perform interactive operation by using an SMTP protocol, perform interactive operation based on a TCP protocol for the broadcast and music playing, and transmit data content for the broadcast and music based on a UDP protocol for the control instructions (start, pause, end, volume control, etc.) for the talk;
specifically, the method for controlling music playing provided by the embodiment of the present invention includes the following steps:
initializing, establishing TCP connection between a background server and an ONU (optical network unit) device, selecting to play music in a broadcasting mode or a streaming media mode by the background server, and sending a corresponding control instruction;
after receiving the initialization instruction, the ONU equipment configures a UDP port for receiving data or a streaming media playing list;
music playing, when the ONU equipment completes initialization, feeding back a result to the background server, and after the background server receives correct feedback, sending a playing starting instruction to the ONU equipment which completes initialization; the ONU equipment receives the playing instruction, starts to analyze the message received from the UDP port or the playing list, writes the message into the audio driver through the function and then plays the sound;
after the playing process of the ONU equipment is started, the playing control of the ONU equipment can be carried out by sending other instructions such as pause, fast forward, volume control and the like through the server sheet; after the server side sends an end instruction, the ONU equipment closes the corresponding UDP port and the play list request, stops writing data into the audio chip, and ends the music play operation of the ONU equipment;
the embodiment of the invention supports diversified operation and control on the playing process of the ONU equipment, is convenient for carrying out adaptive adjustment on various conditions in practical application, provides more playing selection control, is beneficial to the audio application scene of the ONU equipment and improves the utilization rate of the ONU equipment.
Specifically, the embodiment of the present invention further provides transmission of video stream data, including the following steps:
step 270, acquiring an operation instruction of downlink transmission, and transmitting the CPU occupancy rate and the memory occupancy rate to the server side by all the ONU devices in a feedback manner;
step 280, based on the feedback CPU occupancy rate and memory occupancy rate data information of the ONU equipment end, matching and selecting the ONU equipment with the lowest resource occupancy rate; by aiming at the ONU equipment controlled by the server side in the global situation, the equipment with lower equipment resource occupancy rate is detected, so that the resource integration and distribution of ONU video transcoding are facilitated, the resources are reasonably distributed to the maximum extent, and the resource waste caused by the overlow resource occupancy rate of part of equipment is avoided;
step 290, editing a task list to be transcoded and pushed by a video stream, transcoding and pushing transmission data, and after completing resource matching of the ONU equipment at the server end, distributing tasks one by one according to the edited task list;
step 291, continuously acquiring an operation instruction of the server, and stopping current video stream transcoding and stream pushing operation if an operation instruction of task ending of the ONU equipment is detected;
step 292, continuously performing resource occupancy rate alarm detection of the ONU device, and stopping current video stream transcoding and stream pushing operations if the detected resource occupancy rate is greater than a set threshold;
according to the embodiment of the invention, through the resource occupation detection of the global ONU equipment controlled by the server side and aiming at the resource occupation detection results of all the ONU equipment, the tasks can be distributed aiming at the ONU equipment with lower occupancy rates, so that the resource waste caused by the surplus of partial ONU equipment is avoided; and the resource occupancy rate alarm detection of the ONU equipment is continuously carried out, so that after the transcoding operation of part of the ONU equipment occurs, the initial selection fault of the ONU equipment is easily caused because the resource occupancy rate is continuously too large in the transcoding process, therefore, a protection device is arranged at the server end, the resource occupancy detection is carried out aiming at all the ONU equipment at all times, when the condition that the resource occupancy rate exceeds the set threshold value is detected, the protection device at the server end is triggered, and a stop ending instruction is sent to end the transcoding and stream pushing operation of the ONU equipment.
Specifically, if the data to be transcoded and distributed is larger than the maximum processable number of the ONU devices completing resource matching, the current ONU device resource is checked again, and the task is distributed again based on the check result;
based on the balance that the maximum amount can be processed by data to be transcoded and shunted and the number of ONU equipment, the problem that when the resource occupancy rate of the ONU equipment is detected, only the ONU equipment with too low resource occupancy rate is considered, so that the actual selection of the optional ONU equipment does not meet the requirement of the number capable of globally processing transcoding and shunting, and the ONU equipment is inevitably operated for a period of time, and the ONU resource occupancy rate is high easily after a transcoding task is performed, so that a protection device at a server end is triggered, and the transcoding task of the ONU equipment is further caused is avoided;
specifically, if the resource occupancy rate threshold of the optional ONU device is initially set to 20, that is, all ONU devices with resource occupancy rates not exceeding 20 are valid ONU devices to be assigned with tasks;
however, when transcoding distribution is actually performed, if the detected data volume required by the forwarding and stream pushing tasks is still insufficient to be provided at the maximum amount that can be processed by the current ONU device, re-detection and matching of the ONU device are performed at this time, and the resource occupancy threshold of the ONU device is raised to 40, so that the selectable number of the ONU device is enlarged, and this operation is performed cyclically until the number of the ONU devices that successfully match can satisfy the data volume required by the forwarding and stream pushing tasks;
specifically, video stream transcoding and stream pushing are based on video stream data of a video acquisition device to perform pulling, analysis and recombination, wherein the stream pushing is to push the transcoded video stream to a video stream server;
the screenshot is the sending of the picture resource to the backend server over a TCP connection.
The embodiment of the invention also discloses a multimedia device based on ONU integrated audio, video and broadcast, which comprises the following steps:
a first setting module 10 for performing data communication of a setting area through a multimedia device;
and a second setting module 20, configured to acquire the acquired data stream, perform data transmission based on the ONU device integrating audio, video, and broadcast, and perform data uplink communication on the acquired audio stream data and video stream data.
The second setup module 20 includes the following:
a first initialization unit 210, configured to initialize data, connect a server side and an ONU device side based on a TCP protocol, where the server side sends a control instruction for playing music in a broadcast or streaming media manner;
a first obtaining unit 220, configured to obtain a control instruction for music playing at a server end, and configure a UDP port for receiving data or a playlist of streaming media at an ONU device end;
a first feedback unit 230, configured to complete configuration of a UDP port or a playlist of streaming media, and transmit an operation instruction in an uplink;
a second obtaining unit 221, configured to obtain a correct feedback operation instruction sent by the ONU device, perform play instruction transmission based on the operation instruction, perform acquisition message analysis from a UDP port or a playlist, and perform sound playing based on an audio driver of the function write-in device;
a third obtaining unit 222, configured to, after obtaining the operation ending instruction of the server, perform an operation on a UDP port of the ONU device for receiving data or a playlist of the streaming media, close the corresponding UDP port and playlist request, and stop writing data into the ONU device.
The second setup module 20 further includes the following:
a second initialization unit 211, configured to initialize data, connect the server and the device based on a TCP protocol, where the server sends a request instruction for checking all ONU device resources according to each period T;
a second feedback unit 231, configured to obtain an operation instruction for downlink transmission, where all ONU devices transmit the CPU occupancy rate and the memory occupancy rate in a feedback manner to the server;
the device selection unit 240 is configured to match and select an ONU device with the lowest resource occupancy rate based on the fed-back CPU occupancy rate and memory occupancy rate data information of the ONU device end;
the task configuration unit 250 is configured to edit a task list to be transcoded and pushed by a video stream, to perform transcoding and streaming of transmission data, and to distribute tasks one by one according to the edited task list after completing resource matching of the ONU device at the server side;
the first stopping unit 260 is configured to continuously obtain an operation instruction of the server, and stop the current transcoding and streaming of the video stream if a task ending operation instruction of the ONU device is detected.
And a second stopping unit 261, configured to continuously perform resource occupancy rate alarm detection on the ONU device, and stop the current video stream transcoding and stream pushing operation if the resource occupancy rate is detected to be greater than the set threshold.
It should be noted that, as another embodiment provided by the present invention, the number of audio interfaces can be increased to support multiple audio inputs and outputs.
As another embodiment provided by the invention, the noise reduction and echo elimination algorithm of the talkback function can be optimized.
The above description is only a preferred embodiment of the application and is illustrative of the principles of the technology employed. It will be appreciated by a person skilled in the art that the scope of the invention as referred to in the present application is not limited to the embodiments with a specific combination of the above-mentioned features, but also covers other embodiments with any combination of the above-mentioned features or their equivalents without departing from the inventive concept. For example, the above features may be replaced with (but not limited to) features having similar functions disclosed in the present application.
Claims (10)
1. An ONU-based multimedia method for integrating audio, video and broadcast, the method comprising:
performing data communication of a setting area through the multimedia device;
and acquiring the acquired data stream, performing data transmission based on the ONU equipment integrating audio, video and broadcast, and performing data uplink communication on the acquired audio stream data and video stream data.
2. The ONU integrated audio, video and broadcast based multimedia method according to claim 1, wherein the transmission of the audio stream data comprises the steps of:
data initialization, namely connecting a server end and an ONU (optical network unit) equipment end based on a TCP (Transmission control protocol), and sending a control instruction for music playing by the server end in a broadcasting or streaming media mode;
acquiring a control instruction of music playing of a server end, and configuring a UDP (user Datagram protocol) port or a play list of streaming media for receiving data of an ONU (optical network Unit) equipment end;
completing the configuration of a play list based on a UDP port or streaming media, and transmitting an operation instruction in an uplink manner;
acquiring a correct feedback operation instruction sent by an ONU (optical network unit) equipment end, transmitting a playing instruction based on the operation instruction, analyzing an acquired message from a UDP (user datagram protocol) port or a playing list, and playing sound based on an audio drive of a function write-in device;
and after the operation ending instruction of the server end is acquired, the operation of a UDP port or a play list of the streaming media for receiving data of the ONU equipment end is carried out, the corresponding UDP port and the play list request are closed, and the data writing into the ONU equipment end is stopped.
3. The ONU integrated audio, video and broadcast based multimedia method according to claim 1, wherein the transmission of the video stream data comprises the steps of:
data initialization, namely connecting a server end and an equipment end based on a TCP protocol, and sending a request instruction for checking all ONU equipment resources by the server end according to each period T;
acquiring an operation instruction of downlink transmission, and transmitting the CPU occupancy rate and the memory occupancy rate to the server side by all the ONU equipment in a feedback manner;
matching and selecting the ONU equipment with the lowest resource occupancy rate on the basis of the fed back CPU occupancy rate and memory occupancy rate data information of the ONU equipment end;
editing a task list to be subjected to transcoding operation and video stream pushing, performing transcoding and stream pushing of transmission data, and after completing resource matching of ONU equipment at a server end, distributing tasks one by one according to the edited task list;
and continuously acquiring an operation instruction of the server, and stopping the current video stream transcoding and stream pushing operation if the task ending operation instruction of the ONU equipment is detected.
4. The ONU-based method of integrating audio, video, and broadcast according to claim 3,
and if the data to be transcoded and distributed is larger than the maximum processable number of the ONU equipment number matched with the resources, re-checking the resources of the current ONU equipment, and re-distributing the tasks based on the checking result.
5. The ONU-based method of integrating audio, video, and broadcast according to claim 3,
and continuously carrying out resource occupancy rate alarm detection on the ONU equipment, and stopping the current video stream transcoding and stream pushing operation if the detected resource occupancy rate is larger than a set threshold value.
6. The ONU-based method of integrating audio, video, and broadcast according to claim 3,
the video stream transcoding and stream pushing are based on the video stream data of the video acquisition equipment to be pulled, analyzed and recombined, and the stream pushing is used for pushing the transcoded video stream to a video stream server.
7. An ONU-based integrated audio, video and broadcast multimedia apparatus, comprising:
the first setting module is used for carrying out data communication of a setting area through the multimedia equipment;
and the second setting module is used for acquiring the acquired data stream, carrying out data transmission based on the ONU equipment integrating audio, video and broadcast, and carrying out data uplink communication on the acquired audio stream data and video stream data.
8. The ONU-integrated audio, video and broadcast-based multimedia device of claim 7, wherein the second setting module comprises:
the first initialization unit is used for initializing data, connecting the server end with the ONU equipment end based on a TCP (transmission control protocol), and sending a control instruction for playing music by the server end in a broadcasting or streaming media mode;
the first acquisition unit is used for acquiring a control instruction of music playing of the server side and configuring a UDP port for receiving data or a play list of streaming media of the ONU equipment side;
the first feedback unit is used for finishing the configuration of a play list based on a UDP port or streaming media and transmitting an operation instruction in an uplink way;
the second acquisition unit is used for acquiring a correct feedback operation instruction sent by the ONU equipment end, carrying out playing instruction transmission based on the operation instruction, carrying out acquisition message analysis from a UDP port or a play list, and carrying out sound playing based on the audio drive of the function write-in equipment;
and the third acquisition unit is used for performing the operation of a UDP port or a playlist of the streaming media for receiving the data at the ONU equipment end after acquiring the operation ending instruction of the server end, closing the corresponding UDP port and playlist request, and stopping writing the data into the ONU equipment end.
9. The ONU integrated audio, video and broadcast based multimedia device according to claim 7, wherein the second setting module further comprises:
the second initialization unit is used for initializing data, connecting the server side and the equipment side based on a TCP protocol, and sending a request instruction for checking all ONU equipment resources by the server side according to each period T;
the second feedback unit is used for acquiring the operation instruction of downlink transmission, and all the ONU equipment transmits the CPU occupancy rate and the memory occupancy rate to the server side in a feedback manner;
the equipment selection unit is used for matching and selecting the ONU equipment with the lowest resource occupancy rate on the basis of the fed back CPU occupancy rate and memory occupancy rate data information of the ONU equipment end;
the task configuration unit is used for editing a task list to be subjected to transcoding operation and video stream pushing, transcoding and stream pushing of transmission data are carried out, and after the ONU equipment resources at the server end are matched, tasks are distributed one by one according to the edited task list;
and the first stopping unit is used for continuously acquiring the operating instruction of the server side, and stopping the current video stream transcoding and stream pushing operation if the task ending operating instruction of the ONU equipment is detected.
10. The ONU-integrated audio, video and broadcast-based multimedia system of claim 7, further comprising:
and the second stopping unit is used for continuously carrying out resource occupancy rate alarm detection on the ONU equipment, and stopping the current video stream transcoding and stream pushing operation if the resource occupancy rate is detected to be greater than the set threshold value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911174682.7A CN110933469B (en) | 2019-11-26 | 2019-11-26 | Multimedia method and device based on ONU integrated audio, video and broadcast |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911174682.7A CN110933469B (en) | 2019-11-26 | 2019-11-26 | Multimedia method and device based on ONU integrated audio, video and broadcast |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110933469A true CN110933469A (en) | 2020-03-27 |
| CN110933469B CN110933469B (en) | 2022-01-28 |
Family
ID=69851997
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911174682.7A Active CN110933469B (en) | 2019-11-26 | 2019-11-26 | Multimedia method and device based on ONU integrated audio, video and broadcast |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110933469B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001005078A2 (en) * | 1999-07-12 | 2001-01-18 | Walter Jay Weingarten | Transparent systems for communication over computer networks |
| CN1571304A (en) * | 2003-07-26 | 2005-01-26 | 华为技术有限公司 | An optical fibre transmission system and implementing method of optical fibre transmission thereof |
| JP2006174211A (en) * | 2004-12-17 | 2006-06-29 | Synclayer Inc | Optical terminal device |
| EP2273428A1 (en) * | 2008-03-07 | 2011-01-12 | Sicurezza e Ambiente S.p.A. | Computer system, for management of a nationwide intervention network, suitable to provide the re-establishment of normal road conditions, after road accidents |
| CN201910895U (en) * | 2010-09-21 | 2011-07-27 | 顾海涛 | IPQAM realizing device capable of utilizing resources flexibly and sufficiently |
| US8266664B2 (en) * | 2007-01-31 | 2012-09-11 | At&T Intellectual Property I, Lp | Methods and apparatus to provide messages to television users |
| CN103607791A (en) * | 2013-12-03 | 2014-02-26 | 太仓市同维电子有限公司 | Double-uplink optical network unit based on LTE and PON |
| CN105939465A (en) * | 2016-06-22 | 2016-09-14 | 苏州市高事达信息科技股份有限公司 | Video data optical station |
| CN109743646A (en) * | 2019-03-12 | 2019-05-10 | 深圳市瑞吉联通信科技有限公司 | A kind of delivery method and device of broadband connection data flow |
-
2019
- 2019-11-26 CN CN201911174682.7A patent/CN110933469B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001005078A2 (en) * | 1999-07-12 | 2001-01-18 | Walter Jay Weingarten | Transparent systems for communication over computer networks |
| CN1571304A (en) * | 2003-07-26 | 2005-01-26 | 华为技术有限公司 | An optical fibre transmission system and implementing method of optical fibre transmission thereof |
| JP2006174211A (en) * | 2004-12-17 | 2006-06-29 | Synclayer Inc | Optical terminal device |
| US8266664B2 (en) * | 2007-01-31 | 2012-09-11 | At&T Intellectual Property I, Lp | Methods and apparatus to provide messages to television users |
| EP2273428A1 (en) * | 2008-03-07 | 2011-01-12 | Sicurezza e Ambiente S.p.A. | Computer system, for management of a nationwide intervention network, suitable to provide the re-establishment of normal road conditions, after road accidents |
| CN201910895U (en) * | 2010-09-21 | 2011-07-27 | 顾海涛 | IPQAM realizing device capable of utilizing resources flexibly and sufficiently |
| CN103607791A (en) * | 2013-12-03 | 2014-02-26 | 太仓市同维电子有限公司 | Double-uplink optical network unit based on LTE and PON |
| CN105939465A (en) * | 2016-06-22 | 2016-09-14 | 苏州市高事达信息科技股份有限公司 | Video data optical station |
| CN109743646A (en) * | 2019-03-12 | 2019-05-10 | 深圳市瑞吉联通信科技有限公司 | A kind of delivery method and device of broadband connection data flow |
Non-Patent Citations (1)
| Title |
|---|
| 聂邵华: "基于PON技术电信光纤接入网涉及", 《中国优秀硕士学位论文全文数据库》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110933469B (en) | 2022-01-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104935615B (en) | Realize the system and method for voice control household appliance | |
| CN103248863B (en) | A kind of picture pick-up device, communication system and corresponding image processing method | |
| CN109979479B (en) | Echo cancellation method, device, equipment and storage medium | |
| CN105376516A (en) | Mobile video conference system and implementing method thereof | |
| US20060026002A1 (en) | Method and system for handling audio signals of conference | |
| US20210021657A1 (en) | Common distribution of audio and power signals | |
| CN109547844A (en) | Audio/video pushing method and plug-flow client based on WebRTC agreement | |
| US20070107507A1 (en) | Mute processing apparatus and method for automatically sending mute frames | |
| CN110300322B (en) | Screen recording method, client and terminal equipment | |
| US7180535B2 (en) | Method, hub system and terminal equipment for videoconferencing | |
| CN107390532A (en) | A kind of speech recognition intelligent domestic system based on cloud computing | |
| WO2012168391A1 (en) | Method for exiting a low-consumption standby mode, and associated device | |
| CN101547335A (en) | Method and system for calling a multimedia conference using IPTV system | |
| CN108259857A (en) | A kind of two-way intercommunication integral system of video monitoring public broadcasting and its control method | |
| CN110933469B (en) | Multimedia method and device based on ONU integrated audio, video and broadcast | |
| US20110211037A1 (en) | Conferencing System With A Database Of Mode Definitions | |
| EP2665260A1 (en) | Transmitting device, transmitting method, receiving device, receiving method, program, and content delivery system | |
| CN107493453A (en) | System and method for netted end-to-end video conference | |
| US20070129037A1 (en) | Mute processing apparatus and method | |
| CN101754024B (en) | Multiplexing device and multiplexing method | |
| CN100484175C (en) | Method and system of implementing report of current speaker during conference | |
| US20070133589A1 (en) | Mute processing apparatus and method | |
| CN108513159A (en) | Multiple terminals synchronous broadcast controlling method, main equipment, apparatus and system | |
| US5668738A (en) | Dynamic idle aggregation in digital signal transmission | |
| CN103325385A (en) | Method and device for speech communication and method and device for operating jitter buffer |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |