CN117097962A - Multiplexing duration prediction system for wireless transmission - Google Patents

Multiplexing duration prediction system for wireless transmission Download PDF

Info

Publication number
CN117097962A
CN117097962A CN202311359018.6A CN202311359018A CN117097962A CN 117097962 A CN117097962 A CN 117097962A CN 202311359018 A CN202311359018 A CN 202311359018A CN 117097962 A CN117097962 A CN 117097962A
Authority
CN
China
Prior art keywords
multiplexing
target
file
duration
video file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202311359018.6A
Other languages
Chinese (zh)
Other versions
CN117097962B (en
Inventor
许凯杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Yunzhou Communication Technology Co ltd
Original Assignee
Jiangsu Yunzhou Communication Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Yunzhou Communication Technology Co ltd filed Critical Jiangsu Yunzhou Communication Technology Co ltd
Priority to CN202311359018.6A priority Critical patent/CN117097962B/en
Publication of CN117097962A publication Critical patent/CN117097962A/en
Application granted granted Critical
Publication of CN117097962B publication Critical patent/CN117097962B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234381—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2368—Multiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/251—Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computing Systems (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The invention relates to a multiplexing duration prediction system for wireless transmission, comprising: the customized notification mechanism is used for sending out a time length overrun signal when the multiplexing processing time length of multiplexing the target video file and the target audio file which are intelligently predicted exceeds the limit, or else, sending out a time length reliable signal; and the multiplexing processing mechanism is used for executing multiplexing processing when the time length reliable signal is received, and sending out a frame rate reducing request to request the frame rate of the target video file to be reduced when the time length overrun signal is received. According to the invention, a targeted AI prediction model can be constructed, prediction of multiplexing duration of each video file and accompanying audio files thereof can be executed based on the screened basic data, subsequent multiplexing, channel coding and radio frequency transmission can be executed when the predicted duration is not overrun, and frame rate reduction processing is requested to be carried out on the target video file when the predicted duration is overrun so as to ensure that the total duration of the whole wireless coding transmission process is not overrun.

Description

Multiplexing duration prediction system for wireless transmission
Technical Field
The invention relates to the field of wireless transmission, in particular to a multiplexing duration prediction system for wireless transmission.
Background
In the wireless transmission process, different data sources need to be multiplexed into the same multiplexing data stream at a source coding end, and the multiplexing data stream is subjected to channel coding and radio frequency transmission so as to complete signal processing of a transmitting end in the whole wireless transmission process.
Multiplexing is a technology that combines multiple low-speed channels into one high-speed channel, which can effectively increase the utilization rate of data links, so that one high-speed backbone link simultaneously serves multiple low-speed access links, that is, the network backbone can simultaneously carry a large amount of video, voice and data transmission.
Multiplexing is a technique for establishing a plurality of communication channels on one physical line in order to make full use of transmission media. The essence of multiplexing technology is that a plurality of user data in one area are collected by a transmitting multiplexer, then the collected data are transmitted by one physical line, and then the data are separated by a receiving multiplexer and distributed to a plurality of users.
However, in actual operation, due to different data types and configurations of various data sources, multiplexing of video and audio with some configurations is too long, and the time cannot be compensated for at the subsequent channel coding end and the radio frequency transmitting end, so that the whole wireless data transmission time is too long, and the time requirement of wireless data transmission cannot be met.
The technical proposal proposed in the prior art is as follows: the method, the system, the storage medium and the mobile terminal for reducing the front-end wireless transmission time (patent application number 2020111231749) proposed by TCL communication (Ningbo) limited company are used for accessing a wireless channel and determining the idle state of the wireless channel by adopting a monitoring avoidance mechanism, and transmitting data issued by an effective application program in an effective time period through the idle channel, so that the data transmission time is reduced, and the network service quality is improved.
Disclosure of Invention
To solve the technical problems in the related art, the present invention provides a multiplexing duration prediction system for wireless transmission, the system comprising:
the first capturing device is used for acquiring various inherent data of a target video file to be multiplexed at a source coding end, wherein the various inherent data of the target video file are the total bit number of binary data of the target video file, the horizontal resolution and the vertical resolution of a single video frame and the number of video frames;
the second capturing device is used for acquiring various inherent data of a target audio file to be multiplexed by the source coding end, wherein the various inherent data of the target audio file are the total bit number of binary data of the target audio file, a type identifier corresponding to an audio coding type and the total bit of binary data of an accompanying audio signal corresponding to a single video frame, and the target audio file is media content played synchronously with the target video file;
the step-by-step construction equipment is used for executing multiple training operations on the BP neural network to obtain the BP neural network after the multiple training operations, and outputting the BP neural network as an AI prediction model, wherein the training operation times corresponding to the multiple training operations are monotonically and positively associated with the number of video frames;
the duration analysis mechanism is respectively connected with the first capturing device, the second capturing device and the step-by-step construction device and is used for intelligently predicting multiplexing processing duration required for multiplexing the target video file and the target audio file by adopting an AI prediction model based on various inherent data of the target video file and various inherent data of the target audio file;
the customized notification mechanism is connected with the duration analysis mechanism and is used for sending out a duration overrun signal when the multiplexing duration required by multiplexing the target video file and the target audio file which are intelligently predicted exceeds a set duration threshold value, and sending out a duration reliable signal when the multiplexing duration required by multiplexing the target video file and the target audio file which are intelligently predicted does not exceed the set duration threshold value;
the multiplexing processing mechanism is positioned at the source coding end, connected with the customization notification mechanism and used for executing multiplexing processing on the target video file and the target audio file to be multiplexed when the time-length reliable signal is received so as to obtain multiplexing coded data;
the multiplexing processing mechanism is further used for suspending the multiplexing processing of the target video file and the target audio file to be multiplexed when the reliable duration signal is received, and sending out a frame rate reduction request to request the frame rate reduction of the target video file.
According to the technical scheme, a targeted AI prediction model can be constructed, prediction of multiplexing duration of multiplexing each video file and accompanying audio files thereof can be performed based on screened basic data, subsequent multiplexing, channel coding and radio frequency transmission can be performed when the prediction duration is not overrun, and frame rate reduction processing is requested to be performed on a target video file when the prediction duration is overrun so as to ensure that the total duration of the whole wireless coding transmission process is not overrun, so that the intelligent level of wireless transmission duration management is improved.
Drawings
Embodiments of the present invention will be described below with reference to the accompanying drawings.
Fig. 1 is an internal structural diagram of a multiplexing duration prediction system for wireless transmission according to a first embodiment of the present invention.
Fig. 2 is an internal structural diagram of a multiplexing duration prediction system for wireless transmission according to a second embodiment of the present invention.
Fig. 3 is an internal structural view of a multiplexing time duration prediction system for wireless transmission according to a third embodiment of the present invention.
Detailed Description
An embodiment of the multiplexing time length prediction system for wireless transmission according to the present invention will be described in detail with reference to the accompanying drawings.
First embodiment
Fig. 1 is an internal structural diagram of a multiplexing time duration prediction system for wireless transmission according to a first embodiment of the present invention, the system including:
the first capturing device is used for acquiring various inherent data of a target video file to be multiplexed at a source coding end, wherein the various inherent data of the target video file are the total bit number of binary data of the target video file, the horizontal resolution and the vertical resolution of a single video frame and the number of video frames;
in particular, a programmable logic device may be optionally employed to implement the first capture device and a second capture device as described below;
the second capturing device is used for acquiring various inherent data of a target audio file to be multiplexed by the source coding end, wherein the various inherent data of the target audio file are the total bit number of binary data of the target audio file, a type identifier corresponding to an audio coding type and the total bit of binary data of an accompanying audio signal corresponding to a single video frame, and the target audio file is media content played synchronously with the target video file;
the step-by-step construction equipment is used for executing multiple training operations on the BP neural network to obtain the BP neural network after the multiple training operations, and outputting the BP neural network as an AI prediction model, wherein the training operation times corresponding to the multiple training operations are monotonically and positively associated with the number of video frames;
illustratively, the monotonically positive association of the training operation times corresponding to the plurality of training operations with the number of video frames includes: the training operation times corresponding to the multiple training operations are in direct proportion to the number of video frames;
the duration analysis mechanism is respectively connected with the first capturing device, the second capturing device and the step-by-step construction device and is used for intelligently predicting multiplexing processing duration required for multiplexing the target video file and the target audio file by adopting an AI prediction model based on various inherent data of the target video file and various inherent data of the target audio file;
the customized notification mechanism is connected with the duration analysis mechanism and is used for sending out a duration overrun signal when the multiplexing duration required by multiplexing the target video file and the target audio file which are intelligently predicted exceeds a set duration threshold value, and sending out a duration reliable signal when the multiplexing duration required by multiplexing the target video file and the target audio file which are intelligently predicted does not exceed the set duration threshold value;
the multiplexing processing mechanism is positioned at the source coding end, connected with the customization notification mechanism and used for executing multiplexing processing on the target video file and the target audio file to be multiplexed when the time-length reliable signal is received so as to obtain multiplexing coded data;
the multiplexing processing mechanism is further used for suspending the multiplexing processing of the target video file and the target audio file to be multiplexed when the reliable duration signal is received, and sending a frame rate reduction request to request the frame rate reduction of the target video file;
the method comprises the steps of executing multiple training operations on the BP neural network to obtain the BP neural network after the multiple training operations, and outputting the BP neural network as an AI prediction model, wherein the monotonic forward association of training operation times corresponding to the multiple training operations and the number of video frames further comprises: in each training operation performed on the BP neural network, multiplexing the known multiplexing processing time length actually used by multiplexing the single video file and the single audio file is used as the output content of the BP neural network;
the method comprises the steps of executing multiple training operations on the BP neural network to obtain the BP neural network after the multiple training operations, and outputting the BP neural network as an AI prediction model, wherein the monotonic forward association of training operation times corresponding to the multiple training operations and the number of video frames further comprises: in each training operation performed on the BP neural network, the individual pieces of intrinsic data of the single video file and the individual pieces of intrinsic data of the single audio file are also taken as input contents of the BP neural network.
Second embodiment
Fig. 2 is an internal structural diagram of a multiplexing duration prediction system for wireless transmission according to a second embodiment of the present invention.
The multiplexing duration prediction system for wireless transmission in fig. 2 may include:
the first capturing device is used for acquiring various inherent data of a target video file to be multiplexed at a source coding end, wherein the various inherent data of the target video file are the total bit number of binary data of the target video file, the horizontal resolution and the vertical resolution of a single video frame and the number of video frames;
the second capturing device is used for acquiring various inherent data of a target audio file to be multiplexed by the source coding end, wherein the various inherent data of the target audio file are the total bit number of binary data of the target audio file, a type identifier corresponding to an audio coding type and the total bit of binary data of an accompanying audio signal corresponding to a single video frame, and the target audio file is media content played synchronously with the target video file;
the step-by-step construction equipment is used for executing multiple training operations on the BP neural network to obtain the BP neural network after the multiple training operations, and outputting the BP neural network as an AI prediction model, wherein the training operation times corresponding to the multiple training operations are monotonically and positively associated with the number of video frames;
the duration analysis mechanism is respectively connected with the first capturing device, the second capturing device and the step-by-step construction device and is used for intelligently predicting multiplexing processing duration required for multiplexing the target video file and the target audio file by adopting an AI prediction model based on various inherent data of the target video file and various inherent data of the target audio file;
the customized notification mechanism is connected with the duration analysis mechanism and is used for sending out a duration overrun signal when the multiplexing duration required by multiplexing the target video file and the target audio file which are intelligently predicted exceeds a set duration threshold value, and sending out a duration reliable signal when the multiplexing duration required by multiplexing the target video file and the target audio file which are intelligently predicted does not exceed the set duration threshold value;
the multiplexing processing mechanism is positioned at the source coding end, connected with the customization notification mechanism and used for executing multiplexing processing on the target video file and the target audio file to be multiplexed when the time-length reliable signal is received so as to obtain multiplexing coded data;
the channel coding mechanism is connected with the multiplexing processing mechanism and is used for carrying out channel coding on the multiplexing coded data so as to obtain channel coded data;
for example, the channel coding mechanism may be implemented using an SOC device or an ASIC device selectively for channel coding the multiplexed coded data to obtain channel coded data.
Third embodiment
Fig. 3 is an internal structural view of a multiplexing time duration prediction system for wireless transmission according to a third embodiment of the present invention.
The multiplexing time length prediction system for wireless transmission in fig. 3 may include:
the first capturing device is used for acquiring various inherent data of a target video file to be multiplexed at a source coding end, wherein the various inherent data of the target video file are the total bit number of binary data of the target video file, the horizontal resolution and the vertical resolution of a single video frame and the number of video frames;
the second capturing device is used for acquiring various inherent data of a target audio file to be multiplexed by the source coding end, wherein the various inherent data of the target audio file are the total bit number of binary data of the target audio file, a type identifier corresponding to an audio coding type and the total bit of binary data of an accompanying audio signal corresponding to a single video frame, and the target audio file is media content played synchronously with the target video file;
the step-by-step construction equipment is used for executing multiple training operations on the BP neural network to obtain the BP neural network after the multiple training operations, and outputting the BP neural network as an AI prediction model, wherein the training operation times corresponding to the multiple training operations are monotonically and positively associated with the number of video frames;
the duration analysis mechanism is respectively connected with the first capturing device, the second capturing device and the step-by-step construction device and is used for intelligently predicting multiplexing processing duration required for multiplexing the target video file and the target audio file by adopting an AI prediction model based on various inherent data of the target video file and various inherent data of the target audio file;
the customized notification mechanism is connected with the duration analysis mechanism and is used for sending out a duration overrun signal when the multiplexing duration required by multiplexing the target video file and the target audio file which are intelligently predicted exceeds a set duration threshold value, and sending out a duration reliable signal when the multiplexing duration required by multiplexing the target video file and the target audio file which are intelligently predicted does not exceed the set duration threshold value;
the multiplexing processing mechanism is positioned at the source coding end, connected with the customization notification mechanism and used for executing multiplexing processing on the target video file and the target audio file to be multiplexed when the time-length reliable signal is received so as to obtain multiplexing coded data;
the channel coding mechanism is connected with the multiplexing processing mechanism and is used for carrying out channel coding on the multiplexing coded data so as to obtain channel coded data;
and the wireless transmission mechanism is connected with the channel coding mechanism and is used for performing radio frequency transmission on the received channel coded data so as to complete wireless transmission on the channel coded data through a wireless transmission channel.
Next, a further description will be given of the specific structure of the multiplexing time length prediction system for wireless transmission of the present invention.
In a multiplexing time length prediction system for wireless transmission according to any embodiment of the present invention:
the multiplexing processing time length required for multiplexing the target video file and the target audio file by adopting the AI prediction model to intelligently predict based on the inherent data of the target video file and the inherent data of the target audio file comprises the following steps: taking all the inherent data of the target video file and all the inherent data of the target audio file as input contents of an AI prediction model;
the multiplexing processing time length required for multiplexing the target video file and the target audio file by adopting the AI prediction model to intelligently predict based on the inherent data of the target video file and the inherent data of the target audio file further comprises: and operating the AI prediction model to obtain multiplexing processing time required by multiplexing the target video file and the target audio file, which are output by the AI prediction model.
In a multiplexing time length prediction system for wireless transmission according to any embodiment of the present invention:
performing multiple training operations on the BP neural network to obtain the BP neural network after the multiple training operations, and outputting the BP neural network as an AI prediction model, wherein the monotonic forward correlation between the training operation times corresponding to the multiple training operations and the number of video frames comprises: the more the number of video frames, the more the training operation times corresponding to the plurality of training operations.
In a multiplexing time length prediction system for wireless transmission according to any embodiment of the present invention:
acquiring all inherent data of a target audio file to be multiplexed by a source coding end, wherein the inherent data of the target audio file is the total bit number of binary data of the target audio file, a type identifier corresponding to an audio coding type and the total bit number of binary data of an accompanying audio signal corresponding to a single video frame, and the method comprises the following steps: each video frame has corresponding accompanying audio signals, and each video frame and the corresponding accompanying audio signals are synchronously played in the same time section during playing.
And in a multiplexing time length prediction system for wireless transmission according to any embodiment of the present invention:
the method for acquiring the inherent data of the target video file to be multiplexed by the source coding end, wherein the inherent data of the target video file is the total bit number of binary data of the target video file, the horizontal resolution and the vertical resolution of a single video frame and the number of the video frames, and comprises the following steps: the horizontal resolution of a single video frame is the total number of pixel columns in the video picture corresponding to the single video frame;
the method for acquiring the inherent data of the target video file to be multiplexed by the source coding end, wherein the inherent data of the target video file is the total bit number of binary data of the target video file, the horizontal resolution and the vertical resolution of a single video frame and the number of the video frames, and comprises the following steps: the vertical resolution of a single video frame is the total number of pixel rows in the video picture to which the single video frame corresponds.
In addition, in the multiplexing duration prediction system for wireless transmission, performing multiple training operations on the BP neural network to obtain the BP neural network after the multiple training operations, and outputting the BP neural network as an AI prediction model, where the number of training operations corresponding to the multiple training operations is monotonically and positively associated with the number of video frames, and the method further includes: and performing multiple training operations on the BP neural network by using an MATLAB tool box to obtain the BP neural network after the multiple training operations, and outputting the BP neural network as an AI prediction model, wherein the training operation times corresponding to the multiple training operations are monotonically and positively associated with the number of video frames.
The invention has at least the following three important invention points:
inventive point a: the method comprises the steps that an AI prediction model which is designed in a targeted manner is adopted to intelligently predict the time length consumed when a target video file at a source coding end and a target audio file of accompanying sound thereof are multiplexed in the future, so that when the multiplexing time length of intelligent prediction is too long, the target video file is requested to be subjected to frame rate reduction processing to ensure that the total time length of the whole wireless coding transmission process is not overrun, and intelligent management of the wireless coding transmission process is realized;
invention point B: performing multiple training operations on the BP neural network to obtain the BP neural network subjected to the multiple training operations and inputting the BP neural network as an AI prediction model into intelligent prediction of multiplexing time length, wherein training operation times corresponding to the multiple training operations are monotonically and positively associated with the number of video frames, so that the targeted design of the AI prediction model is realized;
invention point C: and screening reliable and comprehensive basic data for intelligent prediction of an AI prediction model, wherein the basic data comprise all inherent data of a target video file and all inherent data of a target audio file, wherein the inherent data of the target video file are the total bit number of binary data of the target video file, the horizontal resolution and the vertical resolution of a single video frame and the number of video frames, and the inherent data of the target audio file are the total bit number of binary data of the target audio file, a type identifier corresponding to an audio coding type and the total bit of binary data of an accompanying audio signal corresponding to the single video frame.
The multiplexing time length prediction system for wireless transmission is used for solving the technical problem that the multiplexing time length is difficult to effectively predict and the whole wireless transmission time length is difficult to control in the prior art, performing prediction of the time length of multiplexing each video file and the accompanying audio files based on the screened basic data by constructing a targeted AI prediction model, performing subsequent multiplexing, channel coding and radio frequency transmission when the prediction time length is not out of limit, and requesting to perform frame rate reduction processing on a target video file when the prediction time length is out of limit so as to ensure that the total time length of the whole wireless coding transmission process is not out of limit, thereby completing effective control of the wireless channel transmission time length.
While the invention has been described with considerable specificity, it should be appreciated that those skilled in the art may change the elements thereof without departing from the spirit and scope of the invention. It is believed that the system of the present invention and the attendant advantages thereof will be understood by the foregoing description and it will be apparent that various changes may be made in the form, construction and arrangement of the components thereof without departing from the scope and spirit of the invention or without sacrificing all of its material advantages, the form herein before described being merely an explanatory embodiment thereof, and further without providing additional material change. The claims are intended to cover and include such modifications.

Claims (9)

1. A multiplex duration prediction system for wireless transmissions, the system comprising:
the first capturing device is used for acquiring various inherent data of a target video file to be multiplexed at a source coding end, wherein the various inherent data of the target video file are the total bit number of binary data of the target video file, the horizontal resolution and the vertical resolution of a single video frame and the number of video frames;
the second capturing device is used for acquiring various inherent data of a target audio file to be multiplexed by the source coding end, wherein the various inherent data of the target audio file are the total bit number of binary data of the target audio file, a type identifier corresponding to an audio coding type and the total bit of binary data of an accompanying audio signal corresponding to a single video frame, and the target audio file is media content played synchronously with the target video file;
the step-by-step construction equipment is used for executing multiple training operations on the BP neural network to obtain the BP neural network after the multiple training operations, and outputting the BP neural network as an AI prediction model, wherein the training operation times corresponding to the multiple training operations are monotonically and positively associated with the number of video frames;
the duration analysis mechanism is respectively connected with the first capturing device, the second capturing device and the step-by-step construction device and is used for intelligently predicting multiplexing processing duration required for multiplexing the target video file and the target audio file by adopting an AI prediction model based on various inherent data of the target video file and various inherent data of the target audio file;
the customized notification mechanism is connected with the duration analysis mechanism and is used for sending out a duration overrun signal when the multiplexing duration required by multiplexing the target video file and the target audio file which are intelligently predicted exceeds a set duration threshold value, and sending out a duration reliable signal when the multiplexing duration required by multiplexing the target video file and the target audio file which are intelligently predicted does not exceed the set duration threshold value;
the multiplexing processing mechanism is positioned at the source coding end, connected with the customization notification mechanism and used for executing multiplexing processing on the target video file and the target audio file to be multiplexed when the time-length reliable signal is received so as to obtain multiplexing coded data;
the multiplexing processing mechanism is further used for suspending the multiplexing processing of the target video file and the target audio file to be multiplexed when the reliable duration signal is received, and sending out a frame rate reduction request to request the frame rate reduction of the target video file.
2. The multiplexing time duration prediction system for wireless transmission according to claim 1, wherein:
performing multiple training operations on the BP neural network to obtain the BP neural network after the multiple training operations, and outputting the BP neural network as an AI prediction model, wherein the monotonic forward correlation between the training operation times corresponding to the multiple training operations and the number of video frames further comprises: in each training operation performed on the BP neural network, multiplexing the known multiplexing processing time length actually used by multiplexing the single video file and the single audio file is used as the output content of the BP neural network;
the method comprises the steps of executing multiple training operations on the BP neural network to obtain the BP neural network after the multiple training operations, and outputting the BP neural network as an AI prediction model, wherein the monotonic forward association of training operation times corresponding to the multiple training operations and the number of video frames further comprises: in each training operation performed on the BP neural network, the individual pieces of intrinsic data of the single video file and the individual pieces of intrinsic data of the single audio file are also taken as input contents of the BP neural network.
3. The multiplexing time duration prediction system for wireless transmission according to claim 2, wherein the system further comprises:
and the channel coding mechanism is connected with the multiplexing processing mechanism and is used for carrying out channel coding on the multiplexing coded data so as to obtain channel coded data.
4. The multiplex duration prediction system for wireless transmission of claim 3, wherein the system further comprises:
and the wireless transmission mechanism is connected with the channel coding mechanism and is used for performing radio frequency transmission on the received channel coded data so as to complete wireless transmission on the channel coded data through a wireless transmission channel.
5. A multiplex duration prediction system for wireless transmission according to any one of claims 2 to 4 wherein:
the multiplexing processing time length required for multiplexing the target video file and the target audio file by adopting the AI prediction model to intelligently predict based on the inherent data of the target video file and the inherent data of the target audio file comprises the following steps: and taking all the intrinsic data of the target video file and all the intrinsic data of the target audio file as input contents of the AI prediction model.
6. The multiplexing time duration prediction system for wireless transmission according to claim 5 wherein:
the multiplexing processing time length required for multiplexing the target video file and the target audio file by adopting the AI prediction model to intelligently predict based on the inherent data of the target video file and the inherent data of the target audio file further comprises: and operating the AI prediction model to obtain multiplexing processing time required by multiplexing the target video file and the target audio file, which are output by the AI prediction model.
7. A multiplex duration prediction system for wireless transmission according to any one of claims 2 to 4 wherein:
performing multiple training operations on the BP neural network to obtain the BP neural network after the multiple training operations, and outputting the BP neural network as an AI prediction model, wherein the monotonic forward correlation between the training operation times corresponding to the multiple training operations and the number of video frames comprises: the more the number of video frames, the more the training operation times corresponding to the plurality of training operations.
8. A multiplex duration prediction system for wireless transmission according to any one of claims 2 to 4 wherein:
acquiring all inherent data of a target audio file to be multiplexed by a source coding end, wherein the inherent data of the target audio file is the total bit number of binary data of the target audio file, a type identifier corresponding to an audio coding type and the total bit number of binary data of an accompanying audio signal corresponding to a single video frame, and the method comprises the following steps: each video frame has corresponding accompanying audio signals, and each video frame and the corresponding accompanying audio signals are synchronously played in the same time section during playing.
9. A multiplex duration prediction system for wireless transmission according to any one of claims 2 to 4 wherein:
the method for acquiring the inherent data of the target video file to be multiplexed by the source coding end, wherein the inherent data of the target video file is the total bit number of binary data of the target video file, the horizontal resolution and the vertical resolution of a single video frame and the number of the video frames, and comprises the following steps: the horizontal resolution of a single video frame is the total number of pixel columns in the video picture corresponding to the single video frame;
the method for acquiring the inherent data of the target video file to be multiplexed by the source coding end, wherein the inherent data of the target video file is the total bit number of binary data of the target video file, the horizontal resolution and the vertical resolution of a single video frame and the number of the video frames, and comprises the following steps: the vertical resolution of a single video frame is the total number of pixel rows in the video picture to which the single video frame corresponds.
CN202311359018.6A 2023-10-19 2023-10-19 Multiplexing duration prediction system for wireless transmission Active CN117097962B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311359018.6A CN117097962B (en) 2023-10-19 2023-10-19 Multiplexing duration prediction system for wireless transmission

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311359018.6A CN117097962B (en) 2023-10-19 2023-10-19 Multiplexing duration prediction system for wireless transmission

Publications (2)

Publication Number Publication Date
CN117097962A true CN117097962A (en) 2023-11-21
CN117097962B CN117097962B (en) 2024-01-26

Family

ID=88772144

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311359018.6A Active CN117097962B (en) 2023-10-19 2023-10-19 Multiplexing duration prediction system for wireless transmission

Country Status (1)

Country Link
CN (1) CN117097962B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6058141A (en) * 1995-09-28 2000-05-02 Digital Bitcasting Corporation Varied frame rate video
CN1481646A (en) * 2000-10-25 2004-03-10 通用仪器公司 Transcoder-multiplexer (transmux) software architecture
CN1905681A (en) * 2006-08-01 2007-01-31 上海广电（集团）有限公司中央研究院 Method for statistics of multiplex transmission stream
CN116723183A (en) * 2023-05-30 2023-09-08 江苏允博信息科技有限公司 Video file equipment and processing method based on light weight

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6058141A (en) * 1995-09-28 2000-05-02 Digital Bitcasting Corporation Varied frame rate video
CN1481646A (en) * 2000-10-25 2004-03-10 通用仪器公司 Transcoder-multiplexer (transmux) software architecture
CN1905681A (en) * 2006-08-01 2007-01-31 上海广电（集团）有限公司中央研究院 Method for statistics of multiplex transmission stream
CN116723183A (en) * 2023-05-30 2023-09-08 江苏允博信息科技有限公司 Video file equipment and processing method based on light weight

Also Published As

Publication number Publication date
CN117097962B (en) 2024-01-26

Similar Documents

Publication Publication Date Title
JP5147950B2 (en) Apparatus and method for performing simulcast over variable bandwidth channel
CN102754398B (en) A method for data transmission in a communication network
EP1724759A1 (en) Method and system for efficient transmission of communication traffic
DE10120590A1 (en) Device and method for providing a multimedia service in a mobile terminal
US11974027B2 (en) System and method for real-time transmission of a panoramic video
CN109803169A (en) The method and system of multichannel multicast are realized based on network bandwidth
CN117097962B (en) Multiplexing duration prediction system for wireless transmission
CN1972517A (en) An emergency broadcast processing method and system
RU2407170C2 (en) Method for interface adaptation of television internet protocol with stream data storage device
FI3468073T3 (en) Method and apparatus for transmitting and receiving broadcast service data in a broadcasting communication system, method for configuring the broadcast service data, and frame including the broadcast service data
CN105227894A (en) A kind of implementation method of video conference and multipoint control unit
CN101273631B (en) Multi-party video communication media flow control system and method
CN107645671A (en) Program switching method and device
CN111755008B (en) Information processing method, information processing apparatus, electronic device, and medium
KR100576543B1 (en) Apparatus and Method for Converting Media Stream for Multimedia Service in DAB system
CN101902475A (en) A kind of transfer control method of variable-speed streaming media in next-generation network and device
US20090061875A1 (en) Mbms soft combining
CN101409832B (en) Transmission method and apparatus for video data
KR100546780B1 (en) Voice over packet system using a plurality of digital signal processors and speech processing method therein
CN115499685B (en) Adaptive multiplexing coding system and method
CN117651288B (en) Signal transmission method, device and equipment of intelligent outdoor television and storage medium
CN111314779B (en) Method and device for determining streaming media transmission quality
CN117560531B (en) Bandwidth detection method and device, electronic equipment and storage medium
CN1700621A (en) An interconnected monitor system and method for implementing monitoring interconnection
JP5311677B2 (en) Knitting management device, multiplex transmission device, knitting multiplex system, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant