CN112835644A - Configurable multimedia application multiplexing method and storage equipment - Google Patents

Configurable multimedia application multiplexing method and storage equipment Download PDF

Info

Publication number
CN112835644A
CN112835644A CN202110162136.2A CN202110162136A CN112835644A CN 112835644 A CN112835644 A CN 112835644A CN 202110162136 A CN202110162136 A CN 202110162136A CN 112835644 A CN112835644 A CN 112835644A
Authority
CN
China
Prior art keywords
different
pipeline
input
modules
passages
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110162136.2A
Other languages
Chinese (zh)
Inventor
池琳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Rockchip Electronics Co Ltd
Original Assignee
Rockchip Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Rockchip Electronics Co Ltd filed Critical Rockchip Electronics Co Ltd
Priority to CN202110162136.2A priority Critical patent/CN112835644A/en
Publication of CN112835644A publication Critical patent/CN112835644A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/445Program loading or initiating
    • G06F9/44505Configuring for program initiating, e.g. using registry, configuration files
    • G06F9/4451User profiles; Roaming

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Stored Programmes (AREA)

Abstract

The invention relates to the field of computers, in particular to a configurable multimedia application multiplexing method and a storage device. The configurable multimedia application multiplexing method comprises the following steps: subdividing the individual modules into different types, including: an input end, an output end and an input and output end; different pipeline passages are constructed according to different target product requirements, and the different pipeline passages are combined, wherein one pipeline passage at least comprises: an input and an output. Aiming at different target product requirements, a set of new application is not required to be compiled for adaptation, code reconstruction is omitted, the complex and redundant processes of corresponding modules are familiar, the modules are used along with the adaptation, a kernel is not required to be modified, and any chip can be realized.

Description

Configurable multimedia application multiplexing method and storage equipment
Technical Field
The invention relates to the field of computers, in particular to a configurable multimedia application multiplexing method and a storage device.
Background
At present, the mainstream embedded consumer products are more and more based on a Linux operating system, and the product scheme generally needs to have any combination of the following modules: the system comprises modules of audio and video acquisition, coding and decoding, image processing, algorithm identification, audio and video playing, network transmission and the like, and is supported by other software plug-ins. The different product schemes are different in matching, and a set of new application is often rewritten to adapt to the new product. The operation is complicated and costly.
Disclosure of Invention
Therefore, a configurable multimedia application multiplexing method needs to be provided to solve the problems that in the prior art, when an embedded consumer product based on a Linux operating system has a new product, a new set of application needs to be rewritten to adapt, the operation is complex, and the cost is high. The specific technical scheme is as follows:
a configurable multiplexing method for multimedia applications, comprising the steps of:
subdividing the individual modules into different types, including: an input end, an output end and an input and output end;
different pipeline passages are constructed according to different target product requirements, and the different pipeline passages are combined, wherein one pipeline passage at least comprises: an input and an output.
Further, the "constructing different pipeline passages according to different target product requirements" specifically includes the steps of:
recording, by the profile, different properties of the respective modules, the different properties including one or more of: attributes, parameters, arrangement structure;
and arranging and combining the modules through the configuration files to construct different pipeline passages.
Further, each pipe path directly supports a synchronous/asynchronous message notification mechanism.
In order to solve the technical problem, the storage device is further provided, and the specific technical scheme is as follows:
a storage device having stored therein a set of instructions for performing:
subdividing the individual modules into different types, including: an input end, an output end and an input and output end;
different pipeline passages are constructed according to different target product requirements, and the different pipeline passages are combined, wherein one pipeline passage at least comprises: one input and one output, each pipe path directly supporting a synchronous/asynchronous message notification mechanism.
Further, the set of instructions is further for performing: the method for constructing different pipeline passages according to different target product requirements specifically comprises the following steps:
recording, by the profile, different properties of the respective modules, the different properties including one or more of: attributes, parameters, arrangement structure;
and arranging and combining the modules through the configuration files to construct different pipeline passages.
Further, each pipe path directly supports a synchronous/asynchronous message notification mechanism.
The invention has the beneficial effects that: subdividing the individual modules into different types, including: an input end, an output end and an input and output end; different pipeline passages are constructed according to different target product requirements, and the different pipeline passages are combined, wherein one pipeline passage at least comprises: an input and an output. Aiming at different target product requirements, a set of new application is not required to be compiled for adaptation, code reconstruction is omitted, the complex and redundant processes of corresponding modules are familiar, the modules are used along with the adaptation, a kernel is not required to be modified, and any chip can be realized.
Drawings
FIG. 1 is a flow chart illustrating a configurable multimedia application multiplexing method according to an embodiment;
FIG. 2 is a schematic diagram of an embodiment of a configurable multiplexing method for multimedia applications according to an embodiment;
fig. 3 is a schematic block diagram of a storage device according to an embodiment.
Description of reference numerals:
300. a storage device.
Detailed Description
To explain technical contents, structural features, and objects and effects of the technical solutions in detail, the following detailed description is given with reference to the accompanying drawings in conjunction with the embodiments.
Referring to fig. 1 to fig. 2, in the present embodiment, a configurable multimedia application multiplexing method may be applied to a storage device, where a Linux system is installed on the storage device, and the storage device includes but is not limited to: personal computers, servers, general purpose computers, special purpose computers, network devices, embedded devices, programmable devices, intelligent mobile terminals, etc.
The core technical idea of the application is as follows: each module is subdivided into three types of source, io and sink, wherein source is used as an input end, io is used as an input end and an output end, and sink is used as an output end. A complete pipeline requires at least one source and one sink combination, and simultaneously supports multiple sources, multiple ios and multiple sinks, and multiple pipeline combinations, and each pipeline directly supports a synchronous/asynchronous message notification mechanism. The attributes, parameters and arrangement structures of the modules are recorded through the json configuration file, so that the complete pipeline path combination can be easily arranged, recombined and configured.
The specific implementation mode is as follows:
step S101: subdividing the individual modules into different types, including: input end, output end and input/output end.
Step S102: different pipeline passages are constructed according to different target product requirements, and the different pipeline passages are combined, wherein one pipeline passage at least comprises: an input and an output.
The method for constructing different pipeline passages according to different target product requirements specifically comprises the following steps:
recording, by the profile, different properties of the respective modules, the different properties including one or more of: attributes, parameters, arrangement structure;
and arranging and combining the modules through the configuration files to construct different pipeline passages.
Where each pipe path directly supports a synchronous/asynchronous message notification mechanism.
Subdividing the individual modules into different types, including: an input end, an output end and an input and output end; different pipeline passages are constructed according to different target product requirements, and the different pipeline passages are combined, wherein one pipeline passage at least comprises: an input and an output. Aiming at different target product requirements, a set of new application is not required to be compiled for adaptation, code reconstruction is omitted, the complex and redundant processes of corresponding modules are familiar, the modules are used along with the adaptation, a kernel is not required to be modified, and any chip can be realized.
This is further detailed below in conjunction with fig. 2:
in fig. 2, 1 channel of audio input and 4 channels of video input are taken as an example, and it is possible to implement simultaneous operation of five different pipelines of functional components by configuration, where each pipeline audio/video/audio is taken as an input end, where video is different video devices, and audio may be multiplexed with one audio device.
The pipeline 0(SOURCE _ VIDEO0+ SOURCE _ AUDIO) has the functions of AUDIO and VIDEO acquisition coding, photographing, human face picture frame, mp4 file recording and rtsp stream pushing.
Pipeline 1(SOURCE _ VIDEO1) is equipped with VIDEO capture, image processing, face algorithms, event notification.
The pipeline 2(SOURCE _ VIDEO2+ SOURCE _ AUDIO) has functions of AUDIO and VIDEO acquisition coding and rtsp plug flow.
The pipe 3(SOURCE _ VIDEO3) has VIDEO capture and local display functions.
The pipe 4(SOURCE _ AUDIO) has AUDIO collection and local play functions.
In other embodiments, different pipeline paths can be constructed by rearranging and combining each module according to actual target product requirements, and free arrangement and combination of all modules can be realized on a user layer, so that the method has good compatibility and expansibility, and the arrangement and combination of all modules can be configured without modifying codes and kernel configuration.
Referring to fig. 2 to fig. 3, in the present embodiment, an embodiment of a memory device 300 is as follows:
a storage device 300 having stored therein a set of instructions for performing:
subdividing the individual modules into different types, including: an input end, an output end and an input and output end;
different pipeline passages are constructed according to different target product requirements, and the different pipeline passages are combined, wherein one pipeline passage at least comprises: one input and one output, each pipe path directly supporting a synchronous/asynchronous message notification mechanism.
Further, the set of instructions is further for performing: the method for constructing different pipeline passages according to different target product requirements specifically comprises the following steps:
recording, by the profile, different properties of the respective modules, the different properties including one or more of: attributes, parameters, arrangement structure;
and arranging and combining the modules through the configuration files to construct different pipeline passages.
Further, each pipe path directly supports a synchronous/asynchronous message notification mechanism.
Subdividing the individual modules into different types, including: an input end, an output end and an input and output end; different pipeline passages are constructed according to different target product requirements, and the different pipeline passages are combined, wherein one pipeline passage at least comprises: an input and an output. Aiming at different target product requirements, a set of new application is not required to be compiled for adaptation, code reconstruction is omitted, the complex and redundant processes of corresponding modules are familiar, the modules are used along with the adaptation, a kernel is not required to be modified, and any chip can be realized.
This is further detailed below in conjunction with fig. 2:
in fig. 2, 1 channel of audio input and 4 channels of video input are taken as an example, and it is possible to implement simultaneous operation of five different pipelines of functional components by configuration, where each pipeline audio/video/audio is taken as an input end, where video is different video devices, and audio may be multiplexed with one audio device.
The pipeline 0(SOURCE _ VIDEO0+ SOURCE _ AUDIO) has the functions of AUDIO and VIDEO acquisition coding, photographing, human face picture frame, mp4 file recording and rtsp stream pushing.
Pipeline 1(SOURCE _ VIDEO1) is equipped with VIDEO capture, image processing, face algorithms, event notification.
The pipeline 2(SOURCE _ VIDEO2+ SOURCE _ AUDIO) has functions of AUDIO and VIDEO acquisition coding and rtsp plug flow.
The pipe 3(SOURCE _ VIDEO3) has VIDEO capture and local display functions.
The pipe 4(SOURCE _ AUDIO) has AUDIO collection and local play functions.
In other embodiments, different pipeline paths can be constructed by rearranging and combining each module according to actual target product requirements, and free arrangement and combination of all modules can be realized on a user layer, so that the method has good compatibility and expansibility, and the arrangement and combination of all modules can be configured without modifying codes and kernel configuration.
It should be noted that, although the above embodiments have been described herein, the invention is not limited thereto. Therefore, based on the innovative concepts of the present invention, the technical solutions of the present invention can be directly or indirectly applied to other related technical fields by making changes and modifications to the embodiments described herein, or by using equivalent structures or equivalent processes performed in the content of the present specification and the attached drawings, which are included in the scope of the present invention.

Claims (6)

1. A configurable multiplexing method for multimedia applications, comprising the steps of:
subdividing the individual modules into different types, including: an input end, an output end and an input and output end;
different pipeline passages are constructed according to different target product requirements, and the different pipeline passages are combined, wherein one pipeline passage at least comprises: an input and an output.
2. The configurable multiplexing method for multimedia applications according to claim 1, wherein said "constructing different pipeline paths according to different target product requirements" further comprises the following steps:
recording, by the profile, different properties of the respective modules, the different properties including one or more of: attributes, parameters, arrangement structure;
and arranging and combining the modules through the configuration files to construct different pipeline passages.
3. A configurable multiplexing method for multimedia applications according to claim 1, wherein each pipe path directly supports the synchronous/asynchronous messaging mechanism.
4. A storage device having a set of instructions stored therein, the set of instructions being operable to perform:
subdividing the individual modules into different types, including: an input end, an output end and an input and output end;
different pipeline passages are constructed according to different target product requirements, and the different pipeline passages are combined, wherein one pipeline passage at least comprises: one input and one output, each pipe path directly supporting a synchronous/asynchronous message notification mechanism.
5. The storage device of claim 4, wherein the set of instructions is further configured to perform: the method for constructing different pipeline passages according to different target product requirements specifically comprises the following steps:
recording, by the profile, different properties of the respective modules, the different properties including one or more of: attributes, parameters, arrangement structure;
and arranging and combining the modules through the configuration files to construct different pipeline passages.
6. A storage device according to claim 4, wherein each pipe path directly supports the synchronous/asynchronous message notification mechanism.
CN202110162136.2A 2021-02-05 2021-02-05 Configurable multimedia application multiplexing method and storage equipment Pending CN112835644A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110162136.2A CN112835644A (en) 2021-02-05 2021-02-05 Configurable multimedia application multiplexing method and storage equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110162136.2A CN112835644A (en) 2021-02-05 2021-02-05 Configurable multimedia application multiplexing method and storage equipment

Publications (1)

Publication Number Publication Date
CN112835644A true CN112835644A (en) 2021-05-25

Family

ID=75932494

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110162136.2A Pending CN112835644A (en) 2021-02-05 2021-02-05 Configurable multimedia application multiplexing method and storage equipment

Country Status (1)

Country Link
CN (1) CN112835644A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004008738A1 (en) * 2002-07-12 2004-01-22 Thomson Licensing Sa Method and device for processing multimedia data
CN102780636A (en) * 2012-08-13 2012-11-14 烽火通信科技股份有限公司 Cross connection universal description method based on nested pipeline
CN103237012A (en) * 2013-03-29 2013-08-07 苏州皓泰视频技术有限公司 Method for processing multimedia data on basis of free components

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004008738A1 (en) * 2002-07-12 2004-01-22 Thomson Licensing Sa Method and device for processing multimedia data
CN102780636A (en) * 2012-08-13 2012-11-14 烽火通信科技股份有限公司 Cross connection universal description method based on nested pipeline
CN103237012A (en) * 2013-03-29 2013-08-07 苏州皓泰视频技术有限公司 Method for processing multimedia data on basis of free components

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
列国周游: ""Apache Beam简介"", 《HTTPS://BLOG.CSDN.NET/FFJL1985/ARTICLE/DETAILS/78046971》 *

Similar Documents

Publication Publication Date Title
JP6502380B2 (en) Broadcast and Broadband Hybrid Services Using MMT and DASH
CN106063278B (en) Code conversion is carried out to Media Stream using subgroup block
Lim et al. MMT: An emerging MPEG standard for multimedia delivery over the internet
US20130121692A1 (en) Signal router
CN103338385A (en) Video processing system and corresponding method
CN102301730A (en) Method, device and system for transmitting and processing multichannel AV
CN102724551A (en) Video encoding system and video encoding method
CN106488259B (en) A kind of joining method and system of HLS Streaming Media fragment
CN104754349A (en) Method and device for hardware decoding of audio/video
US11218784B1 (en) Method and system for inserting markers in a media presentation
CN111327921A (en) Video data processing method and device
CN113301295A (en) Multi-picture video data processing method, device, computer equipment and storage medium
CN112423140A (en) Video playing method and device, electronic equipment and storage medium
CN109889919A (en) A kind of video transcoding method, device, system and medium
US10200732B1 (en) Output-aligned avail blanking for video streams
CN101237583B (en) A decoding and coding method and device for multiple screen
Reznik et al. Transitioning broadcast to cloud
US20080248782A1 (en) Providing Devices With Command Functionality in Content Streams
CN109963185B (en) Video data sending method, video display method, device, system and equipment
CN112835644A (en) Configurable multimedia application multiplexing method and storage equipment
CN116541320B (en) Intelligent IO module bus communication method, IO module, terminal and medium
CN108810560A (en) A kind of rail traffic information live broadcast system and method
CN100448292C (en) Method and equipment for managing interactions in the MPEG-4 standard
JP4249569B2 (en) Demultiplexer application program interface
CN103702172A (en) Method and system for carrying out dolby transcoding on AV (Audio/Video)

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210525