CN101166274A - Built-in software application architecture and application orienting to multimedia instrument and device - Google Patents
Built-in software application architecture and application orienting to multimedia instrument and device Download PDFInfo
- Publication number
- CN101166274A CN101166274A CN 200710069955 CN200710069955A CN101166274A CN 101166274 A CN101166274 A CN 101166274A CN 200710069955 CN200710069955 CN 200710069955 CN 200710069955 A CN200710069955 A CN 200710069955A CN 101166274 A CN101166274 A CN 101166274A
- Authority
- CN
- China
- Prior art keywords
- multimedia
- embedded
- equipment
- software application
- protocol
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The disclosed method discloses embedded type software application architecture (ETSAA) oriented to instrument equipment in multimedia category. The method is established based on a set of embedded type software application component library oriented to digitalized instrument equipment in multimedia category, especially a multimedia dedicated component library. The invention realizes service function flow of multimedia application system, and provides audio and video codec with powerful functions. In the method, a platform installation of embedded system of instrument equipment in multimedia category provides tools and environment support for fast developing. Since the said ETSAA oriented to instrument equipment in multimedia category is passed the functional validation, the invention shortens development cycle greatly, and reaches standardization, modularization, and reusability of system software.
Description
Technical field
The present invention relates to a kind of development approach and device of embedded system of digital multimedia quasi-instrument equipment, refer in particular to method and device that a kind of application software frame is developed the embedded system of multimedia class instrument and equipment fast.
Background technology
Multimedia technologies such as audio frequency and video technology, communication and image technique combine with digitized instrument, have given instrument and equipment new function service, and a large amount of multimedia class instrument and equipment (such as consumer electronics and video monitoring etc.) scales are explosive increase.At present, in the productive life field, the range of application of multimedia class instrument and equipment is wide, and application demand is upgraded day by day.The structure of existing digital multimedia quasi-instrument equipment comprises Main Processor Unit 100, audio frequency input/output module 110, video input/output module 120 generally as shown in Figure 1, UI interactive module 140 and other interactive interfaces 130.Main Processor Unit 100 is a core with flush bonding processor or dsp processor 101, has memory 102 and carries out application storage and storage.Audio frequency input/output module 110, be connected to Main Processor Unit 100, and carry out audio data collecting by microphone 111 etc., and the data that collect are encoded by audio codec 113, and coding audio data can be by audio codec 113 loud speaker 112 outputs of decoding.Video input/output module 120, be connected to Main Processor Unit 100, and carry out video data acquiring by camera 121 etc., the data that collect are encoded by Video Codec 123, and the coding video frequency data that receives can show output by decode LCD122 etc. of Video Codec 123.Other interactive interfaces 130 comprise that debugging interface 131, usb 1 32 or LED show 133 or the like, realize other people machine operation of user.UI interactive module 140, the user operates equipment by gui interface and keyboard etc.
The multimedia class instrument and equipment generally adopts flush bonding processor or dsp processor, realize the high performance requirements of system, and the function of system is complicated, thus very complicated and diversified towards the system development in this field, for the quick exploitation of system has brought obstruction.
Framework is an effective software reuse technology, becomes the research focus of soft project in recent years, is the effective way that realizes Standardize Software Development, reusability and extensibility, and the example of more application success has also been arranged in the embedded system field.Framework has reflected the software architecture of a specific area, for software development provides design and code reuse.Research and develop a software frame, system development is had directive significance and construction value towards the embedded system of multimedia class instrument and equipment.Application software frame carry out multimedia class instrument and equipment embedded system fast exploitation be effectively to improve development efficiency, guarantee system reliability and be convenient to a developing direction of system maintenance.
Summary of the invention
The invention provides a kind of embedded type software application frame towards the multimedia class instrument and equipment.
A kind of embedded type software application frame towards the multimedia class instrument and equipment comprises:
The UI system module is used to finish system resource and device initialize, comprises encoding and decoding Codec storehouse, shows and play up Render equipment, protocol stack, carries out user interface interaction, definition timed events and network multimedia protocol transmission incident;
Play and event processing module, be used to resolve the audio/video coding type, create the audio/video decoding thread; Comprise the video decode module of the output video data that are used to decode, the outputting audio data that is used to decode the audio decoder module, be used to finish the audio frequency and video buffer management and look the event processing module of audio sync function, process user incident and network multimedia data arrival event;
Network sends data module, is used for the DSP coprocessor alternately, according to the timing parameters of UI system module definition, regularly obtains the audio/video coding data from the DSP coprocessor; The The data RTP packing that receives sends by network, or local storage.
Described UI system module is supported Streaming Media quasi-protocol, call quasi-protocol, Network Transmission quasi-protocol.
Multimedia class instrument embedded type software application frame of the present invention is through functional verification, and is reasonable in design; The developer can be in the development environment that development device provides, and builds application system as the combined resource that plays with building blocks easily, has saved the time significantly, and has improved software quality.
The present invention also provides a kind of device that above-mentioned embedded type software application frame is developed multimedia class instrument embedded system fast of using.
A kind ofly develop the device of multimedia class instrument embedded system fast, comprising based on said method:
(a) towards the system support of multimedia class instrument and equipment, the hardware platform of one cover based on multiple typical flush bonding processor is provided, towards the plate level support package BSP (Board SupportPackage) and the driver of hardware platform, and embedded OS SmartOSDI;
(b) graphical Integrated Development Environment IDE (Integrated Development Environment), integrated embedded software application component storehouse and embedded type software application frame towards the multimedia class instrument and equipment, realization is to the management and the use of embedded software application component storehouse and embedded type software application frame, for the exploitation of embedded system provides instrument and environment.
Described embedded software application component storehouse comprises:
Graphical user's component base is used to provide the interface support of one group of GUI application development;
The data management component base is used to provide the data management interface support based on " key-data ";
The audio-video signal and the image processing algorithm support that provide the multimedia class instrument and equipment to use are provided for signal and image processing algorithm component base;
The supports such as communication interface that provide the multimedia class instrument and equipment to use are provided digitized instrument special purpose interface component base;
Multimedia special-purpose member storehouse is used to provide network multimedia communications protocol, Streaming Media host-host protocol and the control of network multimedia transmission QoS to support.
Described multimedia special-purpose member storehouse is supported:
The network multimedia communications protocol comprises H.323 agreement and Session Initiation Protocol;
The Streaming Media host-host protocol comprises agreements such as HTTP, RTSP, SDP, RTP/RTCP, TS STREAM;
The control of network multimedia transmission QoS comprises self-adapted jitter buffer, audio-visual synchronization and video transmission strategy.
Development device of the present invention provides the instrument and the environment of application and development for multimedia class instrument and equipment embedded type software application frame.
The present invention further provides a kind of method of developing multimedia class instrument and equipment embedded system based on said apparatus fast.
A kind ofly develop the method for multimedia class instrument and equipment embedded system fast, may further comprise the steps based on said apparatus:
The inventive method has realized standardization, modularization, componentization and the reusability of multimedia class instrument and equipment embedded system development based on embedded type software application frame and embedded software application component storehouse.Realized well system modularization and; The software element that simultaneously component base and application framework comprised all is by functional verification, has guaranteed the reasonability and the reliability of system.Embedded type software application frame provides a cover framework source code simultaneously, need not change and just can generate executable multimedia class instrument and equipment embedded software program, substitutions and modifications are carried out in framework source code, can reach the system requirements that meet concrete multimedia application.
Description of drawings
Fig. 1 is the hardware system structure schematic block diagram of existing digital multimedia quasi-instrument equipment;
Fig. 2 is the structural representation block diagram of the present invention towards the software application frame of the equipment embedded system of digital multimedia quasi-instrument;
Fig. 3 is the structural representation block diagram of development device of the present invention;
Fig. 4 is the structural representation block diagram in multimedia special-purpose member storehouse;
Fig. 5 develops the flow chart of multimedia class instrument and equipment embedded system fast for the present invention.
Embodiment
As shown in Figure 2, a kind of embedded type software application frame towards the multimedia class instrument and equipment comprises:
Play and event processing module 210, be used to resolve the audio/video coding type, create the audio/video decoding thread, comprising:
Network sends data module 220, is used for the DSP coprocessor alternately, according to the timing parameters of UI system module definition, regularly obtains the audio/video coding data from the DSP coprocessor; The The data RTP packing that receives sends by network, or local storage.
As shown in Figure 3, the equipment embedded system development device of a kind of digital multimedia quasi-instrument comprises:
Support 400 towards multimedia class instrument and equipment embedded system, the hardware platform 401 based on multiple typical flush bonding processor towards the multimedia class instrument and equipment is provided, based on the plate level support package BSP and the driver 402 of multiple typical flush bonding processor, and towards the embedded OS SmartOSDI 403 of digitized instrument equipment.
Graphical Integrated Development Environment 410 provides instrument and resource with patterned form to the developer.Comprise editing machine, compiler and debugging acid etc., various cross compilation environment utilize component base and framework to carry out the fast instrument of exploitation of system, the instrument that component base and framework are carried out secondary development.
Graphical Integrated Development Environment 410 is integrated multimedia class instrument and equipment embedded software application component storehouse 411, comprise graphical user's component base 414, data management component base 415, signal and image processing algorithm component base 416, digitized instrument special purpose interface component base 417 and multimedia special-purpose member 418, realize developing for framework and call.
Graphical Integrated Development Environment 410 is integrated multimedia class instrument and equipment embedded type software application frame 412 provides multiplexing code, and operation be replaced and be deleted etc. to system developer can to source code, finally obtains system software code.
Simultaneously, graphical Integrated Development Environment 410 provides the expansion to multimedia class instrument and equipment embedded software application component storehouse to realize 414, and upgrading for demands of applications provides realization mechanism.
As shown in Figure 4, network multimedia communications protocol 300, Streaming Media host-host protocol 310 and network multimedia transmission QoS support 320 have been realized in multimedia special-purpose member storehouse.Network multimedia communications protocol 300 comprises H.323 agreement support and Session Initiation Protocol support.Streaming Media host-host protocol 310 comprises agreement supports such as HTTP, RTSP, SDP, RTP/RTCP, TS STREAM.Network multimedia transmission QoS support 320 comprises self-adapted jitter buffer, audio-visual synchronization and video transmission strategy etc.
As shown in Figure 5, the flow process of the quick developing digital multimedia class of application software frame instrument and equipment embedded system is as follows: at first carry out demand analysis 501 at concrete multimedia class instrument and equipment system; That carries out the hardware platform of application system and system kernel on the development platform device that Fig. 3 provides builds 502; In Integrated Development Environment IDE, multimedia class instrument and equipment embedded type software application frame is made the adaptability revision 503 of real needs; The framework adaptability revision carries out just can generating concrete application system code 504 after code replaces or delete, can finish system development 505 by being downloaded to Target Board after the steps such as cross compile.
Claims (6)
1. embedded type software application frame towards the multimedia class instrument and equipment is characterized in that comprising:
User interface UI system module (200) is used to finish system resource and device initialize, comprises encoding and decoding Codec storehouse, shows and play up Render equipment, protocol stack, carries out user interface interaction, definition timed events and network multimedia protocol transmission incident;
Play and event processing module (210), be used to resolve the audio/video coding type, create the audio/video decoding thread; Comprise the video decode module (211) of the output video data that are used to decode, the outputting audio data that is used to decode audio decoder module (212), be used to finish the audio frequency and video buffer management and look the event processing module (213) of audio sync function, process user incident and network multimedia data arrival event;
Network sends data module (220), is used for the DSP coprocessor alternately, according to the timing parameters of UI system module (200) definition, regularly obtains the audio/video coding data from the DSP coprocessor; The The data realtime transmission protocol RTP packing that receives sends by network, or local storage.
2. embedded type software application frame as claimed in claim 1 is characterized in that: described UI system module (200) is supported Streaming Media quasi-protocol, call quasi-protocol, Network Transmission quasi-protocol.
An application as claim 1-2 arbitrary as described in the embedded software framework develop the device of multimedia class instrument and equipment embedded system fast, comprising:
(a) towards the system support of multimedia class instrument and equipment, the hardware platform of a cover based on multiple typical flush bonding processor is provided, towards the plate level support package BSP and the driver of hardware platform, and embedded OS SmartOSDI;
(b) graphical Integrated Development Environment IDE, integrated embedded software application component storehouse and embedded type software application frame towards the multimedia class instrument and equipment, realization is to the management and the use of embedded software application component storehouse and embedded type software application frame, for the exploitation of embedded system provides instrument and environment.
4. device as claimed in claim 3 is characterized in that: described embedded software application component storehouse comprises:
Graphical user's component base is used to provide the interface support of a block graphics user interface GUI application development;
The data management component base is used to provide the data management interface support based on " key-data ";
The audio-video signal and the image processing algorithm support that provide the multimedia class instrument and equipment to use are provided for signal and image processing algorithm component base;
The supports such as communication interface that provide the multimedia class instrument and equipment to use are provided digitized instrument special purpose interface component base;
Multimedia special-purpose member storehouse is used to provide network multimedia communications protocol, Streaming Media host-host protocol and the control of network multimedia transmission QoS to support.
5. device as claimed in claim 4 is characterized in that: described multimedia special-purpose member storehouse is supported:
The network multimedia communications protocol comprises H.323 agreement and Session Initiation Protocol;
The Streaming Media host-host protocol comprises agreements such as HTTP, RTSP, SDP, RTP/RTCP, TS STREAM;
The control of network multimedia transmission QoS comprises self-adapted jitter buffer, audio-visual synchronization and video transmission strategy.
6. develop the method for the embedded embedded system of multimedia class instrument and equipment fast based on device as described in claim 3 for one kind, it is characterized in that may further comprise the steps:
Step 501 is carried out the application demand analysis at concrete multimedia class instrument and equipment;
Step 502 is built hardware platform and kernel system in development device;
Step 503 is carried out concrete adaptability revision to embedded type software application frame in graphical Integrated Development Environment;
Step 504 generates the embedded system code;
Step 505 is carried out cross compile to the embedded system code that generates, and is downloaded to Target Board and finishes Embedded System Design.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200710069955 CN101166274A (en) | 2007-07-12 | 2007-07-12 | Built-in software application architecture and application orienting to multimedia instrument and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200710069955 CN101166274A (en) | 2007-07-12 | 2007-07-12 | Built-in software application architecture and application orienting to multimedia instrument and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101166274A true CN101166274A (en) | 2008-04-23 |
Family
ID=39334709
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200710069955 Pending CN101166274A (en) | 2007-07-12 | 2007-07-12 | Built-in software application architecture and application orienting to multimedia instrument and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101166274A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102035817A (en) * | 2009-09-28 | 2011-04-27 | 鸿富锦精密工业（深圳）有限公司 | Digital content system |
| CN103217938A (en) * | 2013-01-09 | 2013-07-24 | 北京卓越信通电子股份有限公司 | Control system for achieving voice frequency remote access and playback |
| CN103777963A (en) * | 2014-02-24 | 2014-05-07 | 武汉大学 | Method for achieving software reuse |
| CN104396271A (en) * | 2012-06-19 | 2015-03-04 | 优米有限公司 | Platform independent system for context-related advertisement delivery and display |
| CN105765618A (en) * | 2013-10-09 | 2016-07-13 | 电子湾有限公司 | Reflow of data presentation using tracking data |
| CN107301868A (en) * | 2017-06-23 | 2017-10-27 | 杭州士兰微电子股份有限公司 | Audio decoding system and audio-frequency decoding method |
| CN113783926A (en) * | 2021-06-21 | 2021-12-10 | 中国舰船研究设计中心 | Ship digital information interaction system based on embedded software application framework |
-
2007
- 2007-07-12 CN CN 200710069955 patent/CN101166274A/en active Pending
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102035817A (en) * | 2009-09-28 | 2011-04-27 | 鸿富锦精密工业（深圳）有限公司 | Digital content system |
| CN104396271A (en) * | 2012-06-19 | 2015-03-04 | 优米有限公司 | Platform independent system for context-related advertisement delivery and display |
| CN103217938A (en) * | 2013-01-09 | 2013-07-24 | 北京卓越信通电子股份有限公司 | Control system for achieving voice frequency remote access and playback |
| CN105765618A (en) * | 2013-10-09 | 2016-07-13 | 电子湾有限公司 | Reflow of data presentation using tracking data |
| CN103777963A (en) * | 2014-02-24 | 2014-05-07 | 武汉大学 | Method for achieving software reuse |
| CN107301868A (en) * | 2017-06-23 | 2017-10-27 | 杭州士兰微电子股份有限公司 | Audio decoding system and audio-frequency decoding method |
| CN107301868B (en) * | 2017-06-23 | 2020-07-14 | 杭州士兰微电子股份有限公司 | Audio decoding system and audio decoding method |
| CN113783926A (en) * | 2021-06-21 | 2021-12-10 | 中国舰船研究设计中心 | Ship digital information interaction system based on embedded software application framework |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6290829B2 (en) | Haptic effect data synchronization in media transport streams | |
| CN101166274A (en) | Built-in software application architecture and application orienting to multimedia instrument and device | |
| CN101828382B (en) | Synchronization of haptic effect data in a media transport stream | |
| KR101384434B1 (en) | Systems and methods for enhanced haptic effects, and recording medium | |
| CN102457715A (en) | Video monitoring equipment, real-time format conversion apparatus and multimedia format conversion method | |
| CN102143382A (en) | Apparatus and method for providing in a terminal a pause function for a broadcast stream | |
| CN104754349A (en) | Method and device for hardware decoding of audio/video | |
| CN102123154B (en) | Session initiation protocol (SIP) terminal and session processing method | |
| CN109982148A (en) | A kind of live broadcasting method, device, computer equipment and storage medium | |
| CN101911634A (en) | A packet generator | |
| CN100550129C (en) | Music rendition apparatus and method and mobile communication terminal | |
| US8619873B2 (en) | Media processing method and media processing program | |
| CN101217030B (en) | A method and device for Kara OK service offering based on media server | |
| CN113296742A (en) | APP data processing method and device and mobile terminal | |
| CN103051946A (en) | General real time streaming protocol (RTSP) stream player based on Android system | |
| CN101968739A (en) | Method for implementing set top box architecture based on flash technology | |
| CN109669691A (en) | Platform universal control method and system based on built-in Linux audio player | |
| CN101122856A (en) | Embedded type software application frame facing network monitoring instrument and its uses | |
| Leopold et al. | A knowledge and component based multimedia adaptation framework | |
| Lucarz et al. | Reconfigurable video coding: Objectives and technologies | |
| CN115437611A (en) | Audio coding and decoding frame and development method based on audio coding and decoding frame | |
| Wang | Compare multimedia frameworks in mobile platforms | |
| Lohse et al. | Towards Automatic Setup of Distributed Multimedia Applications. | |
| KR20100103271A (en) | Streaming service apparatus | |
| Mela | Utilizing dsp for ip telephony applications in mobile terminals |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Open date: 20080423 |