CN106250214A - Media Analysis on resource-constrained devices and process framework - Google Patents

Media Analysis on resource-constrained devices and process framework Download PDF

Info

Publication number
CN106250214A
CN106250214A CN201610389494.6A CN201610389494A CN106250214A CN 106250214 A CN106250214 A CN 106250214A CN 201610389494 A CN201610389494 A CN 201610389494A CN 106250214 A CN106250214 A CN 106250214A
Authority
CN
China
Prior art keywords
assets
resource
media
processing system
processor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610389494.6A
Other languages
Chinese (zh)
Other versions
CN106250214B (en
Inventor
A·凯纳斯
张科
郑云飞
刘舒洁
翟杰夫
C·Y·昌
周小松
H-J·吴
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apple Inc
Original Assignee
Apple Computer Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Apple Computer Inc filed Critical Apple Computer Inc
Publication of CN106250214A publication Critical patent/CN106250214A/en
Application granted granted Critical
Publication of CN106250214B publication Critical patent/CN106250214B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/48Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806Task transfer initiation or dispatching
    • G06F9/4843Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
    • G06F9/4881Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues

Abstract

It relates to the Media Analysis on resource-constrained devices and process framework.The system of the process of a kind of media on resource-constrained devices, this system includes: storage represents the memorizer of the programmed instruction of media asset and the data of relevant descriptor and representative application and medium processing system;With processor response from limiting and to perform programmed instruction for being invoked in the case of programmed instruction represents medium processing system of the application of multiple services of assets execution, to determine layering scheduling assets execution being processed to operation based on the process budget being associated with assets;With unless interrupted, otherwise, on the basis of level one by one, iteration execution processes operation.

Description

Media Analysis on resource-constrained devices and process framework
Priority request
The application benefits from entitled " the Media Analysis and Processing submitted on June 5th, 2015 Framework on a Resource Restricted Device " US Pat Appl Ser s.n.62/171957 excellent First weighing, the entire disclosure of this U. S. application is incorporated herein by reference.
Technical field
It relates to the Media Analysis on resource-constrained devices and the system and method for process framework.
Background technology
Media Analysis and process provide for calculating by the media asset (asset) of terminal storage in being framed in equipment The suite of tools of descriptor.Typically, terminal has limited resource, this can cause descriptor computation due to resource constraint quilt Delay or stop.
Accordingly, it would be desirable to for adjusting according to the process budget identifier of indicating gage evaluation time, expection complexity and other factors The system and method for degree computational methods.
Accompanying drawing explanation
Fig. 1 illustrates the block diagram of the terminal according to an aspect of this disclosure.
Fig. 2 illustrate the Media Analysis according to an aspect of this disclosure and process between framework and client computer mutual.
Fig. 3 illustrates system according to an embodiment of the invention, and this system includes the multiple terminals being in communication with each other by network.
Detailed description of the invention
Embodiment of the disclosure the system and method for the process of the media provided on resource-constrained devices.In response to Come the calling of application of self-identifying media asset to be processed, identifier media asset is performed and relevant to calling The process budget of connection, can produce the layering scheduling processing operation.On the basis of batch one by one, can be based on the layering scheduling produced Perform the process operation of a batch.It addition, can determine that the available resources processing operation of next batch.Without enough Resource can be used for the process operation of next batch, then can interrupt layering scheduling.But, if there is can be used for next batch Process enough resources of operation, then following iteration can be performed based on layering scheduling.
Fig. 1 is the block diagram according to the terminal 100 that embodiment of the disclosure.Terminal 100 can comprise processor 110, memorizer System 120 and input/output 130.Processor 110 can Executive Agent's operating system 112 and one or more application 114 Programmed instruction.Programmed instruction can be stored by accumulator system 120 and be read into processor 110 for execution.Processor 110 can be such as CPU, microprocessor, programmable logic array (PLA), programmable logic array (PAL), logical With array logic (GAL), CPLD (CPLD), special IC (ASIC), field programmable gate array (FPGA) or perform programmed instruction and beneficially data transmission any other PLD (PLD).
Accumulator system 120 represents the hierarchical system of storage device, and this hierarchical system can comprise and resides on processor 110 Random access memory, short term storage device and long term archival memorizer.Can in the case of, accumulator system 120 can comprise electricity, magnetic and/or optical storage apparatus.Accumulator system 120 can comprise Database Systems (not shown).With originally beg for Opinion is relevant, and accumulator system 120 can comprise media asset 121~125, and these media assets can comprise digital picture, regard Frequency and/or graphic file (in the case of possibility is convenient, there is adjoint audio frequency).Except representing media asset 121~125 and phase Close blob descriptor data beyond, accumulator system 120 can store represent operating system 112, application 114 and media divide Analysis and the programmed instruction of process framework 116.Accumulator system 120 can be the removable of internal storage or such as memory chip The memorizer of dress type.Accumulator system 120 can store the information about terminal 100.
Input/output 130 can comprise receive from terminal operator order and to its output data input/ Outut device.Conventional input equipment include the camera arrangement 132 for capturing video and/or rest image, for photograph The microphone system 134 of camera output in combination or independently capturing ambient audio frequency.Other input equipment can include for Accept the button of user command, keyboard, mouse and/or touch screen.They also can comprise position for determining terminal 100 and/ Or the accelerometer of orientation and gyroscope etc..Conventional outut device (not shown) includes presenting the aobvious of video frequency output to operator Show equipment and for exporting the speaker of audio frequency to operator.
Operating system 112 can comprise the instruction limiting Media Analysis with processing framework 116.Media Analysis and process framework 116 can be the software unit performed by processor 110, and this software unit can provide for calculating by terminal in terminal 100 The suite of tools of the binary large object descriptor (being abbreviated as " blob descriptor ") of the media asset 121~125 of 100 storages. Big file that is that Blob could be for being stored in data base the binary data of storage and that transmitted as single entity. Such as, can use as the mass data that character string and stored digital and transmission efficiency are low and be similar to the big data class of blob Type.Blob can be used for storage and transmits the big file of such as image, video and audio frequency etc..Blob can also be multiple type The mixing of file.In one aspect, the data being stored in blob can semi-structured or destructuring.Such as, XML file Semi-structured data can be used, and, multimedia file can use unstructured data.Owing to blob can store bigger file The data of type, therefore they may need substantial amounts of storage and disposal ability.
Process resource available at terminal 100 is often based on the type of the terminal by applying embodiment discussed here and changes Become.Also the process of Blob can be distributed across multiple terminals and/or equipment.Which can be used to perform different editions according to resource To setting analysis.Such as, hardware auxiliary can be used when available.On the other hand, higher priority assets can be endowed more Resource and/or processed before lower priority assets, these lower priority assets be likely to be due to low priority and/ Or limited resource and be conditioned.Additionally, the type of terminal 100 that the type of input-output apparatus may be based on just using changes Become.For this discussion, unless it is pointed out that otherwise the difference between terminal be inessential.
Stored by terminal 100 as it has been described above, Media Analysis and process framework 116 can provide in terminal 100 for calculating The suite of tools of blob descriptor of media asset.Specifically, Media Analysis and process framework 116 can provide following clothes Business, i.e. calculates various blob classes (blobClass) (descriptor, metadata, processed output etc.) for one group of media asset And in data base, store blob.Service can be layered (tier) so that according to identified by the application (client) asked Reason budget is sequentially generated blob.The class being similar to blobClass also can represent can performed for the subset of assets or assets Group analysis.
For the playback function of such as suspending/resuming function, the use of blob is also likely to be useful.Even if blob does not also have Had or be put on the blacklist at least in part, the part of blob present be also likely to be available.
Fig. 2 illustrates Media Analysis and the reciprocal action 200 processed between framework 210 and client 220.Client 220 can Identify one group of assets (msg.230) to be processed, the process budget (msg.235) of each assets and assets are produced one Group blobClass (msg.240).Assets can be video, audio frequency or image etc., and, each in assets BlobClass can comprise the associated binary data of assets.The budget that processes of each assets can be dependent on the process in terminal 100 The characteristic of device 110 or other characteristic of terminal 100 and/or wireless network.
Media Analysis and process framework 210 can respond calling of self-application 114 and configure level based on process budget (tier) scheduling (frame 245).Media Analysis and process framework 210 can determine whether to can be used for according to scheduling at layer one by one Enough resources (frame 250) of each level are performed successively on the basis of Ji.If not, then process and may wait for until existing enough Resource to perform the scheduling of level, or may wait for until the change (frame 252) of required or available resource being detected. If the change of resource is required or is detected, then process the scheduling of adjustable level.When enough resources can be used Time, owing to resource can be used in the terminal, therefore process and can perform level (frame 255) successively according to scheduling.Resource Availability can base Change in equipment purposes.Such as, perform video blob can need enough resources because level scheduling need be adjusted with Perform other level.As an alternative, media asset can change and need different stock numbers, and this also can affect the tune of level Degree and the order of execution assets.
This process also may determine whether time-out (frame 257) occur.If it is then the scheduling of level can be adjusted.If It is not, then process and can continue.Blob result can return to client (msg.260) in callback.Such as, if processing budget For the blob corresponding with video data the lowest, then the scheduling of level can make and have the voice data pair of reduced size The blob answered is preferential, and performs audio frequency blob before video blob.
In one aspect, process budget 235 and can be expressed as blobPriority and expectedDelay, BlobPriority is the value of the priority describing the blob for client 220, and expectedDelay represents should be after which Produce the time delay of blob descriptor.Blob descriptor (msg.240) can be by Asset Type from by Media Analysis and process structure One group of blobClass that the list identification of blobClass that frame 210 is supported is to be calculated.Such as, blobClass can be based on similar Different in the various Asset Types of audio frequency, image and video etc..
Scheduling can collect the multiple levels to perform for assets.Level can types based on assets and different.Usually, Scheduling can be by can be dependent on the time delay of such as expectedDelay and the blob priority of such as blobPriority Complete priority (such as, CompletionPriority) and represent and calculate the complexity of blob descriptor, main process equipment Any dependency between the identification of resource limit, blob descriptor and the value of general computing that uses when calculating blob are by group Knit.In one aspect, video blob descriptor is more complicated than image blob descriptor, therefore, all types of descriptors time Between postpone can be different, and, the priority that completes of all types of descriptors can be different and depend on the type of descriptor.
On the other hand, when client 220 asks non-existent blob or blob the most not, if ExpectedDelay is short, then Media Analysis and process framework 210 can configure one group of level with to given blobPriority Most preferably mate expectedDelay, and dispatch level immediately.Otherwise, if Delay computing is admissible, then media Analyze and process framework 210 can (1) scheduling level with the operation when resources supplIes more preferably (more multiple resource can use, equipment energising etc.) And level can be run at that time.
On the other hand, can dynamically adjust task scheduling based on appointed condition (such as, device temperature and resource contention), and And, its state is reported to client 220.Such as, when the available resources in terminal 100 change, if more resource exists It is made available by terminal 100, then task scheduling can be reorganized, so that video blob has precedence over image or audio frequency blob. In the present case, if video blob reduces the available volume of resources in terminal 100, then scheduling be adjustable to make audio frequency and Image blob is preferential, until more resource is made available by.Other adjustment is imagined based on various resource factors.
On the other hand, each level can represent the blobClass fallen in the range of CompletionPriority value The set calculated.Usually, the calculating in level is shared and is such as obtained, decodes, scales and the assets of other type of pretreatment On the expense of work.
Each blobClass calculates can have the several methods calculating blob.These methods can be in result precision and calculating In complexity mutually different.Media Analysis can calculate across several levels by using different methods with processing framework 210 Blob, each level is perfect/improve blob result.When operating for blob, Media Analysis and process framework 210 may be not required to Call the method previously called, unless between time when the former method of blob exercisable time and current method are carried out Change.For some blob, the result of a kind of method can provide for the starting point of next method.
In one implementation, different Asset Types can have different blobPriority values, and, Media Analysis and Process framework 210 schedulable level with assets blobPriority of based on they the value different for these in the different time They are operated.Such as, digital photos can have the blobPriority value higher than video or audio recording, and, matchmaker Body is analyzed and processes framework 210 schedulable level, to operate them at the Part I dispatched specially. BlobPriority value can be dependent on different Asset Types has much and what resource to use.Such as, Media Analysis and place Reason framework 210 can later time or when resource contention is in low state schedule video and/or audio recording.
In one aspect, Media Analysis and process framework 210 schedulable level are to divide at the relatively low spatial of assets or time Resolution presents the blob of calculating video.When resource allows, the level dispatched after a while can present behaviour in higher resolution Make.Thus, level can be organized in Asset Type based on the characteristic of each independent blob in Asset Type.Such side Face, scheduling can be not merely based on Asset Type and be organized, and can be organized in Asset Type based on Resource Availability etc..
On the other hand, when there is multiple client in individual equipment (not shown), each client can be with above-mentioned Parameter registers (in the future) service request by Media Analysis and process framework 210.Client-based priority, these parameters and Resource Availability, one group of level of Media Analysis and the configurable sequence of process framework 210 is to run.
On the other hand, if after scheduling level, assets are modified (such as, editor), then Media Analysis and process Framework 210 can be revised and dispatch the new process to be performed with reply.
In one example, can occur mutual 200 on smart phone.In the present case, smart phone can have ratio Flat board or the few available resources of computer.Thus, smart phone can have the scheduling of different levels, and can be based on having more Few available resources are differently carried out mutual 200 on flat board or computer.
In another example, can occur mutual 200 on computers.In the present case, computer can have than intelligence The resource of multipoint teleconference, and therefore compared with smart phone, it may be possible to run and need the assets of more resource and/or more Assets.Thus, the scheduling of level and the operation of assets can be at smart phones or have different resource capabilities from same asset Different with the mode performed on another equipment of constraint.
The principle of the disclosure also apply be applicable to disperse system 300, and in this disperse system, framework separates with client 2020 Ground runs, and multiple terminal may access the one group of media item shared.
Fig. 3 illustrates the system 300 according to an aspect of this disclosure, and this system 300 includes being in communication with each other by network 340 Multiple terminals 310~330.Terminal 310~330 can access network 340 by the communication channel 350 limited here.Terminal 310 ~330 can access shared one group assets respectively.
In one aspect, Media Analysis and process framework 332 can be in the terminals with resident request client 312 wherein Run in 310 separate terminals 330.Media Analysis and process framework 332 can have enough available money in its terminal 330 During source, assets are operated.In this case, Media Analysis and process framework 332 can to blobPriority and ExpectedDelay uses the value limited in advance, but still one group of level of configuration sequence is to run so that blob can become in time Must can use.
On the other hand, Media Analysis and process framework can availability based on other common computing device in network, Their ability and network condition are across the several equipment (being shown as processing framework 314,332) that may have access to one group of shared assets Distribution.Level scheduling can distribute level and/or the operation of method among the different terminals 310,330 of support frame.Additionally, layer Level can be sent to another terminal 330 from a terminal 310 so that framework can be kept to grasp when terminal 310 disconnects with network 340 Make.
When request, assets to be processed may be not locally available.Based on network condition and budget, Media Analysis and Process framework 332 schedulable and by network 340 from server or from another terminal acquirement assets.As an alternative, can be to Another terminal distribution having comprised paid close attention to assets processes and dispatch deal thereon.Under system or resource pressure, analyze Can suspend, and intermediate object program is serialized.Analysis can proceed when system condition allows, or is sent to another eventually End is to complete.
For some assets, framework may collapse or can not produce result.In order to avoid in identical assets once Process again and failure, number of attempt during each assets of the countable process of framework.If the count value of given assets reaches Threshold value number of attempt, then in order to avoid again processing this assets, framework can flagged asset or list it in " blacklist ", Or reduction processes the attempt frequency of assets.Blacklist assets can be absolved after the regular hour measures so that it can be again Become suitable.
When processing across several equipment controles, each equipment state can by periodic surveillance, and, in the event of a failure, Failed task can be rerouted to other equipment by level scheduling.
In the disclosure, and, in the claims, it will be appreciated that mention terminal or wireless device is intended to contain such as The electronic equipment of mobile phone, controller, tablet PC, personal computer and PDA etc.." terminal " or " wireless device " to be contained The mobile technology of any compatibility that lid can be connected with cordless communication network calculates equipment.Wireless device also includes mobile phone, shifting (such as, the iPhone of Apple, other classes such as dynamic equipment, mobile base station, subscriber equipment, cell phone, smart phone or mobile phone The PDA of type or smart phone), wireless encryption Canis familiaris L., remote alerting device or wireless network other mobile computing supported set Standby.Term " wireless device " can exchange use, and referred to herein as " wireless phone ", " mobile phone ", " mobile device ", " set Standby ", cellular phone, " mobile device ", " movement station ", " subscriber equipment ", " cell phone ", " smart phone ", " supervision sets Standby " or " phone ".
Wireless device can be connected with " wireless network " or " network ", and to contain by using wireless device obtain or carry For mobile phone or any type of wireless network of messenger service, such as may utilize teachings of the present application and be in the wrong with transmission and place Global system for mobile communications (GSM) network of message data service, CDMA (CDMA) network, Long Term Evolution (LTE) network With 5G (the 5th generation) etc..
Mention the meaning such as " aspect ", " aspect ", " other side " or " one or more aspect " in the disclosure About this aspect describe specific feature, structure or characteristic be included in the disclosure at least one in terms of in.In these public affairs The each position opened occurs that such as phrase " in one aspect " is not necessarily all referring to on the one hand, is not mutually to arrange with other side Independent or the substituting aspect scolded.Additionally, describe can be showed by some aspects and not by other side show various Feature.Similarly, describe can as the requirement in terms of some various requirement of the requirement not as other side.
Additionally, according to the various aspects of the disclosure, method described here specialized hardware to be passed through realizes operation, these Hardware realize include but not limited to processor, microprocessor, PC, PDA, SIM, quasiconductor, special IC (ASIC), can Programmed logic array (PLA), cloud computing equipment and be built as realizing other hardware device of method described herein.
The many aspects of the disclosure can include wired or wireless electronic communication network logical that can be to use known protocol Letter channel, this wired or wireless electronic communication network is all the most such as, wire/wireless LAN (LAN), wire/wireless People's Local Area Network (PAN), wire/wireless home area network (HAN), wire/wireless Wide Area Network (WAN), campus network, metropolitan area Net, enterprise private, Virtual Private Network (VPN), internet, backbone network (BBN), Global Regional network (GAN), interconnection Net, Intranet, extranet, overlay network, near-field communication (NFC), cellular phone network, personal communication service (PCS), this is known Agreement is such as global system for mobile communications (GSM), CDMA (CDMA), GSM/EDGE and UMTS/HSPA network technology, length Phase evolution (LTE), 5G (the 5th generation mobile network or the 5th generation wireless system), (wideband code division is many for WiMAX, HSPA+, W-CDMA Location), CDMA2000 (also referred to as C2K or IMT Multi-Carrier (IMT-MC)), Wireless Fidelity (Wi-Fi) and/or bluetooth etc. And/or its two or more combination.NFC standard covers communication protocol and data interchange format, and based on including ISO/ Existing RF identification (RFID) standard of IEC 14443 and FeliCa.This standard includes ISO/IEC 18092 [3] and by NFC Those of Forum definition.
Many aspects in the disclosure can be at any type by communication channel 350 with wire/wireless communication ability Calculating equipment in be implemented, these calculate equipment the most for example, desk computers, personal computer, meter on knee/mobile Calculation machine, personal digital assistant (PDA), mobile phone, tablet PC and cloud computing equipment etc..
Many aspects in the disclosure can be by the most such as AppleTMiOSTMAny type of elder generation of operating system etc. Enter mobile data to process and be implemented on any type of intelligent movable phone of COS operation.
It shall yet further be noted that the software of the disclosure described herein realizes optionally being stored on tangibly storage medium, these Stereognosis storage medium is such as: the magnetizing mediums of such as dish or band;The magneto-optic of such as dish or optical medium;Or such as storage card or appearance Receive one or more read-only (non-volatile) memorizer, random access memory or other rewritable (volatibility) memorizer The solid state medium of other encapsulation.The digital file attachment of Email or the archives of other self-contained information or one group of archives are considered The distribution medium being equal to tangibly storage medium.Therefore, the disclosure is considered to include that the software wherein stored here realizes The tangibly storage medium here listed or distribution medium, including the equivalent medium generally acknowledged and successor media.
It addition, the various aspects of the disclosure can be implemented in non-general computer realizes.And, disclose permissible from it Being apparent from, the various aspects of the disclosure here illustrated improve the function of system.Additionally, the various aspect bags of the disclosure Include the computer hardware specifically being programmed to solve the targeted challenge of the disclosure.Therefore, the various aspects of the disclosure exist Its specific implementation improves system general function, to perform the process being illustrated by the disclosure and being defined by the claims.
The many aspects of the disclosure can be network.Such as, server can be answered with database combination operation network With.Network application can be in trust in browser controlled environment (such as, java applet etc.), by supporting the language of browser (JavaScript such as, combined with the markup language (such as, HTML (HTML) etc.) presenting browser) quilt Coding etc. so that run common web browser (such as, SafariTMDeng) any computer application can be made to hold OK.Due to web browser universality and use web browser as the convenience of client (that is, thin-client), based on The service of network can be more useful.Additionally, by supporting that crossover-platform is compatible inherently, can be in the feelings not disturbing and installing software Keep under condition and update network application.
The many aspects of the disclosure can include performing to be configured to receive request from client and correspondingly provide response The server of the example of application or software.Server can run on any computer include special-purpose computer.Computer can The treatment element being generally CPU (CPU) including at least one and some form of memorizer.Treatment element can be real Execute computing and logical operation, and, sequence and control unit can respond the information of storage and change the order operated.Server can wrap Include the peripheral apparatus that can allow from external source retrieval information, and, the result of operation is saved and retrieves.Server can be client Operation in end-server architecture.Server can represent some tasks of client executing.The communication letter that client can here limit It is connected with server by network on road.Server can use has the memorizer of error-detecting and correction, redundancy dish and redundancy Power supply etc..
Although describing system and method about the content being currently considered to be particular aspects, but the disclosure being not limited to disclosed Aspect.It is intended to cover the various amendments that are contained in spirit and scope by the claims and similar configuration, and its scope should be by Give the widest explanation, to contain all such modifications and similar structure.The disclosure include any of following claims and All aspects.

Claims (20)

1. a system for the process of the media on resource-constrained devices, this system includes:
Memorizer, described memorizer storage represents media asset and the data of the descriptor being associated and representative are applied and media The programmed instruction of processing system;With
Processor, described processor response from limit will for assets perform multiple services application be invoked at described journey Sequence instructs and performs described programmed instruction in the case of representing described medium processing system:
Determine that will process the layering operated for assets execution dispatches based on the budget that processes being associated with assets;With
Unless interrupted, otherwise, on the basis of level one by one, it is iteratively performed described process to operate.
System the most according to claim 1, wherein, it is based on descriptor excellent that medium processing system further results in processor First level determines process budget.
System the most according to claim 2, wherein, it is true based on time delay that medium processing system further results in processor Surely processing budget, described descriptor should be generated after described time delay.
System the most according to claim 1, wherein, medium processing system further result in processor based on Asset Type from The list of the class of medium processing system support identifies one group of class of calculating.
System the most according to claim 1, wherein, it is based on descriptor excellent that medium processing system further results in processor First level and dispatching based on time delay organizational hierarchy.
System the most according to claim 5, wherein, medium processing system further results in processor and sets based on resource-constrained Standby condition adjusts layering scheduling.
System the most according to claim 1, wherein, medium processing system further results in processor across a network and provides to another Source constrained devices distribution layering scheduling.
System the most according to claim 1, wherein, medium processing system further results in processor and tastes processing assets Examination number of times count, and, if the attempt to number of times reach predetermined quantity, then assets are piped off.
9. a method for the process of the media on resource-constrained devices, the method includes:
Response carrys out the calling of the application of self-identifying media asset to be processed, will process for media asset executions and operate Identifier and with the described process budget called and be associated, generation process operation layering scheduling;
On the basis of batch one by one, complete procedure below iteratively:
The process operation of a batch is performed according to layering scheduling;
Determine the available resources processing operation of next batch;
If resource is not useable for the process operation of next batch, then interrupt schedule;And
Otherwise, following iteration is started.
Method the most according to claim 9, wherein, priority value generation based on media asset processes budget.
11. methods according to claim 10, wherein, are based further on time delay generation and process budget, when described Between postpone after should produce descriptor.
12. methods according to claim 11, also include the list of the class supported based on Asset Type descriptor identification In want calculated one group of class.
13. methods according to claim 9, also include collecting the multiple levels to perform for media asset.
14. methods according to claim 9, wherein, the scheduling producing level is based further on priority value.
15. methods according to claim 14, wherein, the scheduling producing level is based further on time-delay value.
16. methods according to claim 15, wherein, the scheduling producing level is based further on and calculates media asset Complexity that descriptor is associated and based on the resource limit being associated with resource-constrained devices.
17. methods according to claim 9, also include counting the number of times of the trial processing media asset, and If the attempt to number of times reach predetermined quantity, then media asset is piped off.
18. methods according to claim 17, absolve the media piped off after being additionally included in predetermined time quantum Assets.
19. methods according to claim 9, wherein, this executable portion ground hardware is carried out.
20. methods according to claim 9, also include that the process budget regulation of priority based on assets or assets should Perform.
CN201610389494.6A 2015-06-05 2016-06-03 Media Analysis and processing framework on resource-constrained devices Active CN106250214B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201562171957P 2015-06-05 2015-06-05
US62/171,957 2015-06-05

Publications (2)

Publication Number Publication Date
CN106250214A true CN106250214A (en) 2016-12-21
CN106250214B CN106250214B (en) 2019-11-26

Family

ID=57612909

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610389494.6A Active CN106250214B (en) 2015-06-05 2016-06-03 Media Analysis and processing framework on resource-constrained devices

Country Status (1)

Country Link
CN (1) CN106250214B (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0880095A2 (en) * 1997-05-22 1998-11-25 International Business Machines Corporation Resource scheduler
CN1589433A (en) * 2001-11-19 2005-03-02 皇家飞利浦电子股份有限公司 Method and system for allocating a budget surplus to a task
US20050249199A1 (en) * 1999-07-02 2005-11-10 Cisco Technology, Inc., A California Corporation Load balancing using distributed forwarding agents with application based feedback for different virtual machines
CN101471850A (en) * 2007-12-29 2009-07-01 华为技术有限公司 Method for identifying medium resource, medium gateway and medium gateway controller
US20090320027A1 (en) * 2008-06-18 2009-12-24 Microsoft Corporation Fence elision for work stealing
US20120066667A1 (en) * 2010-09-14 2012-03-15 Microsoft Corporation Simulation environment for distributed programs
US20120137299A1 (en) * 2010-11-30 2012-05-31 Moyer Jeffrey E Mechanism for yielding input/output scheduler to increase overall system throughput
US8327365B2 (en) * 2009-05-07 2012-12-04 Bank Of America Corporation Throttling of an interative process in a computer system
CN102841810A (en) * 2011-05-14 2012-12-26 国际商业机器公司 Techniques for executing threads in a computing environment
CN103348693A (en) * 2011-01-05 2013-10-09 联合视频制品公司 Systems and methods for navigating through content in an interactive media guidance application

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0880095A2 (en) * 1997-05-22 1998-11-25 International Business Machines Corporation Resource scheduler
US20050249199A1 (en) * 1999-07-02 2005-11-10 Cisco Technology, Inc., A California Corporation Load balancing using distributed forwarding agents with application based feedback for different virtual machines
CN1589433A (en) * 2001-11-19 2005-03-02 皇家飞利浦电子股份有限公司 Method and system for allocating a budget surplus to a task
CN101471850A (en) * 2007-12-29 2009-07-01 华为技术有限公司 Method for identifying medium resource, medium gateway and medium gateway controller
US20090320027A1 (en) * 2008-06-18 2009-12-24 Microsoft Corporation Fence elision for work stealing
US8327365B2 (en) * 2009-05-07 2012-12-04 Bank Of America Corporation Throttling of an interative process in a computer system
US20120066667A1 (en) * 2010-09-14 2012-03-15 Microsoft Corporation Simulation environment for distributed programs
US20120137299A1 (en) * 2010-11-30 2012-05-31 Moyer Jeffrey E Mechanism for yielding input/output scheduler to increase overall system throughput
CN103348693A (en) * 2011-01-05 2013-10-09 联合视频制品公司 Systems and methods for navigating through content in an interactive media guidance application
CN102841810A (en) * 2011-05-14 2012-12-26 国际商业机器公司 Techniques for executing threads in a computing environment

Also Published As

Publication number Publication date
CN106250214B (en) 2019-11-26

Similar Documents

Publication Publication Date Title
US11126974B2 (en) Blockchain service data processing
KR101541263B1 (en) Method and apparatus for executing user action commands
CN104488291B (en) The method and apparatus utilized for promoting cloud service
CN107864065B (en) Non-buried point data acquisition method, system and computer readable storage medium
CN103873692B (en) Method, device and system for resource sharing
JP2018527683A (en) Method and apparatus for loading terminal application
WO2017167121A1 (en) Method and device for determining and applying association relationship between application programs
CN109766253A (en) A kind of performance data sending method, device, computer equipment and storage medium
CN110781180B (en) Data screening method and data screening device
US10007716B2 (en) System for decomposing clustering events from managed infrastructures coupled to a data extraction device
CN113849179A (en) Artificial intelligence model publishing method and device
CN107517188A (en) A kind of data processing method and device based on Android system
US7784024B2 (en) Program creating system, program creating program, and program creating module
US7784023B2 (en) Program creating system, program creating program, and program creating module
CN106302125B (en) The method, apparatus and system that a kind of pair of solicited message is responded
CN112115394A (en) Data display method, server, terminal and medium
CN116112457A (en) Method, device, computer equipment and storage medium for notifying message
CN106250214B (en) Media Analysis and processing framework on resource-constrained devices
CN112953993B (en) Resource scheduling method, equipment, network system and storage medium
US10503742B2 (en) Electronic device and method of searching data records
CN114896635A (en) Data processing method and device, electronic equipment and storage medium
CN113626002A (en) Service execution method and device
US10402226B2 (en) Media analysis and processing framework on a resource restricted device
CN116561735B (en) Mutual trust authentication method and system based on multiple authentication sources and electronic equipment
CN107977380A (en) Method and apparatus for generating the page

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant