CN106062663A - Methods and systems for generating dynamic user interface - Google Patents

Methods and systems for generating dynamic user interface Download PDF

Info

Publication number
CN106062663A
CN106062663A CN201480040011.0A CN201480040011A CN106062663A CN 106062663 A CN106062663 A CN 106062663A CN 201480040011 A CN201480040011 A CN 201480040011A CN 106062663 A CN106062663 A CN 106062663A
Authority
CN
China
Prior art keywords
application program
user interface
methods
client
program
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201480040011.0A
Other languages
Chinese (zh)
Inventor
许瑞城
林修平
吴齐人
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
FIISER Inc
Original Assignee
FIISER Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by FIISER Inc filed Critical FIISER Inc
Publication of CN106062663A publication Critical patent/CN106062663A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/951—Indexing; Web crawling techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
    • G06F16/972—Access to data in other repository systems, e.g. legacy data or dynamic Web page generation

Abstract

The present invention relates to methods and systems for generating dynamic user interfaces on electronic devices where the dynamic user interface displays output of one or more applications that are running in a remote server. In one preferred embodiment, the one or more applications are operated by robots. In another preferred embodiment, the one or more applications are coupled to client devices, including hardware devices of the client devices, as to allow robust user interaction with the one or more applications remotely from the electronic device.

Description

Produce method or the system at user interface
Other patent application cases of cross-correlation
The priority of the subject application following case of opinion:
U.S. Provisional Patent Application case the 61862967th, its filing date Christian era on August 7th, 2013, and its title For " retrieval and the method and system of application program browser in application program "；
U.S. Provisional Patent Application case the 61922860th, its filing date Christian era on January 1st, 2014, and its title For " for producing the method and system at the user interface relevant to application program retrieval "；
U.S. Provisional Patent Application case the 61951548th, its filing date Christian era on March 12nd, 2014, and its title For " for producing the method and system at the user interface relevant to application program retrieval "；And
U.S. Provisional Patent Application case the 61971029th, its filing date Christian era on March 27th, 2014, and its title For " for the method and system of application program Yu virtual machine communication among unit ".
The described each application case being claimed priority is to be incorporated in subject application with its entirety.
Technical field
The present invention relates to the multiple method with generation user interface on an electronic device or system, be specifically related to multiple carrying It is presented in interface for user dynamical output data and produces method or the system at user interface on an electronic device.
Background technology
Being generated for presenting the user interface of object at present, major part the most all belongs to static, and object can be for example, The search result of networking Search engine, networking Search engine can for example, Google (Google) or Yahoo (Yahoo) or application journey Running gear application program fair in sequence, application program can for example, Android application download system (Android ' s Play Store) or Fructus Mali pumilae application download system (Apple ' s App Store).For example, no matter object is one Webpage, software application, networking PC game (online PC (Personal Computer) game), One running gear application program etc., each object that networking search result and application program fair are typically on interface shows Static word and/or image.Owing to these a little words and/or image are predefined, so these are a little in time manufacturing by creator Word/and image are all static state.The information presented due to static message may be the most out-of-date, if object is the most more Newly, even if the message that then static message is supplied to user is useful but still limited.Additionally, in each object, static literary composition Word and image are almost without providing about vision and the message of impression.In order to obtain such as vision and the news in receptor proved recipe face Breath, user must be downloaded (download), performs (execute) and/or install (install) these a little objects.Citing comes Saying, if object is a webpage, then user will have to enter into (enter) this website；Or, if object is a running gear application Program, then user must be downloaded, installs and perform application program.
Therefore, in order to allow user can receive the most sound, up-to-date information, and regarding about object on interface Feel and the good experience of impression, even in order to user can be held in user downloading, install or perform object In the case of some devices, get final product on direct DIYU interface interactive with object, be then necessary that the user interface providing improvement is come Realize necessity of above-mentioned purpose, and be more than providing static, pre-set word and/or image on interface.
Summary of the invention
The present invention is carried out to solve the problems referred to above, it is therefore intended that provide one open on an electronic device Producing the method and system at user interface, wherein user interface can provide the dynamical output data of object and will be the most defeated Go out data to be presented on user interface to be supplied to user.
The invention provides a kind of system producing dynamic user interface, have the feature that, including: one or more Client；One or more servomechanism, it is networked to one or more client；One or more application program, it resides in one or many Individual servomechanism；And one or more robot program, it resides in one or more servomechanism.Wherein, one or more robot journey Sequence is used for one or more request of one or more client corresponding, performs one or more application program, and at one or more machine When device people's program performs one or more application program, one or more servomechanism is used for by live or close in the way of live, it is provided that One or more output data are to one or more client.
In the dynamic user interface system that the present invention provides, it is also possible to have a feature in that wherein, export data Including the word, snapshot or a series of snapshot that take out in the output data of one or more application program, or partly or entirely contract Time video signal and/or message data.
In the dynamic user interface system that the present invention provides, it is also possible to have a feature in that wherein, one or more Ask with line on search relevant.
In the dynamic user interface system that the present invention provides, it is also possible to have a feature in that wherein, be sent to The output data of one or more application program of this client, are derived from the application program relevant to one or more request.
In the dynamic user interface system that the present invention provides, it is also possible to having a feature in that wherein, relatedness is In using application program, data are determined.
In the dynamic user interface system that the present invention provides, it is also possible to have the feature that, also include one or many Individual application program servomechanism, is used for supporting the execution of one or more application program.
In the dynamic user interface system that the present invention provides, it is also possible to have the feature that and also include for storing The data base of data in application program, in application program, packet contains this one or more application program and corresponding application program The data exchanged between servomechanism.
In the dynamic user interface system that the present invention provides, it is also possible to have the feature that, also include: reside in The media output of client, and reside in the client application of client.Client application is used for presenting from watching Take the output data of one or more application program that device is transmitted by media output.
In the dynamic user interface system that the present invention provides, it is also possible to have a feature in that wherein, defeated by media The client application going out display is presented the output data of one or more application program, is used for making user can pass through client End application program and one or more application program interactive.
In the dynamic user interface system that the present invention provides, it is also possible to have a feature in that wherein, defeated by media The client application going out display is presented the output data of one or more application program, is coupled to one or more corresponding Application program, the behavior of coupling includes transmitting a coordinate and a pair event tag.
In the dynamic user interface system that the present invention provides, it is also possible to have a feature in that analog physical action Means, physical action by simulation come be required during one or more application program interactive, simulation is based on making The interaction of the output data that the client application of user and media output display is presented one or more application program is entered OK.
In the dynamic user interface system that the present invention provides, it is also possible to have a feature in that wherein, one or more Client also includes one or more hardware device, and one or more application program is coupled to one or more hardware device.
In the dynamic user interface system that the present invention provides, it is also possible to have the feature that, also include: for auxiliary Helping one or more virtual machine of one or more application program, one or more application program cannot be in one or more servomechanism with this Ground end mode is run.
In the dynamic user interface system that the present invention provides, it is also possible to have a feature in that wherein, one or more The event of application program is generated for promoting that user is interactive.
In the dynamic user interface system that the present invention provides, it is also possible to have a feature in that wherein, it is generated using In the event of one or more application program of user interaction, it initiates with in application program and from one or more client The position that one or more relatedness asked is the highest.
A part of is set forth in description at this by other advantages of the present invention, and will in the some of description It is clear that or the practice of the permeable present invention and learn.Advantages of the present invention particularly points out in attached through element and combination Add ground entitlement requests, it will realize and reach.It is to be understood that, the explanation of previous generally described book and next details Book is all only exemplary and explanatory, and does not constitute the restriction to scope of the invention as claimed.
Accompanying drawing explanation
Fig. 1 is output data of a preferred embodiment at dynamic user interface in embodiments of the invention；
Fig. 2 is the output data of second embodiment at dynamic user interface, wherein user in embodiments of the invention It is feasible with interface interaction；
Fig. 3 is a preferred embodiment of the system at dynamic user interface in embodiments of the invention；
Fig. 4 is a software of the preferred embodiment of the system at dynamic user interface in embodiments of the invention and relevant Hardware configuration；Fig. 5 a and Fig. 5 b is the flow process of the preferred embodiment of the method at dynamic user interface in embodiments of the invention； Fig. 5 c and Fig. 5 d is without robot program's requested execution application program when, dynamically uses in embodiments of the invention The flow process of the second preferred embodiment of the method at person interface；And
Fig. 6 is the dynamic user interface being related to use the application program of camera shooting photo in embodiments of the invention Present a preferred embodiment of the output data of output data.
Detailed description of the invention
For the technological means making the present invention realize, creation characteristic, reach purpose and be easy to understand with effect, real below Execute example to combine accompanying drawing user dynamic to present invention interface system and be specifically addressed.
The one exemplary dynamic user interface of the present invention, preferably comprises a method or system, and it is used for generation one Interface, the message that interface display is relevant to one or several application program, wherein with regard to an application program, dynamic user interface is preferable The output data of ground display application program, output packet is containing the word of application program, one or more image, one or multiple snapshots (snapshot) or partly or entirely (part or full time-lapsed) video signal and/or message data during contracting, and application Program as be performed without separately require user download, install or perform.
Fig. 1 is a preferred embodiment of the output data describing the present invention dynamic user interface, and at least a part of which is a part of Output data be that preferably by far-end servomechanism crossfire (stream) out wherein application program is on far-end servomechanism By robot program, (robot refers to that certain can perform the software journey of a certain task incessantly with mankind's speed that is beyond one's reach Sequence.Or webrobot, also known as networking Aranea (web spider) or networking reptile robot (web crawler)) performed. Through the transmission data of the application program that displaying is performed, the dynamic user interface of the present invention is provided with about application program Information, the vision comprising application program and experience information.It addition, in a preferred embodiment of the present invention, dynamic user circle Face is used to allow the user can be with application program interactive.In another preferred embodiment, these are implemented in answering of far-end servomechanism May be coupled to the hardware device (for example, an induction apparatus or an input equipment) being arranged in user equipment by program, make Obtain hardware numerical value and can be transferred into those application programs.
The dynamic user interface of the present invention can preferably process various application program, for example, if an application journey Sequence comprises an action application program (mobile app), except provide be relevant to mobile applications program static text narration and/ Or outside static image, the dynamic user interface of the present invention, as mobile applications program has been performed, preferably in existing Video signal and/or the output data of message when the dynamic word of application program, one or more snapshot or part or all of contracting.In other In example, if an application program comprises machine game (mobile game) on the other hand, except providing the static state being relevant to mobile phone games Outside word narration and/or static image, the dynamic user interface of the present invention, as the mobile phone games person of having been used is in wisdom As type running gear (smart device) is played, preferably present word produced by application program, one or more snapshot or Partly or entirely video signal and/or the output data of message during contracting, output data are when one or more robot program operates game Time, application program produced, and the user watching dynamic user interface can be watched mobile phone games accordingly, as mobile phone is swum Play is played typically by robot program.In other examples, if an application program comprises a website with several webpage, In addition to providing the static text narration about website and/or static image, the dynamic user interface of the present invention, such as net The station person of having been used clicks through as different webpages, preferably presents the word of webpage, one or more snapshot or part or complete The output data of video signal and/or message during portion's contracting.Such as those skilled in the art it will be appreciated that present invention can be suitably applied to any answering By program, the output packet of application program is containing word, dynamic image and/or message, such as video signal, animation or the shadow of several static state Picture, such as picture or webpage.
In other examples, because some application programs may possess a subprogram (subprogram) or an activity (activity) at least some of of those application programs is performed, to illustrate how application program is performed to user (executed)/operation (operated), so in the case, robot program there is no need for implementing the dynamic of the present invention State user interface (it is to say, this type of application program is after subprogram/activity is initiated (initiate), can real estate automatically Raw dynamical output data).In the present example, the system of the present invention have only to initiate/activate (activate) this type of application program, And by output data stream (stream) to part corresponding in dynamic user interface, without requiring one or more machine People's program operates application program.
Additionally, in a preferred embodiment, the dynamic user interface of the present invention not only provides the output of a little application program Data, and make user in need not be required download, install or perform application program when, also can be by dynamically User interface and a little application program interactives.
Fig. 2 is the preferred embodiment describing the present invention for user interaction.
As in figure 2 it is shown, the application program 900 shown on dynamic user interface for the present invention, interface is preferably Allow user input message language to dialog box (box) 912 and submit to (submit) message language to application program, and not Application program 900 need to be downloaded.In other examples, user can be through the dynamic user interface of the present invention, on interface Directly click on (click) homepage key (home button) 918 or map page key (map button) 920, map can be controlled Application program 800.Consequently, it is possible to the dynamic user interface of the present invention not show only the output data of application program, and There is provided user to can pass through dynamic user interface and with the chance of application program interactive (interact).
At other embodiments of the invention, dynamic user interface is used for allowing the user can be with the application journey of display on interface Sequence is interactive, and interface needs the action of health to control a little application program, such as, rotates, tilts or shake the equipment of user.At this In inventive embodiment, the action of those healths can be preferably according to application program shown in the interaction of user and interface Output data and be modeled.Specifically, a user can be dynamic by pulling (drag) to be shown in one or more direction The visual output data of one application program at state user interface, come and application program interactive, with the action of simulated body.Citing For, drive athletic game if application program is a racing car, and money racing car is driven athletic game and allowed user by reality One game device turned left or controls the direct of travel of vehicle in game toward right bank, then can borrow on dynamic user interface The output data of application program are pulled so that user can simulate the action of inclination by turning left or turning right.Similarly, if game is permitted Being permitted user and utilize action and the game interactive of a shake (shake), a user can pass through quickly at dynamic user circle Turn left continuously on face and turn right and pull search result to simulate shake action, and then reach the interaction with search result.
In other preferred embodiment, the dynamic user interface of the present invention is used to couple the hardware dress that device comprises Putting, the interface system of the present invention is shown on device, and the hardware numerical value that the interface of the present invention uses a little hardware device to produce is made The input information of the application program by being discussed.For example, the application program discussed can preferably connect from user device Receiving the true or coordinate (or geographical position) of simulation, wherein the interface of the present invention is the global positioning system through device (GPS-Global Positioning System) module (module) is shown on device, or even through by function IP2Location or other can be found geographical position by the Internet address (IP-Internet Protocol) of reaching an agreement on (geo-locations) location information that means are simulated is to be shown on device.In other examples, the application of the present invention Program can collect and receive the change on location of the interface of the present invention, maybe can collect and receive what the interface of the present invention was resided Device location on change and rotate accordingly, to help user can more easily control/operate application.As Fruit has several application program to need entity action control, user interface can concentrate on a specific application program, for example, User interface can hide user interface or the output number of other other application programs being shown in dynamic user interface While according to, highlight the output data of application program/user interface or application program.The dynamic user interface tool of the present invention Device it has been installed on such as search result in order to provide user to have for the ability carrying out intelligent communication with device Identical experience in local side (locally).
The dynamic user interface of the present invention is upper particularly useful at the interior literary composition (context) providing search result.At present, by The search knot that more popular Search engine (search engines) such as Google (Google) and Yahoo (Yahoo) etc. provides Really, can be limited by static data (data) and image institute.Except the static data provided by common search services and shadow Outside picture, the dynamic user interface of the present invention can provide the word in search result, one or more snapshot or part or all of The output data of video signal and/or message during contracting, and as robot program performs search result.Furthermore, because application journey While sequence is currently running, the present invention can access (access to) by (the such dynamic number of data produced by application program According to, it is referred to alternatively as again " data in application program " (in-app data)), in addition to static description based on search result, search Seeking can be separately based on data in (be based on) application program.By implementing (perform) based on the searching of data in application program Seek, can bring more rich and be available for the data (richer pool of data) searched so that compared to general method for searching Or for system, available more accurate search result.About the method and system of data in application program, refer to the U.S. special Profit application case numbering 13960779 (U.S.Patent App.No.13960779) obtains more details and describes.Additionally, In one embodiment of the invention, as depicted in figs. 1 and 2, the dynamic user interface of the present invention make user can with application journey Sequence is presented in the output data interactive on search result interface.By applying the present invention to search interior literary composition (search Context), compared to general method for searching or the search result of system, the present invention can provide when searching more multiple message Higher degree of accuracy, and vision and the search result of sensuously preferably suggestion are provided, download without user, install or perform Application program.
It addition, the lease purpose of purpose or application program is bought at the dynamic user interface of the present invention for application program There is potential value.Specifically, present invention can apply to mobile applications program market, such as Android application program retail sales (Android App stores), wherein the invention enables user before buying and/or downloading application program, can first experience Application program.Additionally, the present invention leases (rent out) application program for hope rather than sells the enterprise of application program Also being useful, wherein user can use by the dynamic user interface of the present invention and rent the application program of coming, and is not necessary to down Carry application program.It is familiar with this area and there is its general skill i.e. it is understood that present invention can apply to multiple different business Environment.
Fig. 3 depicts the system producing dynamic user interface in the preferred embodiment of the present invention.
As it is shown on figure 3, native system preferably comprises one or more servomechanism 10 (server), one or more client (client) 20 and/or one or more servomechanism application program (application server) 30.
Each servomechanism 10 preferably additionally comprises a monitor program 100 (supervisor), one or more robot journey Sequence 110 (robot), one or more application program 120 (application), one or more processor 130 (processor) and/ Or one or more network interface 140 (network interface).Monitor program 100 preferably comprises a software program (software program), its in the present invention as an effector.Each robot program 110 preferably comprises a software journey Sequence, it is used to perform one or more application program 120.Each application program 120 preferably comprises a software application, company Net computer game (online PC game), mobile applications program or web browser etc..Processor 130 is preferably used in Process the data of component parts (component) of (process) servomechanism 10, as monitor program 100, robot program 110, Application program 120, network interface 140, data base (database) 150 or one or more virtual machine 160 (virtual Machine) in therein one.Data base 150 preferably stores data when system sends request.
The system of the present invention also comprises one or more virtual machine 160.If arbitrary application program 120 can not be at servomechanism Operating in local side mode in the operating system of 10, one or more virtual machine 160 can help application program 120 at servomechanism 10 Upper execution.Should be noted, servomechanism 10 preferably comprises several virtual machine 160, so servomechanism 10 can be simulated various The operating system of property, such as Android, Microsoft's Window operating system (Windows), Fructus Mali pumilae action equipment operating system (iOS), UNIX (UNIX operating system) etc..
Application program servomechanism 30 preferably comprise communicate with corresponding application program 120 and/or assist perform application journey The servomechanism of sequence 120.For example, in a preferred embodiment of the present invention, an application program 120 may comprise a networking computer Game；In this example, corresponding application program servomechanism 30 preferably comprises a servomechanism to install networking game 120 And performing several tasks, those tasks can receive data including but not limited to for networking game 120, provide data and/or process Data.In other present invention preferably embodiment, application program 120 can comprise an action application program；In this example, Corresponding application program servomechanism 30 preferably comprises a servomechanism, and servomechanism is installed mobile applications program 120 and performs number Kind of task, those tasks can including but not limited to for corresponding mobile applications program 120 receive data, provide data and/or Process data.In other presently preferred embodiments of the present invention, application program 120 can comprise a web browser (web browser), It can show website；In this example, corresponding application program servomechanism 30 preferably comprises a website servomechanism, website servo Device carries website and performs several tasks, and those tasks can receive number including but not limited to for web browser application program 120 According to, provide data and/or process data.In other presently preferred embodiments of the present invention, application program 120 can be one independent (stand-alone) software application operates without any application program servomechanism 30 so that in this example, and system is not Need corresponding application program servomechanism 30.
One or more client 20 comprises one or more input module 210 (module), one or more network interface 220 (network interface), one or more processor 230 (processor), one or more media output 240 (media Output), one or more hardware device 250 (hardware device) and/or one or more client application 260 (client application).One or more input module 21 is used for receiving input data, such as the request of user.Input mould Block 210 can comprise an on-screen keyboard (onscreen keyboard) a, physical keyboard (physical keyboard), hand-written (handwriting) the possible combination of input module, a voice-input device (such as a mike) or each element above-mentioned.One or Multiple network interfaces 220 make servomechanism 10 be able to and client 20 communication.Media output 240 the most exportable words, video signal And/or message information, such as received the output data relevant with one or more application program 120 by servomechanism 10.
It addition, in a preferred embodiment of the present invention, user can be with application program interactive, and media output 240 also may be used Receive the input data from a user.For example, media output 240 can be at sensing equipment (pointing device) Detection position, such as a cursor (cursor) or touch sensitive screen, wherein in the case of using touch sensitive screen, user can use The such as physical contact mode of pointer (stylus) or finger tips exports Location to media.
Additionally, in this preferred embodiment, client 20 also comprises one or more hardware device 250, it comprises but does not limits It is formed on a camera, a mike, a global positioning system (GPS, Global Positioning System), an accelerometer (accelerometer) a, gyroscope (gyroscope), an OPTICAL SENSORS (light sensor), a thermometer (thermometer) a, magnetometer (magnetometer), a barometer (barometer), a proximity sensor (proximity sensor), a drimeter (hygrometer), a near-field communication (Near Field Communication, NFC) a, image sensor (image sensor) or loudspeaker (loudspeaker).In an example, hardware device 250 is relatively It is used in sensing (sense) environment numerical value (environmental values), such as image, sound, acceleration goodly (acceleration), atmospheric temperature (ambient temperature), specific rotation (rate of rotation), ambient light Level (ambient light level), earth's magnetic field (geomagnetic field), arround air pressure (ambient air Pressure), an object is relative to the nearness of the vision screen of hardware device, relative ambient humidity, coordinate (coordinates) (global positioning system/agps system (AGPS, Assisted Global Positioning System module) etc..The system of the present invention it is preferable that the information exchange of hardware device 250 and application program 120 is carried out, These information exchanged comprise environment numerical value.The flow process description below of this information exchange is in Fig. 5 b.In an example, client Holding application program 260 can preferably comprise or be used in and be coupled to a software application, software application can show this The output data at bright dynamic user interface, such as one web browser or a customized software application (application program) Comprise or be coupled to media output 240.
Fig. 4 illustrates preferable software and a relevant hardware structure of servomechanism 10 in a preferred embodiment of the present invention (hardware architecture) and client 20, in the preferred embodiment, user can be with dynamic user interface institute The application program interactive demonstrated.
As shown in Figure 4, the structure of servomechanism 10 preferably comprise virtual machine 160 (being asked if being employed program 120), One kernel (kernel) 410, one hardware abstraction layer (hardware abstraction layer, HAL) 420, one or more journey Sequence storehouse (libraries) 430, one application framework (application framework) 440, application program 450 and/or One virtual device driver (pseudo driver) 460.One framework of client 20 preferably comprises hardware device 250, equipment Driver 520, one memorizer (memory) 530, one hardware abstraction layer 540, one or more program library 550, one application program Framework 560 and/or an application program 260.
Hardware abstraction layer 420 and 540 preferably comprises multiple software (pieces of software), and it is application program 450 accesses (access) that hardware resource is provided.Although it should be noted that hardware abstraction layer is Android operation system software knot The criteria section (standard part) of structure, but hardware abstraction layer may be present in the most in the same manner or even Every other operating system, such as Fructus Mali pumilae action equipment operating system (iOS) and Microsoft's Window operating system (Windows).Therefore, In replacement (alternative) embodiment of the present invention, the client 20 run in non-Android operation system preferably comprises For processing the similar sofware structure of hardware controls and communication, such as Microsoft's Window driver model (Windows Driver Model).In another preferred embodiment, hardware abstraction layer is unwanted.Application program 450 preferably comprises monitor program 100, robot program 110 and/or application program 120.In a preferred embodiment, application program 260 comprises a website browsing Device.Program library (libraries) 430 and 550 and application framework 440 and 560 software platform, and application are preferably provided Program 450 and 260 can be run on software platform.As before, when application program 120 can be transported in local side mode at servomechanism 10 OK, then perhaps without virtual machine 160.
Memorizer 530 preferably comprises random access memory, and permissible by hardware numerical value produced by hardware device 250 It is stored on random access memory.Virtual device driver 460 is preferably changed the hardware numerical value from client 20 (convert) become to make Application Program Interface (the Application programming of application program 120 or application program 120 Interface, API) intelligible data, and data that (transmit) changed can be sent to application program 120 or application The Application Program Interface of program 120.In a preferred embodiment, a virtual device driver can be used to process one group of application numerical value (such as, it can be used to only process global positioning system coordinate and transmit numerical value to application program circle being associated with position Face).In other preferred embodiment, virtual device driver 460 can preferably be used to process several hardware device 250 to Application program 120 is (it is to say, it can be used to become can change/transmit from different hardware devices dissimilar Hardware numerical value), and therefore promote application program 120 and coupling more than a hardware device.Further drive about virtual The details of dynamic program together will describe with Fig. 5 b.
As being familiar with this area and having it, skill is i.e. understood that, the various assemblies (components) of system can quilt It is incorporated to less servomechanism or the most single electronic computer.For example, servomechanism 10 and arbitrary servomechanism 30 may be all Reside in a machine.From the point of view of another viewpoint, the various assemblies of servomechanism 10, client 20 and/or application program servomechanism 30 Necessity does not resides in single servomechanism or single client, but is likely located at multiple servomechanisms of dispersion (separate) And/or in multiple client.For example, the data base 150 of servomechanism 10 can be located in the database server that it is own, and Database server is separately but networks in servomechanism 10.In other examples, the media output 240 of client 20 can It is one built-in (built-in) screen, and can also be to network in the most independent display (monitor) of client 20.
Fig. 5 a is the flow chart describing the preferred embodiment for the method producing the present invention dynamic user interface.
As shown in Figure 5 a, in step 1000, monitor program 10 preferably starts (initiate) one or more robot Program 110 is to run one or more application program 120.Robot program 110 is preferably to be programmed (program) to be used for simulating The behavior of user and in order to automatically carry out application program.In other preferred embodiments, robot program 110 can by with The user interface of machine ground detection (probe) multiple application program 120, and be used to operate multiple application program 120 randomly. The robot program 110 of this kind is to be adapted to operate various application program 120.The various embodiments of robot program 110 Citing have been described in U.S. patent application case numbering 13960779.In a preferred embodiment of the present invention, robot program 110 comprise use pre-programmed (preprogram) logic to run a software program of application program 120.Other present invention's In preferred embodiment, robot program 110 comprises a software program, and software program uses an optical character recognition (Optical Character recognition, OCR) logic operates application program 120.At another preferred embodiment of the present invention, machine People's program 110 comprises a software program, and (pre-recorded) people that software program is pre-recorded according to application program 120 controls operation (human manipulation) operates application program 120, comprises and uses the people of study self-application program 120 to control patrolling of operation Volume.
For example, in the preferred embodiment, user can be with the application being shown in dynamic user interface Program is interactive, when a user runs through dynamic user interface and controls a search result to operate, uses The behavior of person (is such as clicked on (click) interface and is used to the event of simulated touch/rap, or dilatory action is used to simulation The event of slip/movement) preferably can be detected by client application 260 and/or one or more hardware device 250 and Send back monitor program 100 and/or robot program 110, being a script (script) (or by the behavior record of user The program coding (programming code) of part) to help robot program to use script operation/control same after a while Application program.By the mechanism of this kind of teaching/machine learning, robot program 110 is more anthropoid behavior act through study Only, it preferably becomes more " have wisdom " (intelligent).Accordingly, because robot program 110 becomes more " personalize " (human-like) user will more be had a mind to by the output data of the application program 120, being shown in dynamic user interface Justice.The 4th presently preferred embodiments of the present invention, robot program 110 comprises a software program, and it is described according to four kinds Two or more combinations in logic, operate application program 120.
Preferably decide whether that each application program 120 can in step 1010, monitor program 100 or robot program 110 To operate in the operating system of servomechanism 10 this locality, or determine that application program 120 needs to be executed at virtual in step 1020 On machine 160.In one preferably embodiment, if known applications 120 can be run in local side mode at servomechanism 10 Operations specific system, and the original operating system of inoperative servomechanism 10, then can omit step 1010 and enter directly into step Rapid 1020, so that application program 120 can be performed by corresponding operating system on virtual machine 160.In step 1030, if There is a need to, smooth and easy in order to operate in step 1040, application program 120 can be wired to the application program servo that one or more is corresponding Device 30.In step 1050, the data of application program 120 output, it includes but not limited to word, video signal and/or message.In step 1060, monitor program 100 decides whether the data exported by application program 120 are stored in data base 150.If storing data it is Necessary, in step 1070, application program 120 data exported preferably are stored in data base 150.
In a preferred embodiment, data are stored in data base 150, and packet is containing as by robot program 110 The output data of one or more performed application program 120.It is defeated that output data preferably comprise word, video signal and/or message Go out data.In other presently preferred embodiments of the present invention, the data being stored in data base 150 are included in application program 120 and phase thereof The data of transmission between corresponding application program servomechanism 30.In another one presently preferred embodiments of the present invention, it is stored in data The packet in storehouse 150 is containing such as two kinds of front data.
In a preferred embodiment of the present invention, monitor program 100 determines to store all outputs of application program 120 output Data and between application program 120 and corresponding all of application program servomechanism 30 transmission all data in data base In 150.In other presently preferred embodiments of the present invention, monitor program 100 may determine only to store the data of part.The practice is preferably Reason is to retain the resource of servomechanism 10, the processor power supply of such as servomechanism 10 and/or storage area.For example, if One of them application program 120 discussed comprises the film of a total length (full length), and the system of the present invention only can store A series of film snapshot, the small fragment of film, the small fragment of a series of film or a total length version but low-res product of only having The film of matter, without storing whole movie.
In a preferred embodiment, step 1000 is continuously repeated execution to 1070.In other preferred embodiments, step 1000 to 1070 can repeat the most termly or.For example, if there being the information that a user is asked Do not exist in data base 150 or under not having the situations such as enough system resource, the present invention just can perform.
In step 2000, a user of present system can pass through input module 210 and produces a request.In the present invention A preferred embodiment, if input module 210 comprises a physical keyboard, can through key in (type) specific instruction/keyword Produce request.In other preferred embodiments of the present invention, if input module comprises an audio input device such as mike, in connecing After receiving the audio format (audio form) of instruction/keyword and picking out audio format, request can be generated.
In step 2010, application program 260, by networking interface 220 and 140, transfers the request to monitor program 100.Yu Bu Rapid 2020, monitor program 100 receives request.In step 2030, monitor program 100 picks out the application program of the request of being related to 120.In presently preferred embodiments of the present invention, be stored in the data in data base 150 can supervised program 100 for determining wherein An application program 120 and a specific request between relatedness.As above, when an application program 120 therein is currently running, and work as When mutually circulating between a data application program 120 wherein and corresponding application program servomechanism 30 thereof, it is stored in data Data in storehouse 150 can be included in data (in-app data) in application program, and it preferably comprises an application program therein The output data such as word, video signal and/or the message of 120.Various algorithms (algorithms) can be used to determine dependency, wherein Simplest algorithm comprises searches for data (underlying search data) phase by the word comprised in request with bottom set Comparison.
In step 2040, monitor program 100 determines, by networking interface 140 and 220, to transmit and be related to (the in that comes into question The output data of the application program 120 of request question) are to client 20.In a preferred embodiment of the present invention, supervision Program 100 transmits the overall output data from an application program 120 therein.In other presently preferred embodiments of the present invention, Monitor program 100 is the output data of the most only hop.For example, in a preferred embodiment, monitor program 100 is To save (conserve) system resource such as processes power supply and/or storage area, then may be restricted to client 20 Transmission quantity.Particularly, if the one of the application program come into question 120 comprises the film of a total length, monitor program 100 can preferably limit System output transmission quantity to a series of film snapshot, the small fragment of film, a series of film small fragment to client application journey Sequence 260 rather than transmission whole movie.
In step 2050, when the output data asking relevant application program 120 received and come into question, in step 2060, client application 260 can show output data in media output 230.A preferred embodiment of the present invention, matchmaker Body output 240 is used to show one or more output data coming from one or more relevant application program 120.As before, work as Application program 120 is performed or close to when immediately processing (real time), the output data of application program 120 preferably comprise Video signal and/or message data when word, message, snapshot or a series of snapshot or partly or entirely contracting.The present invention other relatively Good embodiment, from servomechanism 10 crossfire data out the most live (live) or close to live, and is derived from previously storage Data in data base 150.
Fig. 5 b describes preferably one method of the present invention, wherein user can pass through dynamic user interface and one or more Application program 120 is interactive.
As shown in Figure 5 b, in step 3000, in order to promote interaction, monitor program 100 is preferably coupled to client application The output data of program, and output data be shown in media output 240 and/or input module 210 on so that if user opens The dynamic interaction with an application-specific 120 therein, monitor program 100 has the ability to detect.Above-mentioned example is preferably Comprise use coordinate project the output data projection of (mapping) client application 260 in and show and export at media 240.For example, if media output 240 comprises the screen being furnished with 480x800 resolution (resolution), then cartesian Coordinate (Cartesian coordinates) [33,88] is preferably pointed out to start at the 33rd from the upper left corner in a form (window) The position of pixel in pixel on row and the 88th row, wherein form is used for showing the activity of application program 120.Through providing news Breath, as corresponded to the center of client application 260 and/or a pair XY axle bed mark, such as [33,88] and [109,208], May specify the upper left corner and the position in the lower right corner of the image (view) that will be generated, be wherein shown in the visitor of media output 240 The output data of family end application program 260 can be coupled to monitor program 100.Should be suggested, outside cartesian corrdinate system Coordinate system, when meeting above-mentioned condition, also can be used.
In other preferred embodiments, coupling client application 260, to be shown in the output data of media output 240 preferable Additionally comprise: use one or more event tag to point out an event relevant with those coordinates.For example, event " TOUCH [33,66] " represent user to be positioned in the pixel of coordinate [33,66] and rap in media output 240 or touch screen position.It is familiar with This area and there is its common sense person i.e. it is understood that coordinate and/or event tag may need suitable translation (translation) or conversion is to monitor program 100, reason is that monitor program 100 may be used in media output 240 not Same resolution, or it is that only a part of media output 240 is used in the purposes showing dynamic user interface.By providing seat Mark and event tag, when the behavior of user, to point out that this user is wished to start with an application-specific 120 therein mutual Dynamic, and when application-specific 120 is shown in the dynamic user interface of the present invention, monitor program 100 can preferably be detected To event.
In step 3010, user can the most preferably start and the interaction of application program 120.For example, If media output 240 comprises a touch sensitive screen, user can preferably be shown in media output 240 therein one specific should The most interactive by the output data of program 120, such as touch with the top of user finger and carry out interaction.In other present invention Preferred embodiment in, user can use vernier (cursor) on screen aim at (aim) and touch slide-mouse (mouse) aobvious Be shown in media output 240 on an application-specific 120 therein output data on, and with an application-specific therein 120 is interactive.In this two example, a set of coordinate and touch event label are transmitted to monitor program 100, to point out that user is wished Interactive with the application-specific 120 therein corresponding to coordinate opposite position.In other preferred embodiments, if input mould Block comprises a keyboard, and in order to start and the interaction corresponding to a such as application-specific of numeral 9, user can simply strike Hit the specific keys (keys) corresponding to numeral 9.
It follows that in step 3020, monitor program 100 creates a new events (instance) of application program 120, with spy Fixed for independent and user interaction.Because the application program of new events is preferably by user manual operation, so do not have must New events and a robot program 110 are connected.Wish and application program 120 interaction, application more than a user if having Several events of program 120 will be created within servomechanism 10 so that each user can independently of one another with application program 120 Event is interactive.Should be suggested, if application program 120 asks a virtual machine 160 to perform, in a preferred embodiment In, other events of application program 120 and new events, can all result from same virtual machine 160.Preferably implement at other Example, the new events of application program 120 can be implemented in the virtual machine 160 that it is exclusive, rather than with other things of application program 120 Part is shared virtual machine 160 and is produced and perform.
When a new events of application program 120 is generated, the new events of application program 120 be preferable DIYU at the beginning Time be initialised, as user just opens application program.For example, if the application program come into question is a trip Play, the new events of application program 120 can perform by the initial conditions played, allows the user can be by the initial conditions played Start to experience.In other examples, if application program 120 is a mobile applications program, it provides user to listen to message string The ability of stream, then the new events of mobile applications program can start to perform in default (default) page 1, and wherein user can Browse in the music of variety classes (page).
In another kind of situation, when the new events of application program 120 is generated, the new events of application program 120 can State during interaction is asked to be performed with user to application program 120 with accurately or roughly (approximately).Lift For example, if the application program come into question 120 is used to show cartoon (animation) or film, the new thing of application program Part accurately or roughly by user can require that the time point with application program 120 interaction commences play out cartoon.At it In his example, if the application program come into question 120 is an action application program, mobile applications program include one or more movable or Webpage, those activities or a webpage content therein are the related introduction of new car, and require it is such as about the position buying new car Information, then the new events of application program 120 can directly guide (bring) user to having several pages (multi-page) Mobile applications program shows the particular webpage of the location information selling new car.
In other presently preferred embodiments of the present invention, when a new events of application program 120 is generated, application program The new events of 120 can perform by the specific part of application program 120, and wherein specific part is the highest with request relatedness. For example, if the application program come into question 120 is the website that dining room X has multiple webpage, and request is the position about dining room X Putting, robot program can directly guide the new events of webpage to show dining room X position money in the website have multiple webpage The particular webpage of news.Similarly, if the application program come into question 120 is multi-screen (multiscreen) mobile applications of dining room X Program, and request relates to the position of dining room X, then the bootable new events of robot program is in multi-screen mobile applications program Show the specific screens of dining room X position information.
It follows that for the interaction of user to be promoted Yu application program 120, client 20 is preferably coupled to perform Application program 120 on servomechanism 10.This preferably comprises media module 240 and hardware 250 is coupled to application program 120。
In step 3030, in a preferred embodiment, under the situation being coupled to monitor program 100, couple client application Be shown in media output 240 in program 260 outputs data to application program 120, preferably comprises use coordinate and/or event The projection (mapping) that label is carried out.In the case of being coupled to monitor program 100, it is familiar with this area and has the most normal The knowledgeable is it is understood that coordinate may need to carry out suitable translation or conversion corresponding to application program 120, and its reason can comprise should The resolution of the resolution used by program 120 and media output 240 is different and/or the output data of application program 120 only The part occupying the application program 260 in the client of media output 240 exports data.By coupling client 260 Output data are to application program 120 so that application program 120 can receive the user operation in media output 240.
When display is coupled to application program 120 in the output data of the client application 260 of media output 240 Time, the dynamic user interface of the present invention can be used to allow user and an application program interactive, and wherein application program needs with thing Reason motion (physical motion) controls.The example crossed of premise in, in order to want analog physical to move, user Can by drawing the visual output data of application program 120 in one or more direction, come preferably be shown in dynamic user One application program interactive at interface, or operate and control application program.In a preferred embodiment, Dragging movement can preferably produce A series of " DRAG [X, Y] " event tag of coordinate and correspondence is to (pair), and the most corresponding application program 120 can be by X And Building Y target change in value translation (interpret) is a specific direction.In another embodiment, client application journey Sequence 260 may by a series of " DRAG [X, Y] coordinate and event tag are to being converted into data, with suitably mutual with application program 120 Dynamic, wherein data can be translated to a direction by application program 120.
As used the example of an application program of dilatory mechanism, if application program is a driving sport car game, it makes User can control to drive sport car game by making left bank action or right bank action on game station for physically The direction of middle vehicle；If user on dynamic user interface dilatory application program output data to the right side or a left side, then drive Sport car game can make user simulate tilting action on application program 120.Similarly, if driving sport car game to make a user May utilize action and the driving sport car game interactive of a shake, a user can be by the most continuous in dynamic user interface Draw search result to the left and to the right to simulate the action of shake interactive with search result, so that user can be with application journey Sequence 120 is interactive.
In other presently preferred embodiments of the present invention, the hardware device 250 of client 20 also can be coupled to application program 120, The process that induction installation 250 is coupled to application program 120 preferably comprises step 3040, and wherein client 20 obtains application journey Hardware setting required for sequence 120.
The setting of hardware device is preferably one group numerical value, and this group numerical value is used for configuring (configure) application program 120 hardware devices 250 needed.In a preferred embodiment of the present invention, if client 20 has eight hardware devices, the most firmly Part set can preferably use eight bits (digits) form (each bit has one " 0 " or " 1 " numerical value) point out should The request represented with the hardware numerical value of program 120.For example, hardware setting [0,1,1,0,0,0,0,0] can be used to point out to need Want second and third servomechanism/hardware device to be required, and (redirect) should be redirected to answering from client 20 By program 120.The hardware setting of application program 120 can obtain by analyzing (analyze) application program 120.In an Android In the example of application program, AndroidManifest.xml archives point out activity and the meaning being needed to perform application program The quantity of figure filter (intent filters) etc., and the hsrdware requirements information of application program is provided whereby.In this instance, often One application program being implemented on virtual machine can possess at least one hardware setting.
When receiving hardware setting, in step 3050, monitor program 100 is preferably opened and is coupled the hardware of needs and sets Standby 250 to application program 120.This step preferably introduces (involve) virtual servo device 460 and the use of driver 520. In other examples, application program 120 can be coupled to plural number in the case of the hardware setting not considering application program 120 Driver, and transmit hardware numerical value to beyond servomechanism by the second environment selected by hardware setting.It is familiar with this area and tool Standby general knowledge person is it is understood that driver need not operation all the time.Driver can be after receiving hardware setting Start, and time required for driver is no longer employed program 120, driver can be stopped, or when user is changed When (switch to) is to other application programs 120, client 20 can stop driver.
Once hardware device 250 is coupled to application program 120, when a hardware device 250 is triggered (trigger) in step When rapid 3060, storage 530 receives the hardware numerical value that one or more slave driver 520 transmits in step 3060.Yu Bu In rapid 3070, client 20 then transmits hardware numerical value to application program 120 with the hardware abstraction layer 420 of servomechanism 10.Empty Intend driver 460 and receive hardware numerical value, hardware numerical value is converted into the form of applicable application program 120, and will be changed Hardware numerical value is sent to application program 120 and processes.
In other presently preferred embodiments of the present invention, it is not required to implement (implement) virtual device driver.Hardware numerical value May pass to hardware abstraction layer 420, and be directly transferred to application program 120.For example, use dynamically when a user User interface operates a navigation (navigation) application program, and navigation application program is actually at the most directly coupling Run together in the case of real GPS/auxiliary global satellite positioning system (GPS/AGPS) module. Produce the GPS signal in client 20 and can not be sent to the application program 120 that navigates, because dynamically using Person interface itself is an application program, and can not be used for receiving hardware numerical value.Such as, in an Android application program, formula designs Person needs, before encapsulation (pack) application program parcel archives, to write a line and be loaded into (loading) parcel in source code The source code of the classification (class) " GpsSatellite " comprised in android.location, to obtain coordinate, Qi Zhongying Can for example.apk archives in Android with program parcel archives.The reason of above-mentioned loading classification " GpsSatellite " is pre- It is impossible that survey or restriction may operate at the application program at dynamic user interface, so learning the available institute of all hardware It is also highly difficult for having function (functions).In an example of the present invention, the loading institute that dynamic user interface is predeterminable There is classification to provide service.In other examples of the present invention, dynamic user interface dynamically self-configures, specific to be loaded into The classification of kind, or after receiving related hardware numerical value, be coupled to specific hardware and (be such as implemented in dynamic user interface One program is loaded into corresponding classification in response to hardware numerical value).
In a preferred embodiment, when step 3050 needs, the driver corresponding with hardware program 250 is sustainable Be coupled to application program 120, so that archives produced by corresponding hardware numerical value/hardware may pass to application program 120.In other preferred embodiments, when not having networked services, hardware numerical value can be kept in (buffer) in storage 560, and works as When networked services is recovered, hardware numerical value is transmitted only to application program 120.
In a preferred embodiment of the present invention, hardware numerical value comprise image, sound, acceleration, arround temperature, rotation Rate, ambient light level, earth's magnetic field, arround air pressure, an object relative to the nearness of vision screen, relative ambient humidity or Coordinate (global positioning system/agps system module) etc..Hardware numerical value be comprise from client 20 such as camera, Mike, accelerometer, thermometer, gyroscope, magnetometer, barometer, proximity sensor (proximity sensors) or The hardware such as drimeter.
As previously mentioned with respect to the narration of the method for the present invention, monitor program 100 performs many tasks.Should be noted that is prison Superintend and direct program 100 and built (structure) single software module can be become, or monitor program 100 can comprise by monitor program 100 The corresponding several modules dividing (divide) of the various functions performed.For example, monitor program 100 can comprise a mould Block is used for transmitting the output data of application program 120, comprising another different module for storage or the bag of controlling database especially It is used for manufacturing the event etc. of application program containing other modules yet another.It addition, in other embodiments, be not required to monitor program Particular task performed by 100, the method that therefore in application program 100, the module of corresponding particular task is not included in the present invention And system.For example, if application program 120 is always sent to client 20 its all of output data, then without supervision journey Sequence 100 determines transmit what data necessity to client 20.For Ji Duan, if need not be held by monitor program 100 The most task of row, the remaining function of rear monitor program 100 can integrated (fold into) in the method for the present invention and be Other assemblies of system, seem robot program 110.For example, if a specific user always requires (refer to) only The application program of one, the whole of output data can produce from application program and necessity interactive without carrying out user, is therefore not required to Want control and the decision making function of monitor program 100.Taking and generation, robot program 110 can process request in a step 220 Reception, and in step 230 and 240, process the transmission of requested application program 120.
As shown, Fig. 4, Fig. 5 b and Fig. 6 may be used to describe a preferred embodiment, and wherein a user uses camera to make Come for application program 120 filmed image for hardware device 250.Be noted that in Fig. 5, dotted line representative function calling or instruction (calling/ Instruction hardware or corresponding Application Program Interface)；And solid line represents real data transmission, such as image or any kind of Hardware numerical value.
In step 3000, the output data that monitor program 100 preferably couples client application 260 are defeated in media Go out on 240 and receive the behavior of (listen for) user.In step 3010, mutual in order to open with application program 120 Dynamic, a user preferably selects to be shown in the application program 120 at the present invention dynamic user interface, and dynamic user interface is posted Send coordinate and user event to monitor program 100.When receiving coordinate and touch event, monitor program 100 starts application journey Sequence 120.In step 3020, monitor program 100 produces the new events of an application program 120 particular for user.It follows that in Step 3030, monitor program 100 uses coordinate and event tag, is shown in the client application 260 of media output 240 Output data couple with application program 120.In step 3040, monitor program 100 receives the hardware setting of application program 120, What in hardware setting, a hardware 250 therein was asked would is that a camera.In step 3050, monitor program 100 is by camera Driver be coupled to application program 120, this may need to start driver 520 and virtual device driver 460.In step 3060, hardware 250 is activated, and this may comprise a user and press next button, and button is corresponding to the camera figure of an application program Case, and application program shows on dynamic user interface, button can be such as the button 610 of Fig. 6.In receiving touch event After, monitor program 100 then identifies touch event, and applies (apply) touch event on application program 120.Any After the suitably conversion being carried out differences in resolution, application program 120 can identify user according to touch event coordinate wishes Shooting photo, because touch event coordinate represents touch event and betides the position in camera start button.As shown in Figure 6, exist In other embodiments of the present invention, application program 120 may send a set of coordinate to configure the region in a media output 240 620, region 620 is used for starting the button of camera corresponding to one.For example, transmit a set of coordinate to go back application program 120 Step is probably unwanted, because client application 260 may be used to identify user and touch screen at the beginning of to produce The position of beginning touch event.In an example, the figure object (view) corresponding to a button can be produced by dynamical output interface Being born in its local side, therefore the resolution of figure object can be corrected (fixed) in local side mode.But, dynamic user The residue screen at interface is used to show the output data of application program 120, and resolution can be used to adjust (adjust) networking Bandwidth (bandwidth) (such as, 1080P (progressive scan, progressive scan) can be used when high bandwidth, and in 360P can be used) during low bandwidth.
In step 3070, once camera is activated, and hardware numerical value can be addressed to store 530.Hardware numerical value is preferably Comprise one or more image being taken.In step 3080, these data are then sent through hardware abstraction layer 420 and 540 To application program 120.
In other preferred embodiments of the present invention, it need not robot program to run application program 120.Take and generation , user can ask its application program 120 being desirable for simply, then servomechanism 10 manufactures an application program 120 New events for user with as response, and when application program 120 is by time performed by robot program 110, it is not necessary to pre- First show the user output data of application program 120.Therefore, the system corresponding to specific embodiment as shown in Figure 3 will not Need robot program 110.The process of Fig. 5 c and Fig. 5 d diagram presently preferred embodiments of the present invention.
In step 4000, user is inputted (enter) request by input module 210.In step 4010, client 20 Then the request that transmits is to servomechanism 10.It follows that in step 4020, when receiving request, monitor program 100 determines to be related to The application program 120 of request is in step 4030.In step 4040, monitor program 100 produces a new thing of application program 120 Part, monitor program 100 determines that application program 120 suitably runs the need of a virtual machine and application program servomechanism 30 In step 4050-4080.In step 4090, once the new events of application program 120 is generated, application program 120 meeting Start and start to produce output data.Should be emphasised, the output data of application program 120 are relevant in the case The normal initialization state of application program 120, such as the output packet startup screen containing display application program 120, but display Step is not to be caused by the execution of robot program 110.In step 4100, monitor program 100 transmit output data to Client 20, and client 20 receive in step 4110 output data.In step 4120, client 20 shows by servomechanism The 10 output data being sent to application program 120, are shown in media output 240 through client application 260.
It follows that in step 4130, monitor program 100 uses XY coordinate and/or event tag to couple and is shown in matchmaker The application program 260 of body output 240 output data to application program 120, so that user and application program 120 are through should Carrying out interaction by the output data of program 120, wherein output data are to be shown in media output by client application 260 240.If hardware is required interactive with application program 120, client 20 can obtain the hardware transmitted by application program 120 and set Fixed.In step 4150, monitor program 100 uses driver 520 to couple the hardware device 250 of necessity in application program 120, hardware abstraction layer 530, virtual device driver 460 and hardware abstraction layer 420.When application program 120 and hardware device 250 coupling When connecing, it likely triggers hardware device 250 in step 4160.In step 4170, hardware device 250 produces hardware number Value, wherein hardware numerical value can be converted into the manageable form of application program 120 by virtual applications 460, and after conversion Pass hardware numerical value back application program 120.Along with application program 120 is coupled to client 20 completely, user now can be by Client 20 uses application program 120, as application program 120 is just running in client 20, without practically at equipment Download, install and/or perform application program 120 on 20.
Being familiar with this area and have its general ability person and i.e. know, above-mentioned example can be general in the relatively wide invention without departing from the present invention Make a change in the case of thought.It will be appreciated that therefore the invention is not limited in disclosed specific embodiment, but its purpose It is to protect and contains any change having in spirit and scope of the present invention defined in claims as each in the present invention.
Further, when the example that the description present invention is representative, this specification may be with one section of particular order Step present method and/or the process of the present invention.But, method or process that the present invention is presented rely on the most completely This particular order of steps illustrated, because the method or process should not limited by above-mentioned particular sequence step institute.It is familiar with ability Even if the people in territory is i.e. it is understood that use other orders beyond above-mentioned particular order, step set forth in the present invention also can realize Various embodiments of the present invention.Therefore, the above-mentioned particular order of steps illustrated in this specification should not be identified as present invention power The restriction that profit requires.It addition, relate to the method for the present invention and/or the claim of process, should not be so limited to its written step Effect of being thered is provided of order, and be familiar with this area and have general ability person can know, the sequence of steps of the present invention can be in dimension It is changed in the case of holding spirit and scope of the present invention.

Claims (88)

1. the system producing dynamic user interface, it is characterised in that including:
One or more client；
One or more servomechanism, it is networked to one or more client described；
One or more application program, it resides in one or more servomechanism described；And
One or more robot program, it resides in one or more servomechanism described, one or more robot program wherein said It is used for performing one or more application program described, and performs one or more application journey described one or more robot program described During sequence, one or more servomechanism described is used for providing one or more output data to one or more client described.
2. dynamically user interface system as claimed in claim 1, it is characterised in that:
Also including monitor program, it resides in one or more servomechanism described.
3. dynamically user interface system as claimed in claim 1, it is characterised in that:
Described output data include word, the snapshot or a series of taken out in the output data of one or more application program described Snapshot, or video signal and/or message data during part or all of contracting.
4. dynamically user interface system as claimed in claim 1, it is characterised in that:
One or more servomechanism described is received one or more request by one or more client described.
5. dynamically user interface system as claimed in claim 4, it is characterised in that:
Search relevant on described request and line.
6. dynamically user interface system as claimed in claim 4, it is characterised in that:
Described request is relevant to one or more application program for application program purpose of lease.
7. dynamically user interface system as claimed in claim 4, it is characterised in that described request is relevant to one or more and uses The application program of purposes is bought in application program.
8. dynamically user interface system as claimed in claim 4, it is characterised in that:
The output data of described one or more application program being sent to this client, are derived from and ask with described one or more Seek relevant application program.
9. dynamically user interface system as claimed in claim 8, it is characterised in that:
Relatedness is that in using application program, data are determined.
10. dynamically user interface system as claimed in claim 1, it is characterised in that also include:
The data base of data in storing application, in described application, data include from one or more application described The described output data of program.
11. dynamically user interface systems as claimed in claim 10, it is characterised in that:
The source of the described data being sent to one or more client described includes being stored in the output data of described data base.
12. dynamically user interface systems as claimed in claim 1, it is characterised in that also include:
One or more application program servomechanism, is used for supporting the execution of one or more application program described.
13. dynamically user interface systems as claimed in claim 1, it is characterised in that also include:
The data base of data in storing application program, in described application program, data include one or more application program described With the data exchanged between corresponding application program servomechanism.
14. dynamically user interface systems as claimed in claim 4, it is characterised in that also include:
Reside in the media output of described client.
15. dynamically user interface systems as claimed in claim 14, it is characterised in that also include:
Residing in the client application of client, described client application is used for presenting from described servomechanism through institute State the output data of one or more application program described that media output transmits.
16. dynamically user interface systems as claimed in claim 15, it is characterised in that:
Presented the output data of described application program by the described client application of described media output display, be used for making User can pass through client application and with one or more application program interactive described.
17. dynamically user interface systems as claimed in claim 16, it is characterised in that:
The output number of one or more application program described is presented by the described client application of described media output display According to, it is coupled to one or more corresponding application program described.
18. dynamically user interface systems as claimed in claim 17, it is characterised in that:
Described couple behavior and include transmitting a coordinate and a pair event tag.
19. dynamically user interface systems as claimed in claim 16, it is characterised in that also include:
The means of analog physical action, described physical action is carrying out the mistake with one or more application program interactive described by simulation Being required in journey, described simulation is the presented institute of described client application based on user Yu described media output display The interaction of the output data stating one or more application program is carried out.
20. dynamically user interface systems as claimed in claim 1, it is characterised in that:
Described client also includes one or more hardware device.
21. dynamically user interface systems as claimed in claim 20, it is characterised in that:
One or more application program described is coupled to one or more hardware device described.
22. dynamically user interface systems as claimed in claim 21, it is characterised in that:
Described couple behavior and include the exchange of hardware numerical value.
23. dynamically user interface systems as claimed in claim 22, it is characterised in that:
The driving journey that one or more hardware device described in one or more application program cause described is corresponding in described client Sequence, it is used for receiving virtual device driver, the hardware abstraction layer of described hardware numerical value and being coupled to one or more application program described Program library at least within one, receive described hardware numerical value.
24. dynamically user interface systems as claimed in claim 1, it is characterised in that also include:
Being used for assisting one or more virtual machine of one or more application program described, one or more application program described cannot be in One or more servomechanism described runs in local side mode.
25. dynamically user interface systems as claimed in claim 15, it is characterised in that:
The event of one or more application program described is generated for promoting that user is interactive.
26. dynamically user interface systems as claimed in claim 25, it is characterised in that:
It is generated for the described event of the described application program promoting user interactive, initiates with the initial of described application program Place.
27. dynamically user interface systems as claimed in claim 25, it is characterised in that:
It is generated for the described event of the described application program promoting user interactive, initiates with when user and described application When exchange between program is initiated, the place that described application program is performed.
28. dynamically user interface systems as claimed in claim 25, it is characterised in that:
Being generated for the described event of the interactive described application program of user, it initiates with in described application program with described The highest position of relatedness of user request.
29. 1 kinds of methods producing dynamic user interface, it is characterised in that including:
On one or more servomechanism, use one or more robot program to perform one or more application program；And
The output data of one or more application program described are sent to one or more client.
30. methods as claimed in claim 29, it is characterised in that:
The output data of described one or more application program transmitted include the output number from one or more application program described According to word, snapshot or a series of snapshot of middle taking-up, or video signal and/or message data during part or all of contracting.
31. methods as claimed in claim 29, it is characterised in that also include:
One or more request is received by one or more client described.
32. methods as claimed in claim 31, it is characterised in that:
One or more request described includes search index on one or more line.
33. methods as claimed in claim 31, it is characterised in that:
Described one or more request include by one or more application program come one or more for application program purpose of lease Request.
34. methods as claimed in claim 31, it is characterised in that:
Described one or more request include by one or more application program come one or more buy purposes for application program Request.
35. methods as claimed in claim 29, it is characterised in that:
The step of described transmission output data include the output data of one or more application program described be associated in described one or Multiple requests.
36. methods as claimed in claim 35, it is characterised in that:
The relatedness of one or more application program described is that in using application program, data are determined.
37. methods as claimed in claim 29, it is characterised in that:
The step of the output data of transmission one or more application program described, is described in one or more application program described generation During output data, by live or complete in the way of live.
38. methods as claimed in claim 29, it is characterised in that also include:
Storing data in application program, in described application program, data include by being positioned at one or more data base described and by institute The output data stating one or more application program and come.
39. methods as claimed in claim 38, it is characterised in that:
The step of the output data of one or more application program described in described transmission be by transmission be stored in described one or more Output data in data base complete.
40. methods as claimed in claim 29, it is characterised in that also include:
One or more application program servomechanism is used to support the execution of one or more application program described.
41. methods as claimed in claim 40, it is characterised in that also include:
Store in application program data in one or more data base, and in described application program data include described one or more The data exchanged between application program with corresponding application program servomechanism.
42. methods as claimed in claim 29, it is characterised in that also include:
The output data of display one or more application program described are on one or more media export.
43. methods as claimed in claim 42, it is characterised in that also include:
Use one or more client application, show that the output data of one or more application program described are in one or more In media output.
44. methods as claimed in claim 43, it is characterised in that also include:
By exporting the output of one or more application program described in described client application shows at described media Data, make user can exchange with one or more application program described.
45. methods as claimed in claim 44, it is characterised in that also include:
One or more client application described in display in the output of described media is presented one or more application described The output data of program, are coupled to one or more corresponding application program described.
46. methods as claimed in claim 45, it is characterised in that:
Described will described media output on display described in one or more client application presented described in one or more The output data of application program, the step being coupled to one or more corresponding application program described includes: exchange one or more Coordinate and event tag pair.
47. methods as claimed in claim 45, it is characterised in that also include:
The means of analog physical action, described physical action is carrying out the mistake with one or more application program interactive described by simulation Being required in journey, described simulation is the presented institute of described client application based on user Yu described media output display The interaction of the output data stating one or more application program is carried out.
48. methods as claimed in claim 44, it is characterised in that also include:
Produce the event of one or more application program described, to promote between the described event of user and described application program Interactive.
49. dynamically user interface systems as claimed in claim 48, it is characterised in that:
It is generated for the described event of the described application program promoting user interactive, initiates with the initial of described application program Place.
50. dynamically user interface systems as claimed in claim 48, it is characterised in that:
It is generated for the described event of the described application program promoting user interactive, initiates with when user and described application When exchange between program is initiated, the place that described application program is performed.
51. dynamically user interface systems as claimed in claim 48, it is characterised in that:
Be generated for the described event of the described application program promoting user interactive, its initiate with in described application program with The position that one or more relatedness asked described is the highest.
52. methods as claimed in claim 29, it is characterised in that also include:
It is coupled to one or more application program described reside in one or more hardware unit in one or more client described.
53. methods as claimed in claim 52, it is characterised in that:
One or more hardware described in being coupled to one or more application program described to reside in one or more client described The described step of device includes exchanging one or more hardware numerical value.
54. methods as claimed in claim 53, it is characterised in that also include:
One or more application program described processes described hardware numerical value.
55. methods as claimed in claim 29, it is characterised in that also include:
One or more virtual servo device is used to perform one or more application program described.
56. 1 kinds of systems producing dynamic user interface, it is characterised in that including:
One or more client；
One or more servomechanism, it is networked to one or more client described；
One or more application program, it resides in one or more servomechanism described；And
One or more client application, it resides in one or more client described；
One or more client application wherein said be coupled to described one or more reside in described servomechanism or Multiple application programs, so that user is able to come mutual with one or more application program described by one or more client described Dynamic.
57. dynamically user interface systems as claimed in claim 56, it is characterised in that also include:
Media export, and it is used for presenting the defeated of described one or more application program shown by one or more client application Go out data.
58. dynamically user interface systems as claimed in claim 56, it is characterised in that:
Step bag is coupled between one or more client application described and one or more application program described
Include the exchange of coordinate and event tag pair.
59. dynamically user interface systems as claimed in claim 56, it is characterised in that:
Additionally comprise one or more hardware unit.
60. dynamically user interface systems as claimed in claim 59, it is characterised in that:
One or more application program described is coupled to one or more hardware unit described.
61. dynamically user interface systems as claimed in claim 60, it is characterised in that:
The described step that couples comprises one or more hardware numerical value of exchange.
62. dynamically user interface systems as claimed in claim 61, it is characterised in that:
Wherein, the hardware numerical value that one or more application program described comes for locating hardware unit described in reason.
63. 1 kinds of methods producing dynamic user interface system, comprise the steps:
Produce and initialize the event of one or more application program on one or more servomechanism；And
On one or more servomechanism described in being coupled in, the event of application program is in one or more client, so that user is able to Using one or more client described to come and one or more application program interactive described, one or more client wherein said is relative It is in far-end in one or more servomechanism described.
64. methods as described in claim 63, it is characterised in that also include:
Use one or more client application to come in the output of one or more media and show one or more application program described Output data.
65. methods as described in claim 64, it is characterised in that:
Described couple step comprise by described one or more be shown in described media output client application, by described The output data of one or more application program are coupled to one or more corresponding event of one or more application program.
66. methods as described in claim 65, it is characterised in that:
Described by described one or more be shown in described media output client application, will described one or more apply The step of one or more corresponding event that the output data of program are coupled to one or more application program includes: exchange one or more Coordinate and event tag pair.
67. methods as described in claim 63, it is characterised in that also include:
Couple one or more application program described to one or more hardware unit residing in one or more client described.
68. methods as described in claim 67, it is characterised in that:
Described couple one or more application program described to one or more hardware unit residing in one or more client described Step include: exchange one or more hardware numerical value.
69. methods as recited in claim 68, it is characterised in that also include:
One or more application program described processes one or more hardware numerical value described.
70. 1 kinds for configuring sense of touch region, the first layout or according to the second of the second application program being implemented in second environment Second layout of figure object produces the method for the first figure object of the first application program being implemented in first environment, bag Include:
Receive a pair XY coordinate；And
Described to XY coordinate, the position in described first layout of described first application program according to received, produce First figure object.
71. methods as recited in claim 68, it is characterised in that also comprise:
Receive label, wherein said label represent in/corresponding to described first figure object process a kind of event, wherein by institute State described kind of event handled by the first figure object similar or identical with the second graph object of described second application program；And
Configure described first figure object, to have the function corresponding to described label.
72. 1 kinds are transmitted the methods of hardware numerical value come by hardware drive program by first environment to second environment, including under Row step:
It is coupled to described second environment；
Hardware setting is received by described second environment；
Based on described hardware setting, configure to be received hardware numerical value by driver；And
Transmit the hardware numerical value received to described second environment.
73. methods as described in claim 70, it is characterised in that also include:
Be coupled to described driver, to receive after described hardware setting, by described driver receive accordingly described firmly Number of packages value.
74. methods as described in claim 70, it is characterised in that also include:
Before receiving described hardware setting, it is coupled to multiple driver；And
The described hardware drive program selected by described hardware setting by described hardware numerical value, is sent to described second environment.
75. methods as described in claim 70, it is characterised in that also include:
When there is no network services, temporary described hardware numerical value；And
When there being network services, described hardware numerical value is sent to described virtual machine.
76. 1 kinds of be sent in second environment perform by the hardware numerical value of the hardware drive program from first environment second should By the method for program, comprise the following steps:
It is coupled to described virtual machine；
Hardware setting is received by described virtual machine；
According to described hardware setting, it is coupled to driver；
Hardware numerical value is received by described driver；And
Described hardware numerical value is sent to described second application program.
77. methods as described in claim 74, it is characterised in that also include:
When there is no network services, temporary described hardware numerical value；And
When there being network services, described hardware numerical value is sent to described second application program.
78. 1 kinds of movable methods initializing the first application program according to the second application program on virtual machine,
Comprise the steps:
Receive touch event；
Transmit a pair XY coordinate to described virtual machine, wherein said XY coordinate represented touched on screen and produce described touching Touch the position of event；
Receive configuration, initialize with the first activity to described first application program；And
When receiving described touch event, transmit the described first movable produced first result to described virtual machine.
79. methods as described in claim 76, it is characterised in that also include:
Receiving two to XY coordinate, described two pairs of XY coordinates represent can be touched and produce the upper left corner in the region of described touch event Position and lower right position.
80. methods as described in claim 77, it is characterised in that also include:
If described region is touched, then initialize described first movable.
81. methods as described in claim 78, it is characterised in that also comprise:
When receiving described touch event, the described first movable produced second result is sent to described virtual machine.
82. methods as described in claim 76, it is characterised in that also include:
Receive a pair XY coordinate and radius value, the described center that XY coordinate is represented the border circular areas producing described touch event, And described radius value represents the radius of described border circular areas.
83. methods as described in claim 80, it is characterised in that also include:
If described region is touched, then initialize described first movable.
84. methods as described in claim 80, it is characterised in that also include:
When receiving described touch event, the described first movable produced second result is sent to described virtual machine.
85. methods as described in claim X, it is characterised in that:
Described hardware comprise bluetooth, Wi-Fi Wi-Fi, near-field communication, camera, global positioning system, gyroscope, compass and Accelerometer.
86. methods as described in claim X, it is characterised in that:
Described virtual machine includes can the operating system of the multiple application program of master control.
87. 1 kinds of methods receiving advertisement at the first the first application program calculated on device, comprising:
Transmitting an XY coordinate, wherein the user interface of the first application program is touched to a virtual machine；
The 2nd XY coordinate is received by described virtual machine or another servomechanism；And
When described first application program is used for being formed touch area based on described 2nd XY coordinate or in this before, receive wide Accuse；And
Wherein said touch area can be touched and initial one is movable.
88. 1 kinds of methods receiving advertisement on the first the first application program calculating device, comprising:
Receive XY coordinate, to be used for configuring described first application program to form touch area on its user interface, or To be used for showing operation screen or the institute of described first application program on the described user interface of described first application program When stating advertisement, generation activity, wherein said touch area can be touched and initial one is movable.
CN201480040011.0A 2013-08-07 2014-08-07 Methods and systems for generating dynamic user interface Pending CN106062663A (en)

Applications Claiming Priority (9)

Application Number Priority Date Filing Date Title
US201361862967P 2013-08-07 2013-08-07
US61/862967 2013-08-07
US201461922860P 2014-01-01 2014-01-01
US61/922860 2014-01-01
US201461951548P 2014-03-12 2014-03-12
US61/951548 2014-03-12
US201461971029P 2014-03-27 2014-03-27
US61/971029 2014-03-27
PCT/US2014/050248 WO2015021341A1 (en) 2013-08-07 2014-08-07 Methods and systems for generating dynamic user interface

Publications (1)

Publication Number Publication Date
CN106062663A true CN106062663A (en) 2016-10-26

Family

ID=52461949

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201480040011.0A Pending CN106062663A (en) 2013-08-07 2014-08-07 Methods and systems for generating dynamic user interface

Country Status (4)

Country Link
EP (1) EP3014387A4 (en)
JP (1) JP6145577B2 (en)
CN (1) CN106062663A (en)
WO (1) WO2015021341A1 (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006079292A (en) * 2004-09-08 2006-03-23 Aruze Corp Content trial system
US20080234049A1 (en) * 2007-03-23 2008-09-25 Leblanc Marc Andre Method and system for personalized digital game creation
JP2010057921A (en) * 2008-09-05 2010-03-18 Nhn Corp Operation method and system of cooperative online game
CN101889254A (en) * 2007-12-05 2010-11-17 生命力有限公司 Integrated the streaming interactive video of the video segment that is write down
US20120226742A1 (en) * 2011-03-03 2012-09-06 Citrix Systems Inc. Transparent User Interface Integration Between Local and Remote Computing Environments
JP2012236327A (en) * 2011-05-11 2012-12-06 Canon Inc Printing apparatus, method of controlling the same, and program
EP2610776A2 (en) * 2011-09-16 2013-07-03 Veracode, Inc. Automated behavioural and static analysis using an instrumented sandbox and machine learning classification for mobile security

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5910903A (en) * 1997-07-31 1999-06-08 Prc Inc. Method and apparatus for verifying, analyzing and optimizing a distributed simulation
EP2611207A1 (en) * 2011-12-29 2013-07-03 Gface GmbH Cloud-rendered high-quality advertisement frame

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006079292A (en) * 2004-09-08 2006-03-23 Aruze Corp Content trial system
US20080234049A1 (en) * 2007-03-23 2008-09-25 Leblanc Marc Andre Method and system for personalized digital game creation
CN101889254A (en) * 2007-12-05 2010-11-17 生命力有限公司 Integrated the streaming interactive video of the video segment that is write down
JP2010057921A (en) * 2008-09-05 2010-03-18 Nhn Corp Operation method and system of cooperative online game
US20120226742A1 (en) * 2011-03-03 2012-09-06 Citrix Systems Inc. Transparent User Interface Integration Between Local and Remote Computing Environments
JP2012236327A (en) * 2011-05-11 2012-12-06 Canon Inc Printing apparatus, method of controlling the same, and program
EP2610776A2 (en) * 2011-09-16 2013-07-03 Veracode, Inc. Automated behavioural and static analysis using an instrumented sandbox and machine learning classification for mobile security

Also Published As

Publication number Publication date
EP3014387A1 (en) 2016-05-04
JP6145577B2 (en) 2017-06-14
EP3014387A4 (en) 2017-01-04
WO2015021341A1 (en) 2015-02-12
JP2016533576A (en) 2016-10-27

Similar Documents

Publication Publication Date Title
CN102362251B (en) For the user interface providing the enhancing of application programs to control
Jackson et al. Android apps for absolute beginners
JP2021507402A (en) How and systems to manage and display virtual content in mixed reality systems
US10289390B2 (en) Interactive multimodal display platform
US20080168367A1 (en) Dashboards, Widgets and Devices
US20130211923A1 (en) Sensor-based interactive advertisement
US11615581B2 (en) Systems and methods for securely providing virtual reality environments
US11763527B2 (en) Systems and methods for providing virtual reality environment-based training and certification
JP6135671B2 (en) Information processing apparatus and recording medium
US10282904B1 (en) Providing augmented reality view of objects
CN109905592A (en) According to the interactive controlling of user or the providing method and device of the content of synthesis
KR102189924B1 (en) Method and system for remote location-based ar authoring using 3d map
US9538319B1 (en) Synchronization for mapping applications
JP7393361B2 (en) Digital supplementary association and search for visual search
US9292165B2 (en) Multiple-mode interface for spatial input devices
US20200226833A1 (en) A method and system for providing a user interface for a 3d environment
Gonzalez-Sanchez et al. iPhone application development
CN106062663A (en) Methods and systems for generating dynamic user interface
Howse OpenCV for Secret Agents
Newnham Microsoft HoloLens By Example
KR102623374B1 (en) Metaverse implementation system for providing metaverse model house supporting smart home appliance operation simulation
Sharma et al. Open-Source Gesture-Powered Augmented Reality-Based Remote Assistance Tool for Industrial Application: Challenges and Improvisation
Howse OpenCV 4 for Secret Agents: Use OpenCV 4 in secret projects to classify cats, reveal the unseen, and react to rogue drivers
WO2019117655A1 (en) Remote location-based ar authoring method and system using 3d map
Jethwa GU-EYE-DE

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20161026

WD01 Invention patent application deemed withdrawn after publication