CN104685470A - Device and method for generating user interfaces from a template - Google Patents

Abstract

An electronic device is configured to receive a first request to display a user interface of a first third-party application on a respective display that is in communication with the device. The device is further configured to, in response to receiving the request, obtain a first user-interface template configured to be used by a plurality of third-party applications, and request, from the first application, one or more values for populating the first template. The device is also configured to receive, from the first application, while the first application is running on the device, a first set of values for populating the first template; populate the first template with the first set of values; generate a first user interface for the first application using the first template populated with the first set of values; and send information to the respective display that enables the first user interface to be displayed.

Description

For from the equipment of template generation user interface and method

The cross reference of related application

The U.S. Provisional Patent Application 61/832 of patent application claims submission on June 8th, 2013, the right of priority of 841, and it is relevant to following application: the Application U.S. Serial No 61/793,924 that the name that on March 15th, 2013 submits to is called " Voice and Touch User Interface "; The name submitted on February 22nd, 2011 is called the Application U.S. Serial No 13/032,614 of " Pushing a Graphical User Interface to a Remote Device with Display Rules Provided by the Remote Device "; The name submitted on January 6th, 2010 is called the Application U.S. Serial No 12/683,218 of " Pushing a User Interface to a Remote Device "; The name submitted on May 13rd, 2008 is called the Application U.S. Serial No 12/119,960 of " Pushing a User Interface to a Remote Device "; The name submitted on July 1st, 2011 is called the Application U.S. Serial No 13/175,581 of " Pushing a User Interface to a Remote Device "; The name submitted on June 15th, 2011 is called the Application U.S. Serial No 13/161,339 of " Pushing a Graphical User Interface to a Remote Device with Display Rules Provided by the Remote Device "; The name submitted on September 30th, 2011 is called the Application U.S. Serial No 13/250,947 of " Automatically Adapting User Interfaces for Hands-Free Interaction "; The name submitted on January 10th, 2011 is called the Application U.S. Serial No 12/987,982 of " Intelligent Automated Assistant "; The name submitted on January 18th, 2010 is called the U.S.Provisional Serial 61/295,774 of " Intelligent Automated Assistant "; The name submitted on June 3rd, 2011 is called the U.S.Provisional Serial 61/493,201 of " Generating and Processing Data Items that Represent Tasks to Perform "; The name submitted on June 9th, 2012 is called the U.S.Provisional Serial 61/657,744 of " Automatically Adapting User Interface for Hands-Free Interaction (for hands-free mutual automatic adaptation user interface) "; The name submitted on September 9th, 2008 is called the U.S.Provisional Serial 12/207,316 of " Radio with Personal DJ "; The name submitted on November 16th, 2012 is called the U.S.Provisional Serial 61/727,554 of " System and Method for Negotiating Control of a Shared Audio or Visual Resource "; The name submitted on June 8th, 2013 is called the Application U.S. Serial No 61/832,818 of " Mapping Application with Several User Interfaces "; The name submitted on June 8th, 2013 is called the Application U.S. Serial No 13/913,428 of " Application Gateway for Providing Different User Interfaces for Limited Distraction and Non-Limited Distraction Contexts "; The name submitted on June 8th, 2013 is called the U.S.Provisional Serial 61/832,842 of " Device, Method, and Graphical User Interface for Synchronizing Two of More Displays ".

Technical field

The present invention relates generally to for generating user interface, includes but not limited to the electronic equipment of the user interface being provided for third party application.

Background technology

Touch sensitive surface is significantly increasing in recent years as the use of computing machine with the input equipment of other electronic computing device.Exemplary Touch sensitive surface comprises Trackpad and touch-screen display.This type of surface is widely used in handles user interface object on the first display be associated with the first electronic equipment.

Exemplary manipulation comprises: the position and/or the size that adjust one or more user interface object; Activator button or open the file/application program represented by user interface object; Or otherwise handle user interface.Exemplary user interface object comprises digital picture, video, text, icon, control element as button and other figure.

Equipment has first party (or the machine) device software (such as sometimes, operating system, this operating system is for the equipment that developed by the same entity developing this operating system or develop on the direction of this same entity and application program) and third party software, third party software comprises the application program developed independent of first party (or the machine) device software.Third party application to be loaded on equipment sometimes to provide other functional to equipment.

Summary of the invention

But the user interface of third party application be usually customization and/or special.In addition, dedicated user interface sometimes comprise too little so that be difficult to drive time safe handling word or control.In addition, sometimes the control with similar functions is placed in diverse location for the different customization of different application and/or dedicated user interface, make user will cost other time and notice to locate these different controls and to determine the function of these different controls.Therefore, have and be trouble and poor efficiency for the different customization of different application and/or dedicated user interface.In addition, in some cases, it is longer that the time that these user interfaces spend handles the necessary time than user, thus waste energy.This rear consideration is particular importance in battery-driven equipment.

Therefore, need to have faster, more effective for providing the access of third party application and eliminating the electronic equipment of the method that driver diverts attention when using third party application.Improve from the template generation that uses together with third party application and eliminate system for distraction of driver for the legibility of the user interface mutual with third party application and the user interface of ease for use and improve user's efficiency.These class methods are optionally supplemented or are substituted for generating user interface and providing the conventional method of the access to third party application.These class methods alleviate the cognitive load of user, and generate a kind of more effective man-machine interface.For battery-driven equipment, these class methods save power, and increase the time between battery charging.

The above-mentioned defect and other problem that are associated with the user interface of the electronic equipment for having Touch sensitive surface is reduce or eliminated by disclosed equipment.In certain embodiments, equipment is desk-top computer.In certain embodiments, equipment is of portable form (such as, notebook computer, panel computer or handheld device).In certain embodiments, equipment has Trackpad.In certain embodiments, equipment has touch-sensitive display (being also referred to as " touch-screen " or " touch-screen display ").In certain embodiments, equipment has graphic user interface (GUI), one or more processor, storer and stores in memory for performing one or more modules of multiple function, program or instruction set.In certain embodiments, user comes with GUI mutual mainly through the finger contact on Touch sensitive surface and gesture.In certain embodiments, these functions optionally comprise picture editting, picture, displaying, word processing, webpage create, dish editor, electrical form make, play games, play phone, video conference, send and receive e-mail, instant messaging, exercise support, digital photography, digital video record, network browsing, digital music are play and/or digital video broadcasting.Executable instruction for performing these functions is optionally included in the non-transitory computer readable storage medium or other computer program being arranged to and being performed by one or more processor.

According to some embodiments, perform a kind of method at the electronic equipment place with one or more processor and storer.The method comprises: be received in and the respective display that communicates with electronic equipment show first of the user interface of the first third party application and show and ask.In response to receiving the first display request, the method comprises: obtain the first user interface template being configured to be used by multiple third party application; And from the first third party application request for filling one or more values of first user interface template.The method also comprises: when the first third party application runs just on an electronic device, receives the first class value for filling first user interface template from the first third party application; The first class value received from the first third party application is utilized to fill first user interface template; The first user interface template that use utilizes the first class value to fill generates the first user interface for the first third party application; And the information making can be displayed on for the first user interface of the first third party application in respective display is sent to respective display.

According to some embodiments, electronic equipment comprises storer and is couple to the processing unit of storer.Processing unit is configured to be received in and the respective display unit that communicates with electronic equipment shows first of the user interface of the first third party application and show and ask.Processing unit is also configured in response to receiving the first display request: obtain the first user interface template being configured to be used by multiple third party application; And from the first third party application request for filling one or more values of first user interface template.Processing unit is also configured to: when the first third party application runs just on an electronic device, receives the first class value for filling first user interface template from the first third party application; The first class value received from the first third party application is utilized to fill first user interface template; The first user interface template that use utilizes the first class value to fill generates the first user interface for the first third party application; And the information making can be displayed on for the first user interface of the first third party application in respective display unit is sent to respective display unit.

According to some embodiments, electronic equipment comprises one or more processor, storer and one or more program; One or more program is stored in memory and is configured to be performed by one or more processor, and one or more program comprises the instruction of the operation for performing any method as herein described.According to some embodiments, non-transitory computer readable storage medium stores instruction wherein, and when being performed by electronic equipment, these instructions make this equipment perform the operation of any method as herein described.According to some embodiments, electronic equipment comprises the device of the operation for performing any method as herein described.According to some embodiments, the signal conditioning package for using in the first electronic equipment comprises the device of the operation for performing any method as herein described.

Therefore, the electronic equipment with display has faster, more effective user interface for being provided for third party application thus improves the method for the effect of this kind equipment, efficiency and user satisfaction.These class methods and interface can supplement or substitute the conventional method for generating user interface.

Accompanying drawing explanation

In order to understand various described embodiment of the present invention better, should in conjunction with the following drawings with reference to the explanation of the following examples, in the accompanying drawings, similar drawing reference numeral indicates corresponding part in all of the figs.

Figure 1A illustrates the block diagram with the portable multifunction device of touch-sensitive display according to some embodiments.

Figure 1B is the block diagram of the example components for event handling illustrated according to some embodiments.

Fig. 2 shows the portable multifunction device with touch-screen according to some embodiments.

Fig. 3 is the block diagram with the exemplary multifunctional equipment of display and Touch sensitive surface according to some embodiments.

Fig. 4 A show according to some embodiments on portable multifunction device for a kind of exemplary user interface of the application menu.

Fig. 4 B shows a kind of exemplary user interface of the multifunctional equipment for having the Touch sensitive surface separated with display according to some embodiments.

Fig. 5 is the block diagram of a kind of operating environment illustrated according to some embodiments, in this operating environment, and portable multifunction device and external information display systems and/or server communication.

Fig. 6 A-6C illustrates the exemplary user interface from template generation according to some embodiments.

Fig. 7 A-7I is the process flow diagram of a kind of method from template generation user interface illustrated according to some embodiments.

Fig. 8 is the functional block diagram of the electronic equipment according to some embodiments.

Embodiment

Many electronic equipments use graphic user interface.Many graphic user interfaces are Custom Design, or specific to each application program.Method and apparatus described below improves these methods by generating user interface from the user interface templates used together with third party application.In certain embodiments, user interface templates is the user interface templates that the general or application program used by multiple different application has nothing to do.These user interfaces are presented on corresponding display.Same common user interface template is used to contribute to making the user interface standard of third party application for multiple different third party application.This is standardized in still for while user provides the functional access to third party application, make third party application more directly perceived and easier and more convenient carry out with it mutual.

These templates are helpful in a case where specifically: equipment is providing the access to third party application on the information display system of this device external, such as smart phone, this smart phone provides the access to the third party application on this smart phone by the touch-screen display in automobile.Information display system optionally has display, and this display has one of multiple different operating feature set (such as, display size, Control Cooling etc.).In certain embodiments, respective display is the display in vehicle information display, and this display is visible from the pilot set of vehicle, to improve the ease for use that third party application uses by the driver in vehicle and/or passenger.

Below, Figure 1A-1B, Fig. 2 and Fig. 3 provide the description to example devices.Fig. 4 A-4B and 6A-6C shows the exemplary user interface from template generation.Fig. 7 A-7I illustrates a kind of process flow diagram being provided for the method for the user interface of third party application.Fig. 8 is the functional block diagram of electronic equipment.User interface in Fig. 6 A-6C is for explaining the process in Fig. 7 A-7I.

example devices

Present general reference example in detail, the example of these embodiments is illustrated in the accompanying drawings.Show many details in the following detailed description, to provide fully understanding various described embodiment.But it is evident that those of ordinary skill in the art, various described embodiment can be put into practice when not having these details.In other cases, do not describe well-known method, process, parts, circuit and network in detail, thus the aspect of embodiment can be made necessarily hard to understand.

It will also be understood that, although term " first ", " second " etc. are used for describing various element in this article in certain embodiments, these elements should not be subject to the restriction of these terms.These terms are only used to an element and another element to distinguish.Such as, the first contact can be named as the second contact, and similarly, the second contact can be named as the first contact, and does not deviate from the scope of various described embodiment.Be all contact both first contact contacts with second, but they not same contacts.

The object of term just in order to describe specific embodiment used in description in this article to various described embodiment, and also not intended to be limits.As in the description in various described embodiment and appended claims use, singulative " ", " one " and " being somebody's turn to do " are intended to also comprise plural form, unless context is pointed out clearly in addition.It will also be understood that, term "and/or" used herein refers to and contains any and all possible combination of the one or more projects in the project listed explicitly.It will also be understood that, term " comprise " and/or " comprising " when using in this manual be specify exist state feature, integer, step, operation, element and/or parts, but do not get rid of and there is or add one or more further feature, integer, step, operation, element, parts and/or its grouping.

As used herein, based on context, term " if " be optionally interpreted as being meant to " and when ... time " or " ... time " or " in response to determining " or " in response to detecting ".Similarly, based on context, phrase " if determined ... " or " if detecting [the conditioned disjunction event stated] " be optionally interpreted as being meant to " determining ... time " or " in response to determining ... " or " when [the conditioned disjunction event stated] being detected " or " in response to detecting [the conditioned disjunction event stated] ".

Describe electronic equipment, for the user interface of such equipment with for using the embodiment of the associated procedure of such equipment.In certain embodiments, equipment is the portable communication device also comprising other function such as personal digital assistant and/or music player functionality, such as mobile phone.The exemplary embodiment of portable multifunction device includes but not limited to from Apple Inc's (Cupertino, Califormia) iPod with equipment.Optionally use other portable electric appts, such as there is laptop computer or the panel computer of Touch sensitive surface (such as, touch-screen display and/or Trackpad).It is to be further understood that in certain embodiments, equipment is not portable communication device, but has the desk-top computer of Touch sensitive surface (such as, touch-screen display and/or Trackpad).

In the following discussion, a kind of electronic equipment comprising display and Touch sensitive surface is described.But should be appreciated that electronic equipment optionally comprises other physical user-interface device one or more, such as physical keyboard, mouse and/or operating rod.

Equipment supports multiple application program usually, one or more in such as following: picture application program, show application program, word-processing application, webpage creates application program, dish editing application program, spreadsheet applications, game application, telephony application, videoconference application, email application, instant message application program, temper support application program, photograph management application program, digital camera applications program, digital video camcorder application program, network browsing application program, digital music player application, and/or video frequency player application program.

The various application programs that equipment performs optionally use at least one physical user-interface device shared, such as Touch sensitive surface.One or more functions and the corresponding informance be presented on equipment of Touch sensitive surface optionally adjust from a kind of application program and/or are changed to lower a kind of application program and/or are adjusted in corresponding application programs and/or change.Like this, the shared physical structure (such as Touch sensitive surface) of equipment optionally to utilize for user intuitively and clearly user interface to support various application program.

Present concern has the embodiment of the portable set of touch-sensitive display.Figure 1A is the block diagram of the portable multifunction device 100 with touch-sensitive display 112 illustrated according to some embodiments.Touch-sensitive display 112 is conveniently called " touch-screen " sometimes, and sometimes can be called as or be called touch-sensitive display system.Equipment 100 comprises storer 102 (optionally comprising one or more computer-readable recording medium), Memory Controller 122, one or more processing unit (CPU) 120, peripheral interface 118, RF Circuits System 108, audio circuitry 110, loudspeaker 111, microphone 113, I/O (I/O) subsystem 106, other input or opertaing device 116 and outside port 124.Equipment 100 optionally comprises one or more optical sensor 164.Equipment 100 optionally comprises the one or more intensity sensors 165 (such as, Touch sensitive surface, the touch-sensitive display system 112 of such as equipment 100) for the intensity of the contact on checkout equipment 100.Equipment 100 optionally comprise for generate on the appliance 100 sense of touch export one or more sense of touch output generators 167 (such as, at Touch sensitive surface, the touch-sensitive display system 112 of such as equipment 100 or the Trackpad 355 of equipment 300 generate sense of touch output).These parts communicate optionally by one or more communication bus or signal wire 103.

As in the present specification and claims use, " intensity " of the contact on term Touch sensitive surface refers to that contact on Touch sensitive surface (such as, finger contact) power or pressure (power of per unit area), or refer to the power of the contact on Touch sensitive surface or the substitute (surrogate) of pressure.The intensity of contact has value scope, and this value scope comprises at least four different values and more typically comprises up to a hundred different values (such as, at least 256).The intensity of contact optionally uses the combination of various method and various sensor or sensor to determine (or measurement).Such as, below Touch sensitive surface or adjacent to one or more force snesor of Touch sensitive surface optionally for measuring the power at the difference place on Touch sensitive surface.In certain embodiments, from the power measured value merged (such as, weighted mean) of multiple force snesor to determine the power of contact estimated.Similarly, the pressure-sensitive top of stylus is optionally for determining the pressure of stylus on Touch sensitive surface.Alternately, the size of contact area Touch sensitive surface detected and/or its change, the electric capacity of Touch sensitive surface of contiguous contact and/or the resistance of the Touch sensitive surface of its change and/or contiguous contact and/or its change are optionally used as the power of contact on Touch sensitive surface or the substitute of pressure.In certain embodiments, the substitute measured value of contact force or pressure is directly used in and determines whether to exceed intensity threshold (such as, intensity threshold describes with the unit corresponding to substitute measured value).In certain embodiments, the substitute measured value of contact force or pressure is converted into power or the pressure of estimation, and the power estimated or pressure are used for determining whether to exceed intensity threshold (such as, intensity threshold is the pressure threshold of pressing unit of force to measure).

As used in the specification and claims, term " sense of touch output " refer to by the equipment that detected by the touch sense of user by user relative to the physical displacement of the previous position of equipment, equipment parts (such as, Touch sensitive surface) relative to the displacement relative to the barycenter of equipment of the physical displacement of another parts (such as, shell) of equipment or parts.Such as, the parts of equipment or equipment and user to the surface of touch-sensitive (such as, the other parts of the hand of finger, palm or user) when contacting, the sense of touch generated by physical displacement is exported will be read as sense of touch by user, and this sense of touch corresponds to the change in the physical characteristics of perceived equipment or part of appliance.Such as, the movement of Touch sensitive surface (such as, touch-sensitive display or Trackpad) is optionally read as " the pressing click " or " unclamping click " to physical actuation button by user.In some cases, user will feel sense of touch, such as " press click " or " unclamping click ", even if when the physical actuation button be associated with Touch sensitive surface being physically pressed (such as, being shifted) in the movement by user does not move.And for example, the movement of Touch sensitive surface is optionally read as by user or senses is " roughness " of Touch sensitive surface, even if when the smoothness of Touch sensitive surface is unchanged.Although the individuation sensory perception being subject to user is limited the deciphering touched by user by this type of, the sensory perception of many touches is had to be that most of user has.Therefore, when sense of touch export be described to correspond to user specific sensory perception (such as, " press click ", " unclamping click ", " roughness ") time, unless otherwise stated, otherwise the sense of touch generated exports the physical displacement of the equipment of corresponding to or its parts, and this physical displacement will generate the described sensory perception of typical case (or common) user.

Be to be understood that, equipment 100 is an a kind of example of portable multifunction device, and equipment 100 optionally has than shown more or less parts, optionally combines two or more parts, or optionally there is the difference configuration of these parts or arrange.Various parts shown in Figure 1A realize with the combination of hardware, software or software and hardware, comprise one or more signal transacting and/or special IC.

Storer 102 optionally comprises high-speed random access memory, and optionally comprises nonvolatile memory, such as one or more disk storage device, flash memory device or other non-volatile solid state memory equipment.Other parts (such as CPU 120 and peripheral interface 118) of equipment 100 are optionally controlled by Memory Controller 122 access of storer 102.

Peripheral interface 118 can be used to the input and output peripherals of equipment to be couple to CPU 120 and storer 102.This one or more processor 120 runs or performs storage various software program in the memory 102 and/or instruction set, with the various function of actuating equipment 100 and process data.

In certain embodiments, peripheral interface 118, CPU 120 and Memory Controller 122 are optionally implemented on one single chip such as chip 104.In some other embodiments, they are optionally implemented in independently on chip.

RF (radio frequency) Circuits System 108 receives and sends RF signal, is also called electromagnetic signal.RF Circuits System 108 converts electrical signals to electromagnetic signal/electromagnetic signal is converted to electric signal, and via electromagnetic signal and communication network and other communication apparatus communication.RF Circuits System 108 optionally comprises the well-known Circuits System for performing these functions, includes but not limited to antenna system, RF transceiver, one or more amplifier, tuner, one or more oscillator, digital signal processor, codec chip group, subscriber identity module (SIM) card, storer etc.RF Circuits System 108 communicates with network and miscellaneous equipment optionally by radio communication, all internets in this way of network (being also referred to as WWW (WWW)), Intranet and/or wireless network (such as cellular phone network, WLAN (wireless local area network) (LAN) and/or Metropolitan Area Network (MAN) (MAN)).Radio communication optionally uses multiple communication standard, any one in agreement and technology, includes but not limited to global system for mobile communications (GSM), strengthen data GSM environment (EDGE), high-speed downlink packet access (HSDPA), High Speed Uplink Packet access (HSUPA), evolution, clear data (EV-DO), HSPA, HSPA+, two unit HSPA (DC-HSPDA), Long Term Evolution (LTE), near-field communication (NFC), Wideband Code Division Multiple Access (WCDMA) (W-CDMA), CDMA (CDMA), time division multiple access (TDMA) (TDMA), bluetooth, Wireless Fidelity (Wi-Fi) (such as, IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and/or IEEE802.11n), internet protocol voice technology (VoiP), Wi-MAX, email protocol (such as, internet message access protocol (IMAP) and/or post office protocol (POP)), instant message (such as, scalable message process Presence Protocol (XMPP), for instant message and the on-the-spot Session initiation Protocol (SIMPLE) utilizing expansion, instant message and the service of showing up (IMPS)), and/or Short Message Service (SMS), or other any suitable communication protocol, be included in this document submission date also untapped go out communication protocol.

Audio circuitry 110, loudspeaker 111 and microphone 113 provide the audio interface between user and equipment 100.Voice data, from peripheral interface 118 audio reception data, is converted to electric signal by audio circuitry 110, and by electric signal transmission to loudspeaker 111.Loudspeaker 111 converts electrical signals to the sound wave that the mankind can listen.Audio circuitry 110 also receives the electric signal come according to sound wave conversion by microphone 113.Audio circuitry 110 converts electrical signals to voice data, and by audio data transmission to peripheral interface 118 to process.Voice data is optionally retrieved from by peripheral interface 118 and/or is transferred to storer 102 and/or RF Circuits System 108.In certain embodiments, audio circuitry 110 also comprises earphone jack (such as, 212 in Fig. 2).Earphone jack provides the interface between audio circuitry 110 and removable audio frequency I/O peripherals, the earphone that this peripherals such as only exports or there is output (such as, monaural or bi-telephone) and input (such as, microphone) the two headset.

I/O subsystem 106 is by the I/O peripherals on equipment 100, and such as touch-screen 112 and other input control apparatus 116, be couple to peripheral interface 118.I/O subsystem 106 optionally comprises display controller 156, optical sensor controller 158, intensity sensor controller 159, tactile feedback controller 161 and for other input or one or more input control devices 160 of opertaing device.This one or more input control device 160 receives electric signal/transmit the electrical signal to other input control apparatus 116 from other input control apparatus 116.Other input control apparatus 116 optionally comprises physical button (such as, push button, rocker buttons etc.), dial (of a telephone), slide switch, operating rod, click type rotating disk etc.In some alternative embodiments, input control device 160 be optionally couple to (or not being couple to) below any one: keyboard, infrared port, USB port and pointing device such as mouse.One or more button (such as, 208 in Fig. 2) optionally comprises the up/down button that the volume for loudspeaker 111 and/or microphone 113 controls.One or more button optionally comprises push button (such as, 206 in Fig. 2).

Touch-sensitive display 112 provides input interface between equipment and user and output interface.Display controller 156 receives electric signal from touch-screen 112 and/or sends electric signal to touch-screen 112.Touch-screen 112 shows vision to user and exports.Comprise figure, text, icon, video and their any combination (being referred to as " figure ") vision output option.In certain embodiments, the output of some visions or whole visions export and correspond to user interface object.

Touch-screen 112 has and accepts based on sense of touch and/or tactile the Touch sensitive surface, sensor or the sensor group that input from user.Touch-screen 112 detects contacting (any movement contacted with this or interruption) on touch-screen 112 with display controller 156 (together with any associated modules in storer 102 and/or instruction set), and what detected contact be converted to the user interface object be presented on touch-screen 112 (such as, one or more soft-key button, icon, webpage or image) is mutual.In the exemplary embodiment, the contact point between touch-screen 112 and user corresponds to the finger of user.

Touch-screen 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer displays) technology or LED (light emitting diode) technology, but uses other display technique in other embodiments.Touch-screen 112 and display controller 156 optionally use now known or any technology in the multiple touch-sensing technology developed and other proximity sensor arrays or be used for is determined that other element of the one or more points contacted with touch-screen 112 detects later and contact and any movement or interruption, and this multiple touch-sensing technology includes but not limited to capacitive, ohmic, ultrared and surface acoustic wave technique.In one exemplary embodiment, projection-type mutual capacitance detection technology is used, such as from Apple Inc.'s (Cupertino, California) iPod with the technology found.

Touch-screen 112 optionally has the video resolution more than 100dpi.In certain embodiments, touch-screen has the video resolution of about 160dpi.User optionally uses any suitable object or condiment such as stylus, finger etc., contacts with touch-screen 112.In certain embodiments, user interface be designed to mainly with work together with gesture based on contact point, owing to pointing on the touchscreen, contact area is more greatly and possible accuracy is lower compared with the input based on stylus for this.In certain embodiments, the rough input based on finger is translated as accurate pointer/cursor position or order, to perform the action desired by user by equipment.

In certain embodiments, in addition to a touch, equipment 100 optionally comprises for activating or the Trackpad (not shown) of deactivation specific function.In certain embodiments, Trackpad is the touch sensitive regions of equipment, and this touch sensitive regions is different from touch-screen, and it does not show vision and exports.Trackpad is optionally the Touch sensitive surface separated with touch-screen 112, or the extension of the Touch sensitive surface formed by touch-screen.

Equipment 100 also comprises the electric system 162 for powering for various parts.Electric system 162 optionally comprises electric power management system, one or more power supply (such as, battery, alternating current (AC)), the parts that are associated of recharging system, power failure detection circuit, power converter or inverter, power status indicator (such as, light emitting diode (LED)) and other generation with electric power in portable set any, management and distribution.

Equipment 100 optionally also comprises one or more optical sensor 164.Figure 1A shows the optical sensor being couple to optical sensor controller 158 in I/O subsystem 106.Optical sensor 164 optionally comprises charge-coupled image sensor (CCD) or complementary metal oxide semiconductor (CMOS) (CMOS) phototransistor.Optical sensor 164 receives the light by one or more lens projects from environment, and light is converted to the data representing image.In conjunction with image-forming module 143 (being also called camera model), optical sensor 164 optionally catches still image or video.In certain embodiments, optical sensor is positioned on the rear portion of equipment 100, with the touch-screen display 112 on equipment front portion back to, make touch-screen display can be used as the view finder of still image and/or video image acquisition.In certain embodiments, another optical sensor is positioned on the front portion of equipment, while making user watch other video conference participants on touch-screen display, optionally obtains the image of this user for video conference.

Equipment 100 optionally also comprises one or more contact strength sensor 165.Figure 1A illustrates the contact strength sensor being couple to intensity sensor controller 159 in I/O subsystem 106.Contact strength sensor 165 optionally comprises one or more piezoresistive strain gauge, capacitive force transducer, power sensor, piezoelectric force transducer, optical force sensor, capacitive touch sensitive surfaces or other intensity sensor (such as, for measuring the sensor of the power (or pressure) of the contact on Touch sensitive surface).Contact strength sensor 165 receives contact strength information (such as, the surrogate of pressure information or pressure information) from environment.In certain embodiments, at least one contact strength sensor and Touch sensitive surface (such as, touch-sensitive display system 112) Alignment or vicinity.In certain embodiments, at least one contact strength sensor is positioned on the rear portion of equipment 100, with the touch-screen display 112 be positioned on the front portion of equipment 100 back to.

Equipment 100 optionally also comprises one or more proximity transducer 166.Figure 1A shows the proximity transducer 166 being couple to peripheral interface 118.Alternatively, proximity transducer 166 is couple to the input control device 160 in I/O subsystem 106.In certain embodiments, time near the ear that multifunctional equipment is placed in user (such as, when user carries out call), proximity transducer cuts out and forbids touch-screen 112.

Equipment 100 optionally also comprises one or more sense of touch output generator 167.Figure 1A illustrates the sense of touch output generator being couple to tactile feedback controller 161 in I/0 subsystem 106.Sense of touch output generator 167 optionally comprises: one or more electroacoustic equipment, such as loudspeaker or other acoustic component; And/or convert the energy into the electromechanical equipment of linear movement, such as motor, solenoid, electroactive polymer, piezo-activator, electrostatic actuator or other sense of touch export generating unit (such as, converting the electrical signal to the parts that the sense of touch on equipment exports).Contact strength sensor 165 receives tactile feedback from haptic feedback module 133 and generates instruction, and generates the sense of touch output that can be sensed by the user of equipment 100 on the appliance 100.In certain embodiments, at least one sense of touch output generator and Touch sensitive surface are (such as, touch-sensitive display system 112) Alignment or vicinity, and optionally by vertically (such as, to equipment 100 surface within/outside) or laterally (such as, in the plane identical with the surface of equipment 100 before and after ground) mobile Touch sensitive surface generate sense of touch and export.In certain embodiments, at least one sense of touch output generator sensor is positioned on the rear portion of equipment 100, with the touch-screen display 112 be positioned on the front portion of equipment 100 back to.

Equipment 100 optionally also comprises one or more accelerometer 168.Figure 1A shows the accelerometer 168 being couple to peripheral interface 118.Alternatively, accelerometer 168 is optionally couple to the input control device 160 in I/O subsystem 106.In certain embodiments, information is shown with longitudinal view or transverse views on touch-screen display based on the analysis to the data received from this one or more accelerometer.Equipment 100 optionally also comprises magnetometer (not shown) and GPS (or GLONASS or other Global Navigation System) receiver (not shown) except accelerometer 168, for obtaining the information of position about equipment 100 and orientation (such as, vertical or horizontal).

In certain embodiments, the software part stored in the memory 102 comprises operating system 126, communication module (or instruction set) 128, contact/motion module (or instruction set) 130, figure module (or instruction set) 132, text input module (or instruction set) 134, GPS (GPS) module (or instruction set) 135 and application program (or instruction set) 136.In addition, in certain embodiments, storer 102 memory device/overall internal state 157, as can be seen in figures ia and 3.Equipment/overall internal state 157 comprise following in one or more: applications active state, it is movable for being used to indicate which application program (if any) current; Display state, is used to indicate the regional that what application program, view or out of Memory occupy touch-screen display 112; Sensor states, comprises the information obtained from each sensor and the input control apparatus 116 of equipment; And about the position of equipment and/or the positional information of attitude.

Operating system 126 (such as, Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS or embedded OS such as VxWorks) comprise for control and management General System task (such as, memory management, memory device control, electrical management etc.) various software part and/or driver, and be conducive to the communication between various hardware and software parts.

Communication module 128 is conducive to being communicated with miscellaneous equipment by one or more outside port 124, and comprises the various software parts for the treatment of the data received by RF Circuits System 108 and/or outside port 124.Outside port 124 (such as, USB (universal serial bus) (USB), live wire etc.) is suitable for being directly coupled to miscellaneous equipment or coupling indirectly by network (such as, the Internet, WLAN etc.).In certain embodiments, outside port be same or similar with 30 needle connectors that use on iPod (trade mark of Apple Inc.) equipment and/or with spininess (such as, the 30 pins) connector of its compatibility.In certain embodiments, outside port be with 8 needle connectors that use on iPhone and iPod (trade mark of Apple Inc.) equipment (such as, lightning connector) same or similar and/or with spininess (such as, the 8 pins) connector of its compatibility.

Contact/operation module 130 optionally detects the contact with touch-screen 112 (in conjunction with display controller 156) and other touch-sensitive device (such as, Trackpad or physics click type rotating disk).Contact/motion module 130 comprises various software part for performing the various operations relevant with the detection contacted, such as determine whether to have there occurs contact (such as, detect finger and press event), determine the intensity of contact (such as, the power of contact or pressure, or the substitute of the power contacted or pressure), determine whether there is the movement of contact and on whole Touch sensitive surface, follow the tracks of this move (such as, detect one or more finger drag events), and determine whether contact has stopped to stop (such as, detect finger and lift event or contact interruption).Contact/motion module 130 receives contact data from Touch sensitive surface.Determine that the movement of contact point optionally comprises speed (value), speed (value and direction) and/or the acceleration (change in value and/or direction) determining contact point, the movement of contact point is represented by a series of contact data.These operations are optionally applied to single-contact (such as, single abutment) or multiple spot contacts (such as, " multiple point touching "/multiple finger contact) simultaneously.In certain embodiments, contact/motion module 130 detects contacting on Trackpad with display controller 156.

In certain embodiments, whether contact/motion module 130 uses one group of one or more intensity threshold to carry out determination operation and whether performs (such as, determining user's " click " icon) by user.In certain embodiments, a subset of at least intensity threshold is determined (such as according to software parameter, intensity threshold is not determined by the activation threshold of specific physics actuator, and can be adjusted when not changing the physical hardware of equipment 100).Such as, when not changing Trackpad or touch-screen display hardware, mouse " click " threshold value of Trackpad or touch-screen can be configured to predefined threshold value on a large scale in any one.In addition, in some are specifically implemented, user to equipment is provided for the software design patterns of one or more (such as, by adjusting each intensity threshold and/or once adjusting multiple intensity threshold by utilizing to the system-level click of " intensity " parameter) adjusted in intensity threshold class value.

Contact/motion module 130 optionally detects the gesture input of user.Different gestures on Touch sensitive surface have different contact patterns (different motion of such as, detected contact, timing and/or intensity).Therefore, gesture is detected optionally by the concrete contact patterns of detection.Such as, detect that finger tapping down gesture comprises and detect that finger is pressed event, then pressed the identical position of event (or substantially the same position) place (such as, at the picture mark position place) event that detects that finger lifts (being lifted away from) with finger.And for example, Touch sensitive surface detects that finger is gently swept gesture and comprised and detect that finger is pressed event, then one or more finger drag events detected and the event that detects that finger lifts (being lifted away from) subsequently.

Figure module 132 comprises the various known software parts for displaying and display graphics on touch-screen 112 or other display, comprise the parts of the visual impact (such as, brightness, transparency, saturation degree, contrast or other visual characteristic) for changing shown figure.As used herein, term " figure " comprises any object that can be displayed to user, comprises text, webpage, icon (such as comprising the user interface object of soft-key button), digital picture, video, animation etc. without limitation.

In certain embodiments, figure module 132 stores the data representation figure that will use.Each figure is optionally assigned with corresponding code.Figure module 132 receives one or more codes of specifying the figure that will show from application program etc., also receives coordinate data and other graphic attribute data together in the case of necessary, and then generation screen image data exports to display controller 156.

Haptic feedback module 133 comprises the various software parts for generating instruction, and these instructions are used by sense of touch output generator 167, exports to produce sense of touch in response to one or more positions alternately and on the appliance 100 of user and equipment 100.

The soft keyboard of input text in various application program (such as, contact person 137, Email 140, IM 141, browser 147 and need other application program any of Text Input) is optionally provided for as the text input module 134 of the parts of figure module 132.

GPS module 135 determines the position of equipment, and provide this information to use (such as in various application program, be supplied to phone 138 for location-based dialing, be supplied to camera 143 as photo/video metadata and be supplied to the application program that location Based service is provided, such as weather desktop small routine, local Yellow Page desktop small routine and map/navigation desktop small routine).

Application program 136 optionally comprises with lower module (or instruction set) or its subgroup or superset:

Contact module 137 (being sometimes called address list or contacts list);

Phone module 138;

Video conference module 139;

Email client module 140;

Instant message (IM) module 141;

Internet radio module 142;

For the camera model 143 of still image and/or video image;

Image management module 144;

Browser module 147;

Calendaring module 148;

Desktop small routine module 149, optionally comprise following in one or more: other desktop small routine that weather desktop small routine 149-1, stock market desktop small routine 149-2, counter desktop small routine 149-3, alarm clock desktop small routine 149-4, dictionary desktop small routine 149-5 and user obtain and the desktop small routine 149-6 that user creates;

Personal digital assistant module 150;

Vehicle integration module 151;

Video and musical player module 152, be optionally made up of video player module and musical player module;

Notepaper module 153;

Mapping module 154; And/or

Music libraries module 155.

The example being optionally stored other application program 136 in the memory 102 comprises other word-processing application, other picture editting's application program, picture application program, shows application program, application program that JAVA enables, encryption, digital rights management, voice recognition and sound reproduction.

In conjunction with touch-screen 112, display controller 156, contact modules 130, figure module 132 and text input module 134, contact module 137 optionally for management communication record or contacts list (such as, be stored in the application program internal state 192 of the contact module 137 in storer 102 or storer 370), comprising: add name to address list; Name is deleted from address list; Telephone number, e-mail address, actual address or out of Memory are associated with name; Image is associated with name; Name is classified and sorts out; There is provided telephone number or e-mail address to initiate and/or promote the communication by phone 138, video conference 139, Email 140 or IM 141; Etc..

In conjunction with RF Circuits System 108, audio circuitry 110, loudspeaker 111, microphone 113, touch-screen 112, display controller 156, contact modules 130, figure module 132 and text input module 134, phone module 138 is optionally used to input the one or more telephone numbers corresponded in the character string of telephone number, accessing address list 137, revise inputted telephone number, dial corresponding telephone number, conversate and the disconnection or hang up when session completes.As mentioned above, radio communication optionally uses any one in multiple communication standard, agreement and technology.

In conjunction with RF Circuits System 108, audio circuitry 110, loudspeaker 111, microphone 113, touch-screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact modules 130, figure module 132, text input module 134, contacts list 137 and phone module 138, video conference module 139 comprises the executable instruction for the video conference initiated according to user instruction, carry out and between end user and other participant one or more.

In conjunction with RF Circuits System 108, touch-screen 112, display controller 156, contact modules 130, figure module 132 and text input module 134, email client module 140 comprises for creating in response to user instruction, sending, receive and the executable instruction of managing email.Combining image administration module 144, email client module 140 makes to be very easy to create and send the Email with still image or the video image taken by camera model 143.

In conjunction with RF Circuits System 108, touch-screen 112, display controller 156, contact modules 130, figure module 132, with text input module 134, instant message module 141 comprises the character string for inputting in response to instant message, the character of amendment previously input, transmit corresponding instant message (such as, use Short Message Service (SMS) or multimedia information service (MMS) agreement be used for based on phone instant message or use XMPP, SIMPLE, or IMPS is used for the instant message based on the Internet), receive instant message and check the executable instruction of received instant message.In certain embodiments, the instant message transmitting and/or receive optionally comprises figure, photograph, audio file, video file and/or MMS and/or strengthens other annex supported in messenger service (EMS).As used herein, " instant message " refers to the message (message such as, using SMS or MMS to send) based on phone and both the message (message such as, using XMPP, SIMPLE or IMPS to send) based on internet.

In conjunction with touch-screen 112, display system controller 156, contact modules 130, figure module 132, audio circuitry 110, loudspeaker 111 and RF Circuits System 108, Internet radio module 142 be comprise for select and play Internet broadcasting station executable instruction imagination example third party application.

In conjunction with touch-screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact modules 130, figure module 132 and image management module 144, camera model 143 comprise for catch still image or video (comprising video flowing) and they are stored in storer 102, the characteristic of amendment still image or video or delete the executable instruction of still image or video from storer 102.

In conjunction with touch-screen 112, display controller 156, contact modules 130, figure module 132, text input module 134 and camera model 143, image management module 144 comprises for arrangement, amendment (such as, editor) or otherwise manipulate, tag, delete, present (such as, in digital slide or photograph album) and store the executable instruction of still image and/or video image.

In conjunction with RF Circuits System 108, touch-screen 112, display system controller 156, contact modules 130, figure module 132 and text input module 134, browser module 147 comprises for the executable instruction according to user instruction browsing internet (comprise search, be linked to, receive and display web page or its part and be linked to annex and other file of webpage).

In conjunction with RF Circuits System 108, touch-screen 112, display system controller 156, contact modules 130, figure module 132, text input module 134, email client module 140 and browser module 147, calendaring module 148 comprises for creating according to user instruction, display, amendment and the executable instruction of data (such as, calendar, Pending tasks list etc.) that stores calendar and be associated with calendar.

In conjunction with RF Circuits System 108, touch-screen 112, display system controller 156, contact modules 130, figure module 132, text input module 134 and browser module 147, desktop small routine module 149 be the miniature applications program optionally being downloaded by user and use (such as, weather desktop small routine 149-1, stock market desktop small routine 149-2, counter desktop small routine 149-3, alarm clock desktop small routine 149-4 and dictionary desktop small routine 149-5) or the miniature applications program (such as, user create desktop small routine 149-6) that created by user.In certain embodiments, desktop small routine comprises HTML (HTML (Hypertext Markup Language)) file, CSS (CSS (cascading style sheet)) file and JavaScript file.Desktop small routine).

In conjunction with RF Circuits System 108, audio circuitry 110, loudspeaker 111, microphone 113, touch-screen 112, display controller 156, contact modules 130, figure module 132 and text input module 134, personal digital assistant module 150 records voice command and will represent that the information of voice command recorded sends to server 510 in server such as Fig. 5 for analysis, and responds to voice command based on the response from server.

Vehicle integration module 151 comprises the executable instruction for one or more middle process, this one or more middle Process flowchart vehicle (such as, automobile, truck, lorry etc.) in vehicle information display, thus this vehicle information display respective display (such as, the display 547 of the external information display systems 540 in Fig. 5) on user interface is provided, this user interface is such as for mapping application program or music application.Information from third party application is converted to the content for being presented at by vehicle integration application in the respective display of vehicle information display by vehicle integration application.

In conjunction with touch-screen 112, display system controller 156, contact modules 130, figure module 132, audio circuitry 110, loudspeaker 111, RF Circuits System 108, with browser module 147, video and musical player module 152 comprise the executable instruction allowing user downloads and playback stores with one or more file layouts (such as MP3 or AAC file) the music recorded and other audio files, and for display, displaying or otherwise playback video are (such as, on touch-screen 112 or on the external display connected via outside port 124) executable instruction.In certain embodiments, equipment 100 optionally comprises MP3 player, and such as iPod's (trade mark of Apple Inc.) is functional.

In conjunction with touch-screen 112, display controller 156, contact modules 130, figure module 132 and text input module 134, notepaper module 153 comprises for creating according to user instruction and managing the executable instruction of notepaper, Pending tasks inventory etc.

In conjunction with RF Circuits System 108, touch-screen 112, display system controller 156, contact modules 130, figure module 132, text input module 134, GPS module 135 and browser module 147, mapping module 154 is optionally for data (such as, the driving route received according to user instruction, show, revise and store map and be associated with map; With specific location or near shop data relevant with other point of interest; And other location-based data).

In conjunction with touch-screen 112, display system controller 156, contact modules 130, figure module 132, audio circuitry 110, loudspeaker Ill and RF Circuits System 108, music libraries module 155 comprises the imagination example third party application for the executable instruction from music libraries selection and played songs.

Above-mentioned each module and application program correspond to one group of executable instruction for performing one or more functions above-mentioned and method introduced in this application (computer implemented method such as, described herein and out of Memory disposal route).These modules (i.e. instruction set) need not be implemented as software program, process or module separately, and therefore each seed group of these modules is optionally combined in various embodiments or otherwise rearranges.In certain embodiments, storer 102 optionally stores the subgroup of above-mentioned module and data structure.In addition, the other module that do not describe above optionally storing of storer 102 and data structure.

In certain embodiments, equipment 100 is so a kind of equipment, and namely the operation of predefined one group of function is performed by touch-screen and/or Trackpad uniquely on the device.By using touch-screen and/or Trackpad as the main input control apparatus of the operation for equipment 100, optionally reduce the quantity of the physics input control apparatus (such as push button, dial (of a telephone) etc.) on equipment 100.

This predefined one group of function performed by touch-screen and/or Trackpad uniquely optionally comprises the navigation between user interface.In certain embodiments, Trackpad when being touched by user by equipment 100 from display any user interface navigation on the appliance 100 to master menu, main screen menu or root menu.In this type of embodiment, Trackpad is used to perform " menu button ".In some other embodiments, menu button is physics push button or other physics input control apparatus, instead of Trackpad.

Figure 1B is the block diagram of the example components for event handling illustrated according to some embodiments.In certain embodiments, storer 102 (in Figure 1A) or storer 370 (Fig. 3) comprise event classifier 170 (such as, in operating system 126) and corresponding application program 136-1 (such as, aforementioned applications program 137-13,155, any application program in 380-390).

Event classifier 170 receives event information and determines the application view 191 of application program 136-1 and the application program 136-1 that event information will be delivered to.Event classifier 170 comprises event monitor 171 and Event scheduler module 174.In certain embodiments, application program 136-1 comprises application program internal state 192, and the instruction of this application program internal state 192 is presented at the current application program view on touch-sensitive display 112 when application program is movable or performs.In certain embodiments, equipment/overall internal state 157 by event classifier 170 be used for determining which (which) application program current be movable, and application program internal state 192 is used for the application view 191 determining event information to be delivered to by event classifier 170.

In certain embodiments, application program internal state 192 comprises other information, in such as following one or more: when application program 136-1 recovers to perform by passed through by recovery information, the instruction used application program 136-1 display information or be ready for the information shown by application program 136-1 user interface state information, be provided for user and can turn back to the repetition of the prior actions that the previous state of application program 136-1 or the state queue of view and user are taked/cancel queue.

Event monitor 171 receives event information from peripheral interface 118.Event information comprises the information about subevent (such as, the user on touch-sensitive display 112 touches, the part as multi-touch gesture).Peripheral interface 118 transmits its information received from I/O subsystem 106 or sensor (all proximity transducers in this way 166), accelerometer 168 and/or microphone 113 (by audio circuitry 110).Peripheral interface 118 comprises the information from touch-sensitive display 112 or Touch sensitive surface from the information that I/O subsystem 106 receives.

In certain embodiments, event monitor 171 sends request to peripheral interface 118 with predetermined interval.Responsively, peripheral interface 118 transmitting event information.In other embodiments, peripheral interface 118 only when exist remarkable event (such as, receive higher than predetermined noise threshold input and/or receive the input exceeding the predetermined duration) time transmitting event information.

In certain embodiments, event classifier 170 also comprises hit view determination module 172 and/or life event recognizer determination module 173.

When touch-sensitive display 112 shows more than one view, hit view determination module 172 is provided for the software process determining where subevent there occurs in one or more view.The control that view can be seen over the display by user and other element are formed.

The another aspect of the user interface be associated with application program is one group of view, herein sometimes also referred to as application view or user interface windows, and the gesture showing information wherein and occur based on touching.Detect that (corresponding application programs) application view of touch optionally corresponds to the sequencing level in the sequencing or view hierarchies structure of application program wherein.Such as, detect that the floor level view of touch is optionally called hit view wherein, and the event set being identified as correct input is optionally determined based on the hit view started from based on the initial touch of the gesture touched at least in part.

Hit view determination module 172 receives the information relevant to the subevent based on the gesture touched.When application program has the multiple view be organized in hierarchy, hit view is identified as in this hierarchy the minimum view that should process this subevent by hit view determination module 172.In most of situation, hit view is the floor level view that initiation subevent (namely forming first subevent in the subevent sequence of event or potential event) occurs wherein.Once hit view is hit the identification of view determination module, hit view usually receive to be identified as to it hitting view for same touch or the relevant all subevents of input source.

Life event recognizer determination module 173 determines which or which view in view hierarchies structure should receive specific subevent sequence.In certain embodiments, life event recognizer determination module 173 determines that only hitting view should receive specific subevent sequence.In other embodiments, life event recognizer determination module 173 determines that all views of the physical location comprising subevent are the active views related to, and therefore determines that all active views related to should receive particular child sequence of events.In other embodiments, even if touch subevent to be confined to the region be associated with a particular figure completely, view higher in hierarchy will still remain the active view related to.

Event information is dispatched to event recognizer (such as, event recognizer 180) by Event scheduler module 174.In the embodiment comprising life event recognizer determination module 173, event information is delivered to by life event recognizer determination module 173 definite event recognizer by Event scheduler module 174.In certain embodiments, Event scheduler module 174 stores event information in event queue, and event information is retrieved by corresponding event receiver module 182.

In certain embodiments, operating system 126 comprises event classifier 170.Or application program 136-1 comprises event classifier 170.In another embodiment, event classifier 170 is independently modules, or stores the part of another module (such as contact/motion module 130) in the memory 102.

In certain embodiments, application program 136-1 comprises multiple button.onrelease 190 and one or more application view 191, and wherein each comprises the instruction for the treatment of the touch event in the corresponding views of the user interface occurring in application program.Each application view 191 of application program 136-1 comprises one or more event recognizer 180.Usually, corresponding application programs view 191 comprises multiple event recognizer 180.In other embodiments, one or more in event recognizer 180 are somes of standalone module, the higher level object of standalone module all user interface tools in this way bag (not shown) or application program 136-1 therefrom inheritance method and other characteristic.In certain embodiments, corresponding event handling procedure 190 comprise following in one or more: Data Update device 176, object renovator 177, GUI renovator 178 and/or from event classifier 170 receive event data 179.Button.onrelease 190 optionally utilizes or calling data renovator 176, object renovator 177 or GUI renovator 178 upgrade application program internal state 192.Or one or more in application view 191 comprise one or more corresponding event handling procedure 190.In addition, in certain embodiments, one or more in Data Update device 176, object renovator 177 and GUI renovator 178 are included in corresponding application programs view 191.

Corresponding event recognizer 180 receives event information (such as, event data 179) from event classifier 170, and carrys out identified event from event information.Event recognizer 180 comprises Event receiver 182 and event comparator 184.In certain embodiments, event recognizer 180 also at least comprises a following subgroup: metadata 183 and event transfer instruction 188 (optionally comprise subevent and transmit instruction).

Event receiver 182 receives event information from event classifier 170.Event information comprises the information about subevent, such as, touch or touch mobile.According to subevent, event information also comprises other information, the position of such as subevent.When subevent relates to the action of touch, event information optionally also comprises speed and the direction of subevent.In certain embodiments, event comprises equipment and rotates to another orientation (such as from an orientation, rotate to horizontal trend from machine-direction oriented, vice versa), and event information comprises the corresponding information of the current orientation (being also referred to as equipment attitude) about equipment.

Event information and predefined event or subevent define and compare by event comparator 184, and relatively determine event or subevent based on this or determine or the state of more new events or subevent.In certain embodiments, event comparator 184 comprises event definition 186.Event definition 186 comprises the definition (such as, predefined subevent sequence) of event, such as event 1 (187-1), event 2 (187-2) and other.In certain embodiments, the subevent in event 187 such as comprise touch start, touch terminate, touch mobile, touch and cancel and multiple point touching.In an example, the definition of event 1 (187-1) is the double-click on shown object.Such as, the first time that this double-click is included in the scheduled duration on shown object touches (touch start), the first time of scheduled duration lifts (touch and terminate), the second time of scheduled duration on this object be shown touches (touch and start) and the second time of scheduled duration is lifted (touch and terminate).In another example, the definition of event 2 (187-2) is the dragging on shown object.Such as, this dragging is included in lifting (touch and terminate) of movement on touch-sensitive display 112 of the touch (or contact) of the predefined duration on this shown object, this touch and this touch.In certain embodiments, event also comprises the information for one or more associated event handling procedure 190.

In certain embodiments, event definition 187 comprises the definition of the event for respective user interfaces object.In certain embodiments, event comparator 184 performs hit test, to determine which user interface object is associated with subevent.Such as, show on touch display 112 wherein in the application view of three user interface object, when touch being detected on touch-sensitive display 112, event comparator 184 performs hit test, to determine that in these three user interface object, which is associated with this touch (subevent).If each shown object is associated with corresponding button.onrelease 190, then event comparator use this hit to test result to determine which button.onrelease 190 should be activated.Such as, event comparator 184 selects the button.onrelease that is associated with the triggering object tested of this hit and subevent.

In certain embodiments, the definition of corresponding event 187 also comprises delay voltage, and delay voltage postpones the transmission of event information, until determined whether subevent sequence corresponds to the event type of event recognizer really.

When corresponding event recognizer 180 determine subevent string not with any event matches in event definition 186, then this corresponding event recognizer 180 enter event can not, event failure or event done state, then it ignores this based on the follow-up subevent of gesture touched.In this case, other event recognizer (if any) for hit view maintenance activity continues the subevent following the tracks of and process the ongoing gesture based on touching.

In certain embodiments, corresponding event recognizer 180 comprise have instruction event transfer system should how to perform the subevent of the active event recognizer related to is transmitted the attribute that can configure, mark and/or list metadata 183.In certain embodiments, how alternately or the attribute that can configure how can be mutual, mark and/or list metadata 183 comprises instruction event recognizer each other.In certain embodiments, metadata 183 comprises instruction subevent and whether is passed to the attribute that can configure of the level changed in view or sequencing hierarchy, mark and/or list.

In certain embodiments, when one or more particular child events of event are identified, corresponding event recognizer 180 activates the button.onrelease 190 be associated with event.In certain embodiments, the event information be associated with this event is delivered to button.onrelease 190 by corresponding event recognizer 180.Activate button.onrelease 190 and be different from transmission (sending with extension) subevent to hitting view accordingly.In certain embodiments, event recognizer 180 is dished out the mark be associated with identified event, and the button.onrelease 190 be associated with this mark is received this mark and performs predefined process.

In certain embodiments, event transfer instruction 188 comprises transmission does not activate button.onrelease subevent transmission instruction about the event information of subevent.On the contrary, subevent is transmitted instruction and event information is delivered to the button.onrelease of go here and there with subevent and being associated or is delivered to the view enlivening and relate to.The button.onrelease of going here and there with subevent or be associated with the active view related to receives event information, and performs predetermined process.

In certain embodiments, Data Update device 176 creates and upgrades the data used in application program 136-1.Such as, Data Update device 176 upgrades the telephone number used in contact module 137, or is stored in the video file used in video player module 145.In certain embodiments, object renovator 177 creates and upgrades the object used in application program 136-1.Such as, object renovator 176 creates new user interface object, or upgrades the position of user interface object.GUI renovator 178 upgrades GUI.Such as, GUI renovator 178 prepares display information, and display information is sent to figure module 132 in order to display on the touch sensitive display.

In certain embodiments, button.onrelease 190 comprises or has the access rights to data renovator 176, object renovator 177 and GUI renovator 178.In certain embodiments, Data Update device 176, object renovator 177 and GUI renovator 178 are included in the individual module of corresponding application programs 136-1 or application view 191.In other embodiments, they are included in two or more software modules.

Should be appreciated that the discussion of the above-mentioned event handling about the user's touch on touch-sensitive display is also applicable to user's input of other form utilizing input equipment operating multifunction equipment 100, not all user's input is initiated all on the touchscreen.Such as, optionally press or pin the mouse cooperated to move press with mouse button with single or multiple keyboard; Contact on Trackpad is moved, and such as touches, pulls, rolling etc.; Stylus inputs; The movement of equipment; Spoken command; The eyes detected move; Bio-identification inputs; And/or their any combination is optionally used as the input corresponding to the subevent limiting the event that will identify.

Fig. 2 shows a kind of portable multifunction device 100 with touch-screen 112 according to some embodiments.Touch-screen optionally shows one or more figure in user interface (UI) 200.In this embodiment, and in other embodiment introduced hereinafter, user can by such as with one or more finger 202 (in the accompanying drawings not in proportion draw) or with one or more stylus 203 (not drawing in proportion in the accompanying drawings) on figure, make that gesture selects in these figures one or more.In certain embodiments, when user interrupts the contact with this one or more figure, there is the selection to one or more figure.In certain embodiments, gesture optionally comprises that one or many touches, one or many gently sweeps (from left to right, from right to left, up and/or down) and/or the finger that contacted with equipment 100 stirs (from right to left, from left to right, up and/or down).In some are specifically implemented or in some cases, inadvertently figure can not be selected with pattern contact.Such as, when with select corresponding gesture be touch time, what sweep on application icon gently sweeps gesture and optionally can not select corresponding application program.

Equipment 100 optionally also comprises one or more physical button, such as " main screen " or menu button 204.As previously mentioned, menu button 204 is optionally for navigating to any application program 136 in one group of application program being optionally performed on the appliance 100.Or in certain embodiments, menu button is implemented as the soft key in the GUI be presented on touch-screen 112.

In one embodiment, equipment 100 comprises touch-screen 112, menu button 204, push button 206, (one or more) volume knob 208, subscriber identity module (SIM) draw-in groove 210, earphone jack 212 and docking/charging external port one 24 for facility switching machine and locking device.Push button 206 is optionally for reaching the predefined time interval and carry out switching on and shutting down by depressing this button and this button being remained on depressed state to equipment; Locking device is carried out by depressing this button and discharged this button before passing through this predefined time interval; And/or unlocker device or initiate releasing process.Alternative embodiment in, equipment 100 also by microphone 113 accept for activate or some function of deactivation speech input.Equipment 100 also optionally comprises one or more contact strength sensors 165 of the intensity for detecting the contact on touch-screen 112, and/or for generating one or more sense of touch output generators 167 that sense of touch exports for the user of equipment 100.

Fig. 3 is the block diagram with the exemplary multifunctional equipment of display and Touch sensitive surface according to some embodiments.Equipment 300 needs not to be portable.In certain embodiments, equipment 300 is laptop computer, desk-top computer, panel computer, multimedia player device, navigator, educational facilities (such as children for learning toy), games system or opertaing device (such as, family expenses or industrial controller).Equipment 300 generally includes one or more processing unit (CPU) 310, one or more network or other communication interface 360, storer 370 and for making one or more communication bus 320 of these component connection.Communication bus 320 optionally comprises makes system component interconnect and the Circuits System (being sometimes called chipset) of communication between control system parts.Equipment 300 comprises I/O (I/O) interface 330, and this interface 330 comprises the display 340 of normally touch-screen display (such as, touch-screen display 112).I/O interface 330 also optionally comprises keyboard and/or mouse (or other sensing equipment) 350 and Trackpad 355, for generating sense of touch output generator 357 that sense of touch exports (such as on equipment 300, be similar to the above sense of touch output generator 167 with reference to described in Figure 1A), sensor 359 (such as, optical sensor, acceleration transducer, proximity transducer, touch-sensitive sensors and/or be similar to the above contact strength sensor with reference to the contact strength sensor 165 described in Figure 1A).Storer 370 comprises high-speed random access memory, such as DRAM, SRAM, DDR RAM or other random access solid state memory devices; And optionally comprise nonvolatile memory, such as one or more disk storage device, optical disc memory apparatus, flash memory device or other non-volatile solid-state memory devices.Storer 370 optionally comprises one or more memory devices of locating away from CPU 310.In certain embodiments, program, module and data structure that the program, module and the data structure that store in the storer 102 of storer 370 storage and portable multifunction device 100 (Figure 1A) are similar, or their subgroup.In addition, storer 370 is optionally stored in non-existent other program, module and data structure in the storer 102 of portable multifunction device 100.Such as, the storer 370 of equipment 300 optionally stores picture module 380, display module 382, word processing module 384, website creation module 386, dish editor module 388 and/or electrical form module 390, and the storer 102 of portable multifunction device 100 (Figure 1A) does not optionally store these modules.

Each of element above-mentioned identified in Fig. 3 is optionally stored in one or more previously mentioned memory devices.Each of above-mentioned identified module is corresponding to one group of instruction for performing above-mentioned functions.Above-mentioned identified module or program (that is, instruction set) need not be implemented as independent software program, process or module, and therefore each seed group of these modules is optionally combined in various embodiments or otherwise rearranges.In certain embodiments, storer 370 optionally stores the subgroup of above-mentioned module and data structure.In addition, the other module that do not describe above optionally storing of storer 370 and data structure.

Now notice is forwarded to the embodiment of the user interface (" UI ") optionally realized on portable multifunction device 100.

Fig. 4 A shows a kind of exemplary user interface for the application menu on the portable multifunction device 100 according to some embodiments.Similar user interface optionally realizes on equipment 300.In certain embodiments, user interface 400 comprises following element or its subgroup or superset:

The S meter 402 of radio communication (such as cellular signal and Wi-Fi signal);

Time 404;

Bluetooth indicator 405;

Battery Status Indicator 406;

There is conventional application program image target pallet 408, icon such as:

The icon 416 of the mark " phone " of zero phone module 138, this icon 416 optionally comprises the indicator 414 of the quantity of missed call or tone information;

The icon 418 of the mark " mail " of zero email client module 140, this icon 418 optionally comprises the indicator 410 of the quantity not reading Email;

The icon 420 of the mark " browser " of zero browser module 147; With

The icon 422 of the mark " iPod " of zero video and musical player module 152 (being also called iPod (trade mark of Apple Inc.) module 152); And

The icon of other application program, icon such as:

The icon 424 of the mark " text " of zero IM module 141;

The icon 426 of the mark " calendar " of zero calendaring module 148;

The icon 428 of the mark " photograph " of zero image management module 144;

The icon 430 of the mark " camera " of zero camera model 143;

The icon 432 of the mark " music libraries " of zero music libraries module 155;

The icon 434 of the mark " stock market " of zero stock market desktop small routine 149-2;

The icon 436 of the mark " map " of zero mapping module 154;

The icon 438 of the mark " weather " of zero weather desktop small routine 149-1;

The icon 440 of the mark " clock " of zero alarm clock desktop small routine 149-4;

The icon 442 of the mark " Internet radio " of zero Internet radio module 142;

The icon 444 of the mark " notepaper " of zero notepaper module 153; And

Zero icon 446 that application program or module be set, this icon 446 provides the access of the setting to equipment 100 and various application program 136 thereof;

It should be pointed out that the icon label shown in Fig. 4 A is only exemplary.Such as, the icon 422 of video and musical player module 152 is labeled " music " or " music player ".Other label is optionally for various application icon.In certain embodiments, the label of corresponding application programs icon comprises the title of the application program corresponding with this corresponding application programs icon.In certain embodiments, the label of application-specific icon is different from the title of the application program corresponding with this application-specific icon.

Fig. 4 B show have with display 450 (such as, touch-screen display 112) Touch sensitive surface 451 that separates is (such as, flat board in Fig. 3 or Trackpad 355) equipment (equipment 300 such as, in Fig. 3) on exemplary user interface.Equipment 300 also optionally comprises one or more contact strength sensors of the intensity for detecting the contact on Touch sensitive surface 451 (such as, one or more in sensor 357), and/or for generating one or more sense of touch output generators 359 that sense of touch exports for the user of equipment 300.

Although with reference to some in the example that the input on touch-screen display 112 (being wherein combined with Touch sensitive surface and display) provides subsequently, but in certain embodiments, input on the Touch sensitive surface that equipment Inspection and display separate, as shown in Figure 4 B.In certain embodiments, Touch sensitive surface (such as, in Fig. 4 B 451) has the main shaft (such as, in Fig. 4 B 452) corresponding with the main shaft (such as, 453 in Fig. 4 B) on display (such as, 450).According to these embodiments, equipment Inspection in the position corresponding with the relevant position on display (such as, in figure 4b, 460 correspond to 468 and 462 correspond to 470) contact (such as, 460 and 462 in Fig. 4 B) of place and Touch sensitive surface 451.Like this, at Touch sensitive surface (such as, in Fig. 4 B 451) when separating with the display (in Fig. 4 B 450) of multifunctional equipment, the user detected on Touch sensitive surface by equipment inputs (such as, contact 460 and 462 and their movement) by this equipment for handling the user interface on display.Should be appreciated that similar method optionally for other user interface as herein described.

In addition, although mainly with reference to finger input (such as, finger contact, finger tapping down gesture, finger gently sweep gesture) provide example below, but should be understood that, in certain embodiments, one or more in these finger inputs are substituted by the input (such as, inputting based on the input of mouse or stylus) from another input equipment.Such as, gently sweep that gesture optionally clicks (such as, instead of contact) by mouse, to be cursor afterwards substitute along the movement (such as, instead of the movement of contact) in the path of gently sweeping.And for example, mouse when Flick gesture is optionally positioned at by cursor on the position of Flick gesture is clicked (such as, instead of to the detection of contact, be termination detection contact afterwards) substitutes.Similarly, when detecting that multiple user inputs simultaneously, should be understood that, multiple computer mouse is optionally used simultaneously, or a mouse and multiple finger contact are optionally used simultaneously.

Fig. 5 shows the block diagram of a kind of operating environment 500 according to some embodiments.Operating environment 500 comprises server 510, one or more communication network 505, portable multifunction device 100 and external information display systems 540.In certain embodiments, external information display systems 540 is implemented in vehicle.

Server 510 generally includes one or more module for storing in execute store 524, program and/or instruction thus performs the processing unit (CPU) 512 of process operation, one or more network or other communication interface 520, storer 524 and for making one or more communication buss 522 of these component connection.Communication bus 522 optionally comprises makes system component interconnect and the Circuits System (being sometimes called chipset) of communication between control system parts.Storer 524 comprises high-speed random access memory, such as DRAM, SRAM, DDR RAM or other random access solid state memory devices, and can nonvolatile memory be comprised, such as one or more disk storage device, optical disc memory apparatus, flash memory device or other non-volatile solid-state memory devices.Storer 524 optionally comprises one or more memory devices of locating away from CPU 512.In storer 524 or storer 524, non-volatile memory devices alternatively comprises non-transitory computer readable storage medium.In certain embodiments, the computer-readable recording medium of storer 524 or storer 524 stores following program, module and data structure, or their subgroup:

Operating system 526, comprises for the treatment of the process of various basic system services and the process for performing the relevant task of hardware.And

Network communication module 528, for server 510 being connected to other computing equipment by one or more communications network interface 520 and one or more communication network 505 (wire or wirelessly), this one or more communication network 505 is such as internet, other wide area network, LAN (Local Area Network), Metropolitan Area Network (MAN) etc.

Portable multifunction device 100 generally includes with reference to the parts described by figure 1A-1B and/or Fig. 3.

External information display systems 540 generally includes one or more module for storing in execute store 554, program and/or instruction thus performs the processing unit (CPU) 542 of process operation, one or more network or other communication interface 550, storer 554 and for making one or more communication buss 552 of these component connection.External information display systems 540 optionally comprises user interface 546, this user interface 546 comprises display device 547 and control 548 (such as, machinery show can represent (affordance), button or knob, Touch sensitive surface such as touch-screen display or other input source).In certain embodiments, display 547 to receive the touch-screen display that user touches input.Communication bus 552 optionally comprises makes system component interconnect and the Circuits System (being sometimes called chipset) of communication between control system parts.Storer 554 comprises high-speed random access memory, such as DRAM, SRAM, DDR RAM or other random access solid state memory devices, and optionally comprise nonvolatile memory, such as one or more disk storage device, optical disc memory apparatus, flash memory device or other non-volatile solid-state memory devices.Storer 554 optionally comprises one or more memory devices of locating away from CPU 542.In storer 552 or storer 552, non-volatile memory devices alternatively comprises non-transitory computer readable storage medium.In certain embodiments, the computer-readable recording medium of storer 552 or storer 552 stores following program, module and data structure, or their subgroup:

Operating system 556, comprises for the treatment of the process of various basic system services and the process for performing the relevant task of hardware.And

Network communication module 558, for server 540 being connected to other computing equipment, this one or more communication network 505 such as internet, other wide area network, LAN (Local Area Network), Metropolitan Area Network (MAN) etc. by one or more communications network interface 550 and one or more communication network 505 (wire or wirelessly).

In certain embodiments, the display 547 of equipment 100 drive system 540.Such as, equipment 100 sends vision signal to system 540, and the CPU 542 of system 540 plays up this vision signal on display 547.In certain embodiments, equipment 100 sends vision signal directly to display 547, and CPU 542 is not used to play up this vision signal (such as, equipment 100 uses display 547 as secondary monitor).In certain embodiments, user interface shown on the touch-screen 112 of equipment 100 is synchronous with user interface shown on the display 547 of system 540, and in some other embodiments, the user interface of user interface shown on the touch-screen 112 of equipment 100 not with shown on the display 547 of system 540 is synchronous.In certain embodiments, system 540 sends to equipment 100 and corresponds to user's input (such as, user on display 547 touch input or input by the user of control 548) information, and equipment 100 according to received information update the equipment 100 touch-screen 112 on shown by user interface.

user interface and the process be associated

Now notice is forwarded to the embodiment of the user interface (" UI ") that above can realize at the electronic equipment (such as equipment 300 or portable multifunction device 100) with display and Touch sensitive surface and the process be associated.

Fig. 6 A-6C shows the exemplary user interface from the template generation used together with third party application according to some embodiments.User interface in these accompanying drawings is used to demonstrate the process introduced below, comprises the process in Fig. 7 A-7I.

Fig. 6 A shows user interface templates 601 shown on the display 547 of external information display systems 540.In certain embodiments, system 540 is included in (such as, in the panel board or bearing circle of vehicle) in vehicle.In certain embodiments, display 547 is configured to receive the touch-screen display that user touches input.Fig. 6 A also show the multiple user interface object (being sometimes called " show and can represent " or " can select user interface object " in this article) comprising application tile hurdle 602, acquiescence master menu 604, customized menus 608, content choice view 606, campaign item hurdle 610 and exit button 612.In certain embodiments, user interface templates comprises less showing compared with shown in template 601 and can represent, to simplify user interface further and to prevent system for distraction of driver.

Fig. 6 B shows the example of the user interface generated from user interface templates 601 (such as, using together with Internet radio application program).Fig. 6 B shows display current application program (such as, Internet radio application program) title application tile hurdle 602, there is acquiescence control (such as, upwards, downwards, search, classification etc.) master menu 604, there is application-specific control (such as, filter collection, add current to corresponding to the collection of special function) customized menus 608 (such as, collection menu) and exit button 612.Fig. 6 B also show display for current application program selection option (such as, soft jazz station 103, Korea S's pop music radio station 105 etc.) content choice view 606 (such as, radio station is selected), and display is about the campaign item hurdle 610 of the information of the project (such as, Hard Rock music radio station 101) of current active.

Fig. 6 C shows the example of the user interface generated from user interface templates 601 (such as, using together with music libraries application program), and this user interface is different from the user interface generated from template 601 shown in Fig. 6 B.Fig. 6 C shows display current application program (such as, music libraries App) title application tile hurdle 602, there is acquiescence control (such as, upwards, downwards, search, classification etc.) master menu 604, there is application-specific control (such as, playlist 1, playlist 2 etc.) customized menus 608 (such as, user's playlist menu) and exit button 612.Fig. 6 C also show display for current application program selection option (such as, store song 103, store song 105 etc.) content choice view 606 (such as, song storehouse), and display is about the campaign item hurdle 610 of the information of the project (such as, storing song 101) of current active.

As shown in Fig. 6 B-6C, common template (such as, template 601 shown in Fig. 6 A) by the information retrieved from different third party applications is inserted in user interface templates 601, optionally be used to generate the different user interface (user interface for Internet radio application program such as, shown in Fig. 6 B is different from the user interface for music libraries application program shown in Fig. 6 C) for different third party applications.But, similarity is enjoyed at Fig. 6 B and the different user interface shown in Fig. 6 C, them are made to be easier to use and (such as, in both the user interfaces in Fig. 6 B and Fig. 6 C, can to represent be displayed in content choice view 606 for selecting showing of Playable content; And in both the user interfaces in Fig. 6 B and Fig. 6 C, the information about the current media play is displayed in campaign item hurdle 610).In addition, template optionally forces minimum size text, to guarantee that text shown in the user interface in Fig. 6 B and Fig. 6 C is easy to read.

Fig. 7 A-7I illustrates a kind of process flow diagram being provided for the method 700 of the user interface of third party application according to some embodiments.The method 700 is performed at electronic equipment (equipment 300 such as, in Fig. 3 or the portable multifunction device 100 in Figure 1A) place.In certain embodiments, electronic equipment comprises display and Touch sensitive surface.In certain embodiments, display is touch-screen display, and Touch sensitive surface over the display.In certain embodiments, display and Touch sensitive surface are what to separate.Certain operations in method 700 is optionally combined, and/or the order of certain operations is optionally changed.

As described below, method 700 is provided for the user interface alleviating the cognitive load of user when mutual with third party application of third party application, thus creates more effective man-machine interface.For battery-driven electronic equipment, enable user sooner and more effectively and user interface save electric power alternately and add battery charge between time.

This equipment receives the first display request that (702) show the user interface of the first third party application in the respective display of (by wired connection or wireless connections) that communicates with electronic equipment.Such as, this equipment from the control relevant to respective display or the control that is associated with electronic equipment receive correspond to activate for the application program launching icon of the first third party application input (such as, for the Flick gesture on the Internet radio icon 442 (Fig. 4 A) of Internet radio application program 142 (Figure 1A or Fig. 3), or for the Flick gesture on the music libraries icon 432 (Fig. 4 A) of music libraries application program 155 (Figure 1A or Fig. 3)).In certain embodiments, respective display is the display (such as, the touch-screen 112 of portable multifunction device 100) of this equipment.In certain embodiments, respective display is the display (display 547 of the external information display systems 540 such as, in Fig. 5) separated with equipment.

In response to receiving the first display request (704), equipment obtains (706) and is configured (or design) first user interface template for being used by multiple third party application; And this equipment from the first third party application request (710) for filling one or more values of first user interface template.In certain embodiments, first user interface template is (or uncorrelated) user interface templates that the general or application program used by multiple different application has nothing to do.Such as, in certain embodiments, this equipment obtains the user interface templates 601 shown in Fig. 6 A.

In certain embodiments, respective display is that (708) are from the display the visible vehicle information display of the pilot set of vehicle; And first user interface template is one of multiple predetermined user interface templates, the plurality of predetermined user interface templates is configured in user interface respective display generated for third party application, thus prevent system for distraction of driver (such as, the plurality of predetermined template has large font and some options that can easily select, and these options can be operated by driver and driver can not be made to divert attention from safe driving).Therefore, in certain embodiments, these predetermined user interface templates are used to make equipment can provide functional access to one or more third party application to user, some simultaneously maintenance the outward appearance of user interface shown in respective display control, so that the user interface guaranteeing in respective display to use simply and intuitively.

In certain embodiments, the value at the first third party application place is arranged the tree construction that (711) become to comprise multiple node, the plurality of node has predetermined characteristic and has tree relation (such as, father's relation or subrelation) with other nodes one or more in this tree construction.In certain embodiments, to the request of the one or more values for filling first user interface template comprise following in one or more: to returning the request of the value corresponding with the child list of the respective nodes of multiple node (such as, for corresponding to artistical node, child node corresponds to this artistical song or this artistical photograph album); To the request returning the value corresponding with the characteristic list of the respective nodes of multiple node; To providing the request of the content represented by respective nodes (such as, to the request providing the audio content corresponding with audio file, audio stream, video file, video flowing and/or playlist or broadcasting station, playlist or broadcasting station corresponding with the content of multiple different units); The request of the node listing inquired about providing match search (such as, to providing coupling one group of one or more search word and optionally connecting the request of list of artists, album list, list of songs, broadcasting station list, talking book list, blog list etc. of logical operator of search word); And the request to the action lists provided specific to the first third party application, these actions are (such as, " like ", " skipping ", " being added into collection ", " mark " or other dedicated operations) that can carry out when providing the access to the content be associated with the first third party application.In certain embodiments, the characteristic of respective nodes comprise following in one or more: the former figure of respective nodes, the identifier of respective nodes, the duration of the media content be associated with respective nodes, the title of respective nodes (title in the current track play or broadcasting station), the subtitle of respective nodes (such as, the artist of the current song play or the track in current broadcasting station of playing), the mark play whether instruction respective nodes can be play, the mark of broadcasting whether instruction respective nodes has been play, and/or whether instruction respective nodes is the Container Tag of the container with child node.

When the first third party application runs just on an electronic device, this equipment receives (712) for filling first class value (such as, receiving the name list in internet streaming broadcasting station) of first user interface template from the first third party application.Such as, Fig. 6 B shows the user interface templates 601 utilizing from title the data stuffing being the application program of " Internet radio application program ".

In certain embodiments, by the first third party application in response to the request to the one or more values for filling first user interface template, from remote source (such as, the server communicated with the first third party application, the server 510 in such as Fig. 5) one or more values in retrieval (713) first class values.Such as, when selecting streaming Internet broadcasting station for playing, first third party application initiates to send to remote server to start the request of transmitting streaming Internet broadcasting station as a stream, and asks the title of song and the artist of song that will play on streaming Internet broadcasting station and the former figure of corresponding photograph album.First third party application receives these values and these values is transferred to middle process, will be transferred in " playing now " user interface templates of respective display to be attached to this middle process.

In certain embodiments, this equipment comprises (714) and has the personal digital assistant process of speech recognition capabilities (such as, personal digital assistant 150, this personal digital assistant 150 records voice command and will represent that the information of voice command recorded is sent to server 510 in server, such as Fig. 5 for analysis, and responds to voice command based on the response from server).In certain embodiments, this equipment is based on the response of the multiple requests from the first third party application subtend third party application value request, determine the ability of (715) first third party applications, these values are associated (such as with the user interface templates of filling the user interface being used for respective display, personal digital assistant process traversal is used for the tree construction of the metadata of the first third party application, and maps out by the addressable various option of the first third party application and metadata).In certain embodiments, this equipment generates the index (such as, based on by the various option of the first third party application access and the mapping graph of metadata) of the ability of (716) first third party applications.In certain embodiments, this equipment provides (718) to the voice access of the ability of the first third party application (such as by personal digital assistant process, the display of internet streaming broadcasting station list that make user that voice command can be used asking the display of the list of songs of particular artist, to can be used for playing, the playback of the particular songs of particular artist, or search all over display advertising application program with the media of the search inquiry obtaining matches verbal and state).Such as, for streaming Internet radio application program, traversal is used for available streaming Internet broadcasting station and the tree construction of other metadata operated that can be performed by streaming Internet radio application program and sets up the index of the tree construction of this metadata by personal assistant.Subsequently, make user speech order can be provided starting to play broadcasting station to personal digital assistant, stop playing broadcasting station, create new broadcasting station based on current song, skip song or use relate to personal digital assistant voice command (such as, " assistant; artist X broadcasting station please be play ", " assistant; this song please be skip ", " assistant; please list last week create all broadcasting stations " or " assistant please mark this song as favorite ") carry out other operation.

In certain embodiments, whether this equipment Inspection (720) predetermined condition meets.In response to detecting that predetermined condition meets, this equipment redefine the ability of (721) first third party applications and the list regenerating the ability of the first third party application (such as, the index of the various options by the first third party application access is rebuild: this equipment is placed with and communicates with respective display (such as the display 547 of external information display systems 540 (Fig. 5)) when following situation, this equipment is connected to the vehicle information display comprising respective display, and/or one third party application be activated.) such as, for streaming Internet radio application program, the availability that the availability of streaming Internet broadcasting station optionally connects based on the internet for receiving streaming Internet broadcasting station is determined; Similarly, if user creates/subscribes to new broadcasting station or deletion/quit the subscription of old broadcasting station, the metadata be then associated with streaming Internet radio application program changes (such as, which broadcasting station is that node in tree construction and/or which broadcasting station can be play).In order to the metadata of the change at convection type Internet radio application program place addresses, this device periodically ground rebuilds the index of the metadata at streaming Internet radio application program place (such as, when streaming Internet radio application program is activated, maybe when this equipment is connected to vehicle information display).In certain embodiments, third party application notifies that certain part of personal digital assistant metadata has changed or upgraded on one's own initiative, and the index of this part pointing out personal digital assistant to rebuild the metadata of third party application (or all).The information changed in response to this part receiving metadata or third party application are activated next time, and personal digital assistant rebuilds the index of this part (or all) of the metadata of third party application.

This equipment utilization fills (722) first user interface template from the first class value that the first third party application receives.Such as, according to these embodiments, Fig. 6 B shows and utilizes from title is that the data stuffing of the third party application (such as, radio station selection, collection, radio present etc.) of " Internet radio application program " is to generate the user interface templates 601 of the user interface for third party application shown on display 547 in Fig. 6 C.

In certain embodiments, first user interface template is used by multiple different third party application, and the plurality of different third party application comprises (724) first third party applications and the second third party application.In certain embodiments, the value received from corresponding third party application is utilized to comprise to fill first user interface template: with to the predefined font size the user interface that respective display provides, to be inserted in being identified as by corresponding third party application the value belonging to first kind value in predefined region.For first user interface template, first kind information is identified as first kind value by the first third party application, and the Second Type information being different from first kind information is identified as first kind value by the second third party application.Such as, Fig. 6 B illustrates the user interface templates 601 utilizing the value relevant to Internet broadcasting station to fill, and Fig. 6 C illustrates the user interface templates 601 utilizing the value relevant to stored song to fill.According to these embodiments, Fig. 6 B and Fig. 6 C illustrates the user interface templates with same font size.

In certain embodiments, for first user interface template: the title identification (726) of the stations of content (such as, streaming Internet broadcasting station) of long-range generation is first kind value by the first third party application; And the title of predetermined playlist is identified as first kind value by the second third party application.In certain embodiments, predetermined playlist is different from streaming Internet broadcasting station, because predetermined playlist has preseting length and the content of this playlist selects this playlist for setting during broadcasting user, and streaming Internet broadcasting station is the continuous stream with the music not determining length, this continuous stream continue to listen to user the same long time and comprise long-range (such as, by computing machine according to the selection of music algorithm automatically, or by disc jockey, Disk Jockey or carry out irrelevant other people of action manually with the user by equipment) content selected.Such as, in Fig. 6 B-6C, this equipment for the Internet radio application program in Fig. 6 B (such as, as 142 in Figure 1A) title of streaming Internet broadcasting station is identified as first kind value (such as, description to play medium content item), and the title of song is identified as first kind value for the music libraries application program (such as, as 155 in Figure 1A) in Fig. 6 C by this equipment.

In certain embodiments, for first user interface template: the title identification (728) that the first third party application can be transmitted as a stream to the content (such as, music or other media content are transmitted as a stream by the program request of distributed data network such as internet) of this equipment is first kind value; And the title of the content (such as, language learning programs, talking book, music, blog etc.) stored on the device is identified as first kind value by the second third party application.

The first user interface template that this equipment use utilizes the first class value to fill generates (730) first user interface for the first third party application.Such as, Fig. 6 B illustrates the user interface from user interface templates 601 and the value generation from the reception of Internet radio application program.According to this example, Fig. 6 B illustrates: acquiescence master menu 604, this acquiescence master menu 604 comprises information button (such as, for returning the value of the characteristic list corresponding to respective nodes), activator button (such as, for providing the content represented by respective nodes), search button (node listing such as, for providing match search to inquire about); And there is the customized menus 608 of customization button (such as, for providing the action lists specific to the first third party application, these actions can carry out when providing the access to the content be associated with the first third party application).

In certain embodiments, this equipment comprises (732) multiple process, the plurality of process comprises: for running the first third party application process of the first third party application, and for one group of one or more middle process (such as, for the application program of integrating third-party application program and vehicle information display (such as navigating or entertainment systems) or other external information display system (the external information display systems 540 as in Fig. 5)) of the information between relaying respective display and the first third party application process.In certain embodiments, be generated by the middle process from one group of one or more middle process to the request of the one or more values for filling first user interface template; And first user interface is generated by the middle process from one group of one or more middle process.Such as, smart phone (such as, portable multifunction device 100 in Fig. 5) there is vehicle integration application 151 (such as, comprise the application program of one or more middle process), this vehicle integration application 151 controls vehicle (such as, automobile, truck, lorry etc.) in vehicle information display, thus this vehicle information display respective display (such as, the display 547 of the external information display systems 540 in Fig. 5) on user interface is provided, this user interface is such as mapping application program or music application.Smart phone also has one or more third party application, such as independently blog application program or streaming Internet radio application program, and the information from third party application is converted to the content for being presented at by vehicle integration application in the respective display of vehicle information display by vehicle integration application.

In certain embodiments, the first third party application is that (734) media present application program (Internet radio 142 such as, in Figure 1A).In certain embodiments, this equipment comprises first party application program, and this first party application program is that media present application program (video such as, in Figure 1A and musical player module 152); First party application program comprises first party user interface, multiple selectable the showing that the corresponding position of this first party user interface in this first party user interface has for asking media to present the execution of operation can represent and one or more content presents region (such as, for showing the region of the list of useable medium); And generate and be used for the first user interface of the first third party application and comprise: generate and comprise selectable showing and to represent and one or more content presents the user interface in region, selectable showing can represent and one or more content presents region and shows corresponding to first party user interface selectable in function and position and to represent and content presents region.Therefore, in certain embodiments, first user interface template is the template of the information conforms standardized user interface made from third party application, this standardized user interface has and is similar to first party media and presents the control of application program, content area and outward appearance, so that when being displayed on from the visible vehicle information display of the pilot set of vehicle, the consistent user interface providing user to be familiar with and therefore prevent system for distraction of driver.

This equipment sends (736) to respective display or otherwise provides the information (such as, portable multifunction device 100 provides information to the display 547 of the external information display systems 540 in Fig. 5) making can be displayed on for the first user interface of the first third party application in respective display.

In certain embodiments, when being displayed in respective display for the first user interface of the first third party application, this equipment from the input equipment for respective display (such as, the Touch sensitive surface overlapped with respective display, or for the button that controls respective display or knob) receive (738) corresponding input, this corresponding input corresponds to the selection of the option in first user interface (such as, selected option is for playing, suspend, search, the option showing new menu or perform specific to the operation of third party application, this operation is such as " liking ", " skip " or " being added into collection ").In response to receiving corresponding input, the information that this equipment provides (740) to make the first third party application can to respond to the selection of the option in first user interface to the first third party application run just on an electronic device.In certain embodiments, this equipment receives (742) from the response of the first third party application to the selection of option from the first third party application; And sending (744) to respective display or otherwise providing makes the response of the selection to option be provided (such as, showing) to the information of user.Such as, respective display is shown to user the list of streaming Internet broadcasting station title, user touches the title of corresponding streaming Internet broadcasting station (such as, on the touch-screen display of external information display systems 540 in Figure 5), this equipment (such as, portable multifunction device 100 in Fig. 5) the middle process at place provides instruction to select the information of corresponding streaming Internet broadcasting station to the first third party application, first third party application request server (such as, server 510 in Fig. 5) the former figure of corresponding streaming Internet broadcasting station is provided, title, subtitle and audio stream and subsequently to middle process (such as, portable multifunction device 100 place in Figure 5) this information is provided, this middle process generates user interface based on this information and user interface templates and generated user interface is transferred to respective display for display (such as, on the display 547 of external information display systems 540 in Figure 5).

In certain embodiments, communication in the middle of the first party at this equipment place between process transfer respective display in the following manner and the first third party application: convert the data from the first third party application to standardization, the driving that the user interface thus prevent simplified is diverted attention, and by the input that relaying is corresponding with the user interactions with the user interface be presented in respective display, first third party application can be responded to input, even if be not provided the size of instruction respective display at the first third party application, the information of resolution and other characteristic and when not there are the mutual direct access rights to user interface shown on user and respective display.Such as, third party application is not provided the time and position that touch input, but what information acquisition asks as the information of being filtered by process in the middle of first party about user.

In certain embodiments, when the first user interface of the first third party application is displayed on (746) in respective display, this equipment receives (748) instruction to the selection of respective selection in first user interface (such as, to container or the selection of node (such as comprising " artist " file of selected artistical song) with child node, or the selection to the particular interconnect net streaming broadcast radio station in multiple internet streaming broadcasting station) information.In certain embodiments, in response to receiving the information (750) of instruction to the selection of respective selection in first user interface: this equipment obtains (752) and is different from the second user interface templates of first user interface template (such as, for showing the template of the content of container, such as playlist template or " playing now " user interface templates); And from the first third party application request (754) for filling one or more values of the second user interface templates.In certain embodiments, when the first third party application runs just on an electronic device, this equipment receives (756) for filling the second class value of the second user interface templates (such as from the first third party application, for title and the reproduction time information of artist-song selected by playlist template, or for the former figure of the title in broadcasting station of the current broadcasting of " playing now " template, the title of the song of current broadcasting, the song of current broadcasting); The second class value received from the first third party application is utilized to fill (758) second user interface templates; By using the second user interface templates utilizing the second class value to fill, generate (760) for the first third party application the second user interface (such as, the title of selected artistical song and reproduction time information are inserted in playlist template, or the former figure of the title of the song of the title in the broadcasting station of current broadcasting, current broadcasting and the song of current broadcasting is inserted in " playing now " template, " should play now " control that template comprises the song for controlling the time-out/start/stop/F.F./current broadcasting that falls back); And sending (762) to respective display or otherwise provide makes the second user interface for the first third party application can be displayed on information in respective display.

In certain embodiments, after making to be displayed on the information in respective display for the first user interface of the first third party application to respective display transmission (764), this equipment receives (766) in respective display, show second the showing and ask of user interface (such as, receive the control using and be associated with respective display or the control that is associated with electronic equipment to the activation of the application program launching icon for the second third party application) for second third party application different from the first third party application.Such as, user initially play from internet streaming broadcast application 142 audio frequency (such as, use the user interface for streaming Internet radio application program shown in Fig. 6 B) time, user switches to the audio frequency play from independently blog application program or talking book application program.In certain embodiments, in response to receiving the second display request, this equipment from the second third party application request (768) for filling one or more values of first user interface template; When the second third party application runs just on an electronic device, receive (770) for filling the 3rd class value of first user interface template from the second third party application; The 3rd class value received from the second third party application is utilized to fill (772) first user interface template; The first user interface template utilizing the 3rd class value to fill is used to generate (774) second user interface for the second third party application; And sending (776) (or otherwise providing) to respective display makes the second user interface (user interface for music libraries application program 155 such as, shown in Fig. 6 C) for the second third party application be presented at information in respective display.Therefore, in certain embodiments, when asking the different third party application using identical first user interface template, this equipment repeats from third party application value request with the process of filling first user interface template.In the case, this process repeats, because first user interface template is designed or is configured to be used by multiple different third party application.

In certain embodiments, send to respective display make to be displayed on the information in respective display for the first user interface of the first third party application after (764): this equipment to receive from the first third party application (778) for fill first user interface template renewal after the first class value.In certain embodiments, in response to the first class value (780) after the renewal received for filling first user interface template, the first class value after the renewal that this equipment utilization receives from the first third party application fills (782) first user interface template; The first user interface template utilizing the first class value after upgrading to fill is used to generate (784) first user interface for the first third party application; And provide (786) to make the first user interface after the renewal of the first third party application can be displayed on information in respective display to respective display.In certain embodiments, the first class value after renewal is based on the first third party application place event and determines (such as, to the renewal of the user interface for the first third party application be by first third party application initiate, instead of initiated by middle process).Such as, third party application is streaming video application program, and the data cube computation of this equipment ceases to function.In response to detecting that data cube computation ceases to function, third party application is to the middle process transmission information at this equipment place, the instruction of this information was previously marked as " can play " (such as, when there is operational data and connecting) the state of flowing content change, this content is made to be " can not play " (such as, because data cube computation is no longer available).In certain embodiments, when content changes over " can not play " from " can play ", first user interface for the first third party application be updated to indicate this content be " can not play " (such as, by this content is removed from the list of Playable content, or by the contrast that reduces this displaying or show the outward appearance that " can not play " icon or symbol change the displaying of this content near the displaying of this content, to indicate, this content is not current to be play).Such as, in fig. 6b, if this equipment stops the access to the streaming Internet broadcasting station shown in content choice view 606, this equipment will regenerate the user interface shown in Fig. 6 B, to reflect the unavailability of streaming Internet broadcasting station (such as, icon can not be play by the title display adjacent to unavailable radio station, by reducing the contrast (making unavailable radio station " become ash ") in unavailable radio station, or by radio station is removed from content choice view 606).

Should be appreciated that to the concrete order of the operation be described in Fig. 7 A-7I be only exemplary, and not intended to be shows that described order is the but one sequence that can perform these operations.Those of ordinary skill in the art can expect that various mode is resequenced to operation as herein described.

According to some embodiments, Fig. 8 shows the functional block diagram of the first electronic equipment 800 of the principle configuration according to various described embodiment.The functional block of this equipment is optionally realized by the combination carrying out the hardware of principle of various described embodiment, software or hardware and software.It will be understood by those of skill in the art that the functional block described in Fig. 8 is optionally combined or is separated into sub-block, to realize the principle of various described embodiment.Therefore, the description of this paper is optionally supported any possible combination of functional block described herein or separation or limits further.

As shown in Figure 8, electronic equipment 800 comprises the storer being couple to processing unit 802.In certain embodiments, electronic equipment 800 also comprises communications interface unit 804, and this communications interface unit 804 is couple to processing unit 802 and is configured to communicate with respective display unit 806.In certain embodiments, processing unit 802 comprises receiving element 807, obtains unit 808, request unit 810, filler cells 812, Interface debond unit 814, transmitting element 816, information provider unit 818, determining unit 820, index generation unit 822, voice providing unit 824, detecting unit 826 and digital assistant unit 828.Processing unit 802 is configured to receive (such as, utilize receiving element 807 by communications interface unit 804) in the respective display unit communicated with electronic equipment 800, show first of the user interface (such as, utilizing respective display unit 806) of the first third party application show and ask.Processing unit 802 is further configured in response to receiving the first display request: obtain the first user interface template that (such as, utilize and obtain unit 808) is configured to be used by multiple third party application; And from the first third party application request (such as, utilizing request unit 810) for filling one or more values of first user interface template.Processing unit 802 is further configured to: when the first third party application runs just on an electronic device, (such as, utilizing receiving element 807 or communications interface unit 804) is received for filling the first class value of first user interface template from the first third party application; The first class value received from the first third party application is utilized to fill (such as, utilizing filler cells 812) first user interface template; The first user interface template utilizing the first class value to fill is used to generate (such as, utilizing Interface debond unit 814) first user interface for the first third party application; And sending (such as, utilizing transmitting element 816) to respective display unit makes the first user interface for the first third party application can be displayed on information in respective display unit (such as, respective display unit 806).

In certain embodiments, processing unit 802 is further configured to: when the first user interface for the first third party application is displayed on respective display unit (such as, respective display unit 806) upper time, (such as, utilizing receiving element 807 by communications interface unit 804) is received corresponding to the corresponding input to the selection of the option in first user interface from the input equipment for respective display unit; And in response to receiving corresponding input, to the information that the first third party application run just on an electronic device provides (such as, utilizing information provider unit 818) to make the first third party application can to respond to the selection of the option in first user interface.In certain embodiments, processing unit 802 is further configured to: receive (such as, utilizing receiving element 807 by communications interface unit 804) from the response of the first third party application to the selection of option from the first third party application; And send (such as, utilizing transmitting element 816) to respective display unit and make the information response of the selection of option being provided to user.

In certain embodiments, processing unit 802 is further configured to, when the first user interface for the first third party application is displayed on respective display unit (such as, respective display unit 806) upper time: receive the information of (such as, utilizing receiving element 807 by communications interface unit 804) instruction to the selection of respective selection in first user interface; And in response to receiving the information of instruction to the selection of respective selection in first user interface: obtain the second user interface templates that (such as, utilize and obtain unit 808) is different from first user interface template; And from the first third party application request (such as, utilizing request unit 810) for filling one or more values of the second user interface templates.In certain embodiments, processing unit 802 is further configured to: when the first third party application runs just on an electronic device, (such as, utilizing receiving element 807 by communications interface unit 804) is received for filling the second class value of the second user interface templates from the first third party application; The second class value received from the first third party application is utilized to fill (such as, utilizing filler cells 812) second user interface templates; (such as, utilizing Interface debond unit 814) second user interface for the first third party application is generated by using the second user interface templates utilizing the second class value to fill; And sending (such as, utilizing transmitting element 816) to respective display unit makes the second user interface for the first third party application can be displayed on information in respective display unit (such as, respective display unit 806).

In certain embodiments, processing unit 802 is further configured to: sending (such as to respective display unit, utilize transmitting element 816) make the first user interface for the first third party application can be displayed on respective display unit (such as, respective display unit 806) on information after, receive (such as, utilize receiving element 807 or communications interface unit 804) in respective display unit (such as, respective display unit 806) go up display for being different from the second display request of the user interface of the second third party application of the first third party application.In certain embodiments, processing unit 802 is further configured to: in response to receiving the second display request, from the second third party application request (such as, utilizing request unit 810) for filling one or more values of first user interface template; When the second third party application runs just on an electronic device, receive (such as, utilizing receiving element 807 by communications interface unit 804) for filling the 3rd class value of first user interface template from the second third party application; The 3rd class value received from the second third party application is utilized to fill (such as, utilizing filler cells 812) first user interface template; The first user interface template utilizing the 3rd class value to fill is used to generate (such as, utilizing Interface debond unit 814) second user interface for the second third party application; And sending (such as, utilizing transmitting element 816) to respective display unit makes the second user interface for the second third party application can be displayed on information in respective display unit (such as, respective display unit 806).

In certain embodiments, this equipment comprises multiple process, the plurality of process comprises: for running the first third party application process of the first third party application, and for one group of one or more middle process of the information between relaying respective display unit and the first third party application process; Generated by the middle process from one group of one or more middle process to the request of the one or more values for filling first user interface template; And first user interface is generated by the middle process from one group of one or more middle process.

In certain embodiments, by the first third party application in response to the request to the one or more values for filling first user interface template, the one or more values the first class value are retrieved from remote source.

In certain embodiments, respective display unit (such as, respective display unit 806) is from the display unit the visible vehicle information display of the pilot set of vehicle; And first user interface template is one of multiple predetermined user interface templates, the plurality of predetermined user interface templates is configured in user interface respective display unit generated for third party application, thus prevents system for distraction of driver.

In certain embodiments, first user interface template is used by multiple different third party application, and the plurality of different third party application comprises the first third party application and the second third party application; The value received from corresponding third party application is utilized to fill (such as, utilizing filler cells 812) first user interface template comprises: with the predefined font size in the user interface provided to respective display unit, is inserted in predefined region by being identified as the value belonging to first kind value by corresponding third party application; Further, for first user interface template: first kind information is identified as first kind value by the first third party application; And the Second Type information being different from first kind information is identified as first kind value by the second third party application.

In certain embodiments, for first user interface template: the title of the stations of content of long-range generation is identified as first kind value by the first third party application; And the title of predetermined playlist is identified as first kind value by the second third party application.

In certain embodiments, for first user interface template: the title that the first third party application can be continuously streamed to the content of this equipment is identified as first kind value; And the title of the content be stored on the device is identified as first kind value by the second third party application.

In certain embodiments, the value at the first third party application place is arranged to the tree construction comprising multiple node, and the plurality of node has predetermined characteristic and has tree relation with other nodes one or more in this tree construction; And to the request (such as, utilizing request unit 810) of the one or more values for filling first user interface template comprise following in one or more: to the request of the value of the child list returned corresponding to the respective nodes in multiple node; To the request of the value of the characteristic list returned corresponding to the respective nodes in multiple node; To the request providing the content represented by respective nodes; The request of the node listing inquired about providing match search; And the request to the action lists provided specific to the first third party application, these actions can carry out when providing the access to the content be associated with the first third party application.

In certain embodiments, the first third party application is that media present application program.In certain embodiments, equipment 800 comprises first party application program, and this first party application program is that media present application program; First party application program comprises first party user interface, and multiple selectable the showing that the corresponding position of this first party user interface in this first party user interface has for asking media to present the execution of operation can represent and one or more content presents region; And generate (such as, utilize Interface debond unit 814) comprise for the first user interface of the first third party application: generate and comprise selectable showing and to represent and one or more content presents the user interface in region, selectable showing can represent and one or more content presents region and shows corresponding to first party user interface selectable in function and position and to represent and content presents region.

In certain embodiments, processing unit 802 is further configured to, making the first user interface for the first third party application can be displayed on respective display unit (such as to respective display unit transmission, respective display unit 806) on information after: from the first third party application receive (such as, utilizing receiving element 807 by communications interface unit 804) for fill first user interface template renewal after the first class value; And, the first class value in response to after the renewal received for filling first user interface template: utilize the first class value after the renewal received from the first third party application to fill (such as, utilizing filler cells 812) first user interface template; The first user interface template utilizing the first class value after upgrading to fill is used to generate (such as, utilizing Interface debond unit 814) for the first user interface after the renewal of the first third party application; And provide (such as, utilizing information provider unit 818) to make the first user interface after the renewal of the first third party application can be displayed on information in respective display unit to respective display unit.

In certain embodiments, equipment 800 comprises the personal digital assistant process (such as, digital assistant unit 828) with speech recognition capabilities.In certain embodiments, processing unit 802 is further configured to: based on the response of the multiple requests from the first third party application subtend third party application value request, determine (such as, utilize determining unit 820) ability of the first third party application, these values are associated with the user interface templates of filling the user interface being used for respective display unit; Generate the index of the ability of (such as, utilizing index generation unit 822) first third party application; And provide (such as, utilizing voice providing unit 824) voice access to the ability of the first third party application by personal digital assistant process (such as, utilizing digital assistant unit 828).

In certain embodiments, processing unit 802 is further configured to: whether (such as, utilizing detecting unit 826) the predetermined condition of detection meets; Further, in response to detecting that predetermined condition meets: the ability redefining (such as, utilizing determining unit 820) the first third party application; And regenerate the index of the ability of (such as, utilizing index generation unit 822) first third party application.

Operation in above-mentioned information processing method realizes optionally by the one or more functional modules in operation information treating apparatus, this signal conditioning package is such as general processor (such as, as above relative to described by Figure 1A and Fig. 3) or the chip specific to application.

Operation described in above reference diagram 7A-7I is optionally realized by Figure 1A-1B or parts depicted in figure 8.Such as, receive operation 702 and 712, solicit operation 710, padding 722, generating run 730 and transmit operation 736 optionally to be realized by event classifier 170, event recognizer 180 and button.onrelease 190.Event monitor 171 in event classifier 170 detects the contact on touch-sensitive display 112, and event information is delivered to application program 136-1 by Event scheduler module 174.Event information and corresponding event are defined 186 and compare by the corresponding event recognizer 180 of application program 136-1, and determine the first contact of first position on Touch sensitive surface whether (or the orientation of this equipment whether) corresponding to predefined event or subevent, such as to the selection of the object in user interface or this equipment from an orientation to the rotation of another orientation.When corresponding predefined event or subevent being detected, event recognizer 180 activates and the button.onrelease 190 detecting that this event or subevent are associated.Button.onrelease 190 optionally uses or calling data renovator 176 or object renovator 177 upgrade application program internal state 192.In certain embodiments, button.onrelease 190 accesses corresponding GUI renovator 178 to upgrade the content of application program display.Similarly, those skilled in the art can know clearly how can realize other process based on the parts shown in Figure 1A-1B.

In order to the object explained, description is above described by reference to specific embodiment.But exemplary discussion is above not intended to be detailed, be also not intended to limit the invention to disclosed precise forms.According to instructing content above, a lot of modification and variations are all possible.Selecting and describing embodiment is to illustrate principle of the present invention and practical application thereof best, so that the present invention making others skilled in the art to use best thus to have the various amendments being suitable for conceived special-purpose and various described embodiment.

Claims (38)

1. a method, comprising:

Electronic equipment place having one or more processor and storer:

Be received in and the respective display that communicates with described electronic equipment show first of the user interface of the first third party application and show and ask;

In response to receiving described first display request:

Obtain the first user interface template being configured to be used by multiple third party application; And

From described first third party application, ask the one or more values for filling described first user interface template;

When described first third party application described electronic equipment run, receive the first class value for filling described first user interface template from described first third party application;

Described first class value received from described first third party application is utilized to fill described first user interface template;

The described first user interface template that use utilizes described first class value to fill generates the first user interface for described first third party application; And

The information making can be displayed on for the described first user interface of described first third party application in described respective display is sent to described respective display.

2. method according to claim 1, comprising:

When being displayed in described respective display for the described first user interface of described first third party application, receive from the input equipment for described respective display the corresponding input corresponded to the selection of the option described first user interface; And

In response to receiving described corresponding input, described first third party application run on described electronic equipment provides the information that described first third party application can be responded to the selection of the described option in described first user interface;

Receive from the described response of described first third party application to the selection of described option from described first third party application; And

Send to described respective display and make the information that can be provided to described user to the described response of the selection of described option.

3. method according to any one of claim 1 to 2, comprises when being displayed in described respective display for the described first user interface of described first third party application:

Receive the information of instruction to the selection of the respective selection in described first user interface; And

In response to receiving the described information of instruction to the described selection of the described respective selection in described first user interface:

Obtain the second user interface templates being different from described first user interface template; And

From described first third party application, ask the one or more values for filling described second user interface templates;

When described first third party application described electronic equipment run, receive the second class value for filling described second user interface templates from described first third party application;

Described second class value received from described first third party application is utilized to fill described second user interface templates;

Described second user interface templates that use utilizes described second class value to fill generates the second user interface for described first third party application; And

Sending to described respective display makes described second user interface for described first third party application can be displayed on information in described respective display.

4. according to the method in any one of claims 1 to 3, being included in send to described respective display makes after the described first user interface of described first third party application can be displayed on the described information in described respective display:

Be received in the second display request of the user interface described respective display showing the second third party application for being different from described first third party application;

In response to receiving described second display request, from described second third party application, ask the one or more values for filling described first user interface template;

When described second third party application described electronic equipment run, receive the 3rd class value for filling described first user interface template from described second third party application;

Described 3rd class value received from described second third party application is utilized to fill described first user interface template;

The described first user interface template that use utilizes described 3rd class value to fill generates the second user interface for described second third party application; And

Sending to described respective display makes described second user interface for described second third party application can be displayed on information in described respective display.

5. method according to any one of claim 1 to 4, wherein:

Described equipment comprises multiple process, described multiple process comprises: for running the first third party application process of described first third party application, and for one group of one or more middle process of respective display described in relaying and the information between described first third party application process;

Generated by the middle process from described one group of one or more middle process to the described request of the described one or more value for filling described first user interface template; And

Described first user interface is generated by the middle process from described one group of one or more middle process.

6. method according to any one of claim 1 to 5, wherein by described first third party application in response to the described request to the one or more values for filling described first user interface template, from remote source retrieval described first class value one or more values.

7. method according to any one of claim 1 to 6, wherein:

Described respective display is from the display the visible vehicle information display of the pilot set of vehicle; And

Described first user interface template is one of multiple predetermined user interface templates, described multiple predetermined user interface templates is configured in the user interface described respective display generated for described first third party application, and it prevents described system for distraction of driver.

8. method according to any one of claim 1 to 7, wherein:

Described first user interface template is used by multiple different third party application, and described multiple different third party application comprises described first third party application and the second third party application;

Utilize the value received from corresponding third party application to fill described first user interface template to comprise: with the predefined font size the user interface provided to described respective display, insert in predefined region by being identified as by described corresponding third party application the value belonging to first kind value; And

For described first user interface template:

First kind information is identified as described first kind value by described first third party application; And

The Second Type information being different from described first kind information is identified as described first kind value by described second third party application.

9. method according to claim 8, wherein for described first user interface template:

The title of the stations of content of long-range generation is identified as described first kind value by described first third party application; And

The title of predetermined playlist is identified as described first kind value by described second third party application.

10. method according to claim 8, wherein for described first user interface template:

The title that described first third party application can be continuously streamed to the content of described equipment is identified as described first kind value; And

The title of the content stored on said device is identified as described first kind value by described second third party application.

11. methods according to any one of claim 1 to 10, wherein:

Be arranged in the value at described first third party application place the tree construction comprising multiple node, described multiple node has predetermined characteristic and has tree relation with other nodes one or more in described tree construction; And

To the described request of the one or more values for filling described first user interface template comprise following in one or more:

Return the request of the value of the child list corresponding to the respective nodes in described multiple node;

Return the request of the value of the characteristic list corresponding to the respective nodes in described multiple node;

The request of the content represented by described respective nodes is provided;

The request of the node listing providing match search to inquire about; And

There is provided the request of the action lists specific to described first third party application, described action can carry out when providing the access to the content be associated with described first third party application.

12. methods according to any one of claim 1 to 11, wherein:

Described first third party application is that media present application program;

Described equipment comprises first party application program, and described first party application program is that media present application program;

Described first party application program comprises first party user interface, and multiple selectable the showing that the corresponding position of described first party user interface in described first party user interface has for asking media to present the execution of operation can represent and one or more content presents region; And

Generate and be used for the described first user interface of described first third party application and comprise: generate and comprise selectable showing and to represent and one or more content presents the user interface in region, described selectable showing can represent and described one or more content presents region and shows corresponding to described first party user interface described selectable in function and position and to represent and described content presents region.

13. methods according to any one of claim 1 to 12, are making after the described first user interface of described first third party application can be displayed on the described information in described respective display sending to described respective display:

The first class value after the renewal that described first third party application receives for filling described first user interface template; And

The first class value in response to after the described renewal received for filling described first user interface template:

The first class value after the described renewal received from described first third party application is utilized to fill described first user interface template;

The described first user interface template using the first class value after utilizing described renewal to fill generates the first user interface after for the renewal of described first third party application; And

Thering is provided to described respective display makes the first user interface after the described renewal of described first third party application can be displayed on information in described respective display.

14. methods according to any one of claim 1 to 13, wherein:

Described equipment comprises the personal digital assistant process with speech recognition capabilities; And

Described method comprises:

Based on the response of the multiple requests from the first third party application value request described in described first third party application subtend, determine the ability of described first third party application, described value is associated with the user interface templates of filling the user interface being used for described respective display;

Generate the index of the described ability of described first third party application; And

By described personal digital assistant process, provide the voice access of the described ability to described first third party application.

15. methods according to claim 14, comprising:

Detect predetermined condition whether to meet; And

In response to detecting that described predetermined condition meets:

Redefine the described ability of described first third party application; And

Regenerate the described index of the described ability of described first third party application.

16. 1 kinds of electronic equipments, comprising:

One or more processor;

Storer; And

One or more program, wherein said one or more program is stored in which memory and is configured to be performed by described one or more processor, and described one or more program comprises instruction, and described instruction is used for:

Be received in and the respective display that communicates with described electronic equipment show first of the user interface of the first third party application and show and ask;

In response to receiving described first display request:

Obtain the first user interface template being configured to be used by multiple third party application; And

From described first third party application, ask the one or more values for filling described first user interface template;

When described first third party application described electronic equipment run, receive the first class value for filling described first user interface template from described first third party application;

Described first class value received from described first third party application is utilized to fill described first user interface template;

The described first user interface template that use utilizes described first class value to fill generates the first user interface for described first third party application; And

The information making can be displayed on for the described first user interface of described first third party application in described respective display is sent to described respective display.

The non-transitory computer readable storage medium of 17. 1 kinds of one or more programs of storage, described one or more program comprises instruction, and described instruction, when being performed by the electronic equipment with one or more processor and storer, makes described equipment:

Be received in and the respective display that communicates with described electronic equipment show first of the user interface of the first third party application and show and ask;

In response to receiving described first display request:

Obtain the first user interface template being configured to be used by multiple third party application; And

From described first third party application, ask the one or more values for filling described first user interface template;

When described first third party application described electronic equipment run, receive the first class value for filling described first user interface template from described first third party application;

Described first class value received from described first third party application is utilized to fill described first user interface template;

The described first user interface template that use utilizes described first class value to fill generates the first user interface for described first third party application; And

The information making can be displayed on for the described first user interface of described first third party application in described respective display is sent to described respective display.

18. 1 kinds of electronic equipments, comprising:

The respective display communicated with described electronic equipment shows first of the user interface of the first third party application show the device of asking for being received in;

In response to receiving described first display request for the device of following operation:

Obtain the first user interface template being configured to be used by multiple third party application; And

From described first third party application, ask the one or more values for filling described first user interface template;

For when described first third party application described electronic equipment run, receive the device of the first class value for filling described first user interface template from described first third party application;

For utilizing described first class value received from described first third party application to fill the device of described first user interface template;

For the device using the described first user interface template utilizing described first class value to fill to generate the first user interface for described first third party application; And

The device that can be displayed on the information in described respective display for the described first user interface of described first third party application is made for sending to described respective display.

19. 1 kinds, for the signal conditioning package used in the electronic device, comprising:

The respective display communicated with described electronic equipment shows first of the user interface of the first third party application show the device of asking for being received in;

In response to receiving described first display request for the device of following operation:

Obtain the first user interface template being configured to be used by multiple third party application; And

From described first third party application, ask the one or more values for filling described first user interface template;

For when described first third party application described electronic equipment run, receive the device of the first class value for filling described first user interface template from described first third party application;

For utilizing described first class value received from described first third party application to fill the device of described first user interface template;

For the device using the described first user interface template utilizing described first class value to fill to generate the first user interface for described first third party application; And

The device that can be displayed on the information in described respective display for the described first user interface of described first third party application is made for sending to described respective display.

20. 1 kinds of electronic equipments, comprising:

One or more processor;

Storer; And

One or more program, wherein said one or more program is stored in which memory and is configured to be performed by described one or more processor, and described one or more program comprises the instruction for performing according to any one in the method described in claim 1 to 15.

The computer-readable recording medium of 21. 1 kinds of one or more programs of storage, described one or more program comprises instruction, and described instruction, when being performed by electronic equipment, makes described equipment perform according to any one in the method described in claim 1 to 15.

22. 1 kinds of electronic equipments, comprising:

For performing the device according to any one in the method described in claim 1 to 15.

23. 1 kinds, for the signal conditioning package used at electronic equipment, comprising:

For performing the device according to any one in the method described in claim 1 to 15.

24. 1 kinds of electronic equipments, comprising:

Storer; And

Be couple to the processing unit of described storer, described processing unit is configured to:

Be received in and the respective display unit that communicates with described electronic equipment show first of the user interface of the first third party application and show and ask;

In response to receiving described first display request:

Obtain the first user interface template being configured to be used by multiple third party application; And

From described first third party application, ask the one or more values for filling described first user interface template;

When described first third party application described electronic equipment run, receive the first class value for filling described first user interface template from described first third party application;

Described first class value received from described first third party application is utilized to fill described first user interface template;

The described first user interface template that use utilizes described first class value to fill generates the first user interface for described first third party application; And

The information making can be displayed on for the described first user interface of described first third party application in described respective display unit is sent to described respective display unit.

25. electronic equipments according to claim 24, wherein said processing unit is further configured to:

When being displayed in described respective display unit for the described first user interface of described first third party application, receive from the input equipment for described respective display unit the corresponding input corresponded to the selection of the option described first user interface; And

In response to receiving described corresponding input, described first third party application run on described electronic equipment provides the information that described first third party application can be responded to the selection of the described option in described first user interface;

The described response from the selection to described option of described first third party application is received from described first third party application; And

Send to described respective display unit and make the information that can be provided to described user to the described response of the selection of described option.

26. electronic equipments according to any one of claim 24 to 25, wherein said processing unit is further configured to, when being displayed in described respective display unit for the described first user interface of described first third party application:

Receive the information of instruction to the selection of the respective selection in described first user interface; And

In response to receiving the described information of instruction to the described selection of the described respective selection in described first user interface:

Obtain the second user interface templates being different from described first user interface template; And

From described first third party application, ask the one or more values for filling described second user interface templates;

When described first third party application described electronic equipment run, receive the second class value for filling described second user interface templates from described first third party application;

Described second class value received from described first third party application is utilized to fill described second user interface templates;

Described second user interface templates utilizing described second class value to fill by use generates the second user interface for described first third party application; And

Sending to described respective display unit makes described second user interface for described first third party application can be displayed on information in described respective display unit.

27. electronic equipments according to any one of claim 24 to 26, wherein said processing unit is further configured to, and is making after the described first user interface of described first third party application can be displayed on the described information in described respective display unit to described respective display unit transmission:

Be received in the second display request of the user interface described respective display unit showing the second third party application for being different from described first third party application;

In response to receiving described second display request, from described second third party application, ask the one or more values for filling described first user interface template;

When described second third party application described electronic equipment run, receive the 3rd class value for filling described first user interface template from described second third party application;

Described 3rd class value received from described second third party application is utilized to fill described first user interface template;

The described first user interface template that use utilizes described 3rd class value to fill generates the second user interface for described second third party application; And

Sending to described respective display unit makes described second user interface for described second third party application can be displayed on information in described respective display unit.

28. electronic equipments according to any one of claim 24 to 27, wherein:

Described equipment comprises multiple process, described multiple process comprises: for running the first third party application process of described first third party application, and for one group of one or more middle process of respective display unit described in relaying and the information between described first third party application process;

Generated by the middle process from described one group of one or more middle process to the described request of the described one or more value for filling described first user interface template; And

Described first user interface is generated by the middle process from described one group of one or more middle process.

29. electronic equipments according to any one of claim 24 to 28, wherein by described first third party application in response to the described request to the one or more values for filling described first user interface template, from remote source retrieval described first class value one or more values.

30. electronic equipments according to any one of claim 24 to 29, wherein:

Described respective display unit is from the display unit the visible vehicle information display of the pilot set of vehicle; And

Described first user interface template is one of multiple predetermined user interface templates, described multiple predetermined user interface templates is configured in the user interface described respective display unit generated for described third party application, and it prevents system for distraction of driver.

31. electronic equipments according to any one of claim 24 to 30, wherein:

Described first user interface template is used by multiple different third party application, and described multiple different third party application comprises described first third party application and the second third party application;

Utilize the value received from corresponding third party application to fill described first user interface template to comprise: with the predefined font size the user interface provided to described respective display unit, insert in predefined region by being identified as by described corresponding third party application the value belonging to first kind value; And

For described first user interface template:

First kind information is identified as described first kind value by described first third party application; And

The Second Type information being different from described first kind information is identified as described first kind value by described second third party application.

32. electronic equipments according to claim 31, wherein for described first user interface template:

The title of the stations of content of long-range generation is identified as described first kind value by described first third party application; And

The title of predetermined playlist is identified as described first kind value by described second third party application.

33. electronic equipments according to claim 31, wherein for described first user interface template:

The title that described first third party application can be continuously streamed to the content of described equipment is identified as described first kind value; And

The title of the content be stored on said device is identified as described first kind value by described second third party application.

34. electronic equipments according to any one of claim 24 to 33, wherein:

Be arranged in the value at described first third party application place the tree construction comprising multiple node, described multiple node has predetermined characteristic and has tree relation with other nodes one or more in described tree construction; And

To the described request of the one or more values for filling described first user interface template comprise following in one or more:

Return the request of the value of the child list corresponding to the respective nodes in described multiple node;

Return the request of the value of the characteristic list corresponding to the respective nodes in described multiple node;

The request of the content represented by described respective nodes is provided;

The request of the node listing providing match search to inquire about; And

There is provided the request of the action lists specific to described first third party application, described action can carry out when providing the access to the content be associated with described first third party application.

35. electronic equipments according to any one of claim 24 to 34, wherein:

Described first third party application is that media present application program;

Described equipment comprises first party application program, and described first party application program is that media present application program;

Described first party application program comprises first party user interface, and multiple selectable the showing that the corresponding position of described first party user interface in described first party user interface has for asking media to present the execution of operation can represent and one or more content presents region; And

Generate and be used for the described first user interface of described first third party application and comprise: generate and comprise selectable showing and to represent and one or more content presents the user interface in region, described selectable showing can represent and described one or more content presents region and shows corresponding to described first party user interface described selectable in function and position and to represent and described content presents region.

36. electronic equipments according to any one of claim 24 to 35, wherein said processing unit is further configured to, and is making after the described first user interface of described first third party application can be displayed on the described information in described respective display unit to described respective display unit transmission:

The first class value after the renewal that described first third party application receives for filling described first user interface template; And

The first class value in response to after the described renewal received for filling described first user interface template:

The first class value after the described renewal received from described first third party application is utilized to fill described first user interface template;

The described first user interface template using the first class value after utilizing described renewal to fill generates the first user interface after for the renewal of described first third party application; And

Thering is provided to described respective display unit makes the first user interface after the described renewal of described first third party application can be displayed on information in described respective display unit.

37. electronic equipments according to any one of claim 24 to 36, wherein:

Described equipment comprises the personal digital assistant process with speech recognition capabilities; And

Described processing unit is further configured to:

Based on the response of the multiple requests from third party application value request described in described first third party application subtend, determine the ability of described first third party application, described value is associated with the user interface templates of filling the user interface being used for described respective display unit;

Generate the index of the described ability of described first third party application; And

By described personal digital assistant process, provide the voice access of the described ability to described first third party application.

38. according to electronic equipment according to claim 37, and wherein said processing unit is further configured to:

Detect predetermined condition whether to meet; And

In response to detecting that described predetermined condition meets:

Redefine the described ability of described first third party application; And

Regenerate the described index of the described ability of described first third party application.