CN104685470B - For the device and method from template generation user interface - Google Patents

Abstract

The invention discloses a kind of electronic equipment, which is configured as receiving the first request of the user interface for showing the first third party application in the respective display communicated with the equipment.Equipment is further configured to：In response to receiving the request, the first user interface templates for being configured as being used by multiple third party applications are obtained, and one or more values for filling first template are requested from first application program.Equipment is additionally configured to：When the first application program is just run in equipment, the first class value for filling the first template is received from the first application program；The first template is filled using the first class value；The first user interface for the first application program is generated using the first template filled using the first class value；And the information that the first user interface is shown is sent to respective display.

Description

For the device and method from template generation user interface

Cross reference to related applications

The priority for the U.S. Provisional Patent Application 61/832,841 that patent application claims are submitted on June 8th, 2013, and And it is related to following application：Entitled " the Voice and Touch User Interface's " submitted on March 15th, 2013 Application U.S. Serial No 61/793,924；Entitled " the Pushing a Graphical User submitted on 2 22nd, 2011 Interface to a Remote Device with Display Rules Provided by the Remote The Application U.S. Serial No 13/032,614 of Device "；Entitled " the Pushing a User submitted on January 6th, 2010 The Application U.S. Serial No 12/683,218 of Interface to a Remote Device "；On May 13rd, 2008 name submitted The referred to as Application U.S. Serial No 12/119,960 of " Pushing a User Interface to a Remote Device "； The U.S. Shen of entitled " the Pushing a User Interface to a Remote Device " that submits on July 1st, 2011 It please sequence number 13/175,581；Entitled " the Pushing a Graphical User submitted on June 15th, 2011 Interface to a Remote Device with Display Rules Provided by the Remote The Application U.S. Serial No 13/161,339 of Device "；On September 30th, the 2011 entitled " Automatically submitted The Application U.S. Serial No 13/250 of Adapting User Interfaces for Hands-Free Interaction ", 947；The U.S.Application Serial of entitled " the Intelligent Automated Assistant " that submits on January 10th, 2011 Number 12/987,982；The U.S. of entitled " the Intelligent Automated Assistant " that submits on January 18th, 2010 Provisional application Ser.No 61/295,774；Entitled " the Generating and Processing submitted on June 3rd, 2011 The U.S.Provisional Serial 61/493,201 of Data Items that Represent Tasks to Perform "； Entitled " the Automatically Adapting User Interface for Hands-Free submitted on June 9th, 2012 The U.S.Provisional Serial 61/657,744 of Interaction (for hands-free interactive automatic adaptation user interface) "；2008 The U.S.Provisional Serial 12/207,316 of entitled " the Radio with Personal DJ " that submits for September 9th；2012 Entitled " the System and Method for Negotiating Control of a Shared that on November 16, in submits The U.S.Provisional Serial 61/727,554 of Audio or Visual Resource "；On June 8th, 2013 name submitted The referred to as Application U.S. Serial No 61/832 of " Mapping Application with Several User Interfaces ", 818；Entitled " the Application Gateway for Providing Different User submitted on June 8th, 2013 The beauty of Interfaces for Limited Distraction and Non-Limited Distraction Contexts " State's patent application serial numbers 13/913,428；Entitled " Device, Method, the and Graphical that on June 8th, 2013 submits The U.S.Provisional Serial 61/ of User Interface for Synchronizing Two of More Displays " 832,842。

Technical field

Present invention relates generally to for generating user interface, the use for being used for third party application is including but not limited to provided The electronic equipment at family interface.

Background technique

Use in recent years significant growth of the touch sensitive surface as the input equipment of computer and other electronic computing devices. Exemplary touch sensitive surface includes Trackpad and touch-screen display.Such surface is widely used in associated with the first electronic equipment The first display on manipulate user interface object.

Exemplary manipulation includes：Adjust position and/or the size of one or more user interface objects；Activator button is beaten Open the file/application program indicated by user interface object；Or user interface is manipulated in other ways.Exemplary user interface pair As including digital picture, video, text, icon, control element such as button and other figures.

Equipment has first party (or the machine) device software sometimes, and (for example, operating system, which is used for by developing Equipment and application program that the same entity of the operating system is developed or developed on the direction of the same entity out) and the Software of the third party, third party software include the application program developed independently of first party (or the machine) device software.Third party answers It is loaded in sometimes with program in equipment to provide other functionality to equipment.

Summary of the invention

But the user interface of third party application is often customizing and/or dedicated.In addition, dedicated user interface It sometimes include too small so that being difficult to the text or control used safely when driving.In addition, being used for the difference of different application Customization and/or dedicated user interface the control with similar functions is placed in different location sometimes so that user will spend Take other time and attention to position these different controls and determine the function of these different controls.Therefore, have and be used for The different customizations and/or dedicated user interface of different application are troubles and inefficient.In addition, in some cases, this Time necessary to a little user interface the time it takes are manipulated than user is longer, to waste energy.This later regard is in electricity It is especially important in the equipment of pond driving.

Therefore, it is necessary to have faster, more effectively for providing the access to third party application and eliminating driving The electronic equipment for the method that member is diverted attention when using third party application.From the template being used together with third party application The legibility of user interface and the user interface of ease for use of the raising for interacting with third party application is generated to eliminate and drive The person of sailing diverts attention and improves user's efficiency.Such method optionally supplements or is substituted for generate user interface and offer pair The conventional method of the access of third party application.Such method alleviates the cognitive load of user, and generates one kind more Effective man-machine interface.For battery-driven equipment, such method saves power, and increase between battery charging when Between.

It is reduce or eliminated and the user interface phase for the electronic equipment with touch sensitive surface by disclosed equipment Associated drawbacks described above and other problems.In some embodiments, equipment is desktop computer.In some embodiments, equipment It is portable (for example, laptop, tablet computer or handheld device).In some embodiments, equipment has Trackpad. In some embodiments, equipment has touch-sensitive display (also referred to as " touch screen " or " touch-screen display ").In some realities It applies in example, there is equipment graphic user interface (GUI), one or more processors, memory and storage to use in memory In the one or more modules, program or the instruction set that execute multiple functions.In some embodiments, user mainly passes through touch-sensitive table Finger contact and gesture on face to interact with GUI.In some embodiments, these functions optionally include picture editting, draw Figure, word processing, webpage creation, disk editor, electrical form production, plays game, making and receiving calls, video conference, transmitting-receiving electricity at displaying Sub- mail, instant messaging, take exercise supports, digital photography, digital video record, web browsing, digital music broadcasting and/ Or digital video plays.Executable instruction for executing these functions, which is optionally included in, to be configured for by one or more In the non-transient computer readable storage medium of a processor execution or other computer program products.

According to some embodiments, a kind of side is executed at the electronic equipment with one or more processors and memory Method.This method includes：Receive the user that the first third party application is shown in the respective display communicated with electronic equipment The first display request at interface.In response to receiving the first display request, this method includes：Acquisition is configured as by multiple thirds The first user interface templates that square application program uses；And from the request of the first third party application for filling the first user One or more values of interface template.This method further includes：When the first third party application is just run on an electronic device, The first class value for filling the first user interface templates is received from the first third party application；It is answered using from the first third party The first user interface templates are filled with received first class value of program；Use the first user interface using the filling of the first class value Template generates the first user interface for the first third party application；And it is sent to respective display so that for the First user interface of one third party application can be displayed on the information in respective display.

According to some embodiments, electronic equipment includes memory and the processing unit for being couple to memory.Processing unit quilt It is configured to receive the user interface for showing the first third party application in the respective display unit communicated with electronic equipment First display request.Processing unit is additionally configured in response to receiving the first display request：Acquisition is configured as by multiple The first user interface templates that tripartite's application program uses；And it is used from the request of the first third party application for filling first One or more values of family interface template.Processing unit is additionally configured to：When the first third party application is just in electronic equipment When upper operation, the first class value for filling the first user interface templates is received from the first third party application；Using from One third party application received first class value fills the first user interface templates；Using utilizing the of the filling of the first class value One user interface templates generate the first user interface for the first third party application；And it is sent out to respective display unit Send the information that the first user interface for the first third party application is displayed in respective display unit.

According to some embodiments, electronic equipment includes one or more processors, memory and one or more programs；One A or multiple programs are stored in memory and are configured as being performed by one or more processors, and one or more Program includes the instruction for executing the operation of any method described herein.According to some embodiments, non-transient computer can Storage medium store instruction wherein is read, when being executed by electronic equipment, these are instructed so that the equipment executes any this paper institute The operation for the method stated.According to some embodiments, electronic equipment includes the operation for executing any method described herein Device.It include for executing any for the information processing unit used in the first electronic equipment according to some embodiments The device of the operation of method described in text.

Therefore, the electronic equipment with display, which has, faster, is more effectively used for third party application for providing User interface to improve effect, the method for efficiency and user satisfaction of such equipment.Such method and interface can mend It fills or is substituted for generating the conventional method of user interface.

Detailed description of the invention

Various described embodiments for a better understanding of the present invention, it should refer to following reality in conjunction with the following drawings The explanation of example is applied, in the accompanying drawings, similar drawing reference numeral indicates corresponding part in all the appended drawings.

Figure 1A is the block diagram for showing the portable multifunction device in accordance with some embodiments with touch-sensitive display.

Figure 1B is the block diagram for showing the example components in accordance with some embodiments for event handling.

Fig. 2 shows the portable multifunction devices in accordance with some embodiments with touch screen.

Fig. 3 is the block diagram of the exemplary multifunctional equipment in accordance with some embodiments with display and touch sensitive surface.

Fig. 4 A shows one kind in accordance with some embodiments that the application menu is used on portable multifunction device Exemplary user interface.

Fig. 4 B shows in accordance with some embodiments for the multifunctional equipment with the touch sensitive surface separated with display A kind of exemplary user interface.

Fig. 5 is the block diagram for showing a kind of operating environment in accordance with some embodiments, in the operating environment, portable more function It can equipment and external information display systems and/or server communication.

Fig. 6 A-6C shows the exemplary user interface in accordance with some embodiments from template generation.

Fig. 7 A-7I is the flow chart for showing a kind of method from template generation user interface in accordance with some embodiments.

Fig. 8 is the functional block diagram of electronic equipment in accordance with some embodiments.

Specific embodiment

Many electronic equipments use graphic user interface.Many graphic user interfaces are custom designs, or specific to Each application program.Method and apparatus discussed below is by from the user interface being used together with third party application Template generation user interface and improve these methods.In some embodiments, user interface templates are by multiple and different applications The unrelated user interface templates of the general or application program that program uses.These user interfaces are shown on corresponding display 's.Help to make third party application using same common user interface template for multiple and different third party applications User interface standard.This is standardized in while still provide functional access to third party application for user, Keep third party application more intuitive and is easier and is more convenient to interact therewith.

These templates are specifically helpful in a case where：Equipment is in the information display system of the device external Access of the upper offer to third party application, such as smart phone, the smart phone are passing through the touch screen display in automobile Show that device provides the access to the third party application on the smart phone.Information display system optionally has display, should Display has one of multiple and different operating characteristic collection (for example, display size, Control Cooling etc.).In some embodiments, phase Answering display is the display in vehicle information display, the display be it is visible from the pilot set of vehicle, so as to Improve third party application by vehicle driver and/or the ease for use that uses of passenger.

In the following, Figure 1A -1B, Fig. 2 and Fig. 3 provide the description to example devices.Fig. 4 A-4B and 6A-6C show from The exemplary user interface of template generation.Fig. 7 A-7I is to show a kind of user interface for providing and being used for third party application The flow chart of method.Fig. 8 is the functional block diagram of electronic equipment.User interface in Fig. 6 A-6C is used to illustrate the mistake in Fig. 7 A-7I Journey.

Example devices

Reference will now be made in detail to embodiment, the example of these embodiments is shown in the accompanying drawings.It is retouched in detail in following Many details are shown in stating, and are fully understood in order to provide to various described embodiments.But to this field Those of ordinary skill is evident that, various described embodiments can without these specific details by Practice.In other cases, well-known method, process, component, circuit and network are not described in detail, thus will not Unnecessarily make the aspect of embodiment hard to understand.

Although it is each to will be further understood that term " first ", " second " etc. are used to describe herein in some embodiments Kind element, but these elements should not be limited by these terms.These terms are used only to an element and another element It distinguishes.For example, the first contact can be named as the second contact, and similarly, the second contact can be named as first Contact, without departing from the range of various described embodiments.Both first contact and the second contact are all contacts, but they It is not same contact.

Term used in the description to various described embodiments is intended merely to description particular implementation herein The purpose of example, and be not intended to be limiting.Such as in various described embodiments description and the appended claims Used in as, singular "one", "an" and "the" be intended to also include plural form, unless context is clearly It is further noted that.It will be further understood that term "and/or" used herein refers to and covers the project listed in association In one or more projects any and all possible combinations.It will be further understood that term " includes " and/or "comprising" are worked as It is specified when using in the present specification in the presence of stated feature, integer, step, operation, element and/or component, but simultaneously One or more of the other feature, integer, step, operation, element, component and/or its grouping are not precluded the presence or addition of.

As used herein, based on context, term " if " be optionally interpreted to mean " and when ... when " or " ... when " or " in response to determination " or " in response to detecting ".Similarly, based on context, phrase " if it is determined that ... " Or " if detecting [condition or event stated] " be optionally interpreted to mean " when in determination ... " or " in response to Determine ... " or " when detecting [condition or event stated] " or " in response to detecting [the condition or thing stated Part] ".

Describe electronic equipment, for the user interface of such equipment and for using the associated of such equipment The embodiment of process.In some embodiments, equipment is also comprising other functions such as personal digital assistant and/or music The portable communication device of device function, such as mobile phone.The exemplary embodiment of portable multifunction device includes but unlimited In from Apple Inc (Cupertino, Califormia)iPodWithEquipment.Optionally Ground uses other portable electronic devices, such as with the above-knee of touch sensitive surface (for example, touch-screen display and/or Trackpad) Type computer or tablet computer.It is to be further understood that in some embodiments, equipment not instead of portable communication device, Desktop computer with touch sensitive surface (for example, touch-screen display and/or Trackpad).

In the following discussion, a kind of electronic equipment including display and touch sensitive surface is described.It should be appreciated, however, that Electronic equipment optionally includes one or more of the other physical user-interface device, such as physical keyboard, mouse and/or manipulation Bar.

Equipment usually supports a variety of application programs, such as one of following or a variety of：Picture application program shows application Program, word-processing application, webpage creation application program, disk editor application program, spreadsheet applications, game are answered With program, telephony application, videoconference application, email application, instant message application program, temper branch Hold application program, photograph management application program, digital camera applications program, digital video camcorder application program, web browsing Application program, digital music player application, and/or video frequency player application program.

The physical user-interface device that the various application programs executed in equipment optionally use at least one shared, it is all Such as touch sensitive surface.One or more functions of touch sensitive surface and the corresponding informance being shown in equipment are optionally from a kind of application Program adjusts and/or is changed to a kind of lower application program and/or is adjusted and/or changes in corresponding application programs.In this way, setting Standby shared physical structure (such as touch sensitive surface) is propped up optionally with intuitive for a user and clear user interface Hold various application programs.

Focusing on the embodiment of the portable device with touch-sensitive display.Figure 1A be show it is in accordance with some embodiments The block diagram of portable multifunction device 100 with touch-sensitive display 112.Touch-sensitive display 112 is sometimes for being conveniently called " touch screen ", and touch-sensitive display system is referred to alternatively as or is called sometimes.Equipment 100 includes that memory 102 (optionally includes One or more computer readable storage mediums), Memory Controller 122, one or more processing unit (CPU) 120, periphery Equipment interface 118, RF circuit system 108, audio circuitry 110, loudspeaker 111, microphone 113, input/output (I/O) Subsystem 106, other inputs or control equipment 116 and outside port 124.Equipment 100 optionally includes one or more optics Sensor 164.Equipment 100 optionally includes one or more intensity sensing of the intensity of the contact on detection device 100 Device 165 (for example, touch sensitive surface, touch-sensitive display system 112 of such as equipment 100).Equipment 100 is optionally included in equipment Generated on 100 tactile output one or more tactile output generators 167 (for example, in touch sensitive surface, such as equipment 100 Tactile output is generated on the Trackpad 355 of touch-sensitive display system 112 or equipment 300).These components are optionally by one or more Root communication bus or signal wire 103 communicate.

As used in the present specification and claims, " intensity " of the contact on term touch sensitive surface refers to touch-sensitive The power or pressure (power of per unit area) of contact (for example, finger contact) on surface, or refer to the contact on touch sensitive surface Power or pressure substitute (surrogate).The intensity of contact have value range, the value range include at least four different values simultaneously It and more typically include a different values up to a hundred (for example, at least 256).The intensity of contact optionally uses various methods and various The combination of sensor or sensor determines (or measurement).For example, below touch sensitive surface or adjacent to one of touch sensitive surface Or multiple force sensors are optionally for the power at the difference on measurement touch sensitive surface.In some embodiments, from multiple The power measured value of force snesor is merged (for example, weighted average) to determine the power of the contact of estimation.Similarly, the pressure of stylus Pressure of the quick top optionally for determining stylus on touch sensitive surface.Alternatively, the contact detected on touch sensitive surface The capacitor and/or its variation of the size of area and/or the touch sensitive surface of its variation, neighbouring contact, and/or neighbouring contact it is touch-sensitive The power for the contact that the resistance on surface and/or its variation are optionally used as on touch sensitive surface or the substitute of pressure.In some implementations In example, the substitute measured value of contact force or pressure, which is directly used in, determines whether to already exceed intensity threshold (for example, intensity threshold It is to be described with corresponding to the unit of substitute measured value).In some embodiments, the substitute measured value of contact force or pressure The power or pressure for being converted into the power or pressure of estimation, and estimating are used to determine whether to already exceed intensity threshold (for example, strong Degree threshold value is the pressure threshold measured with the unit of pressure).

As used in the specification and claims, term " tactile output " refers to the touching that will pass through user by user It is opposite relative to physical displacement, the component (for example, touch sensitive surface) of equipment of the previous position of equipment to touch the equipment that sense detects In the displacement relative to the mass center of equipment of physical displacement or component of another component (for example, shell) of equipment.For example, The component and user of equipment or equipment are to the surface (for example, other parts of finger, palm or the hand of user) for touching sensitivity In the case where contact, the tactile output generated by physical displacement will be read as sense of touch by user, which, which corresponds to, is perceived To equipment or part of appliance physical characteristic on variation.For example, touch sensitive surface (for example, touch-sensitive display or Trackpad) Mobile " pressing click " or " unclamp and click " being optionally read as by user to physical actuation button.In some cases, it uses Family will feel that sense of touch, such as " click be pressed " or " unclamp and click ", even if being physically pressed in the movement by user When the physical actuation button associated with touch sensitive surface of (for example, being shifted) does not move.For another example, the movement of touch sensitive surface is appointed " roughness " that selection of land is read as or is sensed by user as touch sensitive surface, even if when the smoothness of touch sensitive surface is unchanged.Though It is so such to be limited the individuation sensory perception by user by interpretation of the user to touch, but there are many sense organs touched to know Feel is that most users are shared.Therefore, when tactile output is described as the specific sensory perception corresponding to user (for example, " pressing Lower click ", " unclamp click ", " roughness ") when, unless otherwise stated, otherwise tactile output generated correspond to equipment or The physical displacement of its component, the physical displacement will generate the described sensory perception of typical (or common) user.

It should be appreciated that equipment 100 is an a kind of example of portable multifunction device, and equipment 100 is optionally With than shown more or fewer components, two or more components are optionally combined, or optionally there are these The different configurations of component or arrangement.Various parts shown in Figure 1A are realized with the combination of hardware, software or software and hardware, Including one or more signal processings and/or specific integrated circuit.

Memory 102 optionally includes high-speed random access memory, and also optionally includes nonvolatile memory, Such as one or more disk storage equipments, flash memory device or other non-volatile solid state memory equipment.Equipment 100 other components (such as CPU 120 and peripheral device interface 118) are to the access of memory 102 optionally by memory control Device 122 processed controls.

Peripheral device interface 118 can be used to that the peripheral equipment that outputs and inputs of equipment is couple to CPU 120 and is deposited Reservoir 102.The one or more processors 120 operation executes the various software programs stored in the memory 102 and/or refers to Collection is enabled, to execute the various functions and processing data of equipment 100.

In some embodiments, peripheral device interface 118, CPU 120 and Memory Controller 122 are optionally implemented On one single chip such as chip 104.In some other embodiments, they are optionally implemented on independent chip.

RF (radio frequency) circuit system 108 sends and receivees RF signal, is also designated as electromagnetic signal.RF circuit system 108 will Electric signal is converted to electromagnetic signal/by electromagnetic signal and is converted to electric signal, and via electromagnetic signal and communication network and other Communication apparatus communication.RF circuit system 108 optionally includes the well-known circuit system for executing these functions, including But be not limited to antenna system, RF transceiver, one or more amplifier, tuner, one or more oscillators, at digital signal Manage device, codec chip group, subscriber identity module (SIM) card, memory etc..RF circuit system 108 is optionally by wireless Communication is communicated with network and other equipment, all internets (also referred to as WWW (WWW)) in this way of network, Intranet and/or Wireless network (such as cellular phone network, WLAN (LAN) and/or Metropolitan Area Network (MAN) (MAN)).Wireless communication optionally uses Any one of a variety of communication standards, agreement and technology, including but not limited to global system for mobile communications (GSM), enhancing number According to gsm environment (EDGE), high-speed downlink packet access (HSDPA), High Speed Uplink Packet access (HSUPA), evolution, Clear data (EV-DO), HSPA, HSPA+, double unit HSPA (DC-HSPDA), long term evolution (LTE), near-field communication (NFC), width Band CDMA (W-CDMA), CDMA (CDMA), time division multiple acess (TDMA), bluetooth, Wireless Fidelity (Wi-Fi) (for example, IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and/or IEEE802.11n), internet protocol voice technology (VoiP), Wi-MAX, email protocol (for example, internet message access protocol (IMAP) and/or post office protocol (POP)), Instant message is (for example, scalable message is handled Presence Protocol (XMPP), sent out for instant message and scene using the session of extension Play agreement (SIMPLE), instant message and showing up service (IMPS)), and/or short message service (SMS) or other any fit When communication protocol, including this document submission date also it is untapped go out communication protocol.

Audio circuitry 110, loudspeaker 111 and microphone 113 provide the audio interface between user and equipment 100. Audio circuitry 110 receives audio data from peripheral device interface 118, and audio data is converted to electric signal, and by telecommunications Number it is transferred to loudspeaker 111.Loudspeaker 111 converts electrical signals to the audible sound wave of the mankind.Audio circuitry 110 also receives By microphone 113 according to sound wave conversion come electric signal.Audio circuitry 110 converts electrical signals to audio data, and will Audio data is transferred to peripheral device interface 118 to be handled.Audio data is optionally retrieved from by peripheral device interface 118 And/or it is transmitted to memory 102 and/or RF circuit system 108.In some embodiments, audio circuitry 110 further includes ear Wheat jack (for example, 212 in Fig. 2).Earphone jack is provided outside audio circuitry 110 and removable audio input/output Interface between peripheral equipment, the earphone or there is output (for example, monaural or bi-telephone) which such as only exports With the headset of both inputs (for example, microphone).

I/O subsystem 106 controls the input/output peripheral equipment in equipment 100, such as touch screen 112 and other inputs Control equipment 116 is couple to peripheral device interface 118.I/O subsystem 106 optionally includes display controller 156, optical sensing Device controller 158, intensity sensor controller 159, tactile feedback controller 161 and for other inputs or control equipment One or more input controllers 160.The one or more input controller 160 receives electricity from other input control apparatus 116 Signal/transmit the electrical signal to other input control apparatus 116.Other input control apparatus 116 optionally include physical button (example Such as, button, rocker buttons etc. are pushed), dial, slide switch, control stick, click type rotating disk etc..In some alternative implementations Example in, input controller 160 be optionally couple to (or being not coupled to) below any one：Keyboard, infrared port, USB port, With pointing device such as mouse.One or more buttons (for example, 208 in Fig. 2) optionally include for loudspeaker 111 and/ Or the up/down button of the volume control of microphone 113.One or more buttons, which optionally include, pushes button (for example, figure 206 in 2).

Touch-sensitive display 112 provides the input interface and output interface between equipment and user.Display controller 156 is from touching Screen 112 is touched to receive electric signal and/or send electric signal to touch screen 112.Touch screen 112 shows visual output to user.Vision Output optionally includes figure, text, icon, video and any combination of them (being referred to as " figure ").In some embodiments In, the visual output of some visual outputs or whole corresponds to user interface object.

Touch screen 112 has touch sensitive surface, sensor or the biography for receiving input from user based on tactile and/or tactile Sensor group.Touch screen 112 and display controller 156 (together with any associated modules and/or instruction set in memory 102) Detect touch screen 112 on contact (and any movement or interruption of the contact), and by detected contact be converted to It is shown in the interaction of the user interface object (for example, one or more soft-key buttons, icon, webpage or image) on touch screen 112. In the exemplary embodiment, the contact point between touch screen 112 and user corresponds to the finger of user.

Touch screen 112 optionally using LCD (liquid crystal display) technology, LPD (light emitting polymer displays) technology or LED (light emitting diode) technology, but other display technologies are used in other embodiments.Touch screen 112 and display controller 156 optionally using any technology in the currently known or later a variety of touch-sensing technologies that will be developed and other connect Nearly sensor array contacts and its appoints to detect for determining other elements of the one or more points contacted with touch screen 112 What is mobile or interrupts, and a variety of touch-sensing technologies are including but not limited to capacitive, resistive, infrared ray and surface Technology of acoustic wave.In one exemplary embodiment, using projection-type mutual capacitance detection technology, such as from Apple Inc. (Cupertino, California's)iPodWithIt was found that technology.

Touch screen 112 is optionally with the video resolution for being more than 100dpi.In some embodiments, touch screen has big The video resolution of about 160dpi.User optionally uses any suitable object or additives such as stylus, finger etc., with Touch screen 112 contacts.In some embodiments, user interface is designed to the mainly work together with contact and gesture based on finger Make, this with the input based on stylus compared with due to finger on the touchscreen contact area more greatly and possible accuracy is lower.One In a little embodiments, the rough input based on finger is translated as accurate pointer/cursor position or order by equipment, to execute user Desired movement.

In some embodiments, in addition to a touch, equipment 100 optionally includes specific for activating or deactivating The Trackpad (not shown) of function.In some embodiments, Trackpad is the touch sensitive regions of equipment, the touch sensitive regions and touch screen Difference does not show visual output.Trackpad is optionally the touch sensitive surface separated with touch screen 112, or by touch screen The extension of the touch sensitive surface of formation.

Equipment 100 further includes the electric system 162 for powering for various parts.Electric system 162 optionally includes electricity Power management system, one or more power supply (for example, battery, alternating current (AC)), recharging system, power failure detection circuit, Power converter or inverter, power status indicator (for example, light emitting diode (LED)) and any other and portable device Middle electric power generates, managees, and distributes associated component.

Equipment 100 optionally further includes one or more optical sensors 164.Figure 1A, which is shown, is couple to I/O subsystem The optical sensor of optical sensor controller 158 in 106.Optical sensor 164 optionally includes charge-coupled device (CCD) Or complementary metal oxide semiconductor (CMOS) phototransistor.Optical sensor 164 passes through one or more from environment reception The light of lens projects, and convert light to indicate the data of image.In conjunction with image-forming module 143 (also referred to as camera model), light It learns sensor 164 and optionally captures still image or video.In some embodiments, after optical sensor is located at equipment 100 It is opposite facing with the touch-screen display 112 on equipment front in portion, so that touch-screen display can be used as still image And/or the view finder of video image acquisition.In some embodiments, another optical sensor is located on the front of equipment, so that User obtains the image of the user optionally while watching other video conference participants on touch-screen display to be used for Video conference.

Equipment 100 optionally further includes one or more contact strength sensors 165.Figure 1A, which is shown, is couple to I/O subsystem The contact strength sensor of intensity sensor controller 159 in system 106.Contact strength sensor 165 optionally include one or Multiple piezoresistive strain gauges, capacitive force transducer, power sensor, piezoelectric force transducer, optics force snesor, condenser type are touch-sensitive Surface or other intensity sensors (for example, sensor of the power (or pressure) for measuring the contact on touch sensitive surface).Contact Intensity sensor 165 receives contact strength information (for example, surrogate of pressure information or pressure information) from environment.In some realities It applies in example, at least one contact strength sensor and touch sensitive surface (for example, touch-sensitive display system 112) Alignment or neighbouring. In some embodiments, at least one contact strength sensor is located on the rear portion of equipment 100, with the front for being located at equipment 100 On touch-screen display 112 it is opposite facing.

Equipment 100 optionally further includes one or more proximity sensors 166.Figure 1A, which is shown, to be couple to peripheral equipment and connects The proximity sensor 166 of mouth 118.Alternatively, proximity sensor 166 is couple to the input in I/O subsystem 106 Controller 160.When in some embodiments, near the ear that multifunctional equipment is placed in user (for example, when user into When row call), proximity sensor closes and disables touch screen 112.

Equipment 100 optionally further includes one or more tactile output generators 167.Figure 1A, which is shown, is couple to I/0 subsystem The tactile output generator of tactile feedback controller 161 in system 106.Tactile output generator 167 optionally includes：One or more A electroacoustic equipment, such as loudspeaker or other acoustic components；And/or the electromechanical equipment of linear movement is converted the energy into, such as Motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator or other tactiles output generating unit will be (for example, will Electric signal converts the component of the tactile output on forming apparatus).Contact strength sensor 165 is received from haptic feedback module 133 and is touched Feel that feedback generates instruction, and generates can be exported by the tactile that the user of equipment 100 senses on the appliance 100.Some In embodiment, at least one tactile output generator and touch sensitive surface (for example, touch-sensitive display system 112) Alignment or neighbour Closely, and optionally by vertically (for example, within the surface of equipment 100/except) or laterally (for example, with equipment Front and back ground in the identical plane in 100 surface) touch sensitive surface is moved to generate tactile output.In some embodiments, at least one A tactile output generator sensor is located on the rear portion of equipment 100, with the touch-screen display on the front of equipment 100 112 is opposite facing.

Equipment 100 optionally further includes one or more accelerometers 168.Figure 1A, which is shown, is couple to peripheral device interface 118 accelerometer 168.Alternatively, accelerometer 168 is optionally couple to the input in I/O subsystem 106 Controller 160.In some embodiments, information based on to the analysis from the one or more accelerometer received data and It is shown with longitudinal view or transverse views on touch-screen display.Equipment 100 is gone back optionally other than accelerometer 168 Including magnetometer (not shown) and GPS (or GLONASS or other Global Navigation Systems) receiver (not shown), for being closed Information in the position of equipment 100 and orientation (for example, vertical or horizontal).

In some embodiments, the software component for storing in the memory 102 include operating system 126, communication module (or Instruction set) 128, contact/motion module (or instruction set) 130, figure module (or instruction set) 132, text input module (or refer to Enable collection) 134, global positioning system (GPS) module (or instruction set) 135 and application program (or instruction set) 136.In addition, In some embodiments, memory 102 stores equipment/overall situation internal state 157, as can be seen in figures 1A and 3.Equipment/overall situation is internal State 157 includes one or more in following：Applications active state is used to indicate which application program (if any) It is currently movable；Display state is used to indicate what application program, view or other information and occupies touch-screen display 112 Each region；Sensor states, including each sensor and the information that obtains of input control apparatus 116 from equipment；And About the position of equipment and/or the location information of posture.

Operating system 126 is (for example, Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS or embedded OS Such as VxWorks) it include for controlling and managing general system task (for example, memory management, the control of storage equipment, electric power Management etc.) various software components and/or driver, and be conducive to the communication between various hardware and software components.

Communication module 128 is conducive to communicate by one or more outside ports 124 with other equipment, and further includes using In processing by the various software components of 124 received data of RF circuit system 108 and/or outside port.Outside port 124 (for example, universal serial bus (USB), firewire etc.) be suitable for be directly coupled to other equipment or indirectly by network (for example, Internet, Wireless LAN etc.) coupling.In some embodiments, outside port be in iPod (trade mark of Apple Inc.) equipment Used 30 needle connector is same or similar and/or spininess (for example, 30 needles) connector for being compatible with.One In a little embodiments, outside port is and 8 needle connectors used on iPhone and iPod (trade mark of Apple Inc.) equipment (for example, lightning connector) same or similar and/or spininess (for example, 8 needles) connector for being compatible with.

Contact/operation module 130 is optionally detected and touch screen 112 (in conjunction with display controller 156) and other touch-sensitive is set The contact of standby (for example, Trackpad or physics click type rotating disk).Contact/motion module 130 includes various software components for holding Row various operations relevant with the detection contacted, such as to determine that whether having occurred that contact (for example, detection finger down thing Part), determine contact intensity (for example, contact power or pressure, contact power or pressure substitute), determine whether there is The movement of contact and tracked on entire touch sensitive surface the movement (for example, detecting one or more finger drag events), with And determine whether stop over terminates (for example, detection digit up event or contact are interrupted) for contact.Contact/motion module 130 Contact data are received from touch sensitive surface.Determine that the movement of contact point optionally includes rate (magnitude), the speed of determining contact point (magnitude and direction), and/or acceleration (change in magnitude and/or direction), the movement of contact point by a series of contact data Lai It indicates.These operations are optionally applied to single-contact (for example, single abutment) or multiple spot while contacting (for example, " multiple spot Touch "/multiple fingers contact).In some embodiments, contact/motion module 130 and display controller 156 detect Trackpad On contact.

In some embodiments, contact/motion module 130 is to determine operation using one group of one or more intensity threshold It is no to execute (for example, determining that whether user " clicks " icon) via user.In some embodiments, according to software parameter To determine a subset of at least intensity threshold (for example, intensity threshold is not by the activation threshold of specific physical actuation device Lai really It is fixed, and can be adjusted in the case where not changing the physical hardware of equipment 100).For example, not changing Trackpad or touch screen In the case where display hardware, mouse " click " threshold value of Trackpad or touch screen can be configured to the big model of predefined threshold value Any of enclose.In addition, being provided to the user of equipment for adjusting one in intensity threshold class value in some specific implementations Or it is multiple (for example, once being adjusted by adjusting each intensity threshold and/or by utilizing to the system-level click of " intensity " parameter Multiple intensity thresholds) software setting.

Contact/motion module 130 optionally detects the gesture input of user.Different gestures on touch sensitive surface have difference Contact patterns (for example, the different motion of detected contact, timing and/or intensity).Therefore, specific optionally by detection Contact patterns carry out detection gesture.For example, detect finger Flick gesture include detect finger down event, then with finger It presses and detects that finger lifts (lift at (for example, at picture mark position) the identical position of event (or substantially the same position) From) event.For another example, detecting that finger gently sweeps gesture on touch sensitive surface includes detecting finger down event and then detecting It one or more finger drag events and subsequently detects finger and lifts and (be lifted away from) event.

Figure module 132 includes for the various known of figure to be shown and shown on touch screen 112 or other displays Software component, including for changing shown figure visual impact (for example, brightness, transparency, saturation degree, contrast or Other visual characteristics) component.As used herein, term " figure " includes any object that can be displayed to user, non-limit It include property processed text, webpage, icon (user interface object including soft-key button), digital picture, video, animation etc. Deng.

In some embodiments, figure module 132 stores tables of data diagram shape to be used.Each figure is optionally divided Equipped with corresponding code.Figure module 132 specifies one or more codes of figure to be shown from receptions such as application programs, Also receive coordinate data and other graphic attribute data together if necessary, and it is defeated then to generate screen image data Out to display controller 156.

Haptic feedback module 133 includes the various software components for generating instruction, these instructions are exported by tactile to be occurred Device 167 uses, and the one or more positions so as to the interaction in response to user and equipment 100 on the appliance 100 generate touching Feel output.

It provides optionally as the text input module 134 of the component of figure module 132 in various application program (examples Such as, contact person 137, Email 140, IM 141, browser 147 and any other application program for needing text input) in Input the soft keyboard of text.

GPS module 135 determines the position of equipment, and provides the information to use in various application programs (for example, mentioning Supply phone 138 is to dial for location-based, be supplied to camera 143 as photo/video metadata and be supplied to For the application program of location based service, such as weather desktop small routine, local Yellow Page desktop small routine and map/navigation Desktop small routine).

Application program 136 is optionally included with lower module (or instruction set) or its subgroup or superset：

Contact module 137 (is called address list or contacts list) sometimes；

Phone module 138；

Video conference module 139；

Email client module 140；

Instant message (IM) module 141；

Internet radio module 142；

For still image and/or the camera model 143 of video image；

Image management module 144；

Browser module 147；

Calendaring module 148；

Desktop small routine module 149, optionally includes one or more in following：Weather desktop small routine 149-1, stock City desktop small routine 149-2, calculator desktop small routine 149-3, alarm clock desktop small routine 149-4, dictionary desktop small routine The desktop small routine 149-6 of other desktop small routines and user's creation that 149-5 and user obtain；

Personal digital assistant module 150；

Vehicle integration module 151；

Video and musical player module 152, are optionally made of video player module and musical player module；

Notepaper module 153；

Mapping module 154；And/or

Music library module 155.

The example for the other application program 136 being optionally stored in memory 102 includes other text processing applications Program, other picture editting's application programs, picture application program, show application program, JAVA enable application program, encryption, Digital rights management, voice recognition and sound reproduction.

In conjunction with touch screen 112, display controller 156, contact module 130, figure module 132 and text input module 134, contact module 137 is optionally for management address list or contacts list (for example, being stored in memory 102 or storage In the application program internal state 192 of contact module 137 in device 370), including：Name is added to address list；From address list Delete name；Telephone number, e-mail address, actual address or other information are associated with name；Image and name are closed Connection；Classified to name and is sorted out；Telephone number or e-mail address are provided initiate and/or promote to pass through phone 138, Video conference 139, the communication of Email 140 or IM 141；Etc..

In conjunction with RF circuit system 108, audio circuitry 110, loudspeaker 111, microphone 113, touch screen 112, display Controller 156, contact module 130, figure module 132 and text input module 134, phone module 138 are optionally used for defeated Enter to correspond to the character string of telephone number, one or more telephone numbers in accessing address list 137, modification have inputted Telephone number dials corresponding telephone number, conversates and disconnect or hang up when session is completed.As described above, wireless Communication is optionally using any one of a variety of communication standards, agreement and technology.

In conjunction with RF circuit system 108, audio circuitry 110, loudspeaker 111, microphone 113, touch screen 112, display Controller 156, optical sensor 164, optical sensor controller 158, contact module 130, figure module 132, text input Module 134, contacts list 137 and phone module 138, video conference module 139 include for according to user instructions initiate, Carry out and terminate the executable instruction of the video conference between user and one or more of the other participant.

In conjunction with RF circuit system 108, touch screen 112, display controller 156, contact module 130,132 and of figure module Text input module 134, email client module 140 include for creating, sending in response to user instruction, receive, With the executable instruction of management Email.In conjunction with image management module 144, email client module 140 makes very It is easy creation and sends the Email with the still image or video image that are shot by camera model 143.

In conjunction with RF circuit system 108, touch screen 112, display controller 156, contact module 130,132 and of figure module Text input module 134, instant message module 141 include for having inputted the character string in response to instant message, modification previously The character of input transmits corresponding instant message (for example, using short message service (SMS) or multimedia messaging service (MMS) agreement For based on phone instant message or using XMPP, SIMPLE or IMPS be used for the instant message based on internet), connect Receive instant message and check received instant message executable instruction.In some embodiments, it is transferred and/or received Instant message optionally include figure, photograph, audio file, video file and/or MMS and/or enhancing messaging service (EMS) Middle supported other attachmentes.As used herein, " instant message " refer to based on phone message (for example, using SMS or Both the message that MMS is sent) and message Internet-based (for example, the message sent using XMPP, SIMPLE or IMPS).

In conjunction with touch screen 112, display system controller 156, contact module 130, figure module 132, audio circuitry 110, loudspeaker 111 and RF circuit system 108, Internet radio module 142 are to include for selecting and playing Internet radio The imaginary example third party application of the executable instruction in radio station.

In conjunction with touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact mould Block 130, figure module 132 and image management module 144, camera model 143 include for capturing still image or video (packet Include video flowing) and store them in memory 102, modify the characteristic of still image or video or deleted from memory 102 Except the executable instruction of still image or video.

In conjunction with touch screen 112, display controller 156, contact module 130, figure module 132, text input module 134, With camera model 143, image management module 144 include for arrange, modify (for example, editor) or in other ways manipulate plus Label, deletion, presentation (for example, in digital slide or photograph album) and storage still image and/or video image are held Row instruction.

In conjunction with RF circuit system 108, touch screen 112, display system controller 156, contact module 130, figure module 132 and text input module 134, browser module 147 includes for browsing internet (including search, chain according to user instructions Be connected to, receive and show webpage or part thereof and be linked to the attachment and other files of webpage) executable instruction.

In conjunction with RF circuit system 108, touch screen 112, display system controller 156, contact module 130, figure module 132, text input module 134, email client module 140 and browser module 147, calendaring module 148 include being used for It creates, show according to user instructions, modification and storage calendar and data associated with calendar are (for example, calendar, pending Task list etc.) executable instruction.

In conjunction with RF circuit system 108, touch screen 112, display system controller 156, contact module 130, figure module 132, text input module 134 and browser module 147, desktop small routine module 149 are optionally to be downloaded by user and used Miniature applications program (for example, weather desktop small routine 149-1, stock market desktop small routine 149-2, calculator desktop small routine 149-3, alarm clock desktop small routine 149-4 and dictionary desktop small routine 149-5) or by user create miniature applications program (example Such as, the desktop small routine 149-6 of user's creation).In some embodiments, desktop small routine includes HTML (hypertext markup language Speech) file, CSS (cascading style sheets) file and JavaScript file.In some embodiments, desktop small routine includes XML (extensible markup language) file and JavaScript file are (for example, Yahoo！Desktop small routine).

In conjunction with RF circuit system 108, audio circuitry 110, loudspeaker 111, microphone 113, touch screen 112, display Controller 156, contact module 130, figure module 132 and text input module 134, personal digital assistant module 150 record language Sound order and the information for indicating recorded voice command is sent to the server 510 in server such as Fig. 5 to be used for Analysis, and voice command is made a response based on the response from server.

Vehicle integration module 151 includes the executable instruction for process among one or more, in the one or more Between vehicle information display in Process flowchart vehicle (for example, automobile, truck, lorry etc.), thus aobvious in the information of vehicles Show and provide user interface in the respective display (for example, display 547 of the external information display systems 540 in Fig. 5) of system, The user interface is all for example for mapping application program or music application.Vehicle integration application will be answered from third party The respective display for being shown in vehicle information display by vehicle integration application is converted into the information of program On content.

In conjunction with touch screen 112, display system controller 156, contact module 130, figure module 132, audio circuitry 110, loudspeaker 111, RF circuit system 108 and browser module 147, video and musical player module 152 include allowing to use Family downloading and play back the music recorded stored with one or more file formats (such as MP3 or AAC file) and other sound The executable instruction of sound file, and for show, show or in other ways play back video (for example, on touch screen 112 or On the external display connected via outside port 124) executable instruction.In some embodiments, equipment 100 is optionally Including MP3 player, the functionality of such as iPod (trade mark of Apple Inc.).

In conjunction with touch screen 112, display controller 156, contact module 130, figure module 132 and text input module 134, notepaper module 153 includes the executable instruction for creating and managing notepaper, Pending tasks inventory etc. according to user instructions.

In conjunction with RF circuit system 108, touch screen 112, display system controller 156, contact module 130, figure module 132, text input module 134, GPS module 135 and browser module 147, mapping module 154 is optionally for according to user Command reception, display, modification and storage map and data associated with map are (for example, driving route；With in certain bits Shop and the related data of other points of interest at or near setting；And other location-based data).

In conjunction with touch screen 112, display system controller 156, contact module 130, figure module 132, audio circuitry 110, loudspeaker Ill and RF circuit system 108, music library module 155 include for song to be selected and played from music libraries The imaginary example third party application of executable instruction.

Above-mentioned each module and application program correspond to for executing above-mentioned one or more functions and in this application One group of the method (for example, computer implemented method described herein and other information processing method) introduced can be held Row instruction.These modules (i.e. instruction set) need not be implemented as separated software program, process, or module, therefore these modules Each seed group is optionally combined in various embodiments or rearranges in other ways.In some embodiments, memory 102 optionally store the subgroup of above-mentioned module and data structure.In addition, memory 102 is optionally stored and to be not described above Other module and data structure.

In some embodiments, equipment 100 is such a equipment, i.e. the behaviour of predefined one group of function on the device Work is uniquely executed by touch screen and/or Trackpad.It is used as by using touch screen and/or Trackpad and is used for equipment 100 Operation main input control apparatus, optionally reduction equipment 100 on being physically entered control equipment (such as pushing button, Dial etc.) quantity.

Uniquely optionally included by predefined one group of function that touch screen and/or Trackpad execute between user Navigation between interface.In some embodiments, Trackpad when being touched by user by equipment 100 from display on the appliance 100 Any user interface navigation to main menu, main screen menu or root menu.In such embodiments, it is executed using Trackpad " menu button ".In some other embodiments, menu button be physics push button or it is other be physically entered control equipment, Rather than Trackpad.

Figure 1B is the block diagram for showing the example components in accordance with some embodiments for event handling.In some embodiments In, memory 102 (in Figure 1A) or memory 370 (Fig. 3) include event classifier 170 (for example, in operating system 126) with And corresponding application program 136-1 (for example, aforementioned applications program 137-13,155, any application program in 380-390).

Event classifier 170 receives event information and determination for application program 136-1 that event information is transmitted to and answers With the application view 191 of program 136-1.Event classifier 170 includes event monitor 171 and Event scheduler module 174.In some embodiments, application program 136-1 includes application program internal state 192, the application program internal state 192 It is movable for indicating when application program or while being carrying out is shown in current application program view on touch-sensitive display 112.? In some embodiments, equipment/overall situation internal state 157 is used to determine which (which) application program is worked as by event classifier 170 Before be movable, and application program internal state 192 is used to what event information was transmitted to by determination by event classifier 170 Application view 191.

In some embodiments, application program internal state 192 includes other information, such as following middle one or more Person：When application program 136-1 restores to execute recoverys information to be used, indicate to pass through what application program 136-1 was shown Information is ready for the user interface state information by the application program 136-1 information shown, for enabling a user to The repetition for the prior actions enough taken back to the state queue and user of the previous state of application program 136-1 or view/ Cancel queue.

Event monitor 171 receives event information from peripheral device interface 118.Event information includes about subevent (example Such as, user on touch-sensitive display 112 touches, a part as multi-touch gesture) information.Peripheral device interface 118 It is transmitted from I/O subsystem 106 or sensor (all proximity sensors 166 in this way), accelerometer 168, and/or microphone 113 The received information of (passing through audio circuitry 110) institute.Peripheral device interface 118 includes from the received information of I/O subsystem 106 Information from touch-sensitive display 112 or touch sensitive surface.

In some embodiments, event monitor 171 sends a request to peripheral device interface at predetermined intervals 118.In response, 118 transmitting event information of peripheral device interface.In other embodiments, peripheral device interface 118 is only when depositing It (is held for example, receiving the input higher than predetermined noise threshold and/or receiving more than predetermined in significant event The input of continuous time) when transmitting event information.

In some embodiments, event classifier 170 further includes that hit view determination module 172 and/or life event are known Other device determining module 173.

When touch-sensitive display 112 shows more than one view, hit view determination module 172 is provided for determining sub- thing The software process where part has had occurred in one or more views.View can see over the display by user Control and other elements constitute.

The another aspect of user interface associated with application program is one group of view, otherwise referred to as applies journey herein Sequence view or user interface windows are wherein showing information and the gesture based on touch occur.Wherein detecting touch (corresponding application programs) application view optionally corresponds in the sequencing or view hierarchies structure of application program Sequencing is horizontal.For example, being optionally called hit view in the floor level view for wherein detecting touch, and it is identified Event set to correctly enter optionally at least is based in part on the hit view for the initial touch for starting from the gesture based on touch To determine.

It hits view determination module 172 and receives information relevant to the subevent of the gesture based on touch.Work as application program When with the multiple views being organized in hierarchical structure, hit view determination module 172 is identified as the classification for view is hit The minimum view of the subevent should be handled in structure.In most of situations, hit view is to initiate subevent (to form thing First subevent in the subevent sequence of part or potential event) in the floor level view wherein occurred.Once hit view Figure is hit view determination module identification, and hit view, which is usually received, to be identified as hitting the targeted same touch of view with it Or the relevant all subevents of input source.

Life event identifier determining module 173 determines which or which view in view hierarchies structure should receive spy Fixed subevent sequence.In some embodiments, life event identifier determining module 173 determines that only hit view should receive Specific subevent sequence.In other embodiments, life event identifier determining module 173 determines the physics including subevent All views of position are the views being actively related to, and it is thus determined that all views being actively related to should receive specific sub- thing Part sequence.In other embodiments, it even if touch subevent is confined to region associated with a particular figure completely, is classified The view that higher view is actively related to still maintaining in structure.

Event information is dispatched to event recognizer (for example, event recognizer 180) by Event scheduler module 174.It is wrapping In the embodiment for including life event identifier determining module 173, event information is transmitted to by activity by Event scheduler module 174 173 definite event identifier of event recognizer determining module.In some embodiments, Event scheduler module 174 is in event Event information is stored in queue, event information is retrieved by corresponding event receiver module 182.

In some embodiments, operating system 126 includes event classifier 170.Alternatively, application program 136-1 includes thing Part classifier 170.In another embodiment, event classifier 170 is independent module, or is stored in memory 102 Another module (such as contact/motion module 130) a part.

In some embodiments, application program 136-1 includes multiple button.onreleases 190 and one or more application journey Sequence view 191, each of them include for handling the touch occurred in the corresponding views of the user interface of application program The instruction of event.Each application view 191 of application program 136-1 includes one or more event recognizers 180.It is logical Often, corresponding application programs view 191 includes multiple event recognizers 180.In other embodiments, in event recognizer 180 One or more is some of standalone module, all user interface tool packet (not shown) in this way of standalone module or application program The higher level object of 136-1 therefrom inheritance method and other characteristics.In some embodiments, corresponding event processing routine 190 It includes one or more of the following：Data renovator 176, object renovator 177, GUI renovator 178, and/or from event point The received event data 179 of class device 170.Button.onrelease 190 optionally with or call data renovator 176, object more New device 177 or GUI renovator 178 carry out more new application internal state 192.Alternatively, one in application view 191 or Multiple includes one or more corresponding event processing routines 190.In addition, in some embodiments, data renovator 176, object One or more of renovator 177 and GUI renovator 178 are included in corresponding application programs view 191.

Corresponding event recognizer 180 receives event information (for example, event data 179) from event classifier 170, and Carry out identified event from event information.Event recognizer 180 includes Event receiver 182 and event comparator 184.In some implementations In example, event recognizer 180 also includes at least a subgroup below：Metadata 183 and event transmitting instruction 188 are (optionally It transmits and instructs including subevent).

Event receiver 182 receives event information from event classifier 170.Event information includes the letter about subevent Breath, such as touch or touch movement.According to subevent, event information further includes other information, the position of such as subevent.When When subevent is related to the movement touched, event information optionally further includes rate and the direction of subevent.In some embodiments, Event includes that equipment from an orientation rotates to another orientation (for example, rotating to lateral trend from machine-direction oriented, vice versa), And event information includes the corresponding information of the current orientation (also referred to as equipment posture) about equipment.

Event information and predefined event or subevent definition are compared by event comparator 184, and being based on should Compare the state to determine event or subevent or determination or update event or subevent.In some embodiments, event ratio It include that event defines 186 compared with device 184.Event defines 186 definition (for example, predefined subevent sequence) comprising event, example Such as event 1 (187-1), event 2 (187-2) and other.In some embodiments, the subevent in event 187 for example including Touch starts, touch terminates, touch is moved, touch is cancelled and multiple point touching.In an example, event 1 (187-1) determines Justice is the double-click on shown object.For example, the double-click includes the first time touching of the scheduled duration in displayed object Touch (touch starts), the first time of scheduled duration lift (touch terminates), scheduled duration in the displayed object It is secondary touch (touch starts) and scheduled duration lift (touch terminates) for the second time.In another example, 2 (187- of event 2) definition is the dragging on shown object.For example, the dragging includes the predetermined duration being shown on object at this Touch (or contact), movement and the touch of the touch on touch-sensitive display 112 lift (touch terminates).One In a little embodiments, event further includes the information for one or more associated event processing routines 190.

In some embodiments, it includes the definition for the event of respective user interfaces object that event, which defines 187,.Some In embodiment, event comparator 184 executes hit test, to determine which user interface object is associated with subevent.For example, In the application view for wherein showing three user interface objects on touch display 112, when in touch-sensitive display 112 On when detecting touch, event comparator 184 executes hit test, with determine in these three user interface objects which with should It is associated to touch (subevent).If each shown object is associated with corresponding button.onrelease 190, event ratio Determine which button.onrelease 190 should be activated using the result that the hit is tested compared with device.For example, event comparator 184 selections button.onrelease associated with the object and subevent that trigger hit test.

In some embodiments, the definition of corresponding event 187 further includes delay voltage, and delay voltage postpones event information Transmitting, until having determined whether subevent sequence exactly corresponds to the event type of event recognizer.

It is matched when the determining subevent string of corresponding event identifier 180 does not define any event in 186 with event, then the phase Impossible 180 entry event of event recognizer, event failure or event is answered to terminate state, then it is ignored this and is based on touching Gesture subsequent subevent.In this case, for hit view keep movable other event recognizers (if there is Words) continue to track and handle the subevent of the ongoing gesture based on touch.

In some embodiments, corresponding event identifier 180 includes having how instruction event transmission system should execute To the metadata 183 of attribute, mark and/or the list that can be configured of the subevent transmitting for the event recognizer being actively related to.? In some embodiments, metadata 183 includes how instruction event recognizer interacts each other or how to interact and can configure Attribute, mark and/or list.In some embodiments, metadata 183 includes whether instruction subevent is passed to view or journey Horizontal attribute, label and/or the list that can be configured changed in sequence hierarchical structure.

In some embodiments, when one or more specific subevents of event are identified, corresponding event identifier 180 Activate button.onrelease 190 associated with event.In some embodiments, corresponding event identifier 180 will be with the event Associated event information is transmitted to button.onrelease 190.Activate button.onrelease 190 be different from send (and delay hair Send) subevent is to corresponding hit view.In some embodiments, event recognizer 180 is dished out related to the event identified The mark of connection, and button.onrelease 190 associated with the mark is connected to the mark and executes predefined process.

In some embodiments, event transmitting instruction 188 includes transmitting the event information about subevent without activating thing Transmit instruction in the subevent of part processing routine.On the contrary, subevent transmitting instruction event information is transmitted to it is related to subevent string The button.onrelease of connection is transmitted to the view being actively related to.It is gone here and there with subevent or associated with the view being actively related to Button.onrelease receives event information, and executes predetermined process.

In some embodiments, data renovator 176 creates and updates the data used in application program 136-1.Example Such as, data renovator 176 updates the telephone number used in contact module 137, or is stored in video player module Video file used in 145.In some embodiments, object renovator 177 is created and is updated and makes in application program 136-1 Object.For example, object renovator 176 creates new user interface object, or update the position of user interface object. GUI renovator 178 updates GUI.For example, GUI renovator 178 prepares display information, and figure mould is sent by display information Block 132 is to show on the touch sensitive display.

In some embodiments, button.onrelease 190 includes or has to data renovator 176, object renovator The access authority of 177 and GUI renovator 178.In some embodiments, data renovator 176, object renovator 177 and GUI Renovator 178 is included in corresponding application programs 136-1 or the individual module of application view 191.In other embodiments In, they are included in two or more software modules.

It should be appreciated that the discussion for the event handling that the above-mentioned user about on touch-sensitive display touches is applied also for using defeated Enter user's input of the other forms of equipment operation multifunctional equipment 100, not all user's input is all on the touchscreen It initiates.For example, optionally pressing or pinning the mouse movement to cooperate and mouse button down with single or multiple keyboards；Touch-control Contact on plate is mobile, tap, dragging, rolling etc.；Stylus input；The movement of equipment；Spoken command；The eyes detected It is mobile；Bio-identification input；And/or any combination of them is optionally used as corresponding to the sub- thing for limiting the event to be identified The input of part.

Fig. 2 shows a kind of portable multifunction devices 100 in accordance with some embodiments with touch screen 112.It touches Screen optionally shows one or more figures in user interface (UI) 200.In this embodiment, it and is described below In other embodiments, user can for example, by with one or more finger 202 (being not necessarily to scale in the accompanying drawings) or Gesture is made on figure with one or more stylus 203 (being not necessarily to scale in the accompanying drawings) to select in these figures It is one or more.In some embodiments, when user is interrupted with the contact of the one or more figure, occur to one or more The selection of a figure.In some embodiments, gesture optionally includes one or many taps, one or many gently sweeps (from a left side To the right, the finger from right to left, up and/or down) and/or contacted with equipment 100 is stirred (from right to left, from a left side To the right, up and/or down).In some specific implementations or in some cases, it will not inadvertently be selected with pattern contact Figure.For example, what is swept on application icon gently sweeps gesture optionally not when gesture corresponding with selection is tap It can select corresponding application program.

Equipment 100 optionally further includes one or more physical buttons, such as " main screen " or menu button 204.As before Described, menu button 204 is any in one group of application program being optionally performed on the appliance 100 optionally for navigating to Application program 136.Alternatively, in some embodiments, menu button is implemented as soft in the GUI being shown on touch screen 112 Key.

In one embodiment, equipment 100 includes touch screen 112, menu button 204, is used for facility switching machine and locking Pushing button 206, (one or more) volume knob 208, subscriber identity module (SIM) card slot 210, the headset of equipment are inserted Hole 212 and docking/charging external port 124.Button 206 is pushed optionally for by depressing the button and by the button Depressed state is maintained to carry out switching on and shutting down to equipment up to predefined time interval；By depressing the button and pre- by this The button, which is discharged, before the time interval of definition carrys out locking device；And/or unlocker device or initiate unlocking process.In alternative reality It applies in example, equipment 100 also receives the speech for activating or deactivating certain functions by microphone 113 and inputs.Equipment 100 Also optionally include one or more contact strength sensors 165 of the intensity for detecting the contact on touch screen 112, and/ Or one or more tactile output generators 167 of tactile output are generated for the user for equipment 100.

Fig. 3 is the block diagram of the exemplary multifunctional equipment in accordance with some embodiments with display and touch sensitive surface.If Standby 300 need not be portable.In some embodiments, equipment 300 be laptop computer, desktop computer, tablet computer, Multimedia player device, navigation equipment, educational facilities (such as children for learning toy), game system or control equipment (for example, Household or industrial controller).Equipment 300 generally includes one or more processing units (CPU) 310, one or more networks Or other communication interfaces 360, memory 370 and one or more communication bus 320 for making these component connections.Communication is total Line 320, which optionally includes, makes the circuit system of the communication between system unit interconnection and control system component (be called core sometimes Piece group).Equipment 300 include input/output (I/O) interface 330, the interface 330 include be usually touch-screen display (for example, Touch-screen display 112) display 340.I/O interface 330 also optionally includes keyboard and/or mouse, and (or other directions are set It is standby) 350 and Trackpad 355, in equipment 300 generate tactile output tactile output generator 357 (for example, being similar to The tactile output generator 167 above with reference to described in Figure 1A), sensor 359 (for example, optical sensor, acceleration transducer, Proximity sensor, touch-sensitive sensors, and/or strong similar to the contact of the contact strength sensor 165 above with reference to described in Figure 1A Spend sensor).Memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM or other arbitrary accesses Solid-state memory device；And nonvolatile memory is optionally included, such as one or more disk storage equipments, CD are deposited Store up equipment, flash memory device or other non-volatile solid-state memory devices.Memory 370 is optionally included to be positioned far from CPU 310 One or more storage equipment.In some embodiments, the storage of memory 370 and portable multifunction device 100 (Figure 1A) Memory 102 in similar program, module and the data structure or their son of the program, module and the data structure that are stored Group.In addition, memory 370 is optionally stored in the other journey being not present in the memory 102 of portable multifunction device 100 Sequence, module and data structure.For example, the memory 370 of equipment 300 optionally store picture module 380, display module 382, Word processing module 384, website creation module 386, disk editor module 388, and/or spreadsheet module 390, and it is portable more The memory 102 of function device 100 (Figure 1A) does not store these modules optionally.

Each of above-mentioned identified element is optionally stored in one or more previously mentioned memories in Fig. 3 In equipment.Each of above-mentioned identified module corresponds to one group of instruction for executing above-mentioned function.It is above-mentioned identified Module or program (that is, instruction set) need not be implemented as individual software program, process, or module, and therefore these modules Each seed group is optionally combined in various embodiments or rearranges in other ways.In some embodiments, memory 370 optionally store the subgroup of above-mentioned module and data structure.In addition, memory 370 optionally store it is not described above another Outer module and data structure.

It attention is drawn to the reality for the user interface (" UI ") optionally realized on portable multifunction device 100 Apply example.

Fig. 4 A shows one kind that the application menu is used on portable multifunction device 100 in accordance with some embodiments Exemplary user interface.Similar user interface is optionally realized in equipment 300.In some embodiments, user interface 400 Including following element or its subgroup or superset：

Wirelessly communicate the S meter 402 of (such as cellular signal and Wi-Fi signal)；

Time 404；

Bluetooth indicator 405；

Battery Status Indicator 406；

With common application program image target pallet 408, icon is such as：

The icon 416 of the label " phone " of zero phone module 138, the icon 416 optionally include missed call or voice The indicator 414 of the quantity of message；

The icon 418 of the label " mail " of zero email client module 140, which, which optionally includes, does not read The indicator 410 of the quantity of Email；

The icon 420 of the label " browser " of zero browser module 147；With

The label of zero video and musical player module 152 (also referred to as iPod (trade mark of Apple Inc.) module 152) The icon 422 of " iPod "；And

The icon of other application program, icon is such as：

The icon 424 of the label " text " of zero IM module 141；

The icon 426 of the label " calendar " of zero calendaring module 148；

The icon 428 of the label " photograph " of zero image management module 144；

The icon 430 of the label " camera " of zero camera model 143；

The icon 432 of the label " music libraries " of zero music library module 155；

The icon 434 of the label " stock market " of zero stock market desktop small routine 149-2；

The icon 436 of the label " map " of zero mapping module 154；

The icon 438 of the label " weather " of zero weather desktop small routine 149-1；

The icon 440 of the label " clock " of zero alarm clock desktop small routine 149-4；

The icon 442 of the label " Internet radio " of zero Internet radio module 142；

The icon 444 of the label " notepaper " of zero notepaper module 153；And

The icon 446 of zero setting application program or module, the icon 446 are provided to equipment 100 and its various application programs The access of 136 setting；

It should be pointed out that icon label shown in Fig. 4 A is only exemplary.For example, video and music player The icon 422 of module 152 is labeled " music " or " music player ".Other labels are optionally for various application program images Mark.In some embodiments, the label of corresponding application programs icon includes corresponding with the corresponding application programs icon using journey The title of sequence.In some embodiments, the label of application-specific icon is different from corresponding with the application-specific icon Application program title.

Fig. 4 B is shown with the 451 (example of touch sensitive surface separated with display 450 (for example, touch-screen display 112) Such as, the plate or Trackpad 355 in Fig. 3) equipment (for example, equipment 300 in Fig. 3) on exemplary user interface.Equipment 300 also optionally include one or more contact strength sensor (examples of the intensity for detecting the contact on touch sensitive surface 451 Such as, one or more of sensor 357), and/or the one or more that tactile exports is generated for the user for equipment 300 Tactile output generator 359.

Although by being provided then with reference to the input on touch-screen display 112 (being wherein combined with touch sensitive surface and display) Example in it is some, but in some embodiments, the input on touch sensitive surface that equipment detection is separated with display, such as figure Shown in 4B.In some embodiments, touch sensitive surface (for example, 451 in Fig. 4 B) have on display (for example, 450) The corresponding main shaft (for example, 452 in Fig. 4 B) of main shaft (for example, 453 in Fig. 4 B).According to these embodiments, equipment detection exists Position corresponding with the corresponding position on display is (for example, in figure 4b, 460, which correspond to 468 and 462, corresponds to 470) place The contact with touch sensitive surface 451 (for example, 460 in Fig. 4 B and 462).In this way, in touch sensitive surface (for example, 451 in Fig. 4 B) When separating with the display (450 in Fig. 4 B) of multifunctional equipment, (example is inputted by the user that equipment detects on touch sensitive surface Such as, contact 460 and 462 and their movement) it is used to manipulate the user interface on display by the equipment.It should be appreciated that class As method optionally for other user interfaces as described herein.

In addition, though inputting (for example, gesture is gently swept in finger contact, finger Flick gesture, finger) mostly in reference to finger To provide following example it should be appreciated that in some embodiments, these fingers input one or more of by Input (for example, input or stylus input based on mouse) substitution from another input equipment.For example, gently sweeping gesture optionally (for example, rather than contacting) is clicked by mouse, is later cursor moving (for example, rather than contacting along the path gently swept It is mobile) substitution.For another example, mouse when Flick gesture is optionally located on the position of Flick gesture by cursor click (for example, and It is not detection to contact, is termination detection contact later) substitution.Similarly, it when being detected simultaneously by multiple users input, answers When understanding, multiple computer mouses be optionally used simultaneously or a mouse and multiple fingers contact optionally by simultaneously It uses.

Fig. 5 shows a kind of block diagram of operating environment 500 in accordance with some embodiments.Operating environment 500 includes server 510, one or more communication networks 505, portable multifunction device 100 and external information display systems 540.In some implementations In example, external information display systems 540 are implemented in the car.

Server 510 generally include it is one or more for execute the module stored in memory 524, program and/or Instruct the processing unit (CPU) 512 thereby executing processing operation, one or more networks or other communication interfaces 520, memory 524 and one or more communication bus 522 for making these component connections.Communication bus 522, which optionally includes, makes Account Dept The circuit system (being called chipset sometimes) of communication between part interconnection and control system component.Memory 524 includes high speed Random access memory, such as DRAM, SRAM, DDR RAM or other random access solid state memory devices, and may include non- Volatile memory, such as one or more disk storage equipments, optical disc memory apparatus, flash memory device or other non-easy The property lost solid storage device.Memory 524 optionally includes the one or more storage equipment positioned far from CPU 512.Storage Non-volatile memory devices in device 524 or memory 524 alternatively, which include that non-transient computer is readable, to be deposited Storage media.In some embodiments, memory 524 or the computer-readable recording medium storage following procedure of memory 524, mould Block and data structure or their subgroup：

Operating system 526, it is relevant with for executing hardware including the process for handling various basic system services The process of task.And

Network communication module 528, for passing through one or more communications network interfaces 520 and one or more communication networks Server 510 is connected to other calculating equipment by network 505 (wiredly or wirelessly), and the one or more communication network 505 is all For example internet, other wide area networks, local area network, Metropolitan Area Network (MAN) etc..

Portable multifunction device 100 generally includes the component with reference to described in Figure 1A -1B and/or Fig. 3.

External information display systems 540 generally include it is one or more for execute the module stored in memory 554, Program and/or instruction thereby executing processing operation processing unit (CPU) 542, one or more networks or other communication interfaces 550, memory 554 and one or more communication bus 552 for making these component connections.External information display systems 540 User interface 546 is optionally included, which includes display equipment 547 and control 548 (for example, machinery, which shows, to be indicated (affordance), button or knob, touch sensitive surface such as touch-screen display or other input sources).In some embodiments In, display 547 is the touch-screen display that can receive user's touch input.Communication bus 552, which optionally includes, makes system The circuit system (being called chipset sometimes) of communication between component connection and control system component.Memory 554 includes height Fast random access memory, such as DRAM, SRAM, DDR RAM or other random access solid state memory devices, and optionally Including nonvolatile memory, such as one or more disk storage equipments, optical disc memory apparatus, flash memory device or its Its non-volatile solid-state memory devices.Memory 554 optionally includes the one or more storages positioned far from CPU 542 and sets It is standby.Non-volatile memory devices in memory 552 or memory 552 alternatively include non-transient computer Readable storage medium storing program for executing.In some embodiments, below the computer-readable recording medium storage of memory 552 or memory 552 Program, module and data structure or their subgroup：

Operating system 556, it is relevant with for executing hardware including the process for handling various basic system services The process of task.And

Network communication module 558, for passing through one or more communications network interfaces 550 and one or more communication networks Server 540 is connected to other calculating equipment by network 505 (wiredly or wirelessly), and the one or more communication network 505 is all Such as internet, other wide area networks, local area network, Metropolitan Area Network (MAN).

In some embodiments, the display 547 of 100 drive system 540 of equipment.For example, equipment 100 is sent out to system 540 Vision signal is sent, and the CPU 542 of system 540 renders the vision signal on display 547.In some embodiments, if Standby 100 directly send vision signal to display 547, and CPU 542 is not used to render the vision signal (for example, equipment 100 use display 547 as secondary monitor).In some embodiments, use shown on the touch screen 112 of equipment 100 Family interface is synchronous with user interface shown on the display 547 of system 540, and in some other embodiments, equipment Shown user interface is not synchronous with user interface shown on the display 547 of system 540 on 100 touch screen 112. In some embodiments, system 540 is sent to equipment 100 corresponds to user's input (for example, the user on display 547 touches Input is inputted by the user of control 548) information, and equipment 100 according to the received information of institute come more new equipment 100 Touch screen 112 on shown user interface.

User interface and associated process

Attention is drawn to can be in electronic equipment (such as equipment 300 or portable with display and touch sensitive surface Formula multifunctional equipment 100) on the embodiment of user interface (" UI ") and associated process realized.

Fig. 6 A-6C shows showing from the template generation being used together with third party application in accordance with some embodiments Example property user interface.User interface in these attached drawings be used to demonstrate the process being described below, including the mistake in Fig. 7 A-7I Journey.

Fig. 6 A shows user interface templates 601 shown on the display 547 of external information display systems 540.? In some embodiments, system 540 includes in the car (for example, in the instrument board or steering wheel of vehicle).In some embodiments In, display 547 is configured as receiving the touch-screen display of user's touch input.Fig. 6 A is also shown including application program Title bar 602, default main menu 604, customized menus 608, content selection view 606, campaign item column 610 and exit button 612 multiple user interface objects (being called " showing can indicate " or " optional user interface object " sometimes herein).One In a little embodiments, user interface templates are shown and can be indicated comprising less compared with shown in template 601, to be further simplified use Family interface and prevent system for distraction of driver.

Fig. 6 B is shown from user interface templates 601 (for example, being used together with Internet radio application program) generation The example of user interface.Fig. 6 B shows answering for the title of display current application program (for example, Internet radio application program) With program header column 602, the main menu 604 with default control (for example, upward, downward, search, classification etc.), has and apply The customized menus 608 of program dedicated controls (for example, filtering collection, addition are currently to the collection for corresponding to special function) (for example, collection menu) and exit button 612.Fig. 6 B also shows the selection option (example that display is used for current application program Such as, soft jazz station 103, South Korea's pop music radio station 105 etc.) content selection view 606 (for example, radio station selection), And campaign item column 610 of the display about the information of the project (for example, Hard Rock music radio station 101) of current active.

Fig. 6 C shows the user generated from user interface templates 601 (for example, being used together with music libraries application program) The example at interface, the user interface are different from the user interface generated shown in Fig. 6 B from template 601.Fig. 6 C shows display The application tile column 602 of the title of current application program (for example, music libraries App), have default control (for example, upwards, Downwards, search for, classify etc.) main menu 604, have application-specific control (for example, playlist 1, playlist 2 etc.) Customized menus 608 (for example, user's playlist menu) and exit button 612.Fig. 6 C also shows display for currently answering With the content selection view 606 of the selection option of program (for example, storage song 103, storage song 105 etc.) (for example, song Library), and campaign item column 610 of the display about the information of the project (for example, storage song 101) of current active.

As shown in Fig. 6 B-6C, common template (for example, template 601 shown in Fig. 6 A) is by will be from different thirds The information that square application program retrieves is inserted into user interface templates 601, is optionally used for generating for different thirds The different user interface of square application program is (for example, shown in Fig. 6 B not for the user interface of Internet radio application program It is same as being used for the user interface of music libraries application program shown in Fig. 6 C).However, different user shown in Fig. 6 B and Fig. 6 C Similarity is enjoyed at interface, so that they are easier to using (for example, being used in user interface the two in Fig. 6 B and Fig. 6 C Showing for Playable content of selection can indicate to be displayed in content selection view 606；And user circle in Fig. 6 B and Fig. 6 C In the two of face, the information about the media being currently played is displayed in campaign item column 610).In addition, template is optionally Force minimum size text, to ensure that text shown in the user interface in Fig. 6 B and Fig. 6 C is easy to read.

Fig. 7 A-7I is the side for showing a kind of user interface of the offer in accordance with some embodiments for third party application The flow chart of method 700.This method 700 is in electronic equipment (for example, the equipment 300 in Fig. 3 or the portable multi-function in Figure 1A are set Standby 100) place is performed.In some embodiments, electronic equipment includes display and touch sensitive surface.In some embodiments, it shows Show that device is touch-screen display, and touch sensitive surface is over the display.In some embodiments, display and touch sensitive surface are point It opens.Some operations in method 700 are optionally combined and/or the sequence of some operations is optionally changed.

As described below, method 700 provide for third party application mitigation user with third-party application journey The user interface of cognitive load when sequence interaction, to create more effective man-machine interface.For battery-driven electronic equipment, It allows users to faster and more effectively interact with user interface and saves electric power and increase between battery charging Time.

The equipment receives (702) in the respective display for communicating with electronic equipment and (passing through wired connection or wireless connection) Show the first display request of the user interface of the first third party application.For example, the equipment is from related to respective display Control or control associated with electronic equipment come receive correspond to activation be used for the first third party application application journey Sequence starts the input of icon (for example, being used for the Internet radio icon 442 of Internet radio application program 142 (Figure 1A or Fig. 3) Flick gesture on (Fig. 4 A), or it is used for the music libraries icon 432 (Fig. 4 A) of music libraries application program 155 (Figure 1A or Fig. 3) Flick gesture).In some embodiments, respective display is the display of the equipment (for example, portable multifunction device 100 touch screen 112).In some embodiments, respective display is the display that separates with equipment (for example, outer in Fig. 5 The display 547 of portion's information display system 540).

In response to receiving the first display request (704), it is by multiple thirds that equipment, which obtains (706) to be configured (or design), The first user interface templates that square application program uses；And the equipment requests (710) to be used for from the first third party application Fill one or more values of the first user interface templates.In some embodiments, the first user interface templates be by it is multiple not Unrelated (or irrelevant) user interface templates of the general or application program used with application program.For example, in some implementations In example, which obtains user interface templates 601 shown in Fig. 6 A.

In some embodiments, respective display is that the visible information of vehicles of pilot set of (708) from vehicle is shown Display in system；And the first user interface templates are one of multiple predetermined user interface templates, multiple pre- First determining user interface templates are configured in user circle for generating in respective display and being used for third party application Face, to prevent system for distraction of driver (for example, multiple predetermined template has big font and several easily chooses Option, these options can be operated by driver without making driver divert attention from safe driving).Therefore, in some embodiments, It enables a device to provide a user to one or more third-party application journeys using these predetermined user interface templates Functional access of sequence, while some controls of the appearance to user interface shown in respective display are maintained, so as to Ensure the user interface in respective display be use it is simple and intuitive.

In some embodiments, the value at the first third party application is arranged (711) into the tree including multiple nodes Structure, multiple node with predetermined characteristic and with the other nodes of one or more of the tree construction there is tree to close It is (for example, father's relationship or subrelation).In some embodiments, to the one or more for filling the first user interface templates The request of value includes one or more of following：Value corresponding with the child list of the respective nodes of multiple nodes to return Request (for example, for correspond to artistical node, child node correspond to the artistical song or the artistical phase Volume)；Request to value corresponding with the characteristic list of the respective nodes of multiple nodes is returned；Offer is indicated by respective nodes The request of content is (for example, to providing and audio file, audio stream, video file, video flowing and/or playlist or broadcast electricity The request of the corresponding audio content of platform, playlist or broadcasting station are corresponding with the content of multiple and different units)；To offer matching The request of the node listing of search inquiry to providing one group of one or more search term of matching and optionally connecting (for example, search The list of artists of the logical operator of rope word, album list, list of songs, broadcasting station list, talking book list, podcast The request of list etc.)；And to provide specific to the first third party application action lists request, these movement be Can be carried out when providing to the access of content associated with the first third party application (for example, " liking ", " skipping ", " add Add to collection ", " label " or other dedicated operations).In some embodiments, the characteristic of respective nodes includes one in following Person or more persons：The original image of respective nodes, the identifier of respective nodes, media content associated with respective nodes it is lasting when Between, the subtitles of the title (title of the track or broadcasting station that are currently played) of respective nodes, respective nodes (for example, The track in the artist for the song being currently played or the broadcasting station being currently played), instruction respective nodes whether may be used Playable label, the played label that whether has played of instruction respective nodes, and/or the instruction respective nodes played whether be The Container Tag of container with child node.

When the first third party application is just run on an electronic device, which connects from the first third party application It receives (712) and is used to fill the first class value of the first user interface templates (for example, receiving the name column in internet streaming broadcasting station Table).For example, Fig. 6 B shows the use of the data filling using the application program from entitled " Internet radio application program " Family interface template 601.

In some embodiments, by the first third party application in response to for filling the first user interface templates The requests of one or more value, from remote source (for example, the server communicated with the first third party application, in such as Fig. 5 Server 510) one or more values in (713) first class values of retrieval.For example, when streaming Internet broadcasting station has been selected When for playing, the first third party application, which initiates to send to remote server, starts to transmit as a stream streaming Internet radio electricity The request of platform, and request the title of song and the artist for the song to play on streaming Internet broadcasting station and right Answer photograph album original image.First third party application receives these values and these values is transferred to intermediate process, to be integrated to this Intermediate process will be transmitted in " playing now " user interface templates of respective display.

In some embodiments, which includes the personal digital assistant process (example that (714) have speech recognition capabilities Such as, personal digital assistant 150, the personal digital assistant 150 record voice command and will indicate recorded voice command The server 510 that information is sent in server, such as Fig. 5 is with for analyzing, and based on the response from server to language Sound order makes a response).In some embodiments, which is based on coming from the first third party application opposite direction third-party application The response of multiple requests of PROGRAMMED REQUESTS value determines that the ability of (715) first third party applications, these values are used for filling The user interface templates of the user interface of respective display are associated (for example, personal digital assistant process traversal is for the one the The tree construction of the metadata of tripartite's application program, and map out through the addressable various options of the first third party application And metadata).In some embodiments, the equipment generate (716) first third party applications ability index (for example, Mapping graph based on the various options and metadata that can pass through the access of the first third party application).In some embodiments, should Equipment provides (718) to the voice access of the ability of the first third party application (for example, making by personal digital assistant process User be able to use voice command request particular artist list of songs display, can be used for play internet streaming The display of broadcasting station list, the playback of the particular songs of particular artist, or search all over display advertising application program to obtain The media of search inquiry with oral statement).For example, traversal is used in personal assistant for streaming Internet radio application program In available streaming Internet broadcasting station and the first number for the other operations that can be executed by streaming Internet radio application program According to tree construction and establish the metadata tree construction index.Then, it allows users to provide to personal digital assistant Speech order is to start to play broadcasting station, stop playing broadcasting station, based on current song create new broadcasting station, skip Song or using be related to personal digital assistant voice command (for example, " assistant please play the broadcasting station artist X ", " help Reason please skip this song song ", " assistant please list all broadcasting stations of creation last week " or " assistant please mark this song bent As favorite ") carry out other operations.

In some embodiments, whether equipment detection (720) predetermined condition has met.In response to detecting Predetermined condition has met, which redefines the ability of (721) first third party applications and give birth to again At the list of the ability of the first third party application (for example, the first third-party application journey can be passed through by rebuilding in following situations The index of the various options of sequence access：The equipment is placed with and the respective display (such as (figure of external information display systems 540 5) display 547) communication, the equipment be connected to vehicle information display, and/or a third including respective display Square application program is activated.) for example, for streaming Internet radio application program, the availability of streaming Internet broadcasting station The availability of the internet connection for receiving streaming Internet broadcasting station is optionally based on to determine；Similarly, if with Old broadcasting station is quit the subscription of in family creation/the new broadcasting station of subscription or deletion/, then related to streaming Internet radio application program The metadata of connection changes (for example, it is playable which broadcasting station, which is node and/or which broadcasting station in tree construction). In order to which the metadata of the change at convection type Internet radio application program is addressed, it is mutual to rebuild streaming to the device periodically The index for the metadata networked at broadcast application is (for example, when streaming Internet radio application program is activated, or when should When equipment is connected to vehicle information display).In some embodiments, third party application initiatively notifies digital Certain a part of people assistant's metadata has changed or has updated, and personal digital assistant is prompted to rebuild third party application The index of the part (or all) of metadata.In response to receiving the information or third party that the part of metadata has changed Application program is activated next time, and personal digital assistant rebuilds the part (or all) of the metadata of third party application Index.

The equipment utilization fills (722) first user interface moulds from received first class value of the first third party application Plate.For example, according to these embodiments, Fig. 6 B is shown to be answered using the third party from entitled " Internet radio application program " Display 547 is used for the data filling of program (for example, radio station selection, collection, radio present etc.) to generate in Fig. 6 C The user interface templates 601 of the user interface of upper shown third party application.

In some embodiments, the first user interface templates are used by multiple and different third party applications, multiple Different third party applications includes (724) first third party applications and the second third party application.In some realities It applies in example, includes using from the received value of corresponding third party application to fill the first user interface templates：To be shown to corresponding Predefined font size in the user interface of device offer is provided, the first kind will be identified to belong to by corresponding third party application The value of value is inserted in predefined region.For the first user interface templates, the first third party application is by the first kind Information is identified as first kind value, and the second third party application will differ from the Second Type information knowledge of first kind information It Wei not first kind value.For example, Fig. 6 B shows the user interface templates 601 using value relevant to Internet broadcasting station filling, And Fig. 6 C shows the user interface templates 601 using value relevant to the song stored filling.According to these embodiments, scheme 6B and Fig. 6 C shows the user interface templates with same font size.

In some embodiments, for the first user interface templates：In first third party application will be remotely generating The title identification (726) for holding radio station (for example, streaming Internet broadcasting station) is first kind value；And the second third-party application journey The title of predetermined playlist is identified as first kind value by sequence.In some embodiments, predetermined playlist Different from streaming Internet broadcasting station, because predetermined playlist has the interior of setting length and the playlist Appearance is the setting when user selects the playlist to be used to play, and streaming Internet broadcasting station is that have not determine length Music continuous flow, which continues to listen to the equally long time with user and including remotely (for example, by computer root Automatically according to the selection of music algorithm, or by disc jockey, Disk Jockey or with by the user of equipment it moves Make unrelated other people manually) content of selection.For example, the equipment is for the Internet radio in Fig. 6 B in Fig. 6 B-6C The title of streaming Internet broadcasting station is identified as first kind value (for example, right by application program (for example, such as 142 in Figure 1A) The description of play medium content item), and the equipment is directed to the music libraries application program in Fig. 6 C (for example, as in Figure 1A 155) title of song is identified as first kind value.

In some embodiments, for the first user interface templates：First third party application by streamable extremely The content of the equipment is (for example, music or other media contents are passed by the program request streaming of distributed data network such as internet It is defeated) title identification (728) be first kind value；And content (example of second third party application by storage on the device Such as, language learning programs, talking book, music, podcast etc.) title be identified as first kind value.

The equipment generates (730) using the first user interface templates filled using the first class value for the first third party First user interface of application program.For example, Fig. 6 B is shown from user interface templates 601 and from Internet radio application program The user interface that received value generates.According to this example, Fig. 6 B is shown：Default main menu 604, which includes Information button (for example, for returns corresponding to respective nodes characteristic list value), activator button (for example, for offer by Respective nodes indicate content), search button (for example, for provides match search inquiry node listing)；And has and determine (for example, for providing the action lists specific to the first third party application, these movements are in offer to for button processed Can be carried out when the access of the associated content of one third party application) customized menus 608.

In some embodiments, which includes (732) multiple processes, and multiple process includes：For running the one the First third party application process of tripartite's application program, and for relaying respective display and the first third-party application journey The one or more intermediate processes of one group of information between sequence process for integrating third party application and vehicle (for example, believe Display system (such as navigation or entertainment systems) or other external information display systems are ceased (as the external information in Fig. 5 shows system The application program of system 540)).In some embodiments, asking to one or more values for filling the first user interface templates Seeking Truth is generated by the intermediate process from one group of one or more intermediate process；And the first user interface is by from one group one The intermediate process of a or multiple intermediate processes generates.For example, smart phone (for example, portable multifunction device 100 in Fig. 5) With vehicle integration application 151 (e.g., including the application program of one or more intermediate processes), the integrated application of the vehicle Program 151 controls the vehicle information display in vehicle (for example, automobile, truck, lorry etc.), thus aobvious in the information of vehicles Show and provide user interface in the respective display (for example, display 547 of the external information display systems 540 in Fig. 5) of system, The user interface is all for example for mapping application program or music application.Smart phone also has one or more third parties Application program, such as independent podcast application program or streaming Internet radio application program, and vehicle integration application Information from third party application is converted into being used for showing by vehicle integration application and shows system in information of vehicles Content in the respective display of system.

In some embodiments, the first third party application is (734) media presentation application program (for example, in Figure 1A Internet radio 142).In some embodiments, which includes first party application program, which is matchmaker Application program (for example, video and musical player module 152 in Figure 1A) is presented in body；First party application program includes first party User interface, corresponding position of the first party user interface in the first party user interface have for requesting media presentation The execution of operation it is multiple it is selectable show can indicate and region is presented (for example, available for showing in one or more content The region of the list of media)；And it generates and includes for the first user interface of the first third party application：Generation includes can The showing of selection can indicate and the user interface in one or more contents presentation region, it is selectable show can indicate and one or more Content present region in function and position corresponding to first party user interface it is selectable show can indicate and content presentation area Domain.Therefore, in some embodiments, the first user interface templates are to make the complying with standard of information from third party application The template of user interface, the standardized user interface have the control similar to first party media presentation application program, content regions Domain and appearance, to provide user when being displayed on the visible vehicle information display of pilot set from vehicle Known consistent user interface and therefore prevent system for distraction of driver.

The equipment sends (736) to respective display or is provided in other ways so that being used for the first third party application The first user interface can be displayed on the information in respective display (for example, portable multifunction device 100 is into Fig. 5 External information display systems 540 display 547 provide information).

In some embodiments, when the first user interface for the first third party application is displayed on corresponding display When on device, which (for example, the touch sensitive surface being overlapped with respective display, or uses from the input equipment for respective display In the button or knob of control respective display) (738) accordingly input is received, which corresponds to the first user interface In option selection (for example, selected option is for playing, suspending, search, showing new menu or execute specific to the The option of the operation of tripartite's application program, the operation all for example " liking ", " skipping " or " being added to collection ").In response to connecing Corresponding input is received, which provides (740) to the first third party application just run on an electronic device and make first The information that third party application can make a response the selection of the option in the first user interface.In some embodiments, The equipment receives the response of (742) from the first third party application to the selection of option from the first third party application； And (744) are sent to respective display or are provided in other ways so that being provided the response of the selection of option (for example, aobvious Show) to the information of user.For example, showing the list of streaming Internet broadcasting station title to user in respective display, use The title of corresponding streaming Internet broadcasting station is tapped (for example, the touch screen of the external information display systems 540 in Fig. 5 in family On display), intermediate process at the equipment (for example, portable multifunction device 100 in Fig. 5) is to the first third-party application Program provides the information that corresponding streaming Internet broadcasting station has been selected in instruction, the first third party application request server (for example, server 510 in Fig. 5) provides original image, title, subtitle and the audio stream of corresponding streaming Internet broadcasting station simultaneously And this information is provided then to intermediate process (for example, portable multifunction device 100 at) in Fig. 5, the intermediate process base In the information and user interface templates generate user interface and by user interface generated be transmitted to respective display with In display (for example, on display 547 of the external information display systems 540 in Fig. 5).

In some embodiments, process transfer respective display and the in the following manner among first party at the equipment Communication between one third party application：By the data conversion from the first third party application at standardization, simplification User interface to prevent the driving diverted attention, and by relaying with there is the user interface being shown in respective display The corresponding input of user's interaction, so that the first third party application can make a response input, even if answering in the first third party The size for indicating respective display, the information of resolution ratio and other characteristics are not provided with program and are not had to user and phase When answering the direct access authority of the interaction of user interface shown on display.For example, third party application is not provided with The time of touch input and position, but obtain and request what information as by process filtering among first party about user Information.

In some embodiments, when the first user interface of the first third party application is displayed in respective display (746) when, which receives (748) instruction to the selection of respective selection in the first user interface (for example, to container or with son The selection of the node (such as including " artist " file of selected artistical song) of node, or to multiple internets The selection in the specific internet streaming broadcasting station in streaming broadcast radio station) information.In some embodiments, in response to receiving To instruction to the information (750) of the selection of respective selection in the first user interface：The equipment obtains (752) and is different from the first user Interface template second user interface template (for example, for show container content template, such as playlist template or " playing now " user interface templates)；And from the first third party application request (754) for filling second user circle One or more values of face die plate.In some embodiments, when the first third party application is just run on an electronic device, The equipment from the first third party application receive (756) for fill second user interface template the second class value (for example, with In the title and play time information of the selected artist-song of playlist template, or for " playing now " template The title in currently playing broadcasting station, the title of currently playing song, the original image of currently playing song)；Using from One third party application received second class value fills (758) second user interface template；By using second group of utilization Be worth filling second user interface template, generate (760) for the first third party application second user interface (for example, The title of selected artistical song and play time information are inserted into playlist template, or will be currently playing wide The original image for broadcasting the title in radio station, the title of currently playing song and currently playing song is inserted into " playing now " mould In plate, being somebody's turn to do " playing now " template includes for controlling pause/beginning/stopping/F.F./retroversion currently playing song control Part)；And (762) are sent to respective display or are provided in other ways so that being used for the second of the first third party application User interface can be displayed on the information in respective display.

In some embodiments, it is being sent to respective display so that being used for the first user of the first third party application Interface can be displayed on after the information in respective display (764), which receives (766) and show in respective display Second display request (example of the user interface for second third party application different from the first third party application Such as, use control associated with respective display or control associated with electronic equipment is received to answer for the second third party With the activation of the application program launching icon of program).For example, initially playing in user from internet streaming broadcasted application journey When audio (for example, using the user interface for being used for streaming Internet radio application program shown in Fig. 6 B) of sequence 142, user It switches to and plays the audio from independent podcast application program or talking book application program.In some embodiments, it responds In receive the second display request, the equipment from the second third party application request (768) be used for fill the first user interface One or more values of template；When the second third party application is just run on an electronic device, from the second third-party application Program receives the third class value that (770) are used to fill the first user interface templates；It is received using from the second third party application Third class value fill (772) first user interface templates；Use the first user interface templates using the filling of third class value To generate the second user interface of (774) for the second third party application；And to respective display send (776) (or There is provided in other ways) make the second user interface for the second third party application (for example, being used for shown in Fig. 6 C The user interface of music libraries application program 155) it is shown in the information in respective display.Therefore, in some embodiments, when asking When seeking the different third party applications using identical first user interface templates, which is repeated from third party application Value request is to fill the processes of the first user interface templates.In the case, this process repeats, because of the first user interface templates It is to be specially designed or configured to be used by multiple and different third party applications.

In some embodiments, it is being sent to respective display so that being used for the first user of the first third party application Interface can be displayed on after the information in respective display (764)：The equipment is received from the first third party application (778) for filling updated first class value of the first user interface templates.In some embodiments, in response to receiving use In updated first class value (780) for filling the first user interface templates, the equipment utilization is from the first third party application Received updated first class value fills (782) first user interface templates；It is filled out using using updated first class value The first user interface templates filled generate (784) for the first third party application first user interface；And to phase Answering display to provide (786) enables updated first user interface for the first third party application to be displayed on Information in respective display.In some embodiments, updated first class value is based in the first third party application Locate the event occurred to determine (for example, being by the first third to the update of the user interface for the first third party application Square application program is initiated, rather than is initiated by intermediate process).For example, third party application is streaming video application program, and And the data connection of the equipment ceases to function.In response to detecting that data connection has ceased to function, third party application to Intermediate process transmission information at the equipment, information instruction are previously marked as " can play " (for example, when there are operational datas When connection) the state of flowing content changed so that the content be " not can play " (for example, because data connection no longer It is available).In some embodiments, it when content is changed to " not can play " from " playable ", is answered for the first third party With the first user interface of program be updated to indicate that the content be " not can play " (for example, by by the content from can play It is removed in the list of content, or the contrast by reducing the displaying or display " not can play " figure near the displaying of the content Mark or symbol change the appearance of the displaying of the content, are currently playable to indicate the content not).For example, in Fig. 6 B In, if the equipment terminates the access to streaming Internet broadcasting station shown in content selection view 606, which will be weighed User interface shown in newly-generated Fig. 6 B, to reflect the unavailability of streaming Internet broadcasting station (for example, by adjacent Title in unavailable radio station, which is shown, not can play icon, and the contrast by reducing unavailable radio station (becomes unavailable radio station " Ash "), or by removing radio station from content selection view 606).

It should be appreciated that be only exemplary to the concrete order for the operation being described in Fig. 7 A-7I, not purport Showing that the order is the but one sequence that can execute these operations.Those skilled in the art will recognize that various modes To resequence to operations described herein.

According to some embodiments, Fig. 8 is shown to be set according to the first electronics of the principle configuration of various described embodiments Standby 800 functional block diagram.Hardware, soft of the functional block of the equipment optionally by carrying out the principle of various described embodiments The combination of part or hardware and software is realized.It will be understood by those of skill in the art that functional block described in Fig. 8 is optionally It is combined or is separated into sub-block, to realize the principle of various described embodiments.Therefore, the optional twelve Earthly Branches of description herein It holds any possible combination of functional block described herein or separates or further limit.

As shown in figure 8, electronic equipment 800 includes the memory for being couple to processing unit 802.In some embodiments, electric Sub- equipment 800 further includes communications interface unit 804, which is couple to processing unit 802 and is configured as It is communicated with respective display unit 806.In some embodiments, processing unit 802 include receiving unit 807, obtaining unit 808, Request unit 810, fills unit 812, interface generation unit 814, transmission unit 816, information provider unit 818, determination unit 820, generation unit 822 is indexed, voice provides unit 824, detection unit 826 and digital assistant unit 828.Processing unit 802 It is configured as receiving (for example, passing through communications interface unit 804 using receiving unit 807) in the phase communicated with electronic equipment 800 It answers and shows the first of the user interface (for example, using respective display unit 806) of the first third party application on display unit Display request.Processing unit 802 is further configured in response to receiving the first display request：It obtains (for example, using obtaining Unit 808) it is configured as the first user interface templates used by multiple third party applications；And it is answered from the first third party It is used to fill one or more values of the first user interface templates with PROGRAMMED REQUESTS (for example, utilizing request unit 810).Processing is single Member 802 is further configured to：When the first third party application is just run on an electronic device, from the first third-party application Program receives (for example, utilizing receiving unit 807 or communications interface unit 804) for filling the first of the first user interface templates Class value；It is used using from received first class value of the first third party application to fill (for example, using fills unit 812) first Family interface template；It is generated using the first user interface templates filled using the first class value (for example, using interface generation unit 814) it is used for the first user interface of the first third party application；And it sends to respective display unit (for example, using sending Unit 816) enable the first user interface for the first third party application to be displayed on respective display unit (example Such as, respective display unit 806) on information.

In some embodiments, processing unit 802 is further configured to：When for the first third party application When one user interface is displayed in respective display unit (for example, respective display unit 806), from for respective display unit Input equipment receives (for example, passing through communications interface unit 804 using receiving unit 807) and corresponds to in the first user interface The corresponding input of the selection of option；And in response to receiving corresponding input, to the first third just run on an electronic device Square application program provides (for example, utilizing information provider unit 818) and enables the first third party application to the first user The information that the selection of option in interface makes a response.In some embodiments, processing unit 802 is further configured to：From First third party application receives (for example, passing through communications interface unit 804 using receiving unit 807) and comes from the first third party Response of the application program to the selection of option；And it sends (for example, utilizing transmission unit 816) to respective display unit to make pair The response of the selection of option is provided to the information of user.

In some embodiments, processing unit 802 is further configured to, when for the first third party application When one user interface is displayed in respective display unit (for example, respective display unit 806)：It receives (for example, single using receiving Member 807 passes through communications interface unit 804) instruction is to the information of the selection of respective selection in the first user interface；And in response to Instruction is received to the information of the selection of respective selection in the first user interface：It is different to obtain (for example, utilizing obtaining unit 808) In the second user interface template of the first user interface templates；And it requests from the first third party application (for example, using asking Seek unit 810) for filling one or more values of second user interface template.In some embodiments, 802 quilt of processing unit It is further configured to：When the first third party application is just run on an electronic device, connect from the first third party application (for example, passing through communications interface unit 804 using receiving unit 807) is received for filling second group of second user interface template Value；(for example, using fills unit 812) second user is filled using from received second class value of the first third party application Interface template；It is generated by using the second user interface template filled using the second class value (for example, being generated using interface single 814) member is used for the second user interface of the first third party application；And it sends to respective display unit (for example, using hair Send unit 816) enable the second user interface for the first third party application to be displayed on respective display unit (example Such as, respective display unit 806) on information.

In some embodiments, processing unit 802 is further configured to：It is being sent to respective display unit (for example, benefit With transmission unit 816) enable the first user interface for the first third party application to be displayed on corresponding display list After information in first (for example, respective display unit 806), receive (for example, utilizing receiving unit 807 or communications interface unit 804) display is used for different from the first third party application in respective display unit (for example, respective display unit 806) Second display request of the user interface of the second third party application.In some embodiments, processing unit 802 is further It is configured to：In response to receiving the second display request, request from the second third party application (for example, utilizing request unit 810) for filling one or more values of the first user interface templates；When the second third party application just on an electronic device When operation, (for example, passing through communications interface unit 804 using receiving unit 807) is received from the second third party application and is used for Fill the third class value of the first user interface templates；It is filled using from the received third class value of the second third party application (for example, utilizing fills unit 812) first user interface templates；Use the first user interface templates using the filling of third class value To generate the second user interface of (for example, using interface generation unit 814) for the second third party application；And to phase Display unit transmission (for example, using transmission unit 816) is answered to make the second user interface for the second third party application The information that can be displayed in respective display unit (for example, respective display unit 806).

In some embodiments, which includes multiple processes, and multiple process includes：It is answered for running the first third party With the first third party application process of program, and for relay respective display unit and the first third party application into The one or more intermediate processes of one group of information between journey；To one or more values for filling the first user interface templates Request be by the intermediate process generation from one group of one or more intermediate process；And the first user interface is by from one The intermediate process of the one or more intermediate processes of group generates.

In some embodiments, by the first third party application in response to for filling the first user interface templates One or more values in the first class value are retrieved in the request of one or more value from remote source.

In some embodiments, respective display unit (for example, respective display unit 806) is the pilot set from vehicle Display unit in visible vehicle information display；And the first user interface templates are multiple predetermined users circle One of face die plate, multiple predetermined user interface templates are configured in respective display unit and generate for the The user interface of tripartite's application program, to prevent system for distraction of driver.

In some embodiments, the first user interface templates are used by multiple and different third party applications, multiple Different third party applications includes the first third party application and the second third party application；Using from corresponding third The square received value of application program fills (for example, utilizing fills unit 812) first user interface templates and includes：To be shown to corresponding The predefined font size in user interface that unit provides, will be identified to belong to the first kind by corresponding third party application The value of value is inserted in predefined region；Also, it is directed to the first user interface templates：First third party application is by first Type information is identified as first kind value；And the second third party application will differ from the Second Type letter of first kind information Breath is identified as first kind value.

In some embodiments, for the first user interface templates：In first third party application will be remotely generating The title for holding radio station is identified as first kind value；And the second third party application knows the title of predetermined playlist It Wei not first kind value.

In some embodiments, for the first user interface templates：First third party application can be continuously streamed Title to the content of the equipment is identified as first kind value；And the second third party application will be stored in the equipment The title of content is identified as first kind value.

In some embodiments, the value at the first third party application is arranged to the tree construction including multiple nodes, Multiple node has tree relationship with predetermined characteristic and with the other nodes of one or more of the tree construction；And And under including to the request (for example, utilizing request unit 810) of one or more values for filling the first user interface templates One or more of column：Request to the value for the child list for returning to the respective nodes corresponded in multiple nodes；To returning Return the request of the value of the characteristic list of the respective nodes corresponded in multiple nodes；To providing the content indicated by respective nodes Request；Request to the node listing for providing matching search inquiry；And to providing specific to the first third party application The request of action lists, these movements are can be into when providing to the access of content associated with the first third party application Capable.

In some embodiments, the first third party application is media presentation application program.In some embodiments, if Standby 800 include first party application program, which is media presentation application program；First party application program includes First party user interface, corresponding position of the first party user interface in the first party user interface have for requesting matchmaker Body present operation execution it is multiple it is selectable show can indicate and one or more content presentation region；And generate (example Such as, interface generation unit 814 is utilized) include for the first user interface of the first third party application：It includes optional for generating Showing of selecting can indicate and one or more contents are presented the user interface in region, it is selectable show can indicate in one or more Hold present region in function and position corresponding to first party user interface it is selectable show can indicate and content presentation region.

In some embodiments, processing unit 802 is further configured to, and is sent to respective display unit so that being used for First user interface of the first third party application can be displayed on respective display unit (for example, respective display unit 806) after the information on：It receives from the first third party application (for example, passing through communication interface list using receiving unit 807 Member is 804) for filling updated first class value of the first user interface templates；Also, it is used to fill the in response to receiving Updated first class value of one user interface templates：Using received updated first group from the first third party application Value fills (for example, using fills unit 812) first user interface templates；Use what is filled using updated first class value First user interface templates come generate (for example, using interface generation unit 814) for the first third party application update The first user interface afterwards；And it provides (for example, utilizing information provider unit 818) to respective display unit to make for first Updated first user interface of third party application can be displayed on the information in respective display unit.

In some embodiments, equipment 800 includes having the personal digital assistant process of speech recognition capabilities (for example, number Word assistant unit 828).In some embodiments, processing unit 802 is further configured to：It is answered based on the first third party is come from With the response of multiple requests of program opposite direction third party application value request, (for example, utilizing determination unit 820) first is determined The ability of third party application, these values are related for the user interface templates of user interface of respective display unit to filling Connection；Generate the index of the ability of (for example, using index generation unit 822) first third party application；And pass through number Personal assistant process (for example, utilizing digital assistant unit 828) provides (for example, utilize voice provide unit 824) to the one the The voice access of the ability of tripartite's application program.

In some embodiments, processing unit 802 is further configured to：It is pre- to detect (for example, utilizing detection unit 826) First whether determining condition has met；Also, in response to detecting that predetermined condition has met：Redefine (example Such as, determination unit 820 is utilized) ability of the first third party application；And it regenerates (for example, being generated using index single The index of first 822) ability of the first third party application.

Operation in above- mentioned information processing method is optionally by one or more functions in operation information processing unit Module realizes, all for example general processors of the information processing unit (for example, as above in regard to described by Figure 1A and Fig. 3) or Specific to the chip of application.

The operation above with reference to described in Fig. 7 A-7I is optionally realized by Figure 1A -1B or component depicted in figure 8.Example Such as, receive operation 702 and 712, request operation 710, padding 722, generate operation 730 and send operation 736 optionally by Event classifier 170, event recognizer 180 and button.onrelease 190 are realized.Event monitor in event classifier 170 Device 171 detects the contact on touch-sensitive display 112, and event information is transmitted to using journey by Event scheduler module 174 Sequence 136-1.Event information is defined 186 with corresponding event and is compared by the corresponding event identifier 180 of application program 136-1, And whether determine the first contact on touch sensitive surface at first position (or the orientation of the equipment whether) correspond to it is predefined The rotation that event or subevent, such as selection to the object in user interface or the equipment are orientated from an orientation to another Turn.When detecting corresponding predefined event or subevent, event recognizer 180 activates and detects the event or sub- thing The associated button.onrelease 190 of part.Button.onrelease 190 optionally uses or calls data renovator 176 or object Renovator 177 carrys out more new application internal state 192.In some embodiments, button.onrelease 190 accesses corresponding GUI Renovator 178 carrys out the content that more new application is shown.Similarly, those skilled in the art, which can know clearly, is based on scheming How component shown in 1A-1B can realize other processes.

For purposes of explanation, the description of front is described by reference to specific embodiment.However, above Illustrative discuss is not intended to be the precise forms disclosed in being also not intended to limit the invention in detail.According to Above teaching content, many modifications and variations are all possible.Selection and description embodiment are to most preferably explain Bright the principle of the present invention and its practical application, so as to so that others skilled in the art can most preferably have in use It is suitable for the described embodiment of the invention and various of the various modifications of conceived special-purpose.

Claims (22)

1. a kind of method for generating user interface for third party application, including：

Reception shows first in the respective display communicated with the electronic equipment with one or more processors and memory First display request of the user interface of third party application, the respective display and the display on the electronic equipment It separates and different；

In response to receiving the first display request：

Obtain the first user interface templates for being configured as being used by multiple third party applications；And

From first third party application, one or more values for filling first user interface templates are requested；

When being run on first the third party application electronic equipment, from first third party application Receive the first class value for filling first user interface templates；

First user interface templates are filled using from received first class value of first third party application；

It is answered to generate for first third party using first user interface templates filled using first class value With the first user interface of program；And

First user interface enabled for first third party application is sent to the respective display The information being displayed in the respective display；

Wherein：

First third party application is media presentation application program；

The equipment includes first party application program, and the first party application program is media presentation application program；

The first party application program includes first party user interface, and the first party user interface is in first party user circle Corresponding position in face have the execution for requesting media presentation to operate it is multiple it is selectable show can indicate and one Or region is presented in multiple contents；And

It generates and includes for first user interface of first third party application：It generates and the first party application The first party user interface of program is different, including it is selectable show can indicate and region is presented in one or more contents User interface, it is described it is selectable show can indicate and one or more of contents present region correspond in function and position The first party user interface it is described it is selectable show can indicate and the content present region.

2. according to the method described in claim 1, wherein：

First user interface templates are used by multiple and different third party applications, and the plurality of different third party answers It include first third party application and the second third party application with program；

Include using first user interface templates are filled from the received value of corresponding third party application：With to described corresponding The predefined font size in user interface that display provides, will be identified to belong to by the corresponding third party application The value of first kind value is inserted into predefined region；And

For first user interface templates：

First kind information is identified as the first kind value by first third party application；And

The Second Type information that second third party application will differ from the first kind information is identified as described One kind value.

3. according to the method described in claim 2, being wherein directed to first user interface templates：

The title for the stations of content being remotely generating is identified as the first kind value by first third party application；And

The title of predetermined playlist is identified as the first kind value by second third party application.

4. according to the method described in claim 2, being wherein directed to first user interface templates：

First third party application will can be continuously streamed to the title of the content of the equipment and be identified as described first Class value；And

The title of content of second third party application by storage on said device is identified as the first kind value.

5. method according to claim 1 to 4, wherein：

Value at first third party application is arranged to the tree construction including multiple nodes, the multiple node tool There is predetermined characteristic and there is tree relationship with the other nodes of one or more of the tree construction；And

The request to one or more values for filling first user interface templates include it is one of following or More persons：

Return to the request of the value of the child list of the respective nodes corresponded in the multiple node；

Return to the request of the value of the characteristic list of the respective nodes corresponded in the multiple node；

The request of the content indicated by the respective nodes is provided；

The request of the node listing of matching search inquiry is provided；And

There is provided specific to first third party application action lists request, it is described movement be provide to it is described It can be carried out when the access of the associated content of the first third party application.

6. method according to claim 1 to 4, wherein：

The equipment includes having the personal digital assistant process of speech recognition capabilities；And

The method includes：

Based on multiple requests from the opposite first third party application value request of first third party application Response, determine the ability of first third party application, described value and filling are used for the user of the respective display The user interface templates at interface are associated；

Generate the index of the ability of first third party application；And

By the personal digital assistant process, the voice visit to the ability of first third party application is provided It asks.

7. according to the method described in claim 6, including：

Detect whether predetermined condition has met；And

In response to detecting that the predetermined condition has met：

Redefine the ability of first third party application；And

Regenerate the index of the ability of first third party application.

8. a kind of electronic equipment, including：

One or more processors；

Memory；And

One or more programs, wherein one or more of programs are stored in the memory and are configured as by described One or more processors execute, and one or more of programs include instruction, and described instruction is used for：

Receive the user interface that the first third party application is shown in the respective display communicated with the electronic equipment First display request, the respective display and the displays separated and difference on the electronic equipment；

In response to receiving the first display request：

Obtain the first user interface templates for being configured as being used by multiple third party applications；And

From first third party application, one or more values for filling first user interface templates are requested；

When being run on first the third party application electronic equipment, from first third party application Receive the first class value for filling first user interface templates；

First user interface templates are filled using from received first class value of first third party application；

It is answered to generate for first third party using first user interface templates filled using first class value With the first user interface of program；And

First user interface enabled for first third party application is sent to the respective display The information being displayed in the respective display；

Wherein：

First third party application is media presentation application program；

The equipment includes first party application program, and the first party application program is media presentation application program；

The first party application program includes first party user interface, and the first party user interface is in first party user circle Corresponding position in face have the execution for requesting media presentation to operate it is multiple it is selectable show can indicate and one Or region is presented in multiple contents；And

It generates and includes for first user interface of first third party application：It generates and the first party application The first party user interface of program is different, including it is selectable show can indicate and region is presented in one or more contents User interface, it is described it is selectable show can indicate and one or more of contents present region correspond in function and position The first party user interface it is described it is selectable show can indicate and the content present region.

9. a kind of computer readable storage medium for storing one or more programs, one or more of programs include instruction, Described instruction by the electronic equipment with one or more processors and memory when being executed, so that the equipment：

Receive the user interface that the first third party application is shown in the respective display communicated with the electronic equipment First display request, the respective display and the displays separated and difference on the electronic equipment；

In response to receiving the first display request：

Obtain the first user interface templates for being configured as being used by multiple third party applications；And

From first third party application, one or more values for filling first user interface templates are requested；

When being run on first the third party application electronic equipment, from first third party application Receive the first class value for filling first user interface templates；

First user interface templates are filled using from received first class value of first third party application；

It is answered to generate for first third party using first user interface templates filled using first class value With the first user interface of program；And

First user interface enabled for first third party application is sent to the respective display The information being displayed in the respective display；

Wherein：

First third party application is media presentation application program；

The equipment includes first party application program, and the first party application program is media presentation application program；

The first party application program includes first party user interface, and the first party user interface is in first party user circle Corresponding position in face have the execution for requesting media presentation to operate it is multiple it is selectable show can indicate and one Or region is presented in multiple contents；And

It generates and includes for first user interface of first third party application：It generates and the first party application The first party user interface of program is different, including it is selectable show can indicate and region is presented in one or more contents User interface, it is described it is selectable show can indicate and one or more of contents present region correspond in function and position The first party user interface it is described it is selectable show can indicate and the content present region.

10. a kind of electronic equipment for for third party application generation user interface, including：

For receiving user circle for showing the first third party application in the respective display communicated with the electronic equipment The device of the first display request in face, the respective display and the displays separated and difference on the electronic equipment；

The device of following operation is requested and is used in response to receiving first display：

Obtain the first user interface templates for being configured as being used by multiple third party applications；And

From first third party application, one or more values for filling first user interface templates are requested；

For when being run on first the third party application electronic equipment, from first third-party application Program receives the device for filling the first class value of first user interface templates；

For filling first user interface using from received first class value of first third party application The device of template；

It generates for using using first user interface templates of first class value filling for first third The device of first user interface of square application program；And

For being sent to the respective display so that being used for first user interface of first third party application The device of the information in the respective display can be displayed on；

Wherein：

First third party application is media presentation application program；

The equipment includes first party application program, and the first party application program is media presentation application program；

The first party application program includes first party user interface, and the first party user interface is in first party user circle Corresponding position in face have the execution for requesting media presentation to operate it is multiple it is selectable show can indicate and one Or region is presented in multiple contents；And

It generates and includes for first user interface of first third party application：It generates and the first party application The first party user interface of program is different, including it is selectable show can indicate and region is presented in one or more contents User interface, it is described it is selectable show can indicate and one or more of contents present region correspond in function and position The first party user interface it is described it is selectable show can indicate and the content present region.

11. a kind of device for for third party application generation user interface, including：

For receiving the user interface for showing in the respective display communicated with electronic equipment the first third party application The device of first display request, the respective display and the displays separated and difference on the electronic equipment；

The device of following operation is requested and is used in response to receiving first display：

Obtain the first user interface templates for being configured as being used by multiple third party applications；And

From first third party application, one or more values for filling first user interface templates are requested；

For when being run on first the third party application electronic equipment, from first third-party application Program receives the device for filling the first class value of first user interface templates；

For filling first user interface using from received first class value of first third party application The device of template；

It generates for using using first user interface templates of first class value filling for first third The device of first user interface of square application program；And

For being sent to the respective display so that being used for first user interface of first third party application The device of the information in the respective display can be displayed on；

Wherein：

First third party application is media presentation application program；

The equipment includes first party application program, and the first party application program is media presentation application program；

The first party application program includes first party user interface, and the first party user interface is in first party user circle Corresponding position in face have the execution for requesting media presentation to operate it is multiple it is selectable show can indicate and one Or region is presented in multiple contents；And

It generates and includes for first user interface of first third party application：It generates and the first party application The first party user interface of program is different, including it is selectable show can indicate and region is presented in one or more contents User interface, it is described it is selectable show can indicate and one or more of contents present region correspond in function and position The first party user interface it is described it is selectable show can indicate and the content present region.

12. a kind of electronic equipment, including：

One or more processors；

Memory；And

One or more programs, wherein one or more of programs are stored in the memory and are configured as by described One or more processors execute, and one or more of programs include for executing according to claim 1 to method described in 7 Any one of instruction.

13. a kind of computer readable storage medium for storing one or more programs, one or more of programs include instruction, Described instruction by electronic equipment when being executed, so that equipment execution is any into method described in 7 according to claim 1 It is a kind of.

14. a kind of electronic equipment, including：

For executing according to claim 1 to the device of any one of method described in 7.

15. a kind of information processing unit for being used in electronic equipment, including：

For executing according to claim 1 to the device of any one of method described in 7.

16. a kind of electronic equipment, including：

Memory；And

It is couple to the processing unit of the memory, the processing unit is configured as：

Receive the user interface that the first third party application is shown in the respective display unit communicated with the electronic equipment The first display request, the respective display unit separates and different from the display unit on the electronic equipment；

In response to receiving the first display request：

Obtain the first user interface templates for being configured as being used by multiple third party applications；And

From first third party application, one or more values for filling first user interface templates are requested；

When being run on first the third party application electronic equipment, from first third party application Receive the first class value for filling first user interface templates；

First user interface templates are filled using from received first class value of first third party application；

It is answered to generate for first third party using first user interface templates filled using first class value With the first user interface of program；And

First user interface enabled for first third party application is sent to the respective display unit The information being enough displayed in the respective display unit；

Wherein：

First third party application is media presentation application program；

The equipment includes first party application program, and the first party application program is media presentation application program；

The first party application program includes first party user interface, and the first party user interface is in first party user circle Corresponding position in face have the execution for requesting media presentation to operate it is multiple it is selectable show can indicate and one Or region is presented in multiple contents；And

It generates and includes for first user interface of first third party application：It generates and the first party application The first party user interface of program is different, including it is selectable show can indicate and region is presented in one or more contents User interface, it is described it is selectable show can indicate and one or more of contents present region correspond in function and position The first party user interface it is described it is selectable show can indicate and the content present region.

17. electronic equipment according to claim 16, wherein：

First user interface templates are used by multiple and different third party applications, and the plurality of different third party answers It include first third party application and the second third party application with program；

Include using first user interface templates are filled from the received value of corresponding third party application：With to described corresponding The predefined font size in user interface that display unit provides, will be identified as belonging to by the corresponding third party application It is inserted into predefined region in the value of first kind value；And

For first user interface templates：

First kind information is identified as the first kind value by first third party application；And

The Second Type information that second third party application will differ from the first kind information is identified as described One kind value.

18. electronic equipment according to claim 17, wherein being directed to first user interface templates：

The title for the stations of content being remotely generating is identified as the first kind value by first third party application；And

The title of predetermined playlist is identified as the first kind value by second third party application.

19. electronic equipment according to claim 17, wherein being directed to first user interface templates：

First third party application will can be continuously streamed to the title of the content of the equipment and be identified as described first Class value；And

The title for the content being stored in the equipment is identified as the first kind value by second third party application.

20. electronic equipment described in any one of 6 to 19 according to claim 1, wherein：

Value at first third party application is arranged to the tree construction including multiple nodes, the multiple node tool There is predetermined characteristic and there is tree relationship with the other nodes of one or more of the tree construction；And

The request to one or more values for filling first user interface templates include it is one of following or More persons：

Return to the request of the value of the child list of the respective nodes corresponded in the multiple node；

Return to the request of the value of the characteristic list of the respective nodes corresponded in the multiple node；

The request of the content indicated by the respective nodes is provided；

The request of the node listing of matching search inquiry is provided；And

There is provided specific to first third party application action lists request, it is described movement be provide to it is described It can be carried out when the access of the associated content of the first third party application.

21. electronic equipment described in any one of 6 to 19 according to claim 1, wherein：

The equipment includes having the personal digital assistant process of speech recognition capabilities；And

The processing unit is further configured to：

Based on multiple requests from the opposite first third party application value request of first third party application Response, determine the ability of first third party application, described value and filling are used for the use of the respective display unit The user interface templates at family interface are associated；

Generate the index of the ability of first third party application；And

By the personal digital assistant process, the voice visit to the ability of first third party application is provided It asks.

22. electronic equipment according to claim 21, wherein the processing unit is further configured to：

Detect whether predetermined condition has met；And

In response to detecting that the predetermined condition has met：

Redefine the ability of first third party application；And

Regenerate the index of the ability of first third party application.