CN101535940B - Portable electronic device for instant messaging - Google Patents

Portable electronic device for instant messaging Download PDF

Info

Publication number
CN101535940B
CN101535940B CN2007800413515A CN200780041351A CN101535940B CN 101535940 B CN101535940 B CN 101535940B CN 2007800413515 A CN2007800413515 A CN 2007800413515A CN 200780041351 A CN200780041351 A CN 200780041351A CN 101535940 B CN101535940 B CN 101535940B
Authority
CN
China
Prior art keywords
icon
touch
message
screen display
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN2007800413515A
Other languages
Chinese (zh)
Other versions
CN101535940A (en
Inventor
S·O·勒梅
M·万欧斯
S·赫兹
G·克里斯蒂
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apple Inc
Original Assignee
Apple Computer Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US11/848,208 external-priority patent/US9304675B2/en
Application filed by Apple Computer Inc filed Critical Apple Computer Inc
Publication of CN101535940A publication Critical patent/CN101535940A/en
Application granted granted Critical
Publication of CN101535940B publication Critical patent/CN101535940B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

A portable electronic device for instant messaging is disclosed. One aspect of the invention involves a graphical user interface (GUI) on a portable electronic device with a touch screen display. The GUI has a set of messages exchanged between a user of the device and another person. The set of messages are displayed in a chronological order. In response to detecting a scrolling gesture comprising a substantially vertical movement of a user contact with the touch screen display, the display of messages are scrolled in accordance with a direction of the scrolling gesture. The detecting of the scrolling gesture is substantially independent of a horizontal position of the user contact with the touch screen display.

Description

Be used for the portable electric appts that instant message transmits
Technical field
The disclosed embodiments relate generally to portable electric appts, relate more specifically to the portable set that transmits for carrying out instant message.
Background technology
Along with portable electric appts becomes compacter, and the increase of giving the performed function quantity of locking equipment, design makes the user can be easily become significant challenge with the mutual user interface of multifunctional equipment.This challenge is particularly more important than desk-top computer or the much smaller handheld portable devices of laptop computer for screen.Situation is disadvantageous, passes through because user interface is the user approach that it not only receives content but also user action or behavior (it comprises that the user attempts the feature of access means, instrument and function) are responded.
Some portable communication devices (for example, be also sometimes referred to as mobile phone of cellular phone etc.) resort to the interpolation buttons of pressing more, increase the density of pressing button, overload (overload) function of pressing button utilizes perhaps that the complex menu system makes that the user can access, storage and manipulation data.These legacy user interfaces cause button order and the menu layer level structure of the complexity that the user must remember usually.
Also inflexible such as comprising that physics is pressed a lot of legacy user interfaces of the user interface of button.This is disadvantageous, because may stop user interface by the application program of moving on portable set or by user's configuration and/or repacking.When with the time-consuming requirement of remembeing a plurality of buttons order and menu layer level structure and when activating the difficulty of pressing the button aspect of expecting and being combined, this ineffective activity is gloomy to most of users.
Instant message transmission (IM) business based on portable set is just becoming day by day universal.But the most of IM business on portable electric appts has jejune user interface.Creating instant message on this equipment is trouble.The user usually needs repeatedly to press telephone keypad to select character.Find and check that previous instant message is also difficult.For example, check that for the user new information of writing simultaneously this user with specific user's a series of previous message is very inconvenient or or even impossible.
The portable multifunction device that therefore, need to have the more transparent and more intuitive user interface that is used for the instant message transmission that is easy to use, configure and/or reequip.
Summary of the invention
Utilize disclosed portable multifunction device, alleviate or eliminated defects and the other problems that is associated with the user interface that is used for portable set.In some embodiments, this equipment has the touch-sensitive display (also referred to as touch-screen or touch-screen display) of band graphic user interface (GUI), one or more processors, storer and be stored on storer one or more modules, program or the instruction set that is used for carrying out a plurality of functions.In some embodiments, the user mainly the finger contact by on touch-screen display and attitude and GUI mutual.The instruction that is used for the transfer operation of execution instant message can be included in configuration for the computer program of being carried out by one or more processors.
One aspect of the present invention relates to a kind of computer implemented method, and the portable electric appts that wherein has touch-screen display is carried out following steps: be presented in chronological order the one group of message that exchanges between the user of described equipment and another person; Detection comprises the roll attitude that perpendicular that the user contacts with touch-screen display moves, and wherein, described detection roll attitude is basically irrelevant with the horizontal level that contacts of user and touch-screen display; And roll to the demonstration of message by the direction according to described roll attitude, respond described roll attitude.
Another aspect of the present invention relates to a kind of computer implemented method, the portable electric appts that wherein has touch-screen display is carried out following steps: display session list, each session are included in the user of described equipment and the one group of message that exchanges between another person accordingly; Detection comprises the roll attitude that perpendicular that the user contacts with touch-screen display moves; And by the direction rolling session list according to described roll attitude, respond described roll attitude, wherein, described roll attitude is basically irrelevant with the horizontal level that contacts of user and touch-screen display.
Another aspect of the present invention relates to a kind of portable electric appts.This portable electric appts comprises touch-screen display, one or more processor, storer and one or more program.Described one or more procedure stores and is configured to be carried out by described one or more processors in described storer.Described one or more program comprises: for the instruction of the one group of message that exchanges between the user who is presented in chronological order described equipment and another person; For detection of the instruction that comprises the roll attitude that perpendicular that the user contacts with touch-screen display moves, wherein, described detection roll attitude is basically irrelevant with the horizontal level that contacts of user and touch-screen display; And be used for the demonstration of message being responded the instruction of described roll attitude by rolling according to the direction of described roll attitude.
Another aspect of the present invention relates to a kind of portable electric appts.This portable electric appts comprises touch-screen display, one or more processor, storer and one or more program.Described one or more procedure stores and is configured to be carried out by described one or more processors in described storer.Described one or more program comprises: be used for the instruction of display session list, each session is included in the user of described equipment and the one group of message that exchanges between another person accordingly; For detection of the instruction that comprises the roll attitude that perpendicular that the user contacts with touch-screen display moves; And be used for responding the instruction of described roll attitude by the direction rolling session list according to described roll attitude, wherein, described roll attitude is basically irrelevant with the horizontal level that contacts of user and touch-screen display.
Another aspect of the present invention relates to a kind of computer program, and this computer program comprises computer-readable recording medium and the computer program mechanism that is embedded in wherein.This computer program mechanism comprises instruction, and described instruction makes described equipment carry out following the operation when being carried out by the portable electric appts with touch-screen display: be presented in chronological order the one group of message that exchanges between the user of described equipment and another person; Detection comprises the roll attitude that perpendicular that the user contacts with touch-screen display moves, and wherein, described detection roll attitude is basically irrelevant with the horizontal level that contacts of user and touch-screen display; And roll to the demonstration of message by the direction according to described roll attitude, respond described roll attitude.
Another aspect of the present invention relates to a kind of computer program, and this computer program comprises computer-readable recording medium and the computer program mechanism that is embedded in wherein.This computer program mechanism comprises instruction, described instruction makes operation below described equipment execution when being carried out by the portable electric appts with touch-screen display: display session list, each session are included in the user of described equipment and the one group of message that exchanges between another person accordingly; Detection comprises the roll attitude that perpendicular that the user contacts with touch-screen display moves; And by the direction rolling session list according to described roll attitude, respond described roll attitude, wherein, described roll attitude is basically irrelevant with the horizontal level that contacts of user and touch-screen display.
Another aspect of the present invention relates to a kind of graphic user interface (GUI) having on the portable electric appts of touch-screen display.This GUI has the one group of message that exchanges between the user of described equipment and another person.Show in chronological order described group of message.In response to the roll attitude that comprises that perpendicular that the user contacts with touch-screen display moves being detected, roll to the demonstration of message according to the direction of described roll attitude, wherein said detection roll attitude is basically irrelevant with the horizontal level that contacts of user and touch-screen display.
Another aspect of the present invention relates to a kind of graphic user interface (GUI) having on the portable electric appts of touch-screen display.This GUI has session list, and each session is included in the user of described equipment and the one group of message that exchanges between another person accordingly.In response to the roll attitude that comprises that perpendicular that the user contacts with touch-screen display moves being detected, according to the direction rolling session list of described roll attitude.Described roll attitude is basically irrelevant with the horizontal level that contacts of user and touch-screen display.
Another aspect of the present invention relates to a kind of portable electric appts with touch-screen display, and this equipment comprises: for the device of the one group of message that exchanges between the user who is presented in chronological order described equipment and another person; For detection of the device that comprises the roll attitude that perpendicular that the user contacts with touch-screen display moves, wherein, described detection roll attitude is basically irrelevant with the horizontal level that contacts of user and touch-screen display; And be used for rolling to the demonstration of message by the direction according to described roll attitude, respond the device of described roll attitude.
Another aspect of the present invention relates to a kind of portable electric appts with touch-screen display, and this equipment comprises: be used for the device of display session list, each session is included in the user of described equipment and the one group of message that exchanges between another person accordingly; For detection of the device that comprises the roll attitude that perpendicular that the user contacts with touch-screen display moves; And be used for responding the device of described roll attitude by the direction rolling session list according to described roll attitude, wherein, described roll attitude is basically irrelevant with the horizontal level that contacts of user and touch-screen display.
Another aspect of the present invention relates to a kind of computer implemented method, and the portable electric appts that wherein has touch-screen display is carried out following steps: be presented in chronological order the one group of message that exchanges between the user of described equipment and another person.The message that is sent by another person comprises the first message that sends from the first address that is associated with described another person and the second message that sends from the second address that is associated with described another person, and described the second address is different from described the first address.
Another aspect of the present invention relates to a kind of portable electric appts.This equipment comprises touch-screen display, one or more processor, storer and one or more program.Described one or more procedure stores and is configured to be carried out by described one or more processors in described storer.Described one or more program comprises: for the instruction of the one group of message that exchanges between the user who is presented in chronological order described equipment and another person.The message that is sent by another person comprises the first message that sends from the first address that is associated with described another person and the second message that sends from the second address that is associated with described another person, and described the second address is different from described the first address.
Another aspect of the present invention relates to a kind of computer program, and this computer program comprises computer-readable recording medium and the computer program mechanism that is embedded in wherein.This computer program mechanism comprises instruction, and described instruction makes described equipment carry out following the operation when being carried out by the portable electric appts with touch-screen display: be presented in chronological order the one group of message that exchanges between the user of described equipment and another person.The message that is sent by another person comprises the first message that sends from the first address that is associated with described another person and the second message that sends from the second address that is associated with described another person, and described the second address is different from described the first address.
Another aspect of the present invention relates to a kind of graphic user interface (GUI) having on the portable electric appts of touch-screen display.This GUI has the one group of message that exchanges between chronological user at described equipment and another person.The message that is sent by another person comprises the first message that sends from the first address that is associated with described another person and the second message that sends from the second address that is associated with described another person, and described the second address is different from described the first address.
Another aspect of the present invention relates to a kind of portable electric appts with touch-screen display, and this equipment comprises: for the device of the one group of message that exchanges between the user who is presented in chronological order described equipment and another person.The message that is sent by another person comprises the first message that sends from the first address that is associated with described another person and the second message that sends from the second address that is associated with described another person, and described the second address is different from described the first address.
Thus, the invention provides a kind of for having on the portable electric appts of touch-screen display the transparent and intuitive user interface that creates, checks and find instant messaging session.
Description of drawings
In order to understand better above-mentioned embodiment of the present invention and additional embodiment thereof, should be by reference to the accompanying drawings with reference to following embodiment part, in the accompanying drawings, identical label represents corresponding part from start to finish.
Fig. 1 is illustration according to the block diagram of the portable electric appts with touch-sensitive display of some embodiment.
Fig. 2 illustration according to the portable electric appts with touch-screen of some embodiment.
Fig. 3 illustration according to the exemplary user interface that is used for the unlock of portable electronic equipment of some embodiment.
Fig. 4 illustration according to the exemplary user interface of the application menu on portable electric appts of some embodiment.
Fig. 5 illustration according to the exemplary user interface that is used for listing instant messaging session on portable electric appts of some embodiment.
Fig. 6 A to 6K illustration according to the exemplary user interface of the text that is used for the input instant message of some embodiment.
Fig. 7 illustration according to the exemplary user interface that is used for the deletion instant messaging session of some embodiment.
Fig. 8 A and 8B illustration according to the exemplary user interface that is used for contacts list of some embodiment.
Fig. 9 illustration according to the exemplary user interface that is used for the telephone number that the input instant message transmits of some embodiment.
Figure 10 is illustration according to the process flow diagram in the processing of the touch screen display instant messaging session list of portable electric appts of being used for of some embodiment.
Figure 11 is illustration according to the process flow diagram that shows the processing of the instant messaging session that the user selects when contacting with the predesignated subscriber of the touch-screen of portable electric appts detecting of being used for of some embodiment.
Figure 12 is illustration according to the process flow diagram of processing that is used for showing user inputs character and word suggestion (if any) of some embodiment.
Figure 13 is illustration according to the process flow diagram that showing the processing of corresponding keyboard when selecting the user of icon to contact with keyboard detecting of being used for of some embodiment.
Figure 14 is illustration according to the process flow diagram of processing that is used for explaining the implication that contacts with the specific user of switch key (shift key) of some embodiment.
Figure 15 is illustration according to the process flow diagram that is used for instant message is sent to corresponding recipient's processing of some embodiment.
What Figure 16 was illustration according to some embodiment is used for showing process flow diagram in order to the processing of the instant messaging session list of editing.
Figure 17 is illustration according to the process flow diagram of the processing that is used for the instant messaging session that compiles user selects of some embodiment.
What Figure 18 was illustration according to some embodiment is used for removing the instant messaging session that the user selects or the process flow diagram that withdraws from the processing of session edit pattern.
Figure 19 is illustration according to some embodiment be used for show that the user is from the process flow diagram of the processing of its contacts list of selecting to transfer immediate news.
Figure 20 is illustration according to some embodiment be used for utilize new phone number to start the process flow diagram of the processing of new session.
Figure 21 illustration according to the exemplary user interface that reminding user has new instant message that is used for of some embodiment.
Embodiment
The below will be at length with reference to embodiment, and the example of embodiment illustrates in the accompanying drawings.In order to provide thorough understanding of the present invention, will set forth numerous details in the following detailed description.Yet for those of ordinary skills, obviously understanding the present invention can be in the situation that have these details to implement.In other cases, do not describe widely known method, process, parts, circuits and networks in detail, to avoid unnecessarily making the many aspects of embodiment unclear.
Portable multifunction device, the user interface of this equipment and the embodiment that uses the processing that is associated of these equipment have been described.In certain embodiments, described equipment is the portable communication device that also comprises other functions (for example, PDA and/or music player functionality) such as mobile phone.
User interface is except touch-screen or be presented at and can comprise also virtual click roller on this touch-screen that physics clicks roller.Clicking roller is to contact with the point of roller the user interface facilities that navigation command is provided based on angular displacement or the equipment user of roller.Click roller and can also be used for providing and the user command corresponding to the selection of one or more projects, for example, in the situation that the user of equipment presses at least a portion of bottom roller or the center of roller.Alternatively, disconnect with touch screen surface on the contact of click roller image can indicate and select corresponding user command.For simplicity, in the following discussion, adopt to comprise that the portable electric appts of touch-screen is as exemplary embodiment.Yet, be to be understood that, some user interfaces and the processing that is associated can be applied to comprise other equipment of one or more other physical user interface equipment (for example, physics is clicked roller, physical keyboard, mouse and/or operating rod), for example personal computer and laptop computer.
Except instant message transmitted, this equipment can be supported multiple other application programs, for example telephony application; Videoconference application; Email application; The blog applications program; The digital camera applications program; The digital camera applications program; The network browsing application program; Digital music player application; And/or video frequency player application program.
The multiple application program that can carry out on equipment can adopt at least one common physical user interface equipment, for example touch-screen.Can adjust and/or change one or more functions of touch-screen and the information that is presented at the correspondence on equipment from an application program to next application program and/or in each application program.Like this, the public physical structure (such as touch-screen) of equipment can support to have the multiple application program of directly perceived and transparent user interface.
User interface can comprise one or more soft keyboard embodiments.the soft keyboard embodiment can comprise standard (QWERTY) and/or the non-standard configuration of the symbol on the keyboard display icon, for example, the U.S. Patent application 11/459 that is entitled as " Keyboards For PortableElectronic Devices " of submitting on July 24th, 2006, in 606 and the U.S. Patent application 11/459 that is entitled as " Touch Screen Keyboards For Portable ElectronicsDevices " of submitting on July 24th, 2006, those configurations described in 615, full content in these patented claims is being hereby incorporated by reference.The keyboard embodiment can comprise the icon (or soft key) that quantity reduces for the number of keys on existing physical keyboard, for example key on typewriter.This can be so that the user more easily selects the one or more icons on keyboard, and selects thus the symbol of one or more correspondences.The keyboard embodiment can be adaptive.For example, display icon can be revised according to user action (for example, selecting one or more icons and/or one or more corresponding symbol).One or more application programs on portable set can be utilized common and/or different keyboard embodiments.Thus, the keyboard embodiment that uses can be adjusted into suitable at least some application programs.In some embodiments, one or more keyboard embodiments can be adjusted into suitable each user.For example, the word based on each user uses historical (dictionary writing, slang, individual use).Can adjust that some keyboard embodiments reduce in the situation that the probability that utilizes the user of soft keyboard embodiment when selecting one or more icons and selecting one or more symbol thus to make mistakes.
Pay close attention to now the embodiment of equipment.Fig. 1 is illustration according to the block diagram of the portable multifunction device with touch-sensitive display 112 100 of some embodiment.For simplicity, touch-sensitive display 112 is called as " touch-screen " sometimes.Equipment 100 can comprise storer 102 (it can comprise one or more computer-readable recording mediums), Memory Controller 122, one or more processing units (CPU) 120, Peripheral Interface 118, RF circuit 108, voicefrequency circuit 110, loudspeaker 111, microphone 113, I/O (I/O) subsystem 106, other inputs or opertaing device 116, and outside port 124.Equipment 100 can comprise one or more optical sensors 164.These parts can be communicated by letter by one or more communication buss or signal wire 103.
Should be appreciated that equipment 100 is only an example of portable electric appts 100, and equipment 100 can have than shown more or less parts, can make up two or more parts, perhaps can have different component configuration or setting.Various parts shown in Fig. 1 can be realized in the combination of the hardware, software or the hardware and software that comprise one or more signals processing and/or special IC.
Storer 102 can comprise high-speed random access memory, and can comprise nonvolatile memory, for example one or more disk memory, flush memory device or other non-volatile solid state memory spares.The miscellaneous part such as CPU 120 and Peripheral Interface 118 of equipment 100 can be controlled by Memory Controller 122 access of storer 102.
Peripheral Interface 118 is couple to CPU 120 and storer 102 with the input and output peripheral hardware of equipment.One or more processor 120 operations or execution are stored in various software programs and/or the instruction set in storer 102, to realize various functions and the deal with data of equipment 100.
In certain embodiments, Peripheral Interface 118, CPU120 and Memory Controller 122 can be realized on the one single chip such as chip 104.In some other embodiment, they can be realized on discrete chip.
RF (radio frequency) circuit 108 receives and sends the RF signal, and wherein the RF signal is also referred to as electromagnetic signal.RF circuit 108 is converted to electromagnetic signal/electromagnetic signal is converted to electric signal with electric signal, and communicates by this electromagnetic signal and communication network and other communication facilitiess.RF circuit 108 can comprise the known circuit for these functions of execution, and it includes but not limited to antenna system, RF transceiver, one or more amplifier, tuner, one or more oscillator, digital signal processor, CODEC chipset, Subscriber Identity Module (SIM) card, storer etc.RF circuit 108 can by radio communication with communicate such as the Internet (also referred to as WWW (WWW)), Intranet and/or such as network and other equipment of the wireless network of cellular telephone network, WLAN (wireless local area network) (LAN) and/or Metropolitan Area Network (MAN) (MAN).radio communication can be utilized a plurality of communication standards, any in agreement and technology, these communication standards, agreement and technology include but not limited to global system for mobile communications (GSM), enhanced data gsm environment (EDGE), high-speed downlink packet access (HSDPA), Wideband Code Division Multiple Access (WCDMA) (W-CDMA), CDMA (CDMA), time division multiple access (TDMA) (TDMA), bluetooth, Wireless Fidelity (Wi-Fi) (for example, IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and/or IEEE 802.11n), IP phone (VoIP), Wi-MAX, (for example be used for Email, Internet Message Access Protocol (IMAP) and/or post office protocol (POP)), instant message (for example transmits, scalable message transmits on-the-spot agreement (XMPP), be used for the Session initiation Protocol (SIMPLE) that instant message transmits and on-site support is expanded, and/or instant message transmits live traffic (IMPS)), and/or the agreement of short message service (SMS), perhaps any other suitable communication protocol when submitting to day (be included in application also undeveloped communication protocol).
Voicefrequency circuit 110, loudspeaker 111 and microphone 113 provide the audio interface between user and equipment 100.Voicefrequency circuit 110 is converted to electric signal with this voice data, and this electric signal is sent to loudspeaker 111 from Peripheral Interface 118 audio reception data.Loudspeaker 111 is with the audible sound wave of this electric signal conversion behaviour.Voicefrequency circuit 110 also receives the electric signal that microphone 113 comes from the sound wave conversion.Voicefrequency circuit 110 is converted to voice data with electric signal, and this voice data is sent to Peripheral Interface 118 in order to process.Can be by Peripheral Interface 118 from storer 102 and/or RF circuit 108 retrieve audio data and/or voice data is sent to storer 102 and/or RF circuit 108.In certain embodiments, voicefrequency circuit 110 also comprises the head phone jack (not shown).Head phone jack (for example provides voicefrequency circuit 110 and detachable audio frequency I/O peripheral hardware, the head phone of output or existing output are only arranged (for example, the head phone of monaural or ears) headphone of input (for example, microphone) is arranged again) between interface.
I/O subsystem 106 is couple to Peripheral Interface 118 with the I/O peripheral hardware on equipment 100 (for example, touch-screen 112 and other input/opertaing devices 116).I/O subsystem 106 can comprise display controller 156 and be used for one or more input control devices 160 of other inputs or opertaing device.One or more input control devices 160 from/receive/send electric signal to other inputs or opertaing device 116.Other input/opertaing devices 116 can comprise physical button (for example, press button, rocking arm button, etc.), dial (of a telephone), slide switch, operating rod, click roller etc.In some alternative embodiment, input control device 160 can be couple to lower any (or not being couple to any): keyboard, infrared port, USB port and such as the indicating equipment of mouse.One or more buttons (for example, 208 in Fig. 2) can comprise the up/down button for the volume control of loudspeaker 111 and/or microphone 113.One or more buttons can comprise presses button (for example, 206 in Fig. 2).To pressing pressing fast of button, touch-screen 112 disengagings are held, perhaps bring into use the processing of the attitude on touch-screen with unlocker device, as at U.S. Patent application 11/322,549 (submissions on Dec 23rd, 2005, be entitled as " Unlocking a Device by Performing Gestures on an UnlockImage ") described in, the full content of this patented claim is being hereby incorporated by reference.The length of pressing button (for example, 206) is pressed can be to equipment 100 energisings or outage.The user can customize the function of one or more buttons.Touch-screen 112 is used for realizing virtual or soft key and one or more soft keyboard.
Touch sensitive touch-screen 112 provides input interface and the output interface between equipment and user.Display controller 156 from/receive and/or send electric signal to touch-screen 112.Touch-screen 112 with visual output display to the user.Visual output can comprise figure, text, icon, video with and combination in any (being referred to as " figure ").In certain embodiments, some or all visual outputs can be corresponding to user interface object, and the below will provide the more detailed description to it.
Touch-screen 112 has for contacting based on sense of touch and/or sense of touch touch sensitive surface, sensor or the sensor group of accepting from user's input.Touch-screen 112 and display controller 156 (and any module that is associated and/or instruction set in storer 102) detect the contact (and any movement or disconnection of touching) on touch-screen 112, and the contact that will detect is converted to and is presented at the mutual of user interface object (for example, one or more soft keys, icon, webpage or image) on touch-screen.In an example embodiment, touch-screen 112 is corresponding to user's finger with contact point between the user.
Touch-screen 112 can adopt LCD (liquid crystal display) technology or LPD (light emitting polymer demonstration) technology, although also can adopt other display techniques in other embodiments.Touch-screen 112 and display controller 156 can utilize any and other proximity sensor arrays in multiple known or touch-sensing technology exploitation in the future at present (it includes but not limited to condenser type, resistance-type, infrared and surface acoustic wave technique) or be used for determining detecting with other elements of the one or more points that contact of touch-screen 112 and contact and any movement or the disconnection that contact.Touch-sensitive display in some embodiment of touch-screen 112 can with at United States Patent (USP) 6,323,846 (Westerman etc.), 6,570,557 (Westerman etc.) and/or 6, many touch-sensitives image input unit (tablet) of describing in 677,932 (Westerman) and/or U.S. Patent bulletin 2002/0015024A1 is similar, and the full content of each in above-mentioned patent and patent gazette is being hereby incorporated by reference.Yet, the visual output that touch-screen 112 shows from portable set 100, and the touch-sensitive image input unit does not provide visual output.Touch-screen 112 can have the resolution over 100dpi.In one exemplary embodiment, the touch-screen in display system has the resolution of about 168dpi.The user can utilize such as any suitable object of stylus, finger etc. or annex and contact with touch-screen 112.In certain embodiments, user interface is designed to main contact and the attitude work that utilizes based on finger, because the contact area of finger on touch-screen is larger, so based on the contact of finger and attitude than based on the input out of true of stylus many.In certain embodiments, equipment is converted to the rough input based on finger for accurate indicator/cursor position or the order of carrying out the desirable action of user.
Touch-sensitive display in some embodiment of touch-screen 112 can be as described in following application: the U.S. Patent application No.11/381 that is entitled as " Multipoint TouchSurface Controller " that on May 2nd, (1) 2006 submitted to, 313; The U.S. Patent application No.10/840 that is entitled as " Multipoint Touchscreen " that on May 6th, (2) 2004 submitted to, 862; The U.S. Patent application No.10/903 that is entitled as " Gestures For TouchSensitive Input Devices " that on July 30th, (3) 2004 submitted to, 964; The U.S. Patent application No.11/048 that is entitled as " Gestures For Touch Sensitive Input Devices " that on January 31st, (4) 2005 submitted to, 264; The U.S. Patent application No.11/038 that is entitled as " Mode-Based Graphical User Interfaces For Touch Sensitive InputDevices " that on January 18th, (5) 2005 submitted to, 590; The U.S. Patent application No.11/228 that is entitled as " Virtual Input Device Placement On A Touch Screen UserInterface " that on September 16th, (6) 2005 submitted to, 758; The U.S. Patent application No.11/228 that is entitled as " Operation Of A Computer With A Touch ScreenInterface " that on September 16th, (7) 2005 submitted to, 700; The U.S. Patent application No.11/228 that is entitled as " Activating Virtual Keys Of A Touch-Screen VirtualKeyboard " that on September 16th, (8) 2005 submitted to, 737; And the U.S. Patent application No.11/367 that is entitled as " Multi-Functional Hand-Held Device " of submission on March 3rd, (9) 2006,749.The full content of all these applications is being hereby incorporated by reference.
In certain embodiments, except touch-screen, equipment 100 can also comprise the touch pad (not shown) of activation or deactivation specific function.In certain embodiments, touch pad is the touch sensitive region of the not display of visually output different from touch-screen of equipment.Touch pad can be the touch sensitive surface of separating with touch-screen 112, or the extension of the touch sensitive surface that is formed by touch-screen.
In certain embodiments, equipment 100 can comprise that physics or virtual click roller are as input control apparatus 116.The user can click roller or (for example pass through mobile contact point with clicking roller by rotation, by the situation with respect to the amount of movement of the angle displacement measurement contact point of the central point of clicking roller), come navigation and mutual with it among the one or more Drawing Objects (hereinafter referred to as icon) that show on touch-screen 112.Click roller and also can be used for selecting one or more display icons.For example, the user can press at least a portion of clicking roller or the button that is associated.Can by one or more modules and/or the instruction set in input control device 160 and storer 102, process user command and navigation command that the user provides via the click roller.For virtual click roller, clicking roller and click the roller controller can be respectively the part of touch-screen 112 and display controller 156.For virtual click roller, click the opaque or translucent object of appearing and subsiding alternately and on touch-screen display that roller can be in response to user and equipment.In certain embodiments, virtual click roller is presented on the touch-screen of portable multifunction device, and by user and touch-screen contact operate.
Equipment 100 also comprises for the electric system 162 to various parts power supplies.Electric system 162 (for example can comprise electric power management system, one or more power supply, battery, alternating current (AC)), recharging system, power failure testing circuit, power converter or inverter, power state indicator (for example, light emitting diode (LED)), and with electric power in portable electric appts produce, management and distribute any other parts that are associated.
Equipment 100 also can comprise one or more optical sensors 164.Fig. 1 shows the optical sensor of the optical sensor controller 158 that is couple in I/O subsystem 106.Optical sensor 164 can comprise charge-coupled image sensor (CCD) or complementary metal oxide semiconductor (CMOS) (CMOS) phototransistor.Optical sensor 164 receives projection by the light of one or more lens from environment, and this light is converted to the data of presentation video.Combine with image-forming module 143, but optical sensor 164 catching static images or video.In certain embodiments, optical sensor is positioned at the back side of equipment 100, and is relative with touch-screen display 112 on the front that is positioned at this equipment, thereby touch-screen display can be as for view finder static and/or that video image obtains.In certain embodiments, optical sensor is positioned on the front of equipment, thereby can obtain user images for video conference when the user watches other video conferencing participants on touch-screen display.In certain embodiments, the user can be (for example, by the lens in the rotating machinery shell and sensor) change the position of optical sensor 164, make single optical sensor 164 to be used from video conference with touch-screen display one and static and/or video image obtains.
Equipment 100 also can comprise one or more proximity transducers 166.Fig. 1 shows the proximity transducer 166 that is couple to Peripheral Interface 118.Alternatively, proximity transducer 166 can be couple to the input control device 160 in I/O subsystem 106.Proximity transducer 166 can be embodied as described in following application: the U.S. Patent application No.11/241 that is entitled as " ProximityDetector In Handheld Device " that on September 30th, 2005 submitted to, 839; And the U.S. Patent application No.11/240 that is entitled as " Proximity Detector In Handheld Device " of submission on September 30th, 2005,788, the full content of these applications is by reference for your guidance.In certain embodiments, when multifunctional equipment is placed in the user in one's ear the time (for example, when the user carries out call), proximity transducer cuts out and forbids touch-screen 112.In certain embodiments, when equipment was arranged in user's pocket, wallet or other dark areas, proximity transducer cut out screen, to prevent being in battery consumption unnecessary when holding state at equipment.
Equipment 100 also can comprise one or more accelerometers 168.Fig. 1 shows the accelerometer 168 that is couple to Peripheral Interface 118.Alternatively, accelerometer 168 can be couple to the input control device 160 in I/O subsystem 106.Accelerometer 168 can be as realizing at the U.S. Patent bulletin No.20050190059 that is entitled as " Acceleration-basedTheft Detection System for Portable Electronic Devices " with being entitled as described in the U.S. Patent bulletin No.20060017692 of " Methods And Apparatuses For OperatingA Portable Device Based On An Accelerometer ", and the full content of above-mentioned two patent gazettes is being hereby incorporated by reference.In certain embodiments, information is presented on touch-screen display with vertical view or transverse views based on the analysis to the data that receive from one or more accelerometers.
In certain embodiments, in storer 102, the software part of storage can comprise operating system 126, communication module (or instruction set) 128, contact/mobile module (or instruction set) 130, figure module (or instruction set) 132, text load module (or instruction set) 134, GPS (GPS) module (or instruction set) 135 and application program (or instruction set) 136.
Operating system 126 (for example, Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS or such as the embedded OS of VxWorks) for control and management General System task (for example comprise, memory management, memory device are controlled, electrical management, etc.) various software parts and/or driver, and be convenient to communication between various hardware and software parts.
Communication module 128 is convenient to by one or more outside ports 124 and other devices communicatings, and comprises the various software parts for the treatment of the data that received by RF circuit 108 and/or outside port 124.Outside port 124 (for example, USB (universal serial bus) (USB), FIREWIRE etc.) is suitable for being directly coupled to other equipment or indirectly is couple to other equipment by network (for example, the Internet, WLAN etc.).In certain embodiments, outside port is spininess (for example, 30 pins) connector, and it is identical, similar and/or compatible with 30 needle connectors that adopt in iPod (trade mark of Apple Computer) equipment.
Contact/mobile module 130 can detect the contact with touch-screen 112 (in conjunction with display controller 156) and other touch-sensitive device (for example, touch pad or physics are clicked roller).Contact/mobile module 130 comprises for the various software parts of carrying out the various operations relevant to detecting contact, described operational example is if any determining whether to come in contact, determine whether that described contact has mobile and follows the trail of described movement and determine whether to disconnect described contact (that is, whether contact stop) on touch-screen 112.The movement of determining contact point can comprise speed (amplitude), speed (amplitude and direction) and/or the acceleration (variation of amplitude and/or direction) of determining contact point.These operations can be applied to single contact (for example, finger contact) or be applied to a plurality of contacts simultaneously (for example, " touch "/many finger contacts) more.In certain embodiments, contact/mobile module 130 also detects contacting on touch pad with display controller 156.In certain embodiments, contact/mobile module 130 detects with controller 160 and is clicking contacting on roller 116.
Figure module 132 comprises for the various known software parts that present (render) and display graphics on touch-screen 112, comprises the parts be used to the shading value that changes shown figure (intensity).Term used herein " figure " comprises any object that can be shown to the user, and it includes but not limited to text, webpage, icon (such as the user interface object that comprises soft key), digital picture, video, animation etc.
The text load module 134 that can be used as parts of figure module 132 provides the soft keyboard that is used for input text in various application programs (for example, contact person 137, Email 140, IM 141, blog 142, browser 147 and need any other application program of text input).
GPS module 135 is determined the position of equipment, and provide this information (for example to be used for various application programs, offer phone 138 and be used for the position-based dialing, offer camera 143 and/or Blog device 142 as picture/video metadata, and offer the application program that is used for providing location-based service such as weather widget, local Yellow Page widget and map/navigator window widget).
Application program 136 can comprise with lower module (or instruction set) or its subset or superset:
● contact module 137 (being sometimes referred to as address book or contacts list);
phone module 138;
video conference module 139;
email client module 140;
● instant message transmits (IM) module 141;
blog module 142;
camera module 143 is used for static and/or video image;
image management module 144;
video player module 145;
musical player module 146;
browser module 147;
calendaring module 148;
widget module 149, it can comprise weather widget 149-1, stock widget 149-2, calculator window widget 149-3, alarm clock widget 149-4, dictionary widget 149-5 and other widgets that obtained by the user, and the widget 149-6 of user's establishment;
widget builder module 150 is used to form the widget 149-6 that the user creates; And/or
search module 151.
The example that can be stored in other application programs 136 in storer 102 comprises notepad and other word-processing applications, JAVA enable application program, encryption, Digital Right Management, speech recognition and speech reproduction.
with RF circuit 108, touch-screen 112, display controller 156, contact modules 130, figure module 132 and text load module 134 combine, instant message delivery module 141 can be used for inputting the character string corresponding with instant message, the character of input before revising, (for example send each instant message, adopt the short message service (SMS) or multimedia messaging service, MMS (MMS) agreement that are used for based on the instant message of phone, perhaps adopt the XMPP that is used for based on the instant message of the Internet, SIMPLE or IMPS), receive instant message, and watch the IM session of the message that the user that is included in portable set 100 and each exchange between other people.In certain embodiments, the instant message that sends and/or receive can comprise figure, photo, audio file, video file and/or other annexes of supporting as MMS and/or enhanced messaging transport service (EMS)." the instant message transmission " used in text refer to based on phone message (message of for example, utilizing SMS or MMS to send) and based on the message (message of for example, utilizing XMPP, SIMPLE or IMPS to send) of the Internet.Will be further described below the embodiment of the user interface of utilizing instant message delivery module 141 and the processing that is associated.
It should be noted that the above module that provides and application program (comprising instant message delivery module 141) are corresponding to the instruction set that is used for carrying out above-mentioned one or more functions.These modules (that is, instruction set) needn't be embodied as independent software program, process or module, can make up in various embodiments thus or each subset of these modules of permutatation otherwise.In certain embodiments, storer 102 can be stored the subset of above-mentioned module and data structure.In addition, storer 102 can be stored above other module and the data structure of not describing.
In certain embodiments, equipment 100 is wherein exclusively to pass through the equipment of the operation of predetermined group of function on touch-screen 112 and/or touch pad actuating equipment.By utilizing touch-screen and/or touch pad as the primary input/opertaing device of the operation that is used for equipment 100, can reduce the quantity of physics input/opertaing device on equipment 100 (for example, pressing button, dial (of a telephone) etc.).
Predetermined group of function can exclusively carrying out by touch-screen and/or touch pad comprises the navigation between user interface.In certain embodiments, touch pad when being touched by the user with equipment 100 from being presented at any user interface navigation on equipment 100 to master, initial or root menu.In such an embodiment, touch pad can be called as " menu button ".In some other embodiment, menu button can be to replace the physics of touch pad to press button or other physics input/opertaing devices.
Fig. 2 illustration according to the portable multifunction device with touch-screen 112 100 of some embodiment.Touch-screen can show one or more figures.In this embodiment and following described other embodiment, the user can contact or touch one or more figures by for example utilizing one or more fingers 202 (not drawn on scale in figure) or stylus (not shown), thereby selects described figure.When in certain embodiments, selecting one or more figures to occur in the user to disconnect with the contacting of described one or more figures.In certain embodiments, contact can comprise attitude, for example once or under many raps, once or hit (from left to right, from right to left, up and/or down) under many and the rolling (from right to left, from left to right, up and/or down) of the finger that contacted with equipment 100.In certain embodiments, can not select this figure with contacting unintentionally of figure.For example, be when rapping corresponding to the attitude of selecting, the inswept application program image target attitude of hitting can not selected corresponding application program.In other words, portable electric appts 100 is explained the implication of attitude and correspondingly action after considering to use what application program or module this moment.
Equipment 100 also can comprise one or more physical button, for example " initial (home) " or menu button 204.As previously mentioned, menu button 204 can be used for navigating to any application program 136 in one group of application program can carrying out on equipment 100.Alternatively, in certain embodiments, menu button is embodied as the soft key in GUI on touch-screen 112.
What in one embodiment, equipment 100 comprised touch-screen 112, menu button 204, is used for making equipment to switch on/cut off the power supply and holds equipment presses button 206 and volume adjusting button 208.Pressing button 206 can be used for continuing predetermined time interval and switching on/outage to equipment by pressing this button and this button being remained on down state; By pressing this button and holding this equipment through discharging this button before above-mentioned predetermined time interval; And/or unlocker device or startup release processing.In alternative embodiment, equipment 100 also can be accepted by microphone 113 the speech input of activation or some functions of deactivation.
The below pays close attention to the embodiment of the user interface (" UI ") that can realize and the processing that is associated on portable multifunction device 100.
Fig. 3 illustration according to the example user interface that is used for the unlock of portable electronic equipment of some embodiment.In certain embodiments, user interface 300 comprises following element or its subset or superset:
● utilize finger gesture to be moved unlock image 302 with unlocker device;
● the arrow 304 to the visual cues of release attitude is provided;
● the passage 306 to the additional prompt of release attitude is provided;
● the time 308;
● day 310;
● the date 312; And
● wallpaper image 314.
In certain embodiments, when equipment is in user interface and holds state, the contacting of equipment Inspection and touch-sensitive display (for example, user's finger on unlock image 302 or near contact).Equipment comes mobile unlock image 302 according to described contact.If the contact that detects is corresponding to predetermined attitude, for example mobile unlock image passes passage 306, and equipment changes the user interface released state into.On the contrary, if the contact that detects does not correspond to predetermined attitude, equipment keeps user interface to hold state.As mentioned above, the user makes the U.S. Patent application 11/322 that is entitled as " Unlocking aDevice by Performing Gestures on an Unlock Image " that attitude is submitted on Dec 23rd, 2005 in order to the processing of unlocker device on touch-screen, be described in 549, the full content of this patented claim is being hereby incorporated by reference.
Fig. 4 illustration according to the exemplary user interface that is used for the application menu on portable electric appts of some embodiment.In certain embodiments, user interface 400 comprises following element or its subset or superset:
● be used for the signal strength indicator 402 of radio communication;
● the time 404;
battery status designator 406;
● with commonly use the pallet 408 of the icon of application program such as following being used for:
Zero phone 138;
Zero email client 140, it can comprise the designator 410 of not reading Email quantity;
Zero browser 147; With
Zero music player 146; And
● be used for the icon of other application programs, for example:
○IM?141;
Zero image management 144
Zero camera 143;
Zero video player 145;
Zero weather 149-1;
Zero stock 149-2;
Zero blog 142;
Zero calendar 148;
Zero counter 149-3;
Zero alarm clock 149-4;
Zero dictionary 149-5; And
Zero user creates widget 149-6.
In certain embodiments, UI 400 shows all applications available 136 on a screen, thus the application list that need not to roll (for example, passing through scroll bar).In certain embodiments, along with the increase of number of applications, can reduce corresponding to the size of the icon of application program, thereby can show all application programs on single screen, and need not to roll.In certain embodiments, in the situation that have all application programs on a screen, menu button makes the user can utilize such as two inputs at the most of the application program that activates menu button 204 and then activates hope (for example, by corresponding to rapping or other finger gestures on the icon of this application program) just can access the application program of any expectation.
In certain embodiments, UI 400 provides the integrated access to window based widget application program and non-window based widget application program.In certain embodiments, all widgets its be whether whether all being presented in UI 400 of creating of user.In other embodiments, activate to be used for the user and to create bootable another UI (not shown) to comprising the user and creating widget or create the icon of widget corresponding to the user of the icon of widget 149-6.
In certain embodiments, the user can utilize the U.S. Patent application No.11/459 that is entitled as " Portable Electronic Device With Interface Reconfiguration Mode " that submits on July 24th, 2006, the processing of describing in 602, rearrange the icon in UI 400, the full content of above-mentioned patented claim is being hereby incorporated by reference.For example, the user can utilize finger gesture that application icon is moved into and shift out pallet 408.
In certain embodiments, UI 400 comprises and for the account who is associated with the use of equipment (for example showing, the cellular phone account) updated account is used the meter (not shown) of tolerance, as the U.S. Patent application 11/322 that is entitled as " Account Information Display ForPortable Communication Device " of submitting on Dec 23rd, 2005, described in 552, the full content of above-mentioned patented claim is being hereby incorporated by reference.
Fig. 5 illustration according to the exemplary user interface that is used for listing instant messaging session on portable electric appts of some embodiment.Instant messaging session is included in user and one or more one group of message that exchanges between other people of portable electric appts.In certain embodiments, user interface 500 comprises following element or its subset or superset:
● 402,404 and 406, as mentioned above;
● " instant message " or other similar marks 502;
● even the user has the people's of message session with it name 504 (for example, JaneDoe 504-1), if the telephone number (for example, 408-123-4567 504-3) when perhaps corresponding people's name can not obtain;
● the stop press in session or its a part of text 506 (note, this stop press can be the stop press that the user sends or receives);
● date 508 and/or the time of the stop press in session;
● select icon 510, it starts to the conversion of the UI (for example, in Fig. 6 A for Jane Doe504-1) of corresponding session when being activated (for example, by the finger gesture on icon);
● editor's icon 512, it starts to (for example, Fig. 7) the conversion for the UI of deletion session when being activated (for example, by the finger gesture on icon);
● create message icon 514, it starts to the conversion of user contact lists (for example, Fig. 8 A) when being activated (for example, by the finger gesture on icon); And
vertical bar 516, it helps the user to understand which part that is showing in the instant messaging session list.
Figure 10 is illustration according to the process flow diagram in the processing of the touch screen display instant messaging session list of portable electric appts of being used for of some embodiment.When finger gesture (1002) (for example, the finger in Fig. 4 on IM icon 141 raps 412) being detected, the 141 identification one group of IM session (1004) of IM module also are presented at (1006) on touch-screen with them.In order to edit existing session or to start new session, portable set can show respectively editor's icon 512 and create message icon 514 (1008) on touch-screen.Portable set monitors and to contact with the user of touch-screen, and correspondingly moves (1010).
As shown in Figure 5, can be according to the list of time sequencing display session.Being positioned at the top with the session of " Jane Doe " is because it is unique session that comprises the message that at least one 508-1 today (it is assumed to be on January 29th, 2006 in this example) creates.In certain embodiments, according to the session of sorting of the timestamp of the latest news in each session.In certain embodiments, comprise that the session of the message that at least one is not also checked by the user is highlighted on touch-screen.For example, utilize the 3rd session in the wide line character display list, thus the latest news that the people that it is 408-123-4567 that the hint user does not also check by telephone number sends.
In certain embodiments, determine by seek the entry comprise the telephone number of being used by instant messaging session in user's contacts list 137 title 504 that is associated with this instant messaging session.If do not find this entry, (for example only show telephone number, 504-3) in certain embodiments, if another person sends message from two or more different telephone numbers, if the same entry in user's contacts list 137 (namely, entry for described another person) find whole telephone numbers of use in, message can appear in the same session of the name that comprises this people so.In certain embodiments, session comprises the message that sends from the telephone number that is associated with another person and/or e-mail address.In certain embodiments, the message that is sent by another person comprises the first message that sends from the first address that is associated with this another person and the second message that sends from the second address that is different from described the first address that is associated with this another person.In certain embodiments, the first address is telephone number, and the second address is e-mail address.In certain embodiments, the first and second addresses are two distinct telephone numbers.In certain embodiments, the first and second addresses are two distinct e-mail addresses.
In some other embodiment, if another person sends message from two or more different telephone numbers, message can appear in the different sessions corresponding with jack per station.Telephone number or other identifiers are near these sessions that show to be distinguished from each other of people's name.
In certain embodiments, the name field of instant messaging session comprises title in many ways or other identifiers that participates in session as message recipient and/or sender.If be used for to show denominative space, the selection subsets of display Name, and have the symbol that is similar to " ... " at the end, thus show in session have more in many ways.What give tacit consent to is that the user's of portable electric appts message sends to all sides in session.For simplicity, the embodiment of the IM session that this paper describes subsequently only comprises two sides, i.e. user and another person.But it will be appreciated by those skilled in the art that the method for describing in the present invention also may be used on comprising two with the IM session of top.
Instant message is packed into automatically " session " (at the instant message that exchanges between the user of equipment and each individual or telephone number) make the user more easily realize and follow the trail of and in many ways between the instant message exchange.As below describing, the user not only can see the stop press that is sent by the opposing party, and the user can also access the old message that exchanges between user and the opposing party.
In certain embodiments, be on touch-screen display or near object (for example, the optional position in the instant messaging session list detects finger touch) detected and show afterwards vertical bar 516 temporarily.In certain embodiments, the upright position of vertical bar 516 on the display part of list is corresponding to the upright position of display part in list of list.In certain embodiments, vertical bar 516 has the vertical length corresponding to the part that is being shown in list.In certain embodiments, if whole IM session list can be simultaneously displayed on touch-screen 112, do not show vertical bar 516.In certain embodiments, if can show simultaneously whole IM session list on touch-screen 112, vertical bar 516 is shown as having the length (for example, as shown in Figure 5) corresponding to the length of list viewing area.
As mentioned above, portable set monitors contacting of (1010) user and session list.When the user hit (1012) with finger or stylus along the perpendicular direction on touch-screen, this user's contact can be interpreted as roll attitude.In certain embodiments, roll attitude is the horizontal level that contacts that is independent of user and touch-screen display.In certain embodiments, roll attitude be basically be independent of user and touch-screen display the horizontal level that contacts (for example, one or more lateral side regions of touch-screen display can be preserved for other functions, for example corresponding to the function of icon, soft key or navigation application program function, and these zones can not be used for roll attitude).Portable electric appts correspondingly roll session list and the different piece of display session list (1020).
As shown in Figure 5, session list moves along the direction consistent with roll attitude 516.If roll attitude is (or upwards) downwards, session list also downwards (or upwards) mobile.Downwards the rolling session list is usually with list scrolling more early entry in the list, until arrive article one entry (for example, Jane Doe 504-1).If but the user does not have too many IM session, portable electric appts can show whole session list, and roll attitude is inoperative.
If the user raps (1018) with finger or stylus on editor's icon 512, portable electric appts replaces session list UI with the UI of new permission user edit session.The below is described in more detail with reference to Fig. 7 and 16 pairs of session editor features.
Similarly, if the user raps (1019) on message establishing icon 514, the portable electric appts UI that creates new instant message with new permission user and therefore create new session replaces session list UI.The below is described in more detail this feature with reference to Fig. 8 A-8B, Fig. 9 and Figure 19.
If rap (1014) on the special session of user in list, portable electric appts can be the attitude that indicating user wishes to check the message that is associated with the session of user's selection with this tap interpretation.Therefore, portable electric appts replaces the session list UI shown in Fig. 5 with the session UI shown in Fig. 6 A.
Fig. 6 A to 6K illustration according to the exemplary user interface of the text that is used for the input instant message of some embodiment.
In certain embodiments, user interface 600A (Fig. 6 A) comprises following element or its subset or superset:
● 402,404 and 406, as mentioned above;
● corresponding to the name 504 (if name can not obtain, being perhaps, telephone number itself) of the telephone number that uses in instant messaging session;
instant message icon 602, it starts to the conversion of the UI (for example, UI 500) that lists instant messaging session when being activated (for example, by the finger gesture on icon);
● the instant message 604 from the opposing party of usually sequentially listing along UI 600A one side;
● to the opposing party's instant message 606, it is sequentially listed along the opposite side of UI 600A usually, with message in display session back and forth;
● the timestamp 608 of at least some instant messages;
text input frame 612;
● send icon 614, it starts when being activated (for example, by the finger gesture on icon) message in text box 612 is sent to the opposing party (for example, Jane Doe504-1);
alphabetic keypad 616 is used at frame 612 input texts;
● alternative keyboard selector switch icon 618, it starts the demonstration to different keyboards (for example, 624 in Fig. 6 C) when being activated (for example, by the finger gesture on icon);
● send icon 620, it starts when being activated (for example, by the finger gesture on icon) message in text box 612 is sent to the opposing party (for example, Jane Doe504-1)
● switch key 628, next letter capitalization that it will be selected on alphabetic keypad 616 when being activated (for example, by the finger gesture on icon); And
vertical bar 630, it helps the user to understand which part that is showing in the instant message list in the IM session.
Figure 11 is illustration according to the process flow diagram in the processing that the instant messaging session that is used for when contacting with the predesignated subscriber of the touch-screen of portable electric appts showing that the user selects detected of some embodiment.In this example, in response to the session of Jane Doe on finger gesture 518 (Fig. 5) show session with Jane Doe.
(1102) when the user with the session of Jane Doe is selected detected, one group of instant message 604 that IM module 141 identification is associated with the session and 606 (1104), and show instant message (1106) according to time sequencing in the message viewing area of touch-screen.Due to the access existing session the user may wish to write a new instant message to another person, so described portable electric appts also on touch-screen display message write district (1108).In certain embodiments, the message composition district comprises text box 612 for the character that shows user's input, sends message icon 614, alphabetic keypad 616 and keyboard selector switch icon 618.Portable electric appts monitors and to contact with the user of touch-screen, and correspondingly responds (1110).
In certain embodiments, portable electric appts receives instant message when the user of this equipment is just utilizing Another Application program (for example, utilize browser 147 browsing pages, or utilize music player 146 to listen to the music).In this case, equipment can be used in the user interface that New Consumers interface on touch-screen 112 replaces ongoing application program, perhaps the New Consumers interface is stacked on the user interface of ongoing application program.Figure 21 illustration according to the client that be used for to remind of some embodiment, the exemplary user interface of new instant message is arranged.This user interface can or can not suspend or stop ongoing application program.For example, the user still can listen to the music when this new user interface appears on touch-screen 112.Even the user selects to activate IM module 141 subsequently and this also can set up in response to new information.
In certain embodiments, new user interface (for example, the UI in Figure 21 2100) comprises following element or its subset or superset:
● even send the people's of message name 2102 (for example, Jane Doe), the telephone number of the instant message that it can be by making arrival and the telephone number in user contact person 137 are complementary and are determined;
● the instant message that newly receives or its part 2104 (for example, " Do U want2... ");
● the first action icon 2106, for example " ignore "; And
● the second action icon 2108, for example " check ".
The user selects " ignoring " icon 2106 to make the user interface that brings back to ongoing application program, and the operation that interrupts of user's message that can continue to be arrived.The user selects " checking " icon 2108 can get around user interface 500, and directly takes the user to comprise this new instant message user interface 600A.As described below, then the user can carry out any message associative operation.
In certain embodiments, portable electric appts can receive instant message under it is in the pattern of holding.In this case, equipment can be included in the visual prompting of the arrival of user interface 300 indicating new informations, and/or loudspeaker 111 by equipment generates audio alert.If the user of equipment in response to this visual and/or audio alert and release the touch-screen 112 of equipment, the user can see user interface 600A (but not user interface 400) on touch-screen.
As shown in Figure 6A, may be displayed on the left side of message viewing area from the instant message 604 of Jane Doe, wherein latest news is (for example, 604-2) towards the bottom.The message that the user sends to Jane Doe is positioned at the opposite side of viewing area.The relative vertical position of message is corresponding to the order of these message that exchange between the user of equipment and Jane Doe.The timestamp 608 of selecting indicates also when these message are exchanged.In certain embodiments, timestamp is presented near message associated therewith.If the message viewing area does not have enough spaces to show the timestamp of current every message in the message viewing area, equipment can be selected the timestamp of display message subset, for example corresponding to the timestamp 608-1 of the message 604-1 that is positioned at the message area top with corresponding to the timestamp 608-2 of the message 606-2 that is positioned at the message area bottom.In certain embodiments, if for example between two message interval greater than predetermined threshold, equipment can show the timestamp of the message in the middle of more being positioned at.From this instant message, the user can easily catch the theme of session.If necessary, the user can by use roll attitude 610 (1112) on the message viewing area, browse current other old message that do not showing.As response, portable electric appts rolling message session collection (1124).In certain embodiments, roll attitude is independent of the horizontal level that contacts of user and touch-screen display.In certain embodiments, as mentioned above, roll attitude is independent of the horizontal level that contacts of user and touch-screen display basically.
In certain embodiments, for example underscore, difference font or form and/or color highlight the specific part of the message that is just arriving and just going out in equipment utilization.Usually, highlighted part is considered to have special implication, for example telephone number, URL, stock ticker or name of contact person.These highlighted message parts can be at user option.For example, the user makes activation browser 147 at the finger gesture that highlights on part " apple.com " of message 604-2, and then browser 147 will take the homepage of website www.apple.com to.Similarly, the finger gesture of user on telephone number activates phone 138, and starts the calling to this telephone number.
In certain embodiments, roll attitude vertically downward rolls session downwards, thus the old message in display session.In certain embodiments, roll attitude vertically upward scrolls up session, upgrades in display session thus, more recent message.In certain embodiments, as mentioned above, the stop press in session (for example, 606-2) be presented at instant messaging session list 500 (for example, 506-1) in.
In certain embodiments, be on touch-screen display or near object (for example, the optional position in the instant messaging session list detects finger touch) detected and show afterwards vertical bar 630 temporarily.In certain embodiments, the upright position of vertical bar 630 on the display part of list is corresponding to the upright position of display part in list of list.In certain embodiments, vertical bar 630 has the vertical length corresponding to the part that is being shown in list.For example, in Fig. 6 A, indicate just in the bottom of display message list (it is corresponding to the most recent message) upright position of vertical bar 630, and the vertical length of vertical bar 630 is indicated just roughly half message in display session.
Finger gesture (1114) on different letter keys in response to the user in keyboard is write new instant message in text box 612.The below describes in more detail this with reference to Figure 12 and writes processing.In certain embodiments, the keyboard 616 in Fig. 6 A only has 26 English alphabets due to the finite size of touch-screen.In order to input the character such as numeral, punctuate and other special symbols, the user need to rap (1120) and/or rap (1116) on switch key icon 628 on keyboard selector switch icon 618, to introduce additional keyboard or will have keyboard shift now to different display modes (for example, the letter from the uppercase/lowercase letter to lowercase/uppercase).The below will describe these processing with reference to Figure 13 and 14 respectively in more detail.After completing new information, the user is sending other participants (1118) that rap to send a message to session on message icon 614 or 620.The below describes this transmission processing in more detail with reference to Figure 15.
Figure 12 is illustration according to the process flow diagram of processing that is used for showing user inputs character and word suggestion (if any) of some embodiment.Detecting when the user of letter key is selected (1202), portable electric appts shows that in text box 612 user selects letter (1204).In order to accelerate to write the processing of new information, portable electric appts can determine whether that it can provide any word suggestion (1206) according to user's input.For this reason, portable electric appts can be inputted the user and based on philological algorithm (for example use, as the U.S. Patent application No.11/549 that is entitled as " Method; System; and Graphical User Interfacefor Text Entry with Partial Word Display " that submits on October 13rd, 2006, described in 624, the full content of this application is being hereby incorporated by reference), and demonstration is from one or more related terms (1208) of its database.
As shown in Fig. 6 B, user interface 600B (Fig. 6 B) comprises following element or its subset or superset:
● as above 402,404,406,602,604,606,608,612,614,616,618 and 620; And
word suggestion areas 622, it provides the possibility word word fragment that list is just being keyed in completing user in text box 612.
In this example, string " vacat " based on user's input, portable electric appts show in zone 622 three may words, namely " vacant ", " vacate " and " vacation " user can rap by the finger on the corresponding words icon to select any in these three words.Alternatively, the user can by with the word of the strict coupling of his input on rap the word of ignoring all computer proposes.In certain embodiments, portable electric appts also is kept at user's input in its database as neologisms.After, when the user inputted the subset of identical string or string, portable electric appts can show that these neologisms are as one of word suggestion.In certain embodiments, (for example, 2-3 second) just appears in UI 600B the word suggestion areas afterwards until the user input text predetermined time delay.In certain embodiments, the word suggestion areas is not used or can be closed by the user.
If if this option is not advised or closed to portable electric appts, the portable electric appts continuation monitors and contacts with the user of touch-screen, and correspondingly action (1210).
The description about the word suggestion is provided in addition can be the U.S. Patent application No.11/620 that is entitled as " Method; System; and Graphical User Interface for ProvidingWord Recommendations " that on January 5th, 2007 submitted to, find in 642, the full content of above-mentioned application is being hereby incorporated by reference.
As mentioned above, keyboard 616 may comprise not that the user wants all characters of inputting.There are a lot of diverse ways to introduce additional character.For example, as shown in Fig. 6 B, the user can rap to comprise on keyboard selector switch icon 618 such as numeral and/or punctuate not on the same group the new keyboard of character replace current alphabetic keypad 616.
Figure 13 is illustration according to the process flow diagram that showing the processing of corresponding keyboard when selecting the user of icon to contact with keyboard detecting of being used for of some embodiment.Select (1302) in response to the user to keyboard selector switch 618, the keyboard (1304) of which kind of type has been asked in the portable electric appts inspection.The type that depends on the keyboard of asking, portable electric appts shows alphabetic keypad (1308) or non-alphabetic keypad (1306).In certain embodiments, the implication that contacts with the user of keyboard selector switch icon 618 depends on the current display mode of keyboard.After showing the keyboard of asking, portable electric appts continues supervision and contacts (1310) with the user of touch-screen.
As shown in Fig. 6 C, after the user's finger gesture on the keyboard selector switch icon 618 in Fig. 6 B, present new user interface 600C on touch-screen, this interface has following element or its subset or superset:
● as above 402,404,406,602,604,606,608,612,614,620 and 622;
alternative keyboard 624, it can mainly be made of numeral and punctuate, and wherein makes punctuation key commonly used (for example, fullstop key 631, funny number key 633, question mark key 635 and exclamation number key 637) greater than other keys;
● alphabetic keypad selector switch icon 626, it starts the demonstration to alphabetic keypad (for example, 616 in Fig. 6 A) when being activated (for example, by the finger gesture on icon); And
● switch key 628, it starts the demonstration to another keyboard (for example, 639 in Fig. 6 D) when being activated (for example, by the finger gesture on icon).
It is noted that the non-alphabetic keypad selector switch 618 in Fig. 6 B is replaced by the alphabetic keypad selector switch 626 in Fig. 6 C now.In certain embodiments, fullstop key 631 and funny number key 633 are positioned near keyboard selector switch icon 626, advance to input the distance of fullstop and comma commonly used to reduce user's finger.
But alternative keyboard 624 can not comprise entirely.For example, it may not have any arithmetic operator such as "+", "-", " * " or "/".Finger gesture on keyboard selector switch 626 is taken back alphabetic keypad 616, but not any new keyboard.In certain embodiments, the user can rap on another multifunction key (for example, switch key 628), to introduce additional keyboard.
In certain embodiments, resemble keyboard selector switch icon (618,626) the same, switch key 628 has different implications in different context environmentals.Figure 14 is illustration according to the process flow diagram of processing that is used for explaining the implication that contacts with the specific user of switch key 628 of some embodiment.The user that portable electric appts detects switch key selects (1402).Portable electric appts checks current at what keyboard (1404) of touch screen display.If current keyboard is alphabetic keypad, the finger gesture on switch key touch make portable electric appts subsequently the display mode of user's input alphabet be transformed into lowercase from capitalization, vice versa (1406).
Return to the B with reference to Fig. 6, in certain embodiments, portable electric appts only shows first letter " h " in first word " how " with capitalization in default situation.If the user wishes another capitalization of input in same sentence, he can rap on switch key 628.As a result, after finger gesture with the different mode of vision (for example, with different colours or shade) display switching key 628.In certain embodiments, after the user had inputted next letter with capitalization, switch key 628 turned back to the lowercase pattern.If the user wishes to input a sequence capitalization, he can keep and the predetermined time expand section (for example, 1 to 3 second) of the finger contact of switch key 628, until switch key 628 has new outward appearance.In some other embodiment, switch key 628 for all subsequently user's input alphabet remain on the capitalization pattern, until another finger gesture on switch key 628 detected.
The below turns back to Figure 14, if current keyboard is non-alphabetic keypad (for example, the alternative keyboard 624 in Fig. 6 C), has different implications from user's contact of switch key 628.Because do not have character to have two kinds of different display modes on keyboard 624, so portable electric appts replaces keyboard 624 (1408) with another non-alphabetic keypad 639, then wait for contacting (1410) with next user of touch-screen.
Fig. 6 D is the Snipping Tool of the user interface 600D of correspondence, and it comprises following element or its subset or superset:
● as above 402,404,406,602,604,606,608,612,614,620,622,626,628; With
● another selects keyboard 639 else, and it can mainly be made of symbol and punctuate, wherein makes punctuation key commonly used (for example, fullstop key 631, funny number key 633, question mark key 635 and exclamation number key 637) greater than other keys.
As keyboard 624, do not have character to have two kinds of different display modes in keyboard 639.In certain embodiments, the user can rap on switch key 628 again, has more alternative keyboards of more special characters or symbol with introducing.In certain embodiments, the user can rap on switch key 628 again, to turn back to alternative keyboard 624.At any time, the user can also be by selecting to rap to switch on icon 626 to get back to alphabetic keypad at keyboard.
The description about selecting soft keyboard in addition can be the U.S. Patent application No.11/553 that is entitled as " Method; System; and Graphical User Interface for Selecting aSoft Keyboard " that on October 26th, 2006 submitted to, find in 431, the full content of above-mentioned application is being hereby incorporated by reference.
After completing new information, the user sends this message by activating (for example, with finger gesture) transmission message icon 614 or 620.Fig. 6 E has described to comprise this user interface 600E of following element or its subset or superset:
● as above 402,404,406,602,604,606,608,612,614,616,618 and 620; With
● send to the opposing party's new instant message 606-3.
In certain embodiments, this user's finger gesture triggers the animation of side of the message viewing area of message that new information sends from text box 612 to the user who illustrates by equipment.For example, when the user activates send key (for example, 614 or 620), the text in text box 612 " ejection " or otherwise from frame out, and become to the part of the string of the opposing party's user message 606.Black arrow illustration in Fig. 6 E quote bubble (quote bubble) 606-3 animation form.In certain embodiments, the size of quoting bubble is adjusted with the size of message.In certain embodiments, also sound when message sends, for example drip sound, to notify the user.
Figure 15 is illustration according to the process flow diagram that is used for instant message is sent to corresponding recipient's processing of some embodiment.In response to the user who sends message icon is selected (1502), whether the portable electric appts inspection has any user's input (1504) in text box.If no, can ignore simply the user at the finger gesture that sends on icon, perhaps show error messages (1508) on touch-screen.In certain embodiments, if do not have the user to input, change the visual appearance that (for example, desalination) sends icon 614 in text box.
If any user's input ("Yes" in 1504) is arranged in text box, portable electric appts can carry out the spell check (1506) to user's input alternatively.If any misspelling ("Yes" in 1506) is arranged, show error messages and/or word suggestion on touch-screen, be used for the user and select (1512).If there is no misspelling, portable electric appts sends message, and can also show the movement (1514) of new information from text box to the message viewing area by animation.Then portable electric appts monitors with the user of touch-screen and contacts (1516).
In certain embodiments, key in keyboard 616 (Fig. 6 A, 6B, 6E-6K), 624 (Fig. 6 C) and/or 639 (Fig. 6 D) is temporary transient shape, shade and/or the color of changing when being touched/activating by the user, has activated the expectation key to help the user to understand.In certain embodiments, for identical purpose, the user to any key on touch-screen selects to follow with sound by finger gesture.In some other embodiment, alternative sounds is associated to represent with dissimilar keystroke what key the user " has pressed ".In certain embodiments, illustrate on keyboard corresponding to the profile of user's finger contact or shadow region to help the training user.
In certain embodiments, the user can rap by the finger that the correspondence in the message viewing area is quoted on bubble, deletes instant message from session.Portable electric appts responsively makes to quote to steep and becomes grey light, and ejects wicket on touch-screen.This wicket can comprise "Yes" icon and "No" icon.If the user raps the decision of reaffirming about deletion message by the finger on the "Yes" icon, portable electric appts removes from the message viewing area and quotes bubble so.If but the user selects the "No" icon, quote bubble and continue its normal appearance.
In certain embodiments, user interface 600F (Fig. 6 F) comprises following element or its subset or superset:
● as above 402,404,406,612,614,616,618,620 and 628;
● recipient's input field 632, it (for example is activated, rap by the finger on this field) time receive and show the recipient's of instant message telephone number (if perhaps this recipient is in user contact lists, showing recipient's name);
● add recipient's icon 634, it starts the demonstration to the contacts list that can roll (for example, 638 in Fig. 6 G) when being activated (for example, rapping by the finger on icon); With
● cancel icon 636, it cancels new instant message when being activated (for example, rapping by the finger on icon).
In certain embodiments, user interface 600G (Fig. 6 G) comprises following element or its subset or superset:
● as above 402,404,406,612,614,616,618,620,628,632,634 and 636;
● the contacts list 638 that can roll, the wherein Input matching in contact person and recipient's input field 632; And
vertical bar 640, its help user to understand to show in contacts list with recipient's input field 632 in how many entries of Input matching.
In certain embodiments, list 638 comprise with recipient's input field 632 in the contact person of Input matching.For example, if inputted letter " v ", name or surname are shown with the contact person of " v " beginning.If input alphabet in field 632 " va ", the contacts list constriction is arrived name or surname with the contact person of " va " beginning, and the rest may be inferred, until selected one of (for example, by rapping on the contact person in list 638) shown contact person.
In certain embodiments, the user can apply by the zone to display list 638 attitude 642 of vertically hitting, and comes the scroll list 638.In certain embodiments, attitude this list of rolling downwards vertically downward, and attitude this list that scrolls up vertically upward.
In certain embodiments, be on touch-screen display or near object (for example, the optional position in list 638 detects finger touch) detected and show afterwards vertical bar 640 temporarily.In certain embodiments, the upright position of vertical bar 640 on the display part of list is corresponding to the upright position of display part in list of list.In certain embodiments, vertical bar 640 has the vertical length corresponding to the list part that is showing.
In certain embodiments, user interface 600H (Fig. 6 H) and 600I (Fig. 6 I) comprise following element or its subset or superset:
● as above 402,404,406,612,614,616,618,620,628,632,634 and 636;
● near the suggestion word 644 the word of inputting;
● the suggestion word 646 in the blank in keyboard 616; And/or
● insert mark 656 (for example, cursor, insertion bar, insertion point or indicator).
In certain embodiments, activate suggestion word 644 (for example, rapping by the finger on the suggestion word) and replace with suggestion word 644 word of keying in.In certain embodiments, activate suggestion word 646 (for example, rapping by the finger on blank) and replace with suggestion word 646 word of keying in.In certain embodiments, the user can arrange whether suggestion word 644 and/or 646 (for example, by User Preferences (preference) is set) is shown.
In certain embodiments, letter temporarily be exaggerated after selected (for example, in Fig. 6 H squeeze into " din " afterwards " N " temporarily amplified) so that the feedback to the user to be provided.
In certain embodiments, user interface 600J (Fig. 6 J) and 600K (Fig. 6 K) comprise following element or its subset or superset:
● as above 402,404,406,612,614,616,618,620,628,632,634,636 and 656;
● the expansion 650 of figure, it helps the user to regulate the position of the insertion mark 657 (being sometimes referred to as " insertion point amplifier ") of expansion;
● mark 657 is inserted in expansion; With
vertical bar 658, its expression is showing which part of the instant message that comprises multiline text.
In certain embodiments, insert on mark 656 or near finger contact 648-1 start the demonstration that mark 657-1 is inserted in insertion point amplifier 650 and expansion.In certain embodiments, when finger contact moves on touch-screen (for example, to position 648-2), there are expansion insertion mark (for example, to 657-2) and the correspondence of insertion point amplifier 650 to move.Thus, insertion point amplifier 650 provides the finger that utilizes on touch-screen to input the effective way of positioning cursor or other insertion marks.In certain embodiments, amplifier 650 keeps visible and can be relocated, as long as keep and the Continuous Contact of touch-screen (for example, from 648-1 to 648-2 even to 648-3).
In certain embodiments, the insertion mark (for example, the mark 656 in Fig. 6 I) (for example, Fig. 6 I) at portable electric appts primary importance place in display graphics and figure on touch-screen display.In certain embodiments, inserting mark 656 is cursor, insertion bar, insertion point or indicator.In certain embodiments, figure comprises text (for example, the text in the frame 612 in Fig. 6 I).
Detect with the finger contact (for example, the contact 648-1 in Fig. 6 I) of touch-screen display in certain embodiments, the position of finger contact is near the position of inserting mark.In certain embodiments, any position of the position of finger contact in input text area (for example, the frame 612 in Fig. 6 I).
In response to the finger contact that detects, insertion from first size (for example is marked on touch-screen display, mark 656 in Fig. 6 I) (for example expand to the second size, mark 657-1 in Fig. 6 J), and the part of the figure on touch-screen display (for example, the part 650-1 in Fig. 6 J) expands to the rear size of expansion from original size.
In certain embodiments, the part that is expanded of figure comprises insertion mark and near figure.In certain embodiments, after the part of insertion point and figure is expanded, show to comprise original size and the insertion mark of the rear size of expansion and near the figure of figure.
Detect the movement (for example, in Fig. 6 J from 648-1 to 648-2) of finger contact on touch-screen display
Primary importance according to the finger contact that detects from figure (for example, the 657-1 in Fig. 6 J) moves to the movement of the second place (for example, the 657-2 in Fig. 6 J) the insertion mark of expanding.
In certain embodiments, the part of expanding of figure moves to the second place (for example, in Fig. 6 J from 650-1 to 650-2) and changes from primary importance with inserting mark.In certain embodiments, the part of expanding in figure shows with reservation shape.In certain embodiments, the part that is expanded in figure (for example, 650 in Fig. 6 J) is shown as circle.In certain embodiments, the insertion mark 657 of expanding is in this circle.
The movement of the finger contact that detects in certain embodiments, has in the horizontal component on touch-screen display and the vertical component on touch-screen display.In certain embodiments, moving according to the movement of the finger contact that detects the insertion mark 657 of expanding comprises, do not disconnect contact if finger contact moves to outside input text area, move the insertion mark expanded and institute's expansion of figure according to the horizontal component of the movement of finger contact.For example, in Fig. 6 I, if finger contact moves to 648-3 (keyboard region) from 648-2 (in input text area 612), institute's expansion 650 of expanding insertion point 657 and figure can be according to the horizontal component of the movement from 648-2 to 648-3 and is moved (not shown) along the lower horizontal of input text area.
In certain embodiments, (for example move first area that the insertion mark of expanding is included in the character that utilizes soft keyboard input comprising of touch-screen according to the movement of the finger contact that detects, text box 612 in Fig. 6 J) in, mobile the expansion inserted mark, in the second area (for example, the keyboard 616 in Fig. 6 J) that separates with the first area that wherein soft keyboard is arranged in touch-screen.
In certain embodiments, if disconnected finger contact with touch-screen display, the insertion mark of expanding is (for example, the insertion mark 656 in Fig. 6 K) from the second dimensional contraction to first size.In certain embodiments, described contraction comprise expand and insert mark 657 and narrow down to the animation that inserts mark 656 in the second place.
In certain embodiments, if the finger contact that no longer detects with touch-screen display reaches the schedule time, institute's expansion 650 of figure shrinks.
Comprise insertion mark and figure at the graphic user interface that has on the portable electric appts of touch-screen display.In response to the finger contact 648 that detects with touch-screen display, insert mark and expand to the second size 657 from first size 656, and the part 650 of expansion figure.In response to the movement that the finger contact on touch-screen display detected, the movement of the second place 657-2 according to the primary importance 657-1 of detected finger contact from figure in the figure, mobile institute expands the insertion mark.
As above described about Fig. 6 E, the user of send key 614 is pointed select to have triggered message and move to the animation of message viewing area from text box 612.In certain embodiments, before sending this message, the size of expanded text frame when input text (for example, two styles of writing of the delegation's text from Fig. 6 H in Fig. 6 I this).In certain embodiments, if text box 612 has too multiline text (as by as shown in short vertical bar 658), it does not have the sufficient space that shows whole message.Quote bubble from text box 612 out the time when what comprise multirow message, can little by little increase its size, until satisfy predetermined condition (for example, quote bubble have quantity that size that enough spaces comprise whole message and/or quote bubble reaches the existing message in dialogue-based by equipment threshold value static or that dynamically determine).For example, if text box illustrates 3 row in 10 row instant messages, during message is moved to the animation of message viewing area from text box 612, quote bubble and can quote bubble from 3 row and increase to 10 row and quote bubble.
The description of locating about the insertion mark in addition can be the U.S. Patent application No.11/553 that is entitled as " Method; System; And Graphical User Interface ForPositioning An Insertion Marker In A Touch Screen Display " that on October 26th, 2006 submitted to, find in 436, the full content of above-mentioned application is being hereby incorporated by reference.
Except each message of deletion from session, can also be by the editor's icon 512 whole sessions of deletion in Fig. 5.Fig. 7 illustration according to the exemplary user interface that is used for the deletion instant messaging session of some embodiment.In certain embodiments, user interface 700 comprises following element or its subset or superset:
● as above 402,404,406,504,506,508,510;
● deletion icon 702;
● remove icon 704; With
● complete icon 706.
What Figure 16 was illustration according to some embodiment is used for showing process flow diagram in order to the processing of the instant messaging session list of editing.When user to editor's icon 512 being detected and select (1602), portable electric appts will delete near icon 702 be associated (1604) with each session (for example, deleting icon 702 appears at each session).In addition, portable electric appts can replace editor's icon 512 (1606) with completing icon 706, and supervision contacts (1608) with the user of touch-screen.
If the user is along perpendicular direction hit on touch-screen its finger or stylus (1610), portable electric appts rolling session list (1616).If the user activates deletion icon (for example, utilizing finger gesture), portable electric appts continues the deletion processing for the session of correspondence.Below describe in more detail exemplary session about Figure 17 and 18 and remove processing.If but icon is completed in user's touch, portable electric appts removes all deletion icons 702 from touch-screen, and takes back session list UI as shown in Figure 5.
Figure 17 is illustration according to the process flow diagram of the processing that is used for the instant messaging session that compiles user selects of some embodiment.Detecting when the user of deletion icon associated with the session is selected (1702), portable electric appts changes the outward appearance (for example, in Fig. 7, selected deletion icon 702-4 being rotated 90 degree) (1704) of deletion icon.Portable electric appts will be confirmed icon (for example, removing icon 704) be associated with the session of selecting (1706).In certain embodiments, during editing and processing, the same time shows that is at the most confirmed an icon on touch-screen.Depend on next user of touch-screen to contact (1708), portable electric appts can be carried out different operations for session list.For example, this equipment can come in response to user's roll attitude up/down this list (1710,1718) of rolling.This equipment can be in response to taking back session list UI (1714) completing the finger gesture on icon.
What Figure 18 was illustration according to some embodiment is used for removing the instant messaging session that the user selects or the process flow diagram that withdraws from the processing of session edit pattern.If the user selects to confirm icon (1712,1802), portable electric appts removes session (1804) from touch-screen.If the session that removes is not last in list, portable electric appts can other sessions of upward displacement, to fill the space (1806) that is stayed by the session that is removed.Determining not delete session the expression of the finger gesture of going up Anywhere (1716,1803) except confirming icon 704 user on touch-screen on amended deletion icon 702-4 or in certain embodiments.Therefore, portable electric appts will be deleted icon and change back its original appearance (1805), and remove this confirmation icon (1807) from touch-screen.
After operation 1806 or 1807, portable electric appts continues supervision and contacts (1808) with the user of touch-screen.For example, when the user had completed deletion IM session, the user can point by utilization and rap to activate this icon (1814) on icon 706 completing, and equipment turns back to UI 500.The user can delete another session (1812) by the deletion icon that activation is associated.If there is long filling to surpass the session list of screen area, the user can utilize this list (1810,1816) of rolling of vertically upward and/or vertically downward attitude 708 on touch-screen.
Requirement moves by this session of a plurality of attitudes of user on the different piece (for example, deletion icon 702-4 and confirmation icon 704 are positioned at the opposite side of touch-screen) of touch-screen the chance that processing can reduce user's unexpected deletion session or other similar entries.
Referring again to Fig. 5, the user can start new session with another person by activating message establishing icon 514 (for example, utilizing finger to rap or other attitudes).Figure 19 is illustration according to some embodiment be used for show that the user is from the process flow diagram of the processing of its contacts list of selecting to transfer immediate news.Detect the user of message establishing icon is selected after (1902), portable electric appts is one group of contact person of identification thin or equivalent from station address, because do not know whose (1904) new session is to.Then, the portable electric appts contact person (1908) that touching screen display and identify.In certain embodiments, except contacts list, portable electric appts is touching a plurality of icons of screen display (1909), such as group contact icon, first name and last name icon, alphabetical list icon, cancellation icon and other number icons.The below will describe these icons in more detail about Fig. 8 A and Fig. 8 B.After presenting contacts list and the additional icon, then portable electric appts monitors with the user of touch-screen and contacts (1910).
Fig. 8 A and Fig. 8 B illustration according to the exemplary user interface that is used for contacts list of some embodiment.In certain embodiments, user interface 800A and 800B comprise following element or its subset or superset:
● as above 402,404,406;
● group icon 802, it starts the demonstration to group of contacts when being activated (for example, rapping by the finger on icon);
● name icon 804, its alphabet to them that starts when being activated (for example, rapping by the finger on icon) according to user contact person's name shows (Fig. 8 B);
● surname icon 806, its alphabet to them that starts when being activated (for example, rapping by the finger on icon) according to user contact person's surname shows (Fig. 8 A);
● alphabetical list icon 808, the user can touch this icon with the specific initial in the shown contacts list of quick arrival;
● cancel icon 810, it starts the UI (for example, UI 500) before being converted back to when being activated (for example, by the finger gesture on icon); With
● other number icons 812, it (for example is being activated, by the finger gesture on icon) time start the UI (for example, the UI in Fig. 9 900) be transformed into the telephone number that transmits for the input instant message (for example, not the telephone number in user contact lists).
As the U.S. Patent application No.11/322 that is entitled as " Scrolling List With FloatingAdjacent Index Symbols " that submits on Dec 23rd, 2005, described in 547, the user can utilize the contacts list that rolls of the vertically upward and/or vertically downward attitude 814 on touch-screen, and the full content of this application is being hereby incorporated by reference.
If next user's contact is this roll attitude 814 (1912) or the finger gesture (1914) on one of name icon 804, middle name icon 806 and alphabetical list icon 808, portable electric appts is revised current contact (1920) on display.Although contacts list can be by a plurality of application programs on same portable set (for example, Email, phone and instant message transmit) share, but because contacts list is asked in the IM application program, so in this case the user of the name in contacts list is selected to be used to the IM business.Here, activate to illustrate contacts list about the user to the message establishing icon 514 in IM application program 141.
If portable electric appts detects the name of a people in contacts list or the finger gesture (1916) on other identifiers, the portable electric appts show needle is to the message composition zone (1108 in Figure 11) to selected contact person's message, and shows session UI as shown in Figure 6A.In certain embodiments, if between user and selected people, existing session is arranged, portable electric appts by showing the message be associated with existing session with new session and in existing session.
If portable electric appts detects in user's attitude (1918) of cancelling on icon 810, portable electric appts abandons creating the processing of new session, and takes back the session list shown in Fig. 5 (Figure 10 1006).
If portable electric appts detects the finger gesture (1919) on other number icons 812, startup and the not new session of the people in contacts list usually.Therefore, portable electric appts can present new user interface, is used for the people's that user's input will be used by new session associated person information.
Figure 20 is illustration according to some embodiment be used for utilize new phone number to start the process flow diagram of the processing of new session.When user to other number icons being detected and select (2002), portable electric appts provides associated person information viewing area (2004) and associated person information to write district (2006) on touch-screen.Associated person information can be for the telephone number of IM business or e-mail address.The associated person information viewing area comprises the text box 906 for the associated person information that shows user's input.Associated person information is write the district and is comprised the keyboard 624 of user in order to input this associated person information.Cancel icon (2012) if the user activates, portable electric appts abandons creating the processing of new session, and turns back to the session list UI shown in Fig. 5.If user's input is letter or number (2010), portable electric appts is presented at (2014) in text box with it.
Fig. 9 illustration according to the exemplary user interface that is used for the telephone number that the input instant message transmits of some embodiment.In certain embodiments, user interface 900 comprises following element or its subset or superset:
● as above 402,404,406,602 and 624;
● cancel icon 902, it starts the UI (for example, UI 800A or UI 800B) before rotating back into when being activated (for example, by the finger gesture on icon);
● preserve icon 904, it (for example is being activated, by the finger gesture on icon) time start will input telephone number (for example be kept at the instant messaging session list, UI 500) in, and show the UI (for example, UI 600A) in order to the instant message of writing the telephone number that will send to input; With
● digital input frame 906 is used for utilizing keyboard 624 input telephone numbers.
It is noted that shown keyboard depends on application environment.For example, when needs or digit expected input, UI shows the soft keyboard (for example, 624) with numeral.When needs or the input of expectation letter, UI shows the soft keyboard (for example, 616) with letter.
Provided above description with reference to specific embodiment for purposes of illustration.Yet above exemplary discussion is not be intended to exhaustive or limit the invention to disclosed precise forms.According to above teacher, can carry out many modifications and variations.Select and described embodiment in order to explaining best principle of the present invention and practical application thereof, thus the various embodiment that make those skilled in the art can utilize best the present invention and carried out the various modifications of the special-purpose that is suitable for conceiving.

Claims (28)

1. method that be used for to show instant message comprises the following steps:
Show the instant messaging session list on the touch-screen display of portable electric appts, wherein, corresponding instant messaging session is included in the corresponding one group of instant message that exchanges between the first and corresponding another person;
When showing described instant messaging session list, detection comprises the first roll attitude that moves with the first perpendicular that contacts of described touch-screen display;
By the described instant messaging session list of rolling according to the direction of described the first roll attitude, respond described the first roll attitude, wherein, described the first roll attitude is basically with irrelevant with described first horizontal level that contacts of described touch-screen display;
Selection attitude on the specific instant messaging session of detection in described instant messaging session list;
By substitute the demonstration to described instant messaging session list with the demonstration to described specific instant messaging session, respond described selection attitude, wherein, described specific instant messaging session comprises in chronological order the one group of instant message that exchanges between described the first and single another person;
During instant message in showing described specific instant messaging session, detection comprises the second roll attitude that moves with the second perpendicular that contacts of described touch-screen display, wherein, described detection the second roll attitude is basically with irrelevant with the second horizontal level that contacts of described touch-screen display; And
Roll to the demonstration of the instant message in described specific instant messaging session by the direction according to described the second roll attitude, respond described the second roll attitude.
2. method according to claim 1, comprise and to be presented at alignedly on the first side of described touch-screen display by described the first described single another person's the instant message that sends to, and will send to described the first instant message to be presented at alignedly on the opposite side of described touch-screen display by described single another person.
3. method according to claim 1 also comprises:
Show one or more timestamps adjacent to one or more described instant messages.
4. method according to claim 1 also comprises:
Show by the described the first instant message that sends to described single another person with the first color; And
Show with the second color to send to described the first instant message by described single another person, described the second color is different from described the first color.
5. method according to claim 1 also comprises:
Will by the instant message left-justify of first transmission in described the first and described single another person be presented on touch-screen display; And
Will by the instant message Right Aligns of another transmission in described the first and described single another person be presented on touch-screen display.
6. method according to claim 1 also comprises:
Visually show that in the animation mode message composition district from the described the first instant message that newly sends to described single another person from touch-screen display is to the movement of the message viewing area of touch-screen display.
7. method according to claim 1 also comprises:
Be presented at the instant message that exchanges between described the first and described single another person in the message viewing area; With
Show text box and first group of key in the message composition district.
8. method according to claim 7 also comprises:
Detect with described first group of key in the contacting an of key time, displaying symbol in described text box.
9. method according to claim 7 also comprises:
Detect with described first group of key in the contacting an of key time, substitute at least one subgroup in described first group of key with second group of key.
10. method according to claim 7 also comprises:
According to the text of described the first input, show one or more texts input suggestions in described message composition district; And
When predetermined attitude being detected, add by described the first selected text input suggestion to described text box.
11. method according to claim 7 also comprises:
According to the text of described the first input, show one or more texts input suggestions in described message composition district; With
When predetermined attitude being detected, to be substituted at least a portion text in text box by described the first selected text input suggestion.
12. method according to claim 1 also comprises:
When showing described instant messaging session list:
Show editor's icon on touch-screen display;
When the selection that detects described editor's icon, show the deletion icon adjacent to each session of listing, and substitute described editor's icon to complete icon;
When the selection that detects deletion one of icon, the session that deletion is adjacent with the deletion icon of described selection; And
Detecting when completing the selection of icon, delete the deletion icon adjacent with each session of listing, and substitute the described icon of completing with editor's icon.
13. method according to claim 1 also comprises:
When showing described instant messaging session list:
Show editor's icon on touch-screen display;
When the selection that detects described editor's icon, show the deletion icon adjacent to each session of listing;
When the selection that detects deletion one of icon, the session that deletion is adjacent with the deletion icon of described selection; And
When the selection that detects the part that is not occupied by any deletion icon of touch-screen display, delete the deletion icon adjacent with each session of listing.
14. method according to claim 1 also comprises:
When showing described instant messaging session list:
Show editor's icon on touch-screen display;
When the selection that detects described editor's icon, be adjacent to show the deletion icon with each session of listing, and substitute described editor's icon to complete icon;
When the selection that detects deletion one of icon, the adjacent session of deletion icon contiguous and described selection shows confirms icon; And
When the selection that detects described confirmation icon, from the touch-screen display deletion session adjacent with the deletion icon of described selection.
15. an equipment that is used for showing instant message comprises:
Be used for showing the device of instant messaging session list on the touch-screen display of portable electric appts, wherein, corresponding instant messaging session is included in the corresponding one group of instant message that exchanges between the first and corresponding another person;
Be used for detecting the device that comprises the first roll attitude that moves with the first perpendicular that contacts of described touch-screen display when showing described instant messaging session list;
Be used for by the described instant messaging session list of rolling according to the direction of described the first roll attitude, respond the device of described the first roll attitude, wherein, described the first roll attitude is basically with irrelevant with described first horizontal level that contacts of described touch-screen display;
Device for detection of the selection attitude on the specific instant messaging session in described instant messaging session list;
Be used for by substitute the demonstration to described instant messaging session list with the demonstration to described specific instant messaging session, respond the device of described selection attitude, wherein, described specific instant messaging session comprises in chronological order the one group of instant message that exchanges between described the first and single another person;
Be used for when showing the instant message of described specific instant messaging session, detection comprises the device of the second roll attitude that moves with the second perpendicular that contacts of described touch-screen display, wherein, described detection the second roll attitude is basically with irrelevant with the second horizontal level that contacts of described touch-screen display; And
Be used for responding the device of described the second roll attitude by rolling according to the direction of described the second roll attitude to the demonstration of the instant message of described specific instant messaging session.
16. equipment according to claim 15, comprise for will be presented at alignedly by the described the first instant message that sends to described single another person the first side of described touch-screen display, and will send to described the first instant message to be presented at alignedly device on the opposite side of described touch-screen display by described single another person.
17. equipment according to claim 15 also comprises:
Be used for showing adjacent to one or more described instant messages the device of one or more timestamps.
18. equipment according to claim 15 also comprises:
Be used for showing by the described the first device that sends to described single another person's instant message with the first color; And
Be used for showing with the second color the device that is sent to described the first instant message by described single another person, described the second color is different from described the first color.
19. equipment according to claim 15 also comprises:
Be used for will by the instant message left-justify of first transmission of described the first and described single another person be presented at device on touch-screen display; And
Be used for will by the instant message Right Aligns of another transmission of described the first and described single another person be presented at device on touch-screen display.
20. equipment according to claim 15 also comprises:
Be used for visually showing that in the animation mode message composition district from the described the first instant message that newly sends to described single another person from touch-screen display is to the device of the movement of the message viewing area of touch-screen display.
21. equipment according to claim 15 also comprises:
Be used for being presented in the message viewing area device of the instant message that exchanges between described the first and described single another person; With
Be used for the device at message composition district's demonstration text box and first group of key.
22. equipment according to claim 21 also comprises:
Be used for when detecting with the contacting an of key of described first group of key the device of displaying symbol in described text box.
23. equipment according to claim 21 also comprises:
Be used for when detecting with the contacting an of key of described first group of key, with the device of at least one subgroup in the alternative described first group of key of second group of key.
24. equipment according to claim 21 also comprises:
Be used for the text according to described the first input, show the device of one or more texts input suggestions in described message composition district; And
Be used for when predetermined attitude being detected, add the device of being advised by described the first selected text input to described text box.
25. equipment according to claim 21 also comprises:
Be used for the text according to described the first input, show the device of one or more texts input suggestions in described message composition district; With
Be used for when predetermined attitude being detected, to be substituted the device of at least a portion text in text box by described the first selected text input suggestion.
26. equipment according to claim 15 also comprises:
Be used for showing the device of editor's icon on touch-screen display when showing described instant messaging session list;
Be used for when showing described instant messaging session list, when the selection that detects described editor's icon, show the deletion icon adjacent to each session of listing, and substitute the device of described editor's icon to complete icon;
Be used for when showing described instant messaging session list, when the selection that detects one of deletion icon, the device of the session that deletion is adjacent with the deletion icon of described selection; And
Be used for when showing described instant messaging session list, detecting when completing the selection of icon, delete the deletion icon adjacent with each session of listing, and to edit the alternative described device of completing icon of icon.
27. equipment according to claim 15 also comprises:
Be used for showing the device of editor's icon on touch-screen display when showing described instant messaging session list;
Be used for when showing described instant messaging session list, when the selection that detects described editor's icon, show the device of deletion icon adjacent to each session of listing;
Be used for when showing described instant messaging session list, when the selection that detects one of deletion icon, the device of the session that deletion is adjacent with the deletion icon of described selection; And
Be used for when showing described instant messaging session list, when the selection that detects the part that is not occupied by any deletion icon of touch-screen display, delete the device of the deletion icon adjacent with each session of listing.
28. equipment according to claim 15 also comprises:
Be used for showing the device of editor's icon on touch-screen display when showing described instant messaging session list;
Be used for when showing described instant messaging session list, when the selection that detects described editor's icon, be adjacent to show the deletion icon with each session of listing, and substitute the device of described editor's icon to complete icon;
Be used for when showing described instant messaging session list, when the selection that detects one of deletion icon, the adjacent session of deletion icon contiguous and described selection shows the device of confirming icon; And
Be used for when showing described instant messaging session list, when the selection that detects described confirmation icon, from the device of the touch-screen display deletion session adjacent with the deletion icon of described selection.
CN2007800413515A 2006-09-06 2007-08-31 Portable electronic device for instant messaging Active CN101535940B (en)

Applications Claiming Priority (15)

Application Number Priority Date Filing Date Title
US82476906P 2006-09-06 2006-09-06
US60/824,769 2006-09-06
US87925307P 2007-01-07 2007-01-07
US88381907P 2007-01-07 2007-01-07
US60/883,819 2007-01-07
US60/879,253 2007-01-07
US87946907P 2007-01-08 2007-01-08
US60/879,469 2007-01-08
US94696907P 2007-06-28 2007-06-28
US60/946,969 2007-06-28
US93799307P 2007-06-29 2007-06-29
US60/937,993 2007-06-29
US11/848,208 2007-08-30
US11/848,208 US9304675B2 (en) 2006-09-06 2007-08-30 Portable electronic device for instant messaging
PCT/US2007/077424 WO2008030776A2 (en) 2006-09-06 2007-08-31 Portable electronic device for instant messaging

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN201310169099.3A Division CN103294399B (en) 2006-09-06 2007-08-31 For the portable electric appts that instant message transmits

Publications (2)

Publication Number Publication Date
CN101535940A CN101535940A (en) 2009-09-16
CN101535940B true CN101535940B (en) 2013-06-12

Family

ID=40308482

Family Applications (7)

Application Number Title Priority Date Filing Date
CNA2007800011428A Pending CN101356493A (en) 2006-09-06 2007-08-31 Portable electronic device for photo management
CNA2007800404728A Pending CN101529874A (en) 2006-09-06 2007-08-31 Incoming telephone call management for a portable multifunction device with touch screen display
CN2007800413515A Active CN101535940B (en) 2006-09-06 2007-08-31 Portable electronic device for instant messaging
CN200780040362.1A Active CN101529367B (en) 2006-09-06 2007-08-31 For the voicemail manager of portable multifunction device
CN2007800405082A Active CN101529368B (en) 2006-09-06 2007-09-05 Methods for determining a cursor position from a finger contact with a touch screen display
CN2007800412226A Active CN101535938B (en) 2006-09-06 2007-09-05 Portable electronic device, method, and graphical user interface for displaying structured electronic documents
CN2007800011409A Active CN101356492B (en) 2006-09-06 2007-09-06 Portable electonic device performing similar oprations for different gestures

Family Applications Before (2)

Application Number Title Priority Date Filing Date
CNA2007800011428A Pending CN101356493A (en) 2006-09-06 2007-08-31 Portable electronic device for photo management
CNA2007800404728A Pending CN101529874A (en) 2006-09-06 2007-08-31 Incoming telephone call management for a portable multifunction device with touch screen display

Family Applications After (4)

Application Number Title Priority Date Filing Date
CN200780040362.1A Active CN101529367B (en) 2006-09-06 2007-08-31 For the voicemail manager of portable multifunction device
CN2007800405082A Active CN101529368B (en) 2006-09-06 2007-09-05 Methods for determining a cursor position from a finger contact with a touch screen display
CN2007800412226A Active CN101535938B (en) 2006-09-06 2007-09-05 Portable electronic device, method, and graphical user interface for displaying structured electronic documents
CN2007800011409A Active CN101356492B (en) 2006-09-06 2007-09-06 Portable electonic device performing similar oprations for different gestures

Country Status (3)

Country Link
CN (7) CN101356493A (en)
AU (2) AU2022201622B2 (en)
ES (1) ES2361784T3 (en)

Families Citing this family (150)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8564544B2 (en) 2006-09-06 2013-10-22 Apple Inc. Touch screen device, method, and graphical user interface for customizing display of content category icons
US20080168402A1 (en) 2007-01-07 2008-07-10 Christopher Blumenberg Application Programming Interfaces for Gesture Operations
US20080168478A1 (en) 2007-01-07 2008-07-10 Andrew Platzer Application Programming Interfaces for Scrolling
US9933937B2 (en) 2007-06-20 2018-04-03 Apple Inc. Portable multifunction device, method, and graphical user interface for playing online videos
US8645827B2 (en) 2008-03-04 2014-02-04 Apple Inc. Touch event model
US8717305B2 (en) 2008-03-04 2014-05-06 Apple Inc. Touch event model for web pages
US8416196B2 (en) 2008-03-04 2013-04-09 Apple Inc. Touch event model programming interface
US9311112B2 (en) 2009-03-16 2016-04-12 Apple Inc. Event recognition
US8566045B2 (en) 2009-03-16 2013-10-22 Apple Inc. Event recognition
US9684521B2 (en) 2010-01-26 2017-06-20 Apple Inc. Systems having discrete and continuous gesture recognizers
US8285499B2 (en) * 2009-03-16 2012-10-09 Apple Inc. Event recognition
JP5370754B2 (en) * 2009-06-30 2013-12-18 ソニー株式会社 Input device and input method
TWI412963B (en) 2009-07-01 2013-10-21 Htc Corp Data display and movement methods and systems, and computer program products thereof
CN101650633B (en) * 2009-07-03 2011-10-05 苏州佳世达电通有限公司 Manipulating method of electronic device
JP5436975B2 (en) * 2009-08-21 2014-03-05 オリンパスイメージング株式会社 CAMERA, CAMERA DISPLAY CONTROL METHOD, DISPLAY DEVICE, AND DISPLAY METHOD
CN101996028B (en) * 2009-08-21 2013-04-24 宏达国际电子股份有限公司 Data display and move method and system
JP5333068B2 (en) * 2009-08-31 2013-11-06 ソニー株式会社 Information processing apparatus, display method, and display program
KR101390957B1 (en) * 2009-09-04 2014-05-02 나이키 인터내셔널 엘티디. Monitoring and tracking athletic activity
CN102023790B (en) * 2009-09-22 2013-06-12 宏碁股份有限公司 Method for dynamic operation on interactive objects and system thereof
US8823743B2 (en) * 2009-10-02 2014-09-02 Sony Corporation Image processing device and method, and program
KR20110037298A (en) * 2009-10-06 2011-04-13 삼성전자주식회사 Edit method of list and portable device using the same
KR20110037657A (en) * 2009-10-07 2011-04-13 삼성전자주식회사 Method for providing gui by using motion and display apparatus applying the same
EP2320312A1 (en) * 2009-11-10 2011-05-11 Research In Motion Limited Portable electronic device and method of controlling same
CN101702111B (en) * 2009-11-13 2013-07-03 宇龙计算机通信科技(深圳)有限公司 Method for realizing content scaling of touch screen and terminal
US8381125B2 (en) * 2009-12-16 2013-02-19 Apple Inc. Device and method for resizing user interface content while maintaining an aspect ratio via snapping a perimeter to a gridline
US8736561B2 (en) 2010-01-06 2014-05-27 Apple Inc. Device, method, and graphical user interface with content display modes and display rotation heuristics
US9052894B2 (en) * 2010-01-15 2015-06-09 Apple Inc. API to replace a keyboard with custom controls
EP2507691A4 (en) 2010-01-20 2013-09-11 Nokia Corp User input
CN101763270B (en) 2010-01-28 2011-06-15 华为终端有限公司 Method for displaying and processing assembly and user equipment
US20110191719A1 (en) * 2010-02-04 2011-08-04 Microsoft Corporation Cut, Punch-Out, and Rip Gestures
US20120299860A1 (en) * 2010-02-04 2012-11-29 Nokia Corporation User input
US9454304B2 (en) 2010-02-25 2016-09-27 Microsoft Technology Licensing, Llc Multi-screen dual tap gesture
US20110209101A1 (en) * 2010-02-25 2011-08-25 Hinckley Kenneth P Multi-screen pinch-to-pocket gesture
EP2367097B1 (en) * 2010-03-19 2017-11-22 BlackBerry Limited Portable electronic device and method of controlling same
US8756522B2 (en) 2010-03-19 2014-06-17 Blackberry Limited Portable electronic device and method of controlling same
CN102906682B (en) 2010-04-23 2016-10-26 谷歌技术控股有限责任公司 Use electronic equipment and the method touching detection surface
KR101673925B1 (en) 2010-05-26 2016-11-09 삼성전자주식회사 Portable Device having the touch lock status and Operation system thereof
US8131898B2 (en) * 2010-05-27 2012-03-06 Adobe Systems Incorporated Event handling in an integrated execution environment
CN102270081B (en) * 2010-06-03 2015-09-23 腾讯科技(深圳)有限公司 A kind of method and device adjusting size of list element
US10216408B2 (en) * 2010-06-14 2019-02-26 Apple Inc. Devices and methods for identifying user interface objects based on view hierarchy
JP2012008686A (en) * 2010-06-23 2012-01-12 Sony Corp Information processor and method, and program
EP2405338A1 (en) * 2010-07-06 2012-01-11 HTC Corporation Method for presenting man machine interface and handheld device and computer-readable medium using the method
JP5659586B2 (en) * 2010-07-09 2015-01-28 ソニー株式会社 Display control device, display control method, display control program, and recording medium
CN102209141A (en) * 2010-07-15 2011-10-05 优视科技有限公司 Page scrollbar display method and device for mobile communication equipment terminal
US9304591B2 (en) 2010-08-10 2016-04-05 Lenovo (Singapore) Pte. Ltd. Gesture control
CN102385475B (en) * 2010-09-06 2017-04-19 联想(北京)有限公司 Electronic device and interactive method thereof
JP2012058921A (en) * 2010-09-07 2012-03-22 Sony Corp Information processor, information processing method and program
JP5389757B2 (en) * 2010-09-15 2014-01-15 株式会社ソニー・コンピュータエンタテインメント Image processing apparatus, content creation apparatus, image processing method, and data structure of content file
CN103827779B (en) * 2010-11-20 2017-06-20 纽昂斯通信有限公司 The system and method for accessing and processing contextual information using the text of input
KR101749529B1 (en) * 2010-11-25 2017-06-21 엘지전자 주식회사 Mobile terminal and operation control method thereof
CN102169383A (en) * 2010-11-26 2011-08-31 苏州瀚瑞微电子有限公司 Identification method for rotating gestures of touch screen
US8866735B2 (en) 2010-12-16 2014-10-21 Motorla Mobility LLC Method and apparatus for activating a function of an electronic device
US9363579B2 (en) 2010-12-22 2016-06-07 Google Inc. Video player with assisted seek
CN102053754A (en) * 2010-12-31 2011-05-11 东莞宇龙通信科技有限公司 Method and device for processing key area on touch screen
US9442516B2 (en) * 2011-01-24 2016-09-13 Apple Inc. Device, method, and graphical user interface for navigating through an electronic document
CN102185828B (en) * 2011-01-30 2013-10-09 广东佳和通信技术有限公司 Method for binding and controlling personal computer (PC) software and session initiation protocol user agent (SIP UA)
US9298363B2 (en) 2011-04-11 2016-03-29 Apple Inc. Region activation for touch sensitive surface
JP5254399B2 (en) * 2011-05-13 2013-08-07 株式会社エヌ・ティ・ティ・ドコモ Display device, user interface method and program
US8890823B2 (en) * 2012-01-09 2014-11-18 Motorola Mobility Llc System and method for reducing occurrences of unintended operations in an electronic device
GB2492789B (en) * 2011-07-12 2018-01-03 Denso Corp Displays
US9256361B2 (en) 2011-08-03 2016-02-09 Ebay Inc. Control of search results with multipoint pinch gestures
WO2013020205A1 (en) * 2011-08-05 2013-02-14 Research In Motion Limited System and method for searching for text and displaying found text in augmented reality
US10140011B2 (en) * 2011-08-12 2018-11-27 Microsoft Technology Licensing, Llc Touch intelligent targeting
RU2597458C2 (en) * 2011-09-13 2016-09-10 Сони Компьютер Энтертэйнмент Инк. Information processing device, display control method, program and data medium
US9710048B2 (en) 2011-10-03 2017-07-18 Google Technology Holdings LLC Method for detecting false wake conditions of a portable electronic device
US10684768B2 (en) 2011-10-14 2020-06-16 Autodesk, Inc. Enhanced target selection for a touch-based input enabled user interface
US20130125066A1 (en) * 2011-11-14 2013-05-16 Microsoft Corporation Adaptive Area Cursor
KR20130093720A (en) * 2011-12-23 2013-08-23 삼성전자주식회사 Display apparatus for releasing lock status and method thereof
CN102591853B (en) * 2011-12-29 2015-04-01 优视科技有限公司 Webpage rearrangement method, webpage rearrangement device and mobile terminal
CN103246457B (en) * 2012-02-09 2016-05-04 宇龙计算机通信科技(深圳)有限公司 The starting method of terminal and application program
US9106762B2 (en) * 2012-04-04 2015-08-11 Google Inc. Associating content with a graphical interface window using a fling gesture
WO2013169846A1 (en) * 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for displaying additional information in response to a user contact
AU2013259613B2 (en) 2012-05-09 2016-07-21 Apple Inc. Device, method, and graphical user interface for providing tactile feedback for operations performed in a user interface
JP5467123B2 (en) 2012-05-30 2014-04-09 株式会社ソニー・コンピュータエンタテインメント Information processing apparatus and information processing method
US20130342468A1 (en) * 2012-06-20 2013-12-26 Chimei Innolux Corporation Method for determining touch location on a touch panel and touch panel module
KR101942308B1 (en) * 2012-08-08 2019-01-25 삼성전자주식회사 Method for providing message function and an electronic device thereof
US9811216B2 (en) * 2012-09-14 2017-11-07 Sharp Kabushiki Kaisha Display device, portable terminal, monitor, television, and method for controlling display device
KR102096581B1 (en) * 2012-09-14 2020-05-29 삼성전자주식회사 Method for editing display information and an electronic device thereof
KR102102438B1 (en) * 2012-12-06 2020-04-20 삼성전자주식회사 Display apparatus and method for controlling thereof
US10585553B2 (en) 2012-12-06 2020-03-10 Samsung Electronics Co., Ltd. Display device and method of controlling the same
US9104371B2 (en) * 2012-12-07 2015-08-11 Apple Inc. Integrated visual notification system in an accessory device
CN103135903B (en) * 2013-02-22 2016-04-27 小米科技有限责任公司 A kind of chart gallery display method and device
US9471200B2 (en) * 2013-03-15 2016-10-18 Apple Inc. Device, method, and graphical user interface for organizing and presenting a collection of media items
CN104113682B (en) * 2013-04-22 2018-08-31 联想(北京)有限公司 A kind of image acquiring method and electronic equipment
US9807145B2 (en) * 2013-05-10 2017-10-31 Successfactors, Inc. Adaptive tile framework
US9477331B2 (en) * 2013-06-07 2016-10-25 Apple Inc. Touch detection at bezel edge
US9733716B2 (en) 2013-06-09 2017-08-15 Apple Inc. Proxy gesture recognizer
US10168882B2 (en) * 2013-06-09 2019-01-01 Apple Inc. Device, method, and graphical user interface for switching between camera interfaces
US9419935B2 (en) * 2013-08-02 2016-08-16 Whatsapp Inc. Voice communications with real-time status notifications
JP5505550B1 (en) * 2013-08-06 2014-05-28 富士ゼロックス株式会社 Image display apparatus and program
EP3047359B1 (en) * 2013-09-03 2020-01-01 Apple Inc. User interface for manipulating user interface objects
US10545657B2 (en) 2013-09-03 2020-01-28 Apple Inc. User interface for manipulating user interface objects
US11068128B2 (en) 2013-09-03 2021-07-20 Apple Inc. User interface object manipulations in a user interface
CN103472975A (en) * 2013-09-11 2013-12-25 江苏中科梦兰电子科技有限公司 Intelligent terminal human-computer interaction method with instant messaging style
CN103699297B (en) * 2013-12-13 2018-02-09 乐视网信息技术(北京)股份有限公司 A kind of intelligent terminal and collection of drama broadcast time reminding method
US20170024119A1 (en) * 2014-01-20 2017-01-26 Volkswagen Aktiengesellschaft User interface and method for controlling a volume by means of a touch-sensitive display unit
CN111488111B (en) * 2014-01-23 2023-10-20 苹果公司 virtual computer keyboard
US11914419B2 (en) 2014-01-23 2024-02-27 Apple Inc. Systems and methods for prompting a log-in to an electronic device based on biometric information received from a user
KR20150091607A (en) * 2014-02-03 2015-08-12 엘지전자 주식회사 Mobile terminal and method for controlling the same
US9990129B2 (en) 2014-05-30 2018-06-05 Apple Inc. Continuity of application across devices
US9185062B1 (en) 2014-05-31 2015-11-10 Apple Inc. Message user interfaces for capture and transmittal of media and location content
EP3584671B1 (en) 2014-06-27 2022-04-27 Apple Inc. Manipulation of calendar application in device with touch screen
JP6399834B2 (en) 2014-07-10 2018-10-03 キヤノン株式会社 Information processing apparatus, information processing apparatus control method, and program
CN104133624B (en) * 2014-07-10 2015-10-28 腾讯科技(深圳)有限公司 Web animation display packing, device and terminal
WO2016022496A2 (en) 2014-08-06 2016-02-11 Apple Inc. Reduced-size user interfaces for battery management
KR101610880B1 (en) * 2014-08-12 2016-04-08 네이버 주식회사 Method and apparatus of controlling display, and computer program for executing the method
US20160048319A1 (en) * 2014-08-18 2016-02-18 Microsoft Technology Licensing, Llc Gesture-based Access to a Mix View
DE202015005999U1 (en) * 2014-08-26 2015-11-26 Apple Inc. User interface for restricting messages and alarms
CN104216617B (en) * 2014-08-27 2017-05-24 小米科技有限责任公司 Cursor position determination method and device
WO2016036541A2 (en) 2014-09-02 2016-03-10 Apple Inc. Phone user interface
WO2016036413A1 (en) 2014-09-02 2016-03-10 Apple Inc. Multi-dimensional object rearrangement
WO2016036416A1 (en) 2014-09-02 2016-03-10 Apple Inc. Button functionality
WO2016036509A1 (en) 2014-09-02 2016-03-10 Apple Inc. Electronic mail user interface
US20160062571A1 (en) 2014-09-02 2016-03-03 Apple Inc. Reduced size user interface
EP3189409B1 (en) * 2014-09-02 2020-01-29 Apple Inc. Reduced-size interfaces for managing alerts
US11567626B2 (en) * 2014-12-17 2023-01-31 Datalogic Usa, Inc. Gesture configurable floating soft trigger for touch displays on data-capture electronic devices
WO2016097920A1 (en) * 2014-12-18 2016-06-23 Koninklijke Philips N.V. Medical image editing
KR20160088603A (en) * 2015-01-16 2016-07-26 삼성전자주식회사 Apparatus and method for controlling screen
US9632664B2 (en) 2015-03-08 2017-04-25 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10318142B2 (en) * 2015-03-27 2019-06-11 Google Llc Navigating event information
US9785487B1 (en) * 2015-05-12 2017-10-10 Google Inc. Managing device functions based on physical interaction with device modules
US9860451B2 (en) * 2015-06-07 2018-01-02 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US9658704B2 (en) * 2015-06-10 2017-05-23 Apple Inc. Devices and methods for manipulating user interfaces with a stylus
JP6518141B2 (en) * 2015-06-16 2019-05-22 株式会社ディスコ Touch panel device
CN104978146B (en) * 2015-06-30 2017-11-24 广东欧珀移动通信有限公司 A kind of picture operation method and mobile terminal
US9880735B2 (en) 2015-08-10 2018-01-30 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
EP3337143B1 (en) * 2015-09-25 2023-04-26 Huawei Technologies Co., Ltd. Terminal device and incoming call processing method
KR102553886B1 (en) * 2015-12-24 2023-07-11 삼성전자주식회사 Electronic device and method for image control thereof
US10637986B2 (en) 2016-06-10 2020-04-28 Apple Inc. Displaying and updating a set of application views
DK201670595A1 (en) 2016-06-11 2018-01-22 Apple Inc Configuring context-specific user interfaces
KR20180058097A (en) * 2016-11-23 2018-05-31 삼성전자주식회사 Electronic device for displaying image and method for controlling thereof
CN108266960B (en) * 2017-01-03 2020-09-22 三星电子株式会社 Food storage device and control method thereof
CN107247694A (en) * 2017-07-06 2017-10-13 福建中金在线信息科技有限公司 Information query method, device and electronic equipment based on portable electric appts
CN109429091A (en) * 2017-08-31 2019-03-05 武汉斗鱼网络科技有限公司 Promote method, storage medium, electronic equipment and the system of live streaming viewing experience
CN108197560B (en) * 2017-12-28 2022-06-07 努比亚技术有限公司 Face image recognition method, mobile terminal and computer-readable storage medium
CN110460893B (en) * 2018-05-08 2022-06-03 日本聚逸株式会社 Moving image distribution system, method thereof, and recording medium
US11435830B2 (en) 2018-09-11 2022-09-06 Apple Inc. Content-based tactile outputs
WO2020094214A1 (en) * 2018-11-06 2020-05-14 Volvo Truck Corporation A finger-position sensitive human machine interface for handling a user input of a user and a method for handling a user input of a user of a finger-position sensitive human machine interface
US11481094B2 (en) 2019-06-01 2022-10-25 Apple Inc. User interfaces for location-related communications
US11477609B2 (en) 2019-06-01 2022-10-18 Apple Inc. User interfaces for location-related communications
US11152100B2 (en) 2019-06-01 2021-10-19 Apple Inc. Health application user interfaces
CN110297002B (en) 2019-06-27 2022-05-24 上海联影医疗科技股份有限公司 Energy imaging method, device, equipment and storage medium
CN110968238A (en) * 2019-11-20 2020-04-07 四川商通实业有限公司 Image fast editing method and system based on ios system
CN112835575A (en) * 2019-11-23 2021-05-25 西安诺瓦星云科技股份有限公司 Multi-layer display control method and device
CN113518261B (en) * 2020-12-25 2023-09-22 腾讯科技(深圳)有限公司 Guiding video playing method, guiding video playing device, computer equipment and storage medium
US11822761B2 (en) 2021-05-15 2023-11-21 Apple Inc. Shared-content session user interfaces
US11907605B2 (en) 2021-05-15 2024-02-20 Apple Inc. Shared-content session user interfaces
CN113721818B (en) * 2021-09-02 2022-08-09 北京城市网邻信息技术有限公司 Image processing method, device, equipment and computer readable storage medium
CN113703653A (en) * 2021-09-02 2021-11-26 北京城市网邻信息技术有限公司 Image processing method, device, equipment and computer readable storage medium
CN114866641B (en) * 2022-07-07 2022-11-11 荣耀终端有限公司 Icon processing method, terminal equipment and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1326564A (en) * 1998-09-15 2001-12-12 艾利森公司 Apparatus and method for moving objects on touchscreen display
US6631186B1 (en) * 1999-04-09 2003-10-07 Sbc Technology Resources, Inc. System and method for implementing and accessing call forwarding services

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5880411A (en) * 1992-06-08 1999-03-09 Synaptics, Incorporated Object position detector with edge motion feature and gesture recognition
US6486895B1 (en) * 1995-09-08 2002-11-26 Xerox Corporation Display system for displaying lists of linked documents
US5847709A (en) * 1996-09-26 1998-12-08 Xerox Corporation 3-D document workspace with focus, immediate and tertiary spaces
US6069626A (en) * 1997-02-27 2000-05-30 International Business Machines Corporation Method and apparatus for improved scrolling functionality in a graphical user interface utilizing a transparent scroll bar icon
US6049326A (en) * 1997-05-12 2000-04-11 Siemens Information And Communication Networks, Inc. System and method for dual browser modes
US6169911B1 (en) * 1997-09-26 2001-01-02 Sun Microsystems, Inc. Graphical user interface for a portable telephone
US8479122B2 (en) * 2004-07-30 2013-07-02 Apple Inc. Gestures for touch sensitive input devices
US6181316B1 (en) * 1998-06-04 2001-01-30 International Business Machines Corporation Graphical user interface inline scroll control
US6643824B1 (en) * 1999-01-15 2003-11-04 International Business Machines Corporation Touch screen region assist for hypertext links
DE60045377D1 (en) * 1999-03-30 2011-01-27 Tivo Inc TV VIEWER INTERFACE SYSTEM
US6538665B2 (en) * 1999-04-15 2003-03-25 Apple Computer, Inc. User interface for presenting media information
US7007239B1 (en) * 2000-09-21 2006-02-28 Palm, Inc. Method and apparatus for accessing a contacts database and telephone services
JP2001265481A (en) * 2000-03-21 2001-09-28 Nec Corp Method and device for displaying page information and storage medium with program for displaying page information stored
CN1392476A (en) * 2001-06-19 2003-01-22 神基科技股份有限公司 Method for matching multi-medium program to execute analogue jog dial function
US6690387B2 (en) * 2001-12-28 2004-02-10 Koninklijke Philips Electronics N.V. Touch-screen image scrolling system and method
TW591488B (en) * 2002-08-01 2004-06-11 Tatung Co Window scrolling method and device thereof
CN100483403C (en) * 2002-12-17 2009-04-29 汤姆森许可公司 Method for tagging and displaying songs in a digital audio player
US6990637B2 (en) * 2003-10-23 2006-01-24 Microsoft Corporation Graphical user interface for 3-dimensional view of a data collection based on an attribute of the data
KR100664111B1 (en) * 2004-02-06 2007-01-04 엘지전자 주식회사 A method and a structure and a apparatus of moving cursor for mobile phone
CN100346274C (en) * 2004-03-25 2007-10-31 升达科技股份有限公司 Inputtig method, control module and product with starting location and moving direction as definition
EP1774427A2 (en) * 2004-07-30 2007-04-18 Apple Computer, Inc. Mode-based graphical user interfaces for touch sensitive input devices
KR100984596B1 (en) * 2004-07-30 2010-09-30 애플 인크. Gestures for touch sensitive input devices
WO2006055675A1 (en) * 2004-11-16 2006-05-26 Waters Investments Limited Device for performing separations and methods of making and using same
US7489306B2 (en) * 2004-12-22 2009-02-10 Microsoft Corporation Touch screen accuracy
US8341541B2 (en) * 2005-01-18 2012-12-25 Microsoft Corporation System and method for visually browsing of open windows
US8819569B2 (en) * 2005-02-18 2014-08-26 Zumobi, Inc Single-handed approach for navigation of application tiles using panning and zooming

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1326564A (en) * 1998-09-15 2001-12-12 艾利森公司 Apparatus and method for moving objects on touchscreen display
US6631186B1 (en) * 1999-04-09 2003-10-07 Sbc Technology Resources, Inc. System and method for implementing and accessing call forwarding services

Also Published As

Publication number Publication date
CN101535938B (en) 2013-05-08
AU2022201622B2 (en) 2023-05-18
CN101356492A (en) 2009-01-28
CN101529368A (en) 2009-09-09
CN101529874A (en) 2009-09-09
AU2022201622A1 (en) 2022-03-31
CN101529367A (en) 2009-09-09
CN101356492B (en) 2012-06-27
CN101535938A (en) 2009-09-16
CN101529368B (en) 2012-07-04
CN101529367B (en) 2016-02-17
ES2361784T3 (en) 2011-06-22
CN101356493A (en) 2009-01-28
AU2023216869A1 (en) 2023-09-07
CN101535940A (en) 2009-09-16

Similar Documents

Publication Publication Date Title
CN101535940B (en) Portable electronic device for instant messaging
CN103294399B (en) For the portable electric appts that instant message transmits
US11743375B2 (en) Portable electronic device with conversation management for incoming instant messages
CN101563667B (en) Method and equipment for adjusting an insertion point marker
CN102541434B (en) Deletion gestures on a portable multifunction device
CN101627359B (en) System and method for moving lists on touch screen
US8407603B2 (en) Portable electronic device for instant messaging multiple recipients
CN102016777B (en) Methods and device for editing on a portable multifunction device
CN101641946B (en) Portable electronic device, method, and graphical user interface for displaying electronic lists and documents
CN101727275A (en) Portable electronic device, method, and graphical user interface for displaying structured electronic documents
CN101617288A (en) The portable multifunction device, method and the graphic user interface that are used for translating displayed content

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant