CN107977180A - System and method for enabling low visual acuity user to be interacted with touch-sensitive slave display - Google Patents

System and method for enabling low visual acuity user to be interacted with touch-sensitive slave display Download PDF

Info

Publication number
CN107977180A
CN107977180A CN201711007537.0A CN201711007537A CN107977180A CN 107977180 A CN107977180 A CN 107977180A CN 201711007537 A CN201711007537 A CN 201711007537A CN 107977180 A CN107977180 A CN 107977180A
Authority
CN
China
Prior art keywords
touch
application
represent
display
specific
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711007537.0A
Other languages
Chinese (zh)
Inventor
E·T·塞毛尔
G·F·休格斯
J·P·克雷格
原田丞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apple Inc
Original Assignee
Apple Computer Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from DKPA201770595A external-priority patent/DK179492B1/en
Application filed by Apple Computer Inc filed Critical Apple Computer Inc
Publication of CN107977180A publication Critical patent/CN107977180A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0238—Programmable keyboards
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/0202—Constructional details or processes of manufacture of the input device
    • G06F3/021—Arrangements integrating additional peripherals in a keyboard, e.g. card or barcode reader, optical scanner
    • G06F3/0213—Arrangements providing an integrated pointing device in a keyboard, e.g. trackball, mini-joystick
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14—Display of multiple viewports
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04806—Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/045—Zooming at least part of an image, i.e. enlarging it or shrinking it
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/14—Solving problems related to the presentation of information to be displayed
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/16—Use of wireless transmission of display information
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/24—Keyboard-Video-Mouse [KVM] switch
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2380/00—Specific applications
    • G09G2380/02—Flexible displays

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention is entitled " be used for enable the system and method that low visual acuity user interacts with touch-sensitive slave display ".The system and method disclosed herein that is so that low visual acuity user and can be interacted with touch-sensitive slave display.Illustrative methods include：First user interface of the display for application program, and show second user interface on touch-sensitive slave display on basic display unit, which includes controlling the multiple of the function of application program can represent specific to showing for application.Each showing accordingly can represent to show with the first display size.This method further includes：Detected via slave display and show the input that can represent to contact specific to application with least one.In response to detecting input, and when it keeps contacting with slave display, this method includes：(i) continue to show the first user interface on basic display unit, and (ii) shows at least one amplification expression that can represent shown specific to application on basic display unit.Amplification represents to show with the second display size more than the first display size.

Description

For enable system that low visual acuity user interacts with touch-sensitive slave display and Method
Technical field
Disclosed embodiment is related to touch-sensitive slave display equipment, and more particularly, is related to for so that low regard The improved technology that power user can interact with touch-sensitive slave display.
Background technology
Occlusion issue usually prevents many users from understanding and uses to pass through the available feature of touch sensitive input devices, this is touch-sensitive Input equipment is also used for display and shows and can represent.For example, the user for the touch-sensitive slave display that can be located above physical keyboard may nothing Method check it is some show and can represent because their finger blocks when showing and can represent and be shown at slave display or covers these Showing to represent.In addition, being shown in showing in such slave display can represent typically small.These problems are used for low visual acuity Especially severe for family, these users are likely difficult to see that be shown at slave display some show and can represent, and these Difficulty deteriorates and amplifies because of above-mentioned occlusion issue.
The content of the invention
The embodiments described herein solves disadvantages mentioned above by providing following apparatus and method：The equipment and side Method seamlessly provides the amplification shown and can represented in response to the user mutual at touch-sensitive slave display equipment at basic display unit Represent, so that low visual acuity user can interact with touch-sensitive slave display, (that is, these users now can be main aobvious Show and check that amplification represents at device, it is then determined that being properly entered for what is provided at slave display).Such apparatus and method also subtract Lack the pattern switching needed for user (for example, hand is moved between keyboard and mouse, and eyes to be moved to from keyboard Display) amount, activate input quantity needed for desired function (for example, reducing selection menu option so as to reduce Required input quantity, is explained in greater detail below).Such apparatus and method also cause more information in limited screen On can be with (for example, touch-sensitive slave display be used to provide a user more information, and using limited screen space effectively The information is presented).Such apparatus and method also provide improved man-machine interface in the following manner：There is provided emphasis effect so that Information can more distinguish on touch-sensitive slave display；There is provided lasting interaction so that continuous input from the user, which is directed toward, touches Quick slave display or basic display unit cause equipment to provide output, which is subsequently used for promoting further input from the user (for example, showing can represent to be shown at touch-sensitive slave display, it allows user by being provided input at touch-sensitive slave display How rapid preview will reproduce information on basic display unit, as described below)；And less interaction from the user is required to realize Desired result.In some cases, touch-sensitive slave display is also referred herein as dynamic function row (vice versa).By In these reasons and it is discussed below those, apparatus and method described herein reduce electricity usage and improve electricity The battery life of sub- equipment.
According to some embodiments, method is performed at computing system, which has one or more handle Device；The first shell including basic display unit；Memory；And include at least in part different from the touch-sensitive secondary aobvious of basic display unit Show device second housing (it is different from the first shell) (it is as described below, second housing and touch-sensitive slave display can be include than The component of any equipment of the small display of basic display unit, for example, touch-sensitive slave display is wearable computing devices such as wrist-watch A part, or touch-sensitive slave display is located above physical keyboard in second housing).This method includes：In main display First user interface of the display for application program on device.This method further includes：Second user is shown on touch-sensitive slave display Interface, which, which includes the multiple of available function in control application program, can represent specific to showing for application, its In it is multiple specific to application show in representing it is each with first display size show.This method comprises additionally in：Via touch-sensitive Slave display detect with it is multiple specific to application show in representing at least one can represent what is contacted specific to showing for application Input.In response to detecting input, and when input keeps contacting with touch-sensitive slave display, this method includes：(i) continue On basic display unit display for application program the first user interface, and (ii) shown on basic display unit it is at least one Show that the amplification that can represent represents specific to application, wherein at least one specific to application show the amplification expression that can represent with The second display size more than the first display size is shown.
In some cases, computing system user (specifically, low visual acuity user) possibly can not check exactly with The icon or show and can represent (those such as shown on intelligent watch) that small display size is shown.With showing specific to application It can represent to fill touch-sensitive slave display, showing that these show on larger basic display unit then in response to single input can represent In the amplification of one represent, provided for these users and indicate which kind of they may be selected and show the clear visual feedback that can be represented.Will This improved visual feedback is supplied to user to enhance the operability of equipment, and makes man-machine interface more effective (for example, logical Cross help user and correctly input be provided, and operation be shown in showing on slave display can represent/with this show to represent into User error is reduced during row interaction).In addition, it is allowed to these users check exactly display on a small screen show can represent reality Now continue to interact with touch-sensitive slave display, otherwise due to frequent wrong (for example, incorrect selection) and correct these Extra time and energy needed for mistake this will be impossible.
According to some embodiments, method is performed at computing system, which has one or more handle Device；The first shell including basic display unit；Memory；And include at least in part different from the touch-sensitive secondary aobvious of basic display unit Show device second housing (it is different from the first shell) (it is as described below, second housing and touch-sensitive slave display can be include than The component of any equipment of the small display of basic display unit, for example, touch-sensitive slave display is wearable computing devices such as wrist-watch A part, or touch-sensitive slave display is located above physical keyboard in second housing).This method includes：May have access to Pattern operates touch-sensitive slave display.When operating touch-sensitive slave display may have access to pattern, this method includes：In basic display unit First user interface of the upper display for application program；Second user interface is shown on touch-sensitive slave display, the second user Interface includes：(i) the multiple of available function in application program are controlled can to represent specific to showing for application, and (ii) is controlled System level function it is at least one it is system-level show and can represent, it is plurality of specific to application show each in representing and It is at least one it is system-level show can represent with first display size show；Via touch-sensitive slave display detection with it is multiple specific to should Show in representing it is at least one specific to application show can represent contact input；And in response to detecting input, And when input keeps contacting with touch-sensitive slave display：(A) continue the display on basic display unit and be used for the first of application program User interface, and (B) shown on basic display unit it is at least one show that the amplification that can represent represents specific to application, wherein It is at least one to show that the amplification that represented represents to show with the second display size more than the first display size specific to application.
In some cases, the low visual acuity user of computing system is dependent on the memory key position on keyboard so that Ta Menneng It is enough to provide input to computing system exactly.For including that can be represented with showing of often changing (for example, based on them in spy What determines to make in application program can be represented to change with providing the showing for function useful to user) touch-sensitive slave display Computing system, these users cannot rely solely on memory and be accurately entered to provide.Showing specific to showing for application to represent It is at least one show can represent amplification represent improve computing system operability because low visual acuity user can with it is touch-sensitive Available control interacts at slave display, the touch-sensitive slave display for low visual acuity user may it is too small (or Shown control may be being covered due to the finger of user and is being blocked) and can not check exactly.In this way, low visual acuity User can change for example, by continue to interact (rather than constantly correcting the input of mistake) with touch-sensitive slave display to utilize Into man-machine interface.
According to some embodiments, method is performed at computing system, which has one or more handle Device；The first shell including basic display unit；Memory；And include at least in part different from the touch-sensitive secondary aobvious of basic display unit Show device second housing (it is different from the first shell) (it is as described below, second housing and touch-sensitive slave display can be include than The component of any equipment of the small display of basic display unit, for example, touch-sensitive slave display is wearable computing devices such as wrist-watch A part, or touch-sensitive slave display is located above physical keyboard in second housing).This method includes：In main display First user interface of the display for application program on device.This method further includes：Second user is shown on touch-sensitive slave display Interface, the second user interface include：(i) the multiple of available function in application program are controlled to show energy table specific to application Show, and at least one of (ii) control system level function system-level show and can represent.This method comprises additionally in：Via touch-sensitive pair Display detection show in representing first shows that first on representing is defeated specific to application multiple specific to application Enter.Show that this method includes when can represent that holding contacts specific to application with first in the first input：(i) via touch-sensitive secondary aobvious Show that device detection does not show the above representing second input, and (ii) in response to detecting second first specific to application Input, activation first can be represented specific to showing for application.
In response to allowing not showing the Flick gesture above representing (" separate Flick gesture ") with inputting showing of contacting The activation that can be represented enhances the operability of equipment, and makes man-machine interface more effective (for example, by allowing user by first Finger be placed on it is desired show can represent top, then perform the selection shown the expectation and can represented using different fingers, So that it is guaranteed that only activate it is desired show and can represent, and help to minimize selection/activation of mistake).In addition, it is allowed to Yong Hu Its first finger (not selecting to show to represent) is moved freely around touch-sensitive slave display makes user be kept with touch-sensitive slave display Lasting interaction (shows which shows at touch-sensitive slave display and can represent) by exploring, otherwise due to it is frequent it is wrong (for example, Show the incorrect or unexpected selection that can be represented) and correct these mistake required extra times and energy this will be can not Can.
According to some embodiments, computing system is included with the main display unit for being configured as display user interface The first shell；At least in part include different from basic display unit and be configured as receive user input and show user circle The second housing of the touch-sensitive slave display in face (it is different from the first shell)；And shown with main display unit and touch-sensitive pair The processing unit of device unit communication.Processing unit is configured as：First user of the display for application program on basic display unit Interface；Second user interface is shown on touch-sensitive slave display, which includes available in control application program The multiple of function can be represented specific to showing for application, and multiple each aobvious with first in representing specific to showing for application Show that size is shown；Via touch-sensitive slave display detection with it is multiple specific to application show in representing it is at least one specific to The input that can represent contact is shown in application；And keep connecing with touch-sensitive slave display in response to detecting input, and in input When touching：(i) first user interface of the display for application program on basic display unit is continued, and (ii) on basic display unit Show it is at least one show that the amplification that can represent represents specific to application, wherein at least one can be represented specific to showing for application Amplification represent with more than first display size second display size show.
According to some embodiments, computing system is included with the main display unit for being configured as display user interface The first shell；At least in part include different from basic display unit and be configured as receive user input and show user circle The second housing of the touch-sensitive slave display in face (it is different from the first shell)；And shown with main display unit and touch-sensitive pair The processing unit of device unit communication.Processing unit is configured as：Touch-sensitive slave display is operated may have access to pattern；Can visit When asking that pattern operates touch-sensitive slave display：First user interface of the display for application program on basic display unit；In touch-sensitive pair Second user interface is shown on display, which includes：(i) control application program in available function it is more It is a to represent specific to showing for application, and (ii) control system level function it is at least one it is system-level show and can represent, wherein more It is a specific to application show in representing it is each and at least one it is system-level show can represent with first display size show； Via touch-sensitive slave display detection with it is multiple specific to application show in representing it is at least one specific to application show energy table Show the input of contact；And in response to detecting input, and when input keeps contacting with touch-sensitive slave display：(A) continue On basic display unit display for application program the first user interface, and (B) shown on basic display unit it is at least one Show that the amplification that can represent represents specific to application, wherein at least one specific to application show the amplification expression that can represent with The second display size more than the first display size is shown.
According to some embodiments, computing system is included with the main display unit for being configured as display user interface The first shell；At least in part include different from basic display unit and be configured as receive user input and show user circle The second housing of the touch-sensitive slave display in face (it is different from the first shell)；And shown with main display unit and touch-sensitive pair The processing unit of device unit communication.Processing unit is configured as：First user of the display for application program on basic display unit Interface；Second user interface is shown on touch-sensitive slave display, which includes：(i) controlling can in application program The multiple of function can be represented specific to showing for application, and at least one of (ii) control system level function system-level shows It can represent, be detected via touch-sensitive slave display in multiple the first showing specific to application shown in representing specific to application It can represent the first input of top；And first input with first specific to application show can represent that holding contacts when：(i) Via touch-sensitive slave display detection first specific to application do not show second on representing input, and (ii) in response to Detect the second input, activation first can be represented specific to showing for application.
According to some embodiments, computing system includes one or more processors；With basic display unit first outside Shell；The touch-sensitive slave display different from basic display unit is included at least in part and is optionally included to detect and touch-sensitive pair The second housing of the one or more sensors of the intensity of the contact on surface；And the memory of the one or more programs of storage, One or more of programs are arranged to be performed by one or more processors, and one or more programs include using In perform or cause perform method described herein in either method operation or instruction.According to some embodiments, meter Calculation machine readable storage medium storing program for executing is stored with instruction wherein, and described instruction by computing system when being performed so that computing system performs Or cause the operation for performing the either method in method described herein.According to some embodiments, there is provided computing system Graphic user interface on basic display unit, and the graphic user interface is included with the either method in method described herein One or more of element of display, the element are updated in response to input, any such as in method described herein Described in method.According to some embodiments, computing system includes being used to perform or causes to perform in method described herein Either method operation device.According to some embodiments, the information processor used in computing systems includes using In perform or cause perform method described herein in either method operation device.
Therefore, including the computing system of basic display unit and touch-sensitive slave display be provided with faster, it is more effective and useful/ User-friendly method and interface, so that low visual acuity user be able to can represent with being shown in showing at touch-sensitive slave display Interact, so that for example, by allowing continuing to interact and improving the operable of computing system for user and touch-sensitive slave display Property.
Brief description of the drawings
The various embodiments in order to better understand, should refer to following specific embodiment party in conjunction with the following drawings Formula, wherein reference numeral similar in whole attached drawing refers to corresponding component.
Figure 1A is the illustrative figure according to the portable computing system (for example, laptop computer) of some embodiments.
Figure 1B is the illustrative figure of the main part of the portable computing system in Figure 1A according to some embodiments.
Fig. 2A is the illustrative figure according to the first specific implementation of the desk-top computing system of some embodiments.
Fig. 2 B are the illustrative figures according to the second specific implementation of the desk-top computing system of some embodiments.
Fig. 2 C are the illustrative figures according to the 3rd specific implementation of the desk-top computing system of some embodiments.
Fig. 2 D are the illustrative figures according to the 4th specific implementation of the desk-top computing system of some embodiments.
Fig. 3 A are the block diagrams according to the electronic equipment of some embodiments.
Fig. 3 B are the block diagrams according to the component of the event handling for Fig. 3 A of some embodiments.
Fig. 3 C- Fig. 3 E show the example of the resistance to vibration threshold value according to some embodiments.
Fig. 4 is the block diagram according to the peripheral electronic device of some embodiments.
Fig. 5 A- Fig. 5 N are the schematic diagrames of the basic display unit and slave display according to some embodiments, it is used to show to use In the exemplary user interface for enabling low visual acuity user to be interacted with touch-sensitive slave display.
Fig. 6 A- Fig. 6 C show according to some embodiments low visual acuity user to be carried out with touch-sensitive slave display The flow chart of interactive method.
Fig. 7 A- Fig. 7 C show according to some embodiments low visual acuity user to be carried out with touch-sensitive slave display The flow chart of interactive method.
Fig. 8 A- Fig. 8 C show according to some embodiments low visual acuity user to be carried out with touch-sensitive slave display The flow chart of interactive method.
Fig. 9-Figure 11 shows the functional block diagram of the computing system according to some embodiments.
Embodiment
Figure 1A-Figure 1B, Fig. 2A-Fig. 2 D, Fig. 3 A- Fig. 3 E and Fig. 4 provide the description to example devices.Fig. 5 A- Fig. 5 N It is the schematic diagram of display, it is used to show for enabling low visual acuity user with what touch-sensitive slave display interacted to show Example property user interface.Fig. 6 A- Fig. 6 C, Fig. 7 A- Fig. 7 C and Fig. 8 A- Fig. 8 C are so that low visual acuity user can be with touch-sensitive secondary display The flow chart for the method that device interacts.User interface in Fig. 5 A- Fig. 5 N be used to showing Fig. 6 A- Fig. 6 C, Fig. 7 A- Fig. 7 C and Method and/or process in Fig. 8 A- Fig. 8 C.
Example devices and system
Reference will now be made in detail to embodiment, the example of these embodiments is shown in the drawings.Following retouches in detail Many details are shown in stating, are fully understood in order to provide to various described embodiments.But to this area Those of ordinary skill be evident that various described embodiments can be in the feelings without these details Put into practice under condition.In other cases, well known method, process, component, circuit and network are not described in detail, so that The various aspects of embodiment will not unnecessarily be obscured.
It will be further understood that although in some cases, term " first ", " second " etc. are used to describe herein each Kind element, but these elements should not be restricted by the limitation of these terms.These terms are only intended to an element and another element Distinguish.For example, the first contact can be named as the second contact, and similarly, the second contact can be named as first and connect Touch, without departing from the scope of various described embodiments.First contact and the second contact both contact, but it Be not same contact.
The term used in the description to the various embodiments is intended merely to description particular implementation side herein The purpose of case, and be not intended to be limited.Such as the institute in the description to the various embodiments and the appended claims As use, " one, " one kind " and "the" are intended to also include plural form singulative, unless the context clearly Instruction.It is also understood that term "and/or" used herein refers to and covers in the project listed in association Any and all possible combinations of one or more projects.It will be further understood that term " comprising ", "comprising", " containing " And/or " having " when in the present specification use when specify in the presence of stated feature, integer, step, operation, element and/ Or component, but it is not excluded that in the presence of or other one or more features of addition, integer, step, operation, element, component and/ Or its packet.
As used herein, based on context, term " if " be optionally interpreted to mean " and when ... when " or " ... when " or " in response to determining " or " in response to detecting ".Similarly, based on context, phrase is " if really It is fixed ... " or " if detecting [condition or event stated] " be optionally interpreted to refer to " when determining ... " or " in response to determining ... " or " when detecting [condition or event stated] " or " in response to detecting [the bar stated Part or event] ".
Figure 1A is the illustrative figure according to the portable computing system 100 of some embodiments.Portable computing system 100 can be such as laptop computer, such asEquipment, or any other portable computing device.It is portable Formula computing system 100 includes：(A) display portion 110 with basic display unit 102 is (referred to herein as the first shell 110 Or shell 110)；And (B) has main part 120 (also referred to as second housing 120 or the shell of dynamic function row 104 120)；One group of physics (that is, movably activates) key 106；And it is contained partially in the touch pad in same enclosure 108.Display portion 110 is usually mechanical, electric and communicatively coupled with the main part 120 of portable computing system 100.Example Such as, portable computing system 100 may include hinge, so as to allow display portion 110 to be rotated relative to main part 120.It is portable Formula computing system 100 includes the memory of one or more processors and the one or more programs of storage, one or more A program is performed for one or more processors to perform any one in the embodiment described herein.In some embodiment party It is touch-screen display with reference to the dynamic function row 104 that figure 1B is more fully described in case, it uses resistance sensing, sound sense Survey, capacitance sensing, optical sensing, infrared sensing etc. detect user's touch input and selection.In some embodiments, show The basic display unit 102 for showing part 110 is also touch-screen display.
Figure 1B is the illustrative figure according to the main part 120 of the portable computing system 100 of some embodiments.It is main Body portion 120 include one group of secondary or physical bond 106 (referred to herein as " secondary or physical bond 106 " and " keyboard 106 "), dynamic function row 104, and the touch pad 108 being contained partially in same enclosure.In some embodiments, the dynamic as touch-screen Function row 104 replaces the function row of one group of secondary or physical bond 106, so that allow to reduce as the space shared by this group of secondary or physical bond 106, So as to allow the overall main part 120 of smaller or allow other parts, such as 108 bigger of touch pad.In some embodiment party In case, dynamic function row 104 is about 18 inches relative to the major dimension length of this group of secondary or physical bond 106.Although for the ease of explaining Referred to as " OK ", but in some other embodiments, including the dynamic function row 104 in Figure 1A touch-screen can take it is any Other forms, square, circular, multiple row, column, Duo Gelie, multiple individually sectors etc..Although Figure 1A-Figure 1B shows Go out to replace the dynamic function row 104 of the function row of one group of secondary or physical bond 106, but in some other embodiments, dynamic function row 104 can in addition and/or alternatively grade instead of the numeric keypad part of this group of secondary or physical bond 106, editor/function part.
Each secondary or physical bond of one group of secondary or physical bond 106 has at least one associated input.The input can be printable Character, unprintable character, function or other inputs.The input associated with secondary or physical bond can by Latin language script, I The letter of display (for example, printing) on the surface of the key of primary language character, Chinese character or any other script, words, symbol or other Mark to show.For example, the specific secondary or physical bond indicated at 138 is associated with alphabetic character " z ", the letter z as shown on key It is indicated.In another example, the secondary or physical bond marked with words " order " can be associated with command functions.For example, according to ISO/IEC 9995, ANSI-INCITS 154-1988, JIS X 6002-1980 or other similar standards, one group of secondary or physical bond 106 with QWERTY, Dvorak or other keyboard layouts with alphanumeric, numeral and/or editor/funtion part (for example, Standard, extension or compact) it is associated.
, can be by portable computing system corresponding to the signal of the input associated with secondary or physical bond when key has been activated by a user The processor of 100 (or peripheral keyboards 206 in the computing device 202 or Fig. 2A-Fig. 2 B in Fig. 2A-Fig. 2 D) of system receives.In example In the property shown example, each key of one group of secondary or physical bond 106 includes two plates and spring.User can activate key by pressing lower key, This compression spring.When the springs are compressed, two plates may contact, so as to allow electric current to flow through the plate of connection.In response to passing through The flowing of the electric current of connecting plate, can provide the input corresponding to key to processor.For example, in response to peripheral keyboard in Fig. 2 C The activation of 206 one group of key 106, the input corresponding to the key of activation will be provided to computing device 202.It should be appreciated that can be with Use the other systems of the key for movably activating.
In some embodiments, dynamic function row 104 is that (dynamic function row is also referred to as touch-screen display herein For touch-sensitive slave display 104), it shows that the optional symbol 142 of one or more users (is otherwise referred to as " user circle herein Surface element ", " user interface component ", " show can represent, ", " button " or " soft key ").For example, dynamic function row 104 replaces allusion quotation Function line unit on type keyboard.User can correspond to the optional symbol of one or more users by touching on touch-screen display The position of specific one in 142 selects the specific one in the optional symbol 142 of one or more users.For example, user can Dynamic function row is contacted at the position of magnifying glass designator 214 by the finger for touching 104 user of dynamic function row 104 select the optional symbol of user indicated by magnifying glass symbol 144.In some embodiments, touch contact or touch hand Gesture is included in the touch-down of time (for example, 250ms etc.) interior contact and being lifted away from for contact of predetermined volume.At some In embodiment, the touch-screen display of dynamic function row 104 uses resistance sensing, sound sensing, capacitance sensing, optics sense Survey, infrared sensing etc. are realized to detect user's input and selection.
When user selects the specific one in the optional symbol 142 of one or more users, given birth to by dynamic function row 104 The signal of specific one into corresponding to the optional symbol 142 of one or more users.For example, when user touches dynamic function During " esc " on row 104, dynamic function row 104 will indicate signal transmission input by user corresponding with leaving function to portable The processor of formula computing system 100 (or computing device 202 in Fig. 2A-Fig. 2 D).
In some embodiments, when the specific one in the optional symbol 142 of the one or more users of selection, dynamic Function row 104 is by the position pair with showing the specific one in one or more optional symbols 142 of user on touch-screen display Processor of the signal transmission answered to portable computing system 100 (or computing device 202 in Fig. 2A-Fig. 2 D).It is for example, dynamic State function row 104 can be according to selected by the touch-screen display of the specific one in the optional symbol 142 of one or more users The position selected includes the signal of positional value (0 to 20) to transmit.In the exemplary example of Figure 1B, " esc " symbol can have Positional value 0, magnifying glass symbol 144 can have positional value 16, and so on.Portable computing system 100 (or Fig. 2A-Fig. 2 D Computing device 202) processor can receive the signal of the positional value for indicating the selected optional symbol of user, and using upper Context information explains positional value, it is all as shown in display portion 110 basic display unit 102 (or peripheral display equipment 204, Fig. 2A-Fig. 2 D) on graphic user interface element, which is currently activity or has a focus.
Each it may include designator in one or more optional symbols 142 of user, such as symbol is (for example, such as 144 Magnifying glass symbol shown in place), abbreviation words (for example, " esc "), do not abridge words, character, image, animated image, video Deng.In some embodiments, the corresponding one in the optional symbol 142 of one or more users can receive one or more User inputs.
Input can be in symbol 142 optional with one or more users it is each associated.Input can be function, character, number Value etc..Corresponding one in one or more optional symbols 142 of user may include designator, which, which corresponds to, is used for one The input of corresponding one in a or multiple optional symbols 142 of user.For example, in fig. ib, there is abbreviation words " esc " The optional symbol of user indicates to the user that to leave function associated with the optional symbol of user.When the optional symbol of user selection user, 142 associated function of symbol optional with one or more users can be activated.For example, when user's selection has designator During the optional symbol of the user of " esc ", leaving function can be activated.The activation of function can have different effects, this is depended on just Take the current state of formula computing system 100 (or computing device 202 in Fig. 2A-Fig. 2 D).For example, when in display portion 110 When dialog box is opened on basic display unit 102 (or peripheral display equipment 204, Fig. 2A-Fig. 2 D), on activation dynamic function row 104 Leave function and can close the dialog box.In another example, when by the (or Fig. 2A-figure of portable computing system 100 Computing device 202 in 2D) processor when performing game application, the function of leaving on activation dynamic function row 104 can Pause game.
In some embodiments, function can be related to the combination of the key movably activated and/or the optional symbol of user Connection.For example, actuating can be associated with " duplication " function while command key and " c " key (that is, order+c).In another example In, command key and with designator " esc " the optional symbol of user selection (that is, order+esc) while actuating can activate Function is to open application-specific, such as media player application program.In yet another example, two optional symbols of user Number (for example, the optional symbol of user with designator " esc " and optional symbol 144 of user with magnifying glass designator) Simultaneous selection can cause the activation of function such as specialty search function.
In some embodiments, the first subgroup of the optional symbol 142 of one or more users of dynamic function row 104 146 can be associated with one group of function, and the second subgroup of the optional symbol 142 of one or more users of dynamic function row 104 148 can be associated with second group of function.For example, the optional symbol of user in the first subgroup 146 can be GF global functions (for example, being Irrespective of size function is shown and can be represented), and the optional symbol of user in the second subgroup 148 can be the function specific to application.Cause This, when focus from the first element of the graphic user interface being shown on basic display unit 102 (for example, corresponding to internet browsing The first window of device application program) second element of graphic user interface is displaced to (for example, corresponding to e-mail applications journey Second window of sequence) when, the optional sign modification of user in the second subgroup 148.On the contrary, when focus is from graphic user interface First element shift to graphic user interface second element when, keep the first subgroup 146 in the optional symbol of user.
In some embodiments, the optional symbol of user in the second subgroup 148 is based on being shown on basic display unit 102 Active user interface element in focus determine.In some embodiments, term " in focus " can refer to user The mobile element at interface is (for example, the window associated with application program, the particular tool bar associated with application program or dish List or operating system), which is currently at foreground and actively runs, or can pass through the use from computing system The input that family receives controls, the input key pressing, mouse click, voice command, gesture motion etc..
In some embodiments, corresponding to the one or more users optional symbol 142 of the optional symbol of global user First subgroup 146 occupies the first area (for example, left side of dynamic function row 104) of dynamic function row 104, and one Or the second subgroup 148 of multiple optional symbols 142 of user occupies the second area of dynamic function row 104 (for example, dynamic function The right side of row 104).It should be appreciated that other ratios of dynamic function row 104 can be assigned to the first subgroup 146 and second Subgroup 148.In some embodiments, when no application program has focus, the second area of dynamic function row 104 can Not include the optional symbol of any user.In some embodiments, dynamic function row 104 includes the three of the optional symbol of user A or more subgroup.In some embodiments, dynamic function row 104 can including not being divided into the single group user of subgroup Select symbol.Although the optional symbol of single file user is shown in dynamic function row 104 in fig. ib, but it is to be understood that dynamic Function row 104 may include the optional symbol of rows of user.
In some embodiments, the change of focus change be shown in display portion 110 basic display unit 102 it is (or outer Enclose display apparatus 204, Fig. 2A-Fig. 2 D) on which element of graphic user interface be movable, and which element will Receive user's input.User's input can be received from keyboard, mouse, touch pad or other users input equipment.In addition and/or separately Selection of land, in some embodiments, the change of focus change (or outer in the basic display unit 102 for being shown in display portion 110 Enclose display apparatus 204, Fig. 2A-Fig. 2 D) on graphic user interface foreground in the element that shows.
In some embodiments, the change of focus is inputted in response to user, such as in response to being shown in display portion Graphic user interface on 110 basic display unit 102 (or peripheral display equipment 204, Fig. 2A-Fig. 2 D) is (for example, different window Mouthful) element user's selection, or (show energy for example, being shown on dynamic function row 104 in response to the optional symbol of user One in expression/symbol) user selection and occur.User's selection can be key percussion, mouse click, mouse-over, life Order+tabs input etc..In some embodiments, the change of focus is in response to (or Fig. 2A-Fig. 2 the D of portable system 100 In computing device 202) operating system determine and occur.For example, has focal application window when user closes When, focus can be given different application programs by operating system, such as be had before the application window of closing focal Application program.In another example, when user, which closes, has focal application window, operating system can be by focus Dialog box is given, prompts user to preserve the change done to document via application program.
In some embodiments, the change of focus can be from an element associated with application program to phase Another element being associated with application program is (for example, from the Email synthesis window of email application to electronics The inbox list window of mail applications, or snap into internet from an option of Internet-browser application program Another tabs of browser application) change.In some embodiments, the change of focus can be from one The element that a application program is associated is to the element associated with another application program (for example, from Internet-browser window To email application window) change.In addition, in some embodiments, the change of focus can be from answering Change with the element that program is associated to the element associated with operating system, the operating system such as system dialog box, be System sets control (for example, volume control) and file/folder navigation application program (for example, the FINDER of Apple Inc. Application program) associated window etc..In addition, focus also may point to dialog box, file directory, set control (for example, volume Control) or can receive can to its present information user and/or graphic user interface input by user any other Element.
Fig. 2A is the illustrative figure according to the first specific implementation of the desk-top computing system 200 of some embodiments.It is desk-top Computing system 200 includes computing device 202, the peripheral display equipment 204 with basic display unit 102,206 and of peripheral keyboard Peripheral mouse 208.Computing device 202 includes one or more processors and storage is used to be held by one or more processors The memory of capable one or more programs.In some embodiments, peripheral display equipment 204 can be with computing device 202 Such asIntegration of equipments.In some embodiments, the basic display unit 102 of peripheral display equipment 204 is touch-screen Display.In fig. 2, peripheral display equipment 204 (referred to herein as the first shell 204 or shell 204), peripheral keys Disk 206 and peripheral mouse 208 use communication protocol via wired connection, such as USB or PS/2, or via wireless communication link Bluetooth, Wi-Fi etc. are communicatively coupled to computing device 202.For example, peripheral keyboard 206 is (referred to herein as second Shell 206 or shell 206) away from computing device 202 it is no more than 15 feet (for example, about three feet aways).In fig. 2, it is peripheral Keyboard 206 includes the dynamic function row 104 and one group of secondary or physical bond 106 being at least partially contained within same enclosure.In some realities Apply in scheme, be touch-screen display with reference to the dynamic function row 104 that figure 1B is more fully described.In some embodiments, Peripheral keyboard 206 includes the memory of one or more processors and the one or more programs of storage, one or more of Program can be performed by the one or more processors of peripheral keyboard 206 to perform any in the embodiment described herein It is a.In some embodiments, peripheral keyboard 206 inputs instruction user (for example, key is tapped and shown by dynamic function row 104 The optional symbol of user shown/show the selection that can be represented) signal be relayed to computing device 202.
Fig. 2 B are the illustrative figures according to the second specific implementation of the desk-top computing system 200 of some embodiments.Scheming In 2B, desk-top computing system 200 includes computing device 202, has the peripheral display equipment 204 of basic display unit 102, and Peripheral keyboard 206.In fig. 2b, peripheral display equipment 204 and peripheral keyboard 206 are via wired connection, such as USB or PS/ 2, or via wireless communication link, computing device 202 is communicatively coupled to using communication protocol bluetooth, Wi-Fi etc.. In Fig. 2 B, peripheral keyboard 206 includes 104, the one groups of secondary or physical bonds of dynamic function row being at least partially contained within same enclosure 106, and touch pad 108.In some embodiments, it is to touch with reference to the dynamic function row 104 that figure 1B is more fully described Panel type display.In some embodiments, peripheral keyboard 206 includes one or more processors and storage is one or more The memory of program, one or more of programs can be performed by the one or more processors of peripheral keyboard 206 to perform sheet Any one in embodiment described in text.In some embodiments, peripheral keyboard 206 instruction user is inputted (for example, Key taps, with the user mutual of touch pad 108 and by the optional symbol of user that dynamic function row 104 is shown/show and can represent Selection) signal be relayed to computing device 202.
Fig. 2 C are the illustrative figures according to the 3rd specific implementation of the desk-top computing system 200 of some embodiments.Scheming In 2C, desk-top computing system 200 includes computing device 202, the peripheral display equipment 204 with basic display unit 102, periphery The peripheral input mechanism 212 of keyboard 206 and first.In fig. 2 c, peripheral display equipment 204, peripheral keyboard 206 and first Peripheral input mechanism 212 is via wired connection, such as USB or PS/2, all using communication protocol or via wireless communication link Such as bluetooth, Wi-Fi are communicatively coupled to computing device 202.In fig. 2 c, peripheral keyboard 206 includes one group of secondary or physical bond 106, And the first peripheral input mechanism 212 includes dynamic function row 104 and the touch pad being at least partially contained within same enclosure 108.In some embodiments, it is touch-screen display with reference to the dynamic function row 104 that figure 1B is more fully described.One In a little embodiments, the first peripheral input mechanism 212 includes one or more processors and stores one or more programs Memory, one or more of programs can be performed to hold by the one or more processors of the first peripheral input mechanism 212 Any one in row the embodiment described herein.In some embodiments, the first peripheral input mechanism 212 will indicate to use Family input is (for example, with the user mutual of touch pad 108 and by the optional symbol of user that dynamic function row 104 is shown/show energy Expression user selection) signal be relayed to computing device 202.
Fig. 2 D are the illustrative figures according to the 4th specific implementation of the desk-top computing system 200 of some embodiments.Scheming In 2D, desk-top computing system 200 includes computing device 202, the peripheral display equipment 204 with basic display unit 102, periphery Keyboard 206, peripheral mouse 208, and the second peripheral input mechanism 222.In fig. 2 c, peripheral display equipment 204, periphery The peripheral input mechanism 222 of keyboard 206, peripheral mouse 208 and second is via wired connection, such as USB or PS/2, or via nothing Line communication link, computing device 202 is communicatively coupled to using communication protocol bluetooth, Wi-Fi etc..In fig. 2, it is peripheral Keyboard 206 includes dynamic function row 104 and one group of secondary or physical bond 106.In figure 2d, peripheral keyboard 206 includes one group of secondary or physical bond 106, and the second peripheral input mechanism 222 includes being at least partially contained within the shell of the second peripheral input mechanism 222 Dynamic function row 104.In some embodiments, it is touch-screen with reference to the dynamic function row 104 that figure 1B is more fully described Display.In some embodiments, the second peripheral input mechanism 222 includes one or more processors and storage one Or the memory of multiple programs, one or more of programs can be handled by the second the one or more of peripheral input mechanism 222 Device is performed to perform any one in the embodiment described herein.In some embodiments, the second peripheral input mechanism 222 instruction user is inputted (for example, by the optional symbol of user that dynamic function row 104 is shown/show that the user that can be represented selects) Signal be relayed to computing device 202.
Fig. 3 A are the block diagrams according to the electronic equipment 300 of some embodiments.In some embodiments, electronic equipment 300 be portable electric appts, such as laptop computer (for example, portable computing system 100, Figure 1A).In some embodiment party In case, electronic equipment 300 is not portable set, but desktop computer is (for example, the computing device of desk-top computing system 200 202, Fig. 2A-Fig. 2 D), it is with peripheral display system (for example, peripheral display equipment 204, Fig. 2A-Fig. 2 D) and optionally Peripheral touch sensitive surface (for example, touch pad 108, Fig. 2 B- Fig. 2 C, and/or touch-sensitive display, such as peripheral display equipment 204, Fig. 2A-Fig. 2 D, and/or dynamic function row 104, Fig. 2A-Fig. 2 D) it is communicatively coupled.
Electronic equipment 300 usually supports various application programs, and one or more of such as following application program applies journey Sequence：Drawing application program, presentation application program, word-processing application, website establishment application program, disk editor apply journey Sequence, spreadsheet applications, game application, videoconference application, email application, instant message Application program, image management application, digital camera applications program, digital camera applications program, web browser application Program, and/or media player application program.
The various application programs performed on electronic equipment 300 optionally use at least one general physical User circle Face equipment, such as touch sensitive surface.The one or more functions of touch sensitive surface and the corresponding informance shown by electronic equipment 300 Optionally from the adjustment of application program and/or be changed to next application program, and/or be adjusted in application program and/ Or change.In this way, the shared physical structure (such as touch sensitive surface) of electronic equipment 300 is optionally with straight for a user See and clearly user interface supports various application programs.
Electronic equipment 300 include memory 302 (it optionally includes one or more computer-readable recording mediums), Memory Controller 322, one or more processing units (CPU) 320, peripheral interface 318, RF circuits 308, audio-frequency electric Road 310, loudspeaker 311, microphone 313, input/output (I/O) subsystem 306, other inputs or control device 316 and outer Portion port 324.Electronic equipment 300 optionally include display system 312 (for example, the basic display unit 102 of display portion 110, Figure 1A, and/or dynamic function row 104, Figure 1A-Figure 1B), it can be that touch-sensitive display (otherwise referred to as " touches herein Screen " or " touch-screen display ").Electronic equipment 300 optionally includes one or more optical sensors 364.Electronic equipment 300 optionally include one or more of the intensity for detecting the contact on touch sensitive surface such as touch-sensitive display or touch pad A intensity sensor 365.Electronic equipment 300 optionally includes one or more tactile output generators 367, for touching Tactile output is generated on sensitive surfaces such as touch-sensitive display or touch pad (for example, touch pad 108, Figure 1A-Figure 1B).These portions Part communicates optionally by one or more communication bus or signal wire 303.
As used in this specification, " intensity " of the contact on term touch sensitive surface refers to connecing on touch sensitive surface The power or pressure (power of per unit area) of (for example, finger contact) are touched, or refers to the power or pressure of the contact on touch sensitive surface Substitute (surrogate).The intensity of contact has a value scope, which includes at least four different values and more typical Ground includes up to a hundred different values (for example, at least 256).The intensity of contact optionally uses various methods and various sensings The combination of device or sensor determines (or measurement).For example, touch sensitive surface lower section or one or more adjacent to touch sensitive surface A force snesor is optionally for the power at the difference on measurement touch sensitive surface.In some specific implementations, from multiple power The power measurement of sensor is merged (for example, weighted average), to determine the contact force of estimation.Similarly, the pressure-sensitive top of stylus Optionally for pressure of the definite stylus on touch sensitive surface.Alternatively, the contact area detected on touch sensitive surface it is big Touch-sensitive table near the capacitance of touch sensitive surface near small and/or its change, contact and/or its change and/or contact The resistance in face and/or its change are optionally used as the power of contact or the substitute of pressure on touch sensitive surface.It is specific at some In implementation, the substitute measurement of contact force or pressure, which is directly used in, determines whether to already exceed intensity threshold (for example, intensity threshold Value is described with the unit that is measured corresponding to substitute).In some specific implementations, the substitute measurement of contact force or pressure The power or pressure of estimation are converted into, and the power or pressure estimated are used to determine whether to exceed intensity threshold (for example, strong Degree threshold value is with the pressure threshold of the unit measurement of pressure).
As used in the specification and claims, term " tactile output " refers to that user will be utilized by user The equipment that detects of sense of touch relative to the physical displacement of the previous position of equipment, component (for example, touch sensitive surface) phase of equipment Physical displacement or component for another component (for example, shell) of equipment relative to the barycenter of equipment displacement.For example, Equipment or equipment component and user to touching sensitive surface (for example, other portions of finger, palm or user's hand Point) contact in the case of, by physical displacement generate tactile output sense of touch will be construed to by user, the sense of touch correspond to sets The change perceived of the physical features of standby or equipment component.For example, touch sensitive surface (for example, touch-sensitive display or touch/ Trackpad) movement be optionally construed to by user to " the pressing click " of physical actuation button or " unclamp and click on ".At some In the case of, user will feel that sense of touch, such as " press click " or " unclamp click on ", even in the movement by user and thing When being pressed the physical actuation button associated with touch sensitive surface of (for example, being shifted) to reason and not moving.As another A example, when the smoothness of touch sensitive surface is unchanged, the movement of touch sensitive surface also optionally can be explained by user or felt Survey " roughness " for touch sensitive surface.Although the individuation sensory perception of user will be subject to such explanation of touch by user Limitation, but the sensory perception for having many touches, which is most users, to be shared.Therefore, when tactile output is described as pair Should when specific sensory perception (for example, " unclamp click on ", " pressing click ", " roughness ") of user, unless otherwise stated, Otherwise corresponding to the physical displacement of equipment or its component, it is (or general which will generate typical case for the tactile output generated It is logical) sensory perception of user.
It should be appreciated that electronic equipment 300 is only example, and electronic equipment 300 optionally has than shown component More or fewer components, optionally combine two or more components, or the different configurations optionally with these components Or arrangement.Various parts shown in Fig. 3 A are in hardware, software, firmware or combinations thereof (including one or more signals Process circuit and/or application-specific integrated circuit) in implement.
Memory 302 optionally includes high-speed random access memory, and also optionally includes non-volatile memories Device, such as one or more disk storage equipment, flash memory device or other non-volatile solid state memory equipment.Electricity Access of the miscellaneous part (such as one or more CPU 320 and peripheral interface 318) of sub- equipment 300 to memory 302 Optionally controlled by Memory Controller 322.Peripheral interface 318 can be used for input peripheral and output is outer Peripheral equipment is couple to one or more CPU 320 and memory 302.One or more processing units 320 run or perform quilt The various software programs and/or instruction set of storage in the memory 302, to perform the various functions of electronic equipment 300 and processing Data.In some embodiments, peripheral interface 318, one or more CPU 320 and Memory Controller 322 are appointed Selection of land is such as realized in one single chip on chip 304.In some other embodiments, they are by optionally in independent core On piece is realized.
RF (radio frequency) circuit 308 receives and sends the RF signals for being also designated as electromagnetic signal.RF circuits 308 are by electric signal Be converted to electromagnetic signal/by electromagnetic signal and be converted to electric signal, and come and communication network and other are logical via electromagnetic signal Letter equipment communicates.RF circuits 308 optionally include the well known circuit for performing these functions, include but not limited to Antenna system, RF transceivers, one or more amplifier, tuner, one or more oscillators, digital signal processor, CODEC chipsets, subscriber identity module (SIM) card, memory etc..RF circuits 308 come and net optionally by wireless communication Network and other equipment communicate, these networks are such as internet (also referred to as WWW (WWW)), Intranet, and/or Wireless network (such as, cellular phone network, WLAN (LAN) and/or Metropolitan Area Network (MAN) (MAN)).Wireless communication optionally makes With any one of a variety of communication standards, agreement and technology, include but not limited to global system for mobile communications (GSM), enhancing Data GSM environment (EDGE), high-speed downlink packet access (HSDPA), High Speed Uplink Packet access (HSUPA), Evolution, clear data (EV-DO), HSPA, HSPA+, double unit HSPA (DC- HSPDA), Long Term Evolution (LTE), near-field communication (NFC), wideband code division multiple access (W-CDMA), CDMA (CDMA), time division multiple acess (TDMA), bluetooth, Wireless Fidelity (Wi- Fi) (for example, IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and/or IEEE 802.11n), Internet protocol Voice technology (VoIP), Wi-MAX, email protocol are (for example, internet message access protocol (IMAP) and/or post office protocol (POP)), instant message is (for example, scalable message handles Presence Protocol (XMPP), utilizes extension for instant message and scene Session initiation Protocol (SIMPLE), instant message and the service of showing up (IMPS)), and/or Short Message Service (SMS) or its His any appropriate communication protocol, be included in this document submission date also it is untapped go out communication protocol.
Voicefrequency circuit 310, loudspeaker 311 and microphone 313 provide the audio interface between user and electronic equipment 300. Voicefrequency circuit 310 receives voice data from peripheral interface 318, and voice data is converted into electric signal, and by the electric signal It is transmitted to loudspeaker 311.Loudspeaker 311 converts electrical signals to the audible sound wave of the mankind.Voicefrequency circuit 310 also receive by The electric signal that microphone 313 is changed from sound wave.Voicefrequency circuit 310 converts electrical signals to voice data, and voice data is passed It is defeated to arrive peripheral interface 318, for processing.Voice data is optionally retrieved from and/or is passed by peripheral interface 318 Transport to memory 302 and/or RF circuits 308.In some embodiments, voicefrequency circuit 310 further includes earphone jack.Headset Jack provides the interface between voicefrequency circuit 310 and removable audio input/output ancillary equipment, the removable audio The earphone or there is output (for example, single head-receiver or bi-telephone) and input that input/output ancillary equipment such as only exports The headset of both (for example, microphone).
I/O subsystems 306 are by the input/output ancillary equipment of electronic equipment 300 such as display system 312 and other Input or control device 316 are couple to peripheral interface 318.I/O subsystems 306 optionally include display controller 356, Optical sensor controller 358, intensity sensor controller 359, tactile feedback controller 361, and for other input or Other one or more input controllers 360 of control device.Other one or more input controllers 360 are inputted from other Or control device 316 receive electric signal/by electric signal be sent to other input or control device 316.Other inputs or control Equipment 316 optionally include physical button (for example, pushing button, rocker buttons etc.), dial, slide switch, control stick, Click wheel etc..In some alternative embodiments, other one or more input controllers 360 optionally with the following Any one of coupling (or not with the coupling of any one of the following)：Keyboard, infrared port, USB port and refer to Pin equipment such as mouse.One or more physical buttons are optionally included for loudspeaker 311 and/or microphone 313 The increase of volume control/reduction button.
Display system 312 (for example, the basic display unit 102, Figure 1A of display portion 110, and/or dynamic function row 104, Figure 1A-Figure 1B) output interface is provided between electronic equipment 300 and user (and optionally, when the display system is tactile During quick display, there is provided input interface).Display controller 356 receives electric signal and/or by electric signal from display system 312 Send to display system 312.Display system 312 shows visual output to user.Visual output optionally includes figure, text Sheet, icon, video and any combination of them (being collectively referred to as " figure ").In some embodiments, some visual outputs Or whole visual outputs corresponds to user interface object/element.
In some embodiments, display system 312 (for example, the basic display unit 102, Figure 1A of display portion 110, And/or dynamic function row 104, Figure 1A-Figure 1B) it is to have based on tactile/tactile contact to receive touching for input from the user The touch-sensitive display of sensitive surfaces, sensor or sensor group.Therefore, display system 312 and display controller 356 are (with storage Any associated module and/or instruction set in device 302 are together) contact (and contact on detection display system 312 Any movement or interruption), and the contact detected is converted to and is displayed on user circle on display system 312 In face of the interaction as (for example, one or more soft key, icon, webpage or images).In an exemplary embodiment, show Show that the contact point between device system 312 and user corresponds to the region below the finger of user.
Display system 312 (for example, the basic display unit 102, Figure 1A of display portion 110, and/or dynamic function row 104, Figure 1A-Figure 1B) optionally using LCD (liquid crystal display) technology, LPD (light emitting polymer displays) technology, LED (luminous two Pole pipe) technology or OLED (Organic Light Emitting Diode) technology, but other Display Techniques are used in other embodiments. In some embodiments, when display system 312 is touch-sensitive display, display system 312 and display controller 356 are appointed Selection of land uses currently known or later any technology and other close biographies by a variety of touch-sensing technologies developed Sensor array or the other elements of one or more points for determining to contact with display system 312 contact detecting and its Any movement or interruption, a variety of touch-sensing technologies are including but not limited to capacitive, resistive, infrared ray and table Face technology of acoustic wave.In an exemplary embodiment, using projection-type mutual capacitance detection technology, such as in Apple Inc. (Cupertino, California's)WithPresent in technology.
Display system 312 (for example, the basic display unit 102, Figure 1A of display portion 110, and/or dynamic function row 104, Figure 1A-Figure 1B) optionally have more than 400dpi (for example, 500dpi, 800dpi or bigger) video resolution.At some In embodiment, display system 312 is touch-sensitive display, and user is optionally using stylus, finger etc. and the touch-sensitive display Contacted.In some embodiments, user interface is designed to mainly carry out work with the contact based on finger and gesture Make.In some embodiments, the rough input based on finger is translated as accurate pointer/cursor position by electronic equipment 300 Or order, for performing the desired action of user.
In some embodiments, in addition to display system 312, electronic equipment 300 optionally includes touch pad (for example, touch pad 108, Figure 1A-Figure 1B) is for activating or deactivate specific function.In some embodiments, touch pad It is the touch sensitive regions of electronic equipment 300, the touch sensitive regions are different from display system 312, it does not show visual output.One In a little embodiments, when display system 312 is touch-sensitive display, touch pad is separated with display system 312 Touch sensitive surface, or the extension of the touch sensitive surface formed by display system 312.
Electronic equipment 300 further includes the electric system 362 for powering for various parts.Electric system 362 is optionally wrapped Include electric power management system, one or more power supplys (for example, battery, alternating current (AC) etc.), recharging system, power failure inspection Slowdown monitoring circuit, power converter or inverter, power supply status indicator (for example, light emitting diode (LED)) and set with portable Any other component that generation, management and the distribution of electric power in standby are associated.
Electronic equipment 300 optionally further includes one coupled with the optical sensor controller 358 in I/O subsystems 306 A or multiple optical sensors 364.Optical sensor 364 optionally includes charge coupling device (CCD) or complementary metal oxygen Compound semiconductor (CMOS) phototransistor.Optical sensor 364 is received by one or more lens from environment to project Light, and convert light to represent the data of image.With reference to image-forming module 343, one or more optical sensors 364 are optional Ground captures still image or video.In some embodiments, optical sensor is located on the front portion of electronic equipment 300, makes User while other video conference participants are watched on display system 312, optionally obtain the user image with For video conference.
Electronic equipment 300 optionally further includes one coupled with the intensity sensor controller 359 in I/O subsystems 306 A or multiple contact strength sensors 365.One or more contact strength sensors 365 optionally include one or more pressures It is touch-sensitive to hinder deformeter, capacitive force transducer, electric force snesor, piezoelectric force transducer, optics force snesor, condenser type Surface or other intensity sensors (for example, sensor of the power (or pressure) for measuring the contact on touch sensitive surface).One A or multiple contact strength sensors 365 receive contact strength information (for example, the generation of pressure information or pressure information from environment With thing).In some embodiments, at least one contact strength sensor and touch sensitive surface (for example, touch pad 108, Figure 1A- Figure 1B, or when it is touch-sensitive display, display system 312) Alignment or neighbouring.
Electronic equipment 300 optionally further includes one coupled with the tactile feedback controller 361 in I/O subsystems 306 Or multiple tactile output generators 367.One or more tactile output generators 367 optionally include one or more electroacoustic Equipment such as loudspeaker or other acoustic components；And/or the electromechanical equipment for converting the energy into linear movement is such as electric Machine, solenoid, electroactive polymerizer, piezo-activator, electrostatic actuator or other tactiles output generating unit will be (for example, will The component of tactile output on electric signal conversion forming apparatus).One or more contact strength sensors 365 are from touch feedback mould Block 333 receives touch feedback generation instruction, and generates and can be exported by the tactile that the user of electronic equipment 300 senses. In some embodiments, at least one tactile output generator and touch sensitive surface (for example, touch pad 108, Figure 1A-Figure 1B, or Person is when it is touch-sensitive display, display system 312) Alignment or neighbouring, and optionally by vertically (for example, To the surface inside/outside of electronic equipment 300) or laterally (for example, in the plane identical with the surface of electronic equipment 300 to Mobile touch sensitive surface exports to generate tactile afterwards and forward).
Electronic equipment 300 optionally further includes the one or more proximity sensors coupled with peripheral interface 318 366.Alternatively, other input controllers of one or more of one or more proximity sensors 366 and I/O subsystems 306 360 couplings.Electronic equipment 300 optionally further includes the one or more accelerometers 368 coupled with peripheral interface 318. Alternatively, other 360 couplings of input controller of one or more of one or more accelerometers 368 and I/O subsystems 306 Connect.
In some embodiments, the software part being stored in memory 302 includes operating system 326, communication mould Block 328 (or instruction set), contact/motion module 330 (or instruction set), figure module 332 (or instruction set), application program 340 (or instruction set) and dynamic function row module 350 (or instruction set).In addition, in some embodiments, memory 302 is deposited Equipment/overall situation internal state 357 (or instruction set) is stored up, as shown in Figure 3A.Equipment/overall situation internal state 357 includes following One or more of：Applications active state, it indicates which application program is (if any) current active And/or in focus；Dispaly state, it indicates that what application program, view or other information occupy display system 312 (for example, the basic display unit 102, Figure 1A of display portion 110, and/or dynamic function row 104, Figure 1A-Figure 1B) and/or it is outer Display system is enclosed (for example, the basic display unit 102 of peripheral display equipment 204, Fig. 2A-Fig. 2 D, and/or dynamic function row 104, Fig. 2A-Fig. 2 D) regional；Sensor states, it include from the input of various sensors and electronic equipment 300 or The information that control device 316 obtains, and the position on electronic equipment 300 and/or the positional information of posture.
Operating system 326 is (for example, DARWIN, RTXC, LINUX, UNIX, OS X, WINDOWS or embedded operation system System such as VXWorks) include be used for control and manage general system task (such as memory management, storage device control, work( Rate management etc.) various software parts and/or driver, and promote logical between various hardware componenies and software part Letter.
Communication module 328 be conducive to by one or more outside ports 324 and/or RF circuits 308 come with other equipment (for example, computing device 202, Fig. 2A-Fig. 2 D；Peripheral mouse 208, Fig. 2A and Fig. 2 D；Peripheral keyboard 206, Fig. 2A-Fig. 2 B；The One peripheral input mechanism 212, Fig. 2 C；And/or the second peripheral input mechanism 222, Fig. 2 D) communicate, and further include various Software part for via RF circuits 308 and/or outside port 324 come send/receive data.324 (example of outside port Such as, Universal Serial Bus (USB), firewire etc.) it is suitable for being directly coupled to other equipment or indirectly by network (for example, mutually Networking, Wireless LAN etc.) coupled.In some embodiments, outside port 324 be withUsed in equipment 30 needle connectors are same or similar and/or spininess (for example, 30 pins) connector for being compatible with.
Contact/motion module 330 is optionally detected with display system 312 (when it is touch-sensitive display) (with reference to aobvious Show controller 356) contact with other touch-sensitive devices (for example, touch pad or physics click wheel).Contact/motion module 330 is wrapped Various software parts are included for performing with contacting the relevant various operations of detection, such as to determine that whether being in contact (example Such as, detect finger down event), determine the intensity of contact (for example, the power or pressure of contact, or the power of contact or pressure Substitute), determine whether there is the movement of contact and track the movement across touch sensitive surface (for example, the one or more fingers of detection Drag events) and determine whether contact has stopped (for example, detection digit up event or contact disconnect).Contact/fortune Dynamic model block 330 receives contact data from touch sensitive surface.Determine that the movement of contact point optionally includes the speed of definite contact point (value), speed (value and direction) and/or acceleration (change in value and/or direction), the movement of the contact point is by a system Row contact data represent.These operations are optionally applied to single-contact (for example, single abutment) or multiple spot contacts at the same time (for example, " multiple point touching "/more abutments).In some embodiments, contact/motion module 330 also detects touch pad (example Such as, touch pad 108, Figure 1A-Figure 1B) on contact.
In some embodiments, contact/motion module 330 determines behaviour using one group of one or more intensity threshold Make to be performed (for example, determining whether user has selected or " click " is shown and can be represented) by user whether.In some embodiments In, determine at least one subset of intensity threshold (for example, intensity threshold is not by specific physical actuation device according to software parameter Activation threshold determine, and can be adjusted in the case where not changing the physical hardware of electronic equipment 300).For example, In the case of not changing Trackpad or touch-screen display hardware, mouse " click " threshold value of Trackpad or touch-screen can be set It is fixed into predefined threshold value it is a wide range of in any one threshold value.In addition, in some specific implementations, carried to the user of equipment For for adjusting one or more of one group of intensity threshold intensity threshold (for example, by adjusting each intensity threshold and/or leading to Cross using the system-level click to " intensity " parameter come the multiple intensity thresholds of Primary regulation) software design patterns.
Contact/motion module 330 optionally detects the gesture input carried out by user.Different gestures on touch sensitive surface With different contact patterns (for example, the different motion of detected contact, timing, and/or intensity).Therefore, optionally By detecting specific contact patterns come detection gesture.For example, detection finger tapping down contact includes detecting finger down event, so Afterwards hand is detected at position (or the substantially the same position) place (for example, picture mark position at) identical with finger down event Finger lifts and (is lifted away from) event.And for example, finger is detected on touch sensitive surface and gently sweeps gesture including detecting finger down event, then The one or more finger drag events of detection, and then also detection finger lifts and (is lifted away from) event in some embodiments.
Figure module 332 includes being used to cause and cause to be graphically displayed at basic display unit 102 (for example, display portion 110 Basic display unit 102, the basic display unit 102 of Figure 1A or peripheral display equipment 204, Fig. 2A-Fig. 2 D) or other displays On various known software parts, including for change shown figure visual impact (for example, brightness, transparency, Saturation degree, contrast or other visual characteristics) component.As used herein, term " figure " includes that user can be displayed to Any object, its without limitation include text, webpage, icon (such as user interface object including soft key), numeral Image, video, animation etc..In some embodiments, figure module 332 stores the data for the figure for representing to be used.Each Figure is optionally assigned corresponding code.Figure module 332 specifies the one of figure to be shown from receptions such as application programs A or multiple codes, also receive coordinate data and other graphic attribute data in the case of necessary, and then generate screen View data is to export to display controller 356.
Haptic feedback module 333 includes being used for the various software parts for generating instruction, and the instruction is by one or more tactiles Output generator 367 uses, so as in response to user one with interacting for electronic equipment 300 and on electronic equipment 300 or Tactile output is produced at multiple positions.
Application program 340 is optionally included with lower module (or instruction set), or its subset or superset：
Email client module 341 for receiving, sending, writing and checking Email (has herein When be also referred to as " mail applications " or " email application ")；
For capturing the image-forming module 342 of static and/or video image；
For editing and checking static and/or video image image management module 343 (herein sometimes referred to as For " photo application ")；
For the media player module 344 that plays back audio and/or video, (otherwise referred to as " media are broadcast herein Put device application program ")；And
For being connected to internet and browsing the web-browsing module 345 of internet (herein otherwise referred to as " web browser ").
The example for the other applications 340 being optionally stored in memory 302 includes instant message and communications applications Program, word-processing application, other picture editting's application programs, drawing application program, presentation application program, support Application program, encryption application program, digital rights management application program, speech recognition application programming interface and the speech reproduction of JAVA Application program.
With reference to RF circuits 308, display system 312 (for example, the basic display unit 102, Figure 1A of display portion 110, and/or Dynamic function row 104, Figure 1A-Figure 1B), display controller 356 and contact module 330, one of figure module 332 or more Person, email client module 341 are included to create, send, receive and manage Email in response to user instruction Executable instruction.With reference to image management module 343, email client module 341 is so that being very easy to create and sending out Send with the still image shot by image-forming module 342 or the Email of video image.
With reference to display system 312 (for example, the basic display unit 102, Figure 1A of display portion 110, and/or dynamic function row 104, Figure 1A-Figure 1B), display controller 356, one or more optical sensor 364, optical sensor controller 358, connect One or more of touch block 330, figure module 332 and image management module 343, image-forming module 342 are included to carry out The executable instruction operated below：Capture still image or video (including video flowing) and store them in memory In 302, change the feature of still image or video or delete still image or video from memory 302.
With reference to display system 312 (for example, the basic display unit 102, Figure 1A of display portion 110, and/or dynamic function row 104, Figure 1A-Figure 1B), display controller 356, contact module 330, one of figure module 332 and image-forming module 342 or More persons, image management module 343 are included to arrange, change (for example, editor) or otherwise manipulate, tag, delete Remove, present (for example, in digital slide or photograph album), and storage static state and/or the executable instruction of video image.
With reference to display system 312 (for example, the basic display unit 102, Figure 1A of display portion 110, and/or dynamic function row 104, Figure 1A-Figure 1B), display controller 356, contact module 330, figure module 332, voicefrequency circuit 310, loudspeaker 311, One or more of RF circuits 308 and web-browsing module 345, media player module 344 include allow user download and Playback is with the music recorded and other audio files of one or more file formats (such as MP3 or AAC files) storage Executable instruction, and to show, present or otherwise play back video (for example, the master in display portion 110 shows Show on device 102, Figure 1A or on the basic display unit 102 of the peripheral display equipment 2014 connected via outside port 324, Fig. 2A-Fig. 2 B) executable instruction.
With reference to RF circuits 308, display system 312 (for example, the basic display unit 102, Figure 1A of display portion 110, and/or Dynamic function row 104, Figure 1A-Figure 1B), display controller 356, contact one of module 330 and figure module 332 or more Person, web-browsing module 345 are included (including to search for, link to, receive and show to browse internet according to user instruction Show webpage or part thereof, and link to the annex and alternative document of webpage) executable instruction.
Dynamic function row (DFR) module 350 includes：Mould is presented in focus decision module 351, DFR determining modules 352 and DFR Block 353.In some embodiments, focus decision module 351 be configured to determine that by display system 312 (for example, aobvious Show the basic display unit 102, Figure 1A of part 110) or peripheral display system (for example, peripheral display equipment 204, Fig. 2A-figure 2D) the active user interface element in the focus on the graphic user interface of display.In some embodiments, DFR is determined Module 352 is configured as determining figure (for example, one group one or more based on the active user interface element in focus Showing to represent).In some embodiments, DFR is presented module 353 and is configured as presenting by display system 312 (for example, dynamic State function row 104, Figure 1A-Figure 1B) on the definite figure of DFR determining modules 352.Module 353, which is presented, in DFR includes being used to cause Make and cause to be graphically displayed at various known soft on display system 312 (for example, dynamic function row 104, Figure 1A-Figure 1B) Part component, including for change shown figure visual impact (for example, brightness, transparency, saturation degree, contrast or its His visual characteristic) component.As used herein, term " figure " includes any object that can be displayed to user, its is unrestricted Property include text, webpage, icon (user interface object for including soft key), digital picture, video, animation etc.. In some embodiments, DFR modules 350 include being used for other modules operated below：Adjust dynamic function row 104 Sensitivity；The sense of hearing provided by dynamic function row 104 and/or touch feedback are provided；What adjustment was shown by dynamic function row 104 Showing can represent and the setting of information (for example, size, brightness, font, language etc.)；Adjust the current power of dynamic function row 104 Pattern (for example, normal and low-power mode)；Etc..
In some embodiments, dynamic function row module 350 provides prediction/proactive/suggestion content item (bag with allowing Include the recipient of prediction, the text suggested completes character string, application program of proactive suggestion etc.) component interact.It is proactive It is recommended that content item discussed in more detail in Application U.S. Serial No 15/167,713, this application accordingly in full with the side of reference Formula is incorporated to.
Each module and application program in above-mentioned identified module and application program, which correspond to, to be used to perform above-mentioned one Kind or multiple functions and in the present patent application described method are (for example, computer implemented side described herein Method and other information processing method) executable instruction set.These modules (that is, instruction set) need not with independent software program, Process or module realize, therefore the optionally combination or otherwise in various embodiments of each subset of these modules Rearrange.In some embodiments, memory 302 optionally stores the subgroup of above-mentioned module and data structure.In addition, Memory 302 optionally stores add-on module not described above and data structure.
Fig. 3 B are the block diagrams according to the component of the event handling for Fig. 3 A of some embodiments.In some embodiment party In case, memory 302 (Fig. 3 A) includes event classifier 370 (for example, in operating system 326) and application program 340-1 (for example, any one in aforementioned applications program 341,342,343,344 or 345).
Event classifier 370 receives event information and determines the application program 340-1 that is delivered to event information and should With the application view 391 of program 340-1.Event classifier 370 includes event monitor 371 and event dispatcher module 374.In some embodiments, application program 340-1 includes application program internal state 392, it is indicated when application program is Activity or be shown in upon execution display system 312 (for example, the basic display unit 102, Figure 1A of display portion 110, and/or Dynamic function row 104, Figure 1A-Figure 1B) on one or more current application program views.In some embodiments, if Standby/global internal state 357 by event classifier 370 be used for determining which (which) application program be currently activity or In focus, and application program internal state 392 is used for determining to answer what event information was delivered to by event classifier 370 With Views 391.
In some embodiments, application program internal state 392 includes additional information, and one in such as the following Person or more persons：It is to be used when application program 340-1 recovers to perform to recover information, indicate that being just employed program 340-1 shows The information shown is ready for being employed the user interface state information for the information that program 340-1 is shown, for causing user Can be back to the previous state of application program 340-1 or the state queue of view, and the weight of prior actions that user takes Multiple/revocation queue.
Event monitor 371 receives event information from peripheral interface 318.Event information is included on subevent (example Such as, the user of the part on display system 312 (when it is touch-sensitive display) as multi-touch gesture touches) Information.Peripheral interface 318 transmits it from I/O subsystems 306 or sensor (such as one or more proximity sensors 366th, one or more accelerometers 368 and/or microphone 313 (passing through voicefrequency circuit 310)) information that receives.Ancillary equipment Interface 318 include from the information that I/O subsystems 306 receive from display system 312 (when it is touch-sensitive display) or The information of another touch sensitive surface (for example, touch pad 108, Figure 1A-Figure 1B).
In some embodiments, event monitor 371 sends the request to ancillary equipment and connects at predetermined intervals Mouth 318.In response, 318 transmitting event information of peripheral interface.In other embodiments, peripheral interface 318 Only when there are notable event (for example, receive higher than predetermined noise threshold input and/or receive more than advance The input of definite duration) when ability transmitting event information.
In some embodiments, event classifier 370 further includes hit view determination module 372 and/or life event Identifier determining module 373.
Hit view determination module 372, which provides, to be used to determine that subevent wherein occurs in one or more views, is shown Show when device system 312 shows the software process of more than one view, the control that wherein view can be seen over the display by user Part and other elements composition.
The another aspect of the user interface associated with application program is one group of view, herein also sometimes referred to as Application view or user interface windows, show information and the gesture based on touch occur wherein.Detect wherein (application program) application view touched optionally corresponds in the sequencing of application program or view hierarchies structure Sequencing it is horizontal.For example, detect wherein touch floor level view be optionally referred to as hit view, and by The event set for being considered to correctly enter optionally at least is based in part on the hit view of initial touch to determine, described initial Touch the gesture for starting based on touch.
Click on the reception of view determination module 372 and the relevant information in subevent of the gesture based on contact.Work as application program During with multiple views with hierarchy tissue, hit view determination module 372 will hit that view is identified as should be to sub- thing Minimum view in the hierarchy that part is handled.In most cases, hit view is to initiate subevent (to be formed The first subevent in the subevent sequence of event or potential event) the floor level view that occurs wherein.Once hit regards Figure is hit view determination module and is identified, hit view is usually received is identified as targeted same of hit view with it Touch or the relevant all subevents of input source.
Life event identifier determining module 373 determines which or which view in view hierarchies structure should receive spy Stator sequence of events.In some embodiments, life event identifier determining module 373 determines that only hit view should just connect Receive specific subevent sequence.In other embodiments, life event identifier determining module 373 determines to include subevent All views of physical location are the active views participated in, and it is thus determined that all views actively participated in should all receive it is specific Subevent sequence.In other embodiments, though touch subevent be confined to completely it is associated with a particular figure Region, higher view in hierarchy will still maintain view for active participation.
Event information is assigned to event recognizer (for example, event recognizer 380) by event dispatcher module 374.Wrapping In the embodiment for including life event identifier determining module 373, event dispatcher module 374 by event information be delivered to by 373 definite event identifier of life event identifier determining module.In some embodiments, event dispatcher module 374 Event information is stored in event queue, which is retrieved by corresponding event receiver 382.
In some embodiments, operating system 326 includes event classifier 370.Alternatively, application program 340-1 bags Include event classifier 370.In still another embodiment, event classifier 370 is standalone module, or is stored in and deposits A part for another module (such as, contact/motion module 330) in reservoir 302.
In some embodiments, application program 340-1 includes multiple button.onreleases 390 and one or more should With Views 391, wherein each application view include being used for handling occur application program user interface it is corresponding The instruction of touch event in view.Each application view 391 of application program 340-1 includes one or more events Identifier 380.In general, application view 391 includes multiple event recognizers 380.In other embodiments, event is known One or more of other device 380 event recognizer is a part for standalone module, the standalone module such as user interface tool The object of bag (not shown) or application program the 340-1 therefrom higher level of inheritance method and other attributes.In some embodiment party In case, corresponding event processing routine 390 includes one or more of the following：Data update device 376, object renovator 377th, GUI renovators 378, and/or the event data 379 received from event classifier 370.Button.onrelease 390 is optionally Using or call data update device 376, object renovator 377 or GUI renovators 378 come more new application internal state 392.Alternatively, one or more of application view 391 includes one or more corresponding event processing routines 390.Separately Outside, in some embodiments, one or more of data update device 376, object renovator 377 and GUI renovators 378 It is included in application view 391.
Corresponding event recognizer 380 receives event information (for example, event data 379) from event classifier 370, and And from event information identification events.Event recognizer 380 includes Event receiver 382 and event comparator 384.In some realities Apply in scheme, event recognizer 380 further includes metadata 383 and event delivery instruction, and 388 (it optionally includes subevent and passs Send instruction) at least one subset.
Event receiver 382 receives event information from event classifier 370.Event information is included on subevent for example Touch or touch mobile information.According to subevent, event information further includes additional information, the position of such as subevent.Group When event is related to the movement of touch, event information optionally further includes speed and the direction of subevent.In some embodiments In, event includes equipment and rotates to another orientation (for example, rotate to horizontal orientation from machine-direction oriented, or instead from an orientation It is as the same), and event information includes the corresponding informance of the current orientation (also referred to as equipment posture) on equipment.
Compared with event comparator 384 defines event information with predefined event or subevent, and it is based on being somebody's turn to do Compare, determine event or subevent, or the definite or state of update event or subevent.In some embodiments, event ratio Include event compared with device 384 and define 386.Event defines 386 and includes the definition (for example, predefined subevent sequence) to event, Such as event 1 (387-1), event 2 (387-2), and other events.In some embodiments, the sub- thing in event 387 Part for example starts including touch, touches and terminate, touch mobile, touch cancellation and multiple point touching.In one example, event 1 The definition of (387-1) is the double-click on shown object.For example, double-click the predetermined duration included on shown object First time touch (touch starts), first time for predefining duration is lifted away from (touch terminates), advance on shown object Determine second of touch (touch starts) of duration and being lifted away from for the second time (touch terminates) for predetermined duration.Another In a example, the definition to event 2 (387-2) is the dragging on shown object.For example, dragging is included on shown object Predetermined duration touch (or contact), the shifting touched on display system 312 (when it is touch-sensitive display) It is dynamic and touch to be lifted away from (touch terminates).In some embodiments, event is further included for one or more associated Button.onrelease 390 information.
In some embodiments, event, which defines 387, includes the definition to the event for respective user interfaces object. In some embodiments, event comparator 384 performs hit test, to determine which user interface object and subevent phase Association.For example, in application view (three user interface objects are shown wherein on display system 312), when aobvious Show that event comparator 384 performs hit test, with true when detecting touch in device system 312 (when it is touch-sensitive display) Which of these three fixed user interface objects user interface object is associated with touching (subevent).If each show Show that object is associated with corresponding event processing routine 390, then which event comparator determines using the result that the hit is tested Button.onrelease 390 should be activated.For example, the selection of event comparator 384 and subevent and pair of triggering hit test As associated button.onrelease.
In some embodiments, the definition of corresponding event 387 further includes delay voltage, delay voltage delay event The delivering of information, until having determined that whether subevent sequence exactly corresponds to or do not correspond to the event type of event recognizer.
When corresponding event identifier 380 determines that any event that subevent series is not defined with event in 386 matches, 380 entry event of corresponding event identifier is impossible, event fails or event done state, ignores after this based on tactile The follow-up subevent for the gesture touched.In this case, for hit view holding activity other event recognizers (if If having) continue to track and handle the subevent of the gesture based on touch of lasting progress.
In some embodiments, corresponding event identifier 380 includes having how instruction event delivery system should be held Configurable attribute, mark, and/or the metadata of list 383 that row is delivered to the subevent of the event recognizer of active participation. In some embodiments, metadata 383 includes how instruction event recognizer interacts each other or what is how interacted matches somebody with somebody Put attribute, mark and/or list.In some embodiments, metadata 383 includes whether instruction subevent is delivered to view Or configurable attribute, mark and/or the list of the different levels in sequencing hierarchy.
In some embodiments, when one or more specific subevents of event are identified, corresponding event identifier The 380 activation button.onrelease 390 associated with event.In some embodiments, corresponding event identifier 380 will be with The event information that the event is associated is delivered to button.onrelease 390.Button.onrelease 390 is activated to be different from sub- thing Part sends (and delaying to send) to corresponding hit view.In some embodiments, event recognizer 380 is dished out with being identified The mark that is associated of event, and the button.onrelease 390 associated with the mark obtains the mark and performs predetermined The process of justice.
In some embodiments, event delivery instruction 388 includes event information of the delivering on subevent without swashing The subevent delivery instructions of button.onrelease living.On the contrary, event information is delivered to and subevent system by subevent delivery instructions The associated button.onrelease of row or the view for being delivered to active participation.View with subevent series or with active participation Associated button.onrelease receives event information and performs predetermined process.
In some embodiments, data update device 376 creates and updates the data used in application program 340-1. For example, data update device 376 stores the video file used by media player module 344.In some embodiments, it is right As renovator 377 creates and update the object used by application program 340-1.For example, object renovator 376 creates new user Interface object or the position for updating user interface object.GUI renovators 378 update GUI.For example, GUI renovators 378 prepare to show Show information and send it to figure module 332 for being shown in display system 312 (for example, display portion 110 Basic display unit 102, Figure 1A, and/or dynamic function row 104, Figure 1A-Figure 1B) on.
In some embodiments, one or more button.onreleases 390 include data update device 376, object updates Device 377 and GUI renovators 378 or with access to data renovator 376, object renovator 377 and GUI renovators 378 Authority.In some embodiments, data update device 376, object renovator 377 and GUI renovators 378 are included in application In program 340-1 or the individual module of application view 391.In other embodiments, they be included in two or In more software modules.
It should be appreciated that apply also for utilizing on the discussed above of event handling that the user on touch-sensitive display touches Input equipment inputs to operate the user of the other forms of electronic equipment 300, and not all user's input is all in touch-screen Upper initiation.For example, optionally with single or multiple keyboard pressings or the mouse movement of combination and mouse button is kept to press； Contact movement on touch pad, touch, dragging, rolling etc.；Stylus inputs；The movement of equipment；Spoken command；Detected The eyes movement arrived；Biological characteristic inputs；And/or its any combination is optionally used as the son with defining the event to be identified The corresponding input of event.
Fig. 4 shows the block diagram of the peripheral electronic device 400 according to some embodiments.In some embodiments, it is peripheral Electronic equipment 400 is peripheral input and output device, it by dynamic function row 104 and is physically entered mechanism at least in part, all If one group of secondary or physical bond (for example, one group of secondary or physical bond 106, Fig. 2A-Fig. 2 B) and/or touch pad are (for example, touch pad 108, Fig. 2 B- figures 2C) it is included in same enclosure.The example of peripheral electronic device 400 includes：Peripheral keyboard is (for example, peripheral keyboard 206, figure 2A- Fig. 2 B), peripheral touch sensitive surface (for example, the first peripheral input mechanism 212, Fig. 2 C) or other peripheral input mechanisms (for example, Second peripheral input mechanism 222, Fig. 2 D).Peripheral electronic device 400 and computing device 202 (Fig. 2A-Fig. 2 D) are communicatively coupled. For example, peripheral electronic device 400 uses communication protocols via wired connection, such as USB or PS/2, or via wireless communication link It is communicatively coupled with computing device 202 to discuss bluetooth, Wi-Fi etc..Peripheral electronic device 400 can be dependent on electronic equipment Component in 300 (Fig. 3 A) or during some, or these components or during some can be by peripheral electronic device 400 rather than electronic equipment 300 complete, in peripheral electronic device 400 rather than electronic equipment 300, or by peripheral electricity Sub- equipment 400 rather than electronic equipment 300 accommodate.
In some embodiments, including memory 402, (it optionally includes one or more to peripheral electronic device 400 Computer-readable recording medium), Memory Controller 422, one or more processing unit (CPU) 420, peripheral interface 418th, RF circuits 408, voicefrequency circuit 410, loudspeaker 411, microphone 413, input/output (I/O) subsystem 406, other are defeated Enter or one or more of control device 416 and outside port 424.Peripheral electronic device 400 includes touch-sensitive display system 412 (for example, dynamic function row 104, Fig. 2A-Fig. 2 D) that unite (are otherwise referred to as " touch-sensitive display ", " touch-screen " herein Or " touch-screen display ").
Peripheral electronic device 400 is optionally included for detecting touch sensitive surface such as touch-sensitive display system 412 or touching One or more intensity sensors 465 of the intensity of contact on plate (for example, touch pad 108, Fig. 2 B- Fig. 2 C).Peripheral electron Equipment 400 optionally includes one or more tactile output generators 467, in touch sensitive surface such as touch-sensitive display Tactile output is generated in system 412 or touch pad (for example, touch pad 108, Fig. 2 B- Fig. 2 C).These components are optionally by one A or multiple communication bus or signal wire 403 communicate.
Memory 402 optionally includes high-speed random access memory, and also optionally includes non-volatile memories Device, such as one or more disk storage equipment, flash memory device or other non-volatile solid state memory equipment.Outside The miscellaneous part (such as one or more CPU 420 and peripheral interface 418) of electronic equipment 400 is enclosed to memory 402 Access is optionally controlled by Memory Controller 422.Peripheral interface 418 can be used for one or more 420 Hes of CPU Memory 402 is couple to I/O subsystems 406 and other circuits.One or more processing units 420, which run or perform, to be stored Various software programs and/or instruction set in memory 402, to perform the various functions of peripheral electronic device 400 and processing Data.In some embodiments, peripheral interface 418, one or more CPU 420 and Memory Controller 422 are appointed Selection of land is such as realized in one single chip on chip 404.In some other embodiments, they are by optionally in independent core On piece is realized.
RF (radio frequency) circuit 408 receives and sends the RF signals of also referred to as electromagnetic signal.RF circuits 408 are by electric signal Be converted to electromagnetic signal/by electromagnetic signal and be converted to electric signal, and come and communication network and other are logical via electromagnetic signal Letter equipment communicates.RF circuits 408 optionally include the well known circuit for performing these functions, include but not limited to Antenna system, RF transceivers, one or more amplifier, tuner, one or more oscillators, digital signal processor, CODEC chipsets, subscriber identity module (SIM) card, memory etc..Wireless communication is optionally using a variety of communication standards, association Any one of negotiation technology, include but not limited to near-field communication (NFC), bluetooth, Wireless Fidelity (Wi-Fi) (for example, IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and/or IEEE 802.11n), Wi-MAX or any other conjunction Suitable communication protocol, be included in this document submission date also it is untapped go out communication protocol.
Optional voicefrequency circuit 410, loudspeaker 411 and microphone 413 is provided between user and peripheral electronic device 400 Audio interface.Voicefrequency circuit 410 receives voice data from peripheral interface 418, and voice data is converted into electric signal, And by the electric signal transmission to loudspeaker 411.Loudspeaker 411 converts electrical signals to the audible sound wave of the mankind.Voicefrequency circuit 410 also receive the electric signal changed by microphone 413 from sound wave.Voicefrequency circuit 410 converts electrical signals to voice data, and Voice data is transferred to peripheral interface 418, for processing.Voice data is optionally by peripheral interface 418 It is retrieved from and/or is transmitted to memory 402 and/or RF circuits 408.In some embodiments, voicefrequency circuit 410 further includes Earphone jack.Earphone jack provides the interface between voicefrequency circuit 410 and removable audio input/output ancillary equipment, should The earphone or there is output (for example, single head-receiver or double that removable audio input/output ancillary equipment such as only exports Ear earphone) and input both (for example, microphone) headset.
I/O subsystems 406 are by the input/output ancillary equipment of peripheral electronic device 400 such as touch-sensitive display system 412 (for example, dynamic function row 104, Fig. 2A-Fig. 2 D) are couple to peripheral interface 418.I/O subsystems 406 optionally wrap Display controller 456, intensity sensor controller 459, tactile feedback controller 461 are included, and for other inputs or control One or more input controllers 460 of equipment 416.Other one or more input controllers 460 are from other inputs or control Equipment 416 receive electric signal/by electric signal be sent to other input or control device 416.Other inputs or control device 416 Optionally include physical button (for example, pushing button, rocker buttons etc.), dial, slide switch, control stick, click wheel, One group of secondary or physical bond, touch pad etc..
Touch-sensitive display system 412 (for example, dynamic function row 104, Fig. 2A-Fig. 2 D) is in peripheral electronic device 400 and uses Input/output interface is provided between family.Touch-sensitive display (TSD) controller 456 receives electricity from touch-sensitive display system 412 Signal and/or electric signal is sent to touch-sensitive display system 412.Touch-sensitive display system 412 shows that vision is defeated to user Go out.Visual output optionally includes figure, text, icon, video and any combination of them (being collectively referred to as " figure "). In some embodiments, the visual output of some visual outputs or whole corresponds to user interface object/element.
Touch-sensitive display system 412 (for example, dynamic function row 104, Fig. 2A-Fig. 2 D) includes being based on tactile and/or sense of touch Contact to receive the touch sensitive surface, sensor or sensor group of input from the user.Therefore, touch-sensitive display system 412 Touch-sensitive display is detected with TSD controllers 456 (together with any associated module and/or instruction set in memory 402) Contact (and any movement or interruption of the contact) in system 412, and by the contact detected be converted to for select or The user interface object being displayed in touch-sensitive display system 412 is controlled (for example, one or more soft keys, icon, webpage Or image) signal.In an exemplary embodiment, the contact point pair between touch-sensitive display system 412 and user should In the region contacted with the finger of user of touch-sensitive display system 412.
Touch-sensitive display system 412 (for example, dynamic function row 104, Fig. 2A-Fig. 2 D) optionally uses LCD (liquid crystals Show device) technology, LPD (light emitting polymer displays) technology, LED (light emitting diode) technologies or OLED (organic light-emitting diodes Pipe) technology, but other Display Techniques are used in other embodiments.Touch-sensitive display system 412 and TSD controllers 456 are appointed Selection of land using currently known or later any technology by a variety of touch-sensing technologies developed and other approach The other elements of sensor array or the one or more points for determining to contact with touch-sensitive display system 412 contact to detect And its any movement or interruption, a variety of touch-sensing technologies are including but not limited to capacitive, it is resistive, infrared ray, And surface acoustic wave technique.In an exemplary embodiment, using projection-type mutual capacitance detection technology, such as in Apple Inc. (Cupertino, California)WithPresent in skill Art.
Touch-sensitive display system 412 (for example, dynamic function row 104, Fig. 2A-Fig. 2 D) optionally has more than 400dpi The video resolution of (for example, 500dpi, 800dpi or bigger).In some embodiments, user uses stylus, finger etc. Contacted with touch-sensitive display system 412.In some embodiments, user interface, which is designed to mainly use, is based on finger Contact and gesture work.
In some embodiments, in addition to touch-sensitive display system 412, peripheral electronic device 400 optionally includes Touch pad (for example, touch pad 108, Fig. 2 B- Fig. 2 C).In some embodiments, touch pad is peripheral electronic device 400 Touch sensitive regions, the touch sensitive regions are different from touch-sensitive display system 412, it does not show visual output.In some embodiments In, touch pad is optionally the touch sensitive surface separated with touch-sensitive display system 412, or by touch-sensitive display system 412 The extension of the touch sensitive surface of formation.
Peripheral electronic device 400 further includes the electric system 462 for powering for various parts.Electric system 462 is optional Ground includes electric power management system, one or more power supplys (for example, battery, alternating current (AC) etc.), recharging system, electric power event Hinder detection circuit, power converter or inverter, power supply status indicator (for example, light emitting diode (LED)) and with it is portable Any other component that generation, management and the distribution of electric power in formula equipment are associated.
Peripheral electronic device 400 is optionally further included to be coupled with the intensity sensor controller 459 in I/O subsystems 406 One or more contact strength sensors 465.One or more contact strength sensors 465 optionally include one or more A piezoresistive strain instrument, capacitive force transducer, electric force snesor, piezoelectric force transducer, optics force snesor, condenser type Touch sensitive surface or other intensity sensors are (for example, the sensing of the power (or pressure) for measuring the contact on touch sensitive surface Device).Contact strength sensor 465 receives contact strength information (for example, pressure information or pressure information is alternative from environment Thing).In some embodiments, at least one contact strength sensor and touch sensitive surface are (for example, touch-sensitive display system 412 And/or touch pad 108, Fig. 2 B- Fig. 2 C) Alignment or neighbouring.
Peripheral electronic device 400 optionally further includes what is coupled with the tactile feedback controller 461 in I/O subsystems 406 One or more tactile output generators 467.One or more tactile output generators 467 optionally include one or more Electroacoustic equipment such as loudspeaker or other acoustic components；And/or for converting the energy into the electromechanical equipment of linear movement such as Motor, solenoid, electroactive polymerizer, piezo-activator, electrostatic actuator or other tactiles output generating unit (for example, Convert the electrical signal to the component of the tactile output in equipment).One or more contact strength sensors 465 are from touch feedback Module 433 receives touch feedback generation instruction, and generates the tactile that can be sensed by the user of peripheral electronic device 400 Output.In some embodiments, at least one tactile output generator and touch sensitive surface are (for example, touch-sensitive display system 412 and/or touch pad 108, Fig. 2 B- Fig. 2 C) Alignment or neighbouring, and optionally by vertically (for example, to the periphery The surface inside/outside of electronic equipment 400) or laterally (for example, in the plane identical with the surface of peripheral electronic device 400 Rearwardly and a forwardly) mobile touch sensitive surface exports to generate tactile.
In some embodiments, the software part being stored in memory 402 includes operating system 426, communication mould Block 428 (or instruction set), contact/motion module 430 (or instruction set) and dynamic function row module 450 (or instruction set). In addition, in some embodiments, 402 storage device status 457 of memory, the equipment state includes dispaly state, it is indicated What view or other information occupy each of touch-sensitive display system 412 (for example, dynamic function row 104, Fig. 2A-Fig. 2 D) Region.
Operating system 426 includes various software parts and/or driver for controlling and managing general system task (for example, the control of memory management, storage device, power management etc.), and be conducive between each hardware and software component Communication.
Communication module 428 be conducive to by one or more outside ports 424 and/or RF circuits 408 come with other equipment (for example, computing device 202, Fig. 2A-Fig. 2 D) communicates, and further includes various software parts for via RF circuits 408 and/or outside port 424 send/receive data.Outside port 424 (for example, Universal Serial Bus (USB), firewire etc.) Suitable for being directly coupled to other equipment or being coupled indirectly by network (for example, internet, Wireless LAN etc.).
Contact/motion module 430 is optionally detected with touch-sensitive display system 412 and other touch-sensitive devices (for example, touching Template or physics click wheel) contact.Contact/motion module 430 includes various software parts for performing with contacting detection Relevant various operations, such as to determine that whether being in contact (for example, detection finger down event), having determined the intensity of contact (for example, contact power or pressure, or contact power or pressure substitute), determine whether there is contact movement and with Whether track has stopped across the movement (for example, the one or more finger drag events of detection) of touch sensitive surface and definite contact (for example, detection digit up event or contact disconnect).Contact/motion module 430 receives contact data from touch sensitive surface. Determine that the movement of contact point optionally includes the speed (value) of definite contact point, speed (value and direction) and/or acceleration (change in value and/or direction), the movement of the contact point are represented by a series of contact data.These operations are optionally answered Contacted at the same time (for example, " multiple point touching "/more abutments) for single-contact (for example, single abutment) or multiple spot.One In a little embodiments, contact/motion module 430 also detects the contact on touch pad (for example, touch pad 108, Fig. 2 B- Fig. 2 C).
In some embodiments, contact/motion module 430 determines behaviour using one group of one or more intensity threshold Make to be performed (for example, determining whether user has selected or " click " is shown and can be represented) by user whether.In some embodiments In, determine at least one subset of intensity threshold (for example, intensity threshold is not by specific physical actuation device according to software parameter Activation threshold determine, and can be adjusted in the case where not changing the physical hardware of electronic equipment 400).For example, In the case of not changing Trackpad or touch-screen display hardware, mouse " click " threshold value of Trackpad or touch-screen can be set It is fixed into predefined threshold value it is a wide range of in any one threshold value.In addition, in some specific implementations, carried to the user of equipment For for adjust one or more of one group of intensity threshold intensity threshold (for example, by adjust each intensity threshold and/or Carry out the multiple intensity thresholds of Primary regulation by using the system-level click to " intensity " parameter) software design patterns.
Contact/motion module 430 optionally detects the gesture input carried out by user.Different gestures on touch sensitive surface With different contact patterns (for example, the different motion of detected contact, timing, and/or intensity).Therefore, optionally By detecting specific contact patterns come detection gesture.For example, detection finger tapping down contact includes detecting finger down event, so Afterwards hand is detected at position (or the substantially the same position) place (for example, picture mark position at) identical with finger down event Finger lifts and (is lifted away from) event.And for example, finger is detected on touch sensitive surface and gently sweeps gesture including detecting finger down event, then The one or more finger drag events of detection, and then also detection finger lifts and (is lifted away from) event in some embodiments.
Haptic feedback module 433 includes being used for the various software parts for generating instruction, and the instruction is by one or more tactiles Output generator 467 uses, so as in response to user with interacting for peripheral electronic device 400 and in peripheral electronic device 400 One or more positions produce tactile output.
Dynamic function row (DFR) module 450 includes：Focus obtains module 451, DFR determining modules 452 and DFR and mould is presented Block 453.In some embodiments, focus obtains module 451 and is configured as being lived from computing device 202 (Fig. 2A-Fig. 2 D) The instruction of dynamic user interface element, the active user interface element are shown in peripheral display equipment 204 (Fig. 2A-Fig. 2 D) Basic display unit 102 on graphic user interface current focus.In some embodiments, DFR determining modules 452 by with It is set to based on the active user interface element in current focus to determine figure (for example, one group of one or more shows energy table Show).Alternatively, computing device 202 (Fig. 2A-Fig. 2 D) determines figure (example based on the active user interface element in focus Such as, one group of one or more, which is shown, to represent), and figure is supplied to peripheral electronic device 400 or its component (for example, DFR Module 450) for being shown in touch-sensitive display system 412 (for example, dynamic function row 104, Fig. 2A-Fig. 2 D).One In a little embodiments, DFR is presented module 453 and is configured as presenting by touch-sensitive display system 412 (for example, dynamic function row 104, Fig. 2A-Fig. 2 D) on DFR determining modules 452 determine (or being provided by computing device 202) figure.Module is presented in DFR 453 include being used for causing and cause to be graphically displayed at various known software components in touch-sensitive display system 412, including with In the visual impact (for example, brightness, transparency, saturation degree, contrast or other perceptual properties) for changing shown figure Component.In some embodiments, DFR modules 450 include being used for other modules operated below：Adjust dynamic work( Can manage it 104 sensitivity；The sense of hearing provided by dynamic function row 104 and/or touch feedback are provided；Adjustment is by dynamic function row Showing for 104 displays can represent and the setting of information (for example, size, brightness, font, language etc.)；Adjust dynamic function row 104 Current power pattern (for example, normal and low-power mode)；Etc..
In some embodiments, memory 402 includes event classifier 470 (for example, in operating system 426). In some embodiments, event classifier 470 performs the function identical with event classifier 370 (Fig. 3 B), and including event The module of grader 370 (Fig. 3 B), process and the subset of instruction or superset.Therefore, for simplicity, event classifier 470 It will not be described.
It should be appreciated that peripheral electronic device 400 is only example, and peripheral electronic device 400 optionally has than shown The more or fewer components of component gone out, optionally combine two or more components, or optionally have these components Difference configuration or arrangement.Various parts shown in Fig. 4 are in hardware, software, firmware or combinations thereof (including one or more A signal processing circuit and/or application-specific integrated circuit) in implement.
Above-mentioned identified mould is in the block to be each corresponded to be used to perform above-mentioned one or more functions and in this patent Method (for example, computer implemented method described herein and other information processing method) described in application Executable instruction set.These modules (that is, instruction set) need not realize with independent software program, process or module, therefore these Each subset of module is optionally combined or otherwise rearranged in various embodiments.In some embodiments In, memory 402 optionally stores the subgroup of above-mentioned module and data structure.In addition, memory 402 optionally stores above The add-on module and data structure not described.
As used herein, term " focus selector " refers to the user interface just interacted for instruction user Current portions input element.In some specific implementations including cursor or other positions mark, cursor serves as " focus Selector " so that when cursor is at particular user interface element (for example, button, window, sliding block or other users interface element) During top input (example is detected on touch sensitive surface (for example, touch sensitive surface 451 in touch pad 355 or Fig. 4 in Fig. 3) Such as, pressing input) in the case of, which is conditioned according to detected input.Including making It must can realize some specific realities with the touch-screen display of the direct interaction of the user interface element on touch-screen display Shi Zhong, on the touchscreen detected contact are served as " focus selector " so that when on touch-screen display in specific use Detect input (for example, logical at the position of family interface element (for example, button, window, sliding block or other users interface element) Cross the pressing input of contact) when, which is conditioned according to detected input.It is specific at some In implementation, focus is moved to another region of user interface from a region of user interface, and corresponding without cursor is moved The movement of contact dynamic or on touch-screen display is (for example, by using Tab key or arrow key by focus from a button It is moved to another button)；In these specific implementations, focus selector is according to Jiao between the different zones of user interface Point is mobile and moves.The concrete form taken without considering focus selector, focus selector be typically by user's control so as to Transmission with the user of user interface is desired interacts (for example, being carried out by user's expectation to equipment indicative user interface with it Interactive element) user interface element (or contact on touch-screen display).For example, in touch sensitive surface (for example, touching Plate or touch-screen) on detect pressing input when, focus selector (for example, cursor, contact or choice box) is on the corresponding button Instruction user it is expected to activate the corresponding button (rather than other users Interface Element shown on the display of equipment in the position of side Element).
As used in the present specification and claims, " intensity " of the contact on term touch sensitive surface refers to The power or pressure (power of per unit area) of contact (for example, finger contact or stylus contact) on touch sensitive surface, or finger touch The power of contact on sensitive surfaces or the substitute (surrogate) of pressure.The intensity of contact has value scope, which is included extremely Lack four different values and more typically include up to a hundred different values (for example, at least 256).The intensity of contact is optional Ground is determined (or measurement) using the combination of various methods and various sensors or sensor.For example, touch sensitive surface lower section or phase Adjacent to touch sensitive surface one or more force snesors optionally for measurement touch sensitive surface on difference at power.One In a little specific implementations, the power measurement from multiple force snesors is merged (for example, weighted average or adduction), to determine to estimate The contact force of meter.Similarly, pressure of the pressure-sensitive top of stylus optionally for definite stylus on touch sensitive surface.Alternatively, The size of the contact area detected on touch sensitive surface and/or its change, contact near touch sensitive surface capacitance and/or The resistance for the touch sensitive surface that it changes and/or contact is neighbouring and/or its change are optionally used as connecing on touch sensitive surface Tactile power or the substitute of pressure.Some specific implementation in, the substitute measurement of contact force or pressure be directly used in determine be It is no to already exceed intensity threshold (for example, intensity threshold is described with the unit that is measured corresponding to substitute).It is specific real at some The substitute measurement of Shi Zhong, contact force or pressure is converted into the power or pressure of estimation, and the power or pressure estimated are used for really It is fixed whether to have exceeded intensity threshold (for example, intensity threshold is with the pressure threshold of the unit measurement of pressure).Use contact Intensity allows user to access user for showing energy table (for example, on the touch sensitive display) as attribute input by user Show and/or receive user's input (for example, via touch-sensitive display, touch sensitive surface or physical control/machinery control such as knob Or button) limited area on the spot smaller equipment on the optional equipment function that cannot easily access originally.
In some embodiments, contact/motion module 130 determines behaviour using one group of one or more intensity threshold Make to be performed (for example, determining that whether user " clicks on " icon) by user whether.In some embodiments, according to software Parameter come determine at least one subset of intensity threshold (for example, intensity threshold not by the activation threshold of specific physical actuation device Lai Determine, and can be adjusted in the case where not changing the physical hardware of portable computing system 100).For example, do not changing In the case of Trackpad or touch-screen display hardware, mouse " click " threshold value of Trackpad or touch-screen display can be set It is fixed into predefined threshold value it is a wide range of in any one threshold value.In addition, in some specific implementations, carried to the user of equipment For for adjust one or more of one group of intensity threshold intensity threshold (for example, by adjust each intensity threshold and/or Carry out the multiple intensity thresholds of Primary regulation by using the system-level click to " intensity " parameter) software design patterns.
As used in the specification and in the claims, " characteristic strength " of contact this term refers to based on contact The feature of the contact of one or more intensity.In some embodiments, characteristic strength is based on multiple intensity samples.Feature is strong Degree is optionally based on (for example, after contact is detected, before detecting that contact is lifted, to be examined relative to predefined event Measure contact start movement before or after, before detecting that contact terminates, detect contact intensity increase before or Afterwards and/or detect contact intensity reduce before or after) in the predetermined period (for example, 0.05 Second, 0.1 second, 0.2 second, 0.5 second, 1 second, 2 seconds, 5 seconds, 10 seconds) during sampling predefined quantity intensity sample or one group strong Spend sample.The characteristic strength of contact is optionally based on one or more of the following：The maximum of contact strength, contact The average of intensity, the average value of contact strength, contact strength preceding 10% at value, half maximum of contact strength, contact it is strong 90% maximum of degree etc..In some embodiments, determine characteristic strength when using contact duration (for example, When characteristic strength is the average value of the intensity of contact in time).In some embodiments, by characteristic strength and one group One or more intensity thresholds are compared, to determine whether executed operates user.For example, the group one or more intensity Threshold value may include the first intensity threshold and the second intensity threshold.In this example, contact of the characteristic strength not less than first threshold Causing the first operation, contact of the characteristic strength more than the first intensity threshold but not less than the second intensity threshold causes the second operation, And the contact that characteristic strength exceedes second threshold causes the 3rd operation.In some embodiments, using characteristic strength and Comparison between one or more intensity thresholds come determine whether to perform one or more operations (such as, if perform corresponding Option is abandoned performing corresponding operating), rather than for determining to perform the first operation or the second operation.
In some embodiments, identify a part for gesture for definite characteristic strength.For example, touch sensitive surface can Reception continuously gently sweeps contact, this, which is continuously gently swept, contacts from initial position transition and reach end position and (such as drag hand Gesture), at the end position, the intensity increase of contact.In this example, the characteristic strength contacted at end position can be only Based on the part for continuously gently sweeping contact, rather than contact is entirely gently swept (for example, gently sweeping contact site only at end position Point).In some embodiments, the intensity application smoothing that gesture can be gently swept in the forward direction for the characteristic strength for determining contact is calculated Method.For example, the smoothing algorithm optionally includes one or more of the following：Sliding average smoothing is not weighted to calculate Method, triangle smoothing algorithm, median filter smoothing algorithm, and/or exponential smoothing algorithm.In some cases, for Determine the purpose of characteristic strength, these smoothing algorithms eliminate light narrow spike or the depression swept in the intensity of contact.
In some embodiments, determine whether specific input is full using one or more predefined intensity thresholds Standard of the foot based on intensity.For example, one or more predefined intensity thresholds include (i) contact detection intensity threshold value IT0、 (ii) light press intensity threshold ITL, (iii) pressing intensity threshold IT deeplyD(for example, it is at least initially higher than IL), and/or (iv) Other one or more intensity thresholds are (for example, be less than ILIntensity threshold IH).In some embodiments, flicking Compressive Strength threshold Value corresponds to such intensity：Under the intensity, equipment by perform usually with click on physics mouse button or Trackpad phase Associated operation.In some embodiments, deep pressing intensity threshold corresponds to such intensity：Under the intensity, equipment will Perform the operation different from operation usually associated with the button of click physics mouse or Trackpad.In some embodiments In, when detecting characteristic strength less than light press intensity threshold (for example, and being higher than Nominal contact detection intensity threshold value IT0, The contact lower than Nominal contact detection intensity threshold value is no longer detected) contact when, equipment will according to contact in touch sensitive surface On movement carry out moving focal point selector, without performing and light press intensity threshold or the deep behaviour that to press intensity threshold associated Make.In general, unless otherwise stated, otherwise these intensity thresholds are consistent between different groups of user interface attached drawing.
In some embodiments, response of the equipment to the input detected by equipment is depended on based on during input The standard of contact strength.For example, inputted for some " light press ", more than the contact of the first intensity threshold during input The first response of intensity triggering.In some embodiments, equipment as the response of the input detected by equipment to being depended on including The standard of contact strength and time-based both criteria during input.For example, for some " deep to press " inputs, as long as Meeting the first intensity threshold and meeting to pass through time delay between the second intensity threshold, flicking is exceeded more than during input The intensity of the contact of second intensity threshold of the first intensity threshold of pressure just triggers the second response.The time delay it is lasting when Between typically smaller than 200ms (for example, 40ms, 100ms or 120ms, this depends on the value of the second intensity threshold, and wherein this prolongs The slow time is as the second intensity threshold increases and increases).The time delay helps prevent unexpected deep pressing input.And for example, it is right In some " deep pressing " inputs, the period of susceptibility reduction is will appear from after the first intensity threshold is reached.In the sensitivity During spending the period reduced, the second intensity threshold is improved.This temporarily increase of second intensity threshold, which additionally aids, to be avoided anticipating Outer deep pressing input.For other pressing inputs deeply, the response to detecting deep pressing input is not dependent on time-based mark It is accurate.
In some embodiments, one or more of input intensity threshold value and/or corresponding output are based on one or more A factor (such as, user setting, contact movement, incoming timing, application program operation, speed when applying intensity while defeated The quantity that enters, user's history, environmental factor (for example, ambient noise), focus selector position etc. and change.It is exemplary because Element is described in U.S. Patent Application Serial Number 14/399,606 and 14/624,296, these U.S. Patent applications are in full It is herein incorporated by reference.
For example, Fig. 3 C show that to be based in part on the dynamic that touch input 476 is changed over time with the intensity of time strong Spend threshold value 480.Resistance to vibration threshold value 480 is the summation of two components：Since being initially detected touch input 476 The strong of touch input 476 is tracked after predefined time delay p1 with the first component 474 of time decay and with the time The second component 478 of degree.The initial high intensity threshold value of first component 474 reduces unexpected triggering " deep pressing " response, while still Allow to carry out " deep pressing " response immediately in the case where touch input 476 provides sufficient intensity.Second component 478 reduces logical Cross the gradual strength fluctuation of touch input and inadvertent free " deep pressing " response.In some embodiments, in touch input 476 when meeting resistance to vibration threshold value 480 (for example, point 481 at) in fig. 3 c, triggering " deep pressing " response.
Fig. 3 D show another resistance to vibration threshold value 486 (for example, intensity threshold ID).Fig. 3 D also show two its His intensity threshold：First intensity threshold IHWith the second intensity threshold IL.In Fig. 3 D, although touch input 484 time p2 it The first intensity threshold I of preceding satisfactionHWith the second intensity threshold IL, but do not respond to be provided, prolong until passing through at the time 482 Slow time p2.In addition, in fig. 3d, resistance to vibration threshold value 486 decays with the time, wherein decay from the time 482 (when touching Hair and the second intensity threshold ILDuring associated response) start by the time 488 after predefined time delay p1.This The resistance to vibration threshold value of type is reduced immediately in triggering and lower threshold intensity (such as the first intensity threshold IHOr second intensity Threshold value IL) associated response surprisingly triggers afterwards or simultaneously and resistance to vibration threshold value IDAssociated response.
Fig. 3 E show another resistance to vibration threshold value 492 (for example, intensity threshold ID).In fig. 3e, defeated from touching Enter 490 by initial detecting to after having been subjected to time delay p2, triggering and intensity threshold ILAssociated response.Meanwhile dynamic Intensity threshold 492 is from touch input 490, just the beginning is detected to have been subjected to and decayed after predefined time delay p1.Therefore, In triggering and intensity threshold ILReduce the intensity of touch input 490 after associated response, then increase touch input 490 Intensity without discharge can trigger with intensity threshold IDThe touch input 490 (for example, in time 494) of associated response, Intensity even in touch input 490 is less than another intensity threshold such as intensity threshold ILWhen be also such.
The characteristic strength of contact is from less than light press intensity threshold ITLIntensity increase between light press intensity threshold ITLWith deep pressing intensity threshold ITDBetween intensity be sometimes referred to as " light press " input.The characteristic strength of contact is from less than depth Press intensity threshold ITDIntensity increase to above deep pressing intensity threshold ITDIntensity be sometimes referred to as " deep pressing " input.Connect Characteristic strength is touched from less than contact detection intensity threshold value IT0Intensity increase between contact detection intensity threshold value IT0With flicking Compressive Strength threshold value ITLBetween intensity be sometimes referred to as and detect contact on touch-surface.Contact characteristic intensity from higher than Contact detection intensity threshold value IT0Intensity be decreased below contact detection intensity threshold value IT0Intensity sometimes referred to as detect Contact is lifted from touch-surface.In some embodiments, IT0It is zero.In some embodiments, IT0More than zero at some In diagram, shade circle or the oval intensity for being used to represent the contact on touch sensitive surface.In some diagrams, shadeless circle Or it is oval for representing the corresponding contact on touch sensitive surface, without specifying the intensity of corresponding contact.
Herein in some described embodiments, the gesture or sound of corresponding pressing input are included in response to detecting Ying Yu detects that the corresponding pressing performed using corresponding contact (or multiple contacts) is inputted to perform one or more operations, its In be based at least partially on detect the contact (or multiple contacts) intensity increase to above pressing input intensity threshold value and examine Measure corresponding pressing input.In some embodiments, in response to detecting that it is defeated that the intensity of corresponding contact increases to above pressing Enter intensity threshold to perform corresponding operating (for example, performing corresponding operating on " downward stroke " of corresponding pressing input). In some embodiments, pressing input include corresponding contact intensity increase to above press input intensity threshold value and this connect Tactile intensity is decreased subsequently to less than pressing input intensity threshold value, and in response to detecting that the intensity of corresponding contact then subtracts It is small to performing corresponding operating (for example, being performed on " up stroke " of corresponding pressing input corresponding less than pressing input threshold value Operation).
In some embodiments, equipment is lagged using intensity to avoid the accident input sometimes referred to as " shaken ", wherein Equipment limits or selection has the hysteresis intensity threshold of predefined relation with pressing input intensity threshold value (for example, hysteresis intensity threshold Value than the low X volume unit of pressing input intensity threshold value, or lag intensity threshold be pressing input intensity threshold value 75%, 90% or some rational proportion).Therefore, in some embodiments, pressing input includes the intensity of corresponding contact and increases to height It is decreased subsequently to be less than in the intensity of pressing input intensity threshold value and the contact and corresponds to the stagnant of pressing input intensity threshold value Intensity threshold afterwards, and in response to detecting that the intensity of corresponding contact is decreased subsequently to perform phase less than hysteresis intensity threshold It should operate (for example, performing corresponding operating on " up stroke " of corresponding pressing input).Similarly, in some embodiments In, only detected in equipment the intensity of contact from the intensity equal to or less than hysteresis intensity threshold increase to equal to or higher than by When the intensity pressed the intensity of input intensity threshold value and optionally contacted is decreased subsequently to be equal to or less than the intensity of hysteresis intensity Just detect pressing input, and in response to detecting pressing input (for example, according to environment, the intensity of contact increases or connects Tactile intensity reduces) perform corresponding operating.
In order to easily explain, it is optionally in response to detect situations below and trigger in response to pressing input intensity The pressing input or the description of the operation performed in response to the gesture including pressing input that threshold value is associated：The intensity of contact Increase to above pressing input intensity threshold value, the intensity of contact increases to above pressing from the intensity less than hysteresis intensity threshold The intensity that intensity, the intensity of contact of input intensity threshold value are decreased below pressing input intensity threshold value or contacting is reduced to low In hysteresis intensity threshold corresponding with pressing input intensity threshold value.In addition, describing the operations as in response to detecting contact In the example that intensity is decreased below pressing input intensity threshold value and performs, it is optionally in response to detect that the intensity of contact subtracts It is small to less than corresponding to and perform operation less than the hysteresis intensity threshold of pressing input intensity threshold value.As described above, one In a little embodiments, these triggerings operated are additionally depended on and meet time-based standard (for example, meeting the first intensity Time delay is had been subjected between the second intensity threshold of threshold value and satisfaction).
User interface and associated process
Attention is directed to can be by portable computing system 100 (Figure 1A) or (Fig. 2A-figure of desk-top computing system 200 The user interface (" UI ") and the embodiment of associated procedure 2D) realized.In some embodiments, basic display unit 102 exists Realized in the display portion 110 of portable computing system 100 (Figure 1A).Alternatively, in some embodiments, basic display unit 102 realize in peripheral display apparatus 204 (Fig. 2A-Fig. 2 D).In some embodiments, dynamic function row 104 be The touch-sensitive slave display realized in the main part 120 of portable computing system 100 (Figure 1A-Figure 1B).Alternatively, at some In embodiment, dynamic function row 104 is in peripheral keyboard 206 (Fig. 2A-Fig. 2 B), the first peripheral input mechanism 212 (Fig. 2 C) Or the second touch-sensitive slave display realized in peripheral input mechanism 222 (Fig. 2 D).
Fig. 5 A- Fig. 5 N are the schematic diagrames of the basic display unit and slave display according to some embodiments, it is used to show to use In the exemplary user interface for enabling low visual acuity user to be interacted with touch-sensitive slave display.User in these attached drawings Interface be used to show in method as described below and/or process, including Fig. 6 A- Fig. 6 C, Fig. 7 A- Fig. 7 C and Fig. 8 A- Fig. 8 C Method.It will be appreciated by the skilled addressee that following user interface is only example.In addition, those of ordinary skill in the art It will be understood that can use in practice it is additional show can represent and/or user interface element, or less showing can represent with/ Or user interface element.
Fig. 5 A show basic display unit 102 of the display for the user interface of system preference application program, wherein presenting The Accessibility Options of " enabling touch-control bar scaling ".In addition as shown in Figure 5A, it is shown at touch-sensitive slave display 104 and shows energy Represent be used for activate or control it is associated with the system preference application program being currently displayed at basic display unit 102 specific to The function of application.For example, touch-sensitive slave display includes to represent specific to showing for application, it is used to enable touch-control bar scaling, (be next to system-level " esc " and show that what can be represented shows and can represent) is navigated between menu option；And " all displays " shows energy table Show, it is used for so that basic display unit exits miscellaneous function menu rather than all system preference menu options are presented.Except these Outside specific to the showing and can represent of application, Fig. 5 A also illustrate that touch-sensitive slave display 104 includes being for control system level function Irrespective of size, which shows, can represent 5085-5088 (below with reference to described in method 600).
Fig. 5 A are shown with cursor 504 and enable user's selection of touch-control bar scaling check box (in some embodiments, Basic display unit is also touch-sensitive, and therefore, their finger or stylus can be used to provide input in user, rather than uses Cursor 504).In response to user's selection to check box, then enabling touch-control bar scaling for touch-sensitive slave display 104 can visit Ask pattern (as illustrated for the selected check box at both the basic display unit in Fig. 5 B and touch-sensitive slave display place).In some embodiment party In case, addressable pattern is such operator scheme, wherein activate some features so that with eyesight, hearing, body and The user of technical performance or study and read-write obstacle can interact (i.e., it is allowed to which disabled person is with non-biography with its electronic equipment System mode drives user interface), and during the normal manipulation mode of electronic equipment these special characteristics are unavailable (or can Can be disabled).For example, as described herein, it is the operator scheme for touch-sensitive slave display that touch-control bar scaling, which may have access to pattern, Interaction wherein at touch-sensitive slave display causes to be shown in that showing at touch-sensitive slave display can represent and user interface is put It is big to represent to be presented at basic display unit, so that the low visual acuity user of touch-sensitive slave display can check and show energy with these Represent and user interface interacts.In other words, activate touch-control bar scaling and may have access to the people that pattern allows to have vision disorder The user interface being presented at touch-sensitive slave display is driven in a manner of non-traditional, i.e. by checking the amplification table on basic display unit Show and selection and other inputs are provided at touch-sensitive slave display.In some embodiments, in default situations, touch-control bar It is disabled that scaling may have access to pattern, and must the user interface of use example as shown in figs. 5 a-b activate.
Fig. 5 B are further included using cursor 504 from including that can represent answering for 506-515 for activating showing for various application programs The user of the mail icon 506 is selected with procedures trays 514.Selected in response to the user of the mail icon 506, mail/electronics Then the user interface of mail applications 580 is presented on basic display unit 102 and touch-sensitive slave display 104 be updated with Including corresponding in mail applications 580 the new of available function can represent (for example, showing energy specific to showing for application Represent 5080- 5084).
Fig. 5 C also illustrate user using cursor 504 in the electricity being shown at the user interface of email application 580 Selection text " Everyone " in sub- message body.As shown in Figure 5 D, the text is selected in response to user, text is then in master Be highlighted at display 102, and touch-sensitive slave display be updated to include for manipulate selected text how to present or Display can be represented (for example, 5102,5106 and 5089-5091 can be represented by showing) specific to showing for application.
Fig. 5 D are also shown in the input 5102 at touch-sensitive slave display 104, and input contact, which is shown, can represent 5104, and In response to input 5102, basic display unit is updated can represent that 5104 amplification is represented (for example, amplification table so that showing for contact is presented Show 5204), which represents to show in user interface 5202, it include being shown at slave display 104 other show energy table The amplification shown represents.In addition, focus designator 5206 is presented at user interface 5202, the user interface is oriented to correspond to In the position of the input 5102 at slave display 104.It can be represented and focus designator by providing larger showing, in response to Only single input at slave display 104 so that low visual acuity user can be interacted with touch-sensitive slave display 104 (and Continue to interact with it) (being explained in greater detail below with reference to method 600- 800).
Fig. 5 D are also shown in input 5102 and start when slave display 104 is displaced sideways, and in response, Yong Hujie Other amplifications that face 5202 deviated and showed showing on basic display unit according to the lateral movement and can represent are represented (as schemed Shown in 5E, user interface 5202 is displaced to right side and can be represented with showing that additional amplification is shown).Fig. 5 E show to contact touch-sensitive pair (in response, the second focus designator is presented at amplification user interface 5202, this is put for second input 5103 of display 104 Large user interface is positioned based on the second 5103 position at slave display 104 of input).As shown in Fig. 5 E, input 5102 and second input 5103 offer be provided go pinching gesture, two of which input is across slave display 104 along substantially phase Anti- direction movement, and pinching gesture is gone in response to this, the level of zoom of amplification user interface 5202 increases (such as Fig. 5 F institutes Show).In some embodiments, before pinching gesture is gone in offer, user also presses the key for such as " ordering " key etc, with Via the level of zoom for going pinching gesture modification amplification user interface.
In some embodiments, user can also reduce level of zoom (in Fig. 5 F by providing pinching gesture Shown in input 5102 and 5103), and in response, the level of zoom of amplification user interface 5202 correspondingly reduces (such as Fig. 5 G It is shown).Then Fig. 5 G show to be displaced sideways across slave display 104 and return to the input 5102 in its home position (Fig. 5 H), The input is shown in figure 5d.Fig. 5 H show that user can activate in the following manner and show and can represent 5104：There is provided separately light Hitter's gesture, such as input 5102 is maintained at slave display 104, and in addition instantaneous touch is provided at slave display 104 5106.In response, the appearance of focus designator 5206 can change (Fig. 5 K), and then showing can represent that 5104 and 5204 can be across The sliding block movement that each of which is associated.
Alternatively, Flick gesture is separated instead of providing, user can represent that 5104 holdings are contacted more than predetermined with showing Period (for example, 0.5 second, 0.75 second or 1 second), and in response, the expression of countdown timer 5208 is updated to Counting downwards can represent that 5104 are activated (as shown in Fig. 5 I- Fig. 5 K, wherein falling to count around focus designator 5206 until showing When timer move along clockwise direction, until it expires, and show can represent 5104 and 5204 then it is removable).
As shown in fig. 5l, user then will can show can represent 5104 and 5204 across its corresponding sliding block movement with manipulate with The size text that selected " Everyone " text is associated.For example, will show in user can represent 5104/5204 across sliding block When mobile, the size text of " Everyone " increases (Fig. 5 L) according to the movement dynamically across sliding block.
Turning now to Fig. 5 M, there is provided the additional example of Flick gesture is separated, wherein input 5102 can represent (example with showing Such as, it can represent 5089) to keep contact for showing for the text in overstriking email application, and detect and do not showing It can represent the instantaneous touch 5107 of top.Flick gesture is separated in response to this, and activation, which is transfused to showing for 5102 contacts, to be represented (for example, 5089 can be represented by showing), and perform and show that the function that can represent associated is (selected for example, as shown in Fig. 5 N with this Text " Everyone " look like overstriking now).Fig. 5 N also illustrate that input 5102 is lifted from touch-sensitive slave display 104 From, and in response, amplification expression is no longer presented at basic display unit 102.
The additional description on Fig. 5 A- Fig. 5 N is provided below with reference to method 600-800.
Fig. 6 A- Fig. 6 C are according to some embodiments low visual acuity user to be handed over touch-sensitive slave display The flow chart of mutual method 600.Method 600 performs (602) at computing system, which is included at one or more Device is managed, memory includes the first shell of basic display unit, and includes the touch-sensitive pair different from basic display unit at least in part The second housing of display.Certain operations in method 600 are optionally combined, and/or certain operations order optionally by Change.
In some embodiments, computing system is portable computing system 100 (Figure 1A) or desk-top computing system 200 (Fig. 2A-Fig. 2 D).In some embodiments, basic display unit is the display portion in portable computing system 100 (Figure 1A) The basic display unit 102 (Figure 1A) realized in 110 (referred to herein as the first shell 110, it includes basic display unit 102), and And second housing is the main part 120 of portable computing system 100, and second housing includes touch-sensitive pair at least in part Display (for example, dynamic function row 104, Figure 1A-Figure 1B) and physical keyboard (for example, one group of secondary or physical bond 106) (604).
In some embodiments, second housing is not connected to the first shell (606), for example, because the first shell is the A part and second housing for one equipment is a part for the equipment different from the first equipment (for example, second housing can be A part for mobile phone, tablet device or any other equipment, the other equipment include being shown on smaller slave display Show and can represent, while the other equipment is connected to the computing system for including larger basic display unit).It is unrestricted as one Property example, in some embodiments, second housing is the peripheral keyboard 206 (Fig. 2A-Fig. 2 B) of desk-top computing system 200, It is at least in part comprising touch-sensitive slave display (for example, dynamic function row 104, Fig. 2A-Fig. 2 B) and physical keyboard (for example, one Group secondary or physical bond 106, Fig. 2A-Fig. 2 B).As another example, in some embodiments, second housing is that desk-top calculate is The peripheral input mechanism 212 (Fig. 2 C) of the first of system 200, it is at least in part comprising touch-sensitive slave display (for example, dynamic function Row 104, Fig. 2 C), and second housing includes input mechanism (for example, touch pad 108, Fig. 2 C) without including physical keyboard. As another example, in some embodiments, second housing is a part (608) for wearable computing devices, such as intelligence Can wrist-watch.
As described below, method 600 (and associated interface) enable low visual acuity user and touch-sensitive slave display into Row interaction.As shown in Figure 6A, method 600, which is included on basic display unit, shows that (610) are used for the first user interface of application program (for example, as shown in Figure 5 C, the first user interface for email application is illustrated as being shown in basic display unit 102 On).Method 600 further includes：(612) second user interface is shown on touch-sensitive slave display, which includes control The multiple of available function can be represented specific to showing for application in application program processed, and it is multiple specific to showing for application can table In showing it is each with first display size show.It can represent to control application program specific to showing for application for example, selection is multiple In context-sensitive function, such as user will need to be visited according to their current operations ongoing in the application (all as shown in Figure 5 C multiple can represent that it can be used for sending Email, to electronics specific to showing for application to the function of asking Email message adds emoticon, and the various the Auto-Complete options of selection).In some embodiments or situation, Duo Gete It can represent also based on user with interacting for application program to change (for example, Fig. 5 C show that user makes due to showing for application The text in email message is selected with cursor 504, and in response to the selection of text, is shown in touch-sensitive slave display Multiple in 104 can represent to be updated to include text editing option specific to showing for application, such as by along sliding block 5106 drag it to edit the slider knob 5104 of size text, and for selecting showing for runic, italic and underscore option It can represent 5082- 5084, as shown in Figure 5 D).On show can represent can how based on interaction of the user at basic display unit and The additional detail changed at touch-sensitive slave display and many examples are in jointly owned U.S. Patent application 15/275,298 There is provided, this application is incorporated by reference being incorporated to accordingly.
In some embodiments, and as shown in Figure 5 C, touch-sensitive slave display is further included for activation or control system Level function it is one or more it is system-level show can represent (for example, 5079 can be represented by leaving showing for function for execution, for controlling Showing for the brightness of basic display unit 102 processed can represent 5085, and the showing for volume level for controlling computing system can represent 5086, use In at computing system mute showing can represent 5087, and for controlling or activating via computing system available virtual 5088) showing for people assistant can represent.
In some embodiments, can be via touch-sensitive secondary aobvious specific to each (only) that shows in representing of application Show one or more inputs at device to select (614).In other words, except through being provided at slave display outside input, (multiple any one and any systems for showing in representing specific to application can be selected to show and can represented in any other manner Irrespective of size, which shows, to be represented).In some embodiments, one or more inputs include quick tap, it includes shortly after that light Hit being lifted away from of inputting afterwards；Separately touch (as described below)；And expire the selection thing that occurs afterwards in countdown timer Part (as described below).
Method 600 is further included via touch-sensitive slave display detection (616) with multiple specific in the showing and can represent of application It is at least one specific to application show can represent contact input (for example, showing the input 5102 that can represent at 5104, figure 5D).In response to detect input and input with touch-sensitive slave display keep contact when, method 600 include (618) continuation Display is used for the first user interface of application program (for example, basic display unit, which continues display, is used for Email on basic display unit First user interface of application program), and show on basic display unit and at least one to show that what can be represented puts specific to application It is big to represent (for example, amplification represents 5204).It is at least one to show that the amplification that represented is represented with aobvious more than first specific to application Show that the second display size of size shows that (5204 can be represented with more than showing the display size that can represent 5104 by as shown in Figure 5 D, showing Show).
In some cases, the user (specifically, low visual acuity user) of computing system can not check with small exactly The icon or show and can represent (those such as shown on intelligent watch) that display size is shown.Show energy table with specific to application Show the touch-sensitive slave display of filling, show that these show on larger basic display unit then in response to single input (as described above) The amplification of one in representing represents, is provided for these users and indicates which kind of they may be selected and show the clear vision that can be represented Feedback.It is supplied to user to enhance the operability of equipment this improved visual feedback, and makes man-machine interface more effective (for example, can represent/show with this by helping user to provide correctly input, and showing on slave display is shown in operation It can represent to reduce user error when interacting).In addition, it is allowed to which these users check display showing on a small screen exactly Can represent to realize and continue to interact with touch-sensitive slave display, otherwise due to frequent mistake (for example, incorrect selection) and Need to lose time to correct these mistakes that this will be impossible.
In some embodiments, display is at least one shows that the amplification that can be represented represents to include (620) specific to application Display is at least one in the amplification at second user interface represents shows that the amplification that can be represented is represented (for example, putting specific to application Showing greatly can represent that 5204 amplifications for being displayed on second user interface are represented in 5202).In some embodiments, display the The amplification of two user interfaces represents to be included in shows energy table in display and touch-sensitive slave display on basic display unit specific to application Show that adjacent second shows that the amplification that can be represented represents specific to application.
Represent that interior display is at least one in response to amplification of the single input at second user interface and show energy specific to application The enlarged view of expression provides clearly visual feedback to the user, indicates which they may select show and can represent, and refer to Showing which shows can represent positioned adjacent.It is supplied to user to enhance the operability of equipment this improved visual feedback, And make man-machine interface more effective (for example, by helping user to provide correctly input, and slave display is shown in operation On show can represent and other it is adjacent show can represent/with it is described show can represent and other it is adjacent show and can represent and interact when subtract Few user error).In addition, it is allowed to these users check exactly display on a small screen show can represent realization and touch-sensitive pair The lasting interaction of display, otherwise since frequent wrong (for example, incorrect selection) and needs lose time to correct this A little mistakes this will be impossible.
In some other embodiments, show that what can be represented puts specific to application by least one instead of (or except) It is big to represent to be shown in the amplification expression at second user interface, it is at least one to show that the amplification that represented represents specific to application It is displayed in the central area of basic display unit (for example, first user interface of covering for email application).
Turning now to Fig. 6 B, in some embodiments, the amplification at display second user interface represents to exist including (622) The amplification at second user interface represent in display focus designator (for example, focus designator 5206, including countdown timer 5208 expression, Fig. 5 D), which is based at least partially on input and touch-sensitive secondary display on touch-sensitive slave display The position of device contact (represents that the position of the focus designator 5206 in 5202 generally corresponds to input to position for example, amplifying 5102 position at touch-sensitive slave display 104).In some embodiments, focus designator is shown in response to input And the clear of the position on their finger being located on touch-sensitive slave display is provided to low visual acuity user to visually indicate, with These users are allowed to select showing and representing for display exactly out of touch-sensitive slave display.Amplification table at second user interface Show that the clear vision that interior display focus designator provides a user position on their finger on touch-sensitive slave display is anti- Feedback.In some cases, user may due to visual problem or due to they finger masking it is underlying show can represent and It can not see that small the showing being shown on touch-sensitive slave display can represent.Therefore, focus designator is provided in amplification represents Enhance the operability of equipment, and make man-machine interface it is more effective (for example, by helping user to provide correctly input, and Operation be shown in showing on slave display can represent and other it is adjacent show can represent/with it is described show can represent and other are adjacent Showing can represent to reduce user error when interacting).In addition, it is allowed to which these users understand their finger touch-sensitive exactly Position on slave display is realized to be continued to interact with touch-sensitive slave display, otherwise due to frequently wrong (for example, incorrect Selection) and need to lose time to correct these mistakes that this will be impossible.
In some embodiments, focus designator includes the expression of (624) countdown timer (for example, around focus The expression 5208 of the countdown timer of designator 5206).In some embodiments, method 600 includes：It is defeated according to determining Enter that (this is definite can also to wrap with least one time that can represent to keep contact more than predetermined volume of showing specific to application Include definite user and input movement not yet exceeded into threshold distance (for example, 5px) in threshold time period (for example, 1 second)), renewal The expression of countdown timer is to indicate that countdown timer is movable.For example, as shown in Fig. 5 H- Fig. 5 K, around focus The expression 5208 of the countdown timer of designator 5206 is moved to reflect timer just in countdown along clockwise direction.Root (for example, after 1,1.5 or 2 second cycle) is had expired according to definite countdown timer, method 600 includes：Activation at least one It is a to represent specific to showing for application.The focus designator of expression of the display with countdown timer provides them to the user It will select to show the clear visual feedback that can be represented, which can represent that holding contact exceedes with showing in input Start countdown after the predetermined period.In some cases, user may be due to visual problem or due to theirs Finger masking it is underlying show can represent and can not see that small the showing being shown on touch-sensitive slave display can represent, and Therefore, these users may not know about them and when activate/select and various show and can represent.Therefore it provides with countdown timing The focus designator of device enhances the operability of equipment, and makes man-machine interface more effective (for example, by helping user to provide Correctly input, and operation be shown in showing on slave display can represent and other it is adjacent show can represent/show with described Can represent it is adjacent with other show can represent to reduce user error when interacting).In addition, it is allowed to which these users understand exactly When they, which will activate, is shown and can represent to realize and continue to interact with touch-sensitive slave display, otherwise due to frequent mistake (example Such as, incorrect selection) and need to lose time to correct these mistakes that this will be impossible.
In some embodiments, activating can represent to may include any one of the following specific to showing for application： (i) perform shows the function that can represent associated (such as via the available work(of application program with least one specific to application Can)；(ii) extending showing in touch-sensitive slave display and basic display unit can represent to show that additional function (such as extends volume Showing to represent to show sliding block, which allows to change volume setting)；And (iii) permission user moves along sliding block and shows energy Represent.In some embodiments, and as explained below, activating at least one can represent to be based on specific to showing for application Receive other kinds of input and perform.For example, show that the activation that can be represented can be according to determining at least one specific to application Show and can represent to have been received by quick tap gesture, or have been received by selection it is at least one specific to showing for application can table The separated touch shown and occur that (that is, the first input showing and can represent, and second touches and do not showing and can represent, but leads Cause to show the selection that can be represented).
In some embodiments, it is at least one specific to application show can represent (626) associated with sliding block (for example, Showing can represent that 5104 is associated with sliding block 5106), and activate and at least one can represent to include basis specific to showing for application (or more generally, in order to allow) is at least one to be represented to update at least along the movement of sliding block specific to showing for application One is shown that the amplification that can represent is represented (for example, as it can be seen from figure 5k, in response to falling for focus designator 5206 specific to application Clocked timer has expired, and showing can represent that 5204 can move along sliding block now).In some embodiments, it is at least one Can represent after countdown timer expires specific to showing for application (or in response to above-mentioned quick tap and separated at it Touch input and after activating) be activated before not slidably.In some embodiments, touch-sensitive slave display is also updated To allow at least one to show the identical movement that can be represented (for example, 5104 can be represented now along sliding block by showing specific to application 5106 movements).In some embodiments, after countdown timer expires, for present focus designator (or with Jiao Point designator be associated) visual characteristic be modified to indicate focus designator can move now it is at least one specific to should Showing can represent that (for example, as shown in Fig. 5 K- Fig. 5 L, the expression of countdown timer keeps it to expire state to indicate to be located at It is following show can represent it is now removable/slidably).
Show associated with sliding block is activated after countdown timer expires can represent to help to strengthen grasping for equipment The property made, and make man-machine interface it is more effective (for example, by show in operation can represent/and when showing and can representing and interact reduce user Mistake, and help prevent the unexpected modification of sliding block).In addition, it is allowed to which user understands when they can manipulate sliding block exactly Realization continues to interact with touch-sensitive slave display, otherwise due to frequently mistake (for example, incorrect or unexpected modification of sliding block) And need to lose time to correct these mistakes that this will be impossible.
In some embodiments, continuous contact has been kept to exceed in advance really with touch-sensitive slave display according to definite input Quantitative time (for example, 0.5 second, 0.75 second or 1 second passes through, and before amplification expression is presented at basic display unit, input 5012 keep continuously contacting with touch-sensitive slave display 104), it is at least one to show that the amplification that represented represents aobvious specific to application Show (628) on basic display unit.In some embodiments, if continuously connect as input and the holding of touch-sensitive slave display Touch, then it is not selection or touch input that equipment, which determines to input, and is determined based on this, equipment and then the presentation at basic display unit It is at least one to show that the amplification that represent represents that (in some embodiments, and as described below, equipment is only specific to application Determined in touch-sensitive slave display with carrying out this during addressable pattern operation).
In some embodiments, operated according to definite touch-sensitive slave display with may have access to pattern, display (630) is at least One is shown that the amplification that can be represented represents specific to application.(for example, activating addressable pattern by selecting system preference, such as Shown in Fig. 5 A- Fig. 5 B, and it is explained in greater detail below with reference to method 700).
Referring now to Fig. 6 C, in some embodiments, method 600 includes：Input at touch-sensitive slave display with extremely Few one specific to application show can represent to keep contacting when, at touch-sensitive slave display detection (632) Flick gesture (for example, Touch 5105, Fig. 5 H), which does not contact and at least one can represent specific to showing for application.In some embodiment party In case, touch-sensitive slave display includes showing the first area that can represent and with multiple specific to application with least one Specific to application show in representing other show can represent second area (that is, these other show and can represent not include extremely Few one can represent specific to showing for application), and Flick gesture is received at second area, therefore at least one is not contacted It is a to represent specific to showing for application.In some embodiments, should " separate Flick gesture " be alternative selection option (without Countdown timer must be waited to expire).In response to detecting Flick gesture, method 600 includes：Activate it is at least one specific to The showing and can represent of application (such as, it is allowed to user moves along respective slide to be shown and can represent 5204/5104, such as reference chart above 5K- Fig. 5 L are explained).Another example shows in Fig. 5 M- Fig. 5 N, wherein input 5102 show can represent at 5090 with Touch-sensitive slave display keeps contact, then receives and is showing the Flick gesture 5107 that can represent on 5090, and in response, shows It can represent that 5090 are activated, this causes selected text " Everyone " at basic display unit 102 by overstriking.In response to not existing Show the Flick gesture (separating Flick gesture) on representing and allow to show that the activation that can be represented enhances equipment with what input contacted Operability, and make man-machine interface more effective (desired show can table for example, by allowing user to be placed on the first finger Show, then perform the selection shown the expectation and can represented using different fingers).In addition, it is allowed to which user is touch-sensitive secondary aobvious Show that its is moved freely around device first-hand instigates user to continue to interact with touch-sensitive slave display (by exploring in touch-sensitive pair Showing which shows at display can represent), otherwise due to frequently wrong (for example, showing the incorrect or unexpected choosing that can be represented Select) and need to lose time to correct these mistakes that this will be impossible.
In some embodiments, user various types of can also show and can represent to activate using Flick gesture is separated. For example, in some embodiments, user can show any that can be represented by the way that its finger is placed on date range modification first End manipulates the date or time scope of calendar event (the jointly owned patent being such as incorporated by reference above The example shown in Figure 36 J- Figure 36 Q of application 15/275,298).In some embodiments, then basic display unit is updated Show that each end that can be represented has the focus designator of countdown timer to be included in date range modification, and use Manipulated when family can be in countdown timer two expires date range (as shown in Fig. 5 E- Fig. 5 F, focus designator 5206 and 5212 are provided with each input at touch-sensitive slave display).In some embodiments, user can be burnt by allowing The countdown timer of point designator is expired and changing a series of showing including values can represent at the either end that can be represented showing An end (for example, to manipulate show the only one end that can be represented).
In some embodiments, method 600 includes：(634) predefined gesture is detected at touch-sensitive slave display (for example, user presses order button, and then perform to have at touch-sensitive slave display and input 5102 and 5103 (Fig. 5 F) Pinching gesture or go pinching gesture with 5102 and 5103 (Fig. 5 E) of input), which manipulates zoom-level Not, the level of zoom be used at basic display unit show it is at least one specific to application show can represent amplification expression.Response In detect predefined gesture (or in response to detected during predefined gesture level of zoom each increment grasp It is vertical), method 600 includes：When manipulating level of zoom using predefined gesture, update the amplification at basic display unit and represent (example Such as, go pinching gesture to be further amplified in response to Fig. 5 E, or reduced in response to the pinching gesture of Fig. 5 F).User is allowed to make The operability for the level of zoom enhancing equipment that amplification represents is manipulated with predefined gesture, and makes man-machine interface more effective (for example, adapting to its people's preference by allowing user rapidly and easily to adjust level of zoom).In addition, it is allowed to Yong Hucao Vertical level of zoom enables user to be handed over by ensuring that these users adjust level of zoom to keep lasting with touch-sensitive slave display Mutually so that they can check exactly different can show that what sizes shows shows and can represent that this is for various eyesights level Low visual acuity user is important.
It should be appreciated that the particular order that the operation in Fig. 6 A- Fig. 6 C is described is only an example, it is not purport Indicating that the order is the unique order that these operations can be performed.Those of ordinary skill in the art will recognize that a variety of sides Formula resequences operations described herein.
Fig. 7 A- Fig. 7 C are according to some embodiments low visual acuity user to be handed over touch-sensitive slave display The flow chart of mutual method 700.Method 700 performs (702) at computing system, which is included at one or more Reason device, memory include the first shell of basic display unit, and include the touch-sensitive pair different from basic display unit at least in part The second housing of display.Certain operations in method 700 are optionally combined, and/or certain operations order optionally by Change.
In some embodiments, computing system is portable computing system 100 (Figure 1A) or desk-top computing system 200 (Fig. 2A-Fig. 2 D).In some embodiments, basic display unit is the display portion in portable computing system 100 (Figure 1A) The basic display unit 102 (Figure 1A) realized in 110 (referred to herein as the first shell 110, it includes basic display unit 102), and And second housing is the main part 120 of portable computing system 100, and second housing includes touch-sensitive pair at least in part Display (for example, dynamic function row 104, Figure 1A-Figure 1B) and physical keyboard (for example, one group of secondary or physical bond 106) (704).
In some embodiments, second housing is not connected to the first shell (706), for example, because the first shell is the A part and second housing for one equipment is a part for the equipment different from the first equipment (for example, second housing can be A part for mobile phone, tablet device or any other equipment, the other equipment include being shown on smaller slave display Show and can represent, while the other equipment is connected to the computing system for including larger basic display unit).It is unrestricted as one Property example, in some embodiments, second housing is the peripheral keyboard 206 (Fig. 2A-Fig. 2 B) of desk-top computing system 200, It is at least in part comprising touch-sensitive slave display (for example, dynamic function row 104, Fig. 2A-Fig. 2 B) and physical keyboard (for example, one Group secondary or physical bond 106, Fig. 2A-Fig. 2 B).As another example, in some embodiments, second housing is that desk-top calculate is The peripheral input mechanism 212 (Fig. 2 C) of the first of system 200, it is at least in part comprising touch-sensitive slave display (for example, dynamic function Row 104, Fig. 2 C), and second housing includes input mechanism (for example, touch pad 108, Fig. 2 C) without including physical keyboard. As another example, in some embodiments, second housing is a part (708) for wearable computing devices, such as intelligence Can wrist-watch.
As described below, method 700 (and associated interface) enable low visual acuity user and touch-sensitive slave display into Row interaction.Compared with method 600, method 700 is included at basic display unit to provide to be operated before amplification represents with may have access to pattern Touch-sensitive slave display.The example and description provided above with reference to method 600 is also applied for method 700, and for simplicity, These examples and description are generally not repeated here.As shown in Figure 7 A, method 700 includes：Touched with may have access to pattern operation (710) Quick slave display.For example, as shown in figs. 5 a-b, system preference option is available, and it is touch-sensitive secondary aobvious that it allows user to realize Show the addressable pattern (for example, check box is selected with " enabling touch-control bar scaling " by using cursor 504) of device.In some realities Apply in scheme, check mark option is also presented at touch-sensitive slave display 104, it allows user to pass through in touch-sensitive slave display Provide input to enable or disable addressable pattern (as shown in figs. 5 a-b) at 104.
Remaining operation (operation 714-738) each leisure of method 700 is held with may have access to when pattern operates touch-sensitive slave display Row (712).Method 700, which is included on basic display unit, shows that (714) are used for the first user interface of application program (for example, scheming Exemplary user interface is shown for email application in 5C).Method also includes showing on touch-sensitive slave display (716) second user interface, the second user interface include：(i) control in application program available function it is multiple specific It can represent that (for example, 5080-5084 can be represented by showing, these, which are shown, above with reference to method 600 can represent to provide in showing for application Additional description), and (ii) control system level function it is at least one it is system-level show can represent (for example, 5079 can be represented by showing And 5085-5088, these, which are shown, above with reference to method 600 can represent to provide additional description).Multiple showing specific to application Can represent in it is each and at least one it is system-level show can represent with first show size show.In some embodiments, Each accordingly showing can represent that (only) can select (718) (above via one or more inputs at touch-sensitive slave display Reference operation 614 provides the additional detail on operation 718).
Method 700 further includes：Via touch-sensitive slave display detection (720) with multiple specific in the showing and can represent of application It is at least one specific to application show can represent (for example, 5104 can be represented by showing) contact input (for example, input 5102, figure 5D).In response to detect input and input with touch-sensitive slave display holding contact when (722), method includes：Continue First user interface of the display for application program on basic display unit, and show on basic display unit it is at least one specific to Application shows that the amplification that can be represented represents.It is at least one to show that the amplification that represented is represented with aobvious more than first specific to application Show that the second display size of size is shown.The additional detail and example of operation 722 are provided above with reference to operation 618.
In some cases, the low visual acuity user of computing system is dependent on the memory key position on keyboard so that Ta Menneng It is enough to provide input to computing system exactly.For including with the meter for showing the touch-sensitive slave display that can be represented often changed Calculation system, these users can not rely solely on memory and be accurately entered to provide.Display shows what can be represented specific to application It is at least one to show that the amplification that represented represents to improve the operability of computing system, because low visual acuity user can be with touch-sensitive pair Available control interacts at display, the touch-sensitive slave display for low visual acuity user may it is too small (or may It is blocked since the finger of user is covering shown control) and can not check exactly.In this way, low visual acuity user Can for example, by with touch-sensitive slave display to continue to interact the input of mistake (rather than constantly correct) improved to utilize Man-machine interface.
Turning now to Fig. 7 B, display is at least one to show the amplification expression that can represent including (724) the specific to application The amplification of two user interfaces represents that interior display is at least one and shows that the amplification that can be represented represents specific to application.Above with reference to behaviour Work 620 provides the additional detail and example on operation 724.In response to single input in the amplification at second user interface Display is at least one in representing shows that the enlarged view that can be represented provides clearly visual feedback to the user specific to application, refers to Show which they may select show and can represent, and indicate which shows to represent positioned adjacent.By this improved vision Feedback is supplied to user to enhance the operability of equipment, and makes man-machine interface more effective (for example, by helping user to provide Correctly input, and operation be shown in showing on slave display can represent and other it is adjacent show can represent/and described show energy Represent it is adjacent with other show can represent to reduce user error when interacting).In addition, it is allowed to which these users check aobvious exactly Show showing and can represent to realize and continue to interact with touch-sensitive slave display on a small screen, otherwise due to frequently it is wrong (for example, Incorrect selection) and need to lose time to correct these mistakes that this will be impossible.
In some embodiments, show that the amplification at second user interface represents to include (726) at second user interface Amplification shows focus designator in representing, the input and touch which is based at least partially on touch-sensitive slave display The position of quick slave display contact positions.The additional detail and example on operation 726 are provided above with reference to operation 622. Display focus designator is provided a user on their finger in touch-sensitive secondary display in the amplification at second user interface represents The clear visual feedback of position on device.In some cases, user may be due to visual problem or since their finger hides Cover it is underlying show can represent and can not see small the showing being shown on touch-sensitive slave display can represent.Therefore, putting It is big to represent that the interior focus designator that provides enhances the operability of equipment, and make man-machine interface more effective (for example, passing through help User provide correctly input, and operation be shown in showing on slave display can represent and other it is adjacent show can represent/and It is described show can represent it is adjacent with other show can represent to reduce user error when interacting).In addition, it is allowed to which these users are accurate Ground, which understands position of their finger on touch-sensitive slave display, to be realized and to continue to interact with touch-sensitive slave display, otherwise due to Frequently mistake (for example, incorrect selection) and need to lose time to correct these mistakes that this will be impossible.
In some embodiments, focus designator includes the expression of (728) countdown timer, and method 700 is wrapped Include：The time that can represent that holding is contacted more than predetermined volume has been shown specific to application with least one according to definite input, Method 700 includes updating the expression of countdown timer to indicate that countdown timer is movable.Determined according to definite countdown When device have expired, method 700, which includes activating, at least one can represent specific to showing for application.Provided above with reference to operation 624 Additional detail and example on operation 728.The focus designator of expression of the display with countdown timer carries for user It will select to show the clear visual feedback that can be represented for them, which can represent that holding connects with showing in input Touch and start countdown afterwards more than the predetermined period.In some cases, user may due to visual problem or due to Their finger masking is underlying, which to be shown, can represent and can not see that be shown on touch-sensitive slave display small shows energy table Show, and therefore, these users, which may not know about them and when activate/select, various to be shown and can represent.Therefore it provides with The focus designator of clocked timer enhances the operability of equipment, and makes man-machine interface more effective (for example, passing through help User provide correctly input, and operation be shown in showing on slave display can represent and other it is adjacent show can represent/and It is described show can represent it is adjacent with other show can represent to reduce user error when interacting).In addition, it is allowed to which these users are accurate Ground, which understands them and when will activate, to be shown and can represent to realize and continue to interact with touch-sensitive slave display, otherwise due to frequent mistake (for example, incorrect selection) and need to lose time to correct these mistakes that this will be impossible by mistake.
In some embodiments, it is at least one to represent (730) associated with sliding block specific to showing for application, and Activate it is at least one specific to application show can represent to include it is at least one specific according to (or more generally, in order to allow) Showing to represent to update along the movement of sliding block and at least one show that the amplification that can be represented is represented specific to application in application. The additional detail and example on operation 730 are provided above with reference to operation 626.Activated after countdown timer expires Show associated with sliding block can represent to contribute to the operability for strengthening equipment, and make man-machine interface more effective (for example, passing through Show in operation can represent/with show and can represent and interact when reduce user error, and help prevent sliding block accident change). In addition, it is allowed to which user understands them and when can manipulate sliding block and realize exactly to be continued to interact with touch-sensitive slave display, otherwise Since frequent mistake (for example, sliding block incorrect or unexpected modification) and needing loses time to correct these mistakes, this will It is impossible.
In some embodiments, continuous contact has been kept to exceed in advance really with touch-sensitive slave display according to definite input It is the quantitative time, at least one to show that the amplification that represented represents to show (732) on basic display unit specific to application.Above Reference operation 628 provides the additional detail and example on operation 732.
It attention is directed to Fig. 7 C.In some embodiments, method 700 further includes：In input touch-sensitive secondary aobvious Show at device with it is at least one specific to application show can represent that holding contacts when, at touch-sensitive slave display detect (736) touch Gesture (for example, touch 5107, Fig. 5 M, or touch 5105, Fig. 5 H), the touch-sensitive slave display do not contact it is at least one specific to Application is shown and can be represented.In some embodiments, touch-sensitive slave display includes showing energy specific to application with least one The first area of expression and with it is multiple specific to application show in representing other show the second area that can represent (that is, these other show can represent not include at least one can represent specific to showing for application), and Flick gesture is received in At second area, therefore do not contact and at least one can represent specific to showing for application.In response to detecting Flick gesture, method 700 include：Activating at least one can represent specific to showing for application.Provided above with reference to operation 632 on operation 736 Additional detail and example.In response to allowing to connect with input not showing the Flick gesture on representing (" separate Flick gesture ") Tactile shows that the activation that can be represented enhances the operability of equipment, and makes man-machine interface more effective (for example, by allowing user By the first finger be placed on it is desired show and can represent, then show the expectation what can be represented using different fingers to perform Selection).In addition, it is allowed to which user moves freely its around touch-sensitive slave display and first-hand instigates user and touch-sensitive slave display Lasting interaction (showing which shows at touch-sensitive slave display by exploration can represent) is kept, otherwise due to frequent wrong (example Such as, show the incorrect or unexpected selection that can be represented) and needs lose time to correct these mistakes this will be impossible.
In some embodiments, method 700 includes：(738) predefined gesture is detected at touch-sensitive slave display (those the exemplary predefined gestures such as discussed above with reference to operation 634), the predefined gesture manipulate zoom-level Not, the level of zoom be used at basic display unit show it is at least one specific to application show can represent amplification expression.Response In detecting predefined gesture (or in response to detecting that each increment of level of zoom manipulates), method 700 includes： When manipulating level of zoom using predefined gesture, update the amplification at basic display unit and represent.There is provided above with reference to operation 634 Additional detail and example on operation 738.Allow user using predefined gesture to manipulate the zoom-level that amplification represents Not Zeng Qiang equipment operability, and make man-machine interface more effective (for example, by allowing user rapidly and easily to adjust contracting Rank is put to adapt to its people's preference).In addition, it is allowed to which user, which manipulates level of zoom, enables user by ensuring these users Adjustment level of zoom to continue to interact with touch-sensitive slave display so that they can check exactly different to show What size was shown, which shows, to represent, this is important for the low visual acuity user of various eyesights level.
It should be appreciated that the particular order that the operation in Fig. 7 A- Fig. 7 C is described is only an example, it is not purport Indicating that the order is the unique order that these operations can be performed.Those of ordinary skill in the art will recognize that a variety of sides Formula resequences operations described herein.
Fig. 8 A- Fig. 8 C are according to some embodiments low visual acuity user to be handed over touch-sensitive slave display The flow chart of mutual method 800.Method 800 performs (802) at computing system, which is included at one or more Reason device, memory include the first shell of basic display unit, and include the touch-sensitive pair different from basic display unit at least in part The second housing of display.Certain operations in method 800 are optionally combined, and/or certain operations order optionally by Change.
In some embodiments, computing system is portable computing system 100 (Figure 1A) or desk-top computing system 200 (Fig. 2A-Fig. 2 D).In some embodiments, basic display unit is the display portion in portable computing system 100 (Figure 1A) The basic display unit 102 (Figure 1A) realized in 110 (referred to herein as the first shell 110, it includes basic display unit 102), and And second housing is the main part 120 of portable computing system 100, and second housing includes touch-sensitive pair at least in part Display (for example, dynamic function row 104, Figure 1A-Figure 1B) and physical keyboard (for example, one group of secondary or physical bond 106) (804).
In some embodiments, second housing is not connected to the first shell (806), for example, because the first shell is the A part and second housing for one equipment is a part for the equipment different from the first equipment (for example, second housing can be A part for mobile phone, tablet device or any other equipment, the other equipment include being shown on smaller slave display Show and can represent, while the other equipment is connected to the computing system for including larger basic display unit).It is unrestricted as one Property example, in some embodiments, second housing is the peripheral keyboard 206 (Fig. 2A-Fig. 2 B) of desk-top computing system 200, It is at least in part comprising touch-sensitive slave display (for example, dynamic function row 104, Fig. 2A-Fig. 2 B) and physical keyboard (for example, one Group secondary or physical bond 106, Fig. 2A-Fig. 2 B).As another example, in some embodiments, second housing is that desk-top calculate is The peripheral input mechanism 212 (Fig. 2 C) of the first of system 200, it is at least in part comprising touch-sensitive slave display (for example, dynamic function Row 104, Fig. 2 C), and second housing includes input mechanism (for example, touch pad 108, Fig. 2 C) without including physical keyboard. As another example, in some embodiments, second housing is a part (808) for wearable computing devices, such as intelligence Can wrist-watch.
As described below, method 800 (and associated interface) enable low visual acuity user and touch-sensitive slave display into Row interaction.The example and description provided above with reference to method 600 and 700 is also applied for method 800, and for simplicity, this A little examples and description are generally not repeated here.As shown in Fig. 8 A, method 800, which is included on basic display unit, shows that (802) are used to answer With the first user interface (for example, the user interface for email application, Fig. 5 C) of program.Method 800 further includes (812) second user interface is shown on touch-sensitive slave display, which includes：(i) control is in application program The multiple of interior available function can be represented (for example, 5080-5084 can be represented by showing, above with reference to method specific to showing for application 600 pairs these show can represent to provide additional description), and system-level show can table by (ii) control system level function at least one Show that (for example, 5079 and 5085-5088 can be represented by showing, these, which are shown, above with reference to method 600 can represent to provide additional retouch State).In some embodiments, each accordingly showing can represent that (only) can be via one at touch-sensitive slave display or more It is a to input to select (814) (additional detail on operation 814 is provided above with reference to operation 614).
In some embodiments, first specific to application show can represent with first display size be shown in touch-sensitive pair At display, and method 800 further includes (818)：In response to detecting the first input and in the first input and first specific In application show can represent keep contact when：Continue first user interface of the display for application program on basic display unit；And And display first shows that the amplification that can be represented represents specific to application on basic display unit, wherein amplification is represented with more than first Second display size of display size is shown.The additional detail and example on operation 818 are provided above with reference to operation 618.
Method 800 comprises additionally in：Via the detection of touch-sensitive slave display multiple specific to show in representing the of application One shows the on representing first input (for example, showing the input 5102 that can represent on 5089, Fig. 5 M) specific to application. First input shows that method 800 includes (820) when can represent that holding contacts with first specific to application：Via touch-sensitive secondary display Device detection does not show that second on representing inputs (for example, not showing the input that can represent on 5089 first specific to application 5107, Fig. 5 M), and in response to detecting the second input, activation first can represent specific to showing for application (for example, due to Show can represent 5089 activation and the selected text on overstriking basic display unit, Fig. 5 N).Operation is provided above with reference to operation 632 820 additional example and description.In response to not show the Flick gesture on representing (" separate Flick gesture ") and allow with it is defeated Enter contact shows that the activation that can be represented enhances the operability of equipment, and makes man-machine interface more effective (for example, passing through permission User by the first finger be placed on it is desired show and can represent, then using different fingers, to perform, the expectation is shown can table The selection shown, so that it is guaranteed that only activate it is desired show and can represent, and help to minimize selection/activation of mistake).In addition, permit Family allowable moves freely its first finger (not selecting to show to represent) around touch-sensitive slave display makes user and touch-sensitive secondary display Device keeps lasting interaction (showing which shows at touch-sensitive slave display by exploration can represent), otherwise due to frequent mistake (for example, showing the incorrect or unexpected selection that can be represented) and needs lose time to correct these mistakes, and this will be impossible 's.
It attention is directed to Fig. 8 B.In some embodiments, display is at least one shows energy table specific to application The amplification shown represents that represent that interior display is at least one including the amplification of (822) at second user interface shows energy specific to application The amplification of expression represents.The additional detail and example on operation 822 are provided above with reference to operation 620.In response to single defeated Enter and display is at least one in the amplification at second user interface represents shows that the enlarged view that can represent is use specific to application Family provides clearly visual feedback, indicates which they may select show and can represent, and indicate which shows to represent to be located at Near it.It is supplied to user to enhance the operability of equipment this improved visual feedback, and man-machine interface is more had Effect (for example, by help user provide correctly input, and operation be shown in showing on slave display can represent and its He is adjacent, which to show, to represent/with it is described show can represent and other it is adjacent show and can represent and interact when reduce user error).In addition, These users are allowed to check that display showing on a small screen can represent that realization continues to interact with touch-sensitive slave display exactly, Otherwise due to frequent wrong (for example, incorrect selection) and need to lose time to correct these mistakes these will be can not Can.
In some embodiments, show that the amplification at second user interface represents to include (824) at second user interface Amplification shows focus designator in representing, the input and touch which is based at least partially on touch-sensitive slave display The position of quick slave display contact positions.The additional detail and example on operation 824 are provided above with reference to operation 622. Display focus designator is provided a user on their finger in touch-sensitive secondary display in the amplification at second user interface represents The clear visual feedback of position on device.In some cases, user may be due to visual problem or since their finger hides Cover it is underlying show can represent and can not see small the showing being shown on touch-sensitive slave display can represent.Therefore, putting It is big to represent that the interior focus designator that provides enhances the operability of equipment, and make man-machine interface more effective (for example, passing through help User provide correctly input, and operation be shown in showing on slave display can represent and other it is adjacent show can represent/and It is described show can represent it is adjacent with other show can represent to reduce user error when interacting).In addition, it is allowed to which these users are accurate Ground, which understands position of their finger on touch-sensitive slave display, to be realized and to continue to interact with touch-sensitive slave display, otherwise due to Frequently mistake (for example, incorrect selection) and need to lose time to correct these mistakes that this will be impossible.
In some embodiments, it is at least one to represent (828) associated with sliding block specific to showing for application, and Activate it is at least one specific to application show can represent to include it is at least one specific according to (or more generally, in order to allow) Showing to represent to update along the movement of sliding block and at least one show that the amplification that can be represented is represented specific to application in application. The additional detail and example on operation 828 are provided above with reference to operation 626.Activated after countdown timer expires Show associated with sliding block can represent to contribute to the operability for strengthening equipment, and make man-machine interface more effective (for example, passing through Show in operation can represent/with show and can represent and interact when reduce user error, and help prevent sliding block accident change). In addition, it is allowed to which user understands them and when can manipulate sliding block and realize exactly to be continued to interact with touch-sensitive slave display, otherwise Since frequent mistake (for example, sliding block incorrect or unexpected modification) and needing loses time to correct these mistakes, this will It is impossible.
In some embodiments, continuous contact has been kept to exceed in advance really with touch-sensitive slave display according to definite input It is the quantitative time, at least one to show that the amplification that represented represents to show (830) on basic display unit specific to application.Above Reference operation 628 provides the additional detail and example on operation 830.
In some embodiments, being operated according to definite touch-sensitive slave display with may have access to pattern, showing at least one spy Show that the amplification that can be represented represents due to application.Provided above with reference to operation 630,710 and 712 on the additional of operation 832 Details and example.
Turning now to Fig. 8 C, in some embodiments, method 800 includes：(834) are detected at touch-sensitive slave display Predefined gesture (for example, providing example above with reference to operation 634), the predefined gesture manipulate level of zoom, the scaling Rank be used at basic display unit show it is at least one specific to application show can represent amplification expression；And in response to inspection Predefined gesture is measured, when manipulating level of zoom using predefined gesture, the amplification at basic display unit is updated and represents. The additional detail and example on operation 834 are provided above with reference to operation 634.User is allowed to come using predefined gesture The operability for the level of zoom enhancing equipment that amplification represents is manipulated, and makes man-machine interface more effective (for example, by allowing to use Family rapidly and easily adjusts level of zoom to adapt to its people's preference).In addition, it is allowed to which user, which manipulates level of zoom, makes user Continue to interact with touch-sensitive slave display by ensuring that these users can adjust level of zoom so that they can be accurate Really checking different can show that what sizes showed shows and can represent that this is important for the low visual acuity user of various eyesights level 's.
It should be appreciated that the particular order that the operation in Fig. 8 A- Fig. 8 C is described is only an example, it is not purport Indicating that the order is the unique order that these operations can be performed.Those of ordinary skill in the art will recognize that a variety of sides Formula resequences operations described herein.
According to the principle that some embodiments, Fig. 9 shows the computing system configured according to the various embodiments The functional block diagram of 900 (according to some embodiments, also referred to as electronic equipment 900).The functional block of the system is optionally by performing Hardware, software, firmware or the combinations thereof of the principle of various described embodiments is realized.Those skilled in the art Member is it should be appreciated that the functional block described in Fig. 9 is optionally combined or is separated into sub-block, to realize various described realities Apply the principle of scheme.Therefore, description herein is optionally supported any possible combination of functional block as described herein or is divided From or further limit.For the ease of discussing, computing system 900 is implemented as portable computing system 100 (Figure 1A).One In a little embodiments, computing system 900 is realized according to any one of equipment/system shown in Figure 1A-Fig. 2 D.
As shown in figure 9, the main display unit 902 that computing system 900 includes being configured as display information is (for example, touch-sensitive Display system 112 is also referred to as main touch-screen, main touch-sensitive display and main touch-screen display, Figure 1A), be configured as touching The touch-sensitive slave display unit 904 of contact, gesture and other users input, and processing unit are received on quick slave display 910.System 900 optionally includes the physical keyboard unit 905 for being configured as receiving input through keyboard, and in some embodiment party In case, optional physical keyboard unit includes touch-sensitive slave display unit 904 in second housing, and the second housing is different In the first shell including main display unit 902.In some embodiments, the first shell and second housing be rotatably Connect (for example, being the embodiment of laptop computer for wherein computing system 900), and in other embodiments, the One shell and second housing are not connected to and can be a part for the independent computing device to form system 900 (for example, first Shell is a part for laptop computer, and second housing is specific installation such as wearable computing devices (as intelligent hand Table) a part).Processing unit 910 and main display unit 902, touch-sensitive slave display unit 904, and optional secondary or physical bond Disk unit 905 couples.In some embodiments, processing unit 910 includes display unit (for example, display unit 912), inspection Unit 914 (for example, detection unit 914) is surveyed, and shows and can represent to activate unit (for example, show can represent activate unit 916).
Processing unit is configured as：Display with display unit 912 (for example, combine main display unit on basic display unit 902) it is used for the first user interface of application program；Display (is touched for example, being combined with display unit 912 on touch-sensitive slave display Quick slave display unit 904) second user interface, which includes available function in control application program It is multiple to represent specific to showing for application and multiple each with the first display size in representing specific to showing for application Display；Via touch-sensitive slave display detection (for example, with detection unit 914 combine touch-sensitive slave display unit 904) with it is multiple Specific to application show in representing it is at least one specific to application show can represent contact input；And in response to inspection Input is measured, and when input keeps contacting with touch-sensitive slave display：(i) continue on basic display unit display (for example, with Display unit 912 combines main display unit 902) it is used for the first user interface of application program, and (ii) in basic display unit Upper display (for example, combining main display unit 902 with display unit 912) is at least one to show what can be represented specific to application Amplification represent, and it is at least one specific to application show can represent amplification expression with more than first show size second Display size is shown.
According to some embodiments of computing system 900, at least one amplification that can represent shown specific to application of display Represent the amplification for being included in second user interface represent at least one amplification table that can represent of showing specific to application of display Show.
According to some embodiments of computing system 900, the amplification at display second user interface represents to be included in the second use The amplification at family interface shows focus designator in representing, which is based at least partially on touch-sensitive slave display The position that is contacted with touch-sensitive slave display is inputted to position.
According to some embodiments of computing system 900, focus designator includes the expression of countdown timer, and Processing unit is further configured to：It can represent that holding is contacted specific to showing for application with least one according to definite input More than the time of predetermined volume, update the expression of countdown timer with indicate countdown timer be it is movable (for example, Main display unit 902 is combined with display unit 912)；And had expired according to definite countdown timer, activation at least one It is a to represent specific to showing for application (for example, can represent activation unit 916 with showing).
It is at least one to represent related to sliding block specific to showing for application according to some embodiments of computing system 900 Connection, and activate and at least one can represent to include basis (or more generally, in order to allow) at least one specific to showing for application It is a to represent to update at least one amplification that can represent shown specific to application along the movement of sliding block specific to showing for application Represent.
According to some embodiments of computing system 900, processing unit is further configured to：In input in touch-sensitive pair At display with it is at least one specific to application show can represent that holding contacts when, at touch-sensitive slave display detection touch hand Gesture (for example, combining touch-sensitive slave display unit 904 with detection unit 914), which does not contact at least one spy It can be represented due to showing for application；And in response to detecting Flick gesture, activation is at least one to be represented specific to showing for application (for example, can represent activation unit 916 with showing).In some embodiments, touch-sensitive slave display includes having at least one Specific to application show the first area that can represent and with it is multiple specific to application show in representing other show energy table The second area (that is, these other show can represent not include at least one can represent specific to showing for application) shown, and touch Gesture is received at second area, therefore is not contacted and at least one can be represented specific to showing for application.
According to some embodiments of computing system 900, processing unit is further configured to：In touch-sensitive slave display Place's detection (for example, combining touch-sensitive slave display unit 904 with detection unit 914) predefined gesture, the predefined gesture Level of zoom is manipulated, which is used to show at basic display unit at least one shows that what can be represented puts specific to application It is big to represent；And in response to detecting predefined gesture, when manipulating level of zoom using predefined gesture, renewal master Amplification at display represents (for example, combining main display unit 902 with display unit 912).
According to some embodiments of computing system 900, keep continuously connecing with touch-sensitive slave display according to definite input Touch the time more than predetermined volume, it is at least one to show that the amplification that represented represents to be shown in basic display unit specific to application On.
According to some embodiments of computing system 900, operated according to definite touch-sensitive slave display with may have access to pattern, Show and at least one show that the amplification that can represent represents specific to application.
According to some embodiments of computing system 900, it is multiple specific to application show in representing each can be through Selected by one or more inputs at touch-sensitive slave display.
According to some embodiments of computing system 900, second housing also includes physical keyboard at least in part.
According to some embodiments of computing system 900, second housing is not connected to the first shell.
According to some embodiments of computing system 900, second housing is a part for wearable computing devices.
According to the principle that some embodiments, Figure 10 shows the calculating system configured according to the various embodiments The functional block diagram of system 1000 (according to some embodiments, also referred to as electronic equipment 1000).The functional block of the system optionally by Hardware, software, firmware or the combinations thereof of the principle of various described embodiments are performed to realize.The skill of this area Art personnel should be appreciated that the functional block described in Figure 10 is optionally combined or is separated into sub-block, various described to realize Embodiment principle.Therefore, description herein optionally supports any possible combination of functional block as described herein Or separation or further restriction.For the ease of discussing, computing system 1000 is implemented as portable computing system 100 (Figure 1A). In some embodiments, computing system 1000 is realized according to any one of equipment/system shown in Figure 1A-Fig. 2 D.
As shown in Figure 10, computing system 1000 include be configured as display information main display unit 1002 (for example, Touch-sensitive display system 112 is also referred to as main touch-screen, main touch-sensitive display and main touch-screen display, Figure 1A), be configured as The touch-sensitive slave display unit 1004 of contact, gesture and other users input, and processing list are received on touch-sensitive slave display Member 1010.System 1000 optionally includes the physical keyboard unit 1005 for being configured as receiving input through keyboard, and in some realities Apply in scheme, optional physical keyboard unit includes touch-sensitive slave display unit 1004 in second housing, this is outside second Shell is different from the first shell for including main display unit 1002.In some embodiments, the first shell and second housing can (for example, being the embodiment of laptop computer for wherein computing system 1000) rotatably is connected, and in other embodiment party In case, the first shell and second housing are not connected to and can be a part (example for the independent computing device to form system 1000 Such as, the first shell is a part for laptop computer, and second housing is specific installation such as wearable computing devices The part of (as intelligent watch)).Processing unit 1010 and main display unit 1002, touch-sensitive slave display unit 1004, with And optionally physical keyboard unit 1005 couples.In some embodiments, processing unit 1010 includes display unit (for example, aobvious Show unit 1012), detection unit 1014 (for example, detection unit 1014), show activation unit can be represented (for example, showing can represent sharp Unit 1016 living) and addressable pattern operating unit (for example, the pattern of may have access to operating unit 1018).
Processing unit is configured as：Touch-sensitive slave display is operated may have access to pattern；Touch-sensitive may have access to pattern operation During slave display, display (for example, combining main display unit 1002 with display unit 1012) is for applying on basic display unit First user interface of program；And display with display unit 1012 (for example, combined touch-sensitive secondary aobvious on touch-sensitive slave display Show device unit 1004) second user interface, which includes：(i) control application program in available function it is more It is a to represent specific to showing for application, and (ii) control system level function it is at least one it is system-level show and can represent, and It is multiple specific to application show in representing it is each and at least one it is system-level show can represent with first display size show Show；Via touch-sensitive slave display detection (for example, combining touch-sensitive slave display unit 1004 with detection unit 1014) and multiple spies Due to application show in representing it is at least one specific to application show can represent contact input；And in response to detection To input, and when input keeps contacting with touch-sensitive slave display：Continue to show on basic display unit (for example, single with display Member 1012 combines main display unit 1002) it is used for the first user interface of application program, and shown on basic display unit (for example, with display unit 1012 combine main display unit 1002) at least one amplification that can represent shown specific to application Represent, and it is at least one specific to application show can represent amplification represent with more than first show size second show Size is shown.
According to some embodiments of computing system 1000, display is at least one to show that what can be represented puts specific to application It is big represent the amplification for being included in second user interface represent at least one amplification table that can represent of showing specific to application of display Show.
According to some embodiments of computing system 1000, the amplification at display second user interface represents to be included in second The amplification of user interface shows focus designator in representing, which is based at least partially on touch-sensitive slave display The input position that is contacted with touch-sensitive slave display position.
According to some embodiments of computing system 1000, focus designator includes the expression of countdown timer, and Processing unit is further configured to：It can represent that holding is contacted specific to showing for application with least one according to definite input More than the time of predetermined volume, update the expression of countdown timer with indicate countdown timer be it is movable (for example, Main display unit 1002 is combined with display unit 1012)；And had expired according to definite countdown timer, activation is at least One can represent (for example, can represent activation unit 1016 with showing) specific to showing for application.
It is at least one to represent and sliding block phase specific to showing for application according to some embodiments of computing system 1000 Association, and activate and at least one can represent to include basis (or more generally, in order to allow) at least specific to showing for application One showing to represent to update along the movement of sliding block and at least one shows that what can be represented puts specific to application specific to application It is big to represent.
According to some embodiments of computing system 1000, processing unit is further configured to：In input in touch-sensitive pair At display with it is at least one specific to application show can represent that holding contacts when, at touch-sensitive slave display detection touch hand Gesture, the touch-sensitive slave display are not contacted and at least one can represented (for example, being combined with detection unit 1012 specific to showing for application Touch-sensitive slave display unit 1004)；And in response to detecting Flick gesture, activation is at least one to show energy specific to application Represent (for example, can represent activation unit 1016 with showing).In some embodiments, touch-sensitive slave display includes having at least One specific to application show the first area that can represent and with it is multiple specific to application show in representing other show The second area (that is, these other show can represent not represent specific to showing for application including at least one) that can be represented, and Flick gesture is received at second area, therefore is not contacted and at least one can be represented specific to showing for application.
According to some embodiments of computing system 1000, processing unit is further configured to：In touch-sensitive slave display Place's detection (for example, combining touch-sensitive slave display unit 1004 with detection unit 1012) predefined gesture, the predefined hand Gesture manipulates level of zoom, which is used to show at basic display unit at least one shows what can be represented specific to application Amplification represents；And in response to detecting predefined gesture, when manipulating level of zoom using predefined gesture, renewal Amplification at basic display unit represents (for example, combining main display unit 1002 with display unit 1012).
According to some embodiments of computing system 1000, keep continuous with touch-sensitive slave display according to definite input Contact exceedes the time of predetermined volume, at least one to show that the amplification that represented represents to be shown in main display specific to application On device.
It is multiple to show each in representing specific to application according to some embodiments of computing system 1000 Selected via one or more inputs at touch-sensitive slave display.
According to some embodiments of computing system 1000, second housing also includes physical keyboard at least in part.
According to some embodiments of computing system 1000, second housing is not connected to the first shell.
According to some embodiments of computing system 1000, second housing is a part for wearable computing devices.
According to the principle that some embodiments, Figure 11 shows the calculating system configured according to the various embodiments The functional block diagram of system 1100 (according to some embodiments, also referred to as electronic equipment 1100).The functional block of the system optionally by Hardware, software, firmware or the combinations thereof of the principle of various described embodiments are performed to realize.The skill of this area Art personnel should be appreciated that the functional block described in Figure 11 is optionally combined or is separated into sub-block, various described to realize Embodiment principle.Therefore, description herein optionally supports any possible combination of functional block as described herein Or separation or further restriction.For the ease of discussing, computing system 1100 is implemented as portable computing system 100 (Figure 1A). In some embodiments, computing system 1100 is realized according to any one of equipment/system shown in Figure 1A-Fig. 2 D.
As shown in figure 11, computing system 1100 include be configured as display information main display unit 1102 (for example, Touch-sensitive display system 112 is also referred to as main touch-screen, main touch-sensitive display and main touch-screen display, Figure 1A), be configured as The touch-sensitive slave display unit 1104 of contact, gesture and other users input, and processing list are received on touch-sensitive slave display Member 1110.System 1100 optionally includes the physical keyboard unit 1105 for being configured as receiving input through keyboard, and in some realities Apply in scheme, optional physical keyboard unit includes touch-sensitive slave display unit 1104 in second housing, this is outside second Shell is different from the first shell for including main display unit 1102.In some embodiments, the first shell and second housing can (for example, being the embodiment of laptop computer for wherein computing system 1100) rotatably is connected, and in other embodiment party In case, the first shell and second housing are not connected to and can be a part (example for the independent computing device to form system 1100 Such as, the first shell is a part for laptop computer, and second housing is specific installation such as wearable computing devices The part of (as intelligent watch)).Processing unit 1110 and main display unit 1102, touch-sensitive slave display unit 1104, with And optionally physical keyboard unit 1105 couples.In some embodiments, processing unit 1110 includes display unit (for example, aobvious Show unit 1112), detection unit 1114 (for example, detection unit 1114), and showing can represent activation unit (for example, show can table Show activation unit 1116).
Processing unit is configured as：Display with display unit 1112 (for example, combine basic display unit list on basic display unit 1102) member is used for the first user interface of application program；Display is (for example, with 1112 knot of display unit on touch-sensitive slave display Close touch-sensitive slave display unit 1104) second user interface, which includes：(i) controlling can use in application program The multiple of function can represent that and at least one of (ii) control system level function system-level shows energy specific to showing for application Represent；Via touch-sensitive slave display detection (for example, combining touch-sensitive slave display unit 1104 with detection unit 1114) more It is a specific to application show in representing first specific to application show first on representing input；It is and defeated first Enter with first specific to application show can represent that holding contacts when：(1114 knot of detection unit is used via the detection of touch-sensitive slave display Close touch-sensitive slave display unit 1104) do not show the on representing second input specific to application first, and in response to inspection Measure the second input, activation first can be represented (for example, can represent to activate unit 1116 with showing) specific to showing for application.
According to some embodiments of computing system 1100, processing unit is further configured to：In response to detecting One input and first input with first specific to application show can represent that holding contacts when：Continue to show on basic display unit Show that (for example, combining main display unit 1102 with display unit 1112) is used for the first user interface of application program；And Display (for example, combining main display unit 1102 with display unit 1112) first shows energy specific to application on basic display unit The amplification of expression represents, wherein amplification represents to show with the second display size more than the first display size.
According to some embodiments of computing system 1100, display is at least one to show that what can be represented puts specific to application It is big represent the amplification for being included in second user interface represent at least one amplification table that can represent of showing specific to application of display Show.
According to some embodiments of computing system 1100, the amplification at display second user interface represents to be included in second The amplification of user interface shows focus designator in representing, which is based at least partially on touch-sensitive slave display The input position that is contacted with touch-sensitive slave display position.
It is at least one to represent and sliding block phase specific to showing for application according to some embodiments of computing system 1100 Association, and activate and at least one can represent to include basis (or more generally, in order to allow) at least specific to showing for application One showing to represent to update along the movement of sliding block and at least one shows that what can be represented puts specific to application specific to application It is big to represent.
According to some embodiments of computing system 1100, processing unit is further configured to：In touch-sensitive slave display Place's detection (for example, combining touch-sensitive slave display unit 1104 with detection unit 1114) predefined gesture, the predefined hand Gesture manipulates level of zoom, which is used to show at basic display unit at least one shows what can be represented specific to application Amplification represents；And in response to detecting predefined gesture, when manipulating level of zoom using predefined gesture, renewal Amplification at basic display unit represents (for example, combining main display unit 1102 with display unit 1112).
According to some embodiments of computing system 1100, keep continuous with touch-sensitive slave display according to definite input Contact exceedes the time of predetermined volume, at least one to show that the amplification that represented represents to be shown in main display specific to application On device.
According to some embodiments of computing system 1100, operated according to definite touch-sensitive slave display with may have access to pattern, Show and at least one show that the amplification that can represent represents specific to application.
According to some embodiments of computing system 1100, it is multiple specific to application show each in representing and It is at least one it is system-level show can represent select via one or more inputs at touch-sensitive slave display.
According to some embodiments of computing system 1100, second housing also includes physical keyboard at least in part.
According to some embodiments of computing system 1100, second housing is not connected to the first shell.
According to some embodiments of computing system 1100, second housing is a part for wearable computing devices.
For illustrative purposes, description above is described with reference to specific embodiment.However, illustration above Property discussion be not intended to limit or limit the invention to disclosed precise forms.According to teachings above content, very much Modification and variations are all possible.Selection and description embodiment are to most preferably illustrate the principle of the present invention And its practical application, so as to so that others skilled in the art can be most preferably using with being suitable for being conceived Special-purpose various modifications described embodiment of the invention and various.

Claims (40)

1. a kind of method, including：
At computing system, the computing system include one or more processors including basic display unit, memory first outside Shell, and the second housing of the touch-sensitive slave display different from the basic display unit is included at least in part：
First user interface of the display for application program on the basic display unit；
Second user interface is shown on the touch-sensitive slave display, the second user interface includes controlling the application program The multiple of interior available function can be represented specific to showing for application, wherein the multiple every in representing specific to showing for application It is a show can represent with first display size show；
Via the touch-sensitive slave display detection with it is the multiple specific to application show in representing it is at least one specific to The input that can represent contact is shown in application；And
In response to detecting the input, and when the input keeps contacting with the touch-sensitive slave display：
Continue first user interface of the display for the application program on the basic display unit；
Shown on the basic display unit it is described it is at least one show that the amplification that can represent represents specific to application, wherein it is described extremely Few one is shown that the amplification that can be represented is represented with the second display size more than the described first display size specific to application Display.
2. according to the method described in claim 1, wherein show described at least one specific to described in the showing and can represent of application Amplification represent the amplification for being included in the second user interface represent in display it is described it is at least one specific to showing for application can table The amplification shown represents.
3. according to the method described in claim 2, wherein show that the amplification at the second user interface represents to be included in institute The amplification for stating second user interface represents interior display focus designator, and the focus designator is based at least partially on described The input on touch-sensitive slave display is positioned with position that the touch-sensitive slave display contacts.
4. according to the method described in claim 3, wherein described focus designator includes the expression of countdown timer, and institute The method of stating includes：
According to determining that the input at least one can represent that holding contacts and exceedes predetermined volume specific to showing for application with described Time, update the expression of the countdown timer to indicate that the countdown timer is movable；And
Had expired according to the definite countdown timer, activation is described at least one to be represented specific to showing for application.
5. according to the method described in claim 4, wherein：
It is described it is at least one can represent associated with sliding block specific to showing for application, and
Activating described at least one can represent to include at least one showing energy specific to application according to described specific to showing for application Represent updated along the movement of the sliding block it is described it is at least one specific to application show can represent the amplification expression.
6. according to the method described in claim 2, wherein described touch-sensitive slave display include have it is described it is at least one specific to Application show the first area that can represent and with it is the multiple specific to application show in representing different from described in extremely Few one is shown that other that can represent show the second area that can be represented specific to application, and the method further includes：
At least one showing specific to application at the first area of the input with the touch-sensitive slave display When can represent to keep contact, the Flick gesture at the second area of the touch-sensitive slave display is detected；And
In response to detecting the Flick gesture, activation is described at least one to be represented specific to showing for application.
7. method according to any one of claim 1 to 6, further includes：
Predefined gesture is detected at the touch-sensitive slave display, the predefined gesture manipulates level of zoom, the contracting Put rank be used at the basic display unit show it is described it is at least one specific to application show can represent the amplification expression； And
In response to detecting the predefined gesture, when manipulating the level of zoom using the predefined gesture, more The amplification at the new basic display unit represents.
8. method according to any one of claim 1 to 6, wherein according to determine input with the touch-sensitive slave display Continuous contact is kept more than the time of predetermined volume, at least one amplification table that can represent of showing specific to application Show and be shown on the basic display unit.
9. method according to any one of claim 1 to 6, wherein according to the definite touch-sensitive slave display with addressable Pattern operate, display it is described it is at least one specific to application show can represent the amplification expression.
10. method according to any one of claim 1 to 6, wherein the multiple specific in the showing and can represent of application It is each show can represent to input via the one or more at the touch-sensitive slave display to select.
11. method according to any one of claim 1 to 6, wherein the second housing also inclusion at least in part Manage keyboard.
12. method according to any one of claim 1 to 6, wherein the second housing is not connected to outside described first Shell.
13. according to the method for claim 12, wherein the second housing is a part for wearable computing devices.
14. a kind of computer-readable recording medium for storing executable instruction, the executable instruction is by with one or more First shell of a processor including basic display unit, and the touch-sensitive pair different from the basic display unit is included at least in part When the computing system of the second housing of display performs so that the computing system performs the operation for including the following：
First user interface of the display for application program on the basic display unit；
Second user interface is shown on the touch-sensitive slave display, the second user interface includes controlling the application program The multiple of interior available function can be represented specific to showing for application, wherein the multiple every in representing specific to showing for application It is a show can represent with first display size show；
Via the touch-sensitive slave display detection with it is the multiple specific to application show in representing it is at least one specific to The input that can represent contact is shown in application；And
In response to detecting the input, and when the input keeps contacting with the touch-sensitive slave display：
Continue first user interface of the display for the application program on the basic display unit；
Shown on the basic display unit it is described it is at least one show that the amplification that can represent represents specific to application, wherein it is described extremely Few one is shown that the amplification that can be represented is represented with the second display size more than the described first display size specific to application Display.
15. computer-readable recording medium according to claim 14, wherein showing described at least one specific to application Show the amplification that can represent represent the amplification for being included in the second user interface represent in display at least one spy Show that the amplification that can be represented represents due to application.
16. computer-readable recording medium according to claim 15, wherein showing the described of the second user interface Amplification represents that the amplification for being included in the second user interface shows focus designator in representing, the focus designator is extremely The input being at least partly based on the touch-sensitive slave display is positioned with position that the touch-sensitive slave display contacts.
17. computer-readable recording medium according to claim 16, wherein the focus designator is determined including countdown When device expression, and the operation performed by the computing system includes：
According to determine the input with it is described it is at least one specific to application show can represent to keep contacting exceed it is predetermined The time of amount, updates the expression of the countdown timer to indicate that the countdown timer is movable；And
Had expired according to the definite countdown timer, activation is described at least one to be represented specific to showing for application.
18. computer-readable recording medium according to claim 17, wherein：
It is described it is at least one can represent associated with sliding block specific to showing for application, and
Activating described at least one can represent to include at least one showing energy specific to application according to described specific to showing for application Represent updated along the movement of the sliding block it is described it is at least one specific to application show can represent the amplification expression.
19. computer-readable recording medium according to claim 15, wherein the touch-sensitive slave display includes having institute State at least one showing the first area that can represent and can be represented specific to showing for application with the multiple specific to application In be different from it is described it is at least one show that other that can represent show the second area that can be represented specific to application, and by described The operation that computing system performs includes：
At least one showing specific to application at the first area of the input with the touch-sensitive slave display When can represent to keep contact, the Flick gesture at the second area of the touch-sensitive slave display is detected；And
In response to detecting the Flick gesture, activation is described at least one to be represented specific to showing for application.
20. the computer-readable recording medium according to any one of claim 14 to 20, wherein by the computing system The operation performed includes：
Predefined gesture is detected at the touch-sensitive slave display, the predefined gesture manipulates level of zoom, the contracting Put rank be used at the basic display unit show it is described it is at least one specific to application show can represent the amplification expression； And
In response to detecting the predefined gesture, when manipulating the level of zoom using the predefined gesture, more The amplification at the new basic display unit represents.
21. the computer-readable recording medium according to any one of claim 14 to 20, wherein described defeated according to determining Enter and kept for the continuous time contacted more than predetermined volume with the touch-sensitive slave display, it is described at least one specific to application Show that the amplification that can represent represents to be shown on the basic display unit.
22. the computer-readable recording medium according to any one of claim 14 to 20, wherein described tactile according to determining Quick slave display is operated with may have access to pattern, the display at least one amplification table that can represent of showing specific to application Show.
23. the computer-readable recording medium according to any one of claim 14 to 20, wherein it is the multiple specific to Application shows that each showing in representing can represent select via one or more inputs at the touch-sensitive slave display Select.
24. the computer-readable recording medium according to any one of claim 14 to 20, wherein the second housing is also Physical keyboard is included at least in part.
25. the computer-readable recording medium according to any one of claim 14 to 20, wherein the second housing is not It is connected to first shell.
26. computer-readable recording medium according to claim 25, sets wherein the second housing is wearable computing A standby part.
27. a kind of computing system, including：
One or more processors；
First shell, first shell include basic display unit；
Second housing, the second housing include the touch-sensitive slave display different from the basic display unit at least in part；With
Memory, the memory storage are arranged to the one or more journeys performed by one or more of processors Sequence, one or more of programs include being used for the instruction so that the computing system performs the operation for including the following：
First user interface of the display for application program on the basic display unit；
Second user interface is shown on the touch-sensitive slave display, the second user interface includes controlling the application program The multiple of interior available function can be represented specific to showing for application, wherein the multiple every in representing specific to showing for application It is a show can represent with first display size show；
Via the touch-sensitive slave display detection with it is the multiple specific to application show in representing it is at least one specific to The input that can represent contact is shown in application；And
In response to detecting the input, and when the input keeps contacting with the touch-sensitive slave display：
Continue first user interface of the display for the application program on the basic display unit；
Shown on the basic display unit it is described it is at least one show that the amplification that can represent represents specific to application, wherein it is described extremely Few one is shown that the amplification that can be represented is represented with the second display size more than the described first display size specific to application Display.
28. computing system according to claim 27, wherein showing described at least one can represent specific to showing for application The amplification represent the amplification that is included in the second user interface represent in display it is described at least one specific to application Show that the amplification that can be represented represents.
29. computing system according to claim 28, wherein showing that the amplification at the second user interface represents bag Include the display focus designator in the amplification at the second user interface represents, focus designator at least part ground Positioned in the input on the touch-sensitive slave display with position that the touch-sensitive slave display contacts.
30. computing system according to claim 29, wherein the focus designator includes the expression of countdown timer, And the operation performed by the computing system includes：
According to determine the input with it is described it is at least one specific to application show can represent to keep contacting exceed it is predetermined The time of amount, updates the expression of the countdown timer to indicate that the countdown timer is movable；And
Had expired according to the definite countdown timer, activation is described at least one to be represented specific to showing for application.
31. computing system according to claim 30, wherein：
It is described it is at least one can represent associated with sliding block specific to showing for application, and
Activating described at least one can represent to include at least one showing energy specific to application according to described specific to showing for application Represent updated along the movement of the sliding block it is described it is at least one specific to application show can represent the amplification expression.
32. computing system according to claim 28, wherein the touch-sensitive slave display is included with described at least one Showing the first area that can represent and be different from the multiple specific to showing in representing for application specific to application It is described it is at least one show that other that can represent show the second area that can be represented specific to application, and held by the computing system The capable operation includes：
At least one showing specific to application at the first area of the input with the touch-sensitive slave display When can represent to keep contact, the Flick gesture at the second area of the touch-sensitive slave display is detected；And
In response to detecting the Flick gesture, activation is described at least one to be represented specific to showing for application.
33. the computing system according to any one of claim 27 to 32, wherein as described in performing the computing system Operation includes：
Predefined gesture is detected at the touch-sensitive slave display, the predefined gesture manipulates level of zoom, the contracting Put rank be used at the basic display unit show it is described it is at least one specific to application show can represent the amplification expression； And
In response to detecting the predefined gesture, when manipulating the level of zoom using the predefined gesture, more The amplification at the new basic display unit represents.
34. the computing system according to any one of claim 27 to 32, wherein according to determine input with it is described touch-sensitive Slave display keeps continuous contact more than the time of predetermined volume, at least one institute that can represent of showing specific to application Amplification expression is stated to be shown on the basic display unit.
35. the computing system according to any one of claim 27 to 32, wherein according to the definite touch-sensitive slave display With may have access to pattern operate, display it is described it is at least one specific to application show can represent the amplification expression.
36. the computing system according to any one of claim 27 to 32, wherein the multiple show energy specific to application Each showing in expression can represent select via one or more inputs at the touch-sensitive slave display.
37. the computing system according to any one of claim 27 to 32, wherein the second housing is also at least in part Include physical keyboard.
38. the computing system according to any one of claim 27 to 32, wherein the second housing be not connected to it is described First shell.
39. the computing system according to claim 38, wherein the second housing is a part for wearable computing devices.
40. a kind of computing system, including：
One or more processors；
First shell, first shell include basic display unit；
Second housing, the second housing include the touch-sensitive slave display different from the basic display unit at least in part；With
For performing the device of method according to any one of claim 1 to 6.
CN201711007537.0A 2016-10-25 2017-10-25 System and method for enabling low visual acuity user to be interacted with touch-sensitive slave display Pending CN107977180A (en)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201662412752P 2016-10-25 2016-10-25
US62/412,752 2016-10-25
DKPA201770595 2017-07-31
DKPA201770595A DK179492B1 (en) 2016-10-25 2017-07-31 Systems and methods for enabling low-vision users to interact with a touch-sensitive secondary display
US15/791,251 2017-10-23
US15/791,251 US10649636B2 (en) 2016-10-25 2017-10-23 Systems and methods for enabling low-vision users to interact with a touch-sensitive secondary display

Publications (1)

Publication Number Publication Date
CN107977180A true CN107977180A (en) 2018-05-01

Family

ID=62012690

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711007537.0A Pending CN107977180A (en) 2016-10-25 2017-10-25 System and method for enabling low visual acuity user to be interacted with touch-sensitive slave display

Country Status (2)

Country Link
CN (1) CN107977180A (en)
WO (1) WO2018081112A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111870938A (en) * 2020-07-09 2020-11-03 天津津航计算技术研究所 Control rod serial port drive design method based on windows under vxworks system
CN113094134A (en) * 2021-04-06 2021-07-09 安徽中科美络信息技术有限公司 Display method and device of software interaction interface suitable for old people

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI748462B (en) * 2019-05-20 2021-12-01 仁寶電腦工業股份有限公司 Hearing test device and hearing test method

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102122226A (en) * 2010-01-07 2011-07-13 索尼公司 Display control apparatus, display control method, and display control program
US20130050090A1 (en) * 2011-08-31 2013-02-28 Lenovo (Singapore) Pte. Ltd. Information handling devices with touch-based reflective display
CN103513879A (en) * 2013-04-26 2014-01-15 展讯通信（上海）有限公司 Touch control device and display control method and device thereof
CN104137048A (en) * 2011-12-28 2014-11-05 诺基亚公司 Provision of an open instance of an application
CN104679334A (en) * 2015-03-02 2015-06-03 南京物联传感技术有限公司 Data interaction display system and data interaction display method
CN104965583A (en) * 2015-06-19 2015-10-07 北京晶点科技有限公司 Flat plate type mobile terminal with at least one auxiliary touch display screen module
CN105573656A (en) * 2015-12-31 2016-05-11 深圳市金立通信设备有限公司 Icon response method and terminal

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5132028B2 (en) * 2004-06-11 2013-01-30 三菱電機株式会社 User interface device
US7694231B2 (en) * 2006-01-05 2010-04-06 Apple Inc. Keyboards for portable electronic devices
US9043725B2 (en) * 2007-07-27 2015-05-26 Sony Corporation User interface with enlarged icon display of key function
CN103891300A (en) * 2011-10-19 2014-06-25 汤姆逊许可公司 Remote control with feedback for blind navigation
CN105359065B (en) * 2013-05-02 2019-04-02 辛纳普蒂克斯公司 The multifunction push key of additional function and each function preview is provided

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102122226A (en) * 2010-01-07 2011-07-13 索尼公司 Display control apparatus, display control method, and display control program
US20130050090A1 (en) * 2011-08-31 2013-02-28 Lenovo (Singapore) Pte. Ltd. Information handling devices with touch-based reflective display
CN104137048A (en) * 2011-12-28 2014-11-05 诺基亚公司 Provision of an open instance of an application
CN103513879A (en) * 2013-04-26 2014-01-15 展讯通信（上海）有限公司 Touch control device and display control method and device thereof
CN104679334A (en) * 2015-03-02 2015-06-03 南京物联传感技术有限公司 Data interaction display system and data interaction display method
CN104965583A (en) * 2015-06-19 2015-10-07 北京晶点科技有限公司 Flat plate type mobile terminal with at least one auxiliary touch display screen module
CN105573656A (en) * 2015-12-31 2016-05-11 深圳市金立通信设备有限公司 Icon response method and terminal

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111870938A (en) * 2020-07-09 2020-11-03 天津津航计算技术研究所 Control rod serial port drive design method based on windows under vxworks system
CN113094134A (en) * 2021-04-06 2021-07-09 安徽中科美络信息技术有限公司 Display method and device of software interaction interface suitable for old people
CN113094134B (en) * 2021-04-06 2022-10-18 中科美络科技股份有限公司 Display method and device of software interaction interface suitable for old people

Also Published As

Publication number Publication date
WO2018081112A1 (en) 2018-05-03

Similar Documents

Publication Publication Date Title
US11619991B2 (en) Device control using gaze information
CN107797658B (en) Equipment, method and graphic user interface for tactile mixing
JP6908753B2 (en) Virtual computer keyboard
CN104903834B (en) For equipment, method and the graphic user interface in touch input to transition between display output relation
CN104885050B (en) For determining the equipment, method and the graphic user interface that are rolling or selection content
CN108762605B (en) Device configuration user interface
CN106462283B (en) Calculate the character recognition in equipment
CN104471521B (en) For providing the equipment, method and graphic user interface of feedback for the state of activation for changing user interface object
CN206178562U (en) Electronic device and information processor
CN106605196B (en) remote camera user interface
CN104487927B (en) For selecting the equipment, method and graphic user interface of user interface object
CN105264479B (en) Equipment, method and graphic user interface for navigating to user interface hierarchical structure
US11847378B2 (en) User interfaces for audio routing
US20200379713A1 (en) Methods and user interfaces for sharing audio
CN109690445A (en) Special locking mode user interface
CN110209290A (en) Gestures detection, lists navigation and items selection are carried out using crown and sensor
CN107924277A (en) For manipulating equipment, method and the graphic user interface of user interface by physical gesture
CN109196455A (en) application program shortcut for CARPLAY
CN109219781A (en) Display and update application view group
CN109313528A (en) Accelerate to roll
CN107728906A (en) For moving and placing the equipment, method and graphic user interface of user interface object
US11670144B2 (en) User interfaces for indicating distance
CN108700949A (en) For the tactile time feedbacking based on wrist of loss of sight user
CN107491283A (en) For equipment, method and the graphic user interface of the presentation for dynamically adjusting audio output
US11960615B2 (en) Methods and user interfaces for voice-based user profile management

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination