CN103329062A

CN103329062A - Multi-screen user interface with orientation based control

Info

Publication number: CN103329062A
Application number: CN2011800578603A
Authority: CN
Inventors: A·德帕兹
Original assignee: Flex Electronics Id Co ltd
Current assignee: Flex Electronics Id Co ltd
Priority date: 2010-10-01
Filing date: 2011-09-22
Publication date: 2013-09-25
Also published as: US20200348800A1; US9001158B2; US20120084719A1; WO2012044510A3; US20120081303A1; US20200089391A1; US20120081309A1; US11537259B2; US20120081307A1; US20120084737A1; US8872731B2; MX2013003424A; US11599240B2; US20120081278A1; CN103403658A; WO2012044527A3; US20120081267A1; US8866763B2; US20120084690A1; CN103403658B

Abstract

Control of a plurality of displays of a computing device in response to the change in orientation of the computing device. The computing device may be a handheld computing device with a plurality of displays that are concurrently visible by a user. The displays may be capable of displaying a graphical user interface (GUI). The plurality of displays may be modified in response to a change in orientation of the handheld computing device. The modification may include expanding a GUI that is displayed in a single display when in a first orientation to occupy at least two of the plurality of displays in response to the change in orientation.

Description

Has the multi-screen user interface based on the control in orientation

Related application

The application requires following U.S. Provisional Application No.: the U.S. Provisional Application sequence number 61/389,000 that is entitled as " DUAL DISPLAY WINDOWING SYSTEM " that on October 1st, 2010 submitted to; The provisional application sequence number 61/389,117 that is entitled as " MULTI-OPERATING SYSTEM PORTABLE DOCKETING DEVICE " that on October 1st, 2010 submitted to; And the provisional application sequence number 61/389,087 that is entitled as " TABLET COMPUTING USER INTERFACE " of submission on October 1st, 2010.Each of above provisional application and each part are attached to this by all quoting.

Background technology

Along with calculating and the communication function of handheld computing device becomes more powerful, to be adapted for handheld computing device and use for user interface (interface) mechanism of personal computer exploitation by trial, user interface and the display element of this equipment are evolved.But this of adaptive existing user interface mechanism attempts having run into various obstacles.

For example, many current handheld computing devices utilize physical keyboard for user interface.Exist in orientation (orientation) and fasten the many different embodiments of the physical keyboard (keypad) of change with the pass of device screen.But in each case, physical keyboard occupies the certain proportion of the physical space of this equipment, and has increased the weight of equipment.Except the shortcoming of size and weight, physical keyboard can not by with dispose based on the identical mode of the user interface of touch screen.Though some constrained form of physical keyboard is current have key originally on one's body such as the configurable demonstration on electric ink (eInk) or OLED surface to allow reconfiguring these keys, even in these cases, also can not revise the physical layout of key.But, only can change the value that is associated with secondary or physical bond on the keyboard.

Additive method can provide user's configurability of the increase of physical keyboard.These methods can comprise can be added to key with the plastics covering at the keyboard top of sticker and/or label or the expression difference in functionality external member of the function of reference modification.For example, intention is used for the ZBoard keyboard of laptop computer or desktop computer purposes and has incorporated double-deck physical keyboard into, and this bilayer physical keyboard separates key and layout thereof being connected of signal with sending to this machine.So, the different physical keyboards grafting that are used for different application can be inserted into support, allow configurability completely, make that the orientation of key and layout also are configurable except the function indication of key.This model can expand to handheld computing device; But, the speed that this modular keyboard can change function than the touch screen user interface slowly many.In addition, for each possible function external member, the user must carry other secondary or physical bond layout, and this has greatly increased overall physical size and the weight of this embodiment.An advantage of the physical keyboard of handheld computing device is that user's input space is extended outside user's display space, makes not block any screen space between active stage in user interface in shell, user's the finger of these keys itself, key or the sensing equipment.

A large amount of handheld computing devices uses little touch screen display to send demonstration information to the user, and receives the input from the user.In this case, though the configurability of equipment may greatly increase, and the user may obtain various user interfaces and select, and this dirigibility will be paid a price.That is the shared screen space that this layout need be between display and user interface.Though also have this problem in the touch screen display/user interface techniques of other types, the relatively little physical dimension of handheld computing device causes at the figure that shows with for the anxiety that receives between the zone of importing and providing.For example, small displays has also retrained display space, this may increase the difficulty of understanding action or result, and keyboard or other user interface mechanism place on the application of use or a side of application in use, make this application be extruded to display in addition more in the fraction.Therefore, the individual monitor touch-screen solution of problem that has solved the dirigibility of user interface may be created fuzzy, the VC of display and action and concern even the more substantial problem between user interface and the display.

Therefore, the individual monitor touch panel device is benefited from the user interface dirigibility, but because its limited screen space weakens, and makes when the user just imports information by display in the equipment, may seriously hinder the ability of understanding the information in the display.When the complex interaction that needs between display and the interface, such as the layer on handling map, play games or revises when using the data that receive etc. from science, this problem is aggravated under several critical situation.This conflict between user interface and the screen space has seriously limited can be with the degree of intuitive manner use based on the user interface that touches.

Summary of the invention

First aspect comprises the method for a plurality of displays of controlling handheld computing device.This method comprises described handheld computing device is arranged in the first orientation.When this equipment was in first orientation, first display in described a plurality of displays showed first screen.This method also comprises and described handheld computing device is placed on the second orientation that is different from described first orientation by move described handheld computing device from described first orientation on first direction, and in response to this placement, revise described a plurality of display, make described first to use and to be displayed on described first display and on second display in described a plurality of display.

Second aspect comprises handheld computing device.This equipment comprises processor.In addition, this equipment comprises first display that is in the operative communication of processor.This first display can operate to show first application screen.And this equipment comprises second display that is in the operative communication of processor.This second display can operate to show second application screen different with first application screen.This equipment also comprises the accelerometer that is in the operative communication of described processor, and this accelerometer can operate to analyze the orientation of described handheld computing device, to determine whether described handheld computing device is in one of a plurality of orientation.And the content of described first display and described second display can be controlled in response to the orientation of the handheld computing device of being determined by described accelerometer by processor.

The third aspect comprises the method for a plurality of displays of controlling handheld computing device.This method comprises described handheld computing device is arranged in first orientation.This method also comprises described handheld computing device is placed on second orientation, make when described handheld computing device is in described second orientation, first display in described a plurality of display is in leading location of displays, and second display in described a plurality of display is in the subordinate location of displays.This method comprises that also the orientation of the described handheld computing device of sensing changes to described second orientation, and change to described second orientation in response to the orientation, revise described a plurality of display, make first application that when described handheld computing device is in described first orientation, shows at described first display be displayed on described at least first display and second display.

Numerous characteristics refinement and other characteristic can be applicable to above aspect.Can use these feature refinement and additional features separately or with any combination.So, with each feature of the following feature that comes into question can but must not use with any other feature or the combination of features of any aspect given herein.

In one embodiment, first orientation can be the people image aspect, and second orientation can be landscape orientation.This method can also comprise uses accelerometer to come this placement of sensing.In another embodiment, this method can also comprise by on the second direction opposite with described first direction from described first orientation ambulatory handheld computing equipment, described handheld computing device is positioned in the third party position that is different from described first orientation and second orientation.And when handheld computing device being positioned in the third party position, described first application can be maintained in first display, and the content of described second display can not change.

Movement between the arbitrary orientation of described handheld computing device in described first orientation, second orientation and third party position comprises the angular motion of described handheld computing device.For example, described first direction can comprise turning clockwise of described handheld computing device, and described second direction can comprise turning clockwise of described handheld computing device.

In another embodiment, this method can also comprise when described handheld computing device is in described first orientation, shows with second at described second display and uses second screen that is associated.This method can also comprise by move described handheld computing device from described first orientation on the second direction opposite with described first direction, described handheld computing device is positioned on the third party position that is different from described first orientation and second orientation, and in response to this location, change described a plurality of display, make described first to use and to be displayed on described first display and on second display in described a plurality of display.

In above-described embodiment arbitrarily, can cause described first display in described second orientation, to be positioned at respect to gravity above described second display in the movement on the described first direction.On the contrary, can cause described second display in described second orientation, to be positioned at respect to gravity above described first display in the movement on the described second direction.

In one embodiment, one of described first application and described second application comprise the hierarchical application sequence.In this, these two application can be the hierarchical application sequences.This method can also comprise when described handheld computing device is in one of described second orientation and described third party position, receive the gesture input at described handheld computing device place, and receive in response to this, change described first display or described second display with show described first use and described second application in different one.Described gesture input can be directive, and described change can depend on the direction of described gesture input.

In another embodiment, leading location of displays can be with respect to gravity above the subordinate location of displays.This method can also comprise described equipment is positioned in the third party position, make when described handheld computing device is in described third party position, second display in described a plurality of display is in leading location of displays, and described first display in described a plurality of display is in the subordinate location of displays.Change that can this orientation of sensing, make this method comprise that also the direction in response to described handheld computing device changes to described third party position, revise described a plurality of display, make when being in described first orientation, to be expanded to being presented on described at least first display and described second display in second application screen that described second display shows.

Description of drawings

Fig. 1 is the synoptic diagram of the embodiment of handheld computing device.

Fig. 2 A-D is the diagrammatic representation of an embodiment of the handheld computing device in the various operational instances.

Fig. 3 A-K is the diagrammatic representation of an embodiment of the handheld computing device that provides in diverse location, orientation and operational instances.

Fig. 4 comprises the diagrammatic representation for the various gesture inputs of control handheld computing device.

Fig. 5 A and 5B comprise wherein the diagrammatic representation of an embodiment that is shown the handheld computing device of dissimilar screens by handheld computing device.

Fig. 6 A and 6B are in response to the change in orientation and the diagrammatic representation of the embodiment of the handheld computing device that operates.

Fig. 7 A and 7B are in response to the change in orientation and the diagrammatic representation of other embodiment of the handheld computing device that operates.

Fig. 8 is in response to the change in orientation and the diagrammatic representation of an embodiment of the handheld computing device that comprises at least two displays that operates.

Fig. 9 is the diagrammatic representation that comprises the embodiment of the handheld computing device of at least two displays of running in response to the change in orientation and gesture input.

Figure 10 is in response to the change in orientation and gesture input and the diagrammatic representation of another embodiment of the handheld computing device that comprises at least two displays of running.

Figure 11 is in response to the change in orientation and gesture input and the diagrammatic representation of an embodiment of the handheld computing device that comprises at least two displays of running.

Figure 12 A and 12B provide the synoptic diagram of two embodiment of the handheld computing device of touch-sensitive device.

Figure 13 is the diagrammatic representation of the embodiment of gesture input.

Specific embodiment

The disclosure relate generally to for the input of the mutual gesture of computing equipment.Interface (interface) control specifically be applicable to control have can be on handheld portable devices the equipment of one or more displays of display graphics user interface (GUI).Following discloses can be applied to show and in response to other computing equipments of GUI (for example in various embodiments, laptop computer, flat computer, desktop computer, touch screen monitor etc.), and be not intended to limit and be handheld computing device, unless spell out.

Fig. 1 describes the embodiment of handheld computing device 100.Handheld computing device 100 can comprise first display 102 and second display 104.In addition, though followingly can illustrate and describe two displays (102,104) about the function of each embodiment of handheld computing device, can provide the handheld computing device that comprises more than two displays.In any case, first display 102 and second display 104 can be controlled independently.Display can operate to show shown image or " screen ".As used herein, term " display " intention comprises device hardware, and " screen " intention is included in the demonstration image that produces on the display.In this, display is the physical hardware that can operate to present screen.Screen can comprise the major part of display.For example, screen can occupy except basic all viewing areas outside the zone (for example, menu bar, status bar etc.) that is exclusively used in other functions.Screen can be associated with application and/or the operating system carried out at handheld computing device 100.For example, can display application screen or desktop screen.Application can have the various screens that can be handled, as will be described further.In one embodiment, each display can have the resolution that 480 pixels multiply by 800 pixels, though also can provide higher and the display of low resolution more.

Screen can be relevant with operating system, application etc.In some instances, screen can comprise the interaction feature (for example, button, text area, switch area etc.) that can import to handle by the user.Can receive user's input by various input equipments (for example, physical keyboard, roller ball, directionkeys, touch sensing device etc.).In some instances, screen can only comprise figure, and does not receive the ability of user's input.In other examples, can provide graphic feature and input feature vector by screen.So, one or more displays of handheld computing device, the screen that shows at one or more displays and various user input device can comprise the GUI that allows the user to develop the function of handheld computing device.

Handheld computing device 100 can be configurable between primary importance and the second place.In primary importance, individual monitor (for example, first display 102 or second display 104) can be from user's visual angle as seen.When being in primary importance, display 102,104 both can be exposed to the outside of handheld device 100, but can arrange

display

102 and 104 in non-adjacent mode, make two displays 102,104 not visible (for example from user's visual angle simultaneously, display can be from the place ahead of equipment 100 as seen, and another display can be from the rear of equipment 100 as seen).

Handheld computing device 100 also may be provided in the second place, make display 102,104 can be simultaneously from user's visual angle visible (for example, display 102,104 can be orientated as adjacent one another are).Can in the second place, show display 102,104, make display 102,104 be arranged to back-to-back (end to end) or side by side.In addition, display 102,104 can be disposed in portrait (portrait) orientation or landscape (landscape) orientation with respect to the user.As will be discussed, people image aspect intention is described the following layout of handheld computing device, wherein, and the long limit of the display of this handheld computing device vertical orientated (for example, with respect to gravity or user visual angle).Landscape orientation intention is described below layout, wherein, and the minor face of the display of handheld computing device vertical orientated (for example, with respect to gravity or user visual angle).In addition, grow each display viewing areas independent or combination that limit and minor face can relate to one or more displays of equipment.Therefore, when arranging each display in the people image aspect, viewing area altogether can be disposed in the landscape orientation, and vice versa.In addition, display can be in different directions separately with screen.For example, when display is in landscape orientation, one or more screens can presented on the display, or vice versa in the people image aspect.

Can be in every way between primary importance (for example, individual monitor from user's visual angle as seen) and the second place (for example, at least two displays from user's visual angle simultaneously as seen) manipulation handheld device 100.For example, equipment 100 can comprise slide block (slider) mechanism, make first and second displays 102,104 parallel mode to be arranged in the second place adjacent to each other, and slidably arrive primary importance, at this primary importance place, visible individual monitor only, and another display is blocked by visible display.

Perhaps, equipment 100 can be arranged in doubling shell (clam shell) the type layout, wherein, provides hinge between first display 102 and second display 104, make that display 102,104 couples of users are simultaneously as seen when being in the second place (that is open position).Can provide display 102,104 in the inside of equipment 100 doubling shell part or outside doubling shell part.In this, when equipment is in primary importance (that is, make-position), display 102,104 both can be respectively from the place ahead of equipment and rear as seen.When equipment 100 is shown in an open position, can provide display 102,104 adjacent one another are and in parallel with each other.The replacement of design handheld computing device 100 is arranged, wherein, can provide the difference of display to arrange and/or relative position when being in first and second positions.

In addition, first display 102 and second display 104 may be provided in the equipment of overall separation.In this, the user can handle display 102,104, makes them can orientate (for example, side by side or back-to-back) adjacent one another are as.Display 102,104 can be in operation communication when being adjacent to locate, and makes that display 102,104 can be provided in the following more detailed mode that provides by (for example, via physics contact, radio communication etc.) when being adjacent to locate.Can provide the holding member (not shown) to remain on position adjacent with the display 102,104 that will separate.For example, holding member can comprise the magnet of cooperation, mechanical folder or fastener, elastomeric element etc.

Though with reference to two displays 102,104, the alternative embodiment of handheld device can comprise more than two displays before.In this, two or more displays can with according to before mode move, wherein, only individual monitor can be to the user as seen in primary importance, and a plurality of displays (that is, more than two displays) are as seen in the second place.In addition, in one embodiment, two

displays

102 and 104 can comprise the separated portions of single display device.So, first display 102 can be the first of this single display device, and second display 104 can be the second portion of this single display device.For example, handheld computing device 100(for example has first and second displays 102 and 104) can connector or the butted part of single display device (for example via) functionally be connected to this single display device, make first display 102 and second display 104 at this single display device simulation handheld computing device 100.So, the single display device can have the following stated corresponding to first and second parts first and second displays 102 of

handheld computing device

100 and 104 and that move in the mode that is similar to first and

second displays

102 and 104.

Handheld computing device 100 can also comprise one or more input equipments that can be used for receiving user's input.These input equipments can operate to receive the gesture input from the user, and therefore can be called the gesture sensor usually.A plurality of dissimilar gesture sensors can be provided.Some examples include but not limited to traditional input equipment (keyboard, tracking ball etc.), touch sensing device, optical sensor (for example video camera etc.) etc.Can be with reference to using touch sensing device to receive the gesture input in this discussion that comprises.But the mode of using touch sensing device to be not intended to be used for the input of reception gesture is restricted to only touch sensing device, and only is provided for the illustration purpose.Therefore, may be used to produce the function of the following discloses of importing about the gesture that receives at the touch sensing device place for any aforementioned manner that receives the gesture input.

In this, handheld computing device 100 can comprise at least the first touch sensor 106.In addition, handheld computing device can comprise second touch sensor 108.First touch sensor 106 and/or second touch sensor 108 can be touchpad devices, touch screen equipment or other suitable touch sensing devices.Example comprises capacitor type touch sensing panel, resistor-type touch sensing panel or uses the equipment of other touch sensing technology.First touch sensor 106 and/or second touch sensor 108 can use in conjunction with a part (for example, finger, thumb, hand etc.), writing pencil or other acceptable touch sensing Interface Mechanism well known in the prior art of user's body.In addition, first touch sensor 106 and/or second touch sensor 108 can be many touch apparatus of a plurality of touches of sensing simultaneously.

First touch sensor 106 can be corresponding to first display 102, and second touch sensor 108 can be corresponding to second display 104.In an embodiment of handheld computing device 100, first display 102 and first touch sensor 106 comprise first touch screen display 110.In this, first touch sensor 106 can be transparent or translucent, and locate with respect to first display 102, making that the correspondence that receives at first touch sensor, 106 places touches can be 102 relevant with first display (for example, with first display 102 on the screen that presents carry out alternately).Similarly, second display 104 and second touch sensor 108 can comprise second touch screen display 112.In this, second touch sensor 108 can be located with respect to second display 104, make that touch that second touch sensor, 108 places receive can be 104 relevant with second display (for example, with second display 104 on the screen that presents carry out alternately).Perhaps, first touch sensor 106 and/or second touch sensor 108 can provide discretely with display 102,104.In addition, in optional embodiment, can only provide single touch sensor, this single touch sensor allows to be used for control first display 102 and both inputs of second display 104.Can also or provide this single touch sensor integratedly with displays separated ground.

In this, first and second touch sensors 106,108 can have and display 102,104 essentially identical area occupied (footprint) at handheld computing device 100.Perhaps, touch sensor 106,108 can have and comprises and be less than display 102, whole area occupied of 104.In addition, touch sensor 106,108 can comprise and extend beyond display 102,104 area occupied, makes to provide touch sensor 106, at least a portion of 108 with display 102,104 nonoverlapping relations.As described further below, perhaps, can provide touch sensor 106,108 by complete nonoverlapping relation, make touch sensor 106,108 area occupied and display 102,104 area occupied different fully.

For example, with reference to figure 12A and 12B, the various possible layout for first display 102, second display 104 and touch sensor 106', 106 " and 108 " has been described.In Figure 12 A, first display 102 and second display 104 are arranged to side by side, make boundary line (crease) 196 separate these displays.In this, first display 102 and second display 104 can be arranged in the doubling shell mould layout, make boundary line 196 comprise the hinge of the aforesaid pivot motion between first display 102 and second display 104 of permission.Touch sensor 106' can cross over first display 102 and both width of second display 104.In this, touch sensor 106' can cross over boundary line 196 and not interrupt.Perhaps, shown in Fig. 9 B, can be in the boundary line 196 either side the touch sensor 106 " and 108 " of separation is provided.In this, each of touch sensor 106 " and 108 " can be crossed over each width of first display 102 and second display 104 respectively.

In the arbitrary layout shown in Figure 12 A and the 12B, display (102,104) can also comprise the touch screen display that can use in combination with touch sensing part, and this touch sensing part provides discretely with touch screen display.Therefore,

display

102 and 104 boths can comprise touch screen display, and can provide

display

102 and 104 except touch sensing device 106', 106 " and 108 ".Therefore, the combination of the outer touch sensor of touch screen display (for example 110,112) and display (for example, 106', 106 ", 108 ") can be provided for individual equipment.Both locate touch sensor that can be outside touch screen display (110,112) and display (106', 106 ", 108 ") to receive and touch input.In this, the gesture of the reception of the sensor place outside screen display can have the function different with the same gesture that receives at the touch screen display place.And touch sensing device can be divided into a plurality of districts.The same gesture that receives in different districts can have different functions.For example, at the top of display or the number percent part of the touch sensing device at place, bottom (for example, 10%, 25% etc.) can be defined as the zone that the remainder with touch sensing device separates.Therefore, the gesture that receives in this zone can have the function different with the gesture that receives in the remainder of touch sensing device.

Handheld computing device 100 can also comprise processor 116.Processor 116 can be in the operative communication with data bus 114.Processor 116 can operate to control the function of handheld device 100 usually.For example, processor 116 can executive operating system, and can operate to carry out application.Processor 116 can be in and the communicating by letter of the one or more other assembly 120-134 of handheld computing device 100, as will be described below.For example, processor 116 can be in the direct communication with these one or more other assembly 120-134, or can be via data bus 114 and these one or more other component communications.In addition, though can describing these other assembly 120-134, following discussion is in operative communication with data bus 114, but in other embodiments, any other assembly 120-134 can be in the direct control of any other other assembly 120-134 and communicate by letter.In addition, processor 116 can operate to control independently first display 102 and second display 104, and can operate to receive input from first touch sensor 106 and second touch sensor 108.Processor 116 can comprise one or more different processors.For example, processor 116 can comprise one or more special ICs (ASIC), one or more field programmable gate array (FPGA), one or more general processor or aforesaid combination of operating to carry out machine readable code.

Handheld computing device can comprise can operate the battery 118 that electric power is provided with the assembly to various device and handheld device 100.In this, handheld computing device 100 can be of portable form.

Handheld computing device 100 can also comprise the memory module 120 that is in the operative communication of data bus 114.Memory module 120 can operate to store data (for example, application data).For example, storer 120 can be stored the various functions that can be come actuating equipment 100 by the machine readable code that processor 116 is carried out.

In addition, communication module 122 can be in via the operative communication of data bus 114 with one or more assemblies.Communication module 122 can operate to connect by cellular network, WiFi connection, hard-wired (hardwired) or other suitable modes of wired or wireless communication are communicated by letter.This handheld computing device 100 can also comprise antenna 126.Antenna 126 can be in operative communication with communication module 122 to provide wireless capability to communication module 122.Therefore, handheld computing device 100 can have telephone capability (that is, handheld computing device 100 can be smart phone equipment).

Audio-frequency module 124 can also be provided as being in the operative communication with data bus 114.Audio-frequency module 124 can comprise microphone and/or loudspeaker.In this, audio-frequency module 124 can capturing audio or generation sound.In addition, equipment 100 can comprise camara module 128.Camara module 128 can be in the operative communication with other assemblies of handheld computing device 100, catches and memory image or video helping.

In addition, handheld computing device 100 can comprise I/O module 130.I/O module 130 can provide the input and output feature for handheld computing device 100, make that handheld computing device 100 can be via connector or other devices and connect, in order to synchronous or other communications between handheld computing device 100 and another equipment (for example, peripherals, another computing equipment etc.) are provided.

This handheld computing device 100 can also comprise accelerometer module 132.Accelerometer module 132 can monitor that handheld computing device 100 is with respect to the orientation of gravity.In this, this accelerometer module 132 can operate to determine that handheld computing device 100 is in people image aspect or landscape orientation basically.Accelerometer module 132 can also be by orientation and/or mobile other control functions that provides that monitors handheld computing device 100.

Handheld computing device 100 can also comprise one or more hardware button 134.Hardware button 134 can be used for controlling the various features of handheld computing device 100.Hardware button 134 can have fixed function maybe can with context-sensitive so that the concrete function of button changed in operating period of handheld computing device 100.The example of this hardware button can include but not limited to volume control, home screen button, conclusion button, transmission button, menu button etc.

Also with reference to figure 2A-D, each screen of an embodiment of equipment is shown.Though a plurality of screens can be shown, only or some of a plurality of screens can be shown on the display of equipment at any one time.In this, can be by describing screen (for example, in the left side of display, on the right side of display, below another screen, above another screen etc.) with the relative position of display or other screen.Can logically set up these relations, make physical display not reflect this relative position.For example, screen can be moved to the left from display.Though display screen on display no longer, this screen can have the virtual or logical place in the left side of following display: this screen moves from this display.This logical place can and be embodied in the value of describing this screen (value of for example, storing in storer is corresponding to this screen) by User Recognition.Therefore, when aspect the relative position of other screens during with reference to this screen, can logically embody relation and in the display of equipment, physically do not reflect these relations.

Fig. 2 A-D can show can show at the various examples place of the operation of handheld device and be not intended to any concrete order or arrange a plurality of different screens that present.Can provide single screen application and multi-screen to use.Single screen application intention is described and can be produced the application that can at every turn only occupy the screen of individual monitor.The multi-screen intended application is described can produce the application that can occupy one or more screens of a plurality of displays simultaneously.In addition, multi-screen is used and can be occupied individual monitor.In this, multi-screen is used and can be had single screen pattern and multi-screen pattern.

In Fig. 2 A, show desktop sequence 136.Desktop sequence 136 can comprise a plurality of independent desktop screen 138a-138f.Therefore, each desktop screen 138 can occupy the whole of individual monitor (for example, first display 102 of Fig. 1 or second display 104) basically.Desktop screen 138a-138f can be in predefined procedure makes desktop screen 138a-138f occur continuously, and the order that desktop screen occurs can not resequenced.But, can (for example, in response to the user's input) desktop screen of sequentially navigating 138a-138f.That is to say that one or more can the input by the user among the desktop screen 138a-138f controlled and sequentially be presented on the handheld device.

In addition, Fig. 2 B shows the hierarchical application sequence 140 that multi-screen is used.Hierarchical application sequence 140 can comprise root screen 142, one or more node screen 144 and leaf screen 146.Root screen 142 can be the top-level view of hierarchical application sequence 140, the feasible father's screen that does not have corresponding to this root screen 142.Root screen 142 can be father's screen of node screen 144.It is one or more node screens 144 of father/son that the pass can be provided.The node screen can also be as father's screen of leaf screen 146.By leaf screen 146, mean that leaf screen 146 does not have the node screen 144 of such correspondence: this leaf screen 146 is father's screens of this corresponding node screen 144.So, the leaf screen does not have any child node screen 144.Fig. 2 C describes each

single screen application

148a, 148b and the 148c that sequentially arranges.Each of these single screen application can be used corresponding to different execution.For example, in Fig. 2 C, use 4, use 5 and use 6 and can carry out at equipment, and correspond respectively to each

single screen

148a, 148b and 148c.

Fig. 2 D also comprises aerial view 166.Can during the transfer (for example, screen is in the movement between first display and second display) of screen, use aerial view 166.Do not need the user that aerial view 166 is interpreted as effective GUI screen.Action (for example, this screen is with respect to the movement of one or more displays) about screen is only taking place to user notification in aerial view 166.The application that shows aerial view 166 does not need to end (rest), waits for, handles or understands input.Aerial view 166 can display screen or its expression, just as its just with to move to the amount of screen of second display from first display mobile pro rata, as will be discussed in more detail.In this, can use aerial view 166 with (in response to gesture) contact information about the position of screen during the transfer of screen.Although shown in Fig. 2 D be the grey screen, aerial view 166 only is intended to relate to the screen (for example, the screen in transfer) that can not receive input.In this, the demonstration of aerial view 166 can comprise and is illustrated in the animation just mobile or response of screen when changing etc. (for example, be revised as in the landscape configuration or from landscape configuration revise).

Fig. 3 A-K has described the display 102 of equipment possible in the various embodiment according to handheld computing device of the present disclosure, 104 various layouts and state.For example, when being in first (for example, closure) position, closed preceding display 168 can be as seen, as shown in Fig. 3 A.Closed preceding display 168 can be corresponding with first display 102 or second display 104.The preceding display 168 of the closure that shows can be occupied by desktop screen Dl138, as shown in Figure 3A.Perhaps, can in the preceding display 168 of closure, show the multi-screen application that has the application of single screen or be in single screen pattern.When this equipment was in the close position, closed back display 170 can be from the opposite side of display as seen, shown in Fig. 3 B.Closed back display 170 can show desktop screen or the application screen different with the preceding display 168 of closure, or can for example show aerial view 166(simply, display icon or other figures) and lack function as the interface.

Fig. 3 C describes the closing apparatus that is in landscape orientation 172a.In one embodiment, landscape configuration (that is, wherein, display is adjusted to display screen 148 in landscape orientation) may not be activated (enable), shown in Fig. 3 C.Perhaps, can enable landscape configuration, make that screen 148 is modified when sensor device on landscape orientation 172b, in order in landscape orientation, present screen 148, shown in Fig. 3 D.

This equipment can also be provided in second (for example, opening) position 174, shown in Fig. 3 E.In open position 174, arrange at least two displays 102,104, make two displays 102,104 both can be from user's favourable angle (vantage point) as seen.When being shown in an open position 174, can arrange two displays 102,104 in mode side by side.Therefore, two displays 102,104 each can show independent screen.For example, display 102,104 each can show

independent desktop screen

138a, 138b respectively.Though each

display

102 and 104 is in the people image aspect shown in Fig. 3 E, is appreciated that and in landscape orientation, arranges whole viewing area (comprise first display 102 and second display 104 both).Therefore, the equipment shown in Fig. 3 E is in landscape or people image aspect can to depend on display is to be used alone or common the use.If jointly be used as the single display device, then this equipment may be in landscape orientation, and if display is used alone, then the orientation shown in Fig. 3 E can be called as the people image aspect.

In addition, when this equipment is in open position 174 shown in Fig. 3 F, can also influences this equipment about the similar dependence of using the display that screen still separates as the single display device and be in people image aspect or landscape orientation.As will be appreciated, each single screen is in landscape orientation, if make and to use these displays discretely, then this equipment can be in landscape orientation.If as the single display device, then this equipment can be in the people image aspect.In any case shown in Fig. 3 F, single screen 148 can occupy first display 102, and second display 104 can show desktop screen 138.Can in landscape or portrait mode of figure, show single screen 148.Perhaps, the equipment that is on the open orientation 172 can show multi-screen GUI156, this multi-screen GUI156 can in the people image aspect shown in Fig. 3 G, occupy display 102,104 both, make each display be in landscape orientation.

Fig. 3 I-K describes the possible layout of the screen of multi-screen application 152.In a pattern, when this equipment was in the close position 168 shown in Fig. 3 I, multi-screen uses 152 can occupy individual monitor 102.That is to say that multi-screen uses 152 can be in single screen pattern.Alternatively, when this equipment was in open position shown in Fig. 3 J, multi-screen uses 152 still can occupy individual monitor 102 in single screen pattern.In addition, when this equipment is in open position shown in Fig. 3 K, multi-screen use 152 can expand to occupy display 102,104 both.In this, multi-screen application 152 also can be carried out in the multi-screen pattern.Can be provided for multi-screen application 152 is expanded to from single screen pattern the variety of option of multi-screen pattern.

For example, multi-screen uses 152 can be maximized to two screens that show from the single screen pattern that shows individual monitor in two displays, make in first display, to show father's screen, and node screen (for example, sub-screen) expands in second display.In this, can be the independently screen (for example, shown in Fig. 2 B) that comprises the part of hierarchical application sequence at each screen that shows in first and second displays.Perhaps, single screen pattern that multi-screen is used is convergent-divergent simply, makes that the content of single screen is scaled to occupy two displays.Therefore, the identical content that shows in single screen is scaled to occupy a plurality of displays, does not still provide other viewing areas or figure.In addition, but multi-screen used be maximized to the expansion that the multi-screen pattern may cause the viewing areas of this application from single screen pattern.For example, use if show multi-screen in single screen pattern, when being maximized to the multi-screen pattern, when the scaling of the figure that shows keeps identical, but the viewing areas that multi-screen is used can be expanded.In this, when convergent-divergent remains unchanged when in expansion, but the viewing areas that multi-screen is used can expand in second display.

In this, application can have about the attribute of the screen of this application and the configurable functionality of behavior.For example, application can be configured to single screen application or multi-screen is used.In addition, multi-screen is used and can be applied in the characteristic of the expansion between single screen pattern and the multi-screen pattern and configurable about multi-screen.These Configuration Values can be the default values that can change, and maybe can be the constant values for each application.These Configuration Values can be communicated to this equipment (for example, processor 116) and be applied on the equipment behavior when carrying out with indication.

Fig. 4 describes can be by the various diagrammatic representations of the gesture input of handheld computing device identification.Can partly locate to receive this gesture at one or more touch sensings of this equipment.In this, can use various input mechanisms just to generate as shown in Figure 4 gesture.For example, can use (one or more) finger of writing pencil, user or other equipment to activate touch sensing device in order to receive gesture.The use of gesture can be described the use of the input of deleting, this input of deleting need not be carried out the required FR movement of identical functions traditionally and obtain function.For example, can be by selecting and carry out the movement of screen between display at moving screen between the display, make FR movement between the display be used as input and receive.But this embodiment may be difficult to realize being that first and second displays may be included in the display part of discontinuous separation therebetween.So, gesture can be deleted mobile total movement, or provides the input of replacement to finish identical functions.Therefore, cross over the movement of first and second displays and can be deleted, make to receive gesture at single touch sensing device place.The use of gesture input is particularly suitable for handheld computing device and is, provides the limited input and the display space that are provided at usually on the handheld computing device, and whole actions of input may be difficult to carry out.

With reference to figure 4, circle 190 can be illustrated in the touch that the touch sensing device place receives.Circle 190 can comprise frame (border) 192, and the thickness of this frame 192 can indicate touch to be held static time span at the touch sensing device place.In this, clicking 186 has than long by the narrower frame 192 of 188 frame 192'.In this, long can relating to by 188, keep static at touch-sensitive display and reach than clicking the longer touch of 186 times.So, depend on touch and before movement, keep static time span, can register different gestures.

Drag 176 (by circle 190 expressions) touches that relate to the movement 194 that has in one direction.Drag 176 can relate to touch sensing device keep static certain time quantum that reaches frame 192 expressions begin touch.Contrast, (flick) 178 that slide can relate to the touch that the ratio that had before movement drags shorter residence time, " indicates as the narrow side frame 192 by slip 178.Therefore, again, can produce different gestures by making the residence time difference of touch before movement.This slip 178 can also comprise mobile 194.Drag and the direction of 178 the movement 194 of sliding can be called as the direction that drags or the direction of slip.Therefore, to the right drag the movement 194 that has to the right can be described drag 176.

In one embodiment, having mobile gesture (for example, aforesaid slip or drag gesture) may be limited to along first movement on single direction.Therefore, as long as do not interrupt with contacting of touch-sensing equipment, with the direction different along first on movement may be left in the basket.In this, gesture Once you begin, the movement on the direction that is not the axle that is registered along initial movable may be left in the basket, and perhaps may only register this and move component of a vector along this.

Though directive gesture shown in Figure 4 (for example, drag 176 and slide 178) only be included in the tangential movement after the initial touch, this may not be the actual movement that touches during this gesture.For example, in case begin in the horizontal direction to drag, the movement on the direction different with horizontal direction may not cause will be in the movement of the mobile screen of the direction that is different from horizontal direction.For example, also with reference to Figure 13, can with along direction 210 initial movable 204 beginning from left to right of beginning from left to right drag 176.Subsequently, when keeping with the contacting of touch sensing device, (off) direction that departs from that the user may import on the direction of the direction 210 that is different from beginning moves 206.In this, offset direction moves 206 and may not cause any movement of screen between two displays.In addition, the user may the importation offset direction move 208, wherein only mobile vector part is on the direction of direction 210 of beginning.In this, only the part offset direction moves 208 part and may cause the movement of screen between display.In brief, the movement of application screen between first display 102 and second display 104 can be restricted to along following single axle: display is arranged along this single axle.

At another embodiment that can operate to carry out and show the handheld computing device of a plurality of different application shown in Fig. 5 A and the 5B.Fig. 5 A has described first display 102 and has shown desktop screen 502.Replacedly, first display 102 can show single screen application 504.In addition, first display 102 can show the multi-screen application 506 with single screen pattern operation.Also shown in Fig. 5 A, first display 102 and second display 104 can operate to show multi-screen application 506, make to show the first screen 506' in first display 102, and show second screen 506 in second display 104 ".When in figure described here, showing that multi-screen uses 506, can provide expansion designator 508 to indicate this multi-screen to use 506 and can be expanded or be in the mode of extension shown in Fig. 5 A.In this, may on equipment, not provide expansion designator 508 practically, but in the figure at this, provide this expansion designator 508 can be expanded or be expanded the indication that shows at one or more displays as using.

Fig. 5 B has described may arranging of handheld computing device with at least two displays, and this handheld computing device can operate to show some dissimilar and screens of arranging when at least two displays of this equipment are visible simultaneously.For example, first display 102 can comprise the first screen 504a, and second display 104 can comprise the second screen 504b.Replacedly, first display 102 can show with first multi-screen of single screen pattern operation uses 506a, and second display 104 can show second multi-screen application 506b that carries out with single screen pattern.In addition, it can be hierarchical application that multi-screen uses 506, and making the first screen 506' of the multi-screen application 506 in the display 102 of winning is father's screens, and second screen 506 of the application of the multi-screen in second display 104 506 " is sub-screen.In addition, first display 102 can be operated and show with the multi-screen of single screen pattern operation when showing single screen 504 when second display 104 and use 506.Can unrestrictedly realize aforesaid other combinations, and these other combinations can also comprise with the screen combination of any other type ground and show desktop screen 502.

Fig. 6 A and 6B describe the display 602 of handheld computing device and change into first landscape orientation 540 and the second landscape orientation 540' from people image aspect 530.As finding out in Fig. 6 A that display 602 can be operated with display application screen 504.Replacedly, can show desktop screen, use or other screen modification with the multi-screen of single screen pattern operation, and these screens can have and following similar function.As shown in Figure 6A, can be on first direction 510 (for example, corresponding to the clockwise angular motion of handheld computing device) ambulatory handheld computing equipment, make handheld computing device be oriented in first landscape orientation 540.In this, application screen 504 can be maintained at (for example, application screen 504 may not change in response to the movement on the first direction 510) in the portrait mode of figure.Replacedly, shown in Fig. 6 B, application screen 504 can be in response to the orientation of handheld computing device from the change of people image aspect 530 to first landscape orientation 540 and change.In this, can come application screen 504' behind the display update corresponding to the landscape configuration of application screen 504.Application screen 504 whether change in response to the orientation between people image aspect 530 and first landscape orientation 540 changes modification application screen 504' and from the application screen 504' that revises change the type that can depend on application screen 504, the Configuration Values that whether can landscape configuration, show about application screen, about some other suitable control mode of the change of application screen 504.

In addition, display 602 can (for example, move in the counterclockwise direction), make display 602 be oriented among the second landscape orientation 540' on second direction 520.As shown in Figure 6A, application screen 504 may not change in response to the movement on the second direction 520, makes not revise application screen 504 when handheld computing device is in the second landscape orientation 540'.Shown in Fig. 6 B, the movement of this equipment on second direction 520 that makes handheld computing device be in the second landscape orientation 540' can cause application screen 504 to be modified, make that when this equipment was in the second landscape orientation 540', demonstration was corresponding to the application screen 504 of the modification of the landscape configuration of application screen 504 ".

In this, depend on the direction of movement of display or the position that obtains, can cause application screen 504 is revised as the application screen 504' or 504 of modification in the movement on the first direction 510 and the movement on second direction 520 ".That is to say, the application screen 504' and 504 that revises " can manifest in a similar manner to the user, but two screen 504' and 504 " can be in the mode that moves to the direction of landscape orientation 540 corresponding to handheld computing device from people image aspect 530, differently be orientated with respect to this equipment.

Turn to Fig. 7 A and 7B, the display 602 of handheld computing device can show with the multi-screen of single screen pattern operation uses 506.Display 602 can be mobile in first direction 510 or second direction 520, makes display 602 be oriented in first landscape orientation 540 respectively or among the second landscape orientation 540'.In an embodiment shown in Fig. 7 A, handheld computing device is positioned at the change that does not cause among first landscape orientation 540 or the second landscape orientation 540' multi-screen application 506.In another embodiment shown in Fig. 7 B, can revise multi-screen and use 506, make the application screen 506' or 506 of display 602 display updates ".It still is the second landscape orientation 540' and suitably being arranged that the application screen 506' and 506 that revises " corresponding to the application screen 506 with the landscape configuration operation, make the application screen 506' and 506 that revises " is in first landscape orientation 540 based on handheld computing device.

Fig. 8 describes the display 102 of handheld computing device when arranging that handheld computing device makes visible at least two displays 102 of user and 104, when handheld computing device is changed into first landscape orientation 540 and the second landscape orientation 540' from people image aspect 530,104 running.Depend on the direction (for example, first direction 510 or second direction 520) of the movement of handheld computing device, handheld computing device can be positioned as one of at least two landscape orientation.For example, the movement on first direction 510 can cause handheld computing device to be disposed in first landscape orientation 540, and the movement on second direction 520 can cause handheld computing device to be disposed among the second landscape orientation 540'.(for example on first direction 510 or the second direction 520) different movements can cause the different azimuth of this equipment.For example, based on the direction that this equipment moves, first display 102 can differently be located with respect to second display 104.

When this equipment was in people image aspect 530, in an example, this equipment can show in first display 102 with the multi-screen of single screen pattern operation used 506.Second display 104 can show the single screen of desktop screen 502 or certain other types.When second direction 520 is rotated, the result can be the orientation change to the second landscape configuration 540' simply, the feasible state (that is, which is used shown and is presented in which display) of keeping display.In this, the first display 102(this become bottom display) can show still that the multi-screen of carrying out with single screen pattern uses 506.Second display 104 can still show desktop screen 502.The gesture input (for example dragging gesture 176) that receives when being in landscape orientation 540 may not have function associated with it.That is to say that these gestures may be left in the basket or not cause the movement of screen 502,506 between display 102,104.Multi-screen application 506 with single screen pattern operation can be maintained at (as shown) in the portrait mode of figure, maybe can be adjusted in landscape configuration to show, still only occupies first display 102 simultaneously.Similarly, desktop screen 502 can be adjusted in landscape configuration and to show or maintain in the portrait mode of figure as mentioned above.

In Fig. 8, when handheld computing device by mobile and when moving to first landscape orientation 540 from people image aspect 530 at first direction 510, can change first display 102, make it be in the top location of displays, and can change second display 104, make it be in the bottom location of displays.Can use " top " and " bottom " to refer to display with respect to the position of gravity." top " and " bottom " can also refer to for the location of display from user's angle, and this can be and the relative position identical with respect to gravity maybe can be different.In addition, the top location of displays can be defined as leading location of displays.By leading location of displays, mean that the screen that shows at the display that is in leading location of displays can be expanded, if the extendible words of this screen.For example, the screen that shows at the display that is in leading location of displays can be extended in the display that is in the subordinate location of displays.Leading location of displays and subordinate location of displays can be definable, make top location of displays, bottom location of displays or certain other location of displays can be defined as leading location of displays or subordinate location of displays.

Therefore, equipment moves to the multi-screen that is operating in when first landscape orientation 510 shown in Figure 8 can cause being in people image aspect 530 in single screen pattern at first direction 510 and uses 506 changes, makes it carry out in dual screen mode.This can cause first display 102 to be positioned at second display, 104 tops corresponding to the movement on the first direction 510, the display of winning is become occupy leading location of displays.So, if the application of carrying out in first display 102 in the time of in being in portrait mode of figure 530 can be expanded to occupy more than a display, then change in the orientation of this equipment when making the display of winning be in leading location of displays, multi-screen in first display is used 506 screen and can be extended in the display (for example, second display 104 as shown in Figure 8) in the subordinate location of displays.So, when this equipment was in first landscape orientation, multi-screen was used 506 and can be expanded, and make the display 102 demonstration multi-screens of winning use 506 the first screen 506', and second display 104 showed second screen 506 of multi-screens application 506 ".When being in the multi-screen pattern, the gesture of reception (for example, dragging 176) can be carried out aforesaid and multi-screen and be used 506 functions that are associated.Define with respect to gravity therein among the embodiment of leading location of displays and subordinate location of displays, can determine the orientation of this equipment by using the accelerometer module of as above describing with reference to figure 1.The accelerometer module can operate to determine the orientation of this equipment, and to analyze in a plurality of displays which be topmost display with respect to gravity.This display can be defined as being in leading location of displays again.Therefore, in fact the screen that can be expanded is expanded when this equipment mobile, makes to show that wherein the display of this screen is in leading location of displays.When leading location of displays is defined as topmost display with respect to gravity, can be intuitively concerning the user about the function of the expansion of screen.In this, move when making that display is in topmost display with respect to gravity at this equipment, the effect that can cause User Recognition to go out is the screen used of multi-screen in the gravity effect drops to second display in the subordinate location of displays.Can not expand if occupy the screen of leading display, can seem what not to promote in second display just as gravity to the user.This function of screen can be simulated the physical boards that is subjected to gravity effect or the action of card.This can create user interface intuitively, thereby the user can control the expansion of screen in other displays about gravity to the mode of the concept of the effect of screen to meet the user.

Handheld computing device shown in Figure 9 moves to first landscape orientation 540 from people image aspect 530 and/or the second landscape orientation 540' makes the application of carrying out at the display that is arranged in leading location of displays be expanded another embodiment that strides across two displays.In Fig. 9, when being in people image aspect 530, this equipment can just be carried out, and makes father's screen 506' of multi-screen application 506 be presented in first display 102, and the sub-screen 506 of multi-screen application 506 " is presented in second display 104.Father's screen 506' or sub-screen 506 " can also be expanded to occupying this two displays.In this, as mentioned above, father's screen 506' or sub-screen 506 " any one expansion can cause screen any one expand to and occupy this two displays.In addition, father's screen 506' or sub-screen 506 " expansion can depend on which display is positioned at leading location of displays when handheld computing device changes to one of first landscape orientation 540 and second landscape orientation 540' from people image aspect 530.For example, when handheld computing device changed to first landscape orientation 540 by the movement on first direction 510 from people image aspect 530, first display 102 can be in the leading location of displays with respect to second display 104.This can be positioned at the situation of second display, 104 tops (for example making the display 102 of winning is topmost displays with respect to gravity) corresponding to first display 102 wherein.So, the father's screen 506' that when being in people image aspect 530, in first display 102, shows can be expanded to occupy first display 102 and second display 104 both.

On the contrary, if handheld computing device moves to the second landscape orientation 540' by the movement on second direction 520 from people image aspect 530, then second display 104 can be in leading location of displays, and first display 102 can be in the subordinate location of displays by the fact of second display 104 when be positioned at first display 102 with respect to gravity when second direction 520 moves above.So, when this equipment when second direction 520 moves, sub-screen 506 " can be expanded to occupy this two displays.

In addition, in case this apparatus orientation in first landscape orientation 540 or the second landscape orientation 540', can receive gesture input 176 with mobile between both show at first display 102 and second display 104 father's screen and the sub-screen.In this, when when first direction 510 moves to first landscape orientation 540, father's screen 506' can be expanded make its occupy first display 102 and second display 104 both.Receive at this equipment place make progress drag gesture 176 and can cause making and in two displays, show sub-screen 506 " change.For example, dragging the direction of gesture 176 can be corresponding to the sub-screen 506 that expands to perception after two displays at father's screen 506' " the position.That is to say, when expansion father screen 506' when occupying two displays 102 and 104, may make sub-screen 506 by expansion father screen 506' In the view of the user and " leave the subordinate display.So, the user can perception, sub-screen 506 " be positioned at second display, 104 belows, even sub-screen 506 is " no longer to the user as seen.Therefore, upwards dragging gesture 176 can be intuitively to the user, because when this equipment moves to first landscape orientation 540 from people image aspect 530, father's screen 506' can be expanded and cross over two displays, make to seem when being in landscape orientation 540 by first direction 510 that sub-screen 506 leaves display to father's screen 506' below.Therefore, upwards drag the movement that gesture 176 can cause sub-screen 506', make it occupy two displays 102,104.When sub-screen 506' just occupying first display 102 and second display 104 both the time subsequently drag down gesture 176 can cause the movement of father's screen 506', make it show at two displays 102 and 104.With the opposite direction of above-mentioned direction on drag gesture and can be left in the basket, or do not cause any movement of screen.

When this equipment moves to the second landscape orientation 540' by moving on second direction 520, may be In the view of the user shifts viewing areas onto by sub-screen 506 " is expanded to the subordinate display 102 sub-screen 506 from leading display " but with father's screen 506' below.Therefore, gesture input downwards 176 can cause father's screen 506' to show at two displays 102 and 104.Upwards dragging gesture 176 and can " be illustrated in first display 102 and second display 104 again with sub-screen 506 subsequently.With above-mentioned opposite direction on gesture can be left in the basket, or do not cause any movement of screen.In Figure 10, illustrate and when between people image aspect 530 and first landscape orientation 540 and/or the second landscape orientation 540', changing, have the function of the equipment of a plurality of displays 102 and 104.When being in people image aspect 530, using 506a with first multi-screen of single screen pattern operation can show in first display 102.Second multi-screen application 506b that carries out with single screen pattern can show in second display 104.When first direction 510 moved to first landscape orientation 540, first display 102 can be arranged in leading position with respect to second display 104 at equipment.That is to say that first display 102 can be positioned at second display, 104 tops with respect to gravity.This can cause by locating first display, 102, the first multi-screens and use 506a and be expanded and cross over two displays 102 and 104 so that first display 102 becoming the mode of leading display.Gesture input 176 subsequently can cause using the function that 506a is associated with first multi-screen.Equipment moves to the second landscape orientation 540' by the movement on second direction 520 from people image aspect 530 and can cause second display 104 to be positioned in respect to first display 102 the leading position.So, when handheld computing device rotates to the second landscape orientation 540', second multi-screen of when handheld computing device is in the people image aspect 530, in second display 104, carrying out use 506b can be expanded to occupy first display 102 and second display 104 both.Can receive gesture input 176, and when carrying out, gesture input 176 has with second multi-screen uses the function that 506b is associated in as directed landscape orientation 540.

Turn to Figure 11, show another embodiment of the handheld computing device of running in response to the orientation change of 530 to first landscape orientation 540 or the second landscape orientation 540' from the people image aspect.When in the people image aspect 530 when carrying out, multi-screen is used 506 and can be carried out in first display 102.Single screen application 504 can be carried out in second display 104.When first direction 510 movements made that this equipment is arranged in first landscape orientation 540, first display 102 can be arranged in leading position with respect to second display 104.Because the multi-screen of carrying out in first display 102 in the time of in being in people image aspect 530 is used 506 and can be expanded and cross over a plurality of displays, so feasible on the first direction 510 comprises multi-screen and uses movement that 506 display is in leading position and can cause multi-screen to use 506 expansion.Therefore, multi-screen use 506 can occupy first display 102 and second display 104 both.On the contrary, when when second direction 520 moves to second landscape orientation 540, second display 104 is when can be arranged in leading position when second direction 520 moves.Because single screen application 504 of carrying out in second display 104 when being in people image aspect 530 can not expand to a plurality of screens, so this equipment moves to the expansion that second landscape orientation 540 can not cause single screen application 504 in second direction 520.In this, when when second direction 520 moves, not arbitrarily any expansion of using, display 104 and 102 content can be kept constant, maybe can be rotated to show in landscape configuration.

Though detailed icon and described the present invention in accompanying drawing and above description, these diagrams and describing will be considered to feature be example rather than restriction.For example, some above-mentioned embodiment can make up and/or otherwise arrange (for example, can carry out processing element in proper order by other) with the embodiment of other descriptions.Therefore, should be appreciated that, only illustrate and described preferred embodiment and modification thereof, and the expectation protection institute in spirit of the present invention changes and revises.

Claims

1. method of controlling a plurality of displays of handheld computing device comprises:

Described handheld computing device is arranged in the first orientation;

When described handheld computing device was in first orientation, first display in described a plurality of displays showed first first screen of using;

Described handheld computing device is placed on the second orientation that is different from described first orientation by on first direction, moving described handheld computing device from described first orientation; And

In response to this placement, revise described a plurality of display, make described first to use and to be displayed on described first display and on second display in described a plurality of display.

2. method according to claim 1, wherein, described first orientation comprises the people image aspect, and described second orientation comprises landscape orientation.

3. method according to claim 2 also comprises and uses accelerometer to come this placement of sensing.

4. method according to claim 1 also comprises:

By on the second direction opposite with described first direction from described first orientation ambulatory handheld computing equipment, described handheld computing device is positioned in the third party position that is different from described first orientation and second orientation;

Wherein, when handheld computing device being positioned in the third party position, described first application is maintained in first display, and the content of described second display does not change.

5. method according to claim 4, wherein, the movement between the arbitrary orientation of described handheld computing device in described first orientation, second orientation and third party position comprises the angular motion of described handheld computing device.

6. method according to claim 5, wherein, described first direction comprises turning clockwise of described handheld computing device, and described second direction comprises turning clockwise of described handheld computing device.

7. method according to claim 1 also comprises:

When described handheld computing device is in described first orientation, show second screen that is associated with second application at described second display;

By on the second direction opposite with described first direction, moving described handheld computing device from described first orientation, described handheld computing device is positioned on the third party position that is different from described first orientation and second orientation; And

In response to this location, change described a plurality of display, make described first to use and to be displayed on described first display and on second display in described a plurality of display.

8. method according to claim 7 also comprises and uses accelerometer to come this location of sensing.

9. method according to claim 7 wherein, causes first display described in the described second orientation is positioned at described second display with respect to gravity above in the movement on the described first direction.

10. method according to claim 9 wherein, causes second display described in the described second orientation is positioned at described first display with respect to gravity above in the movement on the described second direction.

11. method according to claim 10, wherein, one of described first application and described second application comprise the hierarchical application sequence.

12. method according to claim 7 also comprises:

When described handheld computing device is in one of described second orientation and described third party position, receive the gesture input at described handheld computing device place; And

Receive in response to this, change described first display and one of described second display with show described first use and described second application in different one.

13. method according to claim 12, wherein, described gesture input is directive, and described change depends on the direction of described gesture input.

14. a handheld computing device comprises:

Processor;

First display is in the operative communication with described processor, and can operates to show first application screen;

Second display is in the operative communication with described processor, and can operates to show second application screen different with described first application screen; And

Accelerometer is in the operative communication with described processor, and the orientation that can operate to analyze described handheld computing device determines whether described handheld computing device is in one of a plurality of orientation;

Wherein, the content of described first display and described second display can be controlled in response to the orientation of the handheld computing device of being determined by described accelerometer by described processor.

15. a method of controlling a plurality of displays of handheld computing device comprises:

Described handheld computing device is arranged in the first orientation;

Described handheld computing device is placed on second orientation, make when described handheld computing device is in described second orientation, first display in described a plurality of display is in leading location of displays, and second display in described a plurality of display is in the subordinate location of displays;

The orientation of the described handheld computing device of sensing changes to described second orientation; And

Change to described second orientation in response to the orientation, revise described a plurality of display, make first application that when described handheld computing device is in described first orientation, shows at described first display be displayed on described at least first display and second display.

16. method according to claim 15, wherein, leading location of displays with respect to gravity above the subordinate location of displays.

17. method according to claim 16 also comprises:

Described equipment is positioned in the third party position, make when described handheld computing device is in described third party position, second display in described a plurality of display is in leading location of displays, and described first display in described a plurality of display is in the subordinate location of displays;

The sensing orientation changes to described third party position; And

Direction in response to described handheld computing device changes to described third party position, revise described a plurality of display, make when being in described first orientation, to be expanded to being presented on described at least first display and described second display in second application screen that described second display shows.

18. method according to claim 15, wherein said first orientation comprises the people image aspect.

19. method according to claim 18, wherein said second orientation comprises landscape orientation.

20. method according to claim 15, wherein, described sensing uses accelerometer.