CN1782977A - Data processing devices and systems with enhanced user interfaces - Google Patents

Data processing devices and systems with enhanced user interfaces Download PDF

Info

Publication number
CN1782977A
CN1782977A CNA2005101288360A CN200510128836A CN1782977A CN 1782977 A CN1782977 A CN 1782977A CN A2005101288360 A CNA2005101288360 A CN A2005101288360A CN 200510128836 A CN200510128836 A CN 200510128836A CN 1782977 A CN1782977 A CN 1782977A
Authority
CN
China
Prior art keywords
menu item
user interface
level
main menu
menu
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CNA2005101288360A
Other languages
Chinese (zh)
Inventor
马吉德·安瓦尔
杰克·麦金利
斯科特·A·詹森
詹姆斯·克莱维持
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Picsel Research Ltd
Original Assignee
Picsel Research Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Picsel Research Ltd filed Critical Picsel Research Ltd
Publication of CN1782977A publication Critical patent/CN1782977A/en
Pending legal-status Critical Current

Links

Images

Abstract

A graphical user interface for a data processing device providing a user friendly menu system and navigation capabilities. A menu system provides a first plurality of primary menu items to a display, each of the primary menu items having a visual field. A navigation module enables a user to navigate the menu system. A reveal process displays, within the visual field of a first primary menu item, a first plurality of secondary menu items associated with the first primary menu item, in response to a navigation to the first primary menu item, while continuing to display a remainder of the first plurality of primary menu items.

Description

Data processing equipment and system with user interface of enhancing
Technical field
The user interface that the present invention relates to data processing equipment and be used to operate this data processing equipment.
Background technology
The user-interface design of mobile phone and other small-sized data processing equipments has unique challenges, because its display screen zone is restricted, be restricted for the quantity that can be installed in the controller that also needs quick, simple and intuitive operation in this equipment.Mobile phone provides a lot of functions (as managing contact, establishment and transmission information, personalized phone setup and quarter-bell being set).Mobile phone user's Interface Design determines canned data in difficulty or ease that the user can navigation feature and their mobile phone basically.
Mobile phone user interface example comprise basic 5 to shake the depressor user interface, from Redmond, the WINDOWS SMARTPHONE of the Microsoft of WA and the NOKIA SERIES 60 of Finland NOKIA.These user interfaces have limited availability, and the user is difficult to realize required function.And the user causes confusion easily for keypress function.Can change the keypress function on these interfaces according to the content that button is pressed greatly.
And, SMARTPHONE and SERIES 60 TMDepend on the use soft key to a great extent, soft key is context-sensitive, multi-functional control, is usually located under next-door neighbour's display screen.And soft key can provide additional function to the user, and they have captured the screen area of preciousness on the display screen.
Summary of the invention
A challenge of mobile phone user's INTERFACE DESIGN user interface that just provide intuitively, easily learn, that operation is consistent, limited space can be predicted and be utilized most effectively to mode.The control that user interface need provide sufficient amount to be managing the phone of original complexity, and guarantees at any time the user not to be had too much control or option, obscures in order to avoid cause.Therefore, each side of the present invention is to provide more intuitive more effective user interface for mobile phone with other small-sized calculation element users.
On the one hand, the present invention relates to the graphic user interface of use in data processing equipment (having display screen and direction controller).User interface comprises menu system, and it comprises more than first the main menu item.User interface is all distributed a visible range for each the main menu item on the display screen of data processing equipment.In one embodiment, user interface is distributed a rectangle visible range for each the main menu item, and one on another.This visible range can comprise icon corresponding with the main menu item and Text Flag.
User interface also comprises a navigation module, is used to receive the input from the user, and is used in response to this input navigation menu system.In addition, user interface has display process, and this display process shows more than first second-level menu item.For example, as the icon of a horizontal line in the visible range of distributing to the main menu item, the user can navigate to this main menu item.Even when navigating to the main menu item, user interface also continues to show the remainder of more than first the main menu item.In one embodiment, navigate to first the main menu item in response to the user, user interface stops to be presented at any second-level menu item shown in the visible range of previous the main menu item that navigates to.
The second-level menu item that is shown by display process can comprise navigation and/or function shortcut.Select the navigation shortcut.The selection of navigation shortcut is provided to the route of the acceleration of the position in the menu system, is included in the route of the execution of basic data processing equipment function.From the main menu item 360 interior selection function shortcuts, the addressable additional function relevant with this main menu item.Menu item can also link with data content.Menu item can text and/or graphic icons represent.In one embodiment, control the choice menus item by triggering by selecting to handle the selection of being explained.In one embodiment, the choice menus item can select control to cancel by triggering the cancellation of selecting processing to be explained by cancellation.Thereby selection and cancellation select to handle the navigation between the menu level that provides in the menu system.
In one embodiment, which second-level menu item is user interface can determine to show based on the operated situation of data processing equipment.For example, in one embodiment, the second-level menu item is shown by the availability of Network Based or peripherals.
In one embodiment, user interface also comprises highlighted processing, with the menu item that has successfully been navigate to user's indication.The highlighted stacked order that can also comprise convergent-divergent, animation or change corresponding to visible range, text or the image of the menu item that the user navigate to.In one embodiment, non-highlighted menu item keeps static on display screen.Consequently, highlighted menu item may cover non-highlighted menu item.In another embodiment, highlighted menu item may be at least one non-highlighted menu item projection simulation shade.
Highlighted menu item can be selected by the selector switch of data processing equipment.The highlighted display additional information that causes of second-level menu item, for example but not determinate, corresponding to the Text Flag or the related data content of second-level menu item.In one embodiment, highlighted processing is used consistent highlighted effect to most of menu items of menu system.
In one embodiment, user interface is in response to user's choice menus item, and the applied several times zoom.Zoom can be by amplifying or dwindling module and control.This module can be selected to handle and integrate with selection and cancellation.In one embodiment, at least one Zoom effect is concentrated on the selected menu item.Can select, zoom concentrates on display screen central authorities.In a Zoom effect, in response to selecting a main menu item, user interface starts animation zoom conversion sequence, and this animation zoom conversion sequence comprises the described selection of convergent-divergent and replaces described more than first the main menu item with more than second the main menu item at least in part.In another example, in response to the selection of menu item, user interface starts the animation zoom, and it replaces menu item with data content at least in part.
In another example Zoom effect, last in the zoom conversion sequence selects to handle that more than second the main menu item is superimposed upon on selected more than first the main menu item of a part.The part that is superimposed upon more than second selected more than first menu item on the main menu item can be the version of the convergent-divergent of selected menu item.
User interface can also comprise cancellation selection processing, is used to start reverse zoom conversion sequence.Oppositely the zoom conversion sequence can consist essentially of the reverse of previous animation zoom conversion sequence.
Description of drawings
Below with reference to accompanying drawing, utilize the mode of example to describe embodiments of the invention, wherein:
Fig. 1 is the conceptual module figure according to the data processing equipment that comprises user interface of an illustrative embodiment of the present invention;
Fig. 2 A is a top view according to the illustrative data processing equipment input media of illustrative embodiment of the present invention to 2C;
Fig. 3 is the conceptual module figure according to the menu of an illustrative embodiment of the present invention;
Fig. 4 A to 4D, Fig. 5 A to 5E and Fig. 6 A to menu navigation, menu item that 6C is depicted as the various aspects according to the present invention select, menu item is highlighted and the embodiment of the menu item technology that " shows (reveal) ";
Fig. 7 A is the diagram of the embodiment of animation zoom conversion according to a further aspect of the invention to 7D;
Fig. 8 A is the diagram of another embodiment of animation zoom conversion according to a further aspect of the invention to 8C;
Fig. 9 A to 9B, Figure 10 A to 10B and 11A be example to 11B according to the demonstration of the zoom conversion of employing Fig. 7 of illustrative embodiment of the present invention and Fig. 8;
Figure 12 A is the diagram of the embodiment of another demonstration zoom function according to a further aspect of the invention to 12D;
Figure 13 A is to use with the consistent of data content zoom according to the menu level of passing through of illustrative embodiment of the present invention to 13D; With
Figure 14 A is the example according to the stacked order supertwist of illustrative embodiment of the present invention to 14B and Figure 15 A to 15C.
Embodiment
The user of data processing equipment typically feels that by the hardware input equipment and by receiving output (as via the audible sound or the Visual Display that show screen curtain or loudspeaker) comes with this equipment mutual.In data processing equipment inside, alternately by user interface control, this user interface will be changed from the input of input equipment, and generation output responds.
Data processing equipment
Fig. 1 is the conceptual module figure that comprises the data processing equipment 100 of user interface 102 according to an embodiment of the invention.In this illustrative embodiment, data processing equipment 100 is mobile phones.Data processing equipment 100 comprises an input media 104 and an output unit 106.Input media 104 receives the input from the user, and it is reached user interface 102 handles.Output unit 106 receives the output from user interface 102, and it is shown to the user.
In other embodiments, be not determinate for example, data processing equipment 100 can be phone, wireless phone, personal digital assistant, palm PC, digital camera or video camera, multimedia player, TV, satellite television terminal, CATV terminal, inter-vehicle information system, vehicle entertainment system, printer, scanner, facsimile recorder and data storage device.Characteristics and advantage about mobile phone data processing equipment 100 described here also may be embodied in any aforementioned means.
Input equipment 104 can make the user provide and be input to data processing equipment 100.Input equipment 104 comprises a direction controller 108, is used for the navigation between the item visual on the output device 106.Direction controller 108 comprises 4 actuators that are used for navigating up and down.Input equipment 104 also comprises selection control 110, is used to select item visual on the output device 106.In addition, input equipment 104 comprises a cancellation selection control 112, is used to cancel the item of previous selection.
Output device 106 is a display 114.Display 114 is for providing the LCD of colored output.Optionally output device 106 comprises gray level and black and white plasma display, cathode-ray tube (CRT), projection screen and other dynamic visual device that is suitable for.
Fig. 2 A is the top view according to the mobile phone data processing equipment 200 of illustrative embodiment of the present invention.Data processing equipment 200 comprises that a display 214 is as output device 106.Display 214 is a colour liquid crystal display device.About input equipment 104, data processing equipment 200 comprises one 5 to rocker switch 203.Five actuator 209a-209d around rocker switch 203 are as selection control 110.Other actuator 212 is as cancellation selection control 112.The relation of selection control 110 and cancellation selection control 112 is shown by a visual indication 207.Visual indication 207 is graphic features of a connection controller 110 and 112.In optional embodiment, visual indication 207 is physical features, as the surface on the data treatment facility 200 (topographical) feature.
Fig. 2 B is the top view for the optional input equipment 104 of data processing equipment 200 ' configuration according to another illustrative embodiment of the present invention.In data processing equipment 200 ', input equipment 104 comprises that four actuator 209a '-209d ' are as direction controller 108.Each actuator 209a '-209d ' is corresponding to a direction, and is upper and lower, left and right.Data processing equipment 200 ' comprises a selection control 210 ' and cancellation selection control 212 ' that is positioned at the common border circular areas that is formed by four actuator 209a-209d.
Fig. 2 C is data processing equipment 200 " top view of another optional input equipment 104 of configuration.Similar with data processing equipment 200 ', at data processing equipment 200 " in, input equipment 104 comprises four actuator 209a "-209d " as direction controller 108.Each actuator 209a '-209d ' is corresponding to a direction, and is upper and lower, left and right.Data processing equipment 200 " comprise be positioned at by actuator 209a "-209d " selection control 210 of the elliptical region that forms " and a cancellation selection control 212 ".
Control to data treatment facility 200 can be by above-mentioned switch, and the mode beyond button or the button provides.Can use the direction controller 108 (as mouse, touch pad, touch-screen/stylus, four-way rocker switch or the like) of other types that identical functions is provided, for the realization of touch-screen, can be by button screen visual or provide based on the order (as disclosed among the PCT patented claim WO 01/79980 " mapping to the symbol stylus gesture (symbolic stylus gestures mapped to interface commands) of interface command ") of gesture (gesture) and to select and cancellation selection control 110 and 112.
User interface
With reference to figure 1, data processing equipment 100 comprises a user interface 102 again.User interface receives input from the user, handles this input and show output according to handled input.User interface comprises a menu system 120 and a navigation module 122.In brief, menu system 120 partly determines to be presented at the output on the output device, and navigation module 122 offers the user and uses input equipment 104 to control the ability of this output.Menu system 120 and navigation module 122 are embodied as the software module of moving on universal or special processor.In optional embodiment, menu system 120, navigation module 122 or its part are implemented in the integrated circuit, as digital signal processor special IC, programmable logic array or other example, in hardware that is fit to.
Menu system
More specifically, menu system 120 comprises a menu 124, a highlighted processing 126 and a display process 128.Fig. 3 is the conceptual module figure that is included in the menu 324 in the menu system 120 according to illustrative embodiment of the present invention.Menu 324 comprises a plurality of the main menu item 360a-360h (being generically and collectively referred to as the main menu item 360) and a plurality of second-level menu item 362a-362m (being generically and collectively referred to as second-level menu item 362).Menu 124 is organized into menu level 364a-364d (being generically and collectively referred to as menu level 364) with menu item 360 and 362.Menu item 360 and 362 generally to other menu level 364, can carry out and handle or application or data provide inlet point, described data comprise text, image, audio frequency, video or multi-medium data.Menu is relevant with figure and/or text data (as icon and Text Flag), and menu item 360 and 362 is used for visually showing corresponding menu item 360 and 362.
Menu level 364 is generally classification.For example, have tree and branched structure.But classification does not need strictness.The menu level 364 of menu 324 can be overlapping, and the various menu item 360 and 362 can place a plurality of menu level 364.Some menu items 360 and 362 can utilize a plurality of paths to visit (" path " is meant that a series of menu items 360 and 362 that the user selects are to arrive given menu item 360 or 362) by menu 324.The content of menu level 364 (that is: menu item 360 and 362 addressable contents) is context-sensitive (although not needing in other embodiments).For example, menu 324 is in response to the data processing equipment 100 of the connection that detects peripherals, make additional menu item 360 and 362 and/or menu level 364 addressable.Similarly, menu 324 is according to the scope that data processing equipment 100 uses, and forbids menu item 360 or 362 or menu level 364.For example, the environment of being not good in connection or when data processing equipment 100 electric energy were low, menu 324 was forbidden communication function.
Menu level 364 comprises one or more the main menu items 360.For example, the top level menu 364a of menu 324 comprises the main menu item 360a and 360b, is designated " content " and " information " respectively.On first menu level 364, select master menu 360 can enter another menu level 364.For example, select contact the main menu item 360a can enter the second contact menu level 364b.
The main menu item 360 is related with one or more second-level menu item 362.For example, the main menu item 360b that is designated " information " is associated with the second-level menu item 362d and the 362e that are designated " fresh information " and " menu " respectively.Second-level menu item 362 provides navigation and/or function shortcut.
The navigation shortcut is connected to other menu level 364 and/or menu item 360 and 362 in the menu 324.The navigation shortcut is connected to menu level 364 and menu item 360 and 362 in the branch of menu 320 systems, and this menu hierarchy comprises second-level menu item 362 the main menu item related with it 360.The navigation shortcut also can be connected to menu level 364 or menu item 360 and 362 in other branches of menu 320 systems.Therefore, the navigation shortcut provides the path of quickening to avoid too much passing through of menu 324.When the shortcut target is leaf of menu tree and branched structure, the execution of function on the navigation shortcut log-on data treatment facility 100.For example, selection is designated " fresh information " and is positioned at the second-level menu item 362d of " information " the main menu item 360b, can start the function that generates fresh information.This can provide from menu level 364a to info menu level 364d and the shortcut easily of farther optional navigation to the user.
The function shortcut relates to the main menu item 360, and the function shortcut is activated from the main menu item 360.The functions of use shortcut can make the multinomial function in the single menu item 360 of user capture, thereby avoids using soft key or selector button.An example of function shortcut is for being designated " menu " and the second-level menu item 362e related with " information " the main menu item 360b.It links to each other with " info menu " menu level 364c, the user option that menu level 364c visit is abundant, as relate to " fresh information " and " viewing files folder " of the operation of " information " menu item 360b.Shortcut is predetermined by menu 320 devisers or author with the related of the main menu item.In addition, or optional, and the user can customize related personalization with reflection menu 120 and use.
Fig. 4 A-4D is at the top view that shows the data processing equipment 400 of the output of system of displayed menus 120 on the screen 414.Illustrative output among Fig. 4 A comprises 6 the main menu item 460a-460f, is designated " contact ", " information ", " calendar ", " camera ", " file browser " and " setting " respectively.Menu system 120 is distributed to the corresponding visible range 465a-465f that one of each the main menu item 460a-460f shows the main menu item therein.Visible range 465 is a collection of pixels, and for example it is set at rectangle or other geometric configuration that is used to differentiate the main menu item 460 and other menu items.
In Fig. 4 A, each the main menu item 460a-460f is assigned with 365, one of a visible range that are generally rectangle and is positioned on another, becomes vertical cylindricality.Each visible range 465a-465f comprises the main menu item 460a-460f corresponding icon related with it, and Text Flag.In addition, the visible range 365a (corresponding with the main menu item 360a among Fig. 3) that is designated " contact " is bigger than other visible ranges 465b-465e.Visible range 465a also comprises 3 second-level menu item 462a-462c.
Highlighted processing
Bigger visible range 465a indication the main menu item 460a of the main menu item 460a is effective.The effect of control triggering selection controller 110, by triggering, menu item 460 and 462 is effectively, below can further describe.The 465a of bigger visible range is by one in a plurality of visual cues of highlighted processing 126 generations, is effective thereby indicate at which menu item of given time or a plurality of menu item 460 and 462 to the user.Other visual cues that generated by highlighted processing comprise, but be not limited to, change color, startup and the main menu item 460 corresponding signs of visible range 465 and change the stacked order (stacked order) of visible range 465 with respect to the visible range 465 of other invalid menu items.Other visual cues can be used for further emphasizing effective menu item 460 and 462, comprise that the shade of using behind the visible range 465 is (by using stacked order, this shade can present three-dimensional appearance) and use transparent, thereby the content below allowing can be visual by the content part ground on upper strata.
Fig. 4 B is second top view of declarative data treatment facility 400 ' according to an embodiment of the invention.In this figure, the secondary the main menu item 460b ' that is designated " information " is effectively, and carries out highlight by highlighted processing 126.Be similar to the visible range 465a of the main menu item 460a among Fig. 4 A, the visible range 465b ' of the main menu item 460b ' is bigger than remaining visible range 465a ' and 465c '-465f '.Visible range 465b ' thus ratio and Fig. 4 A in visible invalid and be constant rate and the visible range 465b of highlight is more not eye-catching by comparison.
Fig. 4 C has shown at second-level menu item 462 when effective, also by highlighted processing 126 highlights.In Fig. 4 C, " information " the main menu item 460b " and " fresh information " second-level menu item 462d ' all be effective.The effective status of second-level menu item 462d ' by highlighted processing 126 by changing second-level menu item 462d ' the main menu item 460b on every side " visible range 465b " and the part color point out the user.Similar with highlight the main menu item 460, highlighted processing 126 can also and change stacked sequential scheduling to second-level menu item 462 change ratios, startup, with the effective status of indication second-level menu item 462.
In one embodiment, data processing equipment 100 uses similar visual cues highlighted and that move in major part (if not all) menu level 364 of menu system 120, feasible use is more prone to, and makes the operation of user interface more directly perceived for the user.But, under the situation that does not depart from scope of the present invention, various menu items 360 and 362 and in various menu level 364, can adopt different visual cues.
Display process
Usually, display process shows and the relevant additional information of a plurality of effective menu items that for example, because the main menu item 460a is effectively, data processing equipment 400 shows second-level menu item 462a-462c among Fig. 4 A.On the contrary, because the main menu item 460b ' is effectively, data processing equipment 400 ' shows second-level menu item 462d-462e.Use display technique, can show at least 4 second-level menu items 462 that obtain effective the main menu item 460 on the screen.But second-level menu item 462 only is a kind of additional information, and it can be shown explicitly by display process 128 and effective menu item.
Fig. 4 D is the 4th top view according to data processing equipment 400 of an illustrative embodiment of the present invention, and this embodiment is illustrated other forms of the data relevant with effective menu item that display process 128 shows.Data processing equipment 400 show corresponding 6 the main menu item 460a -460f of each information that go up storage with data processing equipment 400 .First the main menu item 460a is effective.Visible range 465a , consistent with the main menu item 460a , comprise three second-level menu item 462g-462i, with the similar mode of visible range 465a and 465b ', comprise relevant second-level menu item 462a-462c, 462d and 462e.Visible range 465a also comprises the extracts 466 with the corresponding message of the main menu item 460a .Do not comprise the extracts 466 of its related information with the corresponding visible range 465b of the main menu item 460b -460f -465f .
In addition, in response to the startup of second-level menu item 462, display process 128 shows the additional information relevant with second-level menu item 462.For example, in Fig. 4 C, second-level menu item 462d ' is effectively with highlighted.Under the icon of representing second-level menu item 462d ', Text Flag " fresh information " is shown to notify the function of user's second-level menu item 462d ' by display process 128.If second-level menu item 462 is called as " two demonstration " and handles for invalid then do not show information about second-level menu item 462.
Show with two display process and combine to make for new hand and expert it all is easy-to-use.The textual description of each operation can be mapped to and show screen 414, thereby before selecting any effective menu item, the function of notice custom menu item.About this point, present technique provides the attribute that is similar to the soft key mapping, and does not need additional secondary or physical bond and do not waste relevant screen space.Particularly, when an item was effective, function occurred as required, and the textual description of function can occur according to order.On the contrary, use the soft key method, the key mapping is fixed on the permanent display position.
The wider shortcut that display technique provides can be brought bigger use meaning.Particularly, many users will only use a smaller subset of the available function of data processing equipment 100 usually.The function that these normally used menu systems 120 at different levels conscientiously are set can obviously reduce the menu amount of navigation up and down at different levels, the whole functional that is generally used for special purpose can also be bundled in one or more the main menu items 360 or 460 corresponding common territories in.
Navigation module
Again with reference to figure 1, navigation module 122 provides the ability mutual with menu system 120 to the user.Navigation module 122 comprises respectively to be handled 130, selects processing 132 and cancellation to select to handle 134 in response to the direction of direction controller 108, selection control 110 and cancellation selection control 112.Usually, direction processing 130 change which the main menu item 360 and/or second-level menu item 362 are effective.Select processing 130 and cancellation to select to handle the effective menu level of 132 changes, and select control 130 to go back the beginning of the function on the control data treatment facility 100.
The direction navigation
As implied above, Fig. 4 A-4D is depicted as the navigation instruction of user's input of being explained by navigation module 122.As mentioned above, which or a plurality of menu item 360,362,460 and 462 of direction processing change is effective.Data processing equipment 400 among Fig. 4 A comprises direction controller 408.Direction controller 408 comprises 4 actuator 409a, 409b, 409c and 409d, corresponds respectively to upper and lower a, left side and right.Direction is handled 130 triggerings of explaining as the last actuator 409a and the following actuator 409b of instruction, to change effective the main menu item 460.For example, in Fig. 4 A, if the user has triggered time actuator 409b, then direction processing 130 will indicate menu system 1 20 that the main menu item 460a is ceased to have effect, and make the main menu item 460b effective, and the result is the demonstration of Fig. 4 B.Similarly, in Fig. 4 B, if the user has triggered last actuator 409a, then direction processing 130 will indicate menu system that the main menu item 460b ' is ceased to have effect, and make the main menu item 460a ' effective, the demonstration of result such as Fig. 4 A.
Left and right actuator 409c and 409d control the effective and invalid of second-level menu item 362 and 462.For example, in Fig. 4 B, the main menu item 460b ' is highlighted, shows two second-level menu item 462d and 462e.According to this state, user one triggers the right actuator 409d of direction controller 408, and direction is handled 130 and will be indicated menu system 120 to make second-level menu item 462d effective, shown in Fig. 4 C.If the user triggers right actuator 409d once more, second second-level menu item 462e ' among Fig. 4 C will be effectively also highlighted, and the additional information relevant with second-level menu item 462e ' also is shown.As an alternative, if the user depresses left actuator 409c, then second-level menu item 462d ' will cancel effectively, and data processing equipment 400 " will return the state that Fig. 4 B shows.
Select and the cancellation selection
When menu item 462 and 362 does not have when effective, select to handle 132 and cancellation select to handle 134 navigation that are used to allow between the menu level 364 of menu system 120.In response to user's triggering selection controller 110 (being called " selection "), select to handle and to navigate to menu level 364 downwards, and cancellation selects to handle 134 menu level 364 of navigating back.
For example, with reference to figure 4B and 4C, in Fig. 4 B, " information " the main menu item 460b is effective.When data processing equipment 400 ' is in this state, if user's triggering selection control 410 is selected to handle 132 and will be indicated menu system 120 to navigate to the menu level 364 of " information " menu branch of menu 124 downwards.Navigation results shows on apparent screen 414 of Fig. 4 D.Second menu level 364 of " information " menu branch of menu 124 comprises the main menu item 460a "-460f ", corresponding with each information.When data processing equipment 400 are in the state that shows among Fig. 4 D, if triggering cancellation, the user selects control 412, then cancellation is selected to handle and will be indicated menu system 120 upwards to return a menu level 364, causes the data processing equipment 400 ' output of Fig. 4 B.
Select to handle and cancellation selects to handle 132 and 134 also control data treatment facility 100 ' responses that the selection and the cancellation of second-level menu item 362 and 462 are selected.Whether the response of the selection of second-level menu item 362 or 462 is depended on the second-level menu item is function or navigation shortcut.
Fig. 5 A-5E is a plurality of top views according to a plurality of apparent screen 514 of the data processing equipment 500 of an illustrative embodiment of the present invention.A plurality of apparent screens 514 show navigation and the selection to second-level menu item 562.From the beginning screen that Fig. 5 A shows (as, demonstration when data processing equipment 500 powers up), press first and select control 110a, show the first menu level 564a (Fig. 5 B) with top the main menu item 560a, this main menu item is designated " contact ", highlighted and show its additional information.Press the next menu level 364 of selecting control 110 to navigate to " contact " branch of menu 124 once more.The second menu level 564b lists each contact.When the contacts list menu level shows first, get in touch corresponding top the main menu item 560a ' for effectively and highlighted (Fig. 5 C) with in the contacts list first.Highlighted the main menu item 560a ' comprises 4 the second-level menu item 562a-562ds corresponding respectively with the number of mobile phone of getting in touch and home phone number, the e-mail address of getting in touch and menu links.
When not have second-level menu item 562a-562d be effective, press the right actuator 509d of direction controller 508, the corresponding first second-level menu item 562a of Mobile Directory Number that starts Yu get in touch is shown in Fig. 5 D.In this stage, that is, mobile phone second-level menu item 562a is the effective stage, presses selection control 110 once more, starts to the call of the Mobile Directory Number of this contact, sees shown in the apparent screen 514 of Fig. 5 E.From the screen of Fig. 5 D, repeat to press cancellation selection control 110 is got back to Fig. 5 A by the menu path navigation beginning screen.
Fig. 6 A-6C is a plurality of top views of the data processing equipment 600 of the function shortcut selection of demonstration second-level menu item 662." menu " second-level menu item icon 662b of apparent screen 614 indication " information " the main menu item 660b of data processing equipment 600 is effectively with highlighted.Under this state, press selection control 610, select to handle 132 indication menu systems and make second-level menu item 662b effective in response to the user.Because second-level menu item 662b is corresponding to the function shortcut, so menu system shows the menu level 364 that second-level menu item 662b is linked, i.e. menu level 664b is shown in Fig. 6 B.Another menu level 664b is shown as the zone of the visualization of information territory 665b that is superimposed upon the former apparent screen 614 that comprises selected menu icon 662b amplification or zoom.The menu level 664b of Fig. 6 B also comprises visible range the 665a '-665c ' of a row level, upper and lower actuator 609a that can service orientation controller 608 and 609b and select control 610 to start and select visible range 665a '-665c '.Press the cancellation selection control 612 will show screen 614 return shown in Fig. 6 C the level, it is identical with Fig. 6 A.
According to a characteristic, the combined treatment of navigation module 122 and menu system 120 provides consistance to a certain degree, conventional design not this consistance with three kinds of basic operations at process user interface: the rank of upper and lower navigation feature classification; By pressing the function of the point in the abundant level of additional option; Optionally provide acceleration path so that move on to a concrete difference (navigation shortcut) from specified point of functional classification.
As the example of second kind of situation, the tabulation of all text messages of checking that it is received then selects customizing messages (as rank of downward navigation) with display message if the user demotes.But the user may not want to select (checking) this information, but deletes it, preserves it or obtain sender's details.This situation requires than the strict abundanter behavior that rising/the decline rank is provided.The example of the third situation is " homepage " option that turns back to top level menu that provides in low menu level.
According to illustrative embodiment, the present invention combines these three operating user interfaces in a solution, and it is simpler, more consistent, have more foreseeability and therefore more directly perceived than existing design.For example consequently: at any point of menu system, all possible user action only uses the four direction button upper and lower or across just addressable by " geography " navigation on screen.This and conventional design form contrast, and for example when conventional design, the user need leave simple direction and control and select to provide the soft key that enriches function, perhaps presses special use " option " button.In a configuration of the present invention, only the Geographic Navigation of service orientation control can insert each option, because rich functions and navigation shortcut can be shown as second-level menu item 362 in the scope of heading of four-way actuator.
In use, the navigation of user interface 102 is equal with using four-way control to pass the graticule mesh option of arranging on the whole screen two dimensional surface.Can consider to replace an option graticule mesh with next higher or lower hierarchical planes with selection/ cancellation selection control 110 and 112 vertical direction navigation in this notion " plane ".Therefore the navigation of user interface 102 can all be included in all the time in six actuator scopes using in a mode of making peace expection-and four direction adds and selects and cancellation is selected.Conventional design can not realize this uniformly stable level because they need the user can not expect in menu and the arbitrfary point is left a navigation mode and arrived another (for example soft key actuator), and make the interface complicated, the user is more found it difficult to learn practise and uses.
Visual effect
Can strengthen some characteristics of data processing equipment 100 and user interface 102 by the visual effect of using one or more following explanations.
Fig. 7 to 10 shows the figure zoom technology according to illustrative embodiment of the present invention.When selecting highlighted menu item 360 or 362, provide by animation zoom conversion sequence from the conversion of the current set of menu level 364, rather than replace current demonstration simply with the demonstration of next menu level 364 to next menu level 364.
Data processing equipment 100 uses two kinds of zoom conversions, i.e. zoom translation type 1 and zoom translation types 2 at least.To illustrate in greater detail this two kinds of zoom translation types below.In one embodiment, zoom translation type 1 is used to the conversion result of (for example, select the main menu item 360) (as Fig. 7) between the entree single-stage 364 or menu level 364 to data/content conversion (for example, the zoom from bottom menu level 364 to related content).On the contrary, zoom translation type 2 be used to show the conversion selected behind second-level menu item 362 icons (as Fig. 6,10 and 11B).
Fig. 7 A represents that conceptual initial screen shows, comprises row the main menu item 760a-760f (for example, corresponding to horizontal visible range 760a-760f of Fig. 4 A).Shown in shade among the figure, second the main menu item is highlighted 760b.Select highlighted menu item 760b can start animation zoom conversion sequence.Conversion sequence is from amplifying selected menu item 760b, so the menu item 760a of its partly fuzzy contiguous initial screen and 760c (that is, the screen area that occupies of the visible range 765 of selected item 760b further expands).This shows in Fig. 7 B, and the item 760b ' that amplifies has been described.
In this stage, the content of the visible range 765b ' of expansion is the content representation through the selected menu item 760b that amplifies.Along with visible range 765b ' continues expansion, the expression of the selected menu item 760b of amplification is replaced by the content representation of next menu level 764 '.Particularly, the content of the visible range 765b ' of expansion is replaced by the new the main menu item 760g-7601 of row, i.e. the menu item of the initial scale down demonstration shown in Fig. 7 C.The row of new the main menu item 760g-7601 expand to the final screen display of new menu level 764 ' shown in Fig. 7 D always, and it shows the new row of menu item 760g '-7601 ', and wherein first new the main menu item 760g ' is highlighted.
In the example of Fig. 4 A-4B and Fig. 7, the new menu level 364 of demonstration is full of screen area effectively.2 kinds of zoom translation types, the new menu level 364 of demonstration is not full of screen, but is superimposed upon the selected menu item 362 top (shown in Fig. 5 B) of the former menu level 364 of amplification.
The example of type 2 zooms conversion is shown in Fig. 8 A-8C, and is corresponding with the conversion between Fig. 5 A and the 5B.Fig. 8 A shows initial display screen, comprises row the main menu item 860a-860f.Highlighted the main menu item 860c comprises two second-level menu item 862a and 862b.Second-level menu item 862a is highlighted, and shows the information (" text string ") of more heterogeneous pass.The main menu item 860b adjacent and 860d with selected item by text " on " and D score represent.
Select highlighted second-level menu item 862a can start type 2 zoom conversion sequences.Shown in Fig. 8 B, the demonstration of zoom conversion sequence expansion the current set of menu level 864a and selected second-level menu item 862a ' near zone.In certain stage of sequence, the expression of new menu level 864b is superimposed in the expression of the current set of menu level 864a of expansion and with its expansion.Fig. 8 C shows final screen, and wherein new menu level 864b the main menu item 860a '-860d ' shows under the background of the expression of last menu level 864a the main menu item 860c of expansion.
The example of first and final screen of Fig. 9 A and the conversion of 9B display type 2 zooms, its embodiment also combines highlighted and display technique.In Fig. 9 A, " information " the main menu item 960a of the current set of menu level 964a is highlighted to show two second-level menu item 962a and 962b, and wherein second-level menu item 962b in right side " menu " is highlighted.This can provide the further demonstration of described text " menu ".
Select " menu " second-level menu item 962b can start the conversion of type 2 zooms, it is with the EOS of Fig. 9 B.Next menu level 964b and be designated as " viewing files folder " and the main menu item 960a ' that is highlighted shows together.Next menu level 964b also comprises the main menu item 960b ' and 960c ', and it is denoted as " viewing files folder " and " information setting ", is superimposed upon near the expression of the part that the initial figure of the selected second-level menu item 962b icon of amplification and Fig. 9 A shows.Note, can see the part of text " information " and " menu " among Fig. 9 B.
The use of zoom conversion has improved the visual logic of navigation of perception by menu 124 classifications, and the position sense of the current display screen in better menu 124 classifications is provided for the user.Use dissimilar zoom conversion (Class1 and the type 2 that is used for the shortcut conversion that for example, are used for the main conversion) will further improve the position sense of this menu 124 for dissimilar menu operations.
The quantity of the intermediate screen that the zoom conversion sequence is used can change as the duration of sequence.Usually, this sequence will be with the speed animation between per second 5 and 25 frames.The duration of sequence should be long enough to provide the visual Zoom effect of energy perception, but long to postponing normal phone operation to unacceptable degree.Usually, the duration of sequence can be in about 1/8 second to 1 second scope.The duration that can provide facility to come to select the sequence in the preset range for the user, and/or close effect.In the zoom conversion sequence, can use known " film " editor conversion of any kind of as shear, fade out, clear up and eliminate the content that to expand visible range to be transformed into new menu level content from the current set of menu item content of expanding.
When upwards navigating " returning " by classification, above-mentioned zoom " amplification " conversion can be simply oppositely so that provide identical visual logic at both direction.On this meaning, the effect of selection control 110 is by menu system 120 " amplification ", is " dwindling " and select the effect of cancellation selection control 112, so that the reflection of visual zoom is by the navigation direction of menu 120 classifications.
In one embodiment, the zoom conversion visually concentrates on the physical screen position of selected item usually.In Fig. 9 A-9B, zoom concentrates on the selected second-level menu 962b.Horizontal territory end comprises the conversion (as Fig. 4 A) of the main menu item menu level of representative icon in the left side for menu item, and zoom can concentrate on this icon.
Figure 10 A and 10B are depicted as the another example of menu level to the Class1 zoom conversion of content transition form.In this example, the conversion of Class1 zoom is used to open from info menu 1092 module of text message 1090.Figure 10 A display message menu 1092, wherein first the main menu item 1062a is highlighted, the extracts 1094 of display message content and three second-level menu item 1062a-1062c shortcut icons (all not having highlighted).Press and select control 110 can start the conversion of Class1 zoom, it is with the EOS of Figure 10 B.
In the case, the zoom conversion is visually concentrated on the upper left big envelope icon 1096 of Figure 10 A.Except that second-level menu item the 1062a '-1062c ' identical with Figure 10 A, Figure 10 B has shown complete information 1090 and further " zoom " second-level menu item 1062d.Notice that the left side second-level menu item 1062d of Figure 10 B is highlighted when information 1090 is opened, the text of explicit declaration " zoom ".This has shown how the bottom stage of menu hierarchies shows second-level menu item 1062 icons that are in " two demonstration " state.Though do not need, this point is highly significant, especially for the bottom stage of menu 124 classifications, because the use of selection control 110 does not guide to further rudimentary menu level 364 usually.This principle also can be applicable to higher menu level 364.
The effect that Figure 11 A to 11B is depicted as that type of service 2 zoom conversions are amplified and returns from " menu " shortcut icon 1162c shown in Figure 10 A (1062c).These zooms concentrate on highlighted " menu " second-level menu item 1162c shortcut.The menu level that Figure 11 B shows comprise some with the menu of Figure 11 A (from Figure 11 A grade on menu level 364 item of information addressable) identical option (adding additional option).
The menu of Figure 11 B has shown all information option commonly used, and the menu of Figure 11 A has shown the option of customizing messages special use.This is the menu option how user interface of data processing equipment 100 provides context-sensitive, the visual logic that is consistent substantially simultaneously and use the another example of the control knob of minimum.
Figure 12 A to 12D shows how an embodiment of varifocal user interface 102 expands to the situation of the application program of carrying out on the equipment 100 with the zoom purposes, or expands to the situation of the file of checking on the equipment 100.For example, browser application or the file checked can comprise hyperlink 1298.Clicking hyperlink 1298 will make hyperlink target 1299 dwindle link 1298 page locations that take.From image, the zoom between the foregoing menu level is imitated in this behavior.
Visual zoom that uses by menu system 120 and application program and the visit data that uses by menu system 120 provide, only use 4 to, select and system's navigation of cancellation selection control 108,110 and 112 and the bumpless transfer between the content.Amplify/dwindle order use usually select and/ cancellation selection control 110 and 112 imports.The context that operates in of this button is known as zoom order or autozoom order when suitable, perhaps for example at first navigates to zoom icon that can be shown as second-level menu item etc. etc. in due course.
Figure 13 A to 13D shown so-called zoom continue by menu system 120 to data content with return.Figure 13 A has shown the menu level 1364 of available information 1390a-1390f tabulation, and top information 1390a is highlighted.Press selection control 1310 and can be transformed into Figure 13 B, the full text of the information 1390a of selection shows at this.Show a cover second-level menu item 1362a-1362d in addition, wherein two demonstrations front is with reference to Figure 10 B described first " zoom " second-level menu item 1362a.Press selection control 1310 this moment can make the content of text of information 1390a ' amplify shown in Figure 13 C.In this stage, the user can and sweep the content of text that shows with direction controller 108 rollings.
In this embodiment, the use of selection control 1310 is felt by the consistent of interface zoom to the user.Specifically, from the conversion of Figure 13 A to 13B, selection control 1310 makes zoom enter darker menu level, and from the conversion of Figure 13 B to Figure 13 C, when not having other lower menu level, identical selection control 1310 zooms in the content user.By using cancellation to select control 1312 further to strengthen zoom metaphor (metaphor), content is dwindled.Figure 13 D shows this, arrives Figure 13 C by pressing cancellation selection control 1312.Figure 13 D is equal to Figure 13 B.Therefore, if the user presses cancellation selection control 1312 once more, oppositely zoom is with continuing menu 120 classifications that fall back, to turn back to the state of Figure 13 A.
Figure 14 A and 14B and 15B, 15B and 15C have described according to the highlighted effect of illustrative embodiment of the present invention by the stacked order of data processing equipment 100 utilizations.In Figure 14 A, " information " the main menu item 1460b is highlighted.In order to indicate this state, it physically is seated in the top of the contiguous the main menu item 1460a that is designated " contact ".Although contact the main menu item 1460a part is fuzzy but still as seen, and can be activated by service orientation controller 108.Figure 14 B shows current contact the main menu item 1460a highlighted in same tabulation.This causes that " information " territory 1460b turns back to lower stacked ordinal position, the current top that is in of wherein highlighted the main menu item 1460a.
Except that the stacked order of the menu item that rearranges with the highlighted effective menu item, convergent-divergent (scales) is gone back in highlighted processing 126, and effectively the visible range of menu item is highlighted to emphasize.The visible range of highlighted menu item is exaggerated with respect to the visible range of non-highlighted menu item.Convergent-divergent can comprise the convergent-divergent of text, font and figure (being figure and text target) in the highlighted visible range.In addition, non-highlighted visible range remains on the convergent-divergent of display screen and the position static, and consistent and stable outward appearance in the use are provided.Along with the downward navigation menu level of user, the visible range of each the main menu item is by highlighted and proposition successively, and fixing (although in other embodiments, non-highlighted the main menu item can have displacement) of other holding position, territory and outward appearance.This technology also can be used for showing the partial content relevant with highlighted territory shown in Figure 15 A to 15C, and Figure 15 A to 15C describes the highlighted continuously of text message 1590a-1590c tabulation discipline.
Stacked sequential technologies also can be used with " demonstration " technology.Help showing shortcut icon and other additional information by the ability of utilizing the Z-direction on screen, to create more spaces in highlighted territory.The highlighted the main menu item that is applied at least of stacked order, and can expand to second-level menu item of demonstration etc.Stacked sequential technologies can expand at user option, as the hyperlink in application program and the file.
Except that the characteristic of above-mentioned data processing equipment 100, in the combination of one or more or following interchangeable embodiment, can obtain other functions.
First alternative embodiment
Referring to Fig. 1, in above-mentioned illustrative embodiment, menu system 120 comprises that enough information generates the output that is presented on the display screen 114.In alternative embodiment, menu system comprises can store enough information to be created on the state machine that menu level 364 once shows required output.In this alternative embodiment, menu system 120 is communicated by letter with application program 180 and data source 182 below one or more.For example, application program can comprise " contact " database application 180 and " information " application program 180.Data source 182 can comprise the tables of data of data processing equipment 100 itself, perhaps is stored in the data on the remote storage device.After receiving selection instruction from navigation module 122, menu system inquiry appropriate application program 180 and/or data source 182 are to obtain suitable result.For example, if the user has triggered selection control in " contact " when the main menu item is effective, then menu system is inquired the contact list that " contact " application program 180 is used as the main menu item with retrieval, and retrieves the tabulation of the relevant second-level menu item of each the main menu item.Equally, if concrete contact telephone number second-level menu item is effective and the user has triggered selection control, then menu system indication contacts application 180 is dialed and the effective relevant telephone number of second-level menu item.
The dual operation of module 134 as selection control 110 and module selected in cancellation selection control 112 and cancellation.For example, if a last menu item of selecting causes navigating to new menu level in the menu system 120, then press cancellation selection control 112 in response to the user, cancellation selects module 134 notice Navigation Control with current effective menu item and menu level deactivation, and activates previous effectively menu level.As a result, the history of the navigation module 122 navigation input of can storage receiving from the user.If a last menu item of selecting causes function on, then in response to cancelling pressing of selection control 112, the function that cancellation selects module 134 to stop to start.
Second alternative embodiment
When user interface frame described herein is used in combination at the digital document processing system with international patent application no WO 01/79984 disclosed type, can further strengthen and expand.The characteristics of this document handling system are the systems that comprises a plurality of " File Agents ", and each File Agent is created and is used for identification and explains predetermined file format, and becomes internal file to represent the file translation that enters according to predetermined format.The internal representation that File Agent generates is general, and general among the agency, thereby makes the remainder of system only need handle single data representation and no matter enter the form of file.
Document handling system also comprises a core engine, and it is operated on internal representation to carry out file plan, expression, animation and event handling.Core engine also has script function, can comprise that processing of script or bytecode translation and corresponding reflecting layers are to handle the script that is comprised in the treated file.Document handling system also provides the control of common file manipulation, as pan, zoom and to certain page.
The core document engine is directly communicated by letter with data processing equipment 100 operating systems, so it can insert all OS function and device events by level of abstraction.Therefore core engine can use required all event handlings and script executing, with user interface interaction.In addition, user interface can be used as mutual multimedia tool and realizes, this mutual multimedia tool also can be handled by the File Agent that resides in the document handling system.Document handling system converts multimedia tool to internal representation, and then is provided by core engine.
The solution of Shi Shiing is accomplished the common displaying model of the multiple form of multimedia tool by this way.The existence of modularization File Agent means that instrument can be created as multiple multimedia form, as the example of File Agent is provided for HTML, for MACROMEDIA FLASH (being provided by the grand media companies in San Francisco, California), for SVG, SMIL etc.Because File Agent mainly is routine analyzer, their code can very little (the 100k byte be following), makes several even is illustrated on the limited mobile device of internal memory.File Agent is more much smaller than typical multimedia player, because all planning, reflection, pattern, animation and the timeline (timeline) handled in typical player are to be handled by the core engine of document handling system.Because core engine is operated on public internal representation, so it does not need to duplicate-an extra File Agent of needs when using different multimedia forms.
This system makes the establishment of user interface tool in the different multimedia form become possibility, and this form will be incorporated into single interface.For example, the interface tool of the contacts application of writing with SVG can be on same equipment combine with the interface of writing with FLASH and the information interface combination of a HTML creation.These instruments that separate can be play in the mode to user transparent together at a single equipment interface.Each multimedia tool is packed on request, mates its corresponding File Agent according to file layout.Event handling, reflection, animation and script that core engine is carried out are used uniformly, and irrelevant with the original form of multimedia tool.
Advise that as above user interface 102 can be used as one or more mutual multimedia tool and implements, instrument can be several multimedia segments.Multimedia form such as HTML can create the file that comprises text, image and pattern, and can be arranged to the basis of visual interface.Several these type of multimedia forms such as SVG (upgradeable vector graphics), MACROMEDIAFLASH and SMIL (Synchronized Multimedia Integration Language synchronous multimedia integrate language) provide intrinsic animated function, and it also can be used in the instrument to create animation Zoom effect described below.Mode by the executable script that comprises in the multimedia tool provides interactivity.
Script is a series of instructions that comprise logic decision, loop and condition loop potentially.For interactivity, script uses so-called " event handler ", to catch event and the scripted code of carrying out in response to incident in the computing environment.
The ECMASCRIPT that the Geneva, Switzerland ECMA world provides is a kind of generic script language, and its definition script grammer and requirement provide some intrinsic function such as mathematics, data etc.Otherwise, as long as expansion supports that under hosted environment then ECMASCRIPT just can expand.The most familiar script example that meets ECMASCRIPT is JAVASCRIPT (product of the Sun Microsystems company of California Palo Alto), comes across usually in the webpage that browser checks.This script is contained in webpage itself, and (as changing content on the mouse etc.) tells on to web page files when checking under the main frame browser environment.
Another example is MACROMEDIA FLASH ACTIONSCRIPT, is provided by the Macronmedia company in San Francisco, California.This is also based on ECMASCRIPT (though not in full conformity with), and it has the cover object different with JAVASCRIPT, performance etc.For example, ACTIONSCRIPT comprises the FLASH special object, as MovieClip.For example, the hosted environment of these functions is discerned and carried out to the documentation requirements with ACTIONSCRIPT at the FLASH layer, so that correctly show.
The ability that script in the file was discerned and acted on to host application program (as browser or core engine etc.) depends on corresponding data and the scripting object of function and the bridge layer of method under API and the binding hosted environment.This so-called " reflection layer " is because intrinsic object is reflected to the script territory, so that can enough script indications insert and handle.For example, the user of conventional browser (as microsoft the Internet explorer or Netscape) can open and newly scan the device window.The reflection layer of browser is created the new object of representing this window, so that JAVASCRIPT can insert window performance (as the present operable window menu bar performance of JAVASCRIPT).
Script typically uses " document dbject model " that is called as DOM.This is the classification of object and performance, method and incident.By this kind performance and method, script can insert and the aspect of given host application program itself as the example of above browse window, and can insert the interior object of file of include file script.For example, the button (button 1) in the form (f1) can insert by the mode of scripting object document.fl.buttonl on the interior webpage of browser.The interaction results of this button can be write the script sequence, carries out when the response click event.
By using DOM and ACTIONSCRIPT, the data processing user interface can be implemented in MACROMEDIA FALSH.For example, for the display menu level, data processing equipment 100 is carried out a FLASH multimedia tool (" work ") that contains the visual elements of menu level.In response to ' button downwards ' incident, the script processor of instrument rearranges shown item with reflection and update displayed.The convergent-divergent in stacked order and highlighted territory can be in multimedia tool directly realizes, as the adjusting of displayed content to show fresh information.Equally, instrument can comprise the zoom effect by the animation performance that provides in the FLASH form is provided.This kind animation will start in response to key-press event by the event handler script.
According to illustrative embodiment of the present invention, comprise the function that inserts intrinsic code based on the user interface of multimedia tool, intrinsic code can not become script.Therefore, the multimedia player of user interface has a DOM, its be called _ object of app and allow methodology on this object that intrinsic code library (DLL) is registered and multimedia tool that script uses in their function, be expanded.
Intrinsic code library can be write with the language of compiling, as C or C++.They can comprise can only be with the function of this Programming with Pascal Language, and exceeds the ability and the scope of the script relevant with multimedia tool.Sample library comprises the storehouse of playing mp3 file, or the storehouse of management contact data base.One of method of finishing required user interface frame extendability is the sexadecimal UID of inherent function assignment number (unique identifier) for providing among the DLL.For example, PlayAudioFile (displaying audio file) function in the MP3 storehouse can be given UID 0x2400.These functions by introduce above _ the app object method uses for the author of multimedia tool.
After registry, multimedia tool can be by being called _ library facility that the method call of app. processor exposes, and the UID that calls required function.For example, UI author will call _ app.hander (0x2400, Bohemian Rhapsody ") plays the MP3 audio file of this title.This plan increases said library facility into the reflection layer effectively, and makes them can pass through the UID reference call of its instrument script.Like this, this reflection layer is dynamically expanded by increasing new function.
This technological expansion the function of multimedia layer, as enumerate file directory and return the tabulation of its content.This information can turn back to the multimedia tool in the variable data array, and the element of this variable data array can be used for the instrument as other content.The inherent function of opening single file and taking passages its content also can be provided.This visit (equipment this locality and across a network) to document system, the external file or the content that do not comprise in storage card or the actual file of peripherals permission author in conjunction with multimedia tool itself.
Its example is " digital photograph collection (smart photo gallery) ", its inediting an instrument, the instruction that it has display photos comprises its outward appearance and conversion effect etc.But the photo that instrument shows not is the part of the instrument in the conventional method itself.Under current approach, can enumerate catalogue with they implanting instruments by instructs player, this catalogue can be the operation player camera phone on directory of photos.The tabulation of photo in the catalogue is read by player, is sent to multimedia tool as _ app object array.Multimedia tool by with reference to its _ index in the app array, open object and use the effect that defines in editor's the instrument, the photo object that the outside provides is included in the picture library.
Other example can comprise dynamically settles tabulation or menu-be not to have hard code listing or menu in the multimedia of establishment, and this instrument is with reference to a remote location that comprises tabulation or menu, and this remote location can utilize the control of former instrument dynamically to change.For example, new can be added to tabulation, and when instrument broadcast next time, these new list items are available to it.The instrument of establishment comprises the instruction of using content in the tabulation, but tabulation itself as much current modes need be in instrument static defining.
Another example is to be the instrument that uses contact data base to work out, and database can dynamically increase and change at this.Instrumental function does not change because of establishment in advance.But the content that this function is used is dynamic but not static.These examples have illustrated the opinion of dynamic template, and content is dynamically inserted the multimedia template here.
This framework also makes function expand in working time.For example, data processing equipment 100 can attach user interface 102 instruments with limited function when delivery.By paying certain expense, the user can download new user interface 102 instruments that contain enhancement function, as audio player or document reader function.When playing in user interface 102 frameworks of here describing, new tool will register the additional storehouse (DLL) that the basic interface does not utilize, and these storehouses can load in the working time of device with can not be from the new function of limited interface tool access before being exposed to.Intrasystem integrated, control between the DLL that comprises DOM and extendible this framework of reflection layer enhancing instrument that is called new library facility good at managing and response function to call and carry out and communicating by letter.
Described enforcement also provides existing multimedia form (FLASH, SVG, HTML, SMIL etc.) to be expanded the incident that exceeds its intrinsic scope with processing/response.Regular event comprises that as click and button standard script language can be by using OnClick (click), OnKeypress response events such as (buttons).The system of suggestion expands by audience's target of registration in the UI, and this UI is in response to system, equipment and storehouse incident-as OutofMemory (exceeding internal memory), IncomingCall (incoming call), CardInserted incidents such as (plug-in cards).
Finish this mechanism and utilize extendible reflection layer.The intrinsic incident that is provided by operating system and device software can be provided each intrinsic application program of writing with C etc.For example, therefore these intrinsic storehouses can expose (expose) system and device events, and email application can be caught an incident and received new e-mail with expression.
By use _ app object and _ the app. processor, these system events can be reflected in the multimedia tool multimedia tool by the script effect.For example, email application can comprise UID 0x0036 function and add script so that will return allocating object, the incident that intrinsic application program is caught be attached to return in the allocating object as follows:
listenerobj＝new?object()；
result＝_app.handler(0x0036/*email_addCallbackObject*/，
listenerobj)
/ * result returns the Boolean value, successfully adds if return allocating object, then be true */
listenerobj.onincomingemail＝function()
{
trace(“New?mail?received”)；
}
This script is created an object (listenerobj) in script, it can be in response to the incident from intrinsic email application.At this moment, event handler of script startup, it screen message occurs when new mail arrives.
According to author's intention, this makes the different multimedia instrument respond same incident according to different modes becomes possibility.An example is that this player moves on handheld device.The user inserts equipment with RAM (random access memory) card, makes equipment generate an incident of being explained by multimedia player.Explanation makes player carry out the interior function of instrument, and this instrument is relevant with " plug-in card " incident.Event handler in this multimedia tool (for example) uses above-mentioned technology can select to enumerate the file that inserts on the card, and selected file is included in the magic lantern.The different instruments that insert have a function, promptly play special tune and point out the user to insert card.
Equally, mobile phone can generate an incident, has received text message or has opened the incident of BLUETOOTH (Washington D.C. bluetooth SIG company) radio communication channel with indication.Multimedia player is put into multimedia tool with this incident, and it can respond by several modes, includes instrument in as display notification user's montage or with text message.The incident of other type comprises that incoming call, file load are finished, internal memory overflows etc.
Comprise in the enforcement of multimedia player that in user interface 102 user interface 102 can comprise next integrated basic system of manager module and multimedia tool.The manageable task of this module has: with the multimedia tool player of packing into; Load and unload the application program that needs as required by multimedia tool; Between different multimedia tool, change as required etc.Manager module makes full user interface 102 be made up of a plurality of fragments or a plurality of independent instrument of single user interface 102 multimedia tool.Specific function of each independent instrument execution-as interface, address book etc.Manager module is visited one or several application service neatly for each instrument provides, and provides share and access single application service for several multimedia tool.Aspect broadcasting, this method provides system event is exposed to the environment of media formats on a large scale, and they can not discern these incidents inherently.This method is expanded the event handling of these forms, to comprise the response of system event.
In one embodiment, multimedia tool and multimedia player provide file content and intrinsic user interface 102 outputs of multimedia tool.Multimedia player is by at first making up its output with file content such as text message by the implantation of the script in instrument multimedia tool.Carry out providing of content by multimedia player then, be equal to providing of the interior user interface element of instrument, as graphic icons.
In alternative embodiment, the content of text message is by the file processing engine separate processes of the above-mentioned type.Multimedia tool (icon etc.) user interface element continues to be handled by multimedia player.Along with the enforcement of data processing, equipment is set up a demonstration by covering from the output that provides of the file engine (text message) at player output top.This can finish by the tracing cloth of cutting apart the available screen area of each output (cutting apart by multi-medium script control) or create in the player output of using for the file processing engine by the use transparent body.This enforcement can be used the function of file engine special use by user interface.For example, file content can convergent-divergent, sweep, turn up etc. and do not change the visual user interface control that player provides.User interface element can the different coefficient of convergent-divergent with content.When the file processing engine was handled a plurality of file type, the user interface tool with a cover control can as one man be handled a plurality of file types.
Under the situation that does not depart from spirit of the present invention and key property, the present invention can implement by other concrete form.Therefore can be counted as all aspects be illustrative to above embodiment, but not restriction of the present invention.

Claims (44)

1. graphic user interface that is used for data handling system, this user interface comprises:
Menu system is used for providing more than first the main menu item to display screen, and each of described the main menu item all has visible range;
Navigation module is used to make user's described menu system that can navigate; And
Display process, be used in response to navigation to first the main menu item, in the described visible range of described first the main menu item, show more than first the second-level menu item that is associated with described first the main menu item, continue to show the remainder of described more than first the main menu item simultaneously.
2. user interface as claimed in claim 1, wherein said display process are further removed described more than first second-level menu item in response to the navigation to second the main menu item from described display screen.
3. user interface as claimed in claim 1 or 2, wherein said second-level menu item comprise a plurality of quick.
4. as the described user interface of above arbitrary claim, at least one of wherein said more than first second-level menu item is included in the visual representation of the navigation shortcut of the position in the described menu system.
5. as the described user interface of above arbitrary claim, at least one of wherein said more than first second-level menu item is included in the visual representation of the function shortcut of the option that is associated with described first the main menu item.
6. as the described user interface of above arbitrary claim, at least one of wherein said second-level menu item comprises icon.
7. as the described user interface of above arbitrary claim, at least one of wherein said second-level menu item comprises textual description.
8. as the described user interface of above arbitrary claim, wherein said more than first second-level menu item is context-sensitive.
9. user interface as claimed in claim 8, wherein said context-sensitive more than first second-level menu item depends on the state in conjunction with the equipment of described user interface.
10. user interface as claimed in claim 9, the state of wherein said equipment comprise at least one in the availability of availability that network connects and peripherals.
11. as the described user interface of above arbitrary claim, comprise at least one the highlighted processing of successful navigation that is used for visually being indicated to the main menu item and second-level menu item.
12. user interface as claimed in claim 11, be applicable to selection control in response to described data handling system, and wherein said user interface comprises to be selected to handle, this selects processing response in the use of described selection control, accepts one selection in the main menu item and the second-level menu item when highlighted.
13. user interface as claimed in claim 12 comprises first function that is associated with first the main menu item, and wherein utilizes described selection control to select described first the main menu item can start the execution of described first function.
14. user interface as claimed in claim 13, wherein said first function shows second master menu that comprises more than second the main menu item.
15. user interface as claimed in claim 12 comprises first function that is associated with the first second-level menu item, and wherein utilizes described selection control to select the described first second-level menu item can start the execution of described first function.
16. user interface as claimed in claim 15, wherein said first function shows second master menu that comprises a plurality of second the main menu items.
17. user interface as claimed in claim 11, comprise two display process, this pair display process is used for highlighted in response to the first second-level menu item of described a plurality of second-level menu items, in the visible range of described first the main menu item, show the additional information that is associated with the described first second-level menu item of described a plurality of second-level menu items.
18. user interface as claimed in claim 17, wherein said second-level menu item comprises icon, and described additional information comprises the textual description of described second-level menu item.
19. user interface as claimed in claim 18, wherein said additional information comprise the visual representation of the data that are associated with described highlighted second-level menu item.
20. user interface as claimed in claim 1, wherein said display process shows the visual representation of the data that are associated with described first the main menu item.
21. as the described user interface of above arbitrary claim, wherein said the main menu item shows with vertical row on display screen, and the described visible range horizontal-extending of each the main menu item is on the width of described display screen.
22. user interface as claimed in claim 21, wherein said display process is presented at described more than first second-level menu item in the visible range of described first the main menu item in the mode of horizontal line.
23. user interface as claimed in claim 17, wherein the display format of the additional information in highlighted visible range remains unanimity in by most of menu level of selecting the main menu item visit.
24. user interface as claimed in claim 12, wherein said selection processing response is in the selection of the main menu item, start animation zoom conversion sequence, this animation zoom conversion sequence comprises the described selection of convergent-divergent and replaces described more than first the main menu item with more than second the main menu item at least in part.
25. user interface as claimed in claim 12, wherein said selection processing response is in to one selection in the main menu item and the second-level menu item, start animation zoom conversion sequence, this animation zoom conversion sequence comprises the described selection of convergent-divergent and replaces described the main menu item with data content at least in part.
26. user interface as claimed in claim 24, wherein said selection processing is last described animation zoom conversion sequence, and described more than second the main menu item is superimposed upon on described more than first the main menu item of a part.
27. user interface as claimed in claim 26, the part of wherein said more than first the main menu item comprises the version of the convergent-divergent of described selection.
28. user interface as claimed in claim 24, be applicable to cancellation selection control in response to described data handling system, described user interface comprises cancellation selection processing, is used for the activation in response to described cancellation selection control, starts reverse zoom conversion sequence.
29. user interface as claimed in claim 28, wherein said reverse zoom conversion sequence consist essentially of the reverse of described animation zoom conversion sequence.
30. as one of any described user interface of claim 24, the visual zoom conversion sequence of wherein said animation visually concentrates in the described selection.
31. user interface as claimed in claim 28 wherein in response to described selection control, is passed through the multilevel menu item so that downward navigation to be provided, and in response to described cancellation selection control, to provide upwards navigation by described multilevel menu item.
32. user interface as claimed in claim 12, wherein selected second-level menu item is included in the link of content, and wherein the selection to described second-level menu item can start the visual zoom conversion sequence of animation, during the visual zoom conversion sequence of this animation, described second-level menu item is scaled gradually, and at least in part by described content to replace.
33. user interface as claimed in claim 11, wherein said highlighted processing are indicated to the successful navigation of described first the main menu item by the visible range of expanding described first the main menu item.
34. the figure that user interface as claimed in claim 11, wherein said highlighted processing are associated with the second-level menu item by convergent-divergent and the demonstration of text target are indicated to the successful navigation of described second-level menu item.
35. user interface as claimed in claim 11, the visible range of described first the main menu item is expanded in wherein said highlighted processing, thus the visible range of overlapping at least in part second the main menu item.
36. highlighted in response to described first the main menu item of user interface as claimed in claim 11, wherein non-highlighted the main menu item keeps static on the position.
37. user interface as claimed in claim 11, wherein said highlighted processing are by the adjacent part in described demonstration, figure ground shows the successful navigation that is indicated to described first the main menu item corresponding to the simulation shade of described first the main menu item.
38. user interface as claimed in claim 11, the successful navigation that figure that shows in the visible range of wherein said highlighted processing by described first the main menu item of convergent-divergent and text target are indicated to described first the main menu item.
39. user interface as claimed in claim 1, wherein said user interface comprises: amplification module and dwindle module, and described amplification module is used for visiting the available content of described menu system, and the described module of dwindling is used to close the content of being visited.
40. as the user interface of claim 39, wherein said amplification and dwindle module and be provided for the device shown of convergent-divergent through the content of described menu system visit.
41. user interface as claimed in claim 39, wherein said amplification and the activation of dwindling module provide the navigation between multistage the main menu item.
42. as the described user interface of above arbitrary claim, wherein said navigation module can start the Geographic Navigation of described menu system.
43. user interface as claimed in claim 42 is consistent by the Geographic Navigation ability that described navigation module provides in most of menu level of described menu system wherein.
44. user interface as claimed in claim 43 is consistent in wherein said Geographic Navigation ability all menu level in described menu system.
CNA2005101288360A 2004-12-03 2005-12-02 Data processing devices and systems with enhanced user interfaces Pending CN1782977A (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US63321804P 2004-12-03 2004-12-03
US60/633,218 2004-12-03
US11/061,185 2005-02-18

Publications (1)

Publication Number Publication Date
CN1782977A true CN1782977A (en) 2006-06-07

Family

ID=36773227

Family Applications (2)

Application Number Title Priority Date Filing Date
CNA2005101288360A Pending CN1782977A (en) 2004-12-03 2005-12-02 Data processing devices and systems with enhanced user interfaces
CNA2005101288356A Pending CN1782976A (en) 2004-12-03 2005-12-02 Data processing devices and systems with enhanced user interfaces

Family Applications After (1)

Application Number Title Priority Date Filing Date
CNA2005101288356A Pending CN1782976A (en) 2004-12-03 2005-12-02 Data processing devices and systems with enhanced user interfaces

Country Status (1)

Country Link
CN (2) CN1782977A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101600021A (en) * 2008-06-04 2009-12-09 株式会社泛泰·科力特 Mobile communication terminal and method with dial-in direct function of utilizing call history
CN102104673A (en) * 2009-12-18 2011-06-22 深圳富泰宏精密工业有限公司 Address book management system and method
CN103649894A (en) * 2011-07-14 2014-03-19 微软公司 Dynamic context based menus
CN104412217A (en) * 2012-06-26 2015-03-11 谷歌公司 Prioritized management and presentation of notifications
CN106462358A (en) * 2014-05-31 2017-02-22 苹果公司 Displaying interactive notifications on touch sensitive devices
CN108471806A (en) * 2015-11-02 2018-08-31 莱战略控股公司 User interface for aerosol delivery equipment

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100881952B1 (en) * 2007-01-20 2009-02-06 엘지전자 주식회사 Mobile communication device including touch screen and operation control method thereof
US9116593B2 (en) * 2007-07-06 2015-08-25 Qualcomm Incorporated Single-axis window manager
GB2453789B (en) * 2007-10-19 2012-11-14 British Sky Broadcasting Ltd Television display
US9304658B2 (en) * 2007-12-30 2016-04-05 Qualcomm Incorporated On-screen menu buttons including multiple modes
US8004541B2 (en) * 2008-01-28 2011-08-23 Hewlett-Packard Development Company, L.P. Structured display system with system defined transitions
CN101644985B (en) * 2008-08-06 2013-05-29 比亚迪股份有限公司 Method, system and equipment for displaying terminal user interface
CN101483694B (en) * 2009-02-19 2011-11-09 北京迪漫科技有限公司 Playing control method and apparatus for vector animation
EP2224356A1 (en) * 2009-02-27 2010-09-01 Research In Motion Limited Media player/browser application with short code search for media file and displaying links to access webpages related to the currently played meda file
CN101895706A (en) * 2010-07-16 2010-11-24 四川长虹电器股份有限公司 Method for displaying user interface in 3D mode
CN102419677A (en) * 2010-09-27 2012-04-18 上海三旗通信科技有限公司 Man-machine interaction way for mixed display of standby information, main menu and secondary menus
CN102184075B (en) * 2011-05-12 2013-08-07 北京瑞信在线系统技术有限公司 User interface display method and device
CN102446070A (en) * 2011-12-29 2012-05-09 Tcl集团股份有限公司 Method and device for carrying out quick skip among all levels of directories
KR102130932B1 (en) * 2017-05-16 2020-07-08 애플 인크. Devices, methods, and graphical user interfaces for navigating between user interfaces and interacting with control objects
US11036387B2 (en) 2017-05-16 2021-06-15 Apple Inc. Devices, methods, and graphical user interfaces for navigating between user interfaces and interacting with control objects
WO2019054999A1 (en) * 2017-09-13 2019-03-21 Google Llc Efficiently augmenting images with related content
CN112492365A (en) * 2019-09-11 2021-03-12 新加坡商欧之遥控有限公司 Remote control navigation interface assembly
CN113392129B (en) * 2021-06-28 2024-04-12 恒安嘉新（北京）科技股份公司 Menu searching method and device, electronic equipment and storage medium

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101600021A (en) * 2008-06-04 2009-12-09 株式会社泛泰·科力特 Mobile communication terminal and method with dial-in direct function of utilizing call history
US8554185B2 (en) 2008-06-04 2013-10-08 Pantech Co., Ltd. Mobile communication terminal having a direct dial function using call history and method for performing the function
US8706168B2 (en) 2008-06-04 2014-04-22 Pantech Co., Ltd. Mobile communication terminal having a direct dial function using call history and method for performing the function
US8933955B2 (en) 2008-06-04 2015-01-13 Pantech Co., Ltd. Mobile communication terminal having a direct dial function using call history and method for performing the function
CN102104673A (en) * 2009-12-18 2011-06-22 深圳富泰宏精密工业有限公司 Address book management system and method
CN103649894A (en) * 2011-07-14 2014-03-19 微软公司 Dynamic context based menus
CN104412217B (en) * 2012-06-26 2018-06-05 谷歌有限责任公司 The prioritization management and presentation of notice
CN104412217A (en) * 2012-06-26 2015-03-11 谷歌公司 Prioritized management and presentation of notifications
CN108710466A (en) * 2012-06-26 2018-10-26 谷歌有限责任公司 The prioritization management and presentation of notice
CN108710466B (en) * 2012-06-26 2021-05-25 谷歌有限责任公司 Prioritized management and presentation of notifications
CN106462358A (en) * 2014-05-31 2017-02-22 苹果公司 Displaying interactive notifications on touch sensitive devices
CN106462358B (en) * 2014-05-31 2020-05-01 苹果公司 Displaying interactive notifications on touch-sensitive devices
US10771422B2 (en) 2014-05-31 2020-09-08 Apple Inc. Displaying interactive notifications on touch sensitive devices
US11190477B2 (en) 2014-05-31 2021-11-30 Apple Inc. Displaying interactive notifications on touch sensitive devices
US11916861B2 (en) 2014-05-31 2024-02-27 Apple Inc. Displaying interactive notifications on touch sensitive devices
CN108471806A (en) * 2015-11-02 2018-08-31 莱战略控股公司 User interface for aerosol delivery equipment
US11464259B2 (en) 2015-11-02 2022-10-11 R.J. Reynolds Tobacco Company User interface for an aerosol delivery device
US11812790B2 (en) 2015-11-02 2023-11-14 R.J. Reynolds Tobacco Company User interface for an aerosol delivery device

Also Published As

Publication number Publication date
CN1782976A (en) 2006-06-07

Similar Documents

Publication Publication Date Title
CN1782977A (en) Data processing devices and systems with enhanced user interfaces
JP7028935B2 (en) User interface for your application Devices, methods, and graphical user interfaces for interacting with objects.
CN102428429B (en) Searching Method Of A List And Portable Device Using The Same
EP1667013A2 (en) User interfaces for data processing devices and systems
KR101740439B1 (en) Mobile terminal and method for controlling thereof
CN105683894B (en) Application execution method of display device and display device thereof
EP1667012A2 (en) Data processing devices and systems with enhanced user interfaces
JP5614784B2 (en) Page editing method for home screen of mobile terminal and mobile terminal having home screen
EP2557770B1 (en) Apparatus and method for performing data capture from a picture displayed by a portable terminal
CN104704494A (en) Device, method, and graphical user interface for managing folders with multiple pages
US20130050109A1 (en) Apparatus and method for changing an icon in a portable terminal
US20120313946A1 (en) Display switching apparatus, display switching method, and display switching program
CN102754066A (en) Mobile terminal having multiple display units and data handling method for the same
US20110193804A1 (en) Method and apparatus for editing list in portable terminal
KR20150110559A (en) Electronic system with display mode mechanism and method of operation thereof
KR20140058212A (en) Method for displaying category and an electronic device thereof
CN1941982A (en) A mobile communication terminal having multiple displays and a data processing method thereof
CN102640101A (en) Method and apparatus for providing user interface
KR20120012541A (en) Method and apparatus for operating folder in a touch device
US20070129050A1 (en) Mobile communication terminal with display shortcut key and method of enabling the same
US20150286368A1 (en) Method of operating a background content and terminal supporting the same
KR20100093750A (en) Portable terminal and using method of effect emoticon in it
EP2230587B1 (en) Information processing device and program
CN109714474A (en) Content copying methods, device, terminal and storage medium
WO2024017097A1 (en) Interface display method and terminal device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
CI01 Correction of invention patent gazette

Correction item: Inventor third

Correct: Clewett James

False: Clewett James

Number: 23

Volume: 22

CI02 Correction of invention patent application

Correction item: Inventor third

Correct: Clewett James

False: Clewett James

Number: 23

Page: The title page

Volume: 22

COR Change of bibliographic data

Free format text: CORRECT: INVENTOR NO. 3; FROM: DANMUSHIKELAI MAINTAIN TO: JAMES KELAIWEITE

ERR Gazette correction

Free format text: CORRECT: INVENTOR NO. 3; FROM: DANMUSHIKELAI MAINTAIN TO: JAMES KELAIWEITE

REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1089258

Country of ref document: HK

C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Open date: 20060607

REG Reference to a national code

Ref country code: HK

Ref legal event code: WD

Ref document number: 1089258

Country of ref document: HK