Classifications

• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
  • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
  • G06F3/0482—Interaction with lists of selectable items, e.g. menus
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
  • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
  • G06F3/04842—Selection of displayed objects or displayed text elements
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
  • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
  • G06F3/0485—Scrolling or panning
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
  • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
  • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
  • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
  • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
  • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text

Definitions

• a graphical user interface for a portable computing device Field of the Invention This invention relates to computing devices, in particular to a portable computing device with a touch screen for providing a selection method for menu structures.
• the invention further relates to a method, an apparatus and a computing device program product for providing a selection method for menu structures of a computing device.
• Portable computing devices such as mobile phones or smart phones, with physical key(s) or a physical keyboard can be used without looking at a display of the device since the keys could be felt with fingers.
• some of the keys are designed differently or the keys are indicated by bossages or the like to indicate the location of certain keys.
• portable computing devices with touch screen keys cannot be used without looking at a display of the device, because touch screen keys are arranged to be used by presence and location of a touch within a certain area of the display.
• menu structures in portable computing devices with physical keys or touch screen keys have been implemented as pop-up menus which appear when, for example, a specified key or a touch screen is touched in a specified place such as at the bottom of the screen. From the pop-up menus, users can make a selection by mouse, by physical keys or by touching the wanted menu item or items. The type of selection depends on the type of the portable computing device.
• the present invention relates to a method for a computing device, for example, for a portable computing device with a touch screen.
• the user of the computing device may handle menu structures and selection of menu options of a graphical user interface of the computing device by touch.
• the user may open menu structures by touching to an arbitrary point on the touch screen and select menu options from the open menu structure by releasing the touch when the menu option within or near a selection area of the menu structure.
• the computing device may be a computer, such as a smart phone, having a touch screen and running an operating system, such as Linux, iOS or Android, or some other computing device or portable computing device with a touch screen, such as a game console, an all-in-one computer, a tablet computer, a personal digital assistant (PDA), a satellite navigation device, a mobile phone, or a video game.
• an operating system such as Linux, iOS or Android
• some other computing device or portable computing device with a touch screen such as a game console, an all-in-one computer, a tablet computer, a personal digital assistant (PDA), a satellite navigation device, a mobile phone, or a video game.
• PDA personal digital assistant
• Various aspects of the invention include a method for a computing device having a graphical user interface comprising a touch screen, an apparatus that is configured to perform the method and a computer program product comprising instructions to perform the method.
• a method for a computing device having a graphical user interface comprising a display for displaying a user interface view and a touch screen for receiving input from a user.
• the method comprises displaying a user interface element on the display, opening a menu structure on a side of the user interface element by a touch on the touch screen, wherein the menu structure comprises at least one menu option and a selection area and wherein said at least one menu option is movable in comparison to the selection area, and activating a menu option that is closest to the selection area.
• the menu structure that is closest to the selection area is activated when the touch is detected to be released from the touch screen.
• the method further comprises indicating an openable menu structure by a menu indicator on a side of the user interface element.
• the menu structure indicated by the menu indicator is when the detected touch is detected to move away from the menu indicator.
• the method further comprises indicating movement of at least one menu option over the selection area by visual, audio and/or haptic feedback.
• indicating the activation of the menu option from the menu structure by visual, audio and/or haptic feedback.
• the method further comprises indicating a second menu indicator on a second side of the user interface element if a menu structure is available.
• the user interface element is a photo, a lock screen view or any other view of a terminal device, a web page, a calendar application or a list of phone numbers, phone history, bookmarks, dates, or photos of photo gallery.
• the menu option that is closest to the selection area is displayed, other menu options are invisible.
• the method further comprises providing a feedback for the user when the menu option is activated.
• the method further comprises locking the menu structure open and providing a feedback for the user when the end of the menu structure is reached.
• the feedback provided for the user when the end of the menu structure is reached is different than feedback provided for the user when the menu option is activated.
• an apparatus comprising a processing unit, a memory coupled to said processing unit and a graphical user interface comprising of a display for displaying a user interface element and a touch screen for receiving input from a user.
• the memory is configured to store computer program code and a user interface data.
• the graphical user interface is coupled to said memory and data processing unit.
• the processing unit is configured to execute the program code stored in the memory, whereupon the apparatus is configured to display a user interface element on the display, open a menu structure on a side of the user interface element by a touch on the touch screen, wherein the menu structure comprises at least one menu option and a selection area and wherein said at least one menu option is movable in comparison to the selection area and activate a menu option that is closest to the selection area.
• the apparatus may be an example of a computing device.
• the menu structure that is closest to the selection area is activated when the touch is detected to be released from the touch screen.
• the apparatus is further arranged to indicate an openable menu structure by a menu indicator on a side of the user interface element.
• the menu structure indicated by the menu indicator is opened when the detected touch is detected to move away from the menu indicator.
• the apparatus is further arranged to indicate movement of at least one menu option over the selection area by visual, audio and/or haptic feedback.
• the apparatus is further arranged to indicate the activation of the menu option from the menu structure by visual, audio and/or haptic feedback.
• the apparatus is further arranged to indicate a second menu indicator on a second side of the user interface element if a menu structure is available.
• the user interface element is a photo, a lock screen view or any other view of a terminal device, a web page, a calendar application or a list of phone numbers, phone history, bookmarks, dates, or photos of photo gallery.
• the menu option that is closest to the selection area is displayed, other menu options are invisible.
• the apparatus is further arranged to provide a feedback for the user when the menu option is activated.
• the apparatus is further arranged to lock the menu structure open and provide a feedback for the user when the end of the menu structure is reached.
• the feedback provided for the user when the end of the menu structure is reached is different than feedback provided for the user when the menu option is activated.
• the apparatus that is a computing device is a smart phone.
• a computer program product stored on a computer readable medium and executable in a data processing device comprising a graphical user interface comprising a display for displaying a user interface element and a touch screen for receiving input from a user.
• the computer program product comprises instructions to display a user interface element on the display, open a menu structure on a side of the user interface element by a touch on the touch screen, wherein the menu structure comprises at least one menu option and a selection area and wherein said at least one menu option is movable in comparison to the selection area and activate a menu option that is closest to the selection area and activate a menu option that is closest to the selection area.
• the menu structure that is closest to the selection area is activated when the touch is detected to be released from the touch screen.
• the computer program product further comprises instructions to indicate an openable menu structure by a menu indicator on a side of the user interface element.
• the menu structure indicated by the menu indicator is opened when the detected touch is detected to move away from the menu indicator.
• the computer program product further comprises instructions to indicate movement of at least one menu option over the selection area by visual, audio and/or haptic feedback.
• the computer program product further comprises instructions to indicate the activation of the menu option from the menu structure by visual, audio and/or haptic feedback.
• the computer program product further comprises instructions to indicate a second menu indicator on a second side of the user interface element if a menu structure is available.
• the user interface element is a photo, a lock screen view or any other view of a terminal device, a web page, a calendar application or a list of phone numbers, phone history, bookmarks, dates, or photos of photo gallery.
• the menu option that is closest to the selection area is displayed, other menu options are invisible.
• the computer program product further comprises instructions to provide a feedback for the user when the menu option is activated.
• the computer program product further comprises instructions to lock the menu structure open and provide a feedback for the user when the end of the menu structure is reached.
• the feedback provided for the user when the end of the menu structure is reached is different than feedback provided for the user when the menu option is activated.
• the data processing device is a smart phone.
• FIG. 1 shows an example of a portable computing device
• Fig. 2 shows another example of a portable computing device according to an embodiment
• Figs. 3a-c show views of a display of a touch screen apparatus according to an embodiment of the invention
• Figs. 4a-b show views of a display of a touch screen apparatus according to an embodiment of the invention
• Figs. 5a-f show views of a display of a smart phone having a touch screen according to an embodiment of the invention
• Figs. 6a-b show views of a display of a smart phone having a touch screen according to an embodiment of the invention
• Figs. 7a-b show steps of selecting method by views of a display of a smart phone having a touch screen according to an embodiment of the invention
• Figs. 8a-b show views of a display of a smart phone having a touch screen according to an embodiment of the invention
• Fig. 9 shows a flow chart of a method for using a menu structure according to an embodiment of the invention.
• a touch screen is an electronic visual display of a terminal device that can detect the presence and location of a touch within the area of the display.
• users touch the touch screen of the device with a finger/fingers or a hand, or in some cases with a stylus.
• touch screens are more common in portable computing devices such as game consoles, all-in-one computers, tablet computers, smart phones, personal digital assistants (PDA), satellite navigation devices, mobile phones, and video games.
• PDA personal digital assistants
• satellite navigation devices mobile phones, and video games.
• smart phones There is a trend especially in smart phones to implement terminals with only few or no real hardware buttons. All or most of the functionalities are controlled with so called on-screen buttons, on-screen toolbars or software menu structures.
• the touch screen enables the user to interact with the computing device of the device directly with what is displayed i.e. with on-screen buttons.
• the user selects, for example, by a finger, on-screen buttons, for example, displayed icons or keys.
• on-screen buttons for example, displayed icons or keys.
• Touch screen displays are popular, for example, in personal electronics, in the medical field, in heavy industry, and in kiosks where keyboard and mouse systems do not allow a suitably intuitive, rapid, or accurate interaction by the user with the content on the display.
• on-screen functionalities of touch screen devices i.e. on-screen buttons, toolbars or software menu structures use some of the area of the display, thus limiting the amount of information which can be presented on the display for the user.
• this problem has been solved by increasing the screen size or by decreasing the size of information displayed on the screen.
• the larger screen size leads to larger manufacturing costs of the terminal, and the decreased size of presented information reduces the usability characteristics of the device.
• the use of touch screens of conventional portable computing devices with on-screen buttons, toolbars or software menu structures requires the user to look at the screen when using the touch screen and to tap exactly on the on-screen control places i.e. a defined area on the touch screen. This leads to another kind of usability problem.
• the device cannot be used in a safe manner while moving, driving or cycling etc. or in a comfortable manner while watching TV, discussing with other people or doing something that requires the use of eyes but leaves the hands free. For example, tapping and then moving out of the defined area of the on-screen control normally discards the started action.
• existing touch screen devices give little or no possibilities to be used by visually impaired people, because it might be impossible or at least hard to find on-screen control locations on the touch screen.
• the screen size in some of the devices might be dimensioned in a way that it is not possible to reach onscreen buttons with one hand or without moving the device within the user's hand.
• menu structures comprising menu options such as actions and toolbar items can be opened and scrolled via a touch interface such as a touch screen by an upward and/or downward and/or leftward and/or rightward movement of a finger of a user, and wherein menu options can be selected by releasing the finger when a menu option is within a selection area of the menu structure. Releasing of the finger activates the menu option that is within the selection area, and the menu structure may collapse using spring animation.
• an upward, downward, leftward or rightward movement of the finger opens the menu structure indicated by a menu indicator on the edge of a user interface element; i.e., the movement of the finger away from the menu indicator opens the menu structure.
• the menu opens when the user scrolls up (moves the finger down) when a top menu indicator is shown on the top of the screen i.e. above the user interface element, or scrolls down when a bottom menu indicator is shown on the bottom of the screen i.e. under the user interface element, or scrolls left when a left menu indicator is shown on the left side of the screen i.e. on the left side of the user interface element or scrolls right when a right menu indicator is shown on the right side of the screen i.e.
• the computing device may be a computer, such as a smart phone, having a touch screen and running an operating system, such as Linux, iOS or Android, or some other computing device or portable computing device with a touch screen, such as a game console, an all-in-one computer, a tablet computer, a personal digital assistant (PDA), a satellite navigation device, a mobile phone, or a video game.
• the user interface element may be, for example, a photo, a lock screen view or any other view of a terminal device, a web page, a calendar application or any other application of a terminal device, a list of, for example, phone numbers, phone history, bookmarks, dates, photos of photo gallery, etc.
• the term "on the side of a user interface element" refers to a top border area, a bottom border area, a left border area and/or a right border area of the user interface element.
• a menu structure in the middle of the user interface element for example, in the middle of the list of lit items by dragging list items from both sides of the intermediate menu indicator by two fingers when a menu structure is available in the middle of the list and indicated by the intermediate menu indicator.
• middle of the user interface element refers to a place that is not in the border area of the user interface element, for example, in the beginning or in the end of the list.
• indicators can be shown on all sides of the user interface element at the same time or on two or three or four sides at the same time, for example, in case of moving a web page on the screen.
• a menu corresponding menu indicator, top menu indicator, bottom menu indicator, left menu indicator or right menu indicator can be open and shown.
• one or more menu structures are indicated by the indicator and one or more are not. For example, a menu structure on the top side of a user interface element is not indicated by an indicator, but another menu structure on the left side of a user interface element is indicated by a left menu indicator.
• a menu indicator can be provided at any arbitrary point of any user interface element if there is scrollable content (menu structure) in context with the menu indicator.
• Menu structures according to the invention include a selection area for selecting menu options of the menu structure.
• the desired menu option can be arranged to the selection area by a scrolling action. Scrolling of the menu options over the selection area and selection of a menu option from the menu structure may cause visual, audio and/or haptic feedback for the user. It is also possible, that the apparatus reads the menu options and/or the selected menu option.
• Menu options of a menu structure may be associated with actions such as making a phone call, launching a keypad, sending a message, modifying an item, playing music, going to previous page (when using the menu in browser environment), going to next page, entering Uniform Resource Locator, previous pages in web browsing, starting another application, closing current application, saving status, toggling to other application, etc.
• the menu options may relate to an application that is run by the apparatus, and those options may be default options that are prearranged into menu structures. However it is also possible that the user may select his/her own menu options for each application or views of the apparatus.
• the common feature for all openings of menu structures indicated by menu indicators and selecting menu options from the menu structure is that there is no need to touch a certain place on the touch screen. It is sufficient to touch the screen and to move the touch (finger) in the desired direction.
• FIG. 1 shows an example of an apparatus 100.
• the apparatus 100 comprises a display 1 10, which is a touch-screen display (e.g. capacitive, resistive) configured to display a user interface view and receive input from a user.
• a touch-screen display e.g. capacitive, resistive
• the apparatus according to Figure 1 further comprises at least one camera 120 being situated on same side of the apparatus with the display, or on the opposite side.
• the apparatus comprises two cameras placed on opposite sides of the apparatus 1 00, e.g. front side (i.e. display side) and rear side of the apparatus.
• the apparatus 100 may have one or more physical buttons 130 and one or more touch-screen buttons 1 12, 1 13.
• the apparatus 100 comprises a keypad being provided either on the display as a touch-screen keypad 1 1 1 or on the housing of the apparatus 100 as a physical keypad.
• the apparatus 100 may further comprise a microphone 140 and loudspeaker 150 to receive and to transmit audio.
• the apparatus 100 may also comprise communication interface (not shown in Figure 1 ) configured to connect the apparatus to another device, e.g.
• Wireless communication can be based on any cellular or non-cellular technology, for example GSM (Global System for Mobile communication), WCDMA (Wideband Code Division Multiple Access), CDMA (Code Division Multiple Access). Wireless communication can also relate to short range communication such as Wireless Local Area Network (WLAN), Bluetooth etc.
• the apparatus 100 also comprises a battery or similar powering means.
• the apparatus 100 may comprise one or more sensors, such as accelerometer, gyroscope, magnetometer etc.
• the apparatus 100 may also comprise a vibrator for providing movement of the apparatus in silent mode and for providing tactile feedback in user interface situations.
• the apparatus 100 further comprises a memory ( Figure 2: 210) configured to store computer program code used for operating the apparatus and for providing user interface, and to store user interface data.
• User interface related software can be implemented as separate application and/or it can be part of the operating system of the apparatus. User interface may include default values and it may include values which can be modified by the users.
• the apparatus 100 comprises a processor 220 that executes the program code to perform the apparatus' functionality.
• the apparatus further comprises an input/output element 230 to provide e.g.
• Figure 3a shows a view of a display of a touch screen apparatus according to an embodiment of the invention.
• the apparatus 300 has a graphical user interface 302 comprising the display for displaying a user interface view and information, and a touch screen for receiving input from a user.
• the touch screen may be controlled, for example, with a finger 306.
• a general list 304 as the user interface element.
• the list 304 comprises 9 list items; List items 1 to 9.
• the list items may be for example phone numbers from the phone directory of the phone, links from a web site, photos of a photo gallery, emails of an email service, calendar marks of calendar application, or any other items which relate to each other in some way and which are suitable to be shown as a list.
• a bidirectional arrow 307 in figure 3a the user may scroll the list 304 up or down by the finger 306.
• Figure 3b shows a view of a display of a touch screen apparatus according to an embodiment of the invention, where the user has scrolled up the list 304 of figure 3a by moving the finger 306 upwards on the user interface 302.
• a menu indicator 308 is displayed under the list items of the list 304 on the user interface 302.
• the menu indicator 308 may be called a bottom indicator.
• Figure 3c shows a view of a display of a touch screen apparatus according to an embodiment of the invention, where the user has scrolled down the list 304 of figure 3a by moving the finger 306 downwards on the user interface 302.
• a menu indicator 310 is displayed above the list items of the list 304 on the user interface 302.
• the menu indicator 310 may be called a top indicator.
• the menu indicators 308, 310 may be, for example, graphical elements, such as an illuminated line, a special coloured line, a glow etc. which is shown, for example, on the top or bottom of the screen.
• Figures 4a-b show views of a screen of a touch screen apparatus 300 according to an embodiment of the invention, where the user has further scrolled up the list 304 with the finger 306, i.e. moved the finger down after the list 304 has ended, and the menu indicator has displayed above the list items of the list 304 on the user interface 302 (menu indicator is shown in figure 3c) so that a pull-down menu 402 will appear above the list items of the list 304, i.e.
• the menu 402 may comprise menu options. This embodiment comprises two menu options, Menu Item 1 404 and Menu Item 2 406. However, there may also be only one item or more than two menu items, for example, three, four or more.
• the menu 402 may have a defined selection area, i.e. a zone 408.
• the selection area 408 may be visually indicated,, for example, by a graphical element, such as an illuminated line, a special coloured line, a special coloured menu option text, a glow or by a dashed line as in figure 4a etc.
• a graphical element such as an illuminated line, a special coloured line, a special coloured menu option text, a glow or by a dashed line as in figure 4a etc.
• the selection area 408 is non-visible for the user or that the device gives audio and/or haptic feedback for the user when a menu option is within the selection area.
• the position of the area 408 does not move in relation to the display of the apparatus 300 when the menu 402 is scrolled.
• the area 408 may have a configurable parameter, such as distance (in pixels) from top of the screen, and also the width, i.e. height of the zone may have a configurable parameter, such as amount of pixels.
• a configurable parameter such as distance (in pixels) from top of the screen
• the width i.e. height of the zone
• a configurable parameter such as amount of pixels.
• the user knows which menu item is in order within the selection area 408 and thus selectable by releasing the finger 306 from the touch screen.
• the menu item closest to said zone 408 is the item which would be selected if the user releases the finger from the touch screen: For example, in figure 4a the Menu item 2 406 will be selected, and in figure 4b the Menu item 1 404 will be selected.
• the selection of the menu item from the menu 408 may also cause visual, audio and/or haptic feedback for the user. This feedback, menu item in the selection zone and selection done, may be different.
• the menu 402 may be locked, allowing user to tap by the finger 306 to activate a menu option.
• the locking of the menu 402 may be indicated to user by a different audio or haptic (vibra) feedback compared to the menu item being within the selection area.
• the selection area 408 indicator may disappear.
• end of the menu list may be indicated, for example, by dimming the menu, changing colour of text of menu items, or by changing background colour of menu items.
• a pull-down menu appears under the list items of the list 404; i.e. the list 404 moves upwards so that the menu 402 may be shown under the last list item (List Item 9).
• the menu 402 may comprise the same or different menu options as the above mentioned pull-down list above the menu 402.
• under the list items of the list 404 there is also a selection area.
• the number of menu items in the pull-down menu is not restricted.
• the apparatus indicates, for example, by audio or by vibrating, that a menu item is within a zone 408, thus enabling the user to activate menu options without looking at the display.
• the apparatus may also indicate the selection of this menu option.
• FIGS 5a-f show views of a display of a smart phone having a touch screen according to an embodiment of the invention.
• the smart phone 500 has a graphical user interface comprising the display for displaying a user interface view and information and a touch screen for receiving input from a user.
• Figure 5a shows an embodiment where a photo is displayed as a user interface element on the display of a smart phone 500.
• menu indicators, top menu indicator 502 and down menu 514 and left side indicator 516 are also displayed, indicating that there are menu structures to be used.
• the user has to move down the finger at some point on the touch screen and opened a pull-down menu 504 indicated by the top menu indicator 502.
• the photo is shrunk so that the menu 504 can be shown.
• the photo can be shifted so that the menu can be shown, for example, the photo may be shifted downward, upward, leftward or rightward depending on the opening direction of the menu.
• the menu 504 displays two menu options, Send option and Set to Wallpaper option.
• the Set to Wallpaper option is within the selection area 505.
• Figure 5b shows an embodiment where a photo is displayed on the display of the smart phone 500.
• a menu indicator 502 is also displayed, indicating that there is a pull-down menu structure on top of the screen to be used.
• the user has to move down the finger on the touch screen and opened the pull-down menu 504 indicated by the top menu indicator 502.
• the menu 504 is displayed translucently on top of the displayed photo.
• the menu 504 comprises three menu options, Send option, Set to Wallpaper option and Close Menu Option.
• a selection area 505 is also indicated by dashed lines.
• the Close Menu option is within the selection area 505.
• this empty space locks the menu 504 if the empty space is within the selection area 505 so the user may tap by the finger 306 to activate a menu option.
• menu 504 is displayed non- translucently on top of the displayed photo or on top of displayed on-going action.
• the on-going action may be, for example, a phone call, Internet browser application, web application, messaging application such as email, photo sharing application, multimedia messaging service application, short message service application etc.
• Figure 5c shows an embodiment of the invention where a photo is displayed on the display of the smart phone 500. In this embodiment only the menu option which is within the selection area 505 is shown. Thus only Set to Wallpaper option is shown, but Close Menu 508 and Send 512 options are not shown. However, when the finger is moved further down, the Set to Wallpaper option will disappear and the Close Menu Option 508 will be shown. However, it is also possible that all menu options are shown but the one which is within the selection area 505 is highlighted with a certain colour or some other indicator.
• Figure 5d shows an embodiment where a photo is displayed on the display of the smart phone 500.
• the selection area 505 is only displayed by an illuminated line 506.
• a new menu options might be presented or messaging application such as email, photo sharing application, or multimedia messaging service application might be launched depending on settings.
• Figure 5e shows an embodiment where a photo is displayed on the display of the smart phone 500.
• a menu indicator 514 is also displayed which indicates that there is a menu structure to be used.
• the user has moved up the finger on the touch screen and opened a pull-down menu 509 indicated by the down menu indicator 514.
• the photo is shrunk so that the menu 504 can be shown under the photo. Additionally the photo can be moved upward so that the photo is shown only partially.
• the menu 509 displays three menu options, Delete option, Information option and Close option.
• a selection area 505 is also indicated by dashed lines and also by an illuminated line 506.
• the Information option is currently within the selection area 505.
• Figure 5f shows an embodiment where a photo is displayed on the display of the smart phone 500.
• two menu indicators top menu indicator 502 and down menu indicator 514 are also displayed, indicating that there are menu structures to be used.
• the user has moved up the finger on the touch screen and opened a pull-down menu 509 indicated by the down menu indicator 514.
• the menu 509 is displayed translucently on top of the displayed photo.
• a selection area 505 is indicated by an illuminated line 506. The Delete option is currently within the selection area 505.
• Figures 6a and 6b show views of a display of a smart phone having a touch screen according to an embodiment of the invention.
• the smart phone 600 has a graphical user interface comprising the display for displaying a user interface view and information, and a touch screen for receiving input from a user.
• Figure 6a shows an embodiment where a lock screen view is displayed on the display of the smart phone 600.
• a menu indicator and a top menu indicator 602 are also displayed, indicating that there are menu structures to be used.
• Figure 6b shows an embodiment where a lock screen view is displayed as a user interface element on the display of the smart phone 600.
• a pull down menu 604 that has been indicated by the top menu indicator 602 is also displayed.
• the user has opened the pull-down menu 604 by moving down the finger at some point on the touch screen.
• the menu 604 displays three menu options 608 in this view: Silent profile, Phone and Camera options.
• the selection area 605 is indicated by an illuminated line 606, and the Phone option is currently within the selection area 605.
• Figures 7a, 7b and 7c show steps of a method for selecting a menu option by views of a display of a smart phone 700 having a touch screen according to an embodiment of the invention.
• the apparatus 700 has a graphical user interface comprising the display for displaying a user interface view and information, and a touch screen for receiving input from a user.
• Figure 7a shows a main view as a user interface element on the display of the smart phone. On the main view, a phone history list, a top menu indicator 702 and an intermediate menu indicator 703 are shown.
• the user has opened the menu 704 relating to the top menu indicator 702 by moving down a finger at some point on the touch screen.
• the menu 704 comprises at least two menu options, and two of them are shown, Enter phone number and Call to.
• a selection area 705 is indicated to the user by highlighting the menu option (Call to) within the selecting area 705 with white colour i.e. colour of the font of the menu option is changed.
• the user has selected the Call to menu option by releasing the finger from the touch screen while the Call to menu option was within the selecting area 705.
• the menu 704 is closed and the selected menu option is activated.
• activation of Call to menu option launches a phone number dial pad 708 and opens an area for a phone number to be entered 710. Different menu options activate different applications.
• Figures 8a and 8b show a generic overview of the user interface views of a display of a computing apparatus having a touch screen according to an embodiment of the invention.
• the apparatus 800 has a graphical user interface comprising the display for displaying a user interface view and information, and a touch screen for receiving input from a user.
• a general list is disclosed as a user interface element comprising list items.
• a menu indicator as an intermediate menu indicator 801 is displayed below the List Item 4, i.e. in the middle of the list.
• the intermediate menu indicator 801 indicates that there is scrollable content i.e. pull-down menu relating to the above list item, List Item 4.
• the user of the apparatus may open the pull-down menu by dragging list items from both sides of the intermediate menu indicator 801 by two fingers.
• the view of figure 81 is displayed after opening of the pull-down menu 802 indicated by the intermediate menu indicator 801 .
• the pull-down menu 802 comprises menu options, Menu Option 1 804 and Menu Option 2 806.
• Menu option is again selectable when it is within a selecting area, this selection method is mentioned in context with earlier figures.
• the list item or items above intermediate menu indicator 801 could be static such as avatars, pictures, titles or other static information.
• the user can open the intermediate menu by one finger by moving the finger down below the intermediate indicator.
• List Item 3 and List Item 4 would stay stationary and the menu would appear i.e. open below the intermediate menu indicator 801 .
• Figure 9 shows a flow chart of a method 900 for using a menu structure according to an embodiment of the invention.
• the method 900 can be executed, e.g. by a computing device having a graphical user interface comprising the display for displaying a user interface view and a touch screen for receiving input from a user, wherein the method comprises.
• the computing device may be, for example, a smart phone.
• a user interface element is displayed on the display.
• a menu structure is opened by a touch on the touch screen, wherein the menu structure comprises at least one menu option and a selection area and wherein said at least one menu option is movable in comparison to the selection area, the movement of at least one menu option can be back and forth movement over the selection area.
• the touch may be moving on said touch screen.
• the menu structure comprises at least two menu options.
• a menu option that is closest to the selection area is activated.
• top menu and bottom menu indicators and menu structures can also be used in Internet browser applications. For example, when user is in the top part of a web page a top menu indicator is shown or when the user scrolls the HTML (Hyper Text Markup Language) document down menu items relevant for web browsing can be shown. Shown items can be, for example, "Enter URL” (Universal Resource Locator), "Go back", "Bookmark”, "Share the page” etc.
• HTML Hyper Text Markup Language
• information content of a web page can include instructions on what menu options should be in menu structures according to the invention and downloadable applications may contain menu structures and indicators according to the invention.
• the term "on the side of a user interface element" refers to a top border area, a bottom border area, a - left border area and/or a right border area of the user interface element.
• the menu indicators when the menu indicators are on left or right edge / side of the display the menus might be scrollable from left to right or from right to left.
• the various embodiments of the invention can be implemented with the help of computer program code that resides in a memory and causes an apparatus to carry out the invention.
• the apparatus that is a computing device may comprise circuitry and electronics for handling, receiving and transmitting data, a computer program code in a memory, and a processor which, when running the computer program code, causes the apparatus to carry out the features of an embodiment.

Landscapes

• Engineering & Computer Science (AREA)
• General Engineering & Computer Science (AREA)
• Theoretical Computer Science (AREA)
• Human Computer Interaction (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• User Interface Of Digital Computer (AREA)
• Position Input By Displaying (AREA)

Priority Applications (4)

Applications Claiming Priority (1)

Publications (1)

Family

ID=50775589

Family Applications (1)

Country Status (4)

Cited By (1)

Families Citing this family (19)

Citations (8)

Family Cites Families (23)

• 2012
  • 2012-11-20 US US14/443,378 patent/US20150301697A1/en not_active Abandoned
  • 2012-11-20 EP EP12888743.7A patent/EP2923260B1/en active Active
  • 2012-11-20 IN IN3804DEN2015 patent/IN2015DN03804A/en unknown
  • 2012-11-20 WO PCT/FI2012/051143 patent/WO2014080066A1/en active Application Filing

Patent Citations (8)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events