WO2014011785A1 - Device and method for performing a functionality - Google Patents

Device and method for performing a functionality Download PDF

Info

Publication number
WO2014011785A1
WO2014011785A1 PCT/US2013/049945 US2013049945W WO2014011785A1 WO 2014011785 A1 WO2014011785 A1 WO 2014011785A1 US 2013049945 W US2013049945 W US 2013049945W WO 2014011785 A1 WO2014011785 A1 WO 2014011785A1
Authority
WO
WIPO (PCT)
Prior art keywords
movement
image data
data
display device
view
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2013/049945
Other languages
French (fr)
Inventor
Richard M. Martin
Jaeho Choi
Ian R. Jenkins
Adam J. KARNAS
Shane E. MACGREGOR
Alexander R. Spiro
Konstantinos D. TSIOPANOS
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Symbol Technologies LLC
Original Assignee
Symbol Technologies LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Symbol Technologies LLC filed Critical Symbol Technologies LLC
Priority to DE112013003511.1T priority Critical patent/DE112013003511B4/en
Priority to GB1500202.5A priority patent/GB2518564B/en
Publication of WO2014011785A1 publication Critical patent/WO2014011785A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1694Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/161Indexing scheme relating to constructional details of the monitor
    • G06F2200/1614Image rotation following screen orientation, e.g. switching from landscape to portrait mode
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/163Indexing scheme relating to constructional details of the computer
    • G06F2200/1637Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer

Definitions

  • the invention relates to a mobile unit performing a functionality from a movement of the mobile unit that changes a view of a display device.
  • a conventional mobile unit may be configured with a display device.
  • the display device may be configured to show data to a user such as a view for an application, a menu, a home screen, etc.
  • the display devic may further be configured to allow the user to manipulate the view.
  • the display device may be a touch screen that the user can apply a single finger and a subsequent movement moves the view on the display device to generate an updated view.
  • the display device may allow the user to apply two fingers and a subsequent movement bringing the fingers apart may zoom into the view to generate a zoomed in view while a subsequent movement bringing the fingers together may zoom out the view to generated a zoomed out view.
  • the positioning of these elements may orient other elements on the device, particularly the display device.
  • the conventional display device may also be configured to automatically change the view as a function of the user turning the MU. For example, if the MU is held so that the display device is disposed in a portrait view, the user may turn the MU and the display device so that the MU and display device is held in a landscape view.
  • a motion sensor such as an accelerometer may be used to determine the direction and orientation of the MU.
  • the conventional display device requires a predetermined amount of turning for the view on the display device to be updated. For example, at least a 45° turn may be required prior to the view on the display device to be changed. Once at least a 45° turn is performed, the display device may be automatically updated.
  • this feature only allows for the view on the display device to only have either a portait view or a landscape view.
  • the user may also lock the view on the display device to remove this feature.
  • a turning of the MU will also turn the view on the display device resulting in the user viewing a rotated view that is not right side up relative to the user.
  • This concept also applies to the MU including the rotating feature prior to the view being changed.
  • only a change between a portait view and a landscape view is performed from this movement of the MU. That is, for any further functionality such as an execution or launching of an application requires a further user input (e.g., touching an icon on the view representing the application for it to launch).
  • Fig. 1 illustrates components of a mobile unit in accordance with some embodiments.
  • Fig. 2 illustrates the display device of the mobile unit of Fig. 1 for maintaining a view from a rotation in accordance with some embodiments.
  • FIG. 3 illustrates the display device of the mobile unit of Fig. 1 for maintaining a view from a translation in accordance with some embodiments.
  • FIG. 4 illustrates a flowchart of a method for performing a functionality as a function of a movement of the mobile unit in accordance with some embodiments.
  • the present invention describes a device and method for performing a predefined functionality.
  • the method comprises generating first image data indicative of a first view shown on a display device of a mobile unit (MU), the first view including a plurality of selectable elements, each selectable element configured to execute a predefined functionality, the first image data including first position data and first orientation data for each of the selectable elements; determining movement data indicative of a movement of the display device relative to a user of the MU; generating second image data indicative of a second view shown on the display device as a function of the first image data and the movement data, the second view including at least one of the selectable elements, the second image data including second position data and second orientation data for each of the at least one of the selectable elements, the second position data and the second orientation data being the same as the first position data and the first orientation data, respectively, relative to the user; selecting one of the at least one of the selectable elements of the second view as a function of the second position data and the second orientation data; and executing the predefined functionality
  • the exemplary embodiments may be further understood with reference to the following description and the appended drawings, wherein like elements are referred to with the same reference numerals.
  • the exemplary embodiments describe a device and method for performing a functionality as a function of a movement of a MU that changes a view of a display device. Specifically, the movement of the MU updates the view of the display device to a moved view in which a selected or predetermined functionality is executed or application is launched.
  • the functionality, the movement, the view, the moved view, the display device, and a related method will be discussed in further detail below.
  • FIG. 1 is a MU 100 including a plurality of components for performing a functionality as a function of a movement of the MU 100 that changes a view in accordance with an exemplary embodiment of the present invention.
  • the MU 100 may be any portable device such as a mobile phone, a personal digital assistant, a smartphone, a tablet, a laptop, a barcode reader, etc. Accordingly, the MU 100 may be a handheld device in which the user is capable of moving the MU 100.
  • the movement of the MU 100 may be a rotational movement or a translational movement.
  • the MU 100 may include a processor 105, a memory arrangement 110, a display device 115, an input/output (I/O) device 120, a transceiver 125, and other components 130 such as a portable power supply (e.g., battery).
  • a portable power supply e.g., battery
  • the processor 105 may provide conventional functionalities for the MU 100.
  • the MU 100 may include a plurality of applications that are executed on the processor 105 such as an application including a web browser when connected to a communication network via the transceiver 125.
  • the memory 110 may also provide conventional functionalities for the MU 100.
  • the memory 110 may store data related to operations performed by the processor 105.
  • the processor 105 may provide a feature that allows the user to maintain an orientation and a position of a view even when the user performs a movement on the MU 100. Accordingly, the memory 110 may store an initial view for an updated view to be shown.
  • the transceiver 125 may be any conventional component configured to transmit and/or receive data. The transceiver 125 may therefore enable communication with other electronic devices directly or indirectly through a network.
  • the display device 115 may be any component configured to show data to a user.
  • the display device 115 may be, for example, a liquid crystal display (LCD) to conform to the size of the electronic device 100.
  • the I/O device 120 may be any component configured to receive an input from the user.
  • the I/O device 120 may be a keypad (e.g., alphanumeric keypad, numeric keypad, etc.).
  • the I/O device 120 may also be a touch sensing pad for a user to enter inputs manually with a finger(s) or a stylus.
  • the display device 115 may also incorporate the I/O device 120, particularly when the I/O device 120 is a touch sensing pad including an area in which the user may enter inputs.
  • the I/O device 120 may be a transparent touch sensor placed on top of the display 115 that enables a user to enter inputs.
  • the display device 115 may be configured to maintain an orientation and a position of selectable elements such as icons in a view thereon even subsequent to the user moving the MU 100 in a rotational manner and/or a translational manner.
  • the processor 105 may capture an image of the view on the display device 115 and store the image data on the memory 110.
  • the image data may be
  • the image data may have fixed dimensions, in particular dimensions which are larger than the dimensions of the display device 115.
  • the display device 115 may show a portion of the image data thereon.
  • the processor 105 may determine the portions of the image data to be shown on the display device 115.
  • the image data may be dynamic. That is, the image data shown on the display device 115 may be updated upon the MU 100 being moved in a rotational or a translational manner. The processor 105 may therefore determine the portions of the image data that should no longer be shown on the display device 115 while also determining further portions of the image data that should be shown on the display device 115.
  • the orientation of the elements in the image or the entire image shown on the display device 115 may be maintained. That is, the image may remain in a fixed orientation with respect to the user even after the MU 100 is rotated. Furthermore, the position of the elements in the image or the entire image shown on the display device 115 may be maintained. That is, the relative position of points in the image may remain fixed with respect to the user even after the MU is translated. Accordingly, the portions of the image remaining to be shown on the display device 115 after the MU 100 undergoes a translational movement remains a fixed distance from the user.
  • the processor 105 may determine how to maintain the image on the display device 115 using a variety of factors.
  • the orientation and relative movement with respect to the user of the MU 100 may be determined. These factors may be based upon, for exmple, the ground (e.g., using an accelerometer), the user (e.g., using a front facing camera or imager), a proximity sensor, or other external physical feature (e.g., also using a camera or imager).
  • the other components 130 may include a sensor such as a movement sensor (e.g., accelerometer), an image sensor (e.g., camera), etc.
  • the orientation of the MU 100 may also be used for determining how to show the image data on the display device 115.
  • the MU 100 may be rotated in a variety of manners (e.g., pitch, roll, yaw).
  • the processor 105 may determine the type of rotational movement to determine the image data to be shown.
  • the position of the MU 100 may further be used for determining how to show the image data on the display device 115.
  • the MU 100 may be translated in a variety of manners (e.g., up, down, left, right).
  • the processor 105 may be configured to adjust the presentation of the image data on the display device 115 using any combination of the above noted factors.
  • the features of the exemplary embodiments of the present invention may be manually activated or deactivated. That is, the user may allow the features to be used or not.
  • the user may launch a user interface for settings of the MU 100.
  • the user interface may include an option to allow the user to activate the features.
  • the display device 115 may be configured according to the exemplary embodiments of the present invention.
  • Fig. 2 illustrates the display device 115 of the MU 100 of Fig. 1 for maintaining a view from a rotation in accordance with some embodiments.
  • the image data 200 shown on the display device 115 may represent an original view. That is, the icons on the image data 200 may be shown in a standard portrait mode (e.g., length greater than width). The dimensions of the original view of the image data 200 may correspond to the dimensions of the display device 115.
  • the icons shown on the image data 200 may also be oriented in a manner relative to the user (e.g., right side up).
  • the user of the MU 100 may choose to rotate the MU 100. For example, the user may choose to rotate the MU 100 30° counter-clockwise.
  • the image data 205 shown on the display device 115 may correspond to such a rotational movement.
  • an orientation of the image data may be maintained. That is, the orientation of the image data 200 and the image data 205 are the same. Therefore, the icons shown in the image data 200 may be constant when being updated to the image data 205 after a 30° counter-clockwise rotational movement is performed on the MU 100. Thus, the icons remain in the same orientation relative to the user as was the case in image data 200.
  • the processor 105 may determine that portions of the image data 200 are to be removed for this updated view (e.g., top right corner and bottom left corner) while further portions are required to be shown in the image data 205 (e.g., top left corner and bottom right corner).
  • portions of the image data 200 are to be removed for this updated view (e.g., top right corner and bottom left corner) while further portions are required to be shown in the image data 205 (e.g., top left corner and bottom right corner).
  • the image data 210 may be shown on the display device 115.
  • the locations and orientations of the icons may remain constant.
  • Image data 215-240 illustrates a further example of the orientation and location of the icons remaining constant when the MU 100 is rotated 180° in a counter-clockwise manner.
  • the MU 100 may be oriented so that a handle of the housing extends towards the left (e.g., 0° position). Accordingly, the image data 215 may be shown in a standard landscape setting.
  • the MU 100 may be rotated 45°. In this rotated position, as discussed above, the orientation of the view of the image data 220 remains constant relative to the image data 215.
  • image data 225 the MU 100 may be rotated 90°. Thus, the image data 225 may be shown in a standard portrait setting.
  • Fig. 3 illustrates the display device of the mobile unit of Fig. 1 for maintaining a view from a translation in accordance with some embodiments.
  • the image data 300 shown on the display device 115 may represent an original view. That is, the icons on the image data 300 may again be shown in a standard portrait mode (e.g., length greater than width).
  • the dimensions of the original view of the image data 300 may correspond to the dimensions of the display device 115. However, as discussed above, the image data 300 may have greater dimensions than the dimensions of the display device 115 in which case the processor 105 is configured to store the entire image data 300 or adjust accordingly in a dynamic manner.
  • the icons shown on the image data 300 may also be oriented in a manner relative to the user (e.g., right side up).
  • the user of the MU 100 may choose to move the MU 100 trans lationally. For example, the user may choose to move the MU 100 up, down, left, and/or right.
  • the image data 320 shown on the display device 115 may correspond to an up and right translational movement.
  • a position of the image data may be maintained. That is, the position of the image data 300 and the image data 330 are the same. Therefore, the icons shown in the image data 300 may be constant when being updated to the image data 320 after a translation up and to the right is performed on the MU 100. Thus, the icons remain in the same position relative to the user as was the case in image data 300.
  • the processor 105 may determine that portions of the image data 300 are to be removed for this updated view (e.g., left side and bottom side) while further portions are required to be shown in the image data 320 (e.g., top side and right side).
  • the icons may be removed from the view. As shown in image data 300, all the icons 302-318 may be shown. However, in image data 320, the icons 308, 310, and 312 may be removed as the MU 100 has been moved enough to place these icons outside the viewing of the display device 115.
  • the icon 314 may be partially shown as the MU 100 has been moved in a manner that the top portion of the icon 314 is still visible within the display device 115.
  • the image data 325 may be shown on the display device 115. As discussed above, the locations and orientations of the icons may remain constant. Furthermore, in this scenario, the icons 304, 316, and 318 may be removed from the view of the display device 115 while the icon 314 again partially remains within the view of the display device 115.
  • the image data shown on the display device 115 may be updated in a dynamic manner. That is, when the MU 100 is moved translationally, rotationally, or both, the processor 105 may continuously update the image data shown on the display device 115. Accordingly, if the display device 115 is moved from a first position to a second position, the image data is continuously shown with the elements therein maintaining the orientation and position throughout the movement from the first position to the second position.
  • the movement of the MU 100 and the features for maintaining the position and orientation of the view on the display device may further be used to activate a functionality or launch an application.
  • the icons 304-318 may be selected to launch a corresponding application or activate a functionality.
  • the icon 302 may represent a home or central icon.
  • the home icon 302 may be, for example, a location within the image data 300 when no action is to be taken or the operating system installed on the MU 100 is to go "back" or return to a home state.
  • the MU 100 may be disposed in a position so that the icon 302 is selected. This may illustrate to the user that the icon 302 has been selected from the movement performed on the MU 100.
  • the icon 304 may be selected.
  • the icon 304' results in which the icon may be enlarged and highlighted around the icon. That is, the icon 304' may be updated with visual features indicative of the selection. Further visual features such as a change in color may also be used.
  • the previously selected icon 302 in image data 300 may be deselected in which case the icon 302' results that is resized to an original size (e.g., same size as other non-selected icons).
  • an original size e.g., same size as other non-selected icons.
  • the processor 105 may be configured to automatically launch a corresponding application or perform a corresponding functionality. This action may be performed in a variety of ways. In a first example, the processor 105 may be configured to wait a predetermined amount of time (e.g., 2 seconds) so that when the icon is continuously selected, the processor 105 determines that the corresponding action of the icon is to be performed. In a second example, upon the icon being selected, the user may manually provide an input on the display device 115 (e.g., I/O device 120 incorporated for a touch screen) that selects the icon to perform the corresponding action.
  • a predetermined amount of time e.g. 2 seconds
  • the MU 100 may further be configured to incorporate other movements for the performing of a functionality. As discussed above, the rotational movements are not restricted to a turn within a common plane (e.g., yaw).
  • the MU 100 may also be rotated with a roll or a pitch.
  • the user of the MU 100 may perform a pitch forward to change a selection of the icon. For example, with regard to image data 300, when a pitch forward is performed, the processor 105 may receive this movement input data and move the selection from the icon 302 to the icon 306. In such a scenario, the icon 306 may be selected, highlighted, and enlarged while the icon 302 is deslected and resized.
  • the image data 300 may remain constant during this pitch rotational movement. That is, the image data 300 may only be updated when a yaw rotational movement or a translational movement is performed.
  • the processor 105 may update the image data 300 for additional movements. For example, with a pitch rotational movement, the processor 105 may generate a perspective view so that the image data shown on the display device 115 is maintained with respect to the user. Specifically, with a pitch forward rotational movement, the processor 105 may resize the image data 300 so that an upper portion is widened and zoomed out while a bottom portion is shortened and zoomed in. In this manner, the view of the image data may be substantially the same prior to and after the pitch forward rotational movement.
  • non-visual indicators may also be utilized alone or in combination with the visual indicators.
  • audio data may be played on an audio output component of the MU 100.
  • the home icon e.g., icon 302
  • a prerecorded "home" tone may be played on the audio output component such as saying the word "home” or a predetermined sound indicative of the home icon.
  • a precorded tone may be played on the audio output component such as saying the word "barcode scan” or a predetermined sound indicative of the barcode scan icon.
  • the audio data may be played individually or in combination with the visual indicator as discussed above.
  • an icon may be selected on the image data to provide haptic feedback.
  • a predetermined haptic output may be performed by the MU 100.
  • the MU 100 may include a vibration generating component that generates a vibration that is indicative of the home icon (e.g., continuous vibration for a predetermined amount of time).
  • the vibration generating component may generate a different type of haptic feedback (e.g., predetermined number of vibrations spaced apart from one another).
  • the exemplary embodiments of the present invention may incorporate haptic feedback individually, in combination with other non-visual indicators, in combination with the visual indicators as discussed above, or any combination thereof.
  • the types of visual indicators and the types of non- visual indicators may be combined in any manner to indicate to the user the selection/deselection of a particular icon or functionality.
  • Fig. 4 illustrates a flowchart of a method 400 for performing a functionality as a function of a movement of the mobile unit in accordance with some embodiments.
  • the MU 100 may be configured to maintain a position and orientation of elements shown on a view of a display device after a movement of the MU 100 as well as perform a functionality from the movement.
  • the method 400 will be described with reference to the MU 100 of Fig. 1 and the types of movements shown in Figs. 2 and 3.
  • step 405 image data is shown on the display device 115.
  • the processor 105 is configured to run at least one application such as an operating system.
  • the operating system may have a home screen in which a plurality of icons or selectable elements are shown.
  • the icons 302-318 may be shown.
  • step 410 a determination is made whether a movement of the MU 100 is detected. Specifically, the determination relates to whether the display device 115 is moved. As discussed above, the movement may be a rotational movement (e.g., roll, pitch, yaw) and/or a translational movement (e.g, up, down, left, right). Thus, the user of the MU 100 may move the display device 115 in a variety of manners. If no movement is determined, the method 400 returns to step 405 where the image data shown originally is continued to be shown. If movement is determined, the method 400 continues to step 415.
  • the movement may be a rotational movement (e.g., roll, pitch, yaw) and/or a translational movement (e.g, up, down, left, right).
  • the user of the MU 100 may move the display device 115 in a variety of manners. If no movement is determined, the method 400 returns to step 405 where the image data shown originally is continued to be shown. If movement is determined, the method
  • step 415 the image data shown on the display device 115 is updated.
  • the processor 105 may determine the updated, moved view on the display device 115. If a translational movement is detected, the position and orientation of elements of the image data or the entire image data may be maintained. Thus, if the display device 115 is moved translationally such as the image data 300 and the image data 320, the processor 105 may again determine the updated, moved view on the display device 115.
  • the processor 105 may determine the updated, moved view on the display device 115.
  • step 420 the processor 105 determines if a functionality is selected. If no functionality is selected, the method 400 returns to step 415 where the updated, moved image is continued to be shown on the display device 115. However, if a predefined functionality is selected, the method 400 continues to step 425. As discussed above, the image data 300 may select the icon 302 that corresponds to a predefined functionality. Subsequently, if the display device 115 is moved in a translational manner such as up and to the right, a selection functionality may be triggered so that the icon 304 may be selected. Thus, in step 425, the defined functionality is performed. As discussed above, the functionality may be performed in a variety of manners. For example, the processor 105 may automatically activate and perform the selected predefined functionality. In another example, the user may manually enter an input to perform the selected functionality.
  • the exemplary embodiments of the present invention provide a device and method for performing a functionality as a function of a movement of a MU that changes a view of a display device.
  • the movement of the MU and the display device may be with regard to a rotational movement and/or a translational movement.
  • the processor of the MU is configured to update the view on the display device as a function of the performed movement.
  • the processor of the MU may be configured to perform a functionality as a function of the performed movement. For example, a selection functionality may be triggered so that an icon corresponding to the selected functionality may be altered such as changing a size or display of the icon.
  • a device or structure that is "configured" in a certain way is configured in at least that way, but may also be configured in ways that are not listed.
  • processors or “processing devices”
  • microprocessors digital signal processors, customized processors and field programmable gate arrays (FPGAs) and unique stored program instructions (including both software and firmware) that control the one or more processors to implement, in conjunction with certain non-processor circuits, some, most, or all of the functions of the method and/or apparatus described herein.
  • FPGAs field programmable gate arrays
  • unique stored program instructions including both software and firmware
  • some or all functions could be implemented by a state machine that has no stored program instructions, or in one or more application specific integrated circuits (ASICs), in which each function or some combinations of certain of the functions are implemented as custom logic.
  • ASICs application specific integrated circuits
  • an embodiment can be implemented as a computer-readable storage medium having computer readable code stored thereon for programming a computer (e.g., comprising a processor) to perform a method as described and claimed herein.
  • Examples of such computer-readable storage mediums include, but are not limited to, a hard disk, a CD-ROM, an optical storage device, a magnetic storage device, a ROM (Read Only Memory), a PROM (Programmable Read Only Memory), an EPROM (Erasable Programmable Read Only Memory), an EEPROM (Electrically Erasable Programmable Read Only Memory) and a Flash memory.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • User Interface Of Digital Computer (AREA)

Description

DEVICE AND METHOD FOR PERFORMING A FUNCTIONALITY
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application claims priority to U.S. Provisional Patent Application Ser. No. 61/741,163 filed July 13, 2012, entitled, "MOBILE COMPUTING DEVICE INCLUDING AN ERGONOMIC HANDLE," the contents of which are expressly incorporated herein by reference in their entirety.
FIELD OF THE DISCLOSURE
[0002] The invention relates to a mobile unit performing a functionality from a movement of the mobile unit that changes a view of a display device.
BACKGROUND
[0003] A conventional mobile unit (MU) may be configured with a display device. The display device may be configured to show data to a user such as a view for an application, a menu, a home screen, etc. The display devic may further be configured to allow the user to manipulate the view. For example, the display device may be a touch screen that the user can apply a single finger and a subsequent movement moves the view on the display device to generate an updated view. In another example, the display device may allow the user to apply two fingers and a subsequent movement bringing the fingers apart may zoom into the view to generate a zoomed in view while a subsequent movement bringing the fingers together may zoom out the view to generated a zoomed out view. In handheld devices that include elements that need to be positioned in relation to external features in the environment (e.g., barcode scanner, imager, etc.), the positioning of these elements may orient other elements on the device, particularly the display device.
[0004] To alleviate issues raised from moving the MU, the conventional display device may also be configured to automatically change the view as a function of the user turning the MU. For example, if the MU is held so that the display device is disposed in a portrait view, the user may turn the MU and the display device so that the MU and display device is held in a landscape view. A motion sensor such as an accelerometer may be used to determine the direction and orientation of the MU. However, the conventional display device requires a predetermined amount of turning for the view on the display device to be updated. For example, at least a 45° turn may be required prior to the view on the display device to be changed. Once at least a 45° turn is performed, the display device may be automatically updated. However, this feature only allows for the view on the display device to only have either a portait view or a landscape view. The user may also lock the view on the display device to remove this feature. However, a turning of the MU will also turn the view on the display device resulting in the user viewing a rotated view that is not right side up relative to the user. This concept also applies to the MU including the rotating feature prior to the view being changed. In addition, only a change between a portait view and a landscape view is performed from this movement of the MU. That is, for any further functionality such as an execution or launching of an application requires a further user input (e.g., touching an icon on the view representing the application for it to launch).
[0005] Accordingly, there is a need for providing further views on the display device from a movement of the MU that may also be used for a further functionality such as launching an application.
BRIEF DESCRIPTION OF THE FIGURES
[0006] The accompanying figures, where like reference numerals refer to identical or functionally similar elements throughout the separate views, together with the detailed description below, are incorporated in and form part of the specification, and serve to further illustrate embodiments of concepts that include the claimed invention, and explain various principles and advantages of those embodiments. [0007] Fig. 1 illustrates components of a mobile unit in accordance with some embodiments.
[0008] Fig. 2 illustrates the display device of the mobile unit of Fig. 1 for maintaining a view from a rotation in accordance with some embodiments.
[0009] Fig. 3 illustrates the display device of the mobile unit of Fig. 1 for maintaining a view from a translation in accordance with some embodiments.
[0010] Fig. 4 illustrates a flowchart of a method for performing a functionality as a function of a movement of the mobile unit in accordance with some embodiments.
[0011] Skilled artisans will appreciate that elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale. For example, the dimensions of some of the elements in the figures may be exaggerated relative to other elements to help to improve understanding of embodiments of the present invention.
[0012] The apparatus and method components have been represented where appropriate by conventional symbols in the drawings, showing only those specific details that are pertinent to understanding the embodiments of the present invention so as not to obscure the disclosure with details that will be readily apparent to those of ordinary skill in the art having the benefit of the description herein.
DETAILED DESCRIPTION
[0013] The present invention describes a device and method for performing a predefined functionality. The method comprises generating first image data indicative of a first view shown on a display device of a mobile unit (MU), the first view including a plurality of selectable elements, each selectable element configured to execute a predefined functionality, the first image data including first position data and first orientation data for each of the selectable elements; determining movement data indicative of a movement of the display device relative to a user of the MU; generating second image data indicative of a second view shown on the display device as a function of the first image data and the movement data, the second view including at least one of the selectable elements, the second image data including second position data and second orientation data for each of the at least one of the selectable elements, the second position data and the second orientation data being the same as the first position data and the first orientation data, respectively, relative to the user; selecting one of the at least one of the selectable elements of the second view as a function of the second position data and the second orientation data; and executing the predefined functionality corresponding to the selected one of the selectable elements.
[0014] The exemplary embodiments may be further understood with reference to the following description and the appended drawings, wherein like elements are referred to with the same reference numerals. The exemplary embodiments describe a device and method for performing a functionality as a function of a movement of a MU that changes a view of a display device. Specifically, the movement of the MU updates the view of the display device to a moved view in which a selected or predetermined functionality is executed or application is launched. The functionality, the movement, the view, the moved view, the display device, and a related method will be discussed in further detail below.
[0015] FIG. 1 is a MU 100 including a plurality of components for performing a functionality as a function of a movement of the MU 100 that changes a view in accordance with an exemplary embodiment of the present invention. As illustrated, the MU 100 may be any portable device such as a mobile phone, a personal digital assistant, a smartphone, a tablet, a laptop, a barcode reader, etc. Accordingly, the MU 100 may be a handheld device in which the user is capable of moving the MU 100. The movement of the MU 100 may be a rotational movement or a translational movement. The MU 100 may include a processor 105, a memory arrangement 110, a display device 115, an input/output (I/O) device 120, a transceiver 125, and other components 130 such as a portable power supply (e.g., battery).
[0016] The processor 105 may provide conventional functionalities for the MU 100. For example, the MU 100 may include a plurality of applications that are executed on the processor 105 such as an application including a web browser when connected to a communication network via the transceiver 125. The memory 110 may also provide conventional functionalities for the MU 100. For example, the memory 110 may store data related to operations performed by the processor 105. As will be described in further detail below, the processor 105 may provide a feature that allows the user to maintain an orientation and a position of a view even when the user performs a movement on the MU 100. Accordingly, the memory 110 may store an initial view for an updated view to be shown. The transceiver 125 may be any conventional component configured to transmit and/or receive data. The transceiver 125 may therefore enable communication with other electronic devices directly or indirectly through a network.
[0017] The display device 115 may be any component configured to show data to a user. The display device 115 may be, for example, a liquid crystal display (LCD) to conform to the size of the electronic device 100. The I/O device 120 may be any component configured to receive an input from the user. For example, the I/O device 120 may be a keypad (e.g., alphanumeric keypad, numeric keypad, etc.). The I/O device 120 may also be a touch sensing pad for a user to enter inputs manually with a finger(s) or a stylus. It should be noted that the display device 115 may also incorporate the I/O device 120, particularly when the I/O device 120 is a touch sensing pad including an area in which the user may enter inputs. In another example, the I/O device 120 may be a transparent touch sensor placed on top of the display 115 that enables a user to enter inputs. [0018] According to the exemplary embodiments, the display device 115 may be configured to maintain an orientation and a position of selectable elements such as icons in a view thereon even subsequent to the user moving the MU 100 in a rotational manner and/or a translational manner. The processor 105 may capture an image of the view on the display device 115 and store the image data on the memory 110. According to a first exemplary embodiment, the image data may be
predetermined. That is, the image data may have fixed dimensions, in particular dimensions which are larger than the dimensions of the display device 115. Thus, the display device 115 may show a portion of the image data thereon. When the MU 100 is moved, the processor 105 may determine the portions of the image data to be shown on the display device 115. According to a second exemplary embodiment, the image data may be dynamic. That is, the image data shown on the display device 115 may be updated upon the MU 100 being moved in a rotational or a translational manner. The processor 105 may therefore determine the portions of the image data that should no longer be shown on the display device 115 while also determining further portions of the image data that should be shown on the display device 115. As will be discussed in further detail below, the orientation of the elements in the image or the entire image shown on the display device 115 may be maintained. That is, the image may remain in a fixed orientation with respect to the user even after the MU 100 is rotated. Furthermore, the position of the elements in the image or the entire image shown on the display device 115 may be maintained. That is, the relative position of points in the image may remain fixed with respect to the user even after the MU is translated. Accordingly, the portions of the image remaining to be shown on the display device 115 after the MU 100 undergoes a translational movement remains a fixed distance from the user.
[0019] The processor 105 may determine how to maintain the image on the display device 115 using a variety of factors. The orientation and relative movement with respect to the user of the MU 100 may be determined. These factors may be based upon, for exmple, the ground (e.g., using an accelerometer), the user (e.g., using a front facing camera or imager), a proximity sensor, or other external physical feature (e.g., also using a camera or imager). Accordingly, the other components 130 may include a sensor such as a movement sensor (e.g., accelerometer), an image sensor (e.g., camera), etc. The orientation of the MU 100 may also be used for determining how to show the image data on the display device 115. For example, the MU 100 may be rotated in a variety of manners (e.g., pitch, roll, yaw). The processor 105 may determine the type of rotational movement to determine the image data to be shown. The position of the MU 100 may further be used for determining how to show the image data on the display device 115. For example, the MU 100 may be translated in a variety of manners (e.g., up, down, left, right). The processor 105 may be configured to adjust the presentation of the image data on the display device 115 using any combination of the above noted factors.
[0020] It should be noted that the features of the exemplary embodiments of the present invention may be manually activated or deactivated. That is, the user may allow the features to be used or not. The user may launch a user interface for settings of the MU 100. The user interface may include an option to allow the user to activate the features. Once activated, the display device 115 may be configured according to the exemplary embodiments of the present invention.
[0021] Fig. 2 illustrates the display device 115 of the MU 100 of Fig. 1 for maintaining a view from a rotation in accordance with some embodiments. The image data 200 shown on the display device 115 may represent an original view. That is, the icons on the image data 200 may be shown in a standard portrait mode (e.g., length greater than width). The dimensions of the original view of the image data 200 may correspond to the dimensions of the display device 115. The icons shown on the image data 200 may also be oriented in a manner relative to the user (e.g., right side up). The user of the MU 100 may choose to rotate the MU 100. For example, the user may choose to rotate the MU 100 30° counter-clockwise. As illustrated, the image data 205 shown on the display device 115 may correspond to such a rotational movement. According to the exemplary embodiments of the present invention, an orientation of the image data may be maintained. That is, the orientation of the image data 200 and the image data 205 are the same. Therefore, the icons shown in the image data 200 may be constant when being updated to the image data 205 after a 30° counter-clockwise rotational movement is performed on the MU 100. Thus, the icons remain in the same orientation relative to the user as was the case in image data 200. The processor 105 may determine that portions of the image data 200 are to be removed for this updated view (e.g., top right corner and bottom left corner) while further portions are required to be shown in the image data 205 (e.g., top left corner and bottom right corner). In a substantially similar manner, if the user chooses to rotate the MU 100 70° counter-clockwise from the original position corresponding to the image data 200, the image data 210 may be shown on the display device 115. As discussed above, the locations and orientations of the icons may remain constant.
[0022] Image data 215-240 illustrates a further example of the orientation and location of the icons remaining constant when the MU 100 is rotated 180° in a counter-clockwise manner. In image data 215, the MU 100 may be oriented so that a handle of the housing extends towards the left (e.g., 0° position). Accordingly, the image data 215 may be shown in a standard landscape setting. In image data 220, the MU 100 may be rotated 45°. In this rotated position, as discussed above, the orientation of the view of the image data 220 remains constant relative to the image data 215. In image data 225, the MU 100 may be rotated 90°. Thus, the image data 225 may be shown in a standard portrait setting. In image data 230, the MU 100 may be rotated 100°; in image data 235, the MU 100 may be rotated 135°; and in image data 240, the MU 100 may be rotated 180°. In each subsequent rotational move, the view of the image data 230-240 may be maintained so that the orientation and position are constant, particularly the icons being in a constant view relative to the user. [0023] Fig. 3 illustrates the display device of the mobile unit of Fig. 1 for maintaining a view from a translation in accordance with some embodiments. The image data 300 shown on the display device 115 may represent an original view. That is, the icons on the image data 300 may again be shown in a standard portrait mode (e.g., length greater than width). The dimensions of the original view of the image data 300 may correspond to the dimensions of the display device 115. However, as discussed above, the image data 300 may have greater dimensions than the dimensions of the display device 115 in which case the processor 105 is configured to store the entire image data 300 or adjust accordingly in a dynamic manner. The icons shown on the image data 300 may also be oriented in a manner relative to the user (e.g., right side up). The user of the MU 100 may choose to move the MU 100 trans lationally. For example, the user may choose to move the MU 100 up, down, left, and/or right. As illustrated, the image data 320 shown on the display device 115 may correspond to an up and right translational movement. According to the exemplary embodiments of the present invention, a position of the image data may be maintained. That is, the position of the image data 300 and the image data 330 are the same. Therefore, the icons shown in the image data 300 may be constant when being updated to the image data 320 after a translation up and to the right is performed on the MU 100. Thus, the icons remain in the same position relative to the user as was the case in image data 300. The processor 105 may determine that portions of the image data 300 are to be removed for this updated view (e.g., left side and bottom side) while further portions are required to be shown in the image data 320 (e.g., top side and right side).
Furthermore, as the icons remain in the same position, some of the icons may be removed from the view. As shown in image data 300, all the icons 302-318 may be shown. However, in image data 320, the icons 308, 310, and 312 may be removed as the MU 100 has been moved enough to place these icons outside the viewing of the display device 115. The icon 314 however, may be partially shown as the MU 100 has been moved in a manner that the top portion of the icon 314 is still visible within the display device 115. In a substantially similar manner, if the user chooses to move the MU 100 translationally up and to the left from the original position corresponding to the image data 300, the image data 325 may be shown on the display device 115. As discussed above, the locations and orientations of the icons may remain constant. Furthermore, in this scenario, the icons 304, 316, and 318 may be removed from the view of the display device 115 while the icon 314 again partially remains within the view of the display device 115.
[0024] It should be noted that the image data shown on the display device 115 may be updated in a dynamic manner. That is, when the MU 100 is moved translationally, rotationally, or both, the processor 105 may continuously update the image data shown on the display device 115. Accordingly, if the display device 115 is moved from a first position to a second position, the image data is continuously shown with the elements therein maintaining the orientation and position throughout the movement from the first position to the second position.
[0025] According to the exemplary embodiments of the present invention, the movement of the MU 100 and the features for maintaining the position and orientation of the view on the display device may further be used to activate a functionality or launch an application. As shown in Fig. 3, the icons 304-318 may be selected to launch a corresponding application or activate a functionality. The icon 302 may represent a home or central icon. The home icon 302 may be, for example, a location within the image data 300 when no action is to be taken or the operating system installed on the MU 100 is to go "back" or return to a home state.
Furthermore, as shown in image data 300, the MU 100 may be disposed in a position so that the icon 302 is selected. This may illustrate to the user that the icon 302 has been selected from the movement performed on the MU 100. In a substantially similar manner, when the MU 100 is moved up and to the right corresponding to the image data 320, the icon 304 may be selected. When selected, the icon 304' results in which the icon may be enlarged and highlighted around the icon. That is, the icon 304' may be updated with visual features indicative of the selection. Further visual features such as a change in color may also be used. The previously selected icon 302 in image data 300 may be deselected in which case the icon 302' results that is resized to an original size (e.g., same size as other non-selected icons). When the MU is moved up and to the left corresponding to the image data 325, the icon 308 may be selected. Thus, the icon 308' may result that is enlarged and highlighted.
[0026] When the desired icon has been selected, the processor 105 may be configured to automatically launch a corresponding application or perform a corresponding functionality. This action may be performed in a variety of ways. In a first example, the processor 105 may be configured to wait a predetermined amount of time (e.g., 2 seconds) so that when the icon is continuously selected, the processor 105 determines that the corresponding action of the icon is to be performed. In a second example, upon the icon being selected, the user may manually provide an input on the display device 115 (e.g., I/O device 120 incorporated for a touch screen) that selects the icon to perform the corresponding action.
[0027] The MU 100 may further be configured to incorporate other movements for the performing of a functionality. As discussed above, the rotational movements are not restricted to a turn within a common plane (e.g., yaw). The MU 100 may also be rotated with a roll or a pitch. Using the features for maintaining the position and orientation of the view on the display device 100, the user of the MU 100 may perform a pitch forward to change a selection of the icon. For example, with regard to image data 300, when a pitch forward is performed, the processor 105 may receive this movement input data and move the selection from the icon 302 to the icon 306. In such a scenario, the icon 306 may be selected, highlighted, and enlarged while the icon 302 is deslected and resized. The image data 300 may remain constant during this pitch rotational movement. That is, the image data 300 may only be updated when a yaw rotational movement or a translational movement is performed. In a further exemplary embodiment, the processor 105 may update the image data 300 for additional movements. For example, with a pitch rotational movement, the processor 105 may generate a perspective view so that the image data shown on the display device 115 is maintained with respect to the user. Specifically, with a pitch forward rotational movement, the processor 105 may resize the image data 300 so that an upper portion is widened and zoomed out while a bottom portion is shortened and zoomed in. In this manner, the view of the image data may be substantially the same prior to and after the pitch forward rotational movement.
[0028] It should be noted that the exemplary embodiments of the present invention relating to visual indicators is only exemplary. According to further exemplary embodiments of the present invention, non-visual indicators may also be utilized alone or in combination with the visual indicators. For example, when an icon in the image data is selected, audio data may be played on an audio output component of the MU 100. In a specific example, if the home icon (e.g., icon 302) is selected, a prerecorded "home" tone may be played on the audio output component such as saying the word "home" or a predetermined sound indicative of the home icon. When another icon is selected such as a barcode scan icon (e.g., icon 308), a precorded tone may be played on the audio output component such as saying the word "barcode scan" or a predetermined sound indicative of the barcode scan icon. The audio data may be played individually or in combination with the visual indicator as discussed above. In another example, an icon may be selected on the image data to provide haptic feedback. For example, when an icon is selected, a predetermined haptic output may be performed by the MU 100. In a specific example, if the home icon (e.g., icon 302) is selected, the MU 100 may include a vibration generating component that generates a vibration that is indicative of the home icon (e.g., continuous vibration for a predetermined amount of time). In another example, if another icon such as the barcode scan icon is selected, the vibration generating component may generate a different type of haptic feedback (e.g., predetermined number of vibrations spaced apart from one another). In this manner, the exemplary embodiments of the present invention may incorporate haptic feedback individually, in combination with other non-visual indicators, in combination with the visual indicators as discussed above, or any combination thereof. Accordingly, the types of visual indicators and the types of non- visual indicators may be combined in any manner to indicate to the user the selection/deselection of a particular icon or functionality.
[0029] Fig. 4 illustrates a flowchart of a method 400 for performing a functionality as a function of a movement of the mobile unit in accordance with some embodiments. Specifically, the MU 100 may be configured to maintain a position and orientation of elements shown on a view of a display device after a movement of the MU 100 as well as perform a functionality from the movement. The method 400 will be described with reference to the MU 100 of Fig. 1 and the types of movements shown in Figs. 2 and 3.
[0030] In step 405, image data is shown on the display device 115. As discussed above, the processor 105 is configured to run at least one application such as an operating system. The operating system may have a home screen in which a plurality of icons or selectable elements are shown. With reference to the image data 300, the icons 302-318 may be shown.
[0031] In step 410, a determination is made whether a movement of the MU 100 is detected. Specifically, the determination relates to whether the display device 115 is moved. As discussed above, the movement may be a rotational movement (e.g., roll, pitch, yaw) and/or a translational movement (e.g, up, down, left, right). Thus, the user of the MU 100 may move the display device 115 in a variety of manners. If no movement is determined, the method 400 returns to step 405 where the image data shown originally is continued to be shown. If movement is determined, the method 400 continues to step 415.
[0032] In step 415, the image data shown on the display device 115 is updated. As discussed above, if a rotational movement is detected, the position and orientation of elements of the iamge data or the entire image data may be maintained. Thus, if the display device 115 is rotated with respect to yaw such as with the image data 200 and the image data 205, the processor 105 may determine the updated, moved view on the display device 115. If a translational movement is detected, the position and orientation of elements of the image data or the entire image data may be maintained. Thus, if the display device 115 is moved translationally such as the image data 300 and the image data 320, the processor 105 may again determine the updated, moved view on the display device 115. If both a rotational and a translational movement is detected, the position and orientation of elements of the image data or the entire image data may be maintained. Thus, if the display device 115 is moved with both types of movements, the processor 105 may determine the updated, moved view on the display device 115.
[0033] In step 420, the processor 105 determines if a functionality is selected. If no functionality is selected, the method 400 returns to step 415 where the updated, moved image is continued to be shown on the display device 115. However, if a predefined functionality is selected, the method 400 continues to step 425. As discussed above, the image data 300 may select the icon 302 that corresponds to a predefined functionality. Subsequently, if the display device 115 is moved in a translational manner such as up and to the right, a selection functionality may be triggered so that the icon 304 may be selected. Thus, in step 425, the defined functionality is performed. As discussed above, the functionality may be performed in a variety of manners. For example, the processor 105 may automatically activate and perform the selected predefined functionality. In another example, the user may manually enter an input to perform the selected functionality.
[0034] The exemplary embodiments of the present invention provide a device and method for performing a functionality as a function of a movement of a MU that changes a view of a display device. The movement of the MU and the display device may be with regard to a rotational movement and/or a translational movement. The processor of the MU is configured to update the view on the display device as a function of the performed movement. Subsequently, the processor of the MU may be configured to perform a functionality as a function of the performed movement. For example, a selection functionality may be triggered so that an icon corresponding to the selected functionality may be altered such as changing a size or display of the icon.
[0035] In the foregoing specification, specific embodiments have been described. However, one of ordinary skill in the art appreciates that various modifications and changes can be made without departing from the scope of the invention as set forth in the claims below. Accordingly, the specification and figures are to be regarded in an illustrative rather than a restrictive sense, and all such modifications are intended to be included within the scope of present teachings.
[0036] The benefits, advantages, solutions to problems, and any element(s) that may cause any benefit, advantage, or solution to occur or become more pronounced are not to be construed as a critical, required, or essential features or elements of any or all the claims. The invention is defined solely by the appended claims including any amendments made during the pendency of this application and all equivalents of those claims as issued.
[0037] Moreover in this document, relational terms such as first and second, top and bottom, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. The terms "comprises," "comprising," "has", "having," "includes", "including," "contains", "containing" or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises, has, includes, contains a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by "comprises ...a", "has ...a", "includes ...a", "contains ...a" does not, without more constraints, preclude the existence of additional identical elements in the process, method, article, or apparatus that comprises, has, includes, contains the element. The terms "a" and "an" are defined as one or more unless explicitly stated otherwise herein. The terms "substantially", "essentially", "approximately", "about" or any other version thereof, are defined as being close to as understood by one of ordinary skill in the art, and in one non-limiting embodiment the term is defined to be within 10%, in another embodiment within 5%, in another embodiment within 1% and in another embodiment within 0.5%. The term "coupled" as used herein is defined as connected, although not necessarily directly and not necessarily
mechanically. A device or structure that is "configured" in a certain way is configured in at least that way, but may also be configured in ways that are not listed.
[0038] It will be appreciated that some embodiments may be comprised of one or more generic or specialized processors (or "processing devices") such as
microprocessors, digital signal processors, customized processors and field programmable gate arrays (FPGAs) and unique stored program instructions (including both software and firmware) that control the one or more processors to implement, in conjunction with certain non-processor circuits, some, most, or all of the functions of the method and/or apparatus described herein. Alternatively, some or all functions could be implemented by a state machine that has no stored program instructions, or in one or more application specific integrated circuits (ASICs), in which each function or some combinations of certain of the functions are implemented as custom logic. Of course, a combination of the two approaches could be used.
[0039] Moreover, an embodiment can be implemented as a computer-readable storage medium having computer readable code stored thereon for programming a computer (e.g., comprising a processor) to perform a method as described and claimed herein. Examples of such computer-readable storage mediums include, but are not limited to, a hard disk, a CD-ROM, an optical storage device, a magnetic storage device, a ROM (Read Only Memory), a PROM (Programmable Read Only Memory), an EPROM (Erasable Programmable Read Only Memory), an EEPROM (Electrically Erasable Programmable Read Only Memory) and a Flash memory. Further, it is expected that one of ordinary skill, notwithstanding possibly significant effort and many design choices motivated by, for example, available time, current technology, and economic considerations, when guided by the concepts and principles disclosed herein will be readily capable of generating such software instructions and programs and ICs with minimal experimentation.
[0040] The Abstract of the Disclosure is provided to allow the reader to quickly ascertain the nature of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In addition, in the foregoing Detailed Description, it can be seen that various features are grouped together in various embodiments for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed embodiments require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter lies in less than all features of a single disclosed embodiment. Thus the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separately claimed subject matter.

Claims

Claims
1. A method, comprising:
generating first image data indicative of a first view shown on a display device of a mobile unit (MU), the first view including a plurality of selectable elements, each selectable element configured to execute a predefined functionality, the first image data including first position data and first orientation data for each of the selectable elements;
determining movement data indicative of a movement of the display device relative to a user of the MU;
generating second image data indicative of a second view shown on the display device as a function of the first image data and the movement data, the second view including at least one of the selectable elements, the second image data including second position data and second orientation data for each of the at least one of the selectable elements, the second position data and the second orientation data being the same as the first position data and the first orientation data, respectively, relative to the user;
selecting one of the at least one of the selectable elements of the second view as a function of the second position data and the second orientation data; and
executing the predefined functionality corresponding to the selected one of the selectable elements.
2. The method of claim 1, wherein the movement is one of a translational movement, a rotational movement, and a combination thereof.
3. The method of claim 2, wherein the translational movement is one of an upward movement, a downward movement, a leftward movement, a rightward movement, and a combination thereof.
4. The method of claim 2, wherein the rotational movement is one of a yaw movement, a pitch movement, a roll movement, and a combination thereof.
5. The method of claim 2, wherein, when the translational movement is made, select ones of the selectable elements of the first view are removed.
6. The method of claim 1, wherein the second image data is generated continuously throughout the movement of the display device.
7. The method of claim 1, further comprising:
generating selection image data for the selected one of the at least one of the seletable elements, the selection image data including at least one visual feature.
8. The method of claim 7, wherein the at least visual feature includes an increase in size, a change in color, a highlight around the selected selectable element, and a combination thereof.
9. The method of claim 7, further comprising:
generating deselection image date for a previously selected one of the at least one of the selectable elements, the deselection image data removing the at least one visual feature.
10. The method of claim 1, wherein the functionality is executed one of automatically and manually.
11. A mobile unit (MU), comprising: a display device configured to show first image data indicative of a first view shown thereon, the first view including a plurality of selectable elements, each selectable element configured to execute a predefined functionality, the first image data including first position data and first orientation data for each of the selectable elements;
a processor configured to generate the first image data, the processor further configured to execute the predefined functionality;
a memory storing the first image data, the first position data, and the first orientation data; and
a sensor configured to generate movement data indicative of a movement of the display device relative to a user of the MU,
wherein the processor is configured to generate second image data indicative of a second view shown on the display device as a function of the first image data and the movement data, the second view including at least one of the selectable elements, the second image data including second position data and second orientation data for each of the at least one of the selectable elements, the second position data and the second orientation data being the same as the first position data and the first orientation data, respectively, relative to the user,
wherein the processor is configured to select one of the at least one of the selectable elements of the second view as a function of the second position data and the second orientation data, and
wherein the processor is configured to execut the predefined functionality corresponding to the selected one of the selectable elements.
12. The MU of claim 11 , wherein the movement is one of a translational movement, a rotational movement, and a combination thereof.
13. The MU of claim 12, wherein the translational movement is one of an upward movement, a downward movement, a leftward movement, a rightward movement, and a combination thereof.
14. The MU of claim 12, wherein the rotational movement is one of a yaw movement, a pitch movement, a roll movement, and a combination thereof.
15. The MU of claim 12, wherein, when the translational movement is made, select ones of the selectable elements of the first view are removed
16. The MU of claim 11, wherein the processor is configured to continuously generate the second image data throughout the movement of the display device.
17. The MU of claim 11, wherein the processor is configured to generate selection image data for the selected one of the at least one of the seletable elements, the selection image data including at least one visual feature.
18. The MU of claim 17, wherein the at least visual feature includes an increase in size, a change in color, a highlight around the selected selectable element, and a combination thereof.
19. The MU of claim 17, wherein the processor is configured to generate deselection image date for a previously selected one of the at least one of the selectable elements, the deselection image data removing the at least one visual feature.
20. A computer readable storage medium including a set of instructions executable by a processor, the set of instructions operable to:
generate first image data indicative of a first view shown on a display device of a mobile unit (MU), the first view including a plurality of selectable elements, each selectable element configured to execute a predefined functionality, the first image data including first position data and first orientation data for each of the selectable elements;
determine movement data indicative of a movement of the display device relative to a user of the MU;
generate second image data indicative of a second view shown on the display device as a function of the first image data and the movement data, the second view including at least one of the selectable elements, the second image data including second position data and second orientation data for each of the at least one of the selectable elements, the second position data and the second orientation data being the same as the first position data and the first orientation data, respectively, relative to the user;
select one of the at least one of the selectable elements of the second view as a function of the second position data and the second orientation data; and
execute the predefined functionality corresponding to the selected one of the selectable elements.
PCT/US2013/049945 2012-07-13 2013-07-10 Device and method for performing a functionality Ceased WO2014011785A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
DE112013003511.1T DE112013003511B4 (en) 2012-07-13 2013-07-10 Device and method for executing a function
GB1500202.5A GB2518564B (en) 2012-07-13 2013-07-10 Device and method for performing a functionality

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201261741163P 2012-07-13 2012-07-13
US61/741,163 2012-07-13
US13/684,658 2012-11-26
US13/684,658 US9791896B2 (en) 2012-07-13 2012-11-26 Device and method for performing a functionality

Publications (1)

Publication Number Publication Date
WO2014011785A1 true WO2014011785A1 (en) 2014-01-16

Family

ID=48874523

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2013/049945 Ceased WO2014011785A1 (en) 2012-07-13 2013-07-10 Device and method for performing a functionality

Country Status (4)

Country Link
US (1) US9791896B2 (en)
DE (1) DE112013003511B4 (en)
GB (1) GB2518564B (en)
WO (1) WO2014011785A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9202095B2 (en) 2012-07-13 2015-12-01 Symbol Technologies, Llc Pistol grip adapter for mobile device
US9697393B2 (en) 2015-11-20 2017-07-04 Symbol Technologies, Llc Methods and systems for adjusting mobile-device operating parameters based on housing-support type
US10509473B2 (en) * 2017-09-21 2019-12-17 Paypal, Inc. Providing haptic feedback on a screen

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001027735A1 (en) * 1999-10-12 2001-04-19 Myorigo Oy Operation method of user interface of hand-held device
GB2358336A (en) * 1999-11-03 2001-07-18 Motorola Inc Selecting alphanumeric characters or menu options by movement of the display device
US20100037184A1 (en) * 2008-08-08 2010-02-11 Chi Mei Communication Systems, Inc. Portable electronic device and method for selecting menu items

Family Cites Families (76)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE2610515C3 (en) 1976-03-12 1979-01-25 Agfa-Gevaert Ag, 5090 Leverkusen Cine film camera with a viewfinder and a handle
US4282425A (en) 1979-07-25 1981-08-04 Norand Corporation Instant portable bar code reader
US5035181A (en) 1985-01-22 1991-07-30 The United States Of America As Represented By The Secretary Of The Navy Thermosensitive pop-out device
US5250790A (en) 1988-05-11 1993-10-05 Symbol Technologies, Inc. Hand-mounted scanner with automatic manual initiation of reading indicia
US5756982A (en) 1990-09-11 1998-05-26 Metrologic Instruments, Inc. Body-wearable automatic laser scanner with power-conserving control subsystem
US6286760B1 (en) 1994-08-17 2001-09-11 Metrologic Instruments, Inc. Automatic hand-supportable laser projection scanner for omni-directional reading of bar code symbols within a narrowly confined scanning volume
US5905248A (en) 1990-09-11 1999-05-18 Metrologic Instruments, Inc. System and method for carrying out information-related transactions using web documents embodying transaction enabling applets automatically launched and executed in response to reading URL-encoded symbols pointing thereto
JP2733135B2 (en) 1990-11-20 1998-03-30 富士通株式会社 Laser generation control method for optical reader
US5340972A (en) 1991-05-13 1994-08-23 Symbol Technologies, Inc. Hands-free bar code scanner with finger activated optical control
DE69320456T2 (en) 1992-01-16 1999-04-29 Metrologic Instruments Inc., Blackwood, N.J. HAND-FREE LASER SCANNER ATTACHED TO A BODY AND ITS APPLICATION
US5204531A (en) 1992-02-14 1993-04-20 Digital Instruments, Inc. Method of adjusting the size of the area scanned by a scanning probe
US6189793B1 (en) 1992-06-12 2001-02-20 Metrologic Instruments, Inc. Automatic laser projection scanner with improved activation controlling mechanism
US6853293B2 (en) 1993-05-28 2005-02-08 Symbol Technologies, Inc. Wearable communication system
GB2282906B (en) 1993-10-13 1996-11-06 Dataquill Ltd Data enty systems
US5770848A (en) 1994-11-28 1998-06-23 Hitachi, Ltd. Apparatus and method for treating a commodity by automatically recognizing a barcode attached to a conveyed commodity by scanner
GB2299394A (en) 1995-03-31 1996-10-02 Frazer Concepts Ltd Computer input devices
US6128002A (en) 1996-07-08 2000-10-03 Leiper; Thomas System for manipulation and display of medical images
US5801918A (en) 1996-07-12 1998-09-01 Hand Held Products, Inc. Ergonomic housing for a micro computer
JPH1049290A (en) * 1996-08-05 1998-02-20 Sony Corp Information processing apparatus and method
US6607134B1 (en) 1997-07-17 2003-08-19 Symbol Technologies, Inc. Finger-mounted readers with low power radio frequency communications
US6837435B2 (en) 1997-06-26 2005-01-04 Symbol Technologies, Inc. Adapter unit having a handle grip for a personal digital assistant
US7124950B2 (en) 1997-09-16 2006-10-24 Metrologic Instruments, Inc. Bar code symbol reading system employing electronically-controlled raster-type laser scanner for reading bar code symbols during on hands-on and hands-free modes of operation
US6115025A (en) 1997-09-30 2000-09-05 Silicon Graphics, Inc. System for maintaining orientation of a user interface as a display changes orientation
US6184654B1 (en) 1998-07-28 2001-02-06 Double-Time Battery Corporation Wearable docking-holster system, with energy management, to support portable electronic devices
US7111786B2 (en) 1998-12-03 2006-09-26 Metrologic Instruments, Inc. Automatically-activated wireless hand-supportable laser scanning bar code symbol reading system with data transmission activation switch and automatic communication range dependent control
US6502754B1 (en) 1999-03-01 2003-01-07 Symbol Technologies, Inc. Data acquisition device
US6421234B1 (en) 2000-10-10 2002-07-16 Juniper Systems, Inc. Handheld electronics device having ergonomic features
US7065299B2 (en) 2000-12-05 2006-06-20 Ge Medical Systems Information Technologies, Inc. Medical device having a combination data reader and infrared data transceiver and method of using same
JP2002229675A (en) 2001-02-07 2002-08-16 Matsushita Electric Ind Co Ltd Portable terminal equipment for forearm wearing
US6834249B2 (en) * 2001-03-29 2004-12-21 Arraycomm, Inc. Method and apparatus for controlling a computing system
US6798429B2 (en) * 2001-03-29 2004-09-28 Intel Corporation Intuitive mobile device interface to virtual spaces
US6724366B2 (en) 2001-04-03 2004-04-20 Peter James Crawford Thumb actuated x-y input device
US6795304B1 (en) 2001-04-27 2004-09-21 Palmone, Inc. Keyboard sled with rotating screen
CN100414275C (en) 2001-05-07 2008-08-27 前视红外系统股份公司 Handheld Infrared Camera
GB2377147A (en) * 2001-06-27 2002-12-31 Nokia Corp A virtual reality user interface
US6726070B2 (en) 2002-05-20 2004-04-27 Robert Lautner Ergonomic input-device holder
US11275405B2 (en) 2005-03-04 2022-03-15 Apple Inc. Multi-functional hand-held device
GB2396728B (en) 2002-12-23 2005-04-20 Motorola Inc System method and equipment for reading information on a target
WO2004066615A1 (en) 2003-01-22 2004-08-05 Nokia Corporation Image control
US7537160B2 (en) 2003-04-07 2009-05-26 Silverbrook Research Pty Ltd Combined sensing device
US20030179178A1 (en) 2003-04-23 2003-09-25 Brian Zargham Mobile Text Entry Device
US7195169B2 (en) 2003-07-23 2007-03-27 Symbol Technologies, Inc. Mobile terminal with ergonomic housing
US7746511B2 (en) 2004-04-23 2010-06-29 Symbol Technologies, Inc. Scan head rotation at different optimum angles
US6974083B1 (en) 2004-07-23 2005-12-13 Symbol Technologies, Inc. Point-of-transaction workstation for electro-optically reading one-dimensional indicia, including image capture of two-dimensional targets
USD540838S1 (en) 2005-01-13 2007-04-17 Flir Systems Ab Camera
US7808478B2 (en) 2005-08-22 2010-10-05 Samsung Electronics Co., Ltd. Autonomous handheld device having a drawing tool
US20070113098A1 (en) 2005-11-14 2007-05-17 Symbol Technologies, Inc. Grip security arrangement
US7490776B2 (en) 2005-11-16 2009-02-17 Intermec Scanner Technology Center Sensor control of an aiming beam of an automatic data collection device, such as a barcode reader
US7250603B1 (en) 2006-03-24 2007-07-31 Draeger Safety, Inc. Crawling handle for thermal imaging camera
US7748632B2 (en) 2006-07-25 2010-07-06 Hand Held Products, Inc. Portable data terminal and battery therefor
US20080078839A1 (en) 2006-09-28 2008-04-03 Edward Barkan Electro-optical reader with object sensor
US7886377B2 (en) 2006-10-13 2011-02-15 Hill-Rom Services, Inc. Push handle with rotatable user interface
US7389933B2 (en) 2006-10-13 2008-06-24 Symbol Technologies, Inc. Triggerless electro-optical reader
US8317098B2 (en) 2006-12-01 2012-11-27 Ncr Corporation Item having a data tag
US20080128499A1 (en) 2006-12-05 2008-06-05 Intermec Ip Corp. Programmable trigger handle for handheld devices
US20080163504A1 (en) 2007-01-05 2008-07-10 Smith John E Apparatus and methods for locating and identifying remote objects
US20090262074A1 (en) * 2007-01-05 2009-10-22 Invensense Inc. Controlling and accessing content using motion processing on mobile devices
US7764488B2 (en) 2007-04-23 2010-07-27 Symbol Technologies, Inc. Wearable component with a memory arrangement
US8068121B2 (en) * 2007-06-29 2011-11-29 Microsoft Corporation Manipulation of graphical objects on a display or a proxy device
US20090033633A1 (en) 2007-07-31 2009-02-05 Palo Alto Research Center Incorporated User interface for a context-aware leisure-activity recommendation system
TWM332902U (en) 2007-08-10 2008-05-21 Li Shing Comm Science And Technology Co Ltd Tag reading device and tag
US8102424B2 (en) 2007-10-17 2012-01-24 Fluke Corporation Ergonomic configurations for thermal imaging cameras
US9343034B2 (en) 2008-06-07 2016-05-17 Nokia Technologies Oy User interface, device and method for displaying a stable screen view
US20100026498A1 (en) 2008-07-29 2010-02-04 David Bellows Method and System for Adapting a Mobile Computing Device with an RFID Antenna
US8235590B2 (en) 2008-08-21 2012-08-07 Fluke Corporation Thermal instrument engine
US8717283B1 (en) * 2008-11-25 2014-05-06 Sprint Communications Company L.P. Utilizing motion of a device to manipulate a display screen feature
US8408513B2 (en) 2009-01-06 2013-04-02 Mark Smith Holder systems for mobile devices
CN101877736A (en) 2009-04-30 2010-11-03 深圳富泰宏精密工业有限公司 Automatic adjusting system and method for user interface of mobile terminal
US8427508B2 (en) * 2009-06-25 2013-04-23 Nokia Corporation Method and apparatus for an augmented reality user interface
US7867019B1 (en) 2009-07-17 2011-01-11 Fluke Corporation Thermal imaging device with a battery pack with a shock absorber
US8692851B2 (en) 2010-01-06 2014-04-08 Apple Inc. Device, method, and graphical user interface with grid transformations during device rotation
US8517273B2 (en) 2010-05-28 2013-08-27 Datalogic ADC, Inc. Data reader with multiple modes of operation
USD665440S1 (en) 2010-11-03 2012-08-14 Flir Systems Ab Infrared camera
USD658222S1 (en) 2011-03-23 2012-04-24 Fluke Corporation Thermal imager
US9285950B2 (en) 2011-03-30 2016-03-15 Google Inc. Hover-over gesturing on mobile devices
US9035878B1 (en) * 2012-02-29 2015-05-19 Google Inc. Input system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001027735A1 (en) * 1999-10-12 2001-04-19 Myorigo Oy Operation method of user interface of hand-held device
GB2358336A (en) * 1999-11-03 2001-07-18 Motorola Inc Selecting alphanumeric characters or menu options by movement of the display device
US20100037184A1 (en) * 2008-08-08 2010-02-11 Chi Mei Communication Systems, Inc. Portable electronic device and method for selecting menu items

Also Published As

Publication number Publication date
US9791896B2 (en) 2017-10-17
US20140145925A1 (en) 2014-05-29
DE112013003511T5 (en) 2015-05-07
DE112013003511B4 (en) 2024-10-31
GB2518564A (en) 2015-03-25
GB2518564B (en) 2020-12-09

Similar Documents

Publication Publication Date Title
CN113748407B (en) Electronic device and method for displaying an object providing a split screen
CN105959553B (en) A kind of switching method and terminal of camera
US9766739B2 (en) Method and apparatus for constructing a home screen in a terminal having a touch screen
US9524040B2 (en) Image editing apparatus and method for selecting area of interest
EP2960783B1 (en) Mobile terminal and method for controlling the same
CN103999028B (en) Invisible control
US20170010780A1 (en) Programmable touchscreen zone for mobile devices
US9508322B2 (en) Text box resizing
US9152316B2 (en) Electronic device, controlling method thereof, and non-transitory storage medium
US9030430B2 (en) Multi-touch navigation mode
EP3089433B1 (en) Apparatus and method for controlling operation of mobile terminal
KR20170093658A (en) Electronic device comprising multiple displays and method for controlling thereof
TW200905536A (en) Visual feedback display
JP2009037583A (en) Space-limited marking menu for mobile devices
CA2785016C (en) Overlay handling
US20140310653A1 (en) Displaying history information for application
JP5893456B2 (en) Display control apparatus, control method therefor, program, and storage medium
KR20140026723A (en) Method for providing guide in portable device and portable device thereof
US20160224221A1 (en) Apparatus for enabling displaced effective input and associated methods
US20150185987A1 (en) Method, apparatus and computer readable medium for zooming and operating screen frame
US20140380244A1 (en) Visual table of contents for touch sensitive devices
US20140168098A1 (en) Apparatus and associated methods
KR20140099588A (en) Method for editing contents and display device implementing the same
US20170131879A1 (en) Electronic device for displaying multiple screens and control method therefor
US9791896B2 (en) Device and method for performing a functionality

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13740446

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 1500202

Country of ref document: GB

Kind code of ref document: A

Free format text: PCT FILING DATE = 20130710

WWE Wipo information: entry into national phase

Ref document number: 1500202.5

Country of ref document: GB

WWE Wipo information: entry into national phase

Ref document number: 112013003511

Country of ref document: DE

Ref document number: 1120130035111

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13740446

Country of ref document: EP

Kind code of ref document: A1