WO2013176472A1 - Method and apparatus of controlling user interface using touch screen - Google Patents

Method and apparatus of controlling user interface using touch screen Download PDF

Info

Publication number
WO2013176472A1
WO2013176472A1 PCT/KR2013/004458 KR2013004458W WO2013176472A1 WO 2013176472 A1 WO2013176472 A1 WO 2013176472A1 KR 2013004458 W KR2013004458 W KR 2013004458W WO 2013176472 A1 WO2013176472 A1 WO 2013176472A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
screen
uis
touch input
touchable
Prior art date
Application number
PCT/KR2013/004458
Other languages
French (fr)
Inventor
Hyeong-Min Nam
Original Assignee
Samsung Electronics Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co., Ltd. filed Critical Samsung Electronics Co., Ltd.
Priority to JP2015513898A priority Critical patent/JP6279553B2/en
Priority to CN201380026903.0A priority patent/CN104321736B/en
Priority to EP13793991.4A priority patent/EP2852882B1/en
Publication of WO2013176472A1 publication Critical patent/WO2013176472A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/22Details of telephonic subscriber devices including a touch pad, a touch sensor or a touch detector

Definitions

  • the present invention relates to a touch screen that provides a User Interface (UI). More particularly, the present invention relates to a method and apparatus of controlling a UI to increase user convenience.
  • UI User Interface
  • Digital portable terminals such as smart phones, tablet Personal Computers (PCs), e-book readers, and the like have rapidly gained popularity and their roles, uses and functions have changed.
  • Smart phones which are being widely used, function additionally as an information processor like a personal information manager, in addition to the role of a personal portable communication device.
  • an object-oriented information input means is used for a digital portable terminal in order to enhance user convenience.
  • the digital portable terminal is equipped with a touch screen to allow a user to input necessary information conveniently and to process the input information.
  • a user may be inconvenienced when the user selects and inputs information on the touch screen of a digital portable terminal because of the different sizes of the touch screens.
  • the different sizes of the touch screens are developed and widely equipped for digital portable terminals.
  • a larger touch screen relatively in a digital portable terminal is difficult to touch by one-hand users,
  • FIGS. 1A and 1B illustrate a limitation of a larger touch screen in a digital portable terminal, in terms of a touchable area according to the related art.
  • FIG. 1B illustrates a larger touch screen 100b in a smart phone than a touch screen 100a in a related-art smart phone illustrated in FIG. 1A.
  • a part of the touch screen 100b in the smart phone illustrated in FIG. 1B may be untouchable or inaccessible for touching by a user according to the use environment of an input means because the touch screen 100b is relatively large.
  • the user's hand may be used as the input means of the smart phone.
  • a user that manipulates a digital portable terminal with one hand is referred to as a 'one-hand user'.
  • a one-hand user should first hold the smart phone. Specifically, the user holds the smart phone with the other four fingers of one hand except for the thumb. Then, the one-hand user inputs information to the smart phone, mainly with a thumb 105.
  • the one-hand user may reach the entire display area of the touch screen 100a of the related-art smart phone with the thumb 105 to manipulate the touch screen 100a.
  • the manipulation area is confined to a part of the touch screen 100b larger than the touch screen 100a and thus there are areas beyond reach of the thumb 105, i.e. areas that cannot be touched by the thumb 105 or areas above which the thumb 105 cannot be placed, on the touch screen 100b.
  • UIs are arranged in an array having grids at predetermined intervals on the touch screen or UIs are confined to a specific position on the touch screen in order to receive a user input.
  • a manipulation range available to the one-hand user is limited to a part of the touch screen 100b.
  • the touch screen 100b provides UIs in a typical grid structure or UIs beyond the manipulation range, the UI convenience of the one-hand user may further be decreased.
  • a user may be inconvenienced when the user selects and inputs information on the touch screen of a digital portable terminal because of the different sizes of the touch screens.
  • the different sizes of the touch screens are developed and widely equipped for digital portable terminals.
  • a larger touch screen relatively in a digital portable terminal is difficult to touch by one-hand users.
  • an aspect of the present invention is to provide a method of determining a part of the display area of a touch screen as a user-touchable area and providing User Interfaces (UIs) in the user-touchable area, and a touch screen using the method.
  • UIs User Interfaces
  • Another aspect of the present invention is to provide a method of rearranging UIs in a user-touchable area being a part of the display area of a touch screen by adjusting the sizes and positions of the UIs, taking into account user convenience, and a touch screen using the method.
  • a method of providing UIs on a touch screen includes displaying a menu item in a basic setting menu that is preset in a user device, the menu item being used to select rearrangement of UIs arranged in a display area of the touch screen in a user-touchable partial area, and displaying a rearranged screen displaying the UIs rearranged in the user-touchable partial area, upon sensing of a user touch input selecting the rearrangement of the UIs.
  • a touch screen apparatus of providing UIs includes a display unit displaying a menu item in a basic setting menu that is preset in a user device, the menu item being used to select rearrangement of UIs arranged in a display area of the touch screen apparatus in a user-touchable partial area, and a controller controlling the display unit to display a rearranged screen including the UIs rearranged in the user-touchable partial area,upon sensing of a user touch input selecting the rearrangement of the UIs.
  • FIGS. 1A and 1B illustrate a limitation of using a touch screen with an increased size in a digital portable terminal, in terms of a user-touchable area according to the related art
  • FIG. 2 illustrates a comfort zone defined according to an exemplary embodiment of the present invention
  • FIG. 3 is a block diagram of a touch screen control apparatus according to an exemplary embodiment of the present invention.
  • FIG. 4A is a flowchart illustrating an operation of a comfort zone decider in the touch screen control apparatus according to an exemplary embodiment of the present invention
  • FIG. 4B illustrates a touch input request screen according to an exemplary embodiment of the present invention
  • FIG. 4C illustrates a method of determining a comfort zone according to an exemplary embodiment of the present invention
  • FIG. 5A is a flowchart illustrating an operation of a User Interface (UI) layout converter in the touch screen control apparatus according to an exemplary embodiment of the present invention
  • FIG. 5B illustrates two-dimensional projective transformation between an existing display area and a current comfort zone according to an exemplary embodiment of the present invention
  • FIG. 6 illustrates a comfort zone according to an exemplary embodiment of the present invention
  • FIG. 7 illustrates the shapes of various comfort zones and the positions and sizes of icons rearranged in the comfort zones according to an exemplary embodiment of the present invention
  • FIG. 8A illustrates an icon layout on a home screen and an initial operation according to an exemplary embodiment of the present invention
  • FIG. 8B illustrates screens displayed for a specific setting of rearranging selected icons according to an exemplary embodiment of the present invention
  • FIG. 9A illustrates a screen that displays additional UIs available for rearrangement of selected icons according to an exemplary embodiment of the present invention
  • FIG. 9B illustrates screens that display additional UIs available on a content basis for rearrangement of selected icons according to an exemplary embodiment of the present invention
  • FIG. 10A is a flowchart illustrating an operation of the comfort zone decider in a touch screen control apparatus according to an exemplary embodiment of the present invention
  • FIG. 10B illustrates a comfort zone selection screen according to an exemplary embodiment of the present invention
  • FIG. 10C illustrates default comfort zones pre-stored in a touch screen control apparatus according to an exemplary embodiment of the present invention
  • FIG. 10D illustrates a default comfort zone selection screen according to an exemplary embodiment of the present invention
  • FIG. 10E illustrates a case where a 'new setting button' is selected on a default comfort zone selection screen according to an exemplary embodiment of the present invention
  • FIG. 11A illustrates menu items of a comfort zone apply setting menu added to a setting menu of a user device according to an exemplary embodiment of the present invention.
  • FIG. 11B illustrates a case where if 'Always On' is selected in an 'Apply Time' menu item of the comfort zone apply setting menu, a comfort zone is applied only when a specific sliding motion is made across a touch screen as a user touch input according to an exemplary embodiment of the present invention.
  • Exemplary embodiments of the present invention will be provided to achieve the above-described technical aspects of the present invention.
  • defined entities may have the same names, to which the present invention is not limited.
  • exemplary embodiments of the present invention can be implemented with same or ready modifications in a system having a similar technical background.
  • the present invention provides a method of determining a part of a touch screen having a user-untouchable display area as a user-touchable area and rearranging User Interfaces (UIs) in the user-touchable area.
  • UIs may be any graphical element displayed on a touch screen that a user may interact and/or interface with, such as a button, an icon, a symbol, a command, a picture, a video, and any other similar and/or suitable element that is graphically displayed on a touch screen and/or display device.
  • an input means for a touch screen having a user-untouchable display area is a user's one hand, by way of example.
  • the present invention is not limited thereto, and the input means may be any suitable and/or similar input means, such as any finger of a user and a stylus.
  • a user that manipulates a digital portable terminal with one hand is referred to as a 'one-hand user'.
  • the input means is not limited to a user's one hand in the present invention.
  • a touchable part of the display area of a touch screen is defined as a user-touchable area according to an exemplary embodiment of the present invention.
  • the user-touchable area includes an area touchable by an input means and an area above which the input means may be placed although the input means does not contact the touch screen in the display area of the touch screen.
  • an input to the touch screen for example, a motion of a user s hand or a stylus pen is recognized by motion recognition.
  • the touch screen of the present exemplary embodiments may have a relatively large screen size, compared to a related-art touch screen.
  • a touch screen includes the user-untouchable area, i.e. an area untouchable and/or unreachable by an input means according to a user s reach or an area above which the input means cannot be placed, the present exemplary embodiments are applicable to the touch screen.
  • an input means by which to determine a user-touchable partial area is a thumb of a one-hand user.
  • the user-touchable partial area is called a comfort zone defined as an area touchable by the thumb. While the exemplary embodiments of the present invention will be described using the term 'comfort zone' the comfort zone is interchangeable with the user-touchable partial area having the same meaning.
  • FIG. 2 illustrates a comfort zone defined according to an exemplary embodiment of the present invention.
  • the one-hand user when a one-hand user manipulates a portable digital terminal having a touch screen with one hand, the one-hand user may shape the hand as illustrated in FIG. 2.
  • the one-hand user holds the digital portable terminal with the other four fingers of the hand except for the thumb.
  • the user inputs information such as a specific request by touching the display area of the touch screen with the thumb.
  • a fan-shaped area 200 defines a range in which the thumb may reach on the touch screen.
  • a comfort zone 205 may be defined as an area which can be touched by the thumb of the one-hand user or an area above which the thumb can be placed, i.e. the whole fan-shaped area 200.
  • the comfort zone 205 may be defined as a part of the fan-shaped area 200, which is readily touchable by the thumb or easily sensible, e.g. a shaded part of the fan-shaped area 200.
  • Exemplary embodiments of the present invention provide a method of rearranging UIs in a comfort zone by adjusting the positions, intervals, and layout of the UIs so that the one-hand user may conveniently manipulate a user device.
  • the exemplary embodiments of the present invention also provide additional UIs with which a user uses UIs rearranged in a comfort zone, taking into account user experience.
  • FIG. 3 is a block diagram of a touch screen control apparatus according to an exemplary embodiment of the present invention.
  • a touch screen control apparatus 300 performs specific operations to display information on the touch screen of a digital portable terminal that a one-hand user manipulates.
  • the touch screen control apparatus 300 includes a display unit 305 which may be a touch screen, a comfort zone decider 310, a context decider 315, and a UI layout converter 320.
  • the display unit 305 may be any type of display unit for displaying graphical information, such as a Liquid Crystal Display (LCD) unit, a Light Emitting Diode (LED) display unit, a Thin-Film Transistor (TFT) display unit, an Organic LED (OLED) display unit, or any other similar and/or suitable type of display unit.
  • LCD Liquid Crystal Display
  • LED Light Emitting Diode
  • TFT Thin-Film Transistor
  • OLED Organic LED
  • the comfort zone decider 310, the context decider 315, and the UI layout converter 320 may be incorporated into a controller (not shown), or any other similar and/or suitable type of hardware, in a digital portable terminal having the touch screen control apparatus 300 of FIG. 3.
  • the controller may be configured as at least one processor having a program to control the operation of the display unit 305 and UI operations according to the exemplary embodiments of the present invention.
  • the touch screen control apparatus 300 may further include a motion sensor (not shown).
  • the comfort zone decider 310 receives a user input needed to determine a comfort zone and determines a comfort zone based on the user input.
  • the context decider 315 determines the type of content for which a current UI is activated.
  • the UI layout converter 320 renders a graphic image on the display unit 305 and re-adjusts a screen configuration including the sizes, intervals, and layout of UIs in the determined comfort zone according to an exemplary embodiment of the present invention.
  • the display unit 305 displays a graphic image including the UIs rearranged in the comfort zone in a display area. Operations of the components of the touch screen control apparatus 300 will be described below in greater detail.
  • FIG. 4A is a flowchart illustrating an operation of a comfort zone decider in a touch screen control apparatus according to an exemplary embodiment of the present invention
  • FIG. 4B illustrates a user touch input according to an exemplary embodiment of the present invention
  • FIG. 4C illustrates a method of determining a comfort zone according to an exemplary embodiment of the present invention.
  • the comfort zone decider is the comfort zone decider 310 of FIG. 3.
  • the comfort zone decider 310 controls the display unit 305 to display a comfort zone selection screen (not shown) to determine a comfort zone and then proceeds to step 405.
  • the comfort zone selection may be, for example, a locked home screen or an additional screen requesting a user touch input. Whether the display unit 305 is to display the locked home screen or the additional screen requesting a user touch input may be preset by a user or by default by a manufacturer.
  • step 405 the comfort zone decider 310 determines whether a user touch input has been detected.
  • the one-hand user touches the touch screen corresponding to the display unit 305. Specifically, the one-hand user touches a partial area 430 of the touch screen with a thumb.
  • the touch includes a sliding or drag motion. For example, if a locked home screen is provided as a comfort zone selection, the one-hand user may unlock the screen by sliding or dragging the thumb across the touch screen.
  • the comfort zone decider 310 determines that a user touch input has been detected and goes to step 410. On the contrary, in the absence of a user touch input or if detection of a user touch input is not recognized, the comfort zone decider 310 awaits reception of a user touch input in step 400. Specifically, the comfort zone decider 310 may await reception of a user touch input to unlock the screen or may control the display unit 305 to display an additional touch input request screen on the touch screen.
  • the comfort zone decider 310 may provide a screen from which the user may select a preset default comfort zone. Default comfort zones will be described later in greater detail.
  • the comfort zone decider 310 determines the partial area touched by the thumb as a comfort zone.
  • a user-touchable partial area 440 is not confined to an actual area touched by a thumb of a one-hand user. Specifically, if the one-hand user touches only a specific part 441 of the area 440 with the thumb as illustrated in screen 450 of FIG. 4C, the comfort zone decider 310 determines whether the user has slided or dragged the thumb, for example, from right to left or from left to right, estimates a touchable area based on the specific touched area and the touched direction, and determines the estimated touchable area as a comfort zone.
  • the comfort zone decider 310 controls the display unit 305 to display the comfort zone so that the user may identify the comfort zone.
  • the display unit 305 may display the boundaries of the comfort zone or the full comfort zone on the touch screen.
  • the comfort zone decider 310 controls the display unit 305 to display a screen that prompts the user to maintain or adjust the comfort zone in step 415.
  • the comfort zone decider 310 receives a user input in response to the question.
  • the providing of the screen asking the user whether to maintain or adjust a comfort zone may be set by default in the digital portable terminal by the manufacturer or freely set by the user during initial setting of the digital portable terminal, and the screen may be configured to prompt the user to make a choice between maintenance and adjustment of a comfort zone.
  • the comfort zone decider 310 determines the determined comfort zone as a current comfort zone and provides information about the current comfort zone to the UI layout converter 320 in step 420. On the contrary, if the user input indicates adjustment of the comfort zone, then the comfort zone decider 310 controls the display unit 305 to provide a touch input request screen so that the user may adjust the comfort zone in step 425. Specifically, the display unit 305 displays boundaries 443 and 445 of the determined comfort zone on the touch screen under the control of the comfort zone decider 310, as illustrated in screen 451 of FIG. 4C.
  • the boundary 445 is placed in an adjustable state. Then the user adjusts the size of the comfort zone by dragging the clicked boundary 445 to an intended position 449.
  • the other boundary 443 may be adjusted in the same manner.
  • Clicking and/or dragging used to adjust a comfort zone is an exemplary user input. Therefore, an operation of placing a boundary of a comfort zone to an adjustable state and an operation of adjusting the selected boundary may be performed by predefined various inputs. For example, when a boundary of a comfort zone is placed in an adjustable state by clicking on the boundary, then the boundary of the comfort zone may be changed by a predetermined extent at each click or each time a predetermined motion is recognized.
  • the context decider 315 determines the type of content to be provided in the comfort zone.
  • Table 1 below lists exemplary content types that the context decider 315 of the touch screen control apparatus 300 determines to provide on UIs in the comfort zone. If content is provided on UIs with no distinction made between a comfort zone and a non-comfort zone or if content of a predetermined type is provided on UIs in the comfort zone, then the context decider 315 may not be included in the touch screen control apparatus 300.
  • Table 1 Content Type Example Icons Icons on launcher screen Application control UI Play, stop, pause, etc. of video player Page view Next or previous page on e-book, Web page, etc. List view Lists
  • content types include, for example, icons, an application control UI, a page view, and a list view.
  • the icons are arranged on a home screen displayed on the touch screen of a digital portable terminal that a one-hand user manipulates and each icon provides a function of executing an application mapped to the icon.
  • the application control UI provides a function of executing a manipulation function such as play, stop, pause and the like of a video player.
  • the page view provides a function of returning to the previous page or moving to the next page on an e-book or a Web page.
  • the list view provides a function of listing specific items on the touch screen.
  • FIG. 5A is a flowchart illustrating an operation of a UI layout converter in a touch screen control apparatus according to an exemplary embodiment of the present invention.
  • the UI layout converter is the UI layout converter 320 of FIG. 3.
  • the UL layout converter 320 acquires information about a determined comfort zone from the comfort zone decider 310 in step 500.
  • the UI layout converter 320 divides an existing display area prior to a layout change to the comfort zone, which may be referred to as an existing display area, into a plurality of sub-areas and calculates the coordinates of each sub-area. While rectangles, parallelograms, trapezoids, and the like are available as the shapes of the sub-areas, the following description will be given in the context of each sub-area being a parallelogram, by way of example.
  • the UI Layout converter 320 divides the comfort zone into sub-areas and calculates coordinates of the sub-areas.
  • the UI layout converter 320 calculates a mapping relationship between the coordinates of the display area and the coordinates of the comfort zone. A manner in which the UI layout converter 320 calculates the mapping relationship will be described later in greater detail according to an exemplary embodiment of the present invention.
  • the UI layout converter 320 converts UIs arranged in the existing display area to UIs for the comfort zone.
  • FIG. 5B illustrates two-dimensional projective transformation between an existing display area and a current comfort zone according to an exemplary embodiment of the present invention.
  • an existing display area 550 is divided into, for example, sub-areas, e.g. n rectangles P 1 ,P 2 ,...,P n ,each having a predetermined size along a vertical axis in step 502.
  • a comfort zone 560 is divided into sub-areas, e.g. n squares C 1 ,C 2 ,...,C n , corresponding to the n rectangles P 1 ,P 2 ,...,P n in step 504.
  • the UI layout converter 320 determines the mapping relationship between the coordinates of the n rectangles P 1 ,P 2 ,...,P n and the coordinates of the squares C 1 ,C 2 ,...,C n by two-dimensional projective transformation.
  • the two-dimensional projective transformation may be defined as the following table.
  • a first rectangle P1 which is divided from the existing display area 550, may be represented by the coordinates of four points 501, 503, 505 and 507.
  • the square C1 of the comfort zone 560 corresponding to the rectangle P 1 may be represented by the coordinates of four points 511, 513, 515 and 517.
  • the UI layout converter 320 calculates a matrix A having, as elements, mapping relationships between the coordinates of the points 501, 503, 505, and 507 of the rectangle P1 and the coordinates of the points 511, 513, 515, and 517 of the square C1 by two-dimensional projective transformation.
  • the UI layout converter 320 may express the coordinates x 1 and x 2 of the first point 501 of the rectangle P 1 using the coordinates u 1 andu 2 of the first point 511 of the square C 1 according to Equation (1).
  • the UI layout converter 320 changes x 1 and x 2 in Equation (1) to the expression of Equation (2).
  • the UI layout converter 320 determines the matrix A with a total of nine elements a 11, a 12, a 13 ,...,a 33 of the variables A 1 ,A 2 ,and A 3 .
  • the matrix A is expressed as Equation (3).
  • one of the coordinate pairs, i.e. a first coordinate pair, of the existing display area 550 and one of the coordinate pairs, i.e. a second coordinate pair, of the comfort zone 560 may be expressed as a matrix A with nine elements.
  • the coordinates of the four points 511, 513, 515 and 517 of the square C 1 corresponding to the coordinates of the four points 501, 503, 505 and 507 of the rectangle P 1 may be obtained. Accordingly, once the four coordinate pairs of the rectangle P 1 and the four coordinate pairs of the square C 1 corresponding to the rectangle P 1 are determined, four implementations of Equation(1) and four implementation of Equation(2) describe therespective mapping relationships between the four coordinate pairs of the rectangle P 1 and the four coordinate pairs of the squareC 1 , and thus a total of eighte quations exist. Then any point of the rectangle P 1 may be converted to a point of the square C 1 using one matrix A describing the mapping relationship between therectangle P 1 and the square C 1 .
  • Matrices A are calculated with regards to the mapping relationships between the coordinates of the other rectangles P 2 ,...,P n and the coordinates of the other squares C 2 , ..., C n in the same manner. Then the coordinates of a point of a rectangle are converted to the coordinates of a point of a parallelogram corresponding to the rectangle, i.e. the coordinates of a point of the comfort zone 560.
  • the UI layout converter 320 calculates a matrix A using the first coordinate pairs of four points of each of the sub-areas of an existing display area 550 and the second coordinate pairs of four points of a comfort zone 560, e.g. the coordinates of the points of a parallelogram, corresponding to the first coordinate pairs by Least Square (LSQ) formulation, such as a least square method, RANdom Sample Consensus (RANSAC), or the like.
  • LSQ Least Square
  • RANSAC Random Sample Consensus
  • the UI layout converter 320 may express vector a from the elements of the matrix A according to Equation (4).
  • the UI layout converter 320 may obtain the comfort zone conversion vector a expressed as Equation (6) by representing a homogeneous equation according to Equation (5).
  • the UI layout converter 320 calculates matrices A that describe the mapping relationships between the first coordinate pairs of the points of each sub-area divided from the existing display area and the second coordinate pairs of the points of each sub-area divided from the comfort zone in step 506 and converts UIs in the existing display area to UIs in the comfort zone based on the matrices A in step 508. Specifically, the mapping relationship A between each sub-area of the existing display area and a corresponding sub-area of the comfort zone is determined. Then the coordinates of UIs within the sub-areas of the existing display area are converted to coordinates corresponding to the UIs in the sub-areas of the comfort zone based on the determined matrices A.
  • the first coordinate pairs of the positions of the UIs in the existing display area may be converted to the second coordinate pairs of positions of the UIs in the comfort zone.
  • the UI layout converter 320 may adjust at least one of the positions, sizes, and shapes of the UIs in the comfort zone.
  • FIG. 6 illustrates a comfort zone according to an exemplary embodiment of the present invention.
  • an outer area 630 shown as a shaded part, of the comfort zone may be outside the boundary of the display area of the touch screen.
  • the comfort zone may be larger or smaller than the existing display area. Compared to the display area, the comfort zone may be streamlined or distorted in shape. Therefore, there may exist a need for adjusting the sizes, intervals, and layout of icons displayed in the display area, when the display area is transformed to the comfort zone.
  • the UI layout converter 320 may move UIs located in the outer area 630 to the next page, scale down the sizes of the UIs, or change the shapes of the UIs by adjusting at least one of the positions, sizes, and shapes of UIs, e.g.
  • the UI layout converter 320 may control the display unit 305 to display an additional screen requesting a user input for UI adjustment.
  • the UI layout converter 320 may also control the display unit 305 to display a screen requesting input of the number of uses of each icon. For example, upon receipt of the number of uses of each icon, the UI layout converter 320 may control the display unit 305 to arrange icons having the numbers of uses smaller than a predetermined threshold in the outer area 630. Adjustment of UIs in the comfort zone may be optional.
  • the exemplary embodiments have described above with reference to FIGS. 5A, 5B and 6 such that UIs of an existing display area are converted to UIs of a comfort zone by two-dimensional projective transformation according to the exemplary embodiment of the present invention.
  • the two-dimensional projective transformation is an exemplary method of converting UIs of the display area to UIs of the comfort zone and thus the present invention is not limited to the two-dimensional projective transformation.
  • a method of converting UIs of an existing display area to UIs of a comfort zone will be described.
  • a plurality of default comfort zones are pre-stored during initial setting of a touch screen by the manufacturer.
  • the default comfort zones are formed into shapes that users are likely to frequently use.
  • the comfort zone decider 310 it is also possible for the comfort zone decider 310 to additionally determine a comfort zone based on a user s preference according to a user selection. If each of the default comfort zones includes UIs transformed from UIs of the display area, upon user selection of one of the default comfort zones, an operation of adjusting preset UIs of the selected default comfort zone may be performed selectively.
  • FIG. 7 illustrates the shapes of various comfort zones and the positions and sizes of icons adjusted according to the shapes of the comfort zones according to an exemplary embodiment of the present invention.
  • icons are taken as an exemplary content type displayed in a display area 700, the present invention is not limited thereto, and the present exemplary embodiment is also applicable to other types of content such as a control UI, a page view, and a list view.
  • the display area 700 generally displays icons across the whole area of a touch screen.
  • the icons are arranged equidistantly at their original positions 705.
  • Each icon is spaced from its upper, lower, left, and right adjacent icons by the same distance.
  • the icons displayed in the display area 700 are of the same size. While the icons have the same distance and size in the exemplary embodiment of FIG. 7, the sizes and positions of icons arranged in the display area may be adjusted according to a user setting.
  • the icons mapped to the display area 700 are rearranged at new coordinates in a predetermined comfort zone by two-dimensional projective transformation described above with reference to the exemplary embodiments of FIGS. 5A and 5B.
  • various shapes are available to a comfort zone according to a user input.
  • the icons of the display area 700 are displayed at new coordinates corresponding to the original icon positions 705 in comfort zones 710, 720 and 730, which may also be respectively referred to as comfort zones 1-1, 2-1, and 3-1.
  • the icons of the display area 700 are moved to new coordinates mapped to the original positions of the icons in comfort zone 1-1, while the sizes of the icons are still kept unchanged.
  • An area available to the icons gets narrower from bottom to top in comfort zone 2-1, relative to the display area 700. Therefore, the icons are arranged at new coordinates mapped to their original positions with sizes and intervals decreased in correspondence with a rate at which the area of the comfort zone 2-1 gets narrower.
  • the icons are arranged at new coordinates mapped to their original positions 705, with sizes inversely proportional to the number of their adjacent icons along the horizontal axis in comfort zone 3-1.
  • an icon 731 arranged in the top row of comfort zone 3-1 is large relative to its original size because it does not have any adjacent icon arranged along the horizontal axis on a current page.
  • icons arranged in the bottom row of comfort zone 3-1 are small relative to the icon 731 because each of the bottom-row icons has the most adjacent icons along the horizontal axis on the current page.
  • Icons needing size adjustment are selected from comfort zones 1-1, 2-1, and 3-1. These selected icons are shown as black spots in comfort zones 712, 722 and 732, which may be referred to as comfort zones 1-2, 2-2, and 3-2. Icons may be selected for size adjustment based on the size of a preset default icon. Alternatively, the UI layout converter 320 may control the display unit 305 to display a screen that prompts a user to input an icon selection criterion.
  • comfort zone 1-2 keeps the original sizes of the icons.
  • the original sizes of the icons are set according to a user's preference or by default during initial setting of the display area 700. If the icons are displayed at their original sizes, the user is likely to feel convenient. Thus, no icons are shown as selected in comfort zone 1-2.
  • Relatively small icons are shown as selected in comfort zone 2-2. Specifically, icons 722a, which are arranged in the first to third rows, are selected in comfort zone 2-2.
  • relatively small icons are shown as selected in comfort zone 3-2.
  • icons 732a which are arranged in the bottom two rows, are selected in comfort zone 3-2.
  • comfort zones 714, 724, and 734 which may also be respectively referred to as comfort zones 1-2, 2-2 and 3-2 are displayed respectively in comfort zones 1-3, 2-3, and 3-3.
  • icons 716 outside the display area of comfort zone 1-3 are moved to a next page in comfort zone 1-3.
  • the sizes and intervals of the selected icons 722a in comfort zone 2-2 are returned to the original sizes and intervals in comfort zone 2-3.
  • an area defined by the first to third rows in comfort zone 2-3 is small relative to an area defined by the last row, some icons are moved from the current page to the next page due to the size adjustment.
  • the sizes of the icons 732a shown as selected in comfort zone 2-3 are adjusted appropriately according to a user input or the like and then displayed in comfort zone 3-3. Due to the size adjustment of the icons 732a, some icons are moved to the next page. The next page displays the icons moved due to the shape of comfort zone 3-1 as well as the icons moved due to the size adjustment.
  • comfort zones 1-1 to 3-3 that display icons may be determined according to a user input related to icon sizes and positions, received on the display unit 305 under the control of the UI layout converter 320.
  • a user input may select between individual adjustment and uniform adjustment of selected icons in size and position.
  • FIG. 8A illustrates an icon layout on a home screen and an initial operation according to an exemplary embodiment of the present invention.
  • a home screen with icons arranged with the same size and interval is displayed on an existing display area 805.
  • the home screen with the icons rearranged at new coordinates is displayed in a current comfort zone 810.
  • the rearranged icons have the original size and interval.
  • the comfort zone 810 is defined as an area touchable by a thumb of a one-hand user, the comfort zone 810 has a relatively small available area for icons as compared to the existing display area 805. Accordingly, as the icons are rearranged with the original size and interval in the comfort zone 810, a part of the rearranged icons may be moved to the next page.
  • the user may adjust the sizes and intervals of the icons so that all of the icons may be displayed within the current page or only frequently used icons may be displayed on the home screen according to the user's preferences.
  • the rearranged icons may be displayed on the current and next pages according to their use frequencies. While a page number 807 indicating the current page is written horizontally in the existing display area 805, the present invention is not limited thereto, and the page number 807 may be written according to a thumb moving direction in the comfort zone 810, as indicated by reference numeral 812.
  • the user determines to adjust the sizes, intervals, and layout of the icons after viewing the icons displayed in the comfort zone 810, the user first selects icons to be adjusted from among the displayed icons. For the convenience of description, the selected icons are shown as shaded in the comfort zone 810. For example, the user may select an intended icon by clicking on the icon once or dragging the icon without detaching a hand from the icon, then a selection area 814 including selected icons is displayed. When the user touches a part of the selection area 814 or one of the selected icons, the home screen of the comfort zone 810 displays a window for a specific setting of rearrangement of the selected icons.
  • FIG. 8B illustrates screens displayed for a specific setting of rearranging selected icons according to an exemplary embodiment of the present invention.
  • a first screen 820 displays a pop-up window 822 overlapped over the selection area 814, for a specific setting of rearrangement.
  • the first screen 820 which is rendered transparent, may be displayed simultaneously with the selection area 814.
  • the icons of the selection area 814 may be displayed as a preview reflecting the user input.
  • icons rearranged according to the setting indicated by the user input may be displayed, simultaneously with disappearance of the pop-up window 822.
  • a second screen 830 displays a rearrangement setting menu independently of the existing display area 810.
  • the rearrangement setting menu provides menu items with which to select increase or decrease in the size and interval of a selected icon.
  • a button with which to adjust the degree of increase or decrease such as a rate button may further be displayed.
  • the rearrangement setting menu provides Yes and No buttons for 'manual selection' so that the user may manually rearrange the positions or intervals of selected icons.
  • a reference icon 842 or 844 may be selected according to a user input, such as click or touch, on the icon 842 or 844 in the third screen 840.
  • a user input such as click or touch
  • the sizes and intervals of the icons in the selection area 814 may be adjusted uniformly.
  • the reference icon 842 or 844 may be scaled down or up by dragging the reference icon 842 inward or dragging the reference icon 844 outward in accordance with an intended size.
  • an area corresponding the distance between icons may be adjusted by touching or clicking on the area and then dragging the area inward or outward according to an intended interval.
  • each individual icon within the selection area 814 may be adjusted by dragging a touch or click on the icon according to an intended size or interval, rather than the icons of a selected area 816 which are adjusted in size and interval at one time by setting a reference icon.
  • FIG. 9A illustrates additional UIs available for rearrangement of selected icons according to an exemplary embodiment of the present invention.
  • a screen 900 displays additional UIs, which may be icons, buttons, or similar graphical displays, that are not provided in the existing display area 805 of FIG. 8A, for example, a toggle button 902, a back button 904, and a home button 906.
  • the toggle button 902 is a UI that receives a command to set a comfort zone 912 displayed on the screen 900 as a frequently used page, or The toggle button 902 is able to use as a UI that receives a command to convert between the existing display area 805 and the comfort zone 810. While not shown in FIG. 9A, it is assumed that the comfort zone 912 displays icons rearranged in the manner described before with reference to FIGS. 8A and 8B.
  • the back button 904 is for receiving a command to return to the previous screen.
  • the home button 906 is for receiving a command to return to a home screen , the comfort zone 810, by way of example.
  • icons are displayed as an exemplary content type in a display area for the convenience of description, the present invention is not limited thereto, and the present exemplary embodiment is applicable to many other types of content.
  • FIG. 9B illustrates additional UIs available on a content basis for rearrangement of selected icons according to an exemplary embodiment of the present invention.
  • a first screen 920 displays additional UIs 922 including a toggle button, a back button, and a home button, when lists are rearranged as content in a comfort zone.
  • a second screen 930 displays additional UIs 932 including a toggle button, a back button, and a home button, when multimedia, for example, videos, are rearranged as content in a comfort zone.
  • UIs 934 may further be provided for the user to view the videos.
  • the UIs 934 may include a play button, a pause button, a stop button, and the like.
  • a third screen 940 displays additional UIs 942 including a toggle button, a back button, and a home button, when a keyboard is rearranged as content in a comfort zone.
  • FIG. 10A is a flowchart illustrating an operation of a comfort zone decider in a touch screen control apparatus according to another exemplary embodiment of the present invention.
  • the comfort zone decider 310 may control the display unit 305 to provide a comfort zone selection screen including, for example, at least one of a button that requests a touch input request screen (not shown) to determine a comfort zone and a button that selects preset default comfort zones in step 1000.
  • the comfort zone selection screen may be, for example, a locked home screen or an additional screen requesting a user touch input. Whether the locked home screen or the additional screen requesting a user touch input is provided as the comfort zone selection screen and the touch input request screen on the display unit 305 may be preset by the user or by default by the manufacturer.
  • the comfort zone decider 310 may set a comfort zone based on a user touch input that unlocks the locked screen according to the afore-described exemplary embodiment of the present invention.
  • FIG. 10B illustrates a comfort zone selection screen according to another exemplary embodiment of the present invention.
  • a comfort zone selection screen 1100 may display a comfort zone selection list on the touch screen corresponding to the display unit 305.
  • the comfort zone selection list may include a menu 'touch input request screen' and a menu 'default comfort zones' as illustrated in FIG. 10B. These menus are displayed as buttons so that the user may select a menu by touching a button corresponding to the menu.
  • FIG. 10C illustrates default comfort zones pre-stored in the touch screen control apparatus according to an exemplary embodiment of the present invention.
  • default comfort zones are defined based on the fan-shaped area 200 illustrated in FIG. 2 corresponding to a range touchable by a thumb on the touch screen.
  • the default comfort zones may be preset by the user or by default by the manufacturer according to the above described exemplary embodiments of the present invention.
  • the default comfort zones may be configured by adding an area outside the fan-shaped area 200 or excluding a part from the fan-shaped area 200. Specifically, a first default comfort zone 1102 is fully included in the fan-shaped area 200. A second default comfort zone 1104 is shaped into a rectangle partially overlapped with the fan-shaped area 200. A third default comfort zone 1106 is a part of the fan-shaped area 200, particularly except for a thumb-untouchable area other than a shaded area of the fan-shaped area 200.
  • a fourth default comfort zone 1108 is configured by removing the non-shaded area of the fan-shaped area 200, untouchable by the thumb of the user.
  • a fifth default comfort zone 1110 is shaped into a rectangle having a rectangular non-shaded area of the fan-shaped area 200 being removed.
  • a sixth default comfort zone 1112 is a semi-circle having the center point on the right side of the existing display area 1101, fully included in the fan-shaped area 200.
  • the comfort zone decider 310 determines a menu selected from the comfort zone selection list according to a user touch input in step 1005. If the menu requesting a touch input request screen has been selected, then the comfort zone decider 310 performs steps 1010 through 1025 in the same manner as steps 410 through 425 of FIG. 4. Thus steps 1010 through 1025 will not be described herein to avoid redundancy.
  • the comfort zone decider 310 controls the display unit 305 to display a screen, hereinafter, referred to as a 'default comfort zone selection screen' used to select a specific default comfort zone from among pre-stored default comfort zones in step 1030 and proceeds to step 1035.
  • FIG. 10D illustrates a default comfort zone selection screen according to an exemplary embodiment of the present invention.
  • the default comfort zone selection screen may also be a locked home screen or an additional screen requesting a touch input.
  • a first default comfort zone selection screen 1200a may display buttons that are one-to-one mapped to pre-stored default comfort zones, hereinafter, referred to as 'default comfort zone selection buttons' and a button used to configure a new default comfort zone, hereinafter, referred to as a 'new setting button' at the bottom of the display area.
  • the default comfort zone selection buttons are shown as numerals in FIG. 10D.
  • the comfort zone decider 310 determines whether a user touch input is detected. Upon detecting a user touch input to a default comfort zone selection button in the menus provided on the default comfort zone selection screen in step 1035, then, in step 1040, the comfort zone decider 310 controls the display unit 305 to display a preview of a comfort zone mapped to the default comfort zone selection button. In an exemplary embodiment of the present invention, upon sensing a short touch or a single click on a default comfort zone selection button, the comfort zone decider 310 provides a preview of a default comfort zone corresponding to the default comfort zone selection button. Upon sensing a long touch or double clicks on a default comfort zone selection button, the comfort zone decider 310 determines a default comfort zone mapped to the default comfort zone selection button as a current default comfort zone.
  • a user touch input to button 1 is sensed in a second default comfort zone selection screen 1200b-1. If the user touch input to button 1 is a short touch or single click, the second default comfort zone selection screen 1200b-1 provides a preview of a default comfort zone corresponding to button 1.
  • a user touch input to button 2 is sensed in a third default comfort zone selection screen 1200c-1. If the user touch input to button 2 is a short touch or single click, then the third default comfort zone selection screen 1200c-1 provides a preview of a default comfort zone corresponding to button 2.
  • step 1045 the comfort zone decider 310 determines whether a user touch input being a long touch or double clicks on a specific default comfort zone selection button is detected. If a user touch input has not been detected, in step 1045, in the form of a long touch or double clicks on a specific default comfort zone selection button, then the comfort zone decider 310 awaits detection of a user touch input.
  • the comfort zone decider 310 determines a default comfort zone mapped to the button as a current default comfort zone in step 1050. Subsequently, the comfort zone decider 310 performs an adjustment operation on the current default comfort zone in steps 1015 through 1025. As noted above, steps 1015 through 1025 are the same as steps 415 through 425 of FIG. 4 and thus will not be described herein.
  • the comfort zone decider 310 may control the display unit 305 to provide a touch input request screen.
  • FIG. 10E illustrates a case where the new setting button is selected on a default comfort zone selection screen according to an exemplary embodiment of the present invention.
  • a user touch input to the new setting button is sensed on a fourth default comfort zone selection screen 1200d-1.
  • the fourth default comfort zone selection screen 1200d-1 provides a touch input request screen 1200d-2 to allow the user to set a new comfort zone.
  • a direction 1210 in which the user slides or drags the thumb across the touch screen is sensed.
  • the comfort zone decider 310 may estimate a touchable area based on the touched area and the sensed sliding or dragging direction 1210 and may determine the estimated touchable area as a new comfort zone.
  • the comfort zone decider 310 may control the display unit 305 to display the new comfort zone so that the user may identify the new comfort zone. While not shown, the display unit 305 may display only the boundaries or full area of the determined new comfort zone.
  • the comfort zone decider 310 determines whether the new comfort zone is to be adjusted and performs an adjustment operation based on the determination in steps 1015 through 1025. Specifically, as done in step 415 of FIG. 4, the comfort zone decider 310 controls the display unit 305 to provide a screen asking the user whether to maintain or adjust the new comfort zone and receives a user input in response to the question. Whether the asking screen is to be provided may be preset by default in the digital portable terminal by the manufacturer or may be set freely by the one-hand user during initial setting of the digital portable terminal. For example, the asking screen may prompt the user to make a choice between maintenance and adjustment of the determined comfort zone.
  • the comfort zone decider 310 determines the new comfort zone as a current comfort zone and provides information about the current comfort zone to the UI layout converter 320.
  • the comfort zone decider 310 controls the display unit 305 to provide a touch input request screen 1200d-3 for comfort zone adjustment. Then the display unit 305 displays boundaries 1225 of the new comfort zone on the touch input request screen 1200d-3.
  • the one-hand user clicks a point 1220 for a predetermined amount of time on a boundary 1225 of the current comfort zone, then the clicked boundary 1225 is placed in an adjustable state. The user may now scale up or down the current comfort zone by dragging the clicked boundary 1225 to an intended position.
  • a click and dragging scheme is used to adjust a comfort zone in the above exemplary embodiment
  • the present invention is not limited thereto, and an operation of selecting a boundary of the comfort zone and thus placing the boundary in an adjustable state and an operation of adjusting the boundary may be performed by many other preset inputs.
  • the boundary may be adjusted by a predetermined extent at each click or each time a predetermined motion is recognized.
  • the comfort zone decider 310 adjusts the size of content to be arranged in the new comfort zone and stores the size-adjusted content.
  • the size of the content may be increased or decreased according to preset size levels, for example, large, standard, and small as indicated by reference numerals 1304a, 1304b, and 1304c. While not shown, the content to be displayed in the new comfort zone may be rearranged according to the user's preferences and the use frequencies of the content.
  • a range to which a comfort zone set according to the above-described exemplary embodiments is applied may be set additionally.
  • a 'comfort zone apply setting' menu may be added to a basic setting menu in order to set a range to which a comfort zone is applied in a user device.
  • FIG. 11A illustrates menu items of a comfort zone apply setting menu added to a setting menu of a user device according to an exemplary embodiment of the present invention.
  • the comfort zone apply setting menu may include, for example, an 'Apply Range setting' menu item, an 'Apply Time'menu item, and a 'Recovery Time' menu item.
  • the 'Apply Range Setting' menu item may include an On/Off button to determine whether to use icons provided on a home screen, an On/Off button to determine whether to apply a specific UI such as an afore-described application control UI, and an On/Off button to determine whether to use all screens and icons available to the user device.
  • the 'Apply Time' menu item may impose an additional condition that only when the On button indicating that all screens and icons available to the user device are always used is selected and a predetermined motion is made as a user touch input, a comfort zone is applied.
  • the predetermined motion may include a sliding, a drag, a long touch on an area, and the like.
  • FIG. 11B illustrates a case where if 'Always On'is selected in a 'Apply Time' menu item of the comfort zone usage setting menu, a comfort zone is applied only when a touch input slides across a touch screen according to an exemplary embodiment of the present invention.
  • 'Apply Time' is set in the setting menu in such a manner that the moment a sliding motion is made in any direction in an existing display area 1410, a comfort zone is effective and a target icon 1402 of a one-hand user is outside of the movement range of a thumb of the one-hand user in the existing display area 1410. If the one-hand user slides the thumb across a part of the display area 1410 in any direction, then the display area 1410 is switched to a current default comfort zone 1420 preset according to the above described exemplary embodiments of the present invention. As the target icon 1402 is moved within the current default zone 1420, then the one-hand user may touch the target icon 1402 with the thumb.
  • the 'Recovery Time' may include a menu item that automatically switches a locked screen to a comfort zone, each time the locked screen is unlocked.
  • the comfort zone may be set according to the first exemplary embodiment of the present invention.
  • a recovery time may be set, for example, by making a sliding motion across a screen displaying the comfort zone 1420, reversely to a sliding direction used to switch to the comfort zone 1420.
  • additional UIs are provided to a user in the above manner, the user may readily use or set icons within a comfort zone of a display area. Therefore, user experience is enhanced.
  • a partial touchable area is set in the display area of a touch screen and UIs are rearranged in the partial touchable area by adjusting the sizes and positions of the UIs in a digital portable terminal, a user experience is enhanced. Furthermore, additional UIs are provided to use the rearranged UIs in the partial touchable area, further enhancing user experience.
  • the exemplary embodiments of the present disclosure as described above typically involve the processing of input data and the generation of output data to some extent.
  • This input data processing and output data generation may be implemented in hardware or software in combination with hardware.
  • specific electronic components may be employed in a mobile device or similar or related circuitry for implementing the functions associated with the exemplary embodiments of the present invention as described above.
  • one or more processors operating in accordance with stored instructions may implement the functions associated with the exemplary embodiments of the present invention as described above. If such is the case, it is within the scope of the present disclosure that such instructions may be stored on one or more processor readable mediums.
  • processor readable mediums examples include Read-Only Memory (ROM), Random-Access Memory (RAM), CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices.
  • ROM Read-Only Memory
  • RAM Random-Access Memory
  • CD-ROMs Compact Disc-ROMs
  • magnetic tapes magnetic tapes
  • floppy disks optical data storage devices.
  • the processor readable mediums can also be distributed over network coupled computer systems so that the instructions are stored and executed in a distributed fashion.
  • functional computer programs, instructions, and instruction segments for accomplishing the present invention can be easily construed by programmers skilled in the art to which the present invention pertains

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A method and an apparatus of controlling a User Interfaces (UIs) using a touch screen are provided. The method includes displaying a menu item in a basic setting menu that is preset in a user device, the menu item being used to select rearrangement of UIs arranged in a display area of the touch screen in a user-touchable partial area, and displaying a rearranged screen displaying the UIs rearranged in the user-touchable partial area, upon sensing of a user touch input selecting the rearrangement of the UIs.

Description

METHOD AND APPARATUS OF CONTROLLING USER INTERFACE USING TOUCH SCREEN
The present invention relates to a touch screen that provides a User Interface (UI). More particularly, the present invention relates to a method and apparatus of controlling a UI to increase user convenience.
Digital portable terminals, such as smart phones, tablet Personal Computers (PCs), e-book readers, and the like have rapidly gained popularity and their roles, uses and functions have changed. Smart phones, which are being widely used, function additionally as an information processor like a personal information manager, in addition to the role of a personal portable communication device. Accordingly, an object-oriented information input means is used for a digital portable terminal in order to enhance user convenience. For example, the digital portable terminal is equipped with a touch screen to allow a user to input necessary information conveniently and to process the input information. Previously, a user may be inconvenienced when the user selects and inputs information on the touch screen of a digital portable terminal because of the different sizes of the touch screens. In this context, the different sizes of the touch screens are developed and widely equipped for digital portable terminals. Thus, for example, if a larger touch screen relatively in a digital portable terminal is difficult to touch by one-hand users,
FIGS. 1A and 1B illustrate a limitation of a larger touch screen in a digital portable terminal, in terms of a touchable area according to the related art.
Referring to FIGS. 1A and 1B, FIG. 1B illustrates a larger touch screen 100b in a smart phone than a touch screen 100a in a related-art smart phone illustrated in FIG. 1A. A part of the touch screen 100b in the smart phone illustrated in FIG. 1B may be untouchable or inaccessible for touching by a user according to the use environment of an input means because the touch screen 100b is relatively large. For example, the user's hand may be used as the input means of the smart phone. For the convenience of description, a user that manipulates a digital portable terminal with one hand is referred to as a 'one-hand user'. To use a smart phone, a one-hand user should first hold the smart phone. Specifically, the user holds the smart phone with the other four fingers of one hand except for the thumb. Then, the one-hand user inputs information to the smart phone, mainly with a thumb 105.
In FIG. 1A, the one-hand user may reach the entire display area of the touch screen 100a of the related-art smart phone with the thumb 105 to manipulate the touch screen 100a. On the other hand, the manipulation area is confined to a part of the touch screen 100b larger than the touch screen 100a and thus there are areas beyond reach of the thumb 105, i.e. areas that cannot be touched by the thumb 105 or areas above which the thumb 105 cannot be placed, on the touch screen 100b.
In general, UIs are arranged in an array having grids at predetermined intervals on the touch screen or UIs are confined to a specific position on the touch screen in order to receive a user input.
Therefore, if the one-hand user uses the relatively large touch screen 100b, as illustrated in FIG. 1B, a manipulation range available to the one-hand user is limited to a part of the touch screen 100b. In addition, if the touch screen 100b provides UIs in a typical grid structure or UIs beyond the manipulation range, the UI convenience of the one-hand user may further be decreased.
The above information is presented as background information only to assist with an understanding of the present disclosure. No determination has been made, and no assertion is made, as to whether any of the above might be applicable as prior art with regard to the present invention.
Previously, a user may be inconvenienced when the user selects and inputs information on the touch screen of a digital portable terminal because of the different sizes of the touch screens. In this context, the different sizes of the touch screens are developed and widely equipped for digital portable terminals. Thus, for example, if a larger touch screen relatively in a digital portable terminal is difficult to touch by one-hand users.
Aspects of the present invention are to address at least the above-mentioned problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the present invention is to provide a method of determining a part of the display area of a touch screen as a user-touchable area and providing User Interfaces (UIs) in the user-touchable area, and a touch screen using the method.
Another aspect of the present invention is to provide a method of rearranging UIs in a user-touchable area being a part of the display area of a touch screen by adjusting the sizes and positions of the UIs, taking into account user convenience, and a touch screen using the method.
In accordance with an aspect of the present invention, a method of providing UIs on a touch screen is provided. The method includes displaying a menu item in a basic setting menu that is preset in a user device, the menu item being used to select rearrangement of UIs arranged in a display area of the touch screen in a user-touchable partial area, and displaying a rearranged screen displaying the UIs rearranged in the user-touchable partial area, upon sensing of a user touch input selecting the rearrangement of the UIs.
In accordance with another aspect of the present invention, a touch screen apparatus of providing UIs is provided. The touch screen apparatus includes a display unit displaying a menu item in a basic setting menu that is preset in a user device, the menu item being used to select rearrangement of UIs arranged in a display area of the touch screen apparatus in a user-touchable partial area, and a controller controlling the display unit to display a rearranged screen including the UIs rearranged in the user-touchable partial area,upon sensing of a user touch input selecting the rearrangement of the UIs.
Other aspects, advantages, and salient features of the invention will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses exemplary embodiments of the invention.
The above and other aspects, features, and advantages of certain exemplary embodiments of the present invention will be more apparent from the following description taken in conjunction with the accompanying drawings, in which:
FIGS. 1A and 1B illustrate a limitation of using a touch screen with an increased size in a digital portable terminal, in terms of a user-touchable area according to the related art;
FIG. 2 illustrates a comfort zone defined according to an exemplary embodiment of the present invention;
FIG. 3 is a block diagram of a touch screen control apparatus according to an exemplary embodiment of the present invention;
FIG. 4A is a flowchart illustrating an operation of a comfort zone decider in the touch screen control apparatus according to an exemplary embodiment of the present invention;
FIG. 4B illustrates a touch input request screen according to an exemplary embodiment of the present invention;
FIG. 4C illustrates a method of determining a comfort zone according to an exemplary embodiment of the present invention;
FIG. 5A is a flowchart illustrating an operation of a User Interface (UI) layout converter in the touch screen control apparatus according to an exemplary embodiment of the present invention;
FIG. 5B illustrates two-dimensional projective transformation between an existing display area and a current comfort zone according to an exemplary embodiment of the present invention;
FIG. 6 illustrates a comfort zone according to an exemplary embodiment of the present invention;
FIG. 7 illustrates the shapes of various comfort zones and the positions and sizes of icons rearranged in the comfort zones according to an exemplary embodiment of the present invention;
FIG. 8A illustrates an icon layout on a home screen and an initial operation according to an exemplary embodiment of the present invention;
FIG. 8B illustrates screens displayed for a specific setting of rearranging selected icons according to an exemplary embodiment of the present invention;
FIG. 9A illustrates a screen that displays additional UIs available for rearrangement of selected icons according to an exemplary embodiment of the present invention;
FIG. 9B illustrates screens that display additional UIs available on a content basis for rearrangement of selected icons according to an exemplary embodiment of the present invention;
FIG. 10A is a flowchart illustrating an operation of the comfort zone decider in a touch screen control apparatus according to an exemplary embodiment of the present invention;
FIG. 10B illustrates a comfort zone selection screen according to an exemplary embodiment of the present invention;
FIG. 10C illustrates default comfort zones pre-stored in a touch screen control apparatus according to an exemplary embodiment of the present invention;
FIG. 10D illustrates a default comfort zone selection screen according to an exemplary embodiment of the present invention;
FIG. 10E illustrates a case where a 'new setting button' is selected on a default comfort zone selection screen according to an exemplary embodiment of the present invention;
FIG. 11A illustrates menu items of a comfort zone apply setting menu added to a setting menu of a user device according to an exemplary embodiment of the present invention; and
FIG. 11B illustrates a case where if 'Always On' is selected in an 'Apply Time' menu item of the comfort zone apply setting menu, a comfort zone is applied only when a specific sliding motion is made across a touch screen as a user touch input according to an exemplary embodiment of the present invention.
Throughout the drawings, like reference numerals will be understood to refer to like parts, components, and structures.
The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of exemplary embodiments of the invention as defined by the claims and their equivalents. It includes various specific details to assist in that understanding but these are to be regarded as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. In addition, descriptions of well-known functions and constructions may be omitted for clarity and conciseness.
The terms and words used in the following description and claims are not limited to the bibliographical meanings, but, are merely used by the inventor to enable a clear and consistent understanding of the invention. Accordingly, it should be apparent to those skilled in the art that the following description of exemplary embodiments of the present invention is provided for illustration purpose only and not for the purpose of limiting the invention as defined by the appended claims and their equivalents.
It is to be understood that the singular forms "a","an","the" include plural referents unless the context clearly dictates otherwise. Thus, for example, reference to "a component surface"includes reference to one or more of such surfaces.
By the term "substantially" it is meant that the recited characteristic, parameter, or value need not be achieved exactly, but that deviations or variations, including for example, tolerances, measurement error, measurement accuracy limitations and other factors known to those of skill in the art, may occur in amounts that do not preclude the effect the characteristic was intended to provide.
Exemplary embodiments of the present invention will be provided to achieve the above-described technical aspects of the present invention. In an exemplary implementation, defined entities may have the same names, to which the present invention is not limited. Thus, exemplary embodiments of the present invention can be implemented with same or ready modifications in a system having a similar technical background.
The present invention provides a method of determining a part of a touch screen having a user-untouchable display area as a user-touchable area and rearranging User Interfaces (UIs) in the user-touchable area. In the present exemplary embodiments, UIs may be any graphical element displayed on a touch screen that a user may interact and/or interface with, such as a button, an icon, a symbol, a command, a picture, a video, and any other similar and/or suitable element that is graphically displayed on a touch screen and/or display device. The following description is given with the appreciation that an input means for a touch screen having a user-untouchable display area is a user's one hand, by way of example. However, the present invention is not limited thereto, and the input means may be any suitable and/or similar input means, such as any finger of a user and a stylus.
For the convenience of description, a user that manipulates a digital portable terminal with one hand is referred to as a 'one-hand user'. However, it is to be clearly understood that the input means is not limited to a user's one hand in the present invention.
A touchable part of the display area of a touch screen is defined as a user-touchable area according to an exemplary embodiment of the present invention. The user-touchable area includes an area touchable by an input means and an area above which the input means may be placed although the input means does not contact the touch screen in the display area of the touch screen. When the input means is placed above the touch screen, an input to the touch screen, for example, a motion of a user s hand or a stylus pen is recognized by motion recognition.
The touch screen of the present exemplary embodiments may have a relatively large screen size, compared to a related-art touch screen. As long as a touch screen includes the user-untouchable area, i.e. an area untouchable and/or unreachable by an input means according to a user s reach or an area above which the input means cannot be placed, the present exemplary embodiments are applicable to the touch screen.
In exemplary embodiments of the present invention, it is assumed that an input means by which to determine a user-touchable partial area is a thumb of a one-hand user. In this case, the user-touchable partial area is called a comfort zone defined as an area touchable by the thumb. While the exemplary embodiments of the present invention will be described using the term 'comfort zone' the comfort zone is interchangeable with the user-touchable partial area having the same meaning.
FIG. 2 illustrates a comfort zone defined according to an exemplary embodiment of the present invention.
Referring to FIG. 2, when a one-hand user manipulates a portable digital terminal having a touch screen with one hand, the one-hand user may shape the hand as illustrated in FIG. 2. The one-hand user holds the digital portable terminal with the other four fingers of the hand except for the thumb. Thus, the user inputs information such as a specific request by touching the display area of the touch screen with the thumb. A fan-shaped area 200 defines a range in which the thumb may reach on the touch screen.
In an exemplary embodiment of the present invention, a comfort zone 205 may be defined as an area which can be touched by the thumb of the one-hand user or an area above which the thumb can be placed, i.e. the whole fan-shaped area 200. In another exemplary embodiment of the present invention, the comfort zone 205 may be defined as a part of the fan-shaped area 200, which is readily touchable by the thumb or easily sensible, e.g. a shaded part of the fan-shaped area 200.
Exemplary embodiments of the present invention provide a method of rearranging UIs in a comfort zone by adjusting the positions, intervals, and layout of the UIs so that the one-hand user may conveniently manipulate a user device. The exemplary embodiments of the present invention also provide additional UIs with which a user uses UIs rearranged in a comfort zone, taking into account user experience.
FIG. 3 is a block diagram of a touch screen control apparatus according to an exemplary embodiment of the present invention.
Referring to FIG. 3 a touch screen control apparatus 300 performs specific operations to display information on the touch screen of a digital portable terminal that a one-hand user manipulates. The touch screen control apparatus 300 includes a display unit 305 which may be a touch screen, a comfort zone decider 310, a context decider 315, and a UI layout converter 320. The display unit 305 may be any type of display unit for displaying graphical information, such as a Liquid Crystal Display (LCD) unit, a Light Emitting Diode (LED) display unit, a Thin-Film Transistor (TFT) display unit, an Organic LED (OLED) display unit, or any other similar and/or suitable type of display unit. The detailed configuration of the touch screen control apparatus 300 is purely exemplary. Accordingly, the comfort zone decider 310, the context decider 315, and the UI layout converter 320 may be integrated into a single component or may be divided into more components.
The comfort zone decider 310, the context decider 315, and the UI layout converter 320 may be incorporated into a controller (not shown), or any other similar and/or suitable type of hardware, in a digital portable terminal having the touch screen control apparatus 300 of FIG. 3. The controller may be configured as at least one processor having a program to control the operation of the display unit 305 and UI operations according to the exemplary embodiments of the present invention. To sense a user's motion, the touch screen control apparatus 300 may further include a motion sensor (not shown).
The comfort zone decider 310 receives a user input needed to determine a comfort zone and determines a comfort zone based on the user input. The context decider 315 determines the type of content for which a current UI is activated. The UI layout converter 320 renders a graphic image on the display unit 305 and re-adjusts a screen configuration including the sizes, intervals, and layout of UIs in the determined comfort zone according to an exemplary embodiment of the present invention. The display unit 305 displays a graphic image including the UIs rearranged in the comfort zone in a display area. Operations of the components of the touch screen control apparatus 300 will be described below in greater detail.
FIG. 4A is a flowchart illustrating an operation of a comfort zone decider in a touch screen control apparatus according to an exemplary embodiment of the present invention, FIG. 4B illustrates a user touch input according to an exemplary embodiment of the present invention, and FIG. 4C illustrates a method of determining a comfort zone according to an exemplary embodiment of the present invention.
Referring to FIGS. 4A, 4B, and 4C, for the convenience of description, the comfort zone decider is the comfort zone decider 310 of FIG. 3. The comfort zone decider 310, in step 400, controls the display unit 305 to display a comfort zone selection screen (not shown) to determine a comfort zone and then proceeds to step 405. The comfort zone selection may be, for example, a locked home screen or an additional screen requesting a user touch input. Whether the display unit 305 is to display the locked home screen or the additional screen requesting a user touch input may be preset by a user or by default by a manufacturer.
In step 405, the comfort zone decider 310 determines whether a user touch input has been detected.
As shown in FIG. 4B, the one-hand user touches the touch screen corresponding to the display unit 305. Specifically, the one-hand user touches a partial area 430 of the touch screen with a thumb. The touch includes a sliding or drag motion. For example, if a locked home screen is provided as a comfort zone selection, the one-hand user may unlock the screen by sliding or dragging the thumb across the touch screen.
Upon detection of a thumb-touched partial area 435 of the touch screen in the user touch input applied to unlock the screen, the comfort zone decider 310 determines that a user touch input has been detected and goes to step 410. On the contrary, in the absence of a user touch input or if detection of a user touch input is not recognized, the comfort zone decider 310 awaits reception of a user touch input in step 400. Specifically, the comfort zone decider 310 may await reception of a user touch input to unlock the screen or may control the display unit 305 to display an additional touch input request screen on the touch screen. In another exemplary embodiment of the present invention, if a user touch input has not been received after a predetermined amount of time, the comfort zone decider 310 may provide a screen from which the user may select a preset default comfort zone. Default comfort zones will be described later in greater detail.
In step 410, the comfort zone decider 310 determines the partial area touched by the thumb as a comfort zone. As shown in FIG. 4C, a user-touchable partial area 440 is not confined to an actual area touched by a thumb of a one-hand user. Specifically, if the one-hand user touches only a specific part 441 of the area 440 with the thumb as illustrated in screen 450 of FIG. 4C, the comfort zone decider 310 determines whether the user has slided or dragged the thumb, for example, from right to left or from left to right, estimates a touchable area based on the specific touched area and the touched direction, and determines the estimated touchable area as a comfort zone.
Once the comfort zone is determined, the comfort zone decider 310 controls the display unit 305 to display the comfort zone so that the user may identify the comfort zone. For example, the display unit 305 may display the boundaries of the comfort zone or the full comfort zone on the touch screen. The comfort zone decider 310 controls the display unit 305 to display a screen that prompts the user to maintain or adjust the comfort zone in step 415. Then the comfort zone decider 310 receives a user input in response to the question. The providing of the screen asking the user whether to maintain or adjust a comfort zone may be set by default in the digital portable terminal by the manufacturer or freely set by the user during initial setting of the digital portable terminal, and the screen may be configured to prompt the user to make a choice between maintenance and adjustment of a comfort zone.
If the user input indicates maintenance of the comfort zone, then the comfort zone decider 310 determines the determined comfort zone as a current comfort zone and provides information about the current comfort zone to the UI layout converter 320 in step 420. On the contrary, if the user input indicates adjustment of the comfort zone, then the comfort zone decider 310 controls the display unit 305 to provide a touch input request screen so that the user may adjust the comfort zone in step 425. Specifically, the display unit 305 displays boundaries 443 and 445 of the determined comfort zone on the touch screen under the control of the comfort zone decider 310, as illustrated in screen 451 of FIG. 4C. If the one-hand user touches, for a predetermined amount of time, a specific point 447 on the boundary 445 that the user wants to adjust, then the boundary 445 is placed in an adjustable state. Then the user adjusts the size of the comfort zone by dragging the clicked boundary 445 to an intended position 449. The other boundary 443 may be adjusted in the same manner.
Clicking and/or dragging used to adjust a comfort zone is an exemplary user input. Therefore, an operation of placing a boundary of a comfort zone to an adjustable state and an operation of adjusting the selected boundary may be performed by predefined various inputs. For example, when a boundary of a comfort zone is placed in an adjustable state by clicking on the boundary, then the boundary of the comfort zone may be changed by a predetermined extent at each click or each time a predetermined motion is recognized.
When the comfort zone is maintained or adjusted in the above manner, the context decider 315 determines the type of content to be provided in the comfort zone.
Table 1 below lists exemplary content types that the context decider 315 of the touch screen control apparatus 300 determines to provide on UIs in the comfort zone. If content is provided on UIs with no distinction made between a comfort zone and a non-comfort zone or if content of a predetermined type is provided on UIs in the comfort zone, then the context decider 315 may not be included in the touch screen control apparatus 300.
Table 1
Content Type Example
Icons Icons on launcher screen
Application control UI Play, stop, pause, etc. of video player
Page view Next or previous page on e-book, Web page, etc.
List view Lists
Referring to Table 1, content types include, for example, icons, an application control UI, a page view, and a list view. For example, the icons are arranged on a home screen displayed on the touch screen of a digital portable terminal that a one-hand user manipulates and each icon provides a function of executing an application mapped to the icon.
The application control UI provides a function of executing a manipulation function such as play, stop, pause and the like of a video player. The page view provides a function of returning to the previous page or moving to the next page on an e-book or a Web page. The list view provides a function of listing specific items on the touch screen.
FIG. 5A is a flowchart illustrating an operation of a UI layout converter in a touch screen control apparatus according to an exemplary embodiment of the present invention.
Referring to FIG. 5A, for the convenience of description, the UI layout converter is the UI layout converter 320 of FIG. 3. The UL layout converter 320 acquires information about a determined comfort zone from the comfort zone decider 310 in step 500. In step 502, the UI layout converter 320 divides an existing display area prior to a layout change to the comfort zone, which may be referred to as an existing display area, into a plurality of sub-areas and calculates the coordinates of each sub-area. While rectangles, parallelograms, trapezoids, and the like are available as the shapes of the sub-areas, the following description will be given in the context of each sub-area being a parallelogram, by way of example.
In step 504, the UI Layout converter 320 divides the comfort zone into sub-areas and calculates coordinates of the sub-areas. In step 506, the UI layout converter 320 calculates a mapping relationship between the coordinates of the display area and the coordinates of the comfort zone. A manner in which the UI layout converter 320 calculates the mapping relationship will be described later in greater detail according to an exemplary embodiment of the present invention. In step 520, the UI layout converter 320 converts UIs arranged in the existing display area to UIs for the comfort zone.
FIG. 5B illustrates two-dimensional projective transformation between an existing display area and a current comfort zone according to an exemplary embodiment of the present invention.
Referring to screen 540 of FIG. 5B, an existing display area 550 is divided into, for example, sub-areas, e.g. n rectangles P1,P2,...,Pn,each having a predetermined size along a vertical axis in step 502. Referring to screen 541 of FIG. 5B, a comfort zone 560 is divided into sub-areas, e.g. n squares C1,C2,...,Cn, corresponding to the n rectangles P1,P2,...,Pn in step 504.
In step 506, the UI layout converter 320 determines the mapping relationship between the coordinates of the n rectangles P1,P2,...,Pn and the coordinates of the squares C1,C2,...,Cn by two-dimensional projective transformation. For example, the two-dimensional projective transformation may be defined as the following table.
[Table 2]
Figure PCTKR2013004458-appb-I000001
In order to further explanation of equations in Table 2, FIG. 5B will be referred to. A first rectangle P1, which is divided from the existing display area 550, may be represented by the coordinates of four points 501, 503, 505 and 507. The square C1 of the comfort zone 560 corresponding to the rectangle P1may be represented by the coordinates of four points 511, 513, 515 and 517. The UI layout converter 320 calculates a matrix A having, as elements, mapping relationships between the coordinates of the points 501, 503, 505, and 507 of the rectangle P1 and the coordinates of the points 511, 513, 515, and 517 of the square C1 by two-dimensional projective transformation.
For example, if
Figure PCTKR2013004458-appb-I000002
is the coordinates of the first point 501 of the rectangle P1 and
Figure PCTKR2013004458-appb-I000003
is the coordinates of the first point 511 of the square C1in Table 2, the UI layout converter 320 may express the coordinates x1and x2of the first point 501 of the rectangle P1using the coordinates u1andu2of the first point 511 of the square C1according to Equation (1).
<Equation 1>
Figure PCTKR2013004458-appb-I000004
To obtain the matrix A, the UI layout converter 320 changes x1 and x2 in Equation (1) to the expression of Equation (2).
<<Equation 2>
Figure PCTKR2013004458-appb-I000005
Variables A1,A2,and A3 obtained by Equation(2) are represented respectively as A1=[a11,a12,a13],A2=[a21a22a23],and A3=[a31,a32,a33].
Then the UI layout converter 320 determines the matrix A with a total of nine elements a11,a12,a13,…,a33 of the variables A1,A2,and A3. The matrix A is expressed as Equation (3).
<Equation 3>
Figure PCTKR2013004458-appb-I000006
Therefore, one of the coordinate pairs, i.e. a first coordinate pair, of the existing display area 550 and one of the coordinate pairs, i.e. a second coordinate pair, of the comfort zone 560 may be expressed as a matrix A with nine elements.
If the comfort zone 560 determined by the comfort zone decider 310 is known, then the coordinates of the four points 511, 513, 515 and 517 of the square C1 corresponding to the coordinates of the four points 501, 503, 505 and 507 of the rectangle P1 may be obtained. Accordingly, once the four coordinate pairs of the rectangle P1 and the four coordinate pairs of the square C1 corresponding to the rectangle P1 are determined, four implementations of Equation(1) and four implementation of Equation(2) describe therespective mapping relationships between the four coordinate pairs of the rectangle P1 and the four coordinate pairs of the squareC1, and thus a total of eighte quations exist. Then any point of the rectangle P1 may be converted to a point of the square C1 using one matrix A describing the mapping relationship between therectangle P1 and the square C1.
Matrices A are calculated with regards to the mapping relationships between the coordinates of the other rectangles P2,…,Pn and the coordinates of the other squares C2, …, Cn in the same manner. Then the coordinates of a point of a rectangle are converted to the coordinates of a point of a parallelogram corresponding to the rectangle, i.e. the coordinates of a point of the comfort zone 560.
In summary, the UI layout converter 320 calculates a matrix A using the first coordinate pairs of four points of each of the sub-areas of an existing display area 550 and the second coordinate pairs of four points of a comfort zone 560, e.g. the coordinates of the points of a parallelogram, corresponding to the first coordinate pairs by Least Square (LSQ) formulation, such as a least square method, RANdom Sample Consensus (RANSAC), or the like. For example, an equation of calculating the elements of the matrix A by LSQ formulation is given as Table 3.
[Table 3]
Figure PCTKR2013004458-appb-I000007
Referring to Table 3, the UI layout converter 320 may express vector a from the elements of the matrix A according to Equation (4).
<Equation 4>
Figure PCTKR2013004458-appb-I000008
Then the UI layout converter 320 may obtain the comfort zone conversion vector a expressed as Equation (6) by representing a homogeneous equation according to Equation (5).
<Equation 5>
Figure PCTKR2013004458-appb-I000009
<Equation 6>
Figure PCTKR2013004458-appb-I000010
The UI layout converter 320 calculates matrices A that describe the mapping relationships between the first coordinate pairs of the points of each sub-area divided from the existing display area and the second coordinate pairs of the points of each sub-area divided from the comfort zone in step 506 and converts UIs in the existing display area to UIs in the comfort zone based on the matrices A in step 508. Specifically, the mapping relationship A between each sub-area of the existing display area and a corresponding sub-area of the comfort zone is determined. Then the coordinates of UIs within the sub-areas of the existing display area are converted to coordinates corresponding to the UIs in the sub-areas of the comfort zone based on the determined matrices A. The first coordinate pairs of the positions of the UIs in the existing display area may be converted to the second coordinate pairs of positions of the UIs in the comfort zone. While not shown in FIG. 5A, the UI layout converter 320 may adjust at least one of the positions, sizes, and shapes of the UIs in the comfort zone.
FIG. 6 illustrates a comfort zone according to an exemplary embodiment of the present invention.
Referring to FIG. 6, an outer area 630, shown as a shaded part, of the comfort zone may be outside the boundary of the display area of the touch screen. The comfort zone may be larger or smaller than the existing display area. Compared to the display area, the comfort zone may be streamlined or distorted in shape. Therefore, there may exist a need for adjusting the sizes, intervals, and layout of icons displayed in the display area, when the display area is transformed to the comfort zone. Specifically, the UI layout converter 320 may move UIs located in the outer area 630 to the next page, scale down the sizes of the UIs, or change the shapes of the UIs by adjusting at least one of the positions, sizes, and shapes of UIs, e.g. icons, arranged in the comfort zone, so that the UIs of the outer area 630 may reside within the comfort zone. Alternatively, the UI layout converter 320 may control the display unit 305 to display an additional screen requesting a user input for UI adjustment. The UI layout converter 320 may also control the display unit 305 to display a screen requesting input of the number of uses of each icon. For example, upon receipt of the number of uses of each icon, the UI layout converter 320 may control the display unit 305 to arrange icons having the numbers of uses smaller than a predetermined threshold in the outer area 630. Adjustment of UIs in the comfort zone may be optional.
The exemplary embodiments have described above with reference to FIGS. 5A, 5B and 6 such that UIs of an existing display area are converted to UIs of a comfort zone by two-dimensional projective transformation according to the exemplary embodiment of the present invention. However, the two-dimensional projective transformation is an exemplary method of converting UIs of the display area to UIs of the comfort zone and thus the present invention is not limited to the two-dimensional projective transformation.
A method of converting UIs of an existing display area to UIs of a comfort zone according to another exemplary embodiment of the present invention will be described. A plurality of default comfort zones are pre-stored during initial setting of a touch screen by the manufacturer. The default comfort zones are formed into shapes that users are likely to frequently use. It is also possible for the comfort zone decider 310 to additionally determine a comfort zone based on a user s preference according to a user selection. If each of the default comfort zones includes UIs transformed from UIs of the display area, upon user selection of one of the default comfort zones, an operation of adjusting preset UIs of the selected default comfort zone may be performed selectively.
FIG. 7 illustrates the shapes of various comfort zones and the positions and sizes of icons adjusted according to the shapes of the comfort zones according to an exemplary embodiment of the present invention.
Referring to FIG. 7, while icons are taken as an exemplary content type displayed in a display area 700, the present invention is not limited thereto, and the present exemplary embodiment is also applicable to other types of content such as a control UI, a page view, and a list view.
The display area 700 generally displays icons across the whole area of a touch screen. For example, the icons are arranged equidistantly at their original positions 705. Each icon is spaced from its upper, lower, left, and right adjacent icons by the same distance. The icons displayed in the display area 700 are of the same size. While the icons have the same distance and size in the exemplary embodiment of FIG. 7, the sizes and positions of icons arranged in the display area may be adjusted according to a user setting. The icons mapped to the display area 700 are rearranged at new coordinates in a predetermined comfort zone by two-dimensional projective transformation described above with reference to the exemplary embodiments of FIGS. 5A and 5B.
In an exemplary embodiment of the present invention, various shapes are available to a comfort zone according to a user input. In the exemplary embodiment of FIG. 7, the icons of the display area 700 are displayed at new coordinates corresponding to the original icon positions 705 in comfort zones 710, 720 and 730, which may also be respectively referred to as comfort zones 1-1, 2-1, and 3-1. Specifically, the icons of the display area 700 are moved to new coordinates mapped to the original positions of the icons in comfort zone 1-1, while the sizes of the icons are still kept unchanged. An area available to the icons gets narrower from bottom to top in comfort zone 2-1, relative to the display area 700. Therefore, the icons are arranged at new coordinates mapped to their original positions with sizes and intervals decreased in correspondence with a rate at which the area of the comfort zone 2-1 gets narrower.
The icons are arranged at new coordinates mapped to their original positions 705, with sizes inversely proportional to the number of their adjacent icons along the horizontal axis in comfort zone 3-1. Specifically, an icon 731 arranged in the top row of comfort zone 3-1 is large relative to its original size because it does not have any adjacent icon arranged along the horizontal axis on a current page. On the other hand, icons arranged in the bottom row of comfort zone 3-1 are small relative to the icon 731 because each of the bottom-row icons has the most adjacent icons along the horizontal axis on the current page.
Icons needing size adjustment are selected from comfort zones 1-1, 2-1, and 3-1. These selected icons are shown as black spots in comfort zones 712, 722 and 732, which may be referred to as comfort zones 1-2, 2-2, and 3-2. Icons may be selected for size adjustment based on the size of a preset default icon. Alternatively, the UI layout converter 320 may control the display unit 305 to display a screen that prompts a user to input an icon selection criterion.
For example, comfort zone 1-2 keeps the original sizes of the icons. The original sizes of the icons are set according to a user's preference or by default during initial setting of the display area 700. If the icons are displayed at their original sizes, the user is likely to feel convenient. Thus, no icons are shown as selected in comfort zone 1-2. Relatively small icons are shown as selected in comfort zone 2-2. Specifically, icons 722a, which are arranged in the first to third rows, are selected in comfort zone 2-2. Likewise, relatively small icons are shown as selected in comfort zone 3-2. Specifically, icons 732a, which are arranged in the bottom two rows, are selected in comfort zone 3-2.
The selected icons that have been adjusted in size or position in comfort zones 714, 724, and 734, which may also be respectively referred to as comfort zones 1-2, 2-2 and 3-2 are displayed respectively in comfort zones 1-3, 2-3, and 3-3. For example, icons 716 outside the display area of comfort zone 1-3 are moved to a next page in comfort zone 1-3. The sizes and intervals of the selected icons 722a in comfort zone 2-2 are returned to the original sizes and intervals in comfort zone 2-3. Specifically, since an area defined by the first to third rows in comfort zone 2-3 is small relative to an area defined by the last row, some icons are moved from the current page to the next page due to the size adjustment. The sizes of the icons 732a shown as selected in comfort zone 2-3 are adjusted appropriately according to a user input or the like and then displayed in comfort zone 3-3. Due to the size adjustment of the icons 732a, some icons are moved to the next page. The next page displays the icons moved due to the shape of comfort zone 3-1 as well as the icons moved due to the size adjustment.
As described above, comfort zones 1-1 to 3-3 that display icons may be determined according to a user input related to icon sizes and positions, received on the display unit 305 under the control of the UI layout converter 320. A user input may select between individual adjustment and uniform adjustment of selected icons in size and position.
FIG. 8A illustrates an icon layout on a home screen and an initial operation according to an exemplary embodiment of the present invention.
Referring to FIG. 8A, a home screen with icons arranged with the same size and interval is displayed on an existing display area 805. The home screen with the icons rearranged at new coordinates is displayed in a current comfort zone 810. The rearranged icons have the original size and interval. Considering that the comfort zone 810 is defined as an area touchable by a thumb of a one-hand user, the comfort zone 810 has a relatively small available area for icons as compared to the existing display area 805. Accordingly, as the icons are rearranged with the original size and interval in the comfort zone 810, a part of the rearranged icons may be moved to the next page. In this case, the user may adjust the sizes and intervals of the icons so that all of the icons may be displayed within the current page or only frequently used icons may be displayed on the home screen according to the user's preferences. The rearranged icons may be displayed on the current and next pages according to their use frequencies. While a page number 807 indicating the current page is written horizontally in the existing display area 805, the present invention is not limited thereto, and the page number 807 may be written according to a thumb moving direction in the comfort zone 810, as indicated by reference numeral 812.
If the user determines to adjust the sizes, intervals, and layout of the icons after viewing the icons displayed in the comfort zone 810, the user first selects icons to be adjusted from among the displayed icons. For the convenience of description, the selected icons are shown as shaded in the comfort zone 810. For example, the user may select an intended icon by clicking on the icon once or dragging the icon without detaching a hand from the icon, then a selection area 814 including selected icons is displayed. When the user touches a part of the selection area 814 or one of the selected icons, the home screen of the comfort zone 810 displays a window for a specific setting of rearrangement of the selected icons.
FIG. 8B illustrates screens displayed for a specific setting of rearranging selected icons according to an exemplary embodiment of the present invention.
Referring to FIG. 8B, a first screen 820 displays a pop-up window 822 overlapped over the selection area 814, for a specific setting of rearrangement. For example, the first screen 820, which is rendered transparent, may be displayed simultaneously with the selection area 814. In this case, upon receipt of a user input requesting a specific setting of rearrangement, the icons of the selection area 814 may be displayed as a preview reflecting the user input. Alternatively, upon receipt of a user input requesting a specific setting of rearrangement, icons rearranged according to the setting indicated by the user input may be displayed, simultaneously with disappearance of the pop-up window 822.
A second screen 830 displays a rearrangement setting menu independently of the existing display area 810. For example, the rearrangement setting menu provides menu items with which to select increase or decrease in the size and interval of a selected icon. When the user selects an increase or decrease button in the size and interval of the selected icon, a button with which to adjust the degree of increase or decrease, such as a rate button may further be displayed. According to another exemplary embodiment, the rearrangement setting menu provides Yes and No buttons for 'manual selection' so that the user may manually rearrange the positions or intervals of selected icons. If the Yes button is selected in the second screen 830, then, as shown in a third screen 840, a reference icon 842 or 844 may be selected according to a user input, such as click or touch, on the icon 842 or 844 in the third screen 840. As the size of the reference icon 842 or 844 is adjusted, the sizes and intervals of the icons in the selection area 814 may be adjusted uniformly. For example, the reference icon 842 or 844 may be scaled down or up by dragging the reference icon 842 inward or dragging the reference icon 844 outward in accordance with an intended size. In addition, an area corresponding the distance between icons may be adjusted by touching or clicking on the area and then dragging the area inward or outward according to an intended interval. In another example, the size and interval of each individual icon within the selection area 814 may be adjusted by dragging a touch or click on the icon according to an intended size or interval, rather than the icons of a selected area 816 which are adjusted in size and interval at one time by setting a reference icon.
FIG. 9A illustrates additional UIs available for rearrangement of selected icons according to an exemplary embodiment of the present invention.
Referring to FIG. 9A, a screen 900 displays additional UIs, which may be icons, buttons, or similar graphical displays, that are not provided in the existing display area 805 of FIG. 8A, for example, a toggle button 902, a back button 904, and a home button 906. The toggle button 902 is a UI that receives a command to set a comfort zone 912 displayed on the screen 900 as a frequently used page, or The toggle button 902 is able to use as a UI that receives a command to convert between the existing display area 805 and the comfort zone 810. While not shown in FIG. 9A, it is assumed that the comfort zone 912 displays icons rearranged in the manner described before with reference to FIGS. 8A and 8B. The back button 904 is for receiving a command to return to the previous screen. The home button 906 is for receiving a command to return to a home screen , the comfort zone 810, by way of example.
While it is described herein that icons are displayed as an exemplary content type in a display area for the convenience of description, the present invention is not limited thereto, and the present exemplary embodiment is applicable to many other types of content.
FIG. 9B illustrates additional UIs available on a content basis for rearrangement of selected icons according to an exemplary embodiment of the present invention.
Referring to FIG. 9B, a first screen 920 displays additional UIs 922 including a toggle button, a back button, and a home button, when lists are rearranged as content in a comfort zone. A second screen 930 displays additional UIs 932 including a toggle button, a back button, and a home button, when multimedia, for example, videos, are rearranged as content in a comfort zone. In view of the content nature of the videos, UIs 934 may further be provided for the user to view the videos. For example, the UIs 934 may include a play button, a pause button, a stop button, and the like. A third screen 940 displays additional UIs 942 including a toggle button, a back button, and a home button, when a keyboard is rearranged as content in a comfort zone.
FIG. 10A is a flowchart illustrating an operation of a comfort zone decider in a touch screen control apparatus according to another exemplary embodiment of the present invention.
Referring to FIG. 10A, the comfort zone decider 310 may control the display unit 305 to provide a comfort zone selection screen including, for example, at least one of a button that requests a touch input request screen (not shown) to determine a comfort zone and a button that selects preset default comfort zones in step 1000. The comfort zone selection screen may be, for example, a locked home screen or an additional screen requesting a user touch input. Whether the locked home screen or the additional screen requesting a user touch input is provided as the comfort zone selection screen and the touch input request screen on the display unit 305 may be preset by the user or by default by the manufacturer. For example, if the comfort zone selection screen provides only the button that selects the default comfort zones, the button may have menu items that indicate use and non-use of the default comfort zones. Upon sensing a user touch input that selects a menu item indicating non-use of the default comfort zones, the comfort zone decider 310 may set a comfort zone based on a user touch input that unlocks the locked screen according to the afore-described exemplary embodiment of the present invention.
FIG. 10B illustrates a comfort zone selection screen according to another exemplary embodiment of the present invention.
Referring to FIG. 10B, a comfort zone selection screen 1100 may display a comfort zone selection list on the touch screen corresponding to the display unit 305. The comfort zone selection list may include a menu 'touch input request screen' and a menu 'default comfort zones' as illustrated in FIG. 10B. These menus are displayed as buttons so that the user may select a menu by touching a button corresponding to the menu.
FIG. 10C illustrates default comfort zones pre-stored in the touch screen control apparatus according to an exemplary embodiment of the present invention.
Referring to FIG. 10C, default comfort zones are defined based on the fan-shaped area 200 illustrated in FIG. 2 corresponding to a range touchable by a thumb on the touch screen. The default comfort zones may be preset by the user or by default by the manufacturer according to the above described exemplary embodiments of the present invention.
To offer a wide range of default comfort zones satisfying users' preferences in an existing display area 1101, the default comfort zones may configured by adding an area outside the fan-shaped area 200 or excluding a part from the fan-shaped area 200. Specifically, a first default comfort zone 1102 is fully included in the fan-shaped area 200. A second default comfort zone 1104 is shaped into a rectangle partially overlapped with the fan-shaped area 200. A third default comfort zone 1106 is a part of the fan-shaped area 200, particularly except for a thumb-untouchable area other than a shaded area of the fan-shaped area 200.
A fourth default comfort zone 1108 is configured by removing the non-shaded area of the fan-shaped area 200, untouchable by the thumb of the user. A fifth default comfort zone 1110 is shaped into a rectangle having a rectangular non-shaded area of the fan-shaped area 200 being removed. A sixth default comfort zone 1112 is a semi-circle having the center point on the right side of the existing display area 1101, fully included in the fan-shaped area 200. Although the shapes of default comfort zones are preset as described above, the default comfort zones may be adjusted by the adjustment operation of FIG. 4C, which will be described later in detail.
The comfort zone decider 310 determines a menu selected from the comfort zone selection list according to a user touch input in step 1005. If the menu requesting a touch input request screen has been selected, then the comfort zone decider 310 performs steps 1010 through 1025 in the same manner as steps 410 through 425 of FIG. 4. Thus steps 1010 through 1025 will not be described herein to avoid redundancy.
On the other hand, if the menu requesting default comfort zones has been selected, then the comfort zone decider 310 controls the display unit 305 to display a screen, hereinafter, referred to as a 'default comfort zone selection screen' used to select a specific default comfort zone from among pre-stored default comfort zones in step 1030 and proceeds to step 1035.
FIG. 10D illustrates a default comfort zone selection screen according to an exemplary embodiment of the present invention. The default comfort zone selection screen may also be a locked home screen or an additional screen requesting a touch input.
Referring to FIG. 10D, if a default comfort zone selection screen is a locked home screen, a first default comfort zone selection screen 1200a may display buttons that are one-to-one mapped to pre-stored default comfort zones, hereinafter, referred to as 'default comfort zone selection buttons' and a button used to configure a new default comfort zone, hereinafter, referred to as a 'new setting button' at the bottom of the display area. The default comfort zone selection buttons are shown as numerals in FIG. 10D.
In step 1035, the comfort zone decider 310 determines whether a user touch input is detected. Upon detecting a user touch input to a default comfort zone selection button in the menus provided on the default comfort zone selection screen in step 1035, then, in step 1040, the comfort zone decider 310 controls the display unit 305 to display a preview of a comfort zone mapped to the default comfort zone selection button. In an exemplary embodiment of the present invention, upon sensing a short touch or a single click on a default comfort zone selection button, the comfort zone decider 310 provides a preview of a default comfort zone corresponding to the default comfort zone selection button. Upon sensing a long touch or double clicks on a default comfort zone selection button, the comfort zone decider 310 determines a default comfort zone mapped to the default comfort zone selection button as a current default comfort zone.
For example, a user touch input to button 1 is sensed in a second default comfort zone selection screen 1200b-1. If the user touch input to button 1 is a short touch or single click, the second default comfort zone selection screen 1200b-1 provides a preview of a default comfort zone corresponding to button 1. A user touch input to button 2 is sensed in a third default comfort zone selection screen 1200c-1. If the user touch input to button 2 is a short touch or single click, then the third default comfort zone selection screen 1200c-1 provides a preview of a default comfort zone corresponding to button 2.
In step 1045, the comfort zone decider 310 determines whether a user touch input being a long touch or double clicks on a specific default comfort zone selection button is detected. If a user touch input has not been detected, in step 1045, in the form of a long touch or double clicks on a specific default comfort zone selection button, then the comfort zone decider 310 awaits detection of a user touch input.
On the other hand, if a user touch input being a long touch or double clicks on a specific default comfort zone selection button has been detected in step 1045, then the comfort zone decider 310 determines a default comfort zone mapped to the button as a current default comfort zone in step 1050. Subsequently, the comfort zone decider 310 performs an adjustment operation on the current default comfort zone in steps 1015 through 1025. As noted above, steps 1015 through 1025 are the same as steps 415 through 425 of FIG. 4 and thus will not be described herein. Although not shown, upon sensing a user touch input to the new setting button in the menus provided by the default comfort zone selection screen in step 1035, the comfort zone decider 310 may control the display unit 305 to provide a touch input request screen.
FIG. 10E illustrates a case where the new setting button is selected on a default comfort zone selection screen according to an exemplary embodiment of the present invention.
Referring to FIG. 10E, a user touch input to the new setting button is sensed on a fourth default comfort zone selection screen 1200d-1. The fourth default comfort zone selection screen 1200d-1 provides a touch input request screen 1200d-2 to allow the user to set a new comfort zone. Herein, a direction 1210 in which the user slides or drags the thumb across the touch screen is sensed. The comfort zone decider 310 may estimate a touchable area based on the touched area and the sensed sliding or dragging direction 1210 and may determine the estimated touchable area as a new comfort zone.
Once the comfort zone decider 310 determines the new comfort zone, then the comfort zone decider 310 may control the display unit 305 to display the new comfort zone so that the user may identify the new comfort zone. While not shown, the display unit 305 may display only the boundaries or full area of the determined new comfort zone.
Then the comfort zone decider 310 determines whether the new comfort zone is to be adjusted and performs an adjustment operation based on the determination in steps 1015 through 1025. Specifically, as done in step 415 of FIG. 4, the comfort zone decider 310 controls the display unit 305 to provide a screen asking the user whether to maintain or adjust the new comfort zone and receives a user input in response to the question. Whether the asking screen is to be provided may be preset by default in the digital portable terminal by the manufacturer or may be set freely by the one-hand user during initial setting of the digital portable terminal. For example, the asking screen may prompt the user to make a choice between maintenance and adjustment of the determined comfort zone.
If the user input selects maintenance of the new comfort zone, then the comfort zone decider 310 determines the new comfort zone as a current comfort zone and provides information about the current comfort zone to the UI layout converter 320.
If the user input selects adjustment of the new comfort zone, then the comfort zone decider 310 controls the display unit 305 to provide a touch input request screen 1200d-3 for comfort zone adjustment. Then the display unit 305 displays boundaries 1225 of the new comfort zone on the touch input request screen 1200d-3. When the one-hand user clicks a point 1220 for a predetermined amount of time on a boundary 1225 of the current comfort zone, then the clicked boundary 1225 is placed in an adjustable state. The user may now scale up or down the current comfort zone by dragging the clicked boundary 1225 to an intended position. While a click and dragging scheme is used to adjust a comfort zone in the above exemplary embodiment, the present invention is not limited thereto, and an operation of selecting a boundary of the comfort zone and thus placing the boundary in an adjustable state and an operation of adjusting the boundary may be performed by many other preset inputs. For example, when a boundary of a comfort zone is clicked to an adjustable state, the boundary may be adjusted by a predetermined extent at each click or each time a predetermined motion is recognized.
If a new comfort zone is defined in the afore-described area determination and interval setting operation, then the comfort zone decider 310 adjusts the size of content to be arranged in the new comfort zone and stores the size-adjusted content. The size of the content may be increased or decreased according to preset size levels, for example, large, standard, and small as indicated by reference numerals 1304a, 1304b, and 1304c. While not shown, the content to be displayed in the new comfort zone may be rearranged according to the user's preferences and the use frequencies of the content.
In another exemplary embodiment of the present invention, a range to which a comfort zone set according to the above-described exemplary embodiments is applied may be set additionally. For example, a 'comfort zone apply setting' menu may be added to a basic setting menu in order to set a range to which a comfort zone is applied in a user device.
FIG. 11A illustrates menu items of a comfort zone apply setting menu added to a setting menu of a user device according to an exemplary embodiment of the present invention.
Referring to FIG. 11A, the comfort zone apply setting menu may include, for example, an 'Apply Range setting' menu item, an 'Apply Time'menu item, and a 'Recovery Time' menu item.
The 'Apply Range Setting' menu item may include an On/Off button to determine whether to use icons provided on a home screen, an On/Off button to determine whether to apply a specific UI such as an afore-described application control UI, and an On/Off button to determine whether to use all screens and icons available to the user device.
The 'Apply Time' menu item may impose an additional condition that only when the On button indicating that all screens and icons available to the user device are always used is selected and a predetermined motion is made as a user touch input, a comfort zone is applied. The predetermined motion may include a sliding, a drag, a long touch on an area, and the like.
FIG. 11B illustrates a case where if 'Always On'is selected in a 'Apply Time' menu item of the comfort zone usage setting menu, a comfort zone is applied only when a touch input slides across a touch screen according to an exemplary embodiment of the present invention.
Referring to FIG. 11B, it is assumed that 'Apply Time' is set in the setting menu in such a manner that the moment a sliding motion is made in any direction in an existing display area 1410, a comfort zone is effective and a target icon 1402 of a one-hand user is outside of the movement range of a thumb of the one-hand user in the existing display area 1410. If the one-hand user slides the thumb across a part of the display area 1410 in any direction, then the display area 1410 is switched to a current default comfort zone 1420 preset according to the above described exemplary embodiments of the present invention. As the target icon 1402 is moved within the current default zone 1420, then the one-hand user may touch the target icon 1402 with the thumb.
The 'Recovery Time' may include a menu item that automatically switches a locked screen to a comfort zone, each time the locked screen is unlocked. In this case, the comfort zone may be set according to the first exemplary embodiment of the present invention. A recovery time may be set, for example, by making a sliding motion across a screen displaying the comfort zone 1420, reversely to a sliding direction used to switch to the comfort zone 1420. As additional UIs are provided to a user in the above manner, the user may readily use or set icons within a comfort zone of a display area. Therefore, user experience is enhanced.
As is apparent from the above description of the present invention, since a partial touchable area is set in the display area of a touch screen and UIs are rearranged in the partial touchable area by adjusting the sizes and positions of the UIs in a digital portable terminal, a user experience is enhanced. Furthermore, additional UIs are provided to use the rearranged UIs in the partial touchable area, further enhancing user experience.
At this point it should be noted that the exemplary embodiments of the present disclosure as described above typically involve the processing of input data and the generation of output data to some extent. This input data processing and output data generation may be implemented in hardware or software in combination with hardware. For example, specific electronic components may be employed in a mobile device or similar or related circuitry for implementing the functions associated with the exemplary embodiments of the present invention as described above. Alternatively, one or more processors operating in accordance with stored instructions may implement the functions associated with the exemplary embodiments of the present invention as described above. If such is the case, it is within the scope of the present disclosure that such instructions may be stored on one or more processor readable mediums. Examples of the processor readable mediums include Read-Only Memory (ROM), Random-Access Memory (RAM), CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices. The processor readable mediums can also be distributed over network coupled computer systems so that the instructions are stored and executed in a distributed fashion. Also, functional computer programs, instructions, and instruction segments for accomplishing the present invention can be easily construed by programmers skilled in the art to which the present invention pertains
While the invention has been shown and described with reference to certain exemplary embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims and their equivalents.

Claims (16)

  1. A method of providing User Interfaces (UIs) on a touch screen, the method comprising:
    displaying a menu item in a basic setting menu that is preset in a user device, the menu item being used to select rearrangement of UIs arranged in a display area of the touch screen in a user-touchable partial area; and
    displaying a rearranged screen displaying the UIs rearranged in the user-touchable partial area upon sensing of a user touch input selecting the rearrangement of the UIs.
  2. The method of claim 1, wherein the menu item includes at least one of a sub-menu to set an apply range of the rearranged screen, a sub-menu to set an apply time of the rearrangement of the UIs in the user-touchable partial area, and a sub-menu to set a recovery time of returning the rearranged screen to an original screen.
  3. The method of claim 2, further comprising, if the sub-menu to set the apply time is set to screen unlocking, displaying a user-touchable partial area selection screen upon sensing of a user touch input requesting screen unlocking,
    wherein the user-touchable partial area selection screen includes at least one of a first selection item to select pre-stored default user-touchable partial areas and a second selection item to display a touch input request screen configured to set a user-touchable partial area according to a user touch input.
  4. The method of claim 3, further comprising:
    displaying a screen including first selection buttons mapped to the default user-touchable partial areas and a second selection button to set a new user-touchable partial area upon sensing of a user touch input selecting the second selection item; and
    displaying a preview of a default user-touchable partial area corresponding to a first selection button upon sensing of a user touch input to the first selection button, and displaying a touch input request screen to set a user-touchable partial area upon sensing of a user touch input to the second selection button.
  5. The method of claim 3, wherein if the user-touchable partial area selection screen displays only the first selection item, then the first selection item includes a sub-menu indicating selection of the default user-touchable areas and a sub-menu indicating non-selection of the default user-touchable areas.
  6. The method of claim 5, further comprising:
    displaying a screen including boundaries of a user-touchable partial area in response to the user touch input requesting screen unlocking upon sensing of a user touch input to the sub-menu indicating non-selection of the default user-touchable partial areas;
    adjusting a boundary of the user-touchable partial area according to a user touch input to the boundary upon sensing of the user touch input to the boundary; and
    displaying a rearranged screen including the UIs rearranged in the user-touchable area having the adjusted boundary.
  7. The method of claim 6, wherein the displaying of the rearranged screen including the UIs rearranged in the user-touchable partial area having the adjusted boundary comprises:
    determining a mapping relationship between coordinates of the display area and coordinates of the boundary-adjusted user-touchable partial area; and
    rearranging the UIs arranged in the display area in the boundary-adjusted user-touchable partial area based on the determined mapping relationship.
  8. The method of claim 6, wherein the displaying of the rearranged screen including the UIs rearranged in the user-touchable partial area having the adjusted boundary comprises:
    displaying a screen that includes at least one of the rearranged UIs separately from the other UIs upon sensing of a user touch input to the at least one of the rearranged UIs;
    displaying a screen that includes a menu to set a size and an interval of the at least one of the rearranged UIs; and
    displaying a screen that includes the at least one of the rearranged UIs according to a user touch input on a command included in the menu upon sensing of the user touch input to the command.
  9. A touch screen apparatus of providing User Interface (UIs), the touch screen apparatus comprising:
    a display unit displaying a menu item in a basic setting menu that is preset in a user device, the menu item being used to select rearrangement of UIs arranged in a display area of the touch screen apparatus in a user-touchable partial area; and
    a controller controlling the display unit to display a rearranged screen including the UIs rearranged in the user-touchable partial area upon sensing of a user touch input selecting the rearrangement of the UIs.
  10. The touch screen apparatus of claim 9, wherein the menu item includes at least one of a sub-menu to set an apply range of the rearranged screen, a sub-menu to set an apply time of the rearrangement of the UIs in the user-touchable partial area, and a sub-menu to set a recovery time of returning the rearranged screen to an original screen.
  11. The touch screen apparatus of claim 10, wherein if the sub-menu to set the apply time is set to screen unlocking, the controller controls the display unit to display a user-touchable partial area selection screen upon sensing of a user touch input requesting screen unlocking, and
    wherein the user-touchable partial area selection screen includes at least one of a first selection item to select pre-stored default user-touchable partial areas and a second selection item to display a touch input request screen configured to set a user-touchable partial area according to a user touch input.
  12. The touch screen apparatus of claim 11, wherein, upon sensing of a user touch input selecting the second selection item, the controller controls the display unit to display a screen including first selection buttons mapped to the default user-touchable partial areas and a second selection button to set a new user-touchable partial area, and
    wherein upon sensing of a user touch input to a first selection button, the controller controls the display unit to display a preview of a default user-touchable partial area corresponding to the first selection button, and upon sensing of a user touch input to the second selection button, the controller controls the display unit to display a touch input request screen to set a user-touchable partial area.
  13. The touch screen apparatus of claim 11, wherein if the user-touchable partial area selection screen provides only the first selection item, then the first selection item includes a sub-menu indicating selection of the default user-touchable areas and a sub-menu indicating non-selection of the default user-touchable areas.
  14. The touch screen apparatus of claim 13, wherein the controller controls the display unit to display a screen including boundaries of a user-touchable partial area in response to the user touch input requesting screen unlocking upon sensing of a user touch input to the sub-menu indicating non-selection of the default user-touchable partial areas,
    wherein the controller adjusts a boundary of the user-touchable partial area according to a user touch input to the boundary, upon sensing of the user touch input to the boundary, and
    wherein the controller controls the display unit to display a rearranged screen displaying the UIs rearranged in the user-touchable area having the adjusted boundary.
  15. The touch screen apparatus of claim 14, wherein the controller determines a mapping relationship between coordinates of the display area and coordinates of the boundary-adjusted user-touchable partial area and rearranges the UIs arranged in the display area in the boundary-adjusted user-touchable partial area based on the determined mapping relationship.
  16. The touch screen apparatus of claim 14, wherein the controller controls the display unit to display a screen that includes at least one of the rearranged UIs distinctively from the other UIs upon sensing of a user touch input to the at least one of the rearranged UIs,
    wherein the controller controls the display unit to display a screen that includes a menu to set a size and an interval for the at least one of the rearranged UIs, and
    wherein the controller controls the display unit to display a screen that includes the at least one of the rearranged UIs according to a user touch input to a command included in the menu upon sensing of the user touch input to the command.
PCT/KR2013/004458 2012-05-21 2013-05-21 Method and apparatus of controlling user interface using touch screen WO2013176472A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2015513898A JP6279553B2 (en) 2012-05-21 2013-05-21 User interface control method and apparatus using touch screen
CN201380026903.0A CN104321736B (en) 2012-05-21 2013-05-21 Method and apparatus for carrying out control user interface by using touch screen
EP13793991.4A EP2852882B1 (en) 2012-05-21 2013-05-21 Method and apparatus of controlling user interface using touch screen

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR20120053799 2012-05-21
KR10-2012-0053799 2012-05-21

Publications (1)

Publication Number Publication Date
WO2013176472A1 true WO2013176472A1 (en) 2013-11-28

Family

ID=49580925

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2013/004458 WO2013176472A1 (en) 2012-05-21 2013-05-21 Method and apparatus of controlling user interface using touch screen

Country Status (6)

Country Link
US (2) US10338705B2 (en)
EP (1) EP2852882B1 (en)
JP (1) JP6279553B2 (en)
KR (1) KR102094695B1 (en)
CN (1) CN104321736B (en)
WO (1) WO2013176472A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016001749A1 (en) 2014-06-30 2016-01-07 Alcatel Lucent Method and apparatus for operating a screen of a touch screen device
EP3113008A1 (en) * 2015-06-29 2017-01-04 Samsung Electronics Co., Ltd. A method and an electronic device for one-hand user interface
JP2018045729A (en) * 2017-12-25 2018-03-22 キヤノン株式会社 Information processing apparatus, information processing method, computer program, and recording medium

Families Citing this family (55)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10048860B2 (en) 2006-04-06 2018-08-14 Google Technology Holdings LLC Method and apparatus for user interface adaptation
KR101340703B1 (en) 2011-11-25 2013-12-12 삼성전자주식회사 Device and method for arranging keypad in wireless terminal
US9367085B2 (en) 2012-01-26 2016-06-14 Google Technology Holdings LLC Portable electronic device and method for controlling operation thereof taking into account which limb possesses the electronic device
US20150013476A1 (en) * 2012-02-13 2015-01-15 Thermo Fisher Scientific Oy Electronic Pipette
KR101979666B1 (en) 2012-05-15 2019-05-17 삼성전자 주식회사 Operation Method For plural Touch Panel And Portable Device supporting the same
DE112012007031T5 (en) * 2012-10-19 2015-07-16 Mitsubishi Electric Corporation Information processing apparatus, information terminal, information processing system and calibration method
KR20140070745A (en) * 2012-11-26 2014-06-11 삼성전자주식회사 Display device and driving method thereof
KR20140087731A (en) * 2012-12-31 2014-07-09 엘지전자 주식회사 Portable device and method of controlling user interface
US10691291B2 (en) * 2013-05-24 2020-06-23 Samsung Electronics Co., Ltd. Method and apparatus for displaying picture on portable device
CN104281378A (en) * 2013-07-05 2015-01-14 深圳富泰宏精密工业有限公司 Mobile device one-hand control method and system
GB2516029A (en) * 2013-07-08 2015-01-14 Ibm Touchscreen keyboard
KR102156140B1 (en) * 2013-07-19 2020-09-15 엘지전자 주식회사 Mobile terminal and method for controlling the same
TWI608407B (en) * 2013-11-27 2017-12-11 緯創資通股份有限公司 Touch device and control method thereof
CN104750400B (en) * 2013-12-27 2017-12-15 华为技术有限公司 The optimization operation method and device of terminal interface
US20150186011A1 (en) * 2013-12-30 2015-07-02 Samsung Electronics Co., Ltd. Apparatus and method for interacting with items on a portable terminal
CN105917300B (en) * 2014-01-20 2020-04-14 三星电子株式会社 User interface for touch device
KR20150135980A (en) * 2014-05-26 2015-12-04 삼성전자주식회사 Method for controlling display and electronic device
KR102255302B1 (en) * 2014-07-24 2021-05-24 삼성전자주식회사 Electro-chromic panel capable of selectively making transparent area and reflective area and method of operating the same and display apparatus including the same and method of operating display apparatus
US20170205967A1 (en) * 2014-08-04 2017-07-20 Swirl Design (Pty) Ltd Display and interaction method in a user interface
US9971496B2 (en) 2014-08-04 2018-05-15 Google Technology Holdings LLC Method and apparatus for adjusting a graphical user interface on an electronic device
JP6275584B2 (en) * 2014-08-05 2018-02-07 シャープ株式会社 Electronics
US10152227B2 (en) * 2014-08-26 2018-12-11 International Business Machines Corporation Free form user-designed single-handed touchscreen keyboard
EP3156864B1 (en) * 2014-09-04 2019-11-13 Yamazaki Mazak Corporation Device having menu display function
US10671275B2 (en) * 2014-09-04 2020-06-02 Apple Inc. User interfaces for improving single-handed operation of devices
US20160162149A1 (en) * 2014-12-05 2016-06-09 Htc Corporation Mobile electronic device, method for displaying user interface, and recording medium thereof
US9898126B2 (en) 2015-03-31 2018-02-20 Toshiba Global Commerce Solutions Holdings Corporation User defined active zones for touch screen displays on hand held device
US9874952B2 (en) 2015-06-11 2018-01-23 Honda Motor Co., Ltd. Vehicle user interface (UI) management
US10248311B2 (en) 2015-07-06 2019-04-02 Samsung Electronics Co., Ltd. Electronic device supporting virtual keyboard and method for configuring the virtual keyboard
CN105117056B (en) * 2015-08-17 2019-02-01 青岛海信移动通信技术股份有限公司 A kind of method and apparatus of operation touch-screen
WO2017039125A1 (en) * 2015-08-28 2017-03-09 Samsung Electronics Co., Ltd. Electronic device and operating method of the same
US20170060398A1 (en) * 2015-09-02 2017-03-02 Sap Se Dynamic display of user interface elements in hand-held devices
KR20170029180A (en) * 2015-09-07 2017-03-15 현대자동차주식회사 Vehicle, and control method for the same
JP6344355B2 (en) * 2015-09-28 2018-06-20 キヤノンマーケティングジャパン株式会社 Electronic terminal, and control method and program thereof
CN105487776A (en) * 2015-11-30 2016-04-13 上海斐讯数据通信技术有限公司 Electronic device and operation method of application thereof
KR20170103379A (en) * 2016-03-04 2017-09-13 주식회사 이노스파크 Method for providing responsive user interface
US10079972B2 (en) 2016-03-10 2018-09-18 Mediatek Inc. Method for controlling graphical user interface of camera application
CN106201172B (en) * 2016-06-24 2020-09-01 广州视睿电子科技有限公司 Canvas display method and device for touch screen terminal
KR102629409B1 (en) * 2016-11-11 2024-01-26 삼성전자주식회사 Method for providing object information and electronic device thereof
US10591878B2 (en) * 2016-12-09 2020-03-17 Ademco Inc. Providing integrative comfort in a structure
CN107257395B (en) * 2017-04-27 2019-10-08 努比亚技术有限公司 A kind of screen adjustment method and terminal
US20190026120A1 (en) * 2017-07-21 2019-01-24 International Business Machines Corporation Customizing mobile device operation based on touch points
US10589960B2 (en) * 2017-07-31 2020-03-17 Otis Elevator Company User device including secondary-touch elevator service request interface
WO2019047226A1 (en) 2017-09-11 2019-03-14 广东欧珀移动通信有限公司 Touch operation response method and device
EP3640783B1 (en) 2017-09-11 2023-12-13 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Touch operation response method and device
WO2019047234A1 (en) * 2017-09-11 2019-03-14 广东欧珀移动通信有限公司 Touch operation response method and apparatus
WO2019056393A1 (en) 2017-09-25 2019-03-28 华为技术有限公司 Terminal interface display method and terminal
JP2020537794A (en) * 2017-10-20 2020-12-24 華為技術有限公司Huawei Technologies Co.,Ltd. Icon display method, device, and system
US10770037B2 (en) * 2018-03-15 2020-09-08 Kyocera Document Solutions Inc. Mobile terminal device
US11487425B2 (en) * 2019-01-17 2022-11-01 International Business Machines Corporation Single-hand wide-screen smart device management
EP3734434A1 (en) * 2019-05-01 2020-11-04 Advanced Digital Broadcast S.A. System and method for optimizing a touch screen user interface in mobile devices
CN110502164B (en) * 2019-07-30 2021-05-14 维沃移动通信有限公司 Interface display method and electronic equipment
TWI728446B (en) * 2019-08-28 2021-05-21 華碩電腦股份有限公司 Control method for enabling user interface and electronic device
JP6945608B2 (en) 2019-11-11 2021-10-06 楽天グループ株式会社 Display system, display control method, program
US20210286500A1 (en) * 2020-03-13 2021-09-16 Microsoft Technology Licensing, Llc Sensory Adjustment Mechanism
CN114860144A (en) * 2022-05-26 2022-08-05 北京小米移动软件有限公司 Unlocking interface control method and device of terminal equipment and terminal equipment

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110013733A (en) * 2009-08-03 2011-02-10 삼성전자주식회사 User interface providing method and apparatus
JP2011086036A (en) 2009-10-14 2011-04-28 Victor Co Of Japan Ltd Electronic equipment, method and program for displaying icon
US20110131533A1 (en) * 2009-11-27 2011-06-02 Samsung Electronics Co. Ltd. Apparatus and method for user interface configuration in portable terminal
KR20110090447A (en) * 2010-02-04 2011-08-10 에스케이텔레콤 주식회사 Method for providing user interface according to holding type of terminal and apparatus
US20110265040A1 (en) * 2010-04-22 2011-10-27 Samsung Electronics Co., Ltd. Method for providing graphical user interface and mobile device adapted thereto
WO2011135944A1 (en) 2010-04-30 2011-11-03 日本電気株式会社 Information processing terminal and operation control method for same
US20120017177A1 (en) * 2010-07-16 2012-01-19 Jungwoo Kim Mobile terminal and method of organizing a menu screen therein

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11275405B2 (en) 2005-03-04 2022-03-15 Apple Inc. Multi-functional hand-held device
US20050162399A1 (en) * 2004-01-23 2005-07-28 Kabushiki Kaisha Toshiba Displaying and inputting apparatus
JP5550211B2 (en) 2005-03-04 2014-07-16 アップル インコーポレイテッド Multi-function handheld device
US7657849B2 (en) 2005-12-23 2010-02-02 Apple Inc. Unlocking a device by performing gestures on an unlock image
JP4770634B2 (en) 2006-08-07 2011-09-14 富士ゼロックス株式会社 Representation image rearrangement device
JP2008261946A (en) * 2007-04-10 2008-10-30 Sharp Corp Display control device and method
KR100837283B1 (en) 2007-09-10 2008-06-11 (주)익스트라스탠다드 Mobile device equipped with touch screen
JP2009265793A (en) * 2008-04-23 2009-11-12 Sony Ericsson Mobilecommunications Japan Inc Display and operation device, operation device and program
US8607161B2 (en) * 2008-05-09 2013-12-10 Blackberry Limited Configurable icon sizing and placement for wireless and other devices
CN101661367A (en) * 2008-08-25 2010-03-03 扬智科技股份有限公司 Generation method of menu shortcut mode and user interface device
JP2010061296A (en) 2008-09-02 2010-03-18 Sharp Corp Data creation device, data processor, data supply system, data creation method, data processing method, control program and recording medium
JP2010108081A (en) * 2008-10-28 2010-05-13 Sharp Corp Menu display device, method of controlling the menu display device, and menu display program
KR101078380B1 (en) 2009-03-23 2011-10-31 주식회사 코아로직 Apparatus and Method for Providing Virtual Keyboard
WO2010110550A1 (en) * 2009-03-23 2010-09-30 Core Logic Inc. Apparatus and method for providing virtual keyboard
US20100287468A1 (en) 2009-05-05 2010-11-11 Emblaze Mobile Ltd Apparatus and method for displaying menu items
US8279185B2 (en) 2009-05-08 2012-10-02 Sony Ericsson Mobile Communications Ab Methods, devices and computer program products for positioning icons on a touch sensitive screen
KR101657117B1 (en) * 2009-08-11 2016-09-13 엘지전자 주식회사 Mobile terminal and method for controlling the same
JP5091267B2 (en) * 2010-02-18 2012-12-05 シャープ株式会社 Operating device, electronic device equipped with the operating device, image processing apparatus, and operating method
TWI441072B (en) * 2010-09-21 2014-06-11 Altek Corp Touch screen unlock method and electric device with camera function thereof
KR101685363B1 (en) * 2010-09-27 2016-12-12 엘지전자 주식회사 Mobile terminal and operation method thereof
TWI457818B (en) * 2011-09-09 2014-10-21 Univ Nat Taiwan Science Tech An user interface of an electronic device
WO2013061156A2 (en) * 2011-10-27 2013-05-02 Cell Rox, Ltd. Systems and method for implementing multiple personas on mobile technology platforms
US20140320420A1 (en) * 2013-04-25 2014-10-30 Sony Corporation Method and apparatus for controlling a mobile device based on touch operations

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110013733A (en) * 2009-08-03 2011-02-10 삼성전자주식회사 User interface providing method and apparatus
JP2011086036A (en) 2009-10-14 2011-04-28 Victor Co Of Japan Ltd Electronic equipment, method and program for displaying icon
US20110131533A1 (en) * 2009-11-27 2011-06-02 Samsung Electronics Co. Ltd. Apparatus and method for user interface configuration in portable terminal
KR20110090447A (en) * 2010-02-04 2011-08-10 에스케이텔레콤 주식회사 Method for providing user interface according to holding type of terminal and apparatus
US20110265040A1 (en) * 2010-04-22 2011-10-27 Samsung Electronics Co., Ltd. Method for providing graphical user interface and mobile device adapted thereto
WO2011135944A1 (en) 2010-04-30 2011-11-03 日本電気株式会社 Information processing terminal and operation control method for same
US20120017177A1 (en) * 2010-07-16 2012-01-19 Jungwoo Kim Mobile terminal and method of organizing a menu screen therein

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2852882A4

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016001749A1 (en) 2014-06-30 2016-01-07 Alcatel Lucent Method and apparatus for operating a screen of a touch screen device
EP3113008A1 (en) * 2015-06-29 2017-01-04 Samsung Electronics Co., Ltd. A method and an electronic device for one-hand user interface
US10452232B2 (en) 2015-06-29 2019-10-22 Samsung Electronics Co., Ltd. Method and an electronic device for one-hand user interface
JP2018045729A (en) * 2017-12-25 2018-03-22 キヤノン株式会社 Information processing apparatus, information processing method, computer program, and recording medium

Also Published As

Publication number Publication date
US20190324568A1 (en) 2019-10-24
KR20130129864A (en) 2013-11-29
JP2015518221A (en) 2015-06-25
JP6279553B2 (en) 2018-02-14
US11061496B2 (en) 2021-07-13
CN104321736B (en) 2018-11-13
US20130307801A1 (en) 2013-11-21
EP2852882A4 (en) 2016-01-27
EP2852882A1 (en) 2015-04-01
CN104321736A (en) 2015-01-28
EP2852882B1 (en) 2021-08-18
US10338705B2 (en) 2019-07-02
KR102094695B1 (en) 2020-03-31

Similar Documents

Publication Publication Date Title
WO2013176472A1 (en) Method and apparatus of controlling user interface using touch screen
WO2013180454A1 (en) Method for displaying item in terminal and terminal using the same
WO2016060501A1 (en) Method and apparatus for providing user interface
WO2016064137A1 (en) Apparatus and method of drawing and solving figure content
WO2016036137A1 (en) Electronic device with bent display and method for controlling thereof
EP3436907A1 (en) Remote hover touch system and method
WO2016195291A1 (en) User terminal apparatus and method of controlling the same
WO2012108714A2 (en) Method and apparatus for providing graphic user interface in mobile terminal
WO2014104472A1 (en) Method and apparatus for dual display
WO2017119664A1 (en) Display apparatus and control methods thereof
WO2015182811A1 (en) Apparatus and method for providing user interface
WO2016093506A1 (en) Mobile terminal and control method therefor
WO2014193101A1 (en) Method and apparatus for controlling screen display using environmental information
WO2012030155A2 (en) Item display method and apparatus
CN103823550A (en) Virtual touch method
EP2989527A1 (en) User terminal device with pen and controlling method thereof
WO2015005674A1 (en) Method for displaying and electronic device thereof
WO2015178677A1 (en) User terminal device, method for controlling user terminal device, and multimedia system thereof
WO2014046492A2 (en) Flexible apparatus and control method thereof
WO2012064128A2 (en) Touch screen apparatus and method for controlling same
WO2014190951A1 (en) System and method for mapping occluded area
WO2015178661A1 (en) Method and apparatus for processing input using display
WO2016076568A1 (en) Display apparatus and control method thereof
WO2014104727A1 (en) Method for providing user interface using multi-point touch and apparatus for same
AU2012214993A1 (en) Method and apparatus for providing graphic user interface in mobile terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13793991

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2013793991

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2015513898

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE