GB2468891A

GB2468891A - Varying an image on a touch screen in response to the size of a point of contact made by a user

Info

Publication number: GB2468891A
Application number: GB0905151A
Authority: GB
Inventors: Ian Summers
Original assignee: NEC Corp
Current assignee: NEC Corp
Priority date: 2009-03-26
Filing date: 2009-03-26
Publication date: 2010-09-29
Also published as: GB0905151D0

Abstract

An image displayed on a touchscreen is varied (re-sized) according to the size of a point of contact made by a user (using a stylus or digit i.e. finger or thumb) on the screen. For example, the size 28 of an icon (e.g. a button) displayed on the touch screen may be determined with reference to the size of a user's finger or thumb 26. The size of the point of contact may also determine the age of a user and therefore the actual subject platter displayed.

Description

TOUCH SCREEN

The present invention relates to a touch screen and in particular, but not exclusively, to a touch screen comprising a user interface for an electronic device.

Touch screens have be widely developed and employed particularly as user interfaces for a wide variety of electronic devices and apparatus and are generally arranged to display images of, for example, control elements which a user can touch in order to achieve the required control of the device and/or screen.

In this manner for example, user-applications of the device can be selected and enabled and operational functionality, such as brightness and volume control, or movement of a displayed image, can be achieved.

However, limitations exist concerning the ease and efficiency with which such touch screens can be employed primarily since the control elements, whether displayed buttons or icons etc are generally displayed to a predetermined size, or to one of a selection of predetermined sizes. This can prove disadvantageously limiting for example if the control elements are too small, they can prove difficult to select and interact with, whereas if the control elements are too large, there is a related waste of space on the display screen and, further, a limitation in the number of control elements (and related choice) that is available at any one time. The incorrect selection of the control elements if they are found to be too small and in close proximity to one another when displayed on the screen obviously leads to an operation being instigated that was not actually required by the user and which, while itself frustrating, can prove a further disadvantage insofar as a remedial action is then required by the user which consumes not only time, but power required for operation of the device. For a mobile handheld device in particular this can prove particularly limiting.

Although it has been known to allow a user to choose between, for example, small, medium and large icons and fonts etc, such limited possibilities remain restrictive and clearly sub-optimal and the above mentioned disadvantages and limitations can still remain.

Known arrangements for scaling displayed icons related to a data processing system are known from US 6983424 and US 11/797880. However such devices and arrangements provide no direct relationship between the degree of scaling of the icon and ergonomic characteristics of the user.

The present invention seeks to provide for a touch screen having advantages over known such screens and to a related electronic device employing the same.

According to one aspect of the present invention there is provided a touch screen for forming part of an electronic device and arranged for displaying at least one image thereon, the screen being further arranged for determination of the size of a point of contact by the user with the screen, and to vary the said at least one image responsive to the said determination.

In this manner, the image displayed by the screen can be readily, efficiently and accurately determined upon the basis of a characteristic of the user, for example, the size of their hand, or the size of the end of a finger or thumb, and this then in turn serves to determine a characteristic of the at least one displayed image.

That is, the size of the point of contact by the user with the screen can readily determine the likely age of the user, and thus the actual subject matter displayed, and/or the size and manner of the displayed image.

As a particular advantage, the size of subsequent display elements, and in particular control elements, can be determined responsive to the size of the said point of contact.

In this manner, the subsequent use of the touch screen and/or the device employing the same can be advantageously optimised having regard to, for example, the size of a user's digit.

Advantageously therefore, the screen can be arranged to vary the content of the image responsive to the said determination.

Alternatively or in addition, the screen can be arranged to vary the size of the said image responsive to the said determination.

Preferably, the said at least one image can comprise an alphanumeric display element.

Alternatively, the at least one image can comprise a screen icon and, further, can comprise a screen selection element such as on-screen button or scroll element.

Further, the said at least one image can comprise a pictorial element.

Further, the screen can be arranged to conduct a plurality of measurements in order to determine an average size of the set point of contact.

The plurality of measurements can then be taken over a predetermined time frame.

Advantageously, the said determination of the size of the point of contact can employ the determination of X-Y coordinates of the extremities of an area of contact.

Preferably, the said X-Y coordinates serve to define a closed area representative of the point of contact.

Advantageously, the size of the said at least one image is then arranged to map to the size of the area represented by the X-Y coordinates.

As will be appreciated, the said touch screen can comprise a user interface for an electronic device.

Preferably, the electronic device can comprise a portable device and, in particular, can comprise a hand-held device such as a PDA handset or a mobile phone.

According to another aspect of the present invention there is provided a method of varying at least one image displayed on a touch screen forming part of an electronic display device, the method including the step of determining the size of a point of contact by the user with the screen, and varying said at least one image responsive to the determined size.

As will be appreciated, the method of the present invention can employ a touch screen as defined above.

For example, the method can be arranged for controlling the size of the said image or indeed the image content and which further can, comprise any one or more of an alphanumeric element, screen icon, screen button, and pictorial element.

Yet further, the method can include the steps of executing a plurality of measurements so as to find an average size of the said point of contact.

The said determination of the said point of contact can comprise calculating representative X-Y coordinates thereof Preferably, the X-Y coordinates serve to define the shape of an area representative of the said point of contact.

The method can relate to a user touching the screen by way of their hand, or a digit of their hand, or indeed by way of a stylus-type device.

The invention is described further hereinafter, by way of example only, with reference to the accompanying drawings in which: Figs 1 and 2 comprise schematic representations of a touch screen of a mobile phone handset and illustrating the different sizes of icons that can be provided according to an embodiment of the present invention; Fig 3 is a schematic representation of the touch screen of Figs 1 and 2 and illustrating the responsive variation in icon size; and Figs 4 and 5 provide an illustration of a manner in which an average determination of size of point of contact can be achieved.

Turning first to Fig 1, there is provided a schematic representation of a portable electronic device such as a mobile phone handset 10 employing a touch screen 12 which is arranged to display a plurality of selection elements 14, for example in the form of icons in this illustrated embodiment. Of course, it should be appreciated that rather than screen icons, the selection features could comprise on-screen buttons or indeed scroll features or indeed a single image displayed on the screen with active regions expected to receive user contact.

The specific illustrated example shows six icons 14 illustrated in three rows and with two icons in each row.

As will be appreciated, the size of the screen 12 is such that only a total of six icons 14 can be displayed. This can prove somewhat inefficient, and restrictive, particularly if there are in fact more that six options to be represented by way of the corresponding number of more than six icons.

A principal fcature of the present invention is illustrated by reference to Fig 2 which shows the same mobile phone handset 10, and associated touch screen 12, but this time displaying a set of a total of twenty icons 16.

This array of icons 16 is illustrated in five rows of four icons and it will be immediately apparent from comparison with Fig 1, that the icons 16 illustrated in Fig 2 are smaller than those illustrated in Fig 1. Thus, greater efficiency of screen usage is achieved, and a much larger range of icons can be displayed, so as to offer greater functionality to the user by way of the display of screen 12.

While the specific advantages therefore arise in employing the smaller icon size 16 as illustrated in Fig 2 and as compared with Fig 1, it will however be appreciated that a reduction in size of each icon can possibly lead to related disadvantages concerning the accuracy of which each icon can be selected by the user.

However, in accordance with the concept of the present invention, the actual reduced size of the icons 16 in Fig 2 is determined through reference to the size of a point of contact of a user with the screen 12. In this manner, the size of the reduced icon 16 of Fig 2 is determined by reference to, for example, the size of a user's finger or thumb. Insofar as it is the user's finger or thumb that is employed to determine the final active size of the icons 16 any subsequent use by the user of a screen employing those icons can then readily be achieved with an appropriate degree of accuracy whilst optimising efficient use of the overall screen area.

As will be apparent from the following discussion, this illustrated embodiment of the present invention employs a mapping arrangement within the touch screen serving to map the area of the user's point of contact with the screen, i.e. their thumb or finger, and correlate the same into a series of X-Y coordinates. Such series of coordinates can then be employed to create an icon such as each of the icons 16 in Fig 2, of optimum size for that user.

Turning now to Fig 3, there is provided a schematic representation of use of a touch screen embodying the present invention at the time of configuration of the icon size. It should however be appreciated that this illustrates only one example of the manner of recording a user's contact digit size.

The touch screen 12 of Fig 3 is again represented as part of a mobile phone handset 10 and so includes an upper screen region 18 serving to display remaining battery power, signal strength and current time.

A mode for configuring the screen and related device is discussed further hereinafter but, for general background discussion, it should be appreciated that subsequent to entry into the configuration mode, an end user then employs his/her engagement member for touching the screen so as to commence the sizing operation. Commonly, the end users contact with the screen will create a substantially circular shape with a surface area the centre of which can be readily calculated and, subsequently, a first set of readings/values relating to that first point of contact is obtained.

As will be discussed further below, whilst relative stationary contact between the user's engagement member and the screen is preferred, the invention incorporates the realisation that relative motion between the engagement member and screen is quite likely to occur.

This is likely particularly if the screen is used by the very young, elderly, infirm or indeed while the user is in transit by way of a mode of transport. In such an instance, and as described further below, a series of snap-shot measurements will be taken over a particular time period and an average value for the surface area of contact then calculated.

Of course, as a default, the screen can be arranged to employ a series of snap-shot measurements irrespective or whether or not relative movement between the user's engagement member and the screen might be likely to occur.

As will be readily understood, the screen employs an array of sensors each of which has a unique x-y coordinate address within the overall screen and when the end user makes contact with the screen, an appropriate plurality of such sensors activate, either switching on or off, thereby allowing the screen to detect the presence of the end user's engagement member and, importantly, allow for a determination of the area of contact of the member with the screen.

The activated sensors fall within the "footprint" of the point of contact will therefore map to the end-user's engagement member, for example has a substantially circular or substantially oval region of sensor-activation. It should however be appreciated that any appropriate means of sensor activation can be employed such as inductive, capacitive, or resistive as required.

Although, if a relative movement between the users engagement member and the screen occurs, a path of movement over the screen will be apparent, the present invention focuses merely on the determination of the surface area of each snap-shot as indicated by the activation pattern of the sensors and the x-y coordinate values which are mapped to a point of contact of the engagement member can serve to arrive at average x-y coordinate values for each "snap-shot" measurement so as to arrive at coordinates for an area of average size as determined by the snap-shot readings that is described further below.

As also discussed further below, if relative movement between the engagement member and the screen is readily discernable, a "dynamic factor" can be included into the averaging calculations which will serve to indicate that, a slightly larger than expected icon size might be appropriate given the likely ongoing relative movement between the users engagement member and the screen.

The schematic representation of Fig 3 is provided at the time that the user has entered a "configuration" mode as indicated by the display element 20 and which mode is selected at the time a user wishes to achieve optimum icon size.

Illustrated for ease of reference within Fig 3 is the size of an icon 22 that, for example, is preset with the handset 10.

In order to proceed further with configuration, the user makes appropriate contact with the screen 12 such as illustrated by the user's thumb in Fig 3 at a point of contact 24 which can comprise either a preset location on the screen 12, or indeed any appropriate location once the configuration mode has been entered.

The configuration software is arranged to read the X-Y coordinates of the portion of the screen that is actually touched by the user and which area, and related coordinate dimensions, are illustrated schematically as area 26 within Fig 3.

Thus, the configuration software serves to identify a "virtual box size" represented by the X-Y coordinates of the area of contact 26 and to map the same to the actual dimensions of a displayed icon 28 as illustrated further in Fig 3, Accordingly, the reduced-size of icon 28 can then readily be employed in relation to the touch screen 12 and having regard to "ergonomic features" related to the size of the user's digits. Of course, at any stage the user could return to pre-set image sizes if required.

As mentioned previously with reference to Fig 2, an increased number of such reduced sized icon 16 can then be efficiently displayed within the overall area of screen 12, or of course the same number of icons can be displayed but occupying less of the screen area which can therefore provide screen area for the display of other images.

The user can then advantageously interact with more icons within the screen area thereby reducing the need to scroll through various screens in order to display the full range of icons. The number of controlled operations required of the user and associated power consumption, is therefore advantageously reduced.

As will be appreciated from the foregoing, a period of stationery contact between the user's thumb and the screen 12 is preferred so as to arrive at an accurate determination of the "virtual box size" for subsequent sizing of an icon 28. Of course, reference here to a "virtual box" is merely as an example and any appropriate shape can be employed for sizing purposes. However, it is appreciated that various scenarios may well arise in which relative movement between the user's digit and the screen 28 is unavoidable such as when, for example, the user is en route to a destination or, for example, if the user is either very young, old, or in some way impaired of injured.

The invention can then be arranged to take a series of coordinate readings over a predetermined time which can then be averaged so as to arrive at an average "virtual box size" for subsequent icon magnification/reduction.

An example of such an operation is illustrated with reference to Figs 4 and 5.

Turning first to Fig 4 there is illustrated a path of movement of a user's thumb over the screen over a period of time that is divided into eleven segments identified at 1-lI within Fig 4.

As will be appreciated, the manner of movement of the user's thumb over the screen follows substantially has an inverted "S" path and this relates to a series of eleven separate representations 32 of the area of the point of contact 26 as illustrated in Fig 5.

The determination of the "virtual box size" for each of the eleven readings is then made and appropriate average figure calculated so as to arrive at an average representation 26' for the area of contact and employing average X-Y coordinates AvgX and AvgY as also indicated in Fig 5.

Once the processing within the handset has arrived at the average X-Y coordinates representing the average area of contact 26', this value can be employed as noted above in determining the size of the icons to be displayed.

It should also be appreciated that the invention can be made responsive to movement of the user's thumb relative to the screen 12 during the configuration process.

That is, if no relative movement occurs, the sizing operation illustrated by reference to Fig 3 is simply pursued. If however, movemcnt is detected, in an average value can be calculated through the determination of, for example, eleven separate values as illustrated with reference to Figs 4 and 5. Also, if relative movement is determined, the touch screen of the present invention can readily determine that a slightly larger than usual icon might be appropriate for that particular user so as to reflect an apparent lack of accuracy with which they seem to use the device.

Thus, the actual size of the icon can to some extent also be determined having regard to any relative movement within the user's thumb and the screen that is identified.

It should of course be appreciated that the invention is not limited to the display, and sizing of any particular image on the touch screen.

For example, while the size of any particular element of the display, for example displayed icon, screen-button, scroll bar etc can be controlled in accordance with the present invention, the actual display of a non-interactive, and merely graphic display element, can likewise be selected having regard to the area of interaction between the user and the screen.

Such area of interaction is currently primarily employed to provide an estimate of the user's age such that the content of the imagery and/or text to be displayed on the device is thereby determined, restricted or in some other way controlled.

It should of course be appreciated that the invention is not restricted to use in relation to handset devices but could be readily employcd in relation to tablets, PCs, touch screen LCDs and indeed any particular device employing a touch screen. Also, the screen can be arranged to allow for image sizes only between maximum and minimum values which could be dictated.

It should also be appreciated that the reference to a touch screen throughout the present application also encompasses interface device such as touch pads that may be enhanced with variable display functionality even if only limited image options are available.

However employed, the present invention is particularly advantageous in the manner in which is can meet a user's ergonomic requirements, and the manner in which it maps a users anthropometrical data for subsequent use of the touch screen.

Claims

CLAIMS1. A touch screen for forming part of an electronic device and arranged for displaying at least one image thereon, the screen being further arranged for determination of the size of a point of contact by the user with the screen, and to vary said at least one image responsive to the said determination.
2. A touch screen as claimed in Claim 1 and is arranged to vary the content of the image responsive to the said determination.
3. A touch screen as claimed in Claim I or 2, and arranged to vary the size of the said image responsive to the said determination.
4. A touch screen as claimed in Claim 1, 2 or 3, and wherein the said at least one image comprises one or more of an alphanumeric display element, a screen icon button and/or scroll element.
5. A touch screen as claimed in any one or more of Claims I to 4, and arranged to enable a plurality of measurements in order to determine an average size of the said point of contact.
6. A touch screen as claimed in Claim 5 and arranged further to vary thc said at least one image responsive to a determination of relative movement between the said point of contact by the user and the said screen.
7. A touch screen as claimed in Claim 6, wherein the size of the said at least one image is varied responsive to the magnitude of the said relative movement.
8. A touch screen as claimed in any one or more of the preceding claims wherein the said determination of the size of the point of contact can employ determining X-Y coordinates of the extremities of an area of contact.
9. A touch screen as claimed in Claim 8, and arranged to map the said at least one image to an area represented by the said X-Y coordinates.
10. An electronic device including a touch screen as claimed in any one or more of the preceding claims.
11. A method of varying at least one image displayed on a touch screen forming part of an electronic display device, the method including the step of determining the size of a point of contact by the user with the screen, and varying said at least one image responsive to the determined size.
12, A method as claimed in Claim 11 and employing a touch screen as claimed in any one or more of Claims 2 to 10.
13. A touch screen is hereinbefore described with reference to, and as illustrated in, Figs 2-3 of the accompanying drawings.
14. A method of controlling at least one image displayed on a touch screen and substantially is hereinbefore described with reference to Figs 3-5 of the accompanying drawings.