WO2019186201A1 - Display apparatus - Google Patents

Display apparatus Download PDF

Info

Publication number
WO2019186201A1
WO2019186201A1 PCT/GB2019/050931 GB2019050931W WO2019186201A1 WO 2019186201 A1 WO2019186201 A1 WO 2019186201A1 GB 2019050931 W GB2019050931 W GB 2019050931W WO 2019186201 A1 WO2019186201 A1 WO 2019186201A1
Authority
WO
WIPO (PCT)
Prior art keywords
motion
information
display screen
display
erase
Prior art date
Application number
PCT/GB2019/050931
Other languages
French (fr)
Inventor
Maria Francisca Jones
Original Assignee
Maria Francisca Jones
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Maria Francisca Jones filed Critical Maria Francisca Jones
Priority to CN201980029053.7A priority Critical patent/CN112041792A/en
Priority to SG11202009633PA priority patent/SG11202009633PA/en
Priority to KR1020207031286A priority patent/KR20210002509A/en
Priority to EP19717550.8A priority patent/EP3776150A1/en
Priority to JP2020552779A priority patent/JP7379364B2/en
Publication of WO2019186201A1 publication Critical patent/WO2019186201A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1694Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/166Editing, e.g. inserting or deleting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/166Editing, e.g. inserting or deleting
    • G06F40/171Editing, e.g. inserting or deleting by use of digital ink

Definitions

  • the present invention relates to a display apparatus for displaying erasable information.
  • Display apparatuses are used in a wide range of portable and moveable devices, such as mobile telephones, tablet computer devices and laptops.
  • portable and moveable devices such as mobile telephones, tablet computer devices and laptops.
  • the challenges for the designers of portable devices is to design a display apparatus that is light, battery efficient and convenient to use.
  • the present invention provides display apparatus comprising a display screen to display information in a plurality of different regions; a memory to store information for display on the different regions of the display screen; a motion detecting arrangement to detect motion of the display apparatus; and a processor programmed to control the display of the information on the display screen in the different regions and responsive to motion detected by the motion detecting arrangement, to control the display screen to erase at least a part of the information displayed on the display screen, wherein the motion detecting arrangement is configured to detect a plurality of motion types, and the processor is programmed to identify the detected motion types and to selectively erase information displayed on the display screen in the different regions in dependence upon the identified motion types.
  • the present invention also provides a method of controlling a display apparatus having a display screen and a motion detector arrangement to detect motion, the method comprising displaying information on the display screen in a plurality of different regions; detecting a plurality of types of motion of the display apparatus; and selectively erasing information displayed on the display screen in different regions in dependence upon the detected motion types.
  • the present invention also provides a display apparatus comprising a display screen to display a plurality of types of information; a memory to store information for display on the display screen; a motion detecting arrangement to detect motion of the display apparatus; and a processor programmed to control the display of the information on the display screen to display the different information types and responsive to motion detected by the motion detecting arrangement, to control the display screen to erase at least a part of the information displayed on the display screen, wherein the motion detecting arrangement is configured to detect a plurality of motion types, and the processor is programmed to identify the detected motion types and to selectively erase information types displayed on the display screen in dependence upon the identified motion types.
  • the present invention also provides a method of controlling a display apparatus having a display screen and a motion detector arrangement to detect motion, the method comprising displaying information of a plurality of different information types on the display screen; detecting a plurality of types of motion of the display apparatus; and selectively erasing information types displayed on the display screen in dependence upon the detected motion types.
  • the present invention also provides a display apparatus comprising a display screen to display information; a memory to store motion type erase data comprising identifications of motion types and corresponding erase operations, and information for display on the display screen; a motion detecting arrangement to detect motion of the display apparatus; a user input arrangement to receive a user input identifying erase operations during a learning phase; and a processor programmed, in the learning phase when a user input is received identifying a control operation, to identify a motion type from motion detected by the motion detecting arrangement and to store the received user input in correspondence with data identifying the motion type in the motion type erase data, and, subsequent to the learning phase when the motion detecting arrangement detects motion, to use the motion type erase data to identify a motion type and execute the corresponding erase operation to erase at least a part of the information displayed on the display screen.
  • the present invention also provides a method of controlling a display apparatus having a motion detector arrangement to detect motion of the device, the method comprising, during a learning phase: receiving a user input identifying an erase operation; detecting motion of the display apparatus using the motion detector arrangement; identifying a motion type from the motion detected by the motion detecting arrangement; storing the received user input in correspondence with data identifying the motion type as motion type erase data; and repeating the receiving, detecting, identifying and storing steps; and in an operation phase: displaying information on a display screen; detecting motion of the display apparatus using the motion detector arrangement; and using the motion type control data to identify a motion type and execute the corresponding erase operation to erase at least a part of the information displayed on the display screen.
  • Figure 1 is a schematic diagram illustrating an example display apparatus
  • Figure 2 is a schematic diagram illustrating an alternative display of an example display apparatus
  • Figure 3 is a flow diagram illustrating an example learning phase
  • Figure 4 is a flow diagram illustrating an example operational phase
  • Figure 5 is a schematic diagram illustrating the electronic components of an example display apparatus.
  • data store or memory is intended to encompass any computer readable storage medium and/or device (or collection of data storage mediums and/or devices).
  • data stores include, but are not limited to, optical disks (e.g., CD-ROM, DVD-ROM, etc.), magnetic disks (e.g., hard disks, floppy disks, etc.), memory circuits (e.g., solid state drives, random-access memory (RAM), etc.), and/or the like.
  • the functions or algorithms described herein are implemented in hardware, software or a combination of software and hardware in one embodiment.
  • the software comprises computer executable instructions stored on computer readable carrier media such as memory or other type of storage devices.
  • described functions may correspond to modules, which may be software, hardware, firmware, or any combination thereof. Multiple functions are performed in one or more modules as desired, and the embodiments described are merely examples.
  • the software is executed on a digital signal processor, ASIC, microprocessor, or other type of processor.
  • Some embodiments implement the functions in two or more specific interconnected hardware modules or devices with related control and data signals communicated between and through the modules, or as portions of an application- specific integrated circuit.
  • the exemplary process flow is applicable to software, firmware, and hardware implementations.
  • a generalized embodiment provides a display apparatus comprising a display screen to display information; a memory to store information for display on the display screen; a motion detecting arrangement to detect motion of the display apparatus; and a processor programmed to control the display of the information on the display screen and responsive to motion detected by the motion detecting arrangement, to control the display screen to erase at least a part of the information displayed on the display screen, wherein the motion detecting arrangement is configured to detect a plurality of motion types, and the processor is programmed to identify the detected motion types and to selectively erase information displayed on the display screen in dependence upon the identified motion types.
  • the invention is suited to portable display apparatus but is not limited to such.
  • the display apparatus is applicable to any display apparatus that can be moved in a reciprocal, rotational or shaking motion. Such a display apparatus is typically portable and wireless but could be simply moveable and connected by wires.
  • the display apparatus could be part of another apparatus and removeable therefore in use to allow for the shaking, rotating or reciprocating motion to be effected by a user to erase displayed information.
  • the display could be rigid or flexible.
  • the display may be detachable. There could be more than one display and the displays can be of different types, e.g. one flexible and one rigid.
  • at least a part of the information displayed on the display screen is erased in response to shaking or reciprocating motion detected by the motion detecting arrangement that is greater than a threshold. This avoids unintentional erasing of displayed information due to a jolt of the display apparatus, for example while travelling in a car, train or airplane. The erasing of information can require more vigorous movement to initiate the erasing.
  • the erasing of the displayed information also causes the information to be erased or deleted in memory at least for the set of information being displayed, so that the action is equivalent to a delete key on a keyboard (although the information may still be resident in memory to allow an unerase operation).
  • the motion may be detected in multiple directions, and a direction of the shaking or reciprocating motion can be detected to selectively erase information displayed on the display screen.
  • the apparatus can be programmed, or the user can select, so that certain directions of motion of the display apparatus or certain types of motion of the display apparatus, such as different patterns of motion, can cause different erase operations.
  • the different erase operations can relate to erase operations in different screen regions, such as frames on a web page or input regions in an application executing on the display apparatus, or to the erasing of different displayed information types.
  • one type of motion or a different direction of motion may cause the erasing of a displayed image, another the erasing of typed text, another the erasing of handwritten text, another the erasing of a table or spreadsheet, etc.
  • Types of motion that the user can use for erase operations can comprise the shaking or reciprocating motion of the display apparatus can be any of a rectilinear, motion, a reciprocating motion, a rotational motion, swaying motion, see-sawing motion, swinging motion or rocking motion for example.
  • the displacement or amplitude of the‘shake’, the frequency or rate of the ‘shake’ and/or the velocity or vigour or the ‘shake’ can also be components of the type of motion of the display apparatus.
  • the motion can comprise a complex mix or aggregation of motions or motion types e.g. a rotation simultaneously with a shake, or a sequence of motions e.g.
  • the display apparatus can be programmed to allow the user to teach it motion types and erase operations to implement in response to the detected motion type.
  • the display apparatus may display erase options in a learning or startup phase, with the request to the user to initiate a desired motion type to be used for that erase operation.
  • the user may be required to perform the operation a few times for the processor to implement a learning process to learn and store the motion type corresponding to a selected erase operation.
  • the motion types and erase operations can be learned for individual users. For example, a user could enter their name or sign in to use the display apparatus and the learnt motion types and erase operations are then stored for that user for use when the user enters their name or signs in.
  • the display apparatus in one example can include an input arrangement to receive an input for the display of information.
  • the input arrangement can comprise a touch sensitive display and/or a pen.
  • a pen allows a user to input handwritten text and drawings.
  • a carrier medium such as a non-transient storage medium storing code for execution by a processor of a machine to carry out the method, or a transient medium carrying processor executable code for execution by a processor of a machine to carry out the method.
  • Embodiments can be implemented in programmable digital logic that implements computer code. The code can be supplied to the programmable logic, such as a processor or microprocessor, on a carrier medium.
  • a carrier medium is a transient medium i.e. a signal such as an electrical, electromagnetic, acoustic, magnetic, or optical signal.
  • Another form of carrier medium is a non-transitory storage medium that stores the code, such as a solid-state memory, magnetic media (hard disk drive), or optical media (Compact disc (CD) or digital versatile disc (DVD)).
  • the display apparatus can, in one example, be used as the display unit in any of the examples of the display apparatus disclosed in co-pending application GB 1722249.8 filed on 29 th December 2017, the contents of which is hereby incorporate by reference in its entirety or with the device disclosed in co-pending UK patent application entitled“Device Operation Control” filed on the same date as this application, the contents of which is hereby incorporate by reference in its entirety.
  • FIG. 1 is a schematic diagram illustrating a display apparatus.
  • the display apparatus 2 comprises a display screen 1 capable of displaying information.
  • the display screen is displaying three types of information, namely typed text 11, handwritten text 41 and an image 31.
  • the information can be displayed by any application executing on the apparatus, such as a web browser, email application, word processor, spreadsheet, image editor etc.
  • the displayed information can for example be a document or form that has regions to be completed or filled in, e.g. an address region and a name region in a standard form letter, or fields in a form.
  • the handwritten text can be input using a pen device 50.
  • the screen display 1 can be sensitive to the proximity of the pen device 50 to detect the coordinates of the pen device 50 to track its location and hence to generate the input handwritten text 41.
  • the display screen 1 can be touch sensitive to allow for input of information and commands to the display apparatus e.g. by the display of touch sensitive options and/or a keyboard.
  • the motion directions that the display apparatus can experience as a method of erasing displayed information can be a back and forth linear or reciprocating motion in any of three directions along three axes x, y and z in three dimensions as shown by the intersecting arrows. Also, or alternatively, the motion can be non-linear, curved or rotational as shown by the curved arrows.
  • a motion of the display apparatus can erase all of the displayed information or selective parts, such as one or more of the typed text 11, the handwritten text 41 or the image 31.
  • Figure 2 illustrates an alternative display screen 20 of a display apparatus.
  • a typed text display region 10 with displayed typed text 11 an image display region 30 displaying an image 31, and a handwritten text display region 40 displaying handwritten text 41, created using a pen 50.
  • the motion of the display apparatus of this example can be a back and forth linear or reciprocating motion in any of three directions along three axes x, y and z in three dimensions as shown by the intersecting arrows of figure 1. Also, or alternatively, the motion can be non-linear, curved or rotational as shown by the curved arrow in figure 1.
  • a motion of the display apparatus can erase all of the displayed information or selective parts, such as information in one or more of the display regions 10, 30 and 40.
  • a motion type detected by a motion detecting arrangement of the display apparatus can detect any one of a plurality of types of patterns of motion in any dimension or direction.
  • Examples of different patterns of motion are: shaking back and forth, shaking side to side, shaking up and down, turning side to side (tilting side to side), turning up and down (tilting up and down) and rotating.
  • Each of these represents a lateral (shaking) or rotational movement along or about one of the three axes illustrated in figure 1. It is possible to detect two types of each of these motion types, based on the starting motion. For example, back and forth could be back and forth or forth and back, side to side could be left to right or right to left, rotating could be clockwise or anticlockwise rotating etc.
  • the memory of the display apparatus can store a set of erase commands to implement by the processor for each type of motion detected by the motion detecting arrangement and identified by the processor from the signal from the motion detecting arrangement. These commands can be predefined or downloaded from a data source or they can be user defined.
  • the display apparatus can be programmed to allow the user to teach it motion types and erase operations to implement in response to the detected motion type.
  • the display apparatus may display erase options in a learning or startup phase, with the request to the user to initiate a desired motion type to be used for that erase operation.
  • the user may be required to perform the operation a few times for the processor to implement a learning process to learn and store the motion type corresponding to a selected erase operation.
  • the display apparatus then stores a pattern of detected motion for each erase operation to be used in future motion detection operations for the execution of erase operations.
  • Figure 3 is a flow diagram illustrating a learning phase of the display apparatus.
  • step S 1 the display apparatus enters the learning phase. This can be automatic on start-up of the display apparatus or as a result of some other operation of the display apparatus, or it can be as a result of a user selection i.e. a use input, such as using an input arrangement of the display apparatus.
  • step S2 a display of the display apparatus displays a menu of define control operations that a user can choose to execute using motion as a user input.
  • the displayed menu can simply be a list, or a drop-down menu for example.
  • the list could be organized into categories of types of erase operations, e.g. erase one letter, erase one word, erase text, erase all text in a display region or frame, erase image, erase displayed history data, erase in a frame or display region, etc.
  • step S3 a user selection of an erase operation menu item is received and then in step S4, the display apparatus waits for the motion detector arrangement e.g. an accelerometer, to detect motion of the display apparatus.
  • the motion is recorded over a short period of time appropriate to capture the motion pattern e.g. 1-2 seconds.
  • step S5 the process loops back to require the user to repeat the motion input a number (N) times e.g. anything from 3 to 10 times. More iterations improve the accuracy of the matching process but reduces the usability of the display apparatus: a user will lose patience with a requirement to repeat the motion pattern too many times.
  • step S6 the recorded motion patterns for the repeated recordings are averaged and the average is used in step S7 for storage as part of the information on the motion type in the stored motion type erase data.
  • Data indicating the degree of deviation between the recorded motion patterns can also be stored as part of the motion type data to assist with the matching process during the operational phase i.e. to assist with assessing whether a match lies within an expected deviation of a stored average motion pattern.
  • An identifier identifying the corresponding erase operation is also stored as part of the stored motion type erase data.
  • step S2 The process will then return to step S2 to allow the user to select another erase operation from the menu. If the user has finished selecting erase operations, a user can select to exit the learning phase.
  • Figure 4 is a flow diagram illustrating an operational phase of the display apparatus following the learning phase.
  • step S 10 the display device enters the operational phase and in step S l l information is displayed on a display screen.
  • the information can be displayed in different regions, such as frames or windows, as shown in figures 1 and 2.
  • the displayed information can also be of different information types, e.g. text or images.
  • Motion of the display apparatus is detected in step S 12.
  • the pattern of motion is compared with the stored patterns for the motion type in the motion type erase data in step S 13 to determine if the motion matches a motion type. If no match is found (step S 14), the process returns to step S 12 to detect further motion.
  • step S 15 a corresponding erase operation is identified in the motion type erase data and in step S 16 the erase operation is executed.
  • the erase operation matched may be an operation to erase information in one of the regions or to erase an information type such as text or images.
  • the process then returns to step S 12 to detect the next motion of the device for further control operations.
  • an average of motion data for a number of recorded motion operations is taken.
  • the invention is not restricted to taking an average and only one motion detection may be used, or a number may be recorded and they can be stored individually for individual matching with a motion pattern during the operation phase.
  • a user is presented with a menu to select an erase operation to teach the display apparatus the motion type for that erase operation.
  • the user may also be able to define their own erase operation using the user input arrangement.
  • the display apparatus may automatically, e.g. on start-up, enter the learning phase and require the user to enter a sequence of motion types for a sequence of control operations.
  • the motion types and erase operations can be learned for individual users. For example, a user could enter their name or sign in to use the display apparatus and the learnt motion types and erase operations are then stored for that user for use when the user enters their name or signs in.
  • Figure 5 is a schematic diagram illustrating the electronic components of an example display apparatus.
  • a processor 100 is connected to static or non-volatile memory 102 storing code used by the processor 100, such as operating system code and for the storage of data and information for display in a non-volatile manner.
  • Volatile memory 103 is provided for the storage of application code for implementation by the processor 100 and data and information for display and for erase control.
  • the volatile memory can store code (e.g. a code module) comprising code for identifying motion patterns detected by the motion sensor 104, and code (e.g. a code module) for controlling a display screen 105 in response to erase displayed information.
  • the display screen 105 is connected to the processor 100 for the display of information.
  • the display screen 105 can comprise a touch sensitive display to provide an input arrangement.
  • a pen 50 shown in figure 1 can be used with the display screen 105 to allow for the input of freehand text or drawings.
  • a camera 106 can also optionally be connected to the processor 100 to capture images. The camera 106 can also be used as an input arrangement for the input of information and commands using gesture recognition implemented by the processor on the images captured by the camera 106.
  • a network connector 101 is connected to the processor 100 for communication with a communications or computer network. This communication link can pass data, information and controls between the display apparatus and other display apparatuses or computers over the network.
  • the network connector 101 can be connected to a communications or computer network using a wired or wireless connection.
  • a wired connection could be an ethernet connection to a LAN or a telephone connection, such that the network connector 101 acts as a modem or router.
  • a wireless connection could be WIFI, WiMAX, CDMA, GSM, GPRS, wireless local loop or WAN.
  • BluetoothTM may be used.
  • a motion sensor 104 is connected to the processor 100 to detect motion of the display apparatus.
  • the motion sensor 104 can comprise any conventional motion sensor, such as an accelerometer.
  • the motion sensor 104 is capable of detecting motion of the display apparatus in any direction i.e. it is a multi-axis motion sensor to detect motion along any of three orthogonal axes in three dimensions.
  • the display apparatus may have a display screen on both sides, so that it can be turned over to view information on both sides.
  • the erase operation could apply to both sides or to just one side. This, in one example, can be selectively set.
  • the display or displays can also be detached from a mount frame.
  • the display apparatus can comprise a docking part or mount to which a display screen is mounted in a detachable or demountable manner so that the display screen can be used separately from the mount.
  • the mount and display screen can communicate between each other using a wireless link so that the mount can contain some components of the display apparatus, such as the processor and storage, while the display screen can contain only those components necessary to operate the display screen, detect motion of the display screen, and the communicate with the processor.
  • more than one display screen can be provided detachable from a mount, with each display screen operating independently to provide the erase operation by motion detection using a shared processor in the mount.
  • the display apparatus can include one or more loudspeakers for audio output and one or more microphones for audio input. Also, the display apparatus can connect to a peripheral device such as a keyboard and/or pointing device by a wired or wireless connection to allow for input of information and commands to the display apparatus. [0060] In any of the examples above, the display apparatus can include other input arrangements, such as a keyboard, pointer device (e.g. a mouse), or a touch screen, to enable a user to input controls and information in conjunction with the motion detection control input method. The input arrangement can also be used to perform conventional erase operations to supplement the motion erase capability of the display apparatus, e.g. keyboard deletions, selections of text and displayed deletion operations, etc. Also, a camera can be provided to allow image capture to enable gesture input as a method of control or information input.
  • a peripheral device such as a keyboard and/or pointing device by a wired or wireless connection to allow for input of information and commands to the display apparatus.
  • the display apparatus can include other input arrangements, such as
  • a camera in addition to or alternatively to the motion control input, can be provided in the apparatus to capture video in a direction facing the user so that the user can use gestures to control the erasing of information displayed on the display screen in dependence upon the type of identified gesture.
  • the gesture control can comprise the recognition of movements of a user’s body parts i.e. hands, facial features or the overall body position or the recognition of an object moved by the user, such as a stick, ruler or something worn by the user.
  • Pattern recognition techniques can be used to recognize the type of gestures and to identify them.
  • Example gesture types can include sweeping of a hand to the left or right, or up or down, or a waving of a hand.
  • the gesture control erase operation can be used, for example, where the user is unable to pick up the display apparatus, e.g. they have wet or dirty hands.
  • the display screen can be controlled to be responsive to the detected gesture type and to identify a comparable or associated motion type that controls the same erase operation and to control the display screen to cause the display screen to mimic the motion equivalent command to the gesture command. For example, if the motion command to erase text in a display region is a left to right rotation, when an equivalent or associated gesture command e.g. waving the hand from left to right, is identified, the display screen can cause the display to rotate from left to right to act as a confirmation back to the user that the gesture command has been recognized as the motion command.
  • the invention provides gesture control instead of motion control.
  • the display apparatus can comprise a display screen to display information; a memory to store information for display on the display screen; a gesture detecting arrangement to detect a gesture (e.g. a camera and recognition software); and a processor programmed to control the display of the information on the display screen and responsive to gesture detected by the gesture detecting arrangement, to control the display screen to erase at least a part of the information displayed on the display screen, wherein the gesture detecting arrangement is configured to sense a plurality of gesture types, and the processor is programmed to identify the sensed gesture types and to selectively erase information displayed on the display screen in dependence upon the identified gesture types.
  • the gesture recognition operates in the same way as the motion detection and hence, in the motion detection examples described herein above, motion can be replaced with gesture in this aspect.
  • the display apparatus can be mobile or fixed/attached.
  • a camera can be provided in the apparatus to capture video in a direction facing the user so that the user can use gestures to control the erasing of information displayed on the display screen in dependence upon the type of identified gesture.
  • the gesture control can comprise the recognition of movements of a user’s body parts i.e. hands, facial features or the overall body position. Pattern recognition techniques can be used to recognize the type of gestures and to identify them.
  • Example gesture types can include sweeping of a hand to the left or right, or up or down, or a waving of a hand.

Abstract

Display apparatus comprises a display screen to display information, a memory to store information for display on the display screen, a motion detecting arrangement to detect motion of the display apparatus, and a processor programmed to control the display of the information on the display screen and responsive to motion detected by the motion detecting arrangement, to control the display screen to erase at least a part of the information displayed on the display screen, wherein the motion detecting arrangement is configured to sense a plurality of motion types, and the processor is programmed to identify the sensed motion types and to selectively erase information displayed on the display screen in dependence upon the identified motion types.

Description

DISPLAY APPARATUS
FIELD OF THE INVENTION
[0001] The present invention relates to a display apparatus for displaying erasable information.
BACKGROUND INFORMATION
[0002] Display apparatuses are used in a wide range of portable and moveable devices, such as mobile telephones, tablet computer devices and laptops. The challenges for the designers of portable devices is to design a display apparatus that is light, battery efficient and convenient to use.
SUMMARY OF THE INVENTION
[0003] The present invention provides display apparatus comprising a display screen to display information in a plurality of different regions; a memory to store information for display on the different regions of the display screen; a motion detecting arrangement to detect motion of the display apparatus; and a processor programmed to control the display of the information on the display screen in the different regions and responsive to motion detected by the motion detecting arrangement, to control the display screen to erase at least a part of the information displayed on the display screen, wherein the motion detecting arrangement is configured to detect a plurality of motion types, and the processor is programmed to identify the detected motion types and to selectively erase information displayed on the display screen in the different regions in dependence upon the identified motion types.
[0004] The present invention also provides a method of controlling a display apparatus having a display screen and a motion detector arrangement to detect motion, the method comprising displaying information on the display screen in a plurality of different regions; detecting a plurality of types of motion of the display apparatus; and selectively erasing information displayed on the display screen in different regions in dependence upon the detected motion types.
[0005] The present invention also provides a display apparatus comprising a display screen to display a plurality of types of information; a memory to store information for display on the display screen; a motion detecting arrangement to detect motion of the display apparatus; and a processor programmed to control the display of the information on the display screen to display the different information types and responsive to motion detected by the motion detecting arrangement, to control the display screen to erase at least a part of the information displayed on the display screen, wherein the motion detecting arrangement is configured to detect a plurality of motion types, and the processor is programmed to identify the detected motion types and to selectively erase information types displayed on the display screen in dependence upon the identified motion types.
[0006] The present invention also provides a method of controlling a display apparatus having a display screen and a motion detector arrangement to detect motion, the method comprising displaying information of a plurality of different information types on the display screen; detecting a plurality of types of motion of the display apparatus; and selectively erasing information types displayed on the display screen in dependence upon the detected motion types.
[0007] The present invention also provides a display apparatus comprising a display screen to display information; a memory to store motion type erase data comprising identifications of motion types and corresponding erase operations, and information for display on the display screen; a motion detecting arrangement to detect motion of the display apparatus; a user input arrangement to receive a user input identifying erase operations during a learning phase; and a processor programmed, in the learning phase when a user input is received identifying a control operation, to identify a motion type from motion detected by the motion detecting arrangement and to store the received user input in correspondence with data identifying the motion type in the motion type erase data, and, subsequent to the learning phase when the motion detecting arrangement detects motion, to use the motion type erase data to identify a motion type and execute the corresponding erase operation to erase at least a part of the information displayed on the display screen.
[0008] The present invention also provides a method of controlling a display apparatus having a motion detector arrangement to detect motion of the device, the method comprising, during a learning phase: receiving a user input identifying an erase operation; detecting motion of the display apparatus using the motion detector arrangement; identifying a motion type from the motion detected by the motion detecting arrangement; storing the received user input in correspondence with data identifying the motion type as motion type erase data; and repeating the receiving, detecting, identifying and storing steps; and in an operation phase: displaying information on a display screen; detecting motion of the display apparatus using the motion detector arrangement; and using the motion type control data to identify a motion type and execute the corresponding erase operation to erase at least a part of the information displayed on the display screen.
BRIEF DESCRIPTION OF THE DRAWINGS
[0009] Figure 1 is a schematic diagram illustrating an example display apparatus;
[0010] Figure 2 is a schematic diagram illustrating an alternative display of an example display apparatus;
[0011] Figure 3 is a flow diagram illustrating an example learning phase;
[0012] Figure 4 is a flow diagram illustrating an example operational phase; and
[0013] Figure 5 is a schematic diagram illustrating the electronic components of an example display apparatus.
DETAILED DESCRIPTION
[0014] In the following detailed description, reference is made to the accompanying drawings that form a part hereof, and in which is shown by way of illustration specific embodiments in which the inventive subject matter may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice them, and it is to be understood that other embodiments may be utilized, and that structural, logical, and electrical changes may be made without departing from the scope of the inventive subject matter. Such embodiments of the inventive subject matter may be referred to, individually and/or collectively, herein by the term“invention” merely for convenience and without intending to voluntarily limit the scope of this application to any single invention or inventive concept if more than one is in fact disclosed.
[0015] The following description is, therefore, not to be taken in a limited sense, and the scope of the inventive subject matter is defined by the appended claims and their equivalents.
[0016] In the following embodiments, like components are labelled with like reference numerals.
[0017] In the following embodiments, the term data store or memory is intended to encompass any computer readable storage medium and/or device (or collection of data storage mediums and/or devices). Examples of data stores include, but are not limited to, optical disks (e.g., CD-ROM, DVD-ROM, etc.), magnetic disks (e.g., hard disks, floppy disks, etc.), memory circuits (e.g., solid state drives, random-access memory (RAM), etc.), and/or the like.
[0018] The functions or algorithms described herein are implemented in hardware, software or a combination of software and hardware in one embodiment. The software comprises computer executable instructions stored on computer readable carrier media such as memory or other type of storage devices. Further, described functions may correspond to modules, which may be software, hardware, firmware, or any combination thereof. Multiple functions are performed in one or more modules as desired, and the embodiments described are merely examples. The software is executed on a digital signal processor, ASIC, microprocessor, or other type of processor.
[0019] Some embodiments implement the functions in two or more specific interconnected hardware modules or devices with related control and data signals communicated between and through the modules, or as portions of an application- specific integrated circuit. Thus, the exemplary process flow is applicable to software, firmware, and hardware implementations.
[0020] A generalized embodiment provides a display apparatus comprising a display screen to display information; a memory to store information for display on the display screen; a motion detecting arrangement to detect motion of the display apparatus; and a processor programmed to control the display of the information on the display screen and responsive to motion detected by the motion detecting arrangement, to control the display screen to erase at least a part of the information displayed on the display screen, wherein the motion detecting arrangement is configured to detect a plurality of motion types, and the processor is programmed to identify the detected motion types and to selectively erase information displayed on the display screen in dependence upon the identified motion types.
[0021] The invention is suited to portable display apparatus but is not limited to such.
The display apparatus is applicable to any display apparatus that can be moved in a reciprocal, rotational or shaking motion. Such a display apparatus is typically portable and wireless but could be simply moveable and connected by wires. The display apparatus could be part of another apparatus and removeable therefore in use to allow for the shaking, rotating or reciprocating motion to be effected by a user to erase displayed information. The display could be rigid or flexible. The display may be detachable. There could be more than one display and the displays can be of different types, e.g. one flexible and one rigid. [0022] In one example, at least a part of the information displayed on the display screen is erased in response to shaking or reciprocating motion detected by the motion detecting arrangement that is greater than a threshold. This avoids unintentional erasing of displayed information due to a jolt of the display apparatus, for example while travelling in a car, train or airplane. The erasing of information can require more vigorous movement to initiate the erasing.
[0023] In one example, the erasing of the displayed information also causes the information to be erased or deleted in memory at least for the set of information being displayed, so that the action is equivalent to a delete key on a keyboard (although the information may still be resident in memory to allow an unerase operation).
[0024] The motion may be detected in multiple directions, and a direction of the shaking or reciprocating motion can be detected to selectively erase information displayed on the display screen.
[0025] The apparatus can be programmed, or the user can select, so that certain directions of motion of the display apparatus or certain types of motion of the display apparatus, such as different patterns of motion, can cause different erase operations. For example, the different erase operations can relate to erase operations in different screen regions, such as frames on a web page or input regions in an application executing on the display apparatus, or to the erasing of different displayed information types. For example, one type of motion or a different direction of motion may cause the erasing of a displayed image, another the erasing of typed text, another the erasing of handwritten text, another the erasing of a table or spreadsheet, etc.
[0026] Types of motion that the user can use for erase operations can comprise the shaking or reciprocating motion of the display apparatus can be any of a rectilinear, motion, a reciprocating motion, a rotational motion, swaying motion, see-sawing motion, swinging motion or rocking motion for example. The displacement or amplitude of the‘shake’, the frequency or rate of the ‘shake’ and/or the velocity or vigour or the ‘shake’ can also be components of the type of motion of the display apparatus. The motion can comprise a complex mix or aggregation of motions or motion types e.g. a rotation simultaneously with a shake, or a sequence of motions e.g. a shake followed by a rotation, or a rotation in one direction followed by a rotation in another direction. The sequence of motions can hence be a sequence of the same motion types or different motion types. [0027] The display apparatus can be programmed to allow the user to teach it motion types and erase operations to implement in response to the detected motion type. For example, the display apparatus may display erase options in a learning or startup phase, with the request to the user to initiate a desired motion type to be used for that erase operation. The user may be required to perform the operation a few times for the processor to implement a learning process to learn and store the motion type corresponding to a selected erase operation. The motion types and erase operations can be learned for individual users. For example, a user could enter their name or sign in to use the display apparatus and the learnt motion types and erase operations are then stored for that user for use when the user enters their name or signs in.
[0028] The display apparatus in one example can include an input arrangement to receive an input for the display of information. The input arrangement can comprise a touch sensitive display and/or a pen. A pen allows a user to input handwritten text and drawings.
[0029] One aspect provides a carrier medium, such as a non-transient storage medium storing code for execution by a processor of a machine to carry out the method, or a transient medium carrying processor executable code for execution by a processor of a machine to carry out the method. Embodiments can be implemented in programmable digital logic that implements computer code. The code can be supplied to the programmable logic, such as a processor or microprocessor, on a carrier medium. One such embodiment of a carrier medium is a transient medium i.e. a signal such as an electrical, electromagnetic, acoustic, magnetic, or optical signal. Another form of carrier medium is a non-transitory storage medium that stores the code, such as a solid-state memory, magnetic media (hard disk drive), or optical media (Compact disc (CD) or digital versatile disc (DVD)).
[0030] The display apparatus can, in one example, be used as the display unit in any of the examples of the display apparatus disclosed in co-pending application GB 1722249.8 filed on 29th December 2017, the contents of which is hereby incorporate by reference in its entirety or with the device disclosed in co-pending UK patent application entitled“Device Operation Control” filed on the same date as this application, the contents of which is hereby incorporate by reference in its entirety.
[0031] Specific embodiments will now be described with reference to the drawings.
[0032] Figure 1 is a schematic diagram illustrating a display apparatus. [0033] The display apparatus 2 comprises a display screen 1 capable of displaying information. In this example, the display screen is displaying three types of information, namely typed text 11, handwritten text 41 and an image 31. The information can be displayed by any application executing on the apparatus, such as a web browser, email application, word processor, spreadsheet, image editor etc. The displayed information can for example be a document or form that has regions to be completed or filled in, e.g. an address region and a name region in a standard form letter, or fields in a form. The handwritten text can be input using a pen device 50. The screen display 1 can be sensitive to the proximity of the pen device 50 to detect the coordinates of the pen device 50 to track its location and hence to generate the input handwritten text 41. The display screen 1 can be touch sensitive to allow for input of information and commands to the display apparatus e.g. by the display of touch sensitive options and/or a keyboard.
[0034] Below the display apparatus is displayed the motion directions that the display apparatus can experience as a method of erasing displayed information. The motion can be a back and forth linear or reciprocating motion in any of three directions along three axes x, y and z in three dimensions as shown by the intersecting arrows. Also, or alternatively, the motion can be non-linear, curved or rotational as shown by the curved arrows.
[0035] In the example of figure 1, a motion of the display apparatus can erase all of the displayed information or selective parts, such as one or more of the typed text 11, the handwritten text 41 or the image 31.
[0036] Figure 2 illustrates an alternative display screen 20 of a display apparatus. In this example, there are three different display regions, namely a typed text display region 10 with displayed typed text 11, an image display region 30 displaying an image 31, and a handwritten text display region 40 displaying handwritten text 41, created using a pen 50.
[0037] The motion of the display apparatus of this example can be a back and forth linear or reciprocating motion in any of three directions along three axes x, y and z in three dimensions as shown by the intersecting arrows of figure 1. Also, or alternatively, the motion can be non-linear, curved or rotational as shown by the curved arrow in figure 1.
[0038] In the example of figure 2, a motion of the display apparatus can erase all of the displayed information or selective parts, such as information in one or more of the display regions 10, 30 and 40.
[0039] Although different types of information are illustrated and described as being displayed in the different display regions in figure 2, the different display regions could display the same information type or any combination of information types. Also, a display region could display a mix of information types. The example of figure 2 is just for illustration.
[0040] Hence, a motion type detected by a motion detecting arrangement of the display apparatus can detect any one of a plurality of types of patterns of motion in any dimension or direction. Examples of different patterns of motion are: shaking back and forth, shaking side to side, shaking up and down, turning side to side (tilting side to side), turning up and down (tilting up and down) and rotating. Each of these represents a lateral (shaking) or rotational movement along or about one of the three axes illustrated in figure 1. It is possible to detect two types of each of these motion types, based on the starting motion. For example, back and forth could be back and forth or forth and back, side to side could be left to right or right to left, rotating could be clockwise or anticlockwise rotating etc.
[0041] The memory of the display apparatus can store a set of erase commands to implement by the processor for each type of motion detected by the motion detecting arrangement and identified by the processor from the signal from the motion detecting arrangement. These commands can be predefined or downloaded from a data source or they can be user defined.
[0042] The display apparatus can be programmed to allow the user to teach it motion types and erase operations to implement in response to the detected motion type. For example, the display apparatus may display erase options in a learning or startup phase, with the request to the user to initiate a desired motion type to be used for that erase operation. The user may be required to perform the operation a few times for the processor to implement a learning process to learn and store the motion type corresponding to a selected erase operation. The display apparatus then stores a pattern of detected motion for each erase operation to be used in future motion detection operations for the execution of erase operations.
[0043] Figure 3 is a flow diagram illustrating a learning phase of the display apparatus.
[0044] In step S 1, the display apparatus enters the learning phase. This can be automatic on start-up of the display apparatus or as a result of some other operation of the display apparatus, or it can be as a result of a user selection i.e. a use input, such as using an input arrangement of the display apparatus. In step S2 a display of the display apparatus displays a menu of define control operations that a user can choose to execute using motion as a user input. The displayed menu can simply be a list, or a drop-down menu for example. The list could be organized into categories of types of erase operations, e.g. erase one letter, erase one word, erase text, erase all text in a display region or frame, erase image, erase displayed history data, erase in a frame or display region, etc.
[0045] In step S3, a user selection of an erase operation menu item is received and then in step S4, the display apparatus waits for the motion detector arrangement e.g. an accelerometer, to detect motion of the display apparatus. The motion is recorded over a short period of time appropriate to capture the motion pattern e.g. 1-2 seconds. In order to improve the accuracy of the matching process and to allow for variations in the pattern of motion by the user, in step S5, the process loops back to require the user to repeat the motion input a number (N) times e.g. anything from 3 to 10 times. More iterations improve the accuracy of the matching process but reduces the usability of the display apparatus: a user will lose patience with a requirement to repeat the motion pattern too many times.
[0046] At the end of the loop back process, in step S6 the recorded motion patterns for the repeated recordings are averaged and the average is used in step S7 for storage as part of the information on the motion type in the stored motion type erase data. Data indicating the degree of deviation between the recorded motion patterns can also be stored as part of the motion type data to assist with the matching process during the operational phase i.e. to assist with assessing whether a match lies within an expected deviation of a stored average motion pattern. An identifier identifying the corresponding erase operation is also stored as part of the stored motion type erase data.
[0047] The process will then return to step S2 to allow the user to select another erase operation from the menu. If the user has finished selecting erase operations, a user can select to exit the learning phase.
[0048] Figure 4 is a flow diagram illustrating an operational phase of the display apparatus following the learning phase.
[0049] In step S 10, the display device enters the operational phase and in step S l l information is displayed on a display screen. The information can be displayed in different regions, such as frames or windows, as shown in figures 1 and 2. The displayed information can also be of different information types, e.g. text or images. Motion of the display apparatus is detected in step S 12. The pattern of motion is compared with the stored patterns for the motion type in the motion type erase data in step S 13 to determine if the motion matches a motion type. If no match is found (step S 14), the process returns to step S 12 to detect further motion. If a match is found with motion data for a match type in step S 14, in step S 15 a corresponding erase operation is identified in the motion type erase data and in step S 16 the erase operation is executed. The erase operation matched may be an operation to erase information in one of the regions or to erase an information type such as text or images. The process then returns to step S 12 to detect the next motion of the device for further control operations.
[0050] In figure 4, an average of motion data for a number of recorded motion operations is taken. However, the invention is not restricted to taking an average and only one motion detection may be used, or a number may be recorded and they can be stored individually for individual matching with a motion pattern during the operation phase.
[0051] In figure 4 a user is presented with a menu to select an erase operation to teach the display apparatus the motion type for that erase operation. The user may also be able to define their own erase operation using the user input arrangement. Further, the display apparatus may automatically, e.g. on start-up, enter the learning phase and require the user to enter a sequence of motion types for a sequence of control operations. The motion types and erase operations can be learned for individual users. For example, a user could enter their name or sign in to use the display apparatus and the learnt motion types and erase operations are then stored for that user for use when the user enters their name or signs in.
[0052] Figure 5 is a schematic diagram illustrating the electronic components of an example display apparatus.
[0053] A processor 100 is connected to static or non-volatile memory 102 storing code used by the processor 100, such as operating system code and for the storage of data and information for display in a non-volatile manner. Volatile memory 103 is provided for the storage of application code for implementation by the processor 100 and data and information for display and for erase control. The volatile memory can store code (e.g. a code module) comprising code for identifying motion patterns detected by the motion sensor 104, and code (e.g. a code module) for controlling a display screen 105 in response to erase displayed information.
[0054] The display screen 105 is connected to the processor 100 for the display of information. The display screen 105 can comprise a touch sensitive display to provide an input arrangement. A pen 50 (shown in figure 1) can be used with the display screen 105 to allow for the input of freehand text or drawings. A camera 106 can also optionally be connected to the processor 100 to capture images. The camera 106 can also be used as an input arrangement for the input of information and commands using gesture recognition implemented by the processor on the images captured by the camera 106. [0055] A network connector 101 is connected to the processor 100 for communication with a communications or computer network. This communication link can pass data, information and controls between the display apparatus and other display apparatuses or computers over the network. The network connector 101 can be connected to a communications or computer network using a wired or wireless connection. For example, a wired connection could be an ethernet connection to a LAN or a telephone connection, such that the network connector 101 acts as a modem or router. A wireless connection could be WIFI, WiMAX, CDMA, GSM, GPRS, wireless local loop or WAN. For low range and low power wireless communications, Bluetooth™ may be used.
[0056] A motion sensor 104 is connected to the processor 100 to detect motion of the display apparatus. The motion sensor 104 can comprise any conventional motion sensor, such as an accelerometer. The motion sensor 104 is capable of detecting motion of the display apparatus in any direction i.e. it is a multi-axis motion sensor to detect motion along any of three orthogonal axes in three dimensions.
[0057] In any of the examples above, the display apparatus may have a display screen on both sides, so that it can be turned over to view information on both sides. The erase operation could apply to both sides or to just one side. This, in one example, can be selectively set. The display or displays can also be detached from a mount frame.
[0058] In one or more embodiments, the display apparatus can comprise a docking part or mount to which a display screen is mounted in a detachable or demountable manner so that the display screen can be used separately from the mount. The mount and display screen can communicate between each other using a wireless link so that the mount can contain some components of the display apparatus, such as the processor and storage, while the display screen can contain only those components necessary to operate the display screen, detect motion of the display screen, and the communicate with the processor. In one embodiment, more than one display screen can be provided detachable from a mount, with each display screen operating independently to provide the erase operation by motion detection using a shared processor in the mount.
[0059] The display apparatus can include one or more loudspeakers for audio output and one or more microphones for audio input. Also, the display apparatus can connect to a peripheral device such as a keyboard and/or pointing device by a wired or wireless connection to allow for input of information and commands to the display apparatus. [0060] In any of the examples above, the display apparatus can include other input arrangements, such as a keyboard, pointer device (e.g. a mouse), or a touch screen, to enable a user to input controls and information in conjunction with the motion detection control input method. The input arrangement can also be used to perform conventional erase operations to supplement the motion erase capability of the display apparatus, e.g. keyboard deletions, selections of text and displayed deletion operations, etc. Also, a camera can be provided to allow image capture to enable gesture input as a method of control or information input.
[0061] In embodiments, in addition to or alternatively to the motion control input, a camera can be provided in the apparatus to capture video in a direction facing the user so that the user can use gestures to control the erasing of information displayed on the display screen in dependence upon the type of identified gesture. The gesture control can comprise the recognition of movements of a user’s body parts i.e. hands, facial features or the overall body position or the recognition of an object moved by the user, such as a stick, ruler or something worn by the user. Pattern recognition techniques can be used to recognize the type of gestures and to identify them. Example gesture types can include sweeping of a hand to the left or right, or up or down, or a waving of a hand.
[0062] Where the gesture control is provided in conjunction with the motion control, the gesture control erase operation can be used, for example, where the user is unable to pick up the display apparatus, e.g. they have wet or dirty hands. Further, the display screen can be controlled to be responsive to the detected gesture type and to identify a comparable or associated motion type that controls the same erase operation and to control the display screen to cause the display screen to mimic the motion equivalent command to the gesture command. For example, if the motion command to erase text in a display region is a left to right rotation, when an equivalent or associated gesture command e.g. waving the hand from left to right, is identified, the display screen can cause the display to rotate from left to right to act as a confirmation back to the user that the gesture command has been recognized as the motion command.
[0063] In one aspect, the invention provides gesture control instead of motion control.
In this aspect the display apparatus can comprise a display screen to display information; a memory to store information for display on the display screen; a gesture detecting arrangement to detect a gesture (e.g. a camera and recognition software); and a processor programmed to control the display of the information on the display screen and responsive to gesture detected by the gesture detecting arrangement, to control the display screen to erase at least a part of the information displayed on the display screen, wherein the gesture detecting arrangement is configured to sense a plurality of gesture types, and the processor is programmed to identify the sensed gesture types and to selectively erase information displayed on the display screen in dependence upon the identified gesture types. Hence, in this aspect, the gesture recognition operates in the same way as the motion detection and hence, in the motion detection examples described herein above, motion can be replaced with gesture in this aspect.
[0064] In this aspect, the display apparatus can be mobile or fixed/attached. A camera can be provided in the apparatus to capture video in a direction facing the user so that the user can use gestures to control the erasing of information displayed on the display screen in dependence upon the type of identified gesture. The gesture control can comprise the recognition of movements of a user’s body parts i.e. hands, facial features or the overall body position. Pattern recognition techniques can be used to recognize the type of gestures and to identify them. Example gesture types can include sweeping of a hand to the left or right, or up or down, or a waving of a hand.
[0065] It will be readily understood to those skilled in the art that various other changes in the details, material, and arrangements of the parts and method stages which have been described and illustrated in order to explain the nature of the inventive subject matter may be made without departing from the principles and scope of the inventive subject matter as expressed in the subjoined claims.

Claims

1. Display apparatus comprising:
a display screen to display information in a plurality of different regions;
a memory to store information for display on the different regions of the display screen; a motion detecting arrangement to detect motion of the display apparatus; and a processor programmed to control the display of the information on the display screen in the different regions and responsive to motion detected by the motion detecting arrangement, to control the display screen to erase at least a part of the information displayed on the display screen, wherein the motion detecting arrangement is configured to detect a plurality of motion types, and the processor is programmed to identify the detected motion types and to selectively erase information displayed on the display screen in different regions in dependence upon the identified motion types.
2. Display apparatus according to claim 1, wherein the processor is programmed to selectively erase at least a part of the information displayed on the display screen in different regions in response to shaking or reciprocating motion detected by the motion detecting arrangement that is greater than a threshold.
3. Display apparatus according to claim 1 or claim 2, wherein the processor is programmed to delete the erased displayed information in the memory.
4. Display apparatus according to any preceding claim, wherein the motion detecting arrangement is configured to detect a plurality of patterns of motion in multiple directions, and the processor is programmed to identify the detected patterns of motion and to selectively erase information displayed on the display screen in different regions in dependence upon the identified patterns.
5. Display apparatus comprising:
a display screen to display a plurality of types of information;
a memory to store information for display on the display screen;
a motion detecting arrangement to detect motion of the display apparatus; and a processor programmed to control the display of the information on the display screen to display the different information types and responsive to motion detected by the motion detecting arrangement, to control the display screen to erase at least a part of the information displayed on the display screen, wherein the motion detecting arrangement is configured to detect a plurality of motion types, and the processor is programmed to identify the detected motion types and to selectively erase information types displayed on the display screen in dependence upon the identified motion types.
6. Display apparatus according to claim 5, wherein the processor is programmed to selectively erase the displayed information type in response to shaking or reciprocating motion detected by the motion detecting arrangement that is greater than a threshold.
7. Display apparatus according to claim 5 or claim 6, wherein the processor is programmed to delete the erased displayed information in the memory.
8. Display apparatus according to any one of claims 5 to 7, wherein the motion detecting arrangement is configured to detect a plurality of patterns of motion in multiple directions, and the processor is programmed to identify the detected patterns of motion and to selectively erase displayed information types in dependence upon the identified patterns.
9. Display apparatus according to any preceding claim, including an input arrangement for the input of information for display.
10. Display apparatus according to claim 9, wherein the input arrangement includes a pen device and the display screen is touch sensitive for information input.
11. Display apparatus comprising:
a display screen to display information;
a memory to store motion type erase data comprising identifications of motion types and corresponding erase operations, and information for display on the display screen;
a motion detecting arrangement to detect motion of the display apparatus;
a user input arrangement to receive a user input identifying erase operations during a learning phase; and a processor programmed, in the learning phase when a user input is received identifying a control operation, to identify a motion type from motion detected by the motion detecting arrangement and to store the received user input in correspondence with data identifying the motion type in the motion type erase data, and, subsequent to the learning phase when the motion detecting arrangement detects motion, to use the motion type erase data to identify a motion type and execute the corresponding erase operation to erase at least a part of the information displayed on the display screen.
12. A display apparatus according to claim 11, wherein the processor is programmed, in the learning phase when a user input is received identifying a control operation, to identify a said motion type by averaging the detected motion received from the motion detecting arrangement a plurality of times and to store the received user input in correspondence with data identifying the motion type in the motion type erase data
13. A display apparatus according to claim 11 or claim 12, wherein the processor is programmed to, in the learning phase, receive a plurality of user inputs and to identify a said motion type from motion detected by the motion detecting arrangement for each user input and to store the received user inputs in correspondence with data identifying the respective motion type in the motion type erase data.
14. A display apparatus according to any one of claims 11 to 13, wherein the processor is programmed to identify a plurality of motion types comprising a combination of motions in multiple directions.
15. A display apparatus according to claim 14, wherein the directions comprise at least one of lateral and/or rotational directions.
16. A display apparatus according to any one of claims 11 to 15, wherein the information is displayed in a plurality of regions, and the erase operations for different motion types identify erase operations for different regions.
17. A display apparatus according to any one of claims 11 to 15, wherein the displayed information comprises a plurality of different types of information, and the erase operations for different motion types identify erase operations for different types of information.
18. A method of controlling a display apparatus having a display screen and a motion detector arrangement to detect motion, the method comprising:
displaying information on the display screen in a plurality of different regions;
detecting a plurality of types of motion of the display apparatus; and
selectively erasing information displayed on the display screen in different regions in dependence upon the detected motion types.
19. A method according to claim 18, wherein at least a part of the information displayed on the display screen in the different regions is selectively erased in response to shaking or reciprocating motion detected by the motion detecting arrangement that is greater than a threshold.
20. A method according to claim 18 or claim 19, wherein the information is stored in a memory, including deleting the erased displayed information in the memory.
21. A method according to any one of claims 18 to 20, wherein a plurality of patterns of motion in multiple directions are detected, and the information displayed on the display screen in the different regions is selectively erased in dependence upon the detected patterns.
22. A method of controlling a display apparatus having a display screen and a motion detector arrangement to detect motion, the method comprising:
displaying information of a plurality of different information types on the display screen;
detecting a plurality of types of motion of the display apparatus; and
selectively erasing information types displayed on the display screen in dependence upon the detected motion types.
23. A method according to claim 22, wherein at least a part of the type of information displayed on the display screen is selectively erased in response to shaking or reciprocating motion detected by the motion detecting arrangement that is greater than a threshold.
24. A method according to claim 22 or claim 23, wherein the information is stored in a memory, including deleting the erased displayed information in the memory.
25. A method according to any one of claims 22 to 24, wherein a plurality of patterns of motion in multiple directions are detected, and the type of information displayed on the display screen is selectively erased in dependence upon the detected patterns.
26. A method according to any one of claims 22 to 25, including receiving the input of information for display.
27. A method according to claim 26, wherein the information is input by a pen device and the display screen is touch sensitive for information input.
28. A method of controlling a display apparatus having a motion detector arrangement to detect motion of the device, the method comprising:
during a learning phase:
receiving a user input identifying an erase operation;
detecting motion of the display apparatus using the motion detector arrangement; identifying a motion type from the motion detected by the motion detecting arrangement;
storing the received user input in correspondence with data identifying the motion type as motion type erase data;
and repeating the receiving, detecting, identifying and storing steps; and
in an operation phase:
displaying information on a display screen;
detecting motion of the display apparatus using the motion detector arrangement; and using the motion type control data to identify a motion type and execute the corresponding erase operation to erase at least a part of the information displayed on the display screen.
29. A method according to claim 28, wherein in the learning phase, when a user input is received identifying an erase operation, a said motion type is identified by averaging the detected motion received from the motion detecting arrangement a plurality of times, and the received user input is stored in correspondence with data identifying the motion type in the motion type erase data
30. A method according to claim 28 or claim 29, wherein the motion types comprise a combination of motions in multiple directions.
31. A method according to claim 30, wherein the directions comprise at least one of lateral and/or rotational directions.
32. A method according to any one of claims 29 to 31, wherein the information is displayed in a plurality of regions, and the erase operations for different motion types identify erase operations for different regions.
33. A method according to any one of claims 9 to 12, wherein the displayed information comprises a plurality of different types of information, and the erase operations for different motion types identify erase operations for different types of information.
34. A carrier medium carrying processor implementable code for execution by a processor to implement the method of any one of claims 18 to 33.
PCT/GB2019/050931 2018-03-29 2019-03-29 Display apparatus WO2019186201A1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
CN201980029053.7A CN112041792A (en) 2018-03-29 2019-03-29 Display device
SG11202009633PA SG11202009633PA (en) 2018-03-29 2019-03-29 Display apparatus
KR1020207031286A KR20210002509A (en) 2018-03-29 2019-03-29 Display device
EP19717550.8A EP3776150A1 (en) 2018-03-29 2019-03-29 Display apparatus
JP2020552779A JP7379364B2 (en) 2018-03-29 2019-03-29 display device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB1805278.7A GB2572437A (en) 2018-03-29 2018-03-29 Display apparatus
GB1805278.7 2018-03-29

Publications (1)

Publication Number Publication Date
WO2019186201A1 true WO2019186201A1 (en) 2019-10-03

Family

ID=62142353

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2019/050931 WO2019186201A1 (en) 2018-03-29 2019-03-29 Display apparatus

Country Status (7)

Country Link
EP (1) EP3776150A1 (en)
JP (1) JP7379364B2 (en)
KR (1) KR20210002509A (en)
CN (1) CN112041792A (en)
GB (1) GB2572437A (en)
SG (1) SG11202009633PA (en)
WO (1) WO2019186201A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110053641A1 (en) * 2008-11-10 2011-03-03 Samsung Electronics Co., Ltd. Motion input device for portable terminal and operation method using the same
WO2012078654A1 (en) * 2010-12-07 2012-06-14 Google Inc. Editing based on force-based physical cues
US20160291864A1 (en) * 2010-11-12 2016-10-06 Blackberry Limited Method of interacting with a portable electronic device
EP3120222A1 (en) * 2014-03-15 2017-01-25 Microsoft Technology Licensing, LLC Trainable sensor-based gesture recognition

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4853302B2 (en) * 2007-01-19 2012-01-11 日本電気株式会社 Command input device for portable terminal and command input method for portable terminal
US20110029869A1 (en) * 2008-02-29 2011-02-03 Mclennan Hamish Method and system responsive to intentional movement of a device
KR101457116B1 (en) * 2011-11-07 2014-11-04 삼성전자주식회사 Electronic apparatus and Method for controlling electronic apparatus using voice recognition and motion recognition
US9841893B2 (en) * 2012-03-30 2017-12-12 Nokia Technologies Oy Detection of a jolt during character entry
CN102681667B (en) * 2012-04-24 2015-11-25 华为终端有限公司 The backing method of text event detection and terminal
CN102681695B (en) * 2012-04-25 2016-12-07 北京三星通信技术研究有限公司 cursor control method and device
JP2015114700A (en) * 2013-12-09 2015-06-22 株式会社Nttドコモ Object display device
CN105183325B (en) * 2015-10-27 2019-06-18 上海斐讯数据通信技术有限公司 A kind of customized input method and system
JP6663131B2 (en) * 2016-01-28 2020-03-11 カシオ計算機株式会社 Display device, display control method and program
CN106850956A (en) * 2016-12-21 2017-06-13 珠海市魅族科技有限公司 Information deletion method and device
CN107122106A (en) * 2017-04-25 2017-09-01 北京洋浦伟业科技发展有限公司 The delet method and device of a kind of usage record

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110053641A1 (en) * 2008-11-10 2011-03-03 Samsung Electronics Co., Ltd. Motion input device for portable terminal and operation method using the same
US20160291864A1 (en) * 2010-11-12 2016-10-06 Blackberry Limited Method of interacting with a portable electronic device
WO2012078654A1 (en) * 2010-12-07 2012-06-14 Google Inc. Editing based on force-based physical cues
EP3120222A1 (en) * 2014-03-15 2017-01-25 Microsoft Technology Licensing, LLC Trainable sensor-based gesture recognition

Also Published As

Publication number Publication date
KR20210002509A (en) 2021-01-08
GB201805278D0 (en) 2018-05-16
CN112041792A (en) 2020-12-04
GB2572437A (en) 2019-10-02
EP3776150A1 (en) 2021-02-17
SG11202009633PA (en) 2020-10-29
JP2021519975A (en) 2021-08-12
JP7379364B2 (en) 2023-11-14

Similar Documents

Publication Publication Date Title
US11314804B2 (en) Information search method and device and computer readable recording medium thereof
KR102144553B1 (en) Multiple-display method, machine-readable storage medium and electronic device
CN105683893B (en) Control interface is presented on enabling the equipment touched in shortage based on movement or movement
KR102041332B1 (en) Mobile operating system
CN106775313A (en) Split screen method of controlling operation thereof and mobile terminal
EP2811420A2 (en) Method for quickly executing application on lock screen in mobile device, and mobile device therefor
US20140240363A1 (en) Context awareness-based screen scroll method, machine-readable storage medium and terminal therefor
US10949668B2 (en) Electronic apparatus and method for controlling thereof
JP2016511471A (en) Method for controlling display of a plurality of objects by movement-related input to portable terminal and portable terminal
KR102022042B1 (en) Data transfer method and system thereof
US10572144B2 (en) Input processing method and apparatus of electronic device
CN104246683A (en) Object control method performed in device including transparent display, the device, and computer readable recording medium thereof
CN107407945A (en) From the system and method for screen locking capture images
US9600094B2 (en) Apparatus, method, and program product for directing motion of a writing device
US10331340B2 (en) Device and method for receiving character input through the same
CN103765367A (en) Information processing apparatus, information processing method, and program
KR102140811B1 (en) User Interface Providing Method for Device and Device Thereof
CN105320260A (en) Control method for mobile terminal and mobile terminal
WO2019186201A1 (en) Display apparatus
KR102186103B1 (en) Context awareness based screen scroll method, machine-readable storage medium and terminal
WO2019186203A1 (en) Device operation control
KR101898162B1 (en) Apparatus and method of providing additional function and feedback to other apparatus by using information of multiple sensor
Date Accepted in Partial Fulfillment of the Requirements For the Degree of Master of Fine Arts at

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19717550

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2020552779

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2019717550

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2019717550

Country of ref document: EP

Effective date: 20201029