EP2390772A1 - User interface with three dimensional user input - Google Patents

User interface with three dimensional user input Download PDF

Info

Publication number
EP2390772A1
EP2390772A1 EP10164471A EP10164471A EP2390772A1 EP 2390772 A1 EP2390772 A1 EP 2390772A1 EP 10164471 A EP10164471 A EP 10164471A EP 10164471 A EP10164471 A EP 10164471A EP 2390772 A1 EP2390772 A1 EP 2390772A1
Authority
EP
European Patent Office
Prior art keywords
image
depth
value
configured
user input
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP10164471A
Other languages
German (de)
French (fr)
Inventor
Erik Backlund
Peter ÅBERG
Henrik Bengtsson
Henrik Heringslack
Jari Sassi
Ola THÖRN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Mobile Communications AB
Original Assignee
Sony Mobile Communications AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Mobile Communications AB filed Critical Sony Mobile Communications AB
Priority to EP10164471A priority Critical patent/EP2390772A1/en
Publication of EP2390772A1 publication Critical patent/EP2390772A1/en
Application status is Ceased legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815Interaction with three-dimensional environments, e.g. control of viewpoint to navigate in the environment
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

A device and method for image manipulation is provided. The image manipulation may be performed as a function of a three dimensional user input (203) and image or application specific data (207) regarding the displayed image to be manipulated. The three dimensional input (203) may be in the form of a two dimensional position on a touch screen and a measured force in the third dimension. The image or application specific data (207) may be in the form of a maximum depth value indicating the maximum depth of the displayed image. The system may be configured to adjust the image based on a percentage of the measured user input force and a threshold force. The image may be adjusted based on the percentage and the maximum depth.

Description

    TECHNICAL FIELD
  • Example embodiments presented herein are directed towards a multimedia device, and methods for using the same, comprising a user interface configured to receive a three dimensional input/output and/or alter a displayed image based on the input.
  • BACKGROUND
  • Many multimedia devices employ touch screen technology. For example, a user may be able to enlarge or shrink an image on a display screen by placing two fingers on a screen and moving the two fingers away from each other, or closer to each other, respectively, to achieve the desired effect. The use of touch screen technology allows a user to easily navigate through menus and manipulate displayed data. Touch screen technology is also employed in various gaming applications.
  • While current systems do exist for manipulating an image via input received from a touch screen, none of these systems utilize a measured force with respect to image and/or application specific data. Often user navigation through menus or gaming systems involves predefined steps or movements, Image manipulation or user navigation may be greatly improved with the use of measured force data and image or application specific data as it provides greater accuracy.
  • SUMMARY
  • Thus, an objective of the present invention remedies the above mentioned problems with respect to current systems. According to example embodiments, an image adjusting system is provided. The image adjusting system may include a receiving port that may be configured to receive a user input through a touch screen interface. The image adjusting system may also include an analyzer that may be configured to provide a depth configuration value based on the user input and image depth information of a displayed image. The image adjusting system may further include a processor that may be configured to alter the displayed image based on the depth reconfiguration value.
  • The image depth information may define a maximum depth of the image. The image depth information may be embedded in metadata or may be determined through image analysis. The user input may be in the form of a three dimensional input. The user input may be further defined as a location in a two dimensional location and an applied force measured in a third dimension.
  • In example embodiments, the analyzer may further include a comparator that may be configured to compare the applied force to a threshold force value. The comparator may further be configured to determine a difference percentage of the applied force and the threshold value. The analyzer may be further configured to provide the depth reconfiguration value based on the difference percentage. The threshold value may be programmably adjustable.
  • Example embodiments further include a multimedia device for displaying images, characterized that the multimedia device may comprise a touch screen configured to receive a three dimensional user input. At least one dimension of the user input may be a measure of force. The device may further include a processor that may be configured to alter a displayed image as a function of a percentage of the applied force.
  • Example embodiments also include a method for providing a user interface. The method may include receiving a user input through a touch screen interface, evaluating a depth reconfiguration value based on the user input and image depth information of a displayed image, and altering the displayed image based on the depth reconfiguration value. The evaluating may further include comparing the applied force to a threshold force value, determining a difference percentage of the applied force and threshold force value, and providing the depth reconfiguration value based on the difference percentage.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The foregoing will be apparent from the following more particular description of example embodiments of the invention, as illustrated in the accompanying drawings in which like reference characters refer to the same parts throughout the different views. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating embodiments of the present invention.
    • FIG. 1 is an illustrative example employing example embodiments;
    • FIG. 2 is an illustration of a multimedia device according to an example embodiment;
    • FIG. 3 is a block schematic of an image adjust system according to example embodiments; and
    • FIG. 4 is a flow diagram depicting operational steps which may be taken by the system of FIG. 3 according to example embodiments.
    DETAILED DESCRIPTION
  • In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular components, elements, techniques, etc. in order to provide a thorough understanding of the example embodiments presented herein. However, it will be apparent to one skilled in the art that the example embodiments may be practiced in other manners that depart from these specific details. In other instances, detailed descriptions of well-known methods and elements are omitted so as not to obscure the description of the example embodiments.
  • Example embodiments presented herein are directed towards image manipulation or navigation through an interface utilizing a three dimensional user input and image or application specific data. For example, embodiments presented herein may be utilized in gaming applications where a user may walk through a virtual world. Based on a measurement of a force component of the user input, a determination may be made as to how far (with respect to depth perception) a user may navigate through the virtual world.
  • Similarly, a user may zoom in or enlarge a displayed image, where the amount of enlargement is determined in part by the measured force component of the user input. In contrast to current systems which require the use of two fingers to perform such tasks, example embodiments are presented herein which require the use of only one finger and provide great accuracy through the use of image or application specific data.
  • Embodiments may also be employed for user navigation through a menu. For example, a user may cycle through a number of cascaded menus and a determination as to how for within the menu selection a user may go may be based on a force measurement of the user input.
  • It should be appreciated that example embodiments presented herein may be employed in a variety of applications, for example, applications involving image, movie, gaming, menu systems, or any other type of applications known in the art which involve a form of display.
  • Figure 1 provides an illustrative example use of the embodiments presented. In Figure 1, a user is navigating through a virtual world in a gaming application. The virtual user is represented as the stick figure 401. A user may navigate through the virtual world by pressing the touch screen, for example, in location 403. An imaging system, according to example embodiments, may recognize the X and Y coordinates, as shown in axis 103, as the location which the user desires to navigate to. The imaging system may further measure a force exerted by the user interacting the touch screen 101 in the Z direction, as shown in axis 103.
  • In the current example, the measured force exerted by the user is 2N. A threshold force (or maximum force) associated with the gaming application is 5N. The imaging system may compare the two force values and the system may determine a difference percentage of 40% (e.g., 2N is 40% of 5N).
  • The imaging system may further provide a depth reconfiguration value based on image depth information associated with the gaming application. In Figure 1 the image depth information is the maximum depth, which is shown as Z max. In the current example Z max is set as 20km. Given that the difference percentage has been calculated as 40%, the system may calculate the depth configuration value as 8km (40% of the Z max value 20km). This information may then be utilized to alter the displayed image in a manner that the user will navigate through the virtual world a total distance of 8km in the direction of user defined location 403.
  • Figure 2 illustrates an example of a multimedia device in the form of a mobile phone 100 that may employ the example embodiments presented herein. Example embodiments presented herein will be explained with a mobile phone being the multimedia device. It should be appreciated that example embodiments may be applied to other multimedia devices having an electronic visual display known in the art, for example, PDAs or video game devices.
  • The multimedia device 100 may include a touch screen 101. The multimedia touch screen 101 may employ, for example, capacitive sensing technology to detect when a user is providing input via the screen 101. It should be appreciated that any other sensing means known in the art may be employed, for example, resistive technology, surface acoustic wave technology, surface capacitance technology, projected capacitance technology, mutual capacitive sensors, self capacitance sensors, strain gauge or force panel technology, optical imaging, dispersive signal technology, acoustic pulse recognition, and coded LCD technology.
  • The multimedia device 100 may further include an image adjusting system 200 that may be configured to adjust an image displayed on the screen 101 of the multimedia device 100, as shown in Figure 3. Figure 4 is a flow chart illustrating example operational steps that may be taken by the image adjusting system 200 of Figure 3. The image adjusting system 200 may include an input port 201 that may be configured to receive user data 203 (301). The user data may be three dimensional data providing position data and force data. The position data may include an X and Y coordinate providing information as to where a user touched the screen 101, as shown by coordinate axis 103. The force data may be a pressure reading as to how much force a user touched the screen 101 within a Z direction, as indicated by the coordinate axis 103.
  • Once received by the input port 201, the user data 203 may then be transferred to an analyzer 205. The analyzer may also be configured to receive image depth information regarding an image currently being displayed on screen 101. The image depth information may be included within the image itself as embedded metadata. Alternatively, the image depth information may be obtained through image analysis. It should be appreciated that image depth information may also be obtained through any other means known in the art.
  • Upon receiving the image depth information 207, the analyzer 205 may utilize a comparator 209 to compare the applied force in the Z coordinate and a threshold force value (302). The threshold force value may define a maximum force to be applied on the multimedia device 100 or a maximum force to be applied to a specific image. The threshold force may be programmably adjusted by a user. The adjustment to the threshold force may be with respect to the maximum force numerical value as well as to what the threshold force will be associated with (e.g., the multimedia device, a specific image, or a specific application). It should be appreciated that the threshold force value may be included in the image depth information 207 or may be registered within the analyzer 205, or within else where in the image adjusting system 200.
  • Once the analyzer 205 has received the threshold force value and the user applied force value, the comparator 209 may compare the two force values and provide a percentage difference of the two values (303, 305). Upon computation of the percentage difference, the analyzer 205 may be configured to determine a depth reconfiguration value based on the determined percentage difference (307). For example, if the determined percentage difference is 50%, the analyzer may calculate the depth reconfiguration to be 50% of a Z coordinate maximum. The Z coordinate maximum may be defined as the maximum depth associated with a particular image or application. For example, if a user is utilizing an application in which an associated Z coordinate maximum is 10km, a percentage difference of 50% would result in a depth reconfiguration value of 5km (50% of the Z coordinate maximum). It should also be appreciated that the Z coordinate maximum depth may be associated with the multimedia device. It should further be appreciated that the Z coordinate maximum depth value may also be programmably adjustable.
  • Once the depth reconfiguration has been calculated, the analyzer 205 may be configured to send the depth reconfiguration 213 to a processor 215. The processor 215 may be configured to provide alteration instructions 217 to adjust the image displayed on the screen 101 (309).
  • It should be appreciated that, using example embodiments, a user may be able to steer a screen pointer directly to a three dimensional point by, for example, enabling 100% of the total depth.
  • The various embodiments of the present invention described herein is described in the general context of method steps or processes, which may be implemented in one embodiment by a computer program product, embodied in a computer-readable medium, including computer-executable instructions, such as program code, executed by computers in networked environments. A computer-readable medium may include removable and non-removable storage devices including, but not limited to, Read Only Memory (ROM), Random Access Memory (RAM), compact discs (CDs), digital versatile discs (DVD), etc. Generally, program modules may include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Computer-executable instructions, associated data structures, and program modules represent examples of program code for executing steps of the methods disclosed herein. The particular sequence of such executable instructions or associated data structures represents examples of corresponding acts for implementing the functions described in such steps or processes.
  • The above mentioned and described embodiments are only given as examples and should not be limiting to the example embodiments. Other solutions, uses, objectives, and functions within the scope of the invention as claimed in the below described patent claims should be apparent for the person skilled in the art.

Claims (15)

  1. A method of providing a user interface comprising:
    receiving a user input (203) through a touch screen interface (101);
    evaluating a depth reconfiguration value (213) based on the user input (203) and image depth information (207) of a displayed image; and
    altering the displayed image based on the depth reconfiguration value (213).
  2. The method of Claim 1 wherein the image depth information (207) defines a maximum depth of the image.
  3. The method of Claim 1 wherein the image depth information (207) is embedded in metadata.
  4. The method of Claim 1 further comprising determining the image depth information through (207) image analysis.
  5. The method of Claim 5 wherein the user input (203) is three dimensional and defines a two dimensional location and an applied force in a third dimension.
  6. The method of Claim 5 evaluating the depth configuration further comprises:
    comparing the applied force to a threshold force value;
    determining a difference percentage of the applied force and the threshold force value; and
    providing the depth reconfiguration value (213) based on the difference percentage.
  7. The method of Claim 6 wherein the threshold value is programmably adjustable.
  8. An image adjusting system comprising a receiving port (201) configured to receive a user input (203) through a touch screen interface (101) characterized in that the system further comprises:
    an analyzer (205) configured to provide a depth configuration value (213) based on the user input (201) and image depth information (207) of a displayed image; and
    a processor (215) configured to alter the displayed image based on the depth reconfiguration value (213).
  9. The system of Claim 8 wherein the image depth information (207) defines a maximum depth of the image.
  10. The system of Claim 8 wherein the image depth information (207) is embedded in metadata.
  11. The system of Claim 8 wherein the analyzer (205) is further configured to determine the image depth information (207) through image analysis.
  12. The system of Claim 8 wherein the user input (203) is three dimensional and defines a two dimensional location and an applied force in a third dimension.
  13. The system of Claim 12 wherein the analyzer further comprises:
    a comparator (209) configured to compare the applied force to a threshold force value; and
    the analyzer (205) further configured to determine a difference percentage of the applied force and the threshold value, wherein the analyzer is further configured to provide the depth reconfiguration value based on the difference percentage.
  14. The system of Claim 13 wherein the threshold value is programmably adjustable.
  15. A multimedia device for displaying images, characterized that said multimedia device comprising a touch screen (101) configured to receive a three dimensional user input (203), wherein at least one dimension is a measure of force, and a processor (215) configured to alter a displayed image as a function of a percentage of the applied force.
EP10164471A 2010-05-31 2010-05-31 User interface with three dimensional user input Ceased EP2390772A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP10164471A EP2390772A1 (en) 2010-05-31 2010-05-31 User interface with three dimensional user input

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP10164471A EP2390772A1 (en) 2010-05-31 2010-05-31 User interface with three dimensional user input
US13/116,583 US8625882B2 (en) 2010-05-31 2011-05-26 User interface with three dimensional user input

Publications (1)

Publication Number Publication Date
EP2390772A1 true EP2390772A1 (en) 2011-11-30

Family

ID=42731811

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10164471A Ceased EP2390772A1 (en) 2010-05-31 2010-05-31 User interface with three dimensional user input

Country Status (2)

Country Link
US (1) US8625882B2 (en)
EP (1) EP2390772A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3081150A1 (en) 2015-04-15 2016-10-19 Alasdair Ivan Andre Gant Skin protrusion size determination
EP2610728A3 (en) * 2011-12-28 2017-10-11 Nintendo Co., Ltd. Information processing program, information processing system, and information processing method

Families Citing this family (56)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10298834B2 (en) 2006-12-01 2019-05-21 Google Llc Video refocusing
US9035876B2 (en) 2008-01-14 2015-05-19 Apple Inc. Three-dimensional user interface session control
US20110164032A1 (en) * 2010-01-07 2011-07-07 Prime Sense Ltd. Three-Dimensional User Interface
US9693039B2 (en) * 2010-05-27 2017-06-27 Nintendo Co., Ltd. Hand-held electronic device
JP2012000165A (en) * 2010-06-14 2012-01-05 Sega Corp Video game apparatus
US8872762B2 (en) 2010-12-08 2014-10-28 Primesense Ltd. Three dimensional user interface cursor control
US8933876B2 (en) 2010-12-13 2015-01-13 Apple Inc. Three dimensional user interface session control
US9377865B2 (en) 2011-07-05 2016-06-28 Apple Inc. Zoom-based gesture user interface
US9459758B2 (en) 2011-07-05 2016-10-04 Apple Inc. Gesture-based interface with enhanced features
US8881051B2 (en) * 2011-07-05 2014-11-04 Primesense Ltd Zoom-based gesture user interface
US9417754B2 (en) 2011-08-05 2016-08-16 P4tents1, LLC User interface system, method, and computer program product
US9030498B2 (en) 2011-08-15 2015-05-12 Apple Inc. Combining explicit select gestures and timeclick in a non-tactile three dimensional user interface
US9218063B2 (en) 2011-08-24 2015-12-22 Apple Inc. Sessionless pointing user interface
US9229534B2 (en) 2012-02-28 2016-01-05 Apple Inc. Asymmetric mapping for tactile and non-tactile user interfaces
WO2013169845A1 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for scrolling nested regions
WO2013169882A2 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for moving and dropping a user interface object
WO2013169843A1 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for manipulating framed graphical objects
CN109062488A (en) 2012-05-09 2018-12-21 苹果公司 For selecting the equipment, method and graphic user interface of user interface object
AU2013259630B2 (en) 2012-05-09 2016-07-07 Apple Inc. Device, method, and graphical user interface for transitioning between display states in response to gesture
EP3185116A1 (en) 2012-05-09 2017-06-28 Apple Inc. Device, method and graphical user interface for providing tactile feedback for operations performed in a user interface
WO2013169865A2 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for moving a user interface object based on an intensity of a press input
DE112013002412T5 (en) 2012-05-09 2015-02-19 Apple Inc. Device, Method, and Graphical User Interface for providing feedback for changing activation states of a user interface object
WO2013169849A2 (en) 2012-05-09 2013-11-14 Industries Llc Yknots Device, method, and graphical user interface for displaying user interface objects corresponding to an application
DE202013012233U1 (en) 2012-05-09 2016-01-18 Apple Inc. Device and graphical user interface to display additional information in response to a user Contact
WO2013169842A2 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for selecting object within a group of objects
WO2013169875A2 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for displaying content associated with a corresponding affordance
US9225810B2 (en) 2012-07-03 2015-12-29 Sony Corporation Terminal device, information processing method, program, and storage medium
KR102003261B1 (en) * 2012-09-13 2019-07-30 삼성전자 주식회사 Operating Method of Electronic Device based on a touch pressure and Electronic Device supporting the same
US8997021B2 (en) * 2012-11-06 2015-03-31 Lytro, Inc. Parallax and/or three-dimensional effects for thumbnail image displays
CN109375853A (en) 2012-12-29 2019-02-22 苹果公司 To equipment, method and the graphic user interface of the navigation of user interface hierarchical structure
EP2939096A1 (en) 2012-12-29 2015-11-04 Apple Inc. Device, method, and graphical user interface for determining whether to scroll or select contents
EP2939098B1 (en) 2012-12-29 2018-10-10 Apple Inc. Device, method, and graphical user interface for transitioning between touch input to display output relationships
WO2014105279A1 (en) 2012-12-29 2014-07-03 Yknots Industries Llc Device, method, and graphical user interface for switching between user interfaces
US10334151B2 (en) 2013-04-22 2019-06-25 Google Llc Phase detection autofocus using subaperture images
EP3019913A4 (en) * 2013-07-10 2017-03-08 Real View Imaging Ltd. Three dimensional user interface
KR20160106985A (en) * 2015-03-03 2016-09-13 삼성전자주식회사 Method for displaying image and electronic apparatus
US10048757B2 (en) 2015-03-08 2018-08-14 Apple Inc. Devices and methods for controlling media presentation
US9990107B2 (en) 2015-03-08 2018-06-05 Apple Inc. Devices, methods, and graphical user interfaces for displaying and using menus
US10095396B2 (en) 2015-03-08 2018-10-09 Apple Inc. Devices, methods, and graphical user interfaces for interacting with a control object while dragging another object
US9632664B2 (en) 2015-03-08 2017-04-25 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US9785305B2 (en) 2015-03-19 2017-10-10 Apple Inc. Touch input cursor manipulation
US10152208B2 (en) 2015-04-01 2018-12-11 Apple Inc. Devices and methods for processing touch inputs based on their intensities
US10275898B1 (en) 2015-04-15 2019-04-30 Google Llc Wedge-based light-field video capture
US10341632B2 (en) 2015-04-15 2019-07-02 Google Llc. Spatial random access enabled video system with a three-dimensional viewing volume
US9860451B2 (en) 2015-06-07 2018-01-02 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US10346030B2 (en) 2015-06-07 2019-07-09 Apple Inc. Devices and methods for navigating between user interfaces
US9830048B2 (en) 2015-06-07 2017-11-28 Apple Inc. Devices and methods for processing touch inputs with instructions in a web page
US10200598B2 (en) 2015-06-07 2019-02-05 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US9891811B2 (en) 2015-06-07 2018-02-13 Apple Inc. Devices and methods for navigating between user interfaces
US9979909B2 (en) 2015-07-24 2018-05-22 Lytro, Inc. Automatic lens flare detection and correction for light-field images
US10248308B2 (en) 2015-08-10 2019-04-02 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interfaces with physical gestures
US20170045981A1 (en) 2015-08-10 2017-02-16 Apple Inc. Devices and Methods for Processing Touch Inputs Based on Their Intensities
US9880735B2 (en) 2015-08-10 2018-01-30 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10235035B2 (en) 2015-08-10 2019-03-19 Apple Inc. Devices, methods, and graphical user interfaces for content navigation and manipulation
US10275892B2 (en) 2016-06-09 2019-04-30 Google Llc Multi-view scene segmentation and propagation
US10354399B2 (en) 2017-05-25 2019-07-16 Google Llc Multi-view back-projection to a light-field

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040021663A1 (en) * 2002-06-11 2004-02-05 Akira Suzuki Information processing method for designating an arbitrary point within a three-dimensional space
US20090022396A1 (en) * 2007-07-06 2009-01-22 Tatsumi Watanabe Image processing device, image processing method, image processing system, program, storage medium, and integrated circuit

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5844574A (en) * 1995-05-22 1998-12-01 Umax Data Systems, Inc. System for enabling a CPU and an image processor to synchronously access a RAM
US6073036A (en) * 1997-04-28 2000-06-06 Nokia Mobile Phones Limited Mobile station with touch input having automatic symbol magnification function
KR100347439B1 (en) * 2001-02-28 2002-08-03 주식회사 에이터치 Method of Sensing the Pressure in Touch Screen and Structure of Sensing the Pressure in Touch Screen
TW521205B (en) * 2001-06-05 2003-02-21 Compal Electronics Inc Touch screen capable of controlling amplification with pressure
US7499040B2 (en) * 2003-08-18 2009-03-03 Apple Inc. Movable touch pad with added functionality
US7519223B2 (en) * 2004-06-28 2009-04-14 Microsoft Corporation Recognizing gestures and using gestures for interacting with software applications
US7743348B2 (en) * 2004-06-30 2010-06-22 Microsoft Corporation Using physical objects to adjust attributes of an interactive display application
JP4388878B2 (en) * 2004-10-19 2009-12-24 任天堂株式会社 Input processing program and an input processing unit
US7331245B2 (en) * 2005-11-22 2008-02-19 Avago Technologies Ecbu Ip Pte Ltd Pressure distribution sensor and sensing method
US20080024454A1 (en) * 2006-07-31 2008-01-31 Paul Everest Three-dimensional touch pad input device
US8559705B2 (en) * 2006-12-01 2013-10-15 Lytro, Inc. Interactive refocusing of electronic images
US7956847B2 (en) * 2007-01-05 2011-06-07 Apple Inc. Gestures for controlling, manipulating, and editing of media files using touch sensitive devices
JP4605214B2 (en) * 2007-12-19 2011-01-05 ソニー株式会社 The information processing apparatus, information processing method, and program
TW200943140A (en) * 2008-04-02 2009-10-16 Asustek Comp Inc Electronic apparatus and control method thereof
US8209628B1 (en) * 2008-04-11 2012-06-26 Perceptive Pixel, Inc. Pressure-sensitive manipulation of displayed objects
US8363020B2 (en) * 2009-08-27 2013-01-29 Symbol Technologies, Inc. Methods and apparatus for pressure-based manipulation of content on a touch screen
US8378985B2 (en) * 2010-05-26 2013-02-19 Sony Mobile Communications Ab Touch interface for three-dimensional display control
US9262002B2 (en) * 2010-11-03 2016-02-16 Qualcomm Incorporated Force sensing touch screen

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040021663A1 (en) * 2002-06-11 2004-02-05 Akira Suzuki Information processing method for designating an arbitrary point within a three-dimensional space
US20090022396A1 (en) * 2007-07-06 2009-01-22 Tatsumi Watanabe Image processing device, image processing method, image processing system, program, storage medium, and integrated circuit

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2610728A3 (en) * 2011-12-28 2017-10-11 Nintendo Co., Ltd. Information processing program, information processing system, and information processing method
EP3081150A1 (en) 2015-04-15 2016-10-19 Alasdair Ivan Andre Gant Skin protrusion size determination

Also Published As

Publication number Publication date
US20120057806A1 (en) 2012-03-08
US8625882B2 (en) 2014-01-07

Similar Documents

Publication Publication Date Title
US8674948B2 (en) Methods of interfacing with multi-point input devices and multi-point input systems employing interfacing techniques
US10042546B2 (en) Systems and methods to present multiple frames on a touch screen
US8466934B2 (en) Touchscreen interface
CN101001433B (en) Method for entering commands and/or characters for a communication device equipped with a tilt sensor
US20110221776A1 (en) Display input device and navigation device
EP2733591A1 (en) User interface device capable of execution of input by finger contact in plurality of modes, input operation assessment method, and program
US20140049483A1 (en) Display device and method for controlling the same
US20120105351A1 (en) Touch Pad Operable with Multi-Objects and Method of Operating same
US9207801B2 (en) Force sensing input device and method for determining force information
US9052765B2 (en) Method for operating a touch sensitive user interface
US20100214239A1 (en) Method and touch panel for providing tactile feedback
US9244544B2 (en) User interface device with touch pad enabling original image to be displayed in reduction within touch-input screen, and input-action processing method and program
JP6547039B2 (en) Crown input for wearable electronics
CN102902473B (en) The mode sensitive of touch data is handled
US20090102804A1 (en) Touch-based apparatus and method thereof
US8947353B2 (en) Photosensor array gesture detection
CN102257468B (en) Input device and method for adjusting a parameter of an electronic system
US20070070046A1 (en) Sensor-based touchscreen assembly, handheld portable electronic device having assembly, and method of determining touch location on a display panel
US9389722B2 (en) User interface device that zooms image in response to operation that presses screen, image zoom method, and program
US20110037778A1 (en) Apparatus And Method For Adjusting An Image In A Screen Of A Handheld Device
US20050088409A1 (en) Method of providing a display for a gui
KR100827243B1 (en) Information input device and method for inputting information in 3d space
JP2016192236A (en) Magnetic stylus
WO2015037389A1 (en) Map information display device, map information display method, and map information display program
AU2014391723B2 (en) Apportionment of forces for multi-touch input devices of electronic devices

Legal Events

Date Code Title Description
AK Designated contracting states:

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

AX Request for extension of the european patent to

Extension state: BA ME RS

17P Request for examination filed

Effective date: 20120529

17Q First examination report

Effective date: 20170327

RAP1 Transfer of rights of an ep published application

Owner name: SONY MOBILE COMMUNICATIONS AB

18R Refused

Effective date: 20180629