CN1906565A - 自适应用户界面输入设备 - Google Patents

自适应用户界面输入设备 Download PDF

Info

Publication number
CN1906565A
CN1906565A CNA2005800017196A CN200580001719A CN1906565A CN 1906565 A CN1906565 A CN 1906565A CN A2005800017196 A CNA2005800017196 A CN A2005800017196A CN 200580001719 A CN200580001719 A CN 200580001719A CN 1906565 A CN1906565 A CN 1906565A
Authority
CN
China
Prior art keywords
user interface
input
adaptive
computer code
sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2005800017196A
Other languages
English (en)
Other versions
CN100478847C (zh
Inventor
米克科·尼尔米
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nokia Technologies Oy
Original Assignee
Nokia Oyj
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Oyj filed Critical Nokia Oyj
Publication of CN1906565A publication Critical patent/CN1906565A/zh
Application granted granted Critical
Publication of CN100478847C publication Critical patent/CN100478847C/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
    • H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
    • H04B1/40—Circuits
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1626—Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1694—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72469—User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00—Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16—Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/163—Indexing scheme relating to constructional details of the computer
    • G06F2200/1637—Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/12—Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/22—Details of telephonic subscriber devices including a touch pad, a touch sensor or a touch detector

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本发明涉及一种自适应用户界面。当其被用在诸如移动之类的特定事件之中的时候，所述自适应用户界面将会提供更能避免出错的输入功能以及更高的易用性。依照本发明原理的用户界面包括用户输入、至少一个传感器以及在功能上与至少一个传感器进行通信并且被适配成改变其用户界面输入模式的显示单元。用户界面能够响应于传感器感测的激励来适配其用户界面输入。

Description

自适应用户界面输入设备
技术领域
本发明主要涉及用户界面的领域。更为特别的是，本发明涉及自适应用户界面。
背景技术
举个例子，传统的信息和通信系统可以包括用于帮助用户执行输入的用户输入设备、用于显示信息的显示设备以及用于接收、管理和处理用户输入及信息的处理器。很多现代的应用都整合了输入设备和显示设备的功能，以便创建直观和便于使用的用户界面。
目前，图形用户界面已被开发出来，在这种界面中，显示设备显示一系列的图标或菜单，用户则可以借助用户输入设备来对其进行选择或操作，以便提供用户输入。举例来说，在某些系统中，用户输入设备包含了鼠标或操纵杆之类的指示机构，该机构可被用于操纵一个指针越过显示设备上显示的图标或菜单项。用户则可以通过将指针定位在与某个图标或菜单项相关联的区域上以及点击选择按键来选择该图标或菜单项。
图形用户界面的另一个实例是包含了“触摸屏”的界面，其中用户是通过直接敲击显示设备或在显示设备上书写来提供输入的。该触摸屏可以显示图标或菜单，或者可以显示例如键盘或响应按钮的其它输入暗喻(metaphor)。并且举例来说，用户可以通过在与所期望的菜单项、图标、按键或按钮相关联的输入区域中敲击显示设备来选择菜单项、图标、键盘按键或响应按钮。所显示的键盘或按钮可以允许用户输入不同的信息片段，其中包括但不局限于电话号码、显示命令响应以及菜单选择。
其他设备可以配备手写识别软件，该软件能使用户借助指示笔而在输入区域中写入字母数字符号。然后，设备中的手写识别软件将会尝试解释和识别那些由用户借助指示笔而在输入区域上绘制的字母数字符号。一般来说，所输入的信息可以显示在图形显示器上，该显示器例如但不限于液晶显示器(LCD)。此外，图形显示器可用于显示菜单或不同的命令提示以及其他信息片段，例如但不限于号码、姓名、消息、菜单功能、设置以及例如定时器或高度计之类的其他应用信息。同样，该系统可以用于与图形显示器上显示的不同信息片段进行交互。
触摸屏用户界面自身可以用于显示图形用户界面。举例来说，这种触摸屏可以采用在图形显示器上显示的虚拟键盘的形式，其中显示器的分立输入区域借助触摸屏机构而与键盘功能的每一个按键相对应。与硬件输入用户界面相比，这些触摸屏用户界面被设计地更为直观并且更便于使用。
所有这些输入/显示设备共同的一个特征是，可以对用户界面输入暗喻和装置进行配置，以便满足特定的应用。很多情况下，这些用户界面是在移动电话或个人数字助理之类的移动设备中使用的。与移动设备相关联的显示设备通常相对较小，特别是与个人计算机之类的较少移动的系统的显示设备相比则更是如此。然而，至少部分是由于尺寸很小，在某些情况下，图形显示器和/或触摸界面是很难使用的。而某些环境条件，例如运动或抖动，则进一步增大了易用性和精确度的问题。不幸的是，在使用移动电话或个人数字助理之类的移动设备的时候，要想防止这种与较小尺寸的输入设备以及经常发生的典型的运动和环境条件相关联的问题将是非常困难的。虽然可以借助虚拟键盘、图标、菜单或手写识别系统来输入数据和命令，但是这时输入速度将会下降，而不舒适感则会提升，并且与使用全尺寸键盘或是在不进行运动的常规条件下操作键盘或输入设备的情况相比，此时的差错率将会增大很多。
对于这些时常很难使用图形显示触摸界面的状况而言，其中一种状况是用户处于运动过程中，例如在用户行走的时候，由此该图形显示器这时同样也处于运动之中。而另一种难以使用图形显示触摸界面的状况则是用户坐在某种交通工具中，由此图形显示触摸接口将会振动或抖动。在这些情况下，用户往往无法将注意力集中在正在移动的图形显示触摸界面上，或者无法借助例如指示笔或用户手指来启动图形显示触摸界面。
由此，在本领域中需要一种用户界面，其中该界面以一种自适应方式来组合显示与输入设备，以便解决与这些设备相关联的问题，由此实现诸如舒适度和易用性之类的附加益处。
发明内容
本发明的一个实施例涉及一种可适应的用户界面。该用户界面能对借助传感器察觉的激励做出响应。依照本发明的原理，在这里可以使用一个或多个能够检测一种或多种激励的传感器。在一个实施例中，用户界面在触摸屏上显示图形暗喻，例如图标、菜单项、虚拟键盘和/或响应按钮，其中诸如大小之类的暗喻的配置及显示特征是响应于运动之类的激励而改变的。
对依照本发明原理的设备而言，该设备包括能对激励进行适应的用户界面。依照本发明原理所制造的设备可以包括移动电话和个人数字助理之类的移动电子设备，但是并不局限于此。
附图说明
图1是一个依照本发明的原理并且包含了自适应用户界面输入的设备实施例的图示。
图2是依照本发明的原理并且包含了自适应用户界面输入的设备的另一个实施例的图示。
图3是依照本发明原理的用户界面的一个实施例的图示。
图4是依照本发明原理的用户界面的另一个实施例的图示。
图5是依照本发明原理的用户界面的另一个实施例的图示。
图6是依照本发明原理的用户界面的另一个实施例的图示。
图7是依照本发明原理的用户界面的另一个实施例的图示。
图8是依照本发明原理的示例传感器架构的一个实施例的框图。
图9是描述依照本发明原理而对用户界面输入设备进行适配的例程的一个实施例的流程图。
具体实施方式
本发明的一个实施例涉及的是自适应用户界面的应用，其中该应用通过提供舒适和便于使用的界面而解决了那些与现有技术相关联的问题。
为了提供这些附加益处，依照本发明原理的用户界面包括用于对环境进行感测的装置，该装置可以用于使用户界面适应于当前环境。举个例子，在这里可以使用传感器来感测运动之类的环境状况，由此可以通过例如增大用户界面的用户输入区域而使用户在设备抖动时更容易进行输入来使用户界面与环境状况相适应。此外，该传感器也可以被配置成对设备停止移动和/或抖动的时间进行感测，然后用户界面则可以返回到“正常”工作模式。
现在参考附图，图1描述的是依照本发明的自适应用户界面的一种可能应用。图1描述的是一个引入到移动电话12中的自适应用户界面10。所述自适应用户界面10包括显示屏14以及指针控制设备16。该显示屏14通过显示图标18、菜单20、列表等等而提供了一个图形用户界面，用户则可以通过操纵指示设备16来选择这些图标、菜单、列表等等。在这种情况下，指示设备16包括操纵杆类型的控制器，以便操纵指针越过所要选择的预期项目。
移动电话12可以包括用于感测环境状况的传感器，以及用于使用户界面适应于所感测的环境状况的控制器。该传感器可以包括下列加速度计、运动检测器、振动检测器、传导球体以及这些设备的组合中的一个或多个，但是并不局限于此。在某些实施例中，传感器包含不同类型的传感器阵列。并且在这里可以使用物理传感器、逻辑传感器或是其组合。依照本发明原理的传感器能够返回来自可能值集合域(可能值的域P)的标量、矢量或符号值(Vxt，其中x表示特定传感器的预分配编号，t表示时间)。举例来说，依照本发明原理的设备可以包括能够检测设备是否运动的传感器。
在使用了一个用于检测运动的传感器的系统中，另一个可能的值采样域(只用于进行说明，并没有对本发明的范围构成限制)可以包括三个可能的输出：表示恰当环境状况中的增大(也就是运动)的a2，表示减小的a0，或是表示相对于进行测量的最后一个时间间隔不变的a1。
表1传感器信号和界面响应的采样域
 关于时间(T)的响应域
运动V1t  0(较少的运动)   1(运动不变)   2(较多运动)
输出  自适应状态(用户界面中的减小响应)   静止状态(用户界面不变)   自适应状态(用户界面中的增大响应)
传感器可以是更复杂的结构的一部分。举例来说，依照本发明原理的用户界面可以将传感器之类的硬件与各种应用或脚本之类的软件结合使用，以便确定当前状态以及解释所述状态的任何变化。
在某些实施例中，用户界面是在具有全球定位系统(GPS)的设备中使用的。所述GPS可以被适配成充当一个运动传感器。举例来说，GPS可以向某个计数器输出坐标，该计数器则能够从设备的全球定位中判定设备处于移动还是静止状态。
在某些实施例中，其中使用的是能够检测振动的运动传感器。举例来说，在这里可以使用一种传感器，该传感器包含部署在圆柱形外壳中并且被适于在圆柱形外壳内部通过移动来检测运动的传导球体。所述圆柱形外壳包含了大量的电路，在与传导球体相接触的时候，这些电路能够短路。
在一个实施例中，用户界面10会响应于来自传感器的信号而进行适配。该用户界面10可以基于来自传感器的信号而在不同的预确定模式之间进行切换，从而进行适配。所述预确定模式可以预先设置，也可以由用户进行配置或是重新配置。而这些模式可以包括但不局限于输入区域改变、显示内容重新排列、指针控制设备16的灵敏度改变或是上述这些模式的组合。举例来说，在没有感测到运动或“振动”的时候，用户界面10可以在“正常模式”中工作，而在检测到运动的时候，它可以切换到“移动模式”，以便将用户界面10适配成对运动进行补偿。所感测的“运动”可以采用实际运动、振动、抖动或是移动设备的其他任何移动的形式。
图2显示了自适应用户界面输入设备的另一个可能的应用。依照本发明的自适应用户界面输入设备10可以引入到个人数字助理(PDA)或是其他移动媒体设备22中，其中举例来说，所述移动媒体设备可以是移动电子游戏设备或移动多功能设备，例如Nokia 7700媒体设备。在这个实施例中，自适应用户界面10包括触摸屏显示器24。该触摸屏显示器24则是通过显示图标18(参见图3)、菜单20(参见图4)、列表26(参见图5)、虚拟键盘28(参见图6)、响应按钮30(参见图5)和/或手写识别输入区域32(参见图7)以及滚动条34等的各种显示控制工具来提供图形用户界面的。可以使用指示笔36来选择或操纵触摸屏显示器24上显示的项目。另外还可以提供轨迹球指示设备38，以便作为提供用户输入的替换装置来操纵触摸屏显示器24上的指针。
与先前的实施例一样，可以包含传感器38(参见图8)用于对运动或抖动之类的环境状况进行感测。然后，用户界面10可以被适配成适应所感测的环境状况，如前所述。举例来说，对图3所示的图标18而言，响应于传感器检测到运动或抖动，每个图标18的大小都可以增大，由此增大触摸屏显示器24上每个图标18的用户输入区域。这样做能使用户更容易地选择图标18。此外，对滚动栏34之类的显示控制工具来说，其大小也可以增大，以便易于使用。也可以对菜单20(图4)、列表26和响应按钮30(图5)、虚拟键盘28的按键(图6)以及手写识别输入区域32(图7)来说进行相同的处理。
此外，在这里也可以响应于所感测的环境状况来进行各种其他的自适应处理，以便提升精确度和易用性。举例来说，在感测到运动或抖动的时候，可以降低触摸屏显示器24的灵敏度，以便减小用户因为移动媒体设备22的意外移动而使指示笔36偶然碰触到触摸屏显示器所导致的非有意地选择命令的次数。此外，触摸屏上显示的项目可以采用不同的形式重新排列，甚至可以禁用和/或清除，以便与不同的环境状况相适应。
在触摸屏显示器24显示了虚拟键盘28的一个实施例中，可以响应于来自传感器38的信号而改变虚拟键盘28的图形显示。在一个移动媒体设备22包含一个传感器阵列的实施例中，键盘28可以根据当时接收到的特定信号集合而以不同的预定方式改变。举例来说，如果使用了加速度计以及光传感器，那么可以通过增大键盘按键的用户输入区域大小以及提升显示器的对比度和亮度来响应一组用于表示正在运动以及光线减弱的信号，从而改变键盘的图形显示。依照本发明的原理，键盘28的布局可以响应于某种激励而被重新调整。此外，举例来说，键盘28的内容可以通过删除最少使用的按键或是改变触摸屏显示器24自身的灵敏度而改变。用户界面输入自适应之间的时间间隔则可以引入到设备中，由此用户界面输入不会过于频繁地变化，以免对设备的易用性造成不利的影响。
举例来说，该传感器可以包括但不限于能够检测x、y、z轴所表示的三维上的运动的加速度计或一个加速度计阵列。响应于恰当的激励，该传感器输出信号，而设备则会将这个信号解释成是需要或不需要在用户界面10中进行自适应处理。举例来说，响应于指示运动的信号，用户界面10可以通过重新配置键盘28上的个别按键的排列、增大每个按键的输入区域的大小和/或减小触摸屏显示器24的灵敏度来进行适配。
图8显示的是用于描述依照本发明的可能的传感器架构实施例的框图。如图8所示，多个传感器38可以用于感测不同的环境状况。这些传感器38可以与控制器40相连，该控制器则接收并处理那些来自传感器38的信号。控制器40与自适应用户界面10相连，并且该控制器可以被配置成根据传感器38感测的不同状况来判定是否改变用户界面10的状态或功能，以及在必要的时候开始进行改变。
图9描述的是控制器40所使用的用于判定是否需要使用户界面10适应于所感测的环境状况的一个例程实例。该设备可以在“正常”模式中开始操作(步骤42)，其中该模式提供的是一组默认的用户输入选项。一旦由传感器检测到激励(步骤44)，那么控制器将会判定传感器检测的激励是否需要用户界面进行适应(步骤46)。如果不需要，那么该例程返回到步骤44，以便等待传感器检测另一个激励。如果需要的话，那么用户界面将被适配成与所感测的环境状况相适应(步骤48)，并且这时将会开始一个用于指示从用户界面进行适应起所经历的时间的定时器(步骤50)。当传感器检测到另一个激励(步骤52)时，检查该定时器以便判定从用户界面最后一次进行适应起是否经过了预定的最小时间量(步骤54)。如果已经经过了最小时间量，那么该例程将会返回到步骤46，以便确定是否应该对用户界面进行适配，如果应该进行适配，则使用户界面与新感测的环境状况相适应(步骤48)，而定时器则会复位(步骤50)，并且该例程将会等待定时器检测下一个激励(步骤52)。此外，在这里可以对这些传感器进行周期性轮询，以便检查环境状况的当前状态。
以上关于本发明的描述概述了自适应用户界面系统和方法的示范性实施例。仅出于说明目的，在这里阐述了众多具体细节，以便提供关于本发明的全面理解。但是对本领域技术人员来说，很明显，这些示范性实施例是可以在没有这些具体细节的情况下实现的。在其他实例中，结构和设备是以框图或列表形式显示的，由此进一步有助于对示范性实施例进行描述。
虽然附图和上文所述的示范性实施例是优选的，但是应该理解，这些实施例仅仅是作为实例提供的。并且举例来说，其他的实施例可以包括用于执行相同操作的不同技术。本发明并不局限于特定的实施例，而是可以扩展成仍旧处于本领域普通技术人员所能理解的附加权利要求的范围和实质以内的不同的修改、组合和排列。

Claims (40)

1.一种自适应用户界面输入，包括：
至少一个能够感测运动的传感器；以及
与所述至少一个传感器进行通信的用户界面输入设备，所述用户界面输入设备被配置成与该至少一个传感器感测的运动相适应。
2.权利要求1的用户界面，其中该用户界面包括一种工作模式，并且该工作模式被配置成响应于所述至少一个传感器感测的运动而从正常工作模式切换到移动工作模式。
3.权利要求2的用户界面，其中所述至少一个传感器还能够感测到没有进行运动，并且用户界面以及用户界面的工作模式被配置成响应于所述至少一个传感器感测的没有运动的状况而从移动工作模式切换到正常工作模式。
4.权利要求1的用户界面，其中用户界面输入设备还包括显示设备和输入设备，所述显示设备被配置成显示输出暗喻，而输入设备则被配置成通过选择输入暗喻来提供输入。
5.权利要求4的用户界面，其中显示设备和输入设备包括触摸屏。
6.权利要求1的用户界面，其中用户界面输入设备还包括手写识别用户输入区域。
7.权利要求4的用户界面，其中输入暗喻包括图标、菜单、响应按钮、列表、显示控制工具和/或虚拟键盘。
8.权利要求4的用户界面，其中输入暗喻的大小可以根据所述至少一个传感器感测的运动而被调整。
9.权利要求4的用户界面，其中输入设备的灵敏度可以根据所述至少一个传感器感测的运动而被调整。
10.权利要求4的用户界面，其中某些输入暗喻可以根据所述至少一个传感器感测的运动而被重新排列、移除或添加。
11.权利要求6的用户界面，其中手写识别用户输入区域的大小和/或灵敏度可以根据所述至少一个传感器所感测的运动而被调整。
12.权利要求1的用户界面，还包括一个用于跟踪用户界面输入设备适配之间的预定最小时间量的定时器，由此只有在从最后一次对用户界面输入设备进行适配起经过了最小时间量之后才会适配所述用户界面输入设备。
13.权利要求2的用户界面，其中移动工作模式包括预先设定的用户界面。
14.权利要求2的用户界面，其中移动工作模式可以由用户进行配置。
15.一种移动设备，包括：
至少一个能够感测运动的传感器；
自适应用户界面，所述用户界面包括与所述至少一个传感器进行通信的用户界面输入设备，该用户界面输入设备被配置成与所述至少一个传感器感测的运动相适应。
16.权利要求15的移动设备，其中该设备包括移动通信设备。
17.权利要求15的移动设备，其中该设备包括移动电话。
18.权利要求15的移动设备，其中该设备包括移动媒体设备。
19.权利要求15的移动设备，其中该设备包括个人数字助理。
20.权利要求15的移动设备，其中用户界面输入设备还包括显示设备和输入设备，显示设备被配置成显示输入暗喻，输入设备被配置成通过选择输入暗喻来提供输入，其中输入暗喻的大小、输入设备灵敏度和/或暗喻的排列及类型可以根据所述至少一个传感器感测的运动而被调整。
21.权利要求15的移动设备，其中用户界面输入设备还包括触摸屏。
22.权利要求15的移动设备，其中用户界面输入设备还包括手写识别用户输入区域。
23.权利要求15的移动设备，还包括用于跟踪用户界面输入设备适配之间的预定最小时间量的定时器，由此只有在从最后一次对用户界面输入设备进行适配起经过了最小时间量之后才会适配所述用户界面输入设备。
24.权利要求15的移动设备，其中所述至少一个传感器是从以下群组中选出的：加速度计、运动检测器、振动检测器、传导球体或全球定位系统。
25.一种用于使用户界面与运动相适应的方法，其中包括以下步骤：
感测用户界面运动的改变；
确定是否应该响应于所感测的变化而对用户界面进行适配；以及
如果需要的话，响应于所感测的变化来对用户界面进行适配。
26.权利要求25的方法，其中用户界面包括一种工作模式，并且其中适配用户界面的步骤还包括响应于所感测的变化而在正常工作模式与移动工作模式之间进行变更。
27.权利要求25的方法，还包括以下步骤：
在适配了用户界面之后，启动定时器；
感测运动中的第二变化；
确定从适配了用户界面时起是否经过了预定的时间量；以及
如果已经经过了预定时间量：
则确定是否应该响应于第二变化来对用户界面进行适配；以及如果需要的话，则响应于第二变化来适配用户界面。
28.权利要求25的方法，其中适配用户界面的步骤还包括调整用户界面上显示的输入暗喻的大小。
29.权利要求25的方法，其中适配用户界面的步骤还包括调整用户界面对于输入命令的灵敏度。
30.权利要求25的方法，其中适配用户界面的步骤还包括重新排列、移除和/或添加输入暗喻到所述用户界面。
31.权利要求26的方法，其中移动工作模式是预先设定的。
32.权利要求26的方法，其中移动工作模式可以由用户进行配置。
33.一种计算机程序产品，包括：
计算机代码，该代码被配置成：
感测用户界面运动的改变；
确定是否应该响应于所感测的变化而对用户界面进行适配；以及
如果需要的话，响应于所感测的变化来对用户界面进行适配。
34.权利要求33的计算机程序产品，其中所包含的计算机代码还包括正常工作模式以及移动工作模式。
35.权利要求33的计算机程序产品，其中适配用户界面的计算机代码还包括在适配了用户界面之后启动定时器的计算机代码；
其中感测运动变化的计算机代码还包括感测运动中的第二变化的计算机代码；
其中确定是否应该适配用户界面的计算机代码还包括用于判定从适配了用户界面时起是否经过了预定时间量以及在经过了预定时间量的情况下判定是否应该响应于第二变化来适配用户界面的计算机代码；以及
其中用于适配用户界面的计算机代码还包括用于响应于第二变化来适配用户界面的计算机代码。
36.权利要求33的计算机代码产品，其中用于适配用户界面的计算机代码还包括用于调整用户界面上显示的输入暗喻大小的计算机代码。
37.权利要求33的计算机代码产品，其中用于适配用户界面的计算机代码还包括用于调整用户界面对于输入命令的灵敏度的计算机代码。
38.权利要求33的计算机代码产品，其中用于适配用户界面的计算机代码还包括用于重新排列、移除和/或添加输入暗喻到用户界面的计算机代码。
39.权利要求34的计算机代码产品，其中移动工作模式是预先设定的。
40.权利要求34的计算机代码产品，还包括允许用户配置移动工作模式的计算机代码。
CNB2005800017196A 2004-01-09 2005-01-06 自适应用户界面输入设备 Active CN100478847C (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/755,111 2004-01-09
US10/755,111 US7401300B2 (en) 2004-01-09 2004-01-09 Adaptive user interface input device

Publications (2)

Publication Number Publication Date
CN1906565A true CN1906565A (zh) 2007-01-31
CN100478847C CN100478847C (zh) 2009-04-15

Family

ID=34739511

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2005800017196A Active CN100478847C (zh) 2004-01-09 2005-01-06 自适应用户界面输入设备

Country Status (5)

Country Link
US (1) US7401300B2 (zh)
EP (1) EP1702256A1 (zh)
KR (1) KR100880855B1 (zh)
CN (1) CN100478847C (zh)
WO (1) WO2005069111A1 (zh)

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101901072A (zh) * 2009-05-26 2010-12-01 索尼公司 信息处理设备、信息处理方法和程序
CN102089744A (zh) * 2008-06-06 2011-06-08 苹果公司 用于移动设备的应用管理的用户界面
WO2011079436A1 (en) * 2009-12-29 2011-07-07 Nokia Corporation Method and apparatus for notification of input environment
CN102279708A (zh) * 2011-08-15 2011-12-14 广州市动景计算机科技有限公司 一种数据输入处理方法及装置
CN102547324A (zh) * 2010-09-22 2012-07-04 株式会社尼康 图像显示装置及摄像装置
CN103246441A (zh) * 2013-03-25 2013-08-14 东莞宇龙通信科技有限公司 终端设备的屏幕显示方法及终端设备
CN103268192A (zh) * 2013-06-14 2013-08-28 北京捷讯华泰科技有限公司 基于关键词搜索的可调节文本输入界面方法
CN103294121A (zh) * 2012-02-23 2013-09-11 株式会社和冠 手写信息输入装置及具备该装置的便携电子设备
CN103309585A (zh) * 2012-03-12 2013-09-18 联想(北京)有限公司 一种信息处理方法及电子设备
CN103365569A (zh) * 2012-03-26 2013-10-23 宇龙计算机通信科技(深圳)有限公司 触摸键盘的显示处理方法和移动终端
CN103500047A (zh) * 2013-09-23 2014-01-08 百度在线网络技术（北京）有限公司 移动终端中交互元素的控制方法、装置和移动终端
CN103838361A (zh) * 2012-11-27 2014-06-04 联想(北京)有限公司 一种信息交互方法、装置及电子设备
CN102246116B (zh) * 2008-12-15 2014-09-24 符号技术有限公司 界面适配系统
CN101978337B (zh) * 2008-02-11 2014-11-05 苹果公司 屏幕的运动补偿
CN104160362A (zh) * 2012-03-07 2014-11-19 印象笔记公司 针对不利使用条件调整移动用户界面
TWI493394B (zh) * 2009-03-24 2015-07-21 微軟公司 雙模態觸控靈敏數位筆記型電腦
CN105468230A (zh) * 2008-04-30 2016-04-06 宏达国际电子股份有限公司 用户界面切换方法及使用该方法的电子装置与存储介质
CN106293199A (zh) * 2016-07-26 2017-01-04 广东小天才科技有限公司 一种控制触摸屏的方法及装置
US9837050B2 (en) 2012-03-12 2017-12-05 Lenovo (Beijing) Co., Ltd. Information processing method, method for driving image collection unit and electrical device
CN107577273A (zh) * 2012-12-13 2018-01-12 卡西欧计算机株式会社 信息显示装置、信息显示方法、记录介质及信息显示系统
CN105678148B (zh) * 2016-01-07 2018-07-06 江苏中威科技软件系统有限公司 一种手写签批内容与底层文档相互控制方法及系统
CN114296512A (zh) * 2016-02-29 2022-04-08 谷歌有限责任公司 具有可动态配置的用户输入装置的计算装置及其操作方法

Families Citing this family (332)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7808479B1 (en) 2003-09-02 2010-10-05 Apple Inc. Ambidextrous mouse
US8645137B2 (en) 2000-03-16 2014-02-04 Apple Inc. Fast, language-independent method for user authentication by voice
US20030152070A1 (en) * 2002-02-04 2003-08-14 Siemens Aktiengesellschaft Method for transmitting signaling messages between first and second network units, and radio communication system and base station subsystem therefor
US11275405B2 (en) * 2005-03-04 2022-03-15 Apple Inc. Multi-functional hand-held device
US7656393B2 (en) 2005-03-04 2010-02-02 Apple Inc. Electronic device having display and surrounding touch sensitive bezel for user interface and control
US7853563B2 (en) 2005-08-01 2010-12-14 Seven Networks, Inc. Universal data aggregation
US20080129552A1 (en) * 2003-10-31 2008-06-05 Iota Wireless Llc Concurrent data entry for a portable device
EP1678654A4 (en) 2003-10-31 2008-07-02 Iota Wireless Llc SIMULTANEOUS DATA ENTRY FOR A PORTABLE DEVICE
US20050222801A1 (en) * 2004-04-06 2005-10-06 Thomas Wulff System and method for monitoring a mobile computing product/arrangement
US7489305B2 (en) * 2004-12-01 2009-02-10 Thermoteknix Systems Limited Touch screen control
US20060206824A1 (en) * 2005-03-10 2006-09-14 Agere Systems Inc. Mobile communication device having scroll overlap adjustment capability and method of operation thereof
JP4696734B2 (ja) * 2005-07-06 2011-06-08 ソニー株式会社 コンテンツデータ再生装置及びコンテンツデータ再生方法
US7822513B2 (en) * 2005-07-27 2010-10-26 Symbol Technologies, Inc. System and method for monitoring a mobile computing product/arrangement
EP1752860B1 (en) * 2005-08-12 2015-03-18 LG Electronics Inc. Mobile terminal with touch screen providing haptic feedback and corresponding method
US20100180238A1 (en) * 2005-08-15 2010-07-15 Koninklijke Philips Electronics, N.V. User interface system for a personal healthcare environment
US8677377B2 (en) 2005-09-08 2014-03-18 Apple Inc. Method and apparatus for building an intelligent automated assistant
US20070130523A1 (en) * 2005-12-01 2007-06-07 Tai-Yeon Ku User interface automatic transform system and method based on display device
US7773739B2 (en) * 2005-12-07 2010-08-10 3Com Corporation Self-configurable telephony architecture
US7882435B2 (en) * 2005-12-20 2011-02-01 Sony Ericsson Mobile Communications Ab Electronic equipment with shuffle operation
MY150138A (en) 2005-12-29 2013-11-29 Ozmiz Pty Ltd Method and system for displaying data on a mobile terminal
US7509588B2 (en) 2005-12-30 2009-03-24 Apple Inc. Portable electronic device with interface reconfiguration mode
WO2007086371A1 (ja) * 2006-01-30 2007-08-02 Kyocera Corporation 文字入力装置
US7764247B2 (en) 2006-02-17 2010-07-27 Microsoft Corporation Adaptive heads-up user interface for automobiles
US7493151B2 (en) * 2006-03-14 2009-02-17 Sony Ericsson Mobile Communications Ab Housing arrangement for a portable device with a display
WO2007105130A2 (en) * 2006-03-14 2007-09-20 Koninklijke Philips Electronics N.V. Method of generating content on a display device
US20070216641A1 (en) * 2006-03-20 2007-09-20 Motorola, Inc. User interface stabilization method and system
US20070247422A1 (en) 2006-03-30 2007-10-25 Xuuk, Inc. Interaction techniques for flexible displays
US20100045705A1 (en) * 2006-03-30 2010-02-25 Roel Vertegaal Interaction techniques for flexible displays
US10048860B2 (en) * 2006-04-06 2018-08-14 Google Technology Holdings LLC Method and apparatus for user interface adaptation
US7880718B2 (en) * 2006-04-18 2011-02-01 International Business Machines Corporation Apparatus, system, and method for electronic paper flex input
US7556204B2 (en) * 2006-04-19 2009-07-07 Nokia Corproation Electronic apparatus and method for symbol input
US20070268261A1 (en) * 2006-05-17 2007-11-22 Erik Lipson Handheld electronic device with data entry and/or navigation controls on the reverse side of the display
TW200744352A (en) * 2006-05-26 2007-12-01 Benq Corp Mobile communication devices and methods for displaying menu thereof
US20070297028A1 (en) * 2006-06-21 2007-12-27 Thomas Wulff System and device for monitoring a computing device
CN101094466A (zh) * 2006-06-21 2007-12-26 明基电通股份有限公司 移动通讯装置及其选单操作画面的显示方法
US8594742B2 (en) 2006-06-21 2013-11-26 Symbol Technologies, Inc. System and method for monitoring a mobile device
US20080046839A1 (en) * 2006-06-27 2008-02-21 Pixtel Media Technology (P) Ltd. Input mode switching methods and devices utilizing the same
US20080001929A1 (en) * 2006-06-28 2008-01-03 Thomas Wulff Touch panel system and method for activation thereof
US20080009325A1 (en) * 2006-07-10 2008-01-10 Research In Motion Limited Menu interface for mobile communications device
US20080030456A1 (en) * 2006-07-19 2008-02-07 Sony Ericsson Mobile Communications Ab Apparatus and Methods for Providing Motion Responsive Output Modifications in an Electronic Device
US20090271739A1 (en) * 2006-07-20 2009-10-29 Matsushita Electric Industrial Co., Ltd. Input control unit
WO2008021175A2 (en) * 2006-08-11 2008-02-21 Wms Gaming Inc. Wagering game with auto-triggered player-input device
US10313505B2 (en) 2006-09-06 2019-06-04 Apple Inc. Portable multifunction device, method, and graphical user interface for configuring and displaying widgets
US8564544B2 (en) 2006-09-06 2013-10-22 Apple Inc. Touch screen device, method, and graphical user interface for customizing display of content category icons
US7940250B2 (en) * 2006-09-06 2011-05-10 Apple Inc. Web-clip widgets on a portable multifunction device
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US20080072174A1 (en) * 2006-09-14 2008-03-20 Corbett Kevin M Apparatus, system and method for the aggregation of multiple data entry systems into a user interface
US20080074384A1 (en) * 2006-09-22 2008-03-27 Research In Motion Limited System and method for adjusting icons, text and images on an electronic device
EP1912109A1 (en) * 2006-09-22 2008-04-16 Research In Motion Limited System and method for adjusting icons, text and images on an electronic device
US8519964B2 (en) 2007-01-07 2013-08-27 Apple Inc. Portable multifunction device, method, and graphical user interface supporting user navigations of graphical objects on a touch screen display
US8788954B2 (en) * 2007-01-07 2014-07-22 Apple Inc. Web-clip widgets on a portable multifunction device
US10437459B2 (en) 2007-01-07 2019-10-08 Apple Inc. Multitouch data fusion
KR101496451B1 (ko) * 2007-01-19 2015-03-05 엘지전자 주식회사 단말기 및 이를 이용한 스크롤 바의 표시방법
KR101266265B1 (ko) * 2007-03-12 2013-05-22 삼성전자주식회사 쿼티키를 갖는 이동통신 단말기 및 그의 이중톤 다중주파수 신호 출력 방법
EP1975783A1 (en) * 2007-03-31 2008-10-01 Sony Deutschland Gmbh Method and system for adapting a user interface of a device
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US9933937B2 (en) 2007-06-20 2018-04-03 Apple Inc. Portable multifunction device, method, and graphical user interface for playing online videos
US9772751B2 (en) 2007-06-29 2017-09-26 Apple Inc. Using gestures to slide between user interfaces
US8619038B2 (en) 2007-09-04 2013-12-31 Apple Inc. Editing interface
US9619143B2 (en) 2008-01-06 2017-04-11 Apple Inc. Device, method, and graphical user interface for viewing application launch icons
US11126321B2 (en) * 2007-09-04 2021-09-21 Apple Inc. Application menu user interface
US8631358B2 (en) 2007-10-10 2014-01-14 Apple Inc. Variable device graphical user interface
US8312373B2 (en) * 2007-10-18 2012-11-13 Nokia Corporation Apparatus, method, and computer program product for affecting an arrangement of selectable items
US8107878B2 (en) * 2007-11-07 2012-01-31 Motorola Mobility, Inc. Methods and apparatus for user-selectable programmable housing skin sensors for user mode optimization and control
US10002189B2 (en) 2007-12-20 2018-06-19 Apple Inc. Method and apparatus for searching using an active ontology
TWI420341B (zh) * 2007-12-31 2013-12-21 Htc Corp 顯示螢幕上選單之方法及其行動裝置
US9330720B2 (en) 2008-01-03 2016-05-03 Apple Inc. Methods and apparatus for altering audio output signals
KR101467885B1 (ko) * 2008-01-04 2014-12-02 엘지전자 주식회사 터치스크린의 감도를 조절할 수 있는 휴대 단말기 및 그제어방법
US8131319B2 (en) * 2008-01-17 2012-03-06 Sony Ericsson Mobile Communications Ab Active display readability enhancement for mobile devices depending on movement
US8676224B2 (en) 2008-02-19 2014-03-18 Apple Inc. Speakerphone control for mobile device
US8996376B2 (en) 2008-04-05 2015-03-31 Apple Inc. Intelligent text-to-speech conversion
US10496753B2 (en) 2010-01-18 2019-12-03 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US9225817B2 (en) * 2008-06-16 2015-12-29 Sony Corporation Method and apparatus for providing motion activated updating of weather information
US20100030549A1 (en) 2008-07-31 2010-02-04 Lee Michael M Mobile device having human language translation capability with positional feedback
US8108777B2 (en) 2008-08-11 2012-01-31 Microsoft Corporation Sections of a presentation having user-definable properties
US20100042954A1 (en) * 2008-08-12 2010-02-18 Apple Inc. Motion based input selection
US8676904B2 (en) 2008-10-02 2014-03-18 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
EP2175343A1 (en) * 2008-10-08 2010-04-14 Research in Motion Limited A method and handheld electronic device having a graphical user interface which arranges icons dynamically
KR101510738B1 (ko) * 2008-10-20 2015-04-10 삼성전자주식회사 휴대단말의 대기화면 구성 방법 및 장치
US20100146444A1 (en) * 2008-12-05 2010-06-10 Microsoft Corporation Motion Adaptive User Interface Service
WO2010067118A1 (en) 2008-12-11 2010-06-17 Novauris Technologies Limited Speech recognition involving a mobile device
US8250001B2 (en) * 2008-12-18 2012-08-21 Motorola Mobility Llc Increasing user input accuracy on a multifunctional electronic device
US10127524B2 (en) 2009-05-26 2018-11-13 Microsoft Technology Licensing, Llc Shared collaboration canvas
JP2010277197A (ja) * 2009-05-26 2010-12-09 Sony Corp 情報処理装置、情報処理方法およびプログラム
US10255566B2 (en) 2011-06-03 2019-04-09 Apple Inc. Generating and processing task items that represent tasks to perform
US9858925B2 (en) 2009-06-05 2018-01-02 Apple Inc. Using context information to facilitate processing of commands in a virtual assistant
US10241752B2 (en) 2011-09-30 2019-03-26 Apple Inc. Interface for a virtual digital assistant
US10241644B2 (en) 2011-06-03 2019-03-26 Apple Inc. Actionable reminder entries
US8970475B2 (en) * 2009-06-19 2015-03-03 Apple Inc. Motion sensitive input control
US9431006B2 (en) 2009-07-02 2016-08-30 Apple Inc. Methods and apparatuses for automatic speech recognition
US9304601B2 (en) * 2009-07-08 2016-04-05 Open Invention Network, Llc System, method, and computer-readable medium for facilitating adaptive technologies
US8654524B2 (en) 2009-08-17 2014-02-18 Apple Inc. Housing as an I/O device
US20110050575A1 (en) * 2009-08-31 2011-03-03 Motorola, Inc. Method and apparatus for an adaptive touch screen display
EP2312416A1 (en) * 2009-10-14 2011-04-20 Research In Motion Limited Touch-sensitive display and method of controlling same
US8161417B1 (en) * 2009-11-04 2012-04-17 Sprint Communications Company L.P. Enhancing usability of a moving touch screen
US8621380B2 (en) 2010-01-06 2013-12-31 Apple Inc. Apparatus and method for conditionally enabling or disabling soft buttons
US8692851B2 (en) * 2010-01-06 2014-04-08 Apple Inc. Device, method, and graphical user interface with grid transformations during device rotation
US8736561B2 (en) 2010-01-06 2014-05-27 Apple Inc. Device, method, and graphical user interface with content display modes and display rotation heuristics
US10705794B2 (en) 2010-01-18 2020-07-07 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US10679605B2 (en) 2010-01-18 2020-06-09 Apple Inc. Hands-free list-reading by intelligent automated assistant
US10276170B2 (en) 2010-01-18 2019-04-30 Apple Inc. Intelligent automated assistant
US10553209B2 (en) 2010-01-18 2020-02-04 Apple Inc. Systems and methods for hands-free notification summaries
WO2011089450A2 (en) 2010-01-25 2011-07-28 Andrew Peter Nelson Jerram Apparatuses, methods and systems for a digital conversation management platform
US8682667B2 (en) 2010-02-25 2014-03-25 Apple Inc. User profiling for selecting user specific voice input processing information
KR20130000401A (ko) 2010-02-28 2013-01-02 오스터하우트 그룹 인코포레이티드 대화형 머리­장착식 아이피스 상의 지역 광고 컨텐츠
US9129295B2 (en) 2010-02-28 2015-09-08 Microsoft Technology Licensing, Llc See-through near-eye display glasses with a fast response photochromic film system for quick transition from dark to clear
US10180572B2 (en) 2010-02-28 2019-01-15 Microsoft Technology Licensing, Llc AR glasses with event and user action control of external applications
US9134534B2 (en) 2010-02-28 2015-09-15 Microsoft Technology Licensing, Llc See-through near-eye display glasses including a modular image source
US9182596B2 (en) 2010-02-28 2015-11-10 Microsoft Technology Licensing, Llc See-through near-eye display glasses with the optical assembly including absorptive polarizers or anti-reflective coatings to reduce stray light
US20120194550A1 (en) * 2010-02-28 2012-08-02 Osterhout Group, Inc. Sensor-based command and control of external devices with feedback from the external device to the ar glasses
US9285589B2 (en) 2010-02-28 2016-03-15 Microsoft Technology Licensing, Llc AR glasses with event and sensor triggered control of AR eyepiece applications
US9341843B2 (en) 2010-02-28 2016-05-17 Microsoft Technology Licensing, Llc See-through near-eye display glasses with a small scale image source
US9223134B2 (en) 2010-02-28 2015-12-29 Microsoft Technology Licensing, Llc Optical imperfections in a light transmissive illumination system for see-through near-eye display glasses
US9229227B2 (en) 2010-02-28 2016-01-05 Microsoft Technology Licensing, Llc See-through near-eye display glasses with a light transmissive wedge shaped illumination system
US20150309316A1 (en) 2011-04-06 2015-10-29 Microsoft Technology Licensing, Llc Ar glasses with predictive control of external device based on event input
US9097890B2 (en) 2010-02-28 2015-08-04 Microsoft Technology Licensing, Llc Grating in a light transmissive illumination system for see-through near-eye display glasses
US9128281B2 (en) 2010-09-14 2015-09-08 Microsoft Technology Licensing, Llc Eyepiece with uniformly illuminated reflective display
US9091851B2 (en) 2010-02-28 2015-07-28 Microsoft Technology Licensing, Llc Light control in head mounted displays
US9097891B2 (en) 2010-02-28 2015-08-04 Microsoft Technology Licensing, Llc See-through near-eye display glasses including an auto-brightness control for the display brightness based on the brightness in the environment
US9366862B2 (en) 2010-02-28 2016-06-14 Microsoft Technology Licensing, Llc System and method for delivering content to a group of see-through near eye display eyepieces
US9759917B2 (en) 2010-02-28 2017-09-12 Microsoft Technology Licensing, Llc AR glasses with event and sensor triggered AR eyepiece interface to external devices
US20120249797A1 (en) 2010-02-28 2012-10-04 Osterhout Group, Inc. Head-worn adaptive display
KR101249702B1 (ko) * 2010-06-16 2013-04-05 주식회사 나이벡 항균 또는 항염증 활성을 가지는 펩타이드 및 이를 유효성분으로 함유하는 약제학적 조성물
US8581844B2 (en) * 2010-06-23 2013-11-12 Google Inc. Switching between a first operational mode and a second operational mode using a natural motion gesture
US8698764B1 (en) 2010-06-30 2014-04-15 Amazon Technologies, Inc. Dorsal touch input
US8508481B1 (en) 2010-07-01 2013-08-13 Sprint Communications Company L.P. Adaptive touch keyboard
EP2418565A1 (en) * 2010-08-12 2012-02-15 Research In Motion Limited Method and electronic device with motion compensation
US8988365B2 (en) * 2010-09-01 2015-03-24 Telefonaktiebolaget L M Ericsson (Publ) Input precision method for minimizing erroneous entries stemming from instability of a mobile device using an accelerometer and apparatus to detect a shake and apparatus and computer program thereof
KR101781129B1 (ko) 2010-09-20 2017-09-22 삼성전자주식회사 어플리케이션을 다운로드받아 설치하는 단말장치 및 그 방법
US9141285B2 (en) 2010-11-05 2015-09-22 Apple Inc. Device, method, and graphical user interface for manipulating soft keyboards
US9244604B1 (en) * 2010-11-05 2016-01-26 Amazon Technologies, Inc. Adaptive touch sensor interface
US8587547B2 (en) 2010-11-05 2013-11-19 Apple Inc. Device, method, and graphical user interface for manipulating soft keyboards
US9383888B2 (en) 2010-12-15 2016-07-05 Microsoft Technology Licensing, Llc Optimized joint document review
US9118612B2 (en) 2010-12-15 2015-08-25 Microsoft Technology Licensing, Llc Meeting-specific state indicators
US9213405B2 (en) 2010-12-16 2015-12-15 Microsoft Technology Licensing, Llc Comprehension and intent-based content for augmented reality displays
US10762293B2 (en) 2010-12-22 2020-09-01 Apple Inc. Using parts-of-speech tagging and named entity recognition for spelling correction
US9864612B2 (en) 2010-12-23 2018-01-09 Microsoft Technology Licensing, Llc Techniques to customize a user interface for different displays
US8842082B2 (en) 2011-01-24 2014-09-23 Apple Inc. Device, method, and graphical user interface for navigating and annotating an electronic document
US9092132B2 (en) 2011-01-24 2015-07-28 Apple Inc. Device, method, and graphical user interface with a dynamic gesture disambiguation threshold
US9262612B2 (en) 2011-03-21 2016-02-16 Apple Inc. Device access using voice authentication
US9990003B2 (en) * 2011-06-03 2018-06-05 Microsoft Technology Licensing, Llc Motion effect reduction for displays and touch input
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
US8719719B2 (en) 2011-06-17 2014-05-06 Google Inc. Graphical icon presentation
US9436301B2 (en) 2011-06-29 2016-09-06 Google Technology Holdings LLC Portable electronic device having interchangeable user interfaces and method thereof
US9411442B2 (en) 2011-06-29 2016-08-09 Google Technology Holdings LLC Electronic device having managed input components
US10019962B2 (en) 2011-08-17 2018-07-10 Microsoft Technology Licensing, Llc Context adaptive user interface for augmented reality display
US9153195B2 (en) 2011-08-17 2015-10-06 Microsoft Technology Licensing, Llc Providing contextual personal information by a mixed reality device
WO2013028908A1 (en) 2011-08-24 2013-02-28 Microsoft Corporation Touch and social cues as inputs into a computer
US8994660B2 (en) 2011-08-29 2015-03-31 Apple Inc. Text correction processing
JP5805601B2 (ja) * 2011-09-30 2015-11-04 京セラ株式会社 装置、方法、及びプログラム
US9544158B2 (en) 2011-10-05 2017-01-10 Microsoft Technology Licensing, Llc Workspace collaboration via a wall-type computing device
US8682973B2 (en) 2011-10-05 2014-03-25 Microsoft Corporation Multi-user and multi-device collaboration
US9996241B2 (en) 2011-10-11 2018-06-12 Microsoft Technology Licensing, Llc Interactive visualization of multiple software functionality content items
US10198485B2 (en) 2011-10-13 2019-02-05 Microsoft Technology Licensing, Llc Authoring of data visualizations and maps
US9367085B2 (en) 2012-01-26 2016-06-14 Google Technology Holdings LLC Portable electronic device and method for controlling operation thereof taking into account which limb possesses the electronic device
US8896539B2 (en) * 2012-02-03 2014-11-25 Synerdyne Corporation Touch-type keyboard with character selection through finger location on multifunction keys
US8686948B2 (en) 2012-02-03 2014-04-01 Synerdyne Corporation Highly mobile keyboard in separable components
US8414207B1 (en) 2012-02-03 2013-04-09 Synerdyne Corporation Ultra-compact mobile touch-type keyboard
US10134385B2 (en) 2012-03-02 2018-11-20 Apple Inc. Systems and methods for name pronunciation
US9483461B2 (en) 2012-03-06 2016-11-01 Apple Inc. Handling speech synthesis of content for multiple languages
JP6105850B2 (ja) * 2012-03-16 2017-03-29 富士通株式会社 携帯端末装置、表示制御方法及び表示制御プログラム
KR101999182B1 (ko) * 2012-04-08 2019-07-11 삼성전자주식회사 사용자 단말 장치 및 그의 제어 방법
US9280610B2 (en) 2012-05-14 2016-03-08 Apple Inc. Crowd sourcing information to fulfill user requests
US9721563B2 (en) 2012-06-08 2017-08-01 Apple Inc. Name recognition system
EP2859746A4 (en) * 2012-06-08 2016-03-16 Thales Canada Inc INTEGRATED COMBAT RESOURCE MANAGEMENT SYSTEM
US9495129B2 (en) 2012-06-29 2016-11-15 Apple Inc. Device, method, and user interface for voice-activated navigation and browsing of a document
US8629362B1 (en) 2012-07-11 2014-01-14 Synerdyne Corporation Keyswitch using magnetic force
US8510794B1 (en) * 2012-07-15 2013-08-13 Identropy, Inc. Methods and apparatus for a unified identity management interface across internal and shared computing applications
US20140040810A1 (en) * 2012-08-01 2014-02-06 James George Haliburton Electronic device and method of changing a keyboard
US20140049467A1 (en) * 2012-08-14 2014-02-20 Pierre-Yves Laligand Input device using input mode data from a controlled device
US9690334B2 (en) 2012-08-22 2017-06-27 Intel Corporation Adaptive visual output based on change in distance of a mobile device to a user
JP2014041497A (ja) * 2012-08-23 2014-03-06 Sanyo Electric Co Ltd 通信端末装置
JP2014041496A (ja) * 2012-08-23 2014-03-06 Sanyo Electric Co Ltd 通信端末装置
US9959038B2 (en) 2012-08-30 2018-05-01 Google Llc Displaying a graphic keyboard
US9576574B2 (en) 2012-09-10 2017-02-21 Apple Inc. Context-sensitive handling of interruptions by intelligent digital assistant
JP5924203B2 (ja) * 2012-09-12 2016-05-25 ブラザー工業株式会社 画像表示制御装置、画像表示制御方法およびプログラム
US9547647B2 (en) 2012-09-19 2017-01-17 Apple Inc. Voice-based media searching
EP2912537A1 (en) 2012-10-26 2015-09-02 Thomson Licensing User interfaces for hand-held electronic devices
US20140181715A1 (en) * 2012-12-26 2014-06-26 Microsoft Corporation Dynamic user interfaces adapted to inferred user contexts
KR20150104615A (ko) 2013-02-07 2015-09-15 애플 인크. 디지털 어시스턴트를 위한 음성 트리거
US9741150B2 (en) 2013-07-25 2017-08-22 Duelight Llc Systems and methods for displaying representative images
US9235270B2 (en) 2013-02-26 2016-01-12 Synerdyne Corporation Multi-touch mechanical-capacitive hybrid keyboard
US10203815B2 (en) 2013-03-14 2019-02-12 Apple Inc. Application-based touch sensitivity
US9368114B2 (en) 2013-03-14 2016-06-14 Apple Inc. Context-sensitive handling of interruptions
KR101759009B1 (ko) 2013-03-15 2017-07-17 애플 인크. 적어도 부분적인 보이스 커맨드 시스템을 트레이닝시키는 것
WO2014144579A1 (en) 2013-03-15 2014-09-18 Apple Inc. System and method for updating an adaptive speech recognition model
US9215302B2 (en) 2013-05-10 2015-12-15 Google Technology Holdings LLC Method and device for determining user handedness and controlling a user interface
WO2014197336A1 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for detecting errors in interactions with a voice-based digital assistant
WO2014197334A2 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
US9582608B2 (en) 2013-06-07 2017-02-28 Apple Inc. Unified ranking with entropy-weighted information for phrase-based semantic auto-completion
WO2014197335A1 (en) 2013-06-08 2014-12-11 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
US10176167B2 (en) 2013-06-09 2019-01-08 Apple Inc. System and method for inferring user intent from speech inputs
CN105264524B (zh) 2013-06-09 2019-08-02 苹果公司 用于实现跨数字助理的两个或更多个实例的会话持续性的设备、方法、和图形用户界面
CN105265005B (zh) 2013-06-13 2019-09-17 苹果公司 用于由语音命令发起的紧急呼叫的系统和方法
KR102140811B1 (ko) * 2013-07-23 2020-08-03 삼성전자주식회사 디바이스의 사용자 인터페이스 제공 방법 및 그 디바이스
CN105453026A (zh) 2013-08-06 2016-03-30 苹果公司 基于来自远程设备的活动自动激活智能响应
US11068128B2 (en) 2013-09-03 2021-07-20 Apple Inc. User interface object manipulations in a user interface
US9137666B1 (en) * 2013-09-13 2015-09-15 Sprint Communications Company L.P. Mobile security using graphical images
US9424558B2 (en) * 2013-10-10 2016-08-23 Facebook, Inc. Positioning of components in a user interface
US10296160B2 (en) 2013-12-06 2019-05-21 Apple Inc. Method for extracting salient dialog usage from live data
US20150177946A1 (en) * 2013-12-20 2015-06-25 Hyundai Motor Company System and method for controlling display of avn
US10416856B2 (en) * 2014-01-27 2019-09-17 Lenovo (Singapore) Pte. Ltd. Handedness for hand-held devices
US20150248378A1 (en) * 2014-02-28 2015-09-03 Konica Minolta Laboratory U.S.A., Inc. Readability on mobile devices
US9620105B2 (en) 2014-05-15 2017-04-11 Apple Inc. Analyzing audio input for efficient speech and music recognition
US10592095B2 (en) 2014-05-23 2020-03-17 Apple Inc. Instantaneous speaking of content on touch devices
US9502031B2 (en) 2014-05-27 2016-11-22 Apple Inc. Method for supporting dynamic grammars in WFST-based ASR
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
US9760559B2 (en) 2014-05-30 2017-09-12 Apple Inc. Predictive text input
US9734193B2 (en) 2014-05-30 2017-08-15 Apple Inc. Determining domain salience ranking from ambiguous words in natural speech
US10078631B2 (en) 2014-05-30 2018-09-18 Apple Inc. Entropy-guided text prediction using combined word and character n-gram language models
US9633004B2 (en) 2014-05-30 2017-04-25 Apple Inc. Better resolution when referencing to concepts
US10289433B2 (en) 2014-05-30 2019-05-14 Apple Inc. Domain specific language for encoding assistant dialog
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
EP3149728B1 (en) 2014-05-30 2019-01-16 Apple Inc. Multi-command single utterance input method
US9842101B2 (en) 2014-05-30 2017-12-12 Apple Inc. Predictive conversion of language input
US9785630B2 (en) 2014-05-30 2017-10-10 Apple Inc. Text prediction using combined word N-gram and unigram language models
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US10659851B2 (en) 2014-06-30 2020-05-19 Apple Inc. Real-time digital assistant knowledge updates
JP6384659B2 (ja) * 2014-07-31 2018-09-05 カシオ計算機株式会社 電子機器、タッチスクリーン制御方法及びプログラム
US9971496B2 (en) 2014-08-04 2018-05-15 Google Technology Holdings LLC Method and apparatus for adjusting a graphical user interface on an electronic device
US10446141B2 (en) 2014-08-28 2019-10-15 Apple Inc. Automatic speech recognition based on user feedback
US9818400B2 (en) 2014-09-11 2017-11-14 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US10789041B2 (en) 2014-09-12 2020-09-29 Apple Inc. Dynamic thresholds for always listening speech trigger
FR3026203B1 (fr) * 2014-09-23 2018-04-13 Thales Systeme d'entree de donnee multimode
US9606986B2 (en) 2014-09-29 2017-03-28 Apple Inc. Integrated word N-gram and class M-gram language models
EP3201721A4 (en) * 2014-09-30 2018-05-30 Hewlett-Packard Development Company, L.P. Unintended touch rejection
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
US9886432B2 (en) 2014-09-30 2018-02-06 Apple Inc. Parsimonious handling of word inflection via categorical stem + suffix N-gram language models
US9646609B2 (en) 2014-09-30 2017-05-09 Apple Inc. Caching apparatus for serving phonetic pronunciations
US10552013B2 (en) 2014-12-02 2020-02-04 Apple Inc. Data detection
US9711141B2 (en) 2014-12-09 2017-07-18 Apple Inc. Disambiguating heteronyms in speech synthesis
US9865280B2 (en) 2015-03-06 2018-01-09 Apple Inc. Structured dictation using intelligent automated assistants
US10152299B2 (en) 2015-03-06 2018-12-11 Apple Inc. Reducing response latency of intelligent automated assistants
US10055121B2 (en) 2015-03-07 2018-08-21 Apple Inc. Activity based thresholds and feedbacks
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US10567477B2 (en) 2015-03-08 2020-02-18 Apple Inc. Virtual assistant continuity
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
JP6274134B2 (ja) * 2015-03-10 2018-02-07 京セラドキュメントソリューションズ株式会社 表示入力装置及びこれを備えた画像形成装置
US9899019B2 (en) 2015-03-18 2018-02-20 Apple Inc. Systems and methods for structured stem and suffix language models
US9842105B2 (en) 2015-04-16 2017-12-12 Apple Inc. Parsimonious continuous-space phrase representations for natural language processing
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
US10127220B2 (en) 2015-06-04 2018-11-13 Apple Inc. Language identification from short strings
US10101822B2 (en) 2015-06-05 2018-10-16 Apple Inc. Language input correction
US9578173B2 (en) 2015-06-05 2017-02-21 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US10613732B2 (en) 2015-06-07 2020-04-07 Apple Inc. Selecting content items in a user interface display
US10186254B2 (en) 2015-06-07 2019-01-22 Apple Inc. Context-based endpoint detection
US11025565B2 (en) 2015-06-07 2021-06-01 Apple Inc. Personalized prediction of responses for instant messaging
US10255907B2 (en) 2015-06-07 2019-04-09 Apple Inc. Automatic accent detection using acoustic models
US9798413B2 (en) 2015-08-27 2017-10-24 Hand Held Products, Inc. Interactive display
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US9697820B2 (en) 2015-09-24 2017-07-04 Apple Inc. Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks
US11010550B2 (en) 2015-09-29 2021-05-18 Apple Inc. Unified language modeling framework for word prediction, auto-completion and auto-correction
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US11587559B2 (en) 2015-09-30 2023-02-21 Apple Inc. Intelligent device identification
US20170131870A1 (en) 2015-10-30 2017-05-11 Loji, Llc Interactive icons with embedded functionality used in text messages
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
KR102579694B1 (ko) * 2015-11-20 2023-09-19 삼성전자주식회사 기능 운용 방법 및 이를 지원하는 전자 장치
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
DK179309B1 (en) 2016-06-09 2018-04-23 Apple Inc Intelligent automated assistant in a home environment
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
US10586535B2 (en) 2016-06-10 2020-03-10 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10490187B2 (en) 2016-06-10 2019-11-26 Apple Inc. Digital assistant providing automated status report
US10509862B2 (en) 2016-06-10 2019-12-17 Apple Inc. Dynamic phrase expansion of language input
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
DK201770423A1 (en) 2016-06-11 2018-01-15 Apple Inc Activity and workout updates
DK179343B1 (en) 2016-06-11 2018-05-14 Apple Inc Intelligent task discovery
DK179415B1 (en) 2016-06-11 2018-06-14 Apple Inc Intelligent device arbitration and control
DK179049B1 (en) 2016-06-11 2017-09-18 Apple Inc Data driven natural language event detection and classification
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
US11216119B2 (en) 2016-06-12 2022-01-04 Apple Inc. Displaying a predetermined view of an application
US10725627B2 (en) * 2016-07-15 2020-07-28 International Business Machines Corporation Managing inputs to a user interface with system latency
US10474753B2 (en) 2016-09-07 2019-11-12 Apple Inc. Language identification using recurrent neural networks
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
US10860199B2 (en) 2016-09-23 2020-12-08 Apple Inc. Dynamically adjusting touch hysteresis based on contextual data
US11281993B2 (en) 2016-12-05 2022-03-22 Apple Inc. Model and ensemble compression for metric learning
US10593346B2 (en) 2016-12-22 2020-03-17 Apple Inc. Rank-reduced token representation for automatic speech recognition
US11514098B2 (en) 2016-12-31 2022-11-29 Spotify Ab Playlist trailers for media content playback during travel
US10489106B2 (en) 2016-12-31 2019-11-26 Spotify Ab Media content playback during travel
US10747423B2 (en) 2016-12-31 2020-08-18 Spotify Ab User interface for media content playback
US11204787B2 (en) 2017-01-09 2021-12-21 Apple Inc. Application integration with a digital assistant
KR102488580B1 (ko) 2017-01-12 2023-01-13 삼성전자주식회사 적응적인 사용자 인터페이스를 제공하기 위한 장치 및 방법
DK201770383A1 (en) 2017-05-09 2018-12-14 Apple Inc. USER INTERFACE FOR CORRECTING RECOGNITION ERRORS
US10417266B2 (en) 2017-05-09 2019-09-17 Apple Inc. Context-aware ranking of intelligent response suggestions
DK201770439A1 (en) 2017-05-11 2018-12-13 Apple Inc. Offline personal assistant
US10395654B2 (en) 2017-05-11 2019-08-27 Apple Inc. Text normalization based on a data-driven learning network
US10726832B2 (en) 2017-05-11 2020-07-28 Apple Inc. Maintaining privacy of personal information
DK179496B1 (en) 2017-05-12 2019-01-15 Apple Inc. USER-SPECIFIC Acoustic Models
US11301477B2 (en) 2017-05-12 2022-04-12 Apple Inc. Feedback analysis of a digital assistant
DK201770429A1 (en) 2017-05-12 2018-12-14 Apple Inc. LOW-LATENCY INTELLIGENT AUTOMATED ASSISTANT
DK179745B1 (en) 2017-05-12 2019-05-01 Apple Inc. SYNCHRONIZATION AND TASK DELEGATION OF A DIGITAL ASSISTANT
DK201770431A1 (en) 2017-05-15 2018-12-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
DK201770432A1 (en) 2017-05-15 2018-12-21 Apple Inc. Hierarchical belief states for digital assistants
US20180336275A1 (en) 2017-05-16 2018-11-22 Apple Inc. Intelligent automated assistant for media exploration
DK179549B1 (en) 2017-05-16 2019-02-12 Apple Inc. FAR-FIELD EXTENSION FOR DIGITAL ASSISTANT SERVICES
US10311144B2 (en) 2017-05-16 2019-06-04 Apple Inc. Emoji word sense disambiguation
US10403278B2 (en) 2017-05-16 2019-09-03 Apple Inc. Methods and systems for phonetic matching in digital assistant services
US10657328B2 (en) 2017-06-02 2020-05-19 Apple Inc. Multi-task recurrent neural network architecture for efficient morphology handling in neural language modeling
WO2019000153A1 (en) * 2017-06-26 2019-01-03 Orange METHOD FOR DISPLAYING A VIRTUAL KEYBOARD ON A MOBILE TERMINAL SCREEN
US10445429B2 (en) 2017-09-21 2019-10-15 Apple Inc. Natural language understanding using vocabularies with compressed serialized tries
US10755051B2 (en) 2017-09-29 2020-08-25 Apple Inc. Rule-based natural language processing
US10636424B2 (en) 2017-11-30 2020-04-28 Apple Inc. Multi-turn canned dialog
US10733982B2 (en) 2018-01-08 2020-08-04 Apple Inc. Multi-directional dialog
US10733375B2 (en) 2018-01-31 2020-08-04 Apple Inc. Knowledge-based framework for improving natural language understanding
US10572065B2 (en) * 2018-02-08 2020-02-25 Synaptics Incorporated Automotive acceleration compensation force sensing
US10789959B2 (en) 2018-03-02 2020-09-29 Apple Inc. Training speaker recognition models for digital assistants
US10592604B2 (en) 2018-03-12 2020-03-17 Apple Inc. Inverse text normalization for automatic speech recognition
US10818288B2 (en) 2018-03-26 2020-10-27 Apple Inc. Natural assistant interaction
US10284897B1 (en) 2018-03-28 2019-05-07 Rovi Guides, Inc. Systems and methods for modifying the display of inputs on a user input device
US10909331B2 (en) 2018-03-30 2021-02-02 Apple Inc. Implicit identification of translation payload with neural machine translation
US11145294B2 (en) 2018-05-07 2021-10-12 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US10928918B2 (en) 2018-05-07 2021-02-23 Apple Inc. Raise to speak
US10984780B2 (en) 2018-05-21 2021-04-20 Apple Inc. Global semantic word embeddings using bi-directional recurrent neural networks
DK201870355A1 (en) 2018-06-01 2019-12-16 Apple Inc. VIRTUAL ASSISTANT OPERATION IN MULTI-DEVICE ENVIRONMENTS
US10892996B2 (en) 2018-06-01 2021-01-12 Apple Inc. Variable latency device coordination
US11386266B2 (en) 2018-06-01 2022-07-12 Apple Inc. Text correction
DK179822B1 (da) 2018-06-01 2019-07-12 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
DK180639B1 (en) 2018-06-01 2021-11-04 Apple Inc DISABILITY OF ATTENTION-ATTENTIVE VIRTUAL ASSISTANT
US10504518B1 (en) 2018-06-03 2019-12-10 Apple Inc. Accelerated task performance
US10694017B2 (en) 2018-06-14 2020-06-23 International Business Machines Corporation Ergonomic position detector
WO2020068876A1 (en) * 2018-09-24 2020-04-02 Interlink Electronics, Inc. Multi-modal touchpad
EP3785102A1 (en) * 2018-12-04 2021-03-03 Google LLC Context aware skim-read friendly text view
US11159731B2 (en) 2019-02-19 2021-10-26 Samsung Electronics Co., Ltd. System and method for AI enhanced shutter button user interface

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SE511516C2 (sv) 1997-12-23 1999-10-11 Ericsson Telefon Ab L M Handburen displayenhet och metod att visa skärmbilder
US8479122B2 (en) * 2004-07-30 2013-07-02 Apple Inc. Gestures for touch sensitive input devices
US6466232B1 (en) * 1998-12-18 2002-10-15 Tangis Corporation Method and system for controlling presentation of information to a user based on the user's condition
US6317114B1 (en) 1999-01-29 2001-11-13 International Business Machines Corporation Method and apparatus for image stabilization in display device
US20020173721A1 (en) * 1999-08-20 2002-11-21 Novasonics, Inc. User interface for handheld imaging devices
US6466198B1 (en) * 1999-11-05 2002-10-15 Innoventions, Inc. View navigation and magnification of a hand-held device with a display
US6690351B1 (en) * 2000-04-06 2004-02-10 Xybernaut Corporation Computer display optimizer
US8120625B2 (en) * 2000-07-17 2012-02-21 Microsoft Corporation Method and apparatus using multiple sensors in a device with a display
US7289102B2 (en) * 2000-07-17 2007-10-30 Microsoft Corporation Method and apparatus using multiple sensors in a device with a display
US20030046401A1 (en) * 2000-10-16 2003-03-06 Abbott Kenneth H. Dynamically determing appropriate computer user interfaces
US6415224B1 (en) * 2001-02-06 2002-07-02 Alpine Electronics, Inc. Display method and apparatus for navigation system
US6816154B2 (en) * 2001-05-30 2004-11-09 Palmone, Inc. Optical sensor based user interface for a portable electronic device
US20040145613A1 (en) * 2003-01-29 2004-07-29 Stavely Donald J. User Interface using acceleration for input

Cited By (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101978337B (zh) * 2008-02-11 2014-11-05 苹果公司 屏幕的运动补偿
CN105468230B (zh) * 2008-04-30 2019-09-03 宏达国际电子股份有限公司 用户界面切换方法及使用该方法的电子装置与存储介质
CN105468230A (zh) * 2008-04-30 2016-04-06 宏达国际电子股份有限公司 用户界面切换方法及使用该方法的电子装置与存储介质
US9965146B2 (en) 2008-06-06 2018-05-08 Apple Inc. User interface for application management for a mobile device
CN102089744B (zh) * 2008-06-06 2016-05-25 苹果公司 应用管理方法和系统
CN102089744A (zh) * 2008-06-06 2011-06-08 苹果公司 用于移动设备的应用管理的用户界面
US11947776B2 (en) 2008-06-06 2024-04-02 Apple Inc. Systems and methods for providing and interacting with application-update objects on a mobile device
US11320961B2 (en) 2008-06-06 2022-05-03 Apple Inc. Systems and methods for providing and interacting with application-update objects on a mobile device
US10318119B2 (en) 2008-06-06 2019-06-11 Apple Inc. User interface for application management for a mobile device
US8751321B2 (en) 2008-06-06 2014-06-10 Apple Inc. User interface for application management for a mobile device
CN102246116B (zh) * 2008-12-15 2014-09-24 符号技术有限公司 界面适配系统
TWI493394B (zh) * 2009-03-24 2015-07-21 微軟公司 雙模態觸控靈敏數位筆記型電腦
CN101901072B (zh) * 2009-05-26 2013-05-01 索尼公司 信息处理设备、信息处理方法
CN101901072A (zh) * 2009-05-26 2010-12-01 索尼公司 信息处理设备、信息处理方法和程序
US9104261B2 (en) 2009-12-29 2015-08-11 Nokia Technologies Oy Method and apparatus for notification of input environment
WO2011079436A1 (en) * 2009-12-29 2011-07-07 Nokia Corporation Method and apparatus for notification of input environment
CN102547324B (zh) * 2010-09-22 2016-02-17 株式会社尼康 图像显示装置及摄像装置
CN102547324A (zh) * 2010-09-22 2012-07-04 株式会社尼康 图像显示装置及摄像装置
CN102279708A (zh) * 2011-08-15 2011-12-14 广州市动景计算机科技有限公司 一种数据输入处理方法及装置
CN103294121A (zh) * 2012-02-23 2013-09-11 株式会社和冠 手写信息输入装置及具备该装置的便携电子设备
CN104160362A (zh) * 2012-03-07 2014-11-19 印象笔记公司 针对不利使用条件调整移动用户界面
CN103309585A (zh) * 2012-03-12 2013-09-18 联想(北京)有限公司 一种信息处理方法及电子设备
CN106648494B (zh) * 2012-03-12 2020-03-20 联想(北京)有限公司 一种信息处理方法及电子设备
CN106648494A (zh) * 2012-03-12 2017-05-10 联想(北京)有限公司 一种信息处理方法及电子设备
US9837050B2 (en) 2012-03-12 2017-12-05 Lenovo (Beijing) Co., Ltd. Information processing method, method for driving image collection unit and electrical device
CN103365569A (zh) * 2012-03-26 2013-10-23 宇龙计算机通信科技(深圳)有限公司 触摸键盘的显示处理方法和移动终端
CN103838361B (zh) * 2012-11-27 2017-06-27 联想(北京)有限公司 一种信息交互方法、装置及电子设备
CN103838361A (zh) * 2012-11-27 2014-06-04 联想(北京)有限公司 一种信息交互方法、装置及电子设备
CN107577273A (zh) * 2012-12-13 2018-01-12 卡西欧计算机株式会社 信息显示装置、信息显示方法、记录介质及信息显示系统
CN103246441A (zh) * 2013-03-25 2013-08-14 东莞宇龙通信科技有限公司 终端设备的屏幕显示方法及终端设备
CN103246441B (zh) * 2013-03-25 2016-02-10 东莞宇龙通信科技有限公司 终端设备的屏幕显示方法及终端设备
CN103268192A (zh) * 2013-06-14 2013-08-28 北京捷讯华泰科技有限公司 基于关键词搜索的可调节文本输入界面方法
CN103500047A (zh) * 2013-09-23 2014-01-08 百度在线网络技术（北京）有限公司 移动终端中交互元素的控制方法、装置和移动终端
CN105678148B (zh) * 2016-01-07 2018-07-06 江苏中威科技软件系统有限公司 一种手写签批内容与底层文档相互控制方法及系统
CN114296512A (zh) * 2016-02-29 2022-04-08 谷歌有限责任公司 具有可动态配置的用户输入装置的计算装置及其操作方法
CN114296512B (zh) * 2016-02-29 2024-05-03 谷歌有限责任公司 具有可动态配置的用户输入装置的计算装置及其操作方法
CN106293199B (zh) * 2016-07-26 2019-10-22 广东小天才科技有限公司 一种控制触摸屏的方法及装置
CN106293199A (zh) * 2016-07-26 2017-01-04 广东小天才科技有限公司 一种控制触摸屏的方法及装置

Also Published As

Publication number Publication date
WO2005069111A1 (en) 2005-07-28
KR20060103949A (ko) 2006-10-04
EP1702256A1 (en) 2006-09-20
US7401300B2 (en) 2008-07-15
CN100478847C (zh) 2009-04-15
US20050154798A1 (en) 2005-07-14
KR100880855B1 (ko) 2009-01-30

Similar Documents

Publication Publication Date Title
CN100478847C (zh) 自适应用户界面输入设备
CN102609170B (zh) 电子装置及其信息呈现方法
US9569071B2 (en) Method and apparatus for operating graphic menu bar and recording medium using the same
JP5260506B2 (ja) タッチパッド上における挙動を認識してスクロール機能を制御し既定の場所でのタッチダウンによってスクロールを活性化する方法
CN103257684B (zh) 方向敏感的信号输出方法及装置
JP5307726B2 (ja) タッチパッド上においてスクローリングを活性化し制御する方法
TWI614645B (zh) 具有手姿勢控制之輸入裝置
WO2011042814A1 (en) Methods and devices that resize touch selection zones while selected on a touch sensitive display
EP2112581A1 (en) Method and apparatus for operating graphic menu bar and recording medium using the same
EP3629139A1 (en) Operating a touch screen control system according to a plurality of rule sets
CN1942848A (zh) 用户接口
KR101215915B1 (ko) 모션 제어 커서를 갖는 휴대용 전자 장치
JP2009536385A (ja) スクロール付き多機能キー
JP2011227854A (ja) 情報表示装置
JPWO2009031213A1 (ja) 携帯端末装置及び表示制御方法
CN101231569A (zh) 用户界面中的菜单
CN1997958A (zh) 图形用户界面的多层显示
CN104714643B (zh) 一种利用传感器实现模拟触摸屏的方法、系统及移动终端
WO2002088853A1 (en) Motion-based input system for handheld devices
US20120050032A1 (en) Tracking multiple contacts on an electronic device
CN104185823B (zh) 电子设备中的显示器和方法
JP5653062B2 (ja) 情報処理装置、操作入力装置、情報処理システム、情報処理方法、プログラム及び情報記憶媒体
US20050110756A1 (en) Device and method for controlling symbols displayed on a display device
KR100859882B1 (ko) 터치 기반 사용자 입력 장치상의 듀얼 포인트 사용자입력을 인지하기 위한 방법 및 장치
KR101133493B1 (ko) 터치 패드 및 이를 이용한 멀티 터치 인식 방법

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20160119

Address after: Espoo, Finland

Patentee after: Technology Co., Ltd. of Nokia

Address before: Espoo, Finland

Patentee before: Nokia Oyj