CN201181467Y - Hand-hold mobile communicating device - Google Patents

Hand-hold mobile communicating device Download PDF

Info

Publication number
CN201181467Y
CN201181467Y CN 200720194296 CN200720194296U CN201181467Y CN 201181467 Y CN201181467 Y CN 201181467Y CN 200720194296 CN200720194296 CN 200720194296 CN 200720194296 U CN200720194296 U CN 200720194296U CN 201181467 Y CN201181467 Y CN 201181467Y
Authority
CN
China
Prior art keywords
touch
finger
volume
gesture
means
Prior art date
Application number
CN 200720194296
Other languages
Chinese (zh)
Inventor
格雷格·克里斯蒂
Original Assignee
苹果公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US87875407P priority Critical
Priority to US60/878,754 priority
Priority to US11/818,342 priority
Application filed by 苹果公司 filed Critical 苹果公司
Application granted granted Critical
Publication of CN201181467Y publication Critical patent/CN201181467Y/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for entering handwritten data, e.g. gestures, text
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04808Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen

Abstract

The utility model relates to a handheld mobile communication device, and provides a system and software used for realizing the gesture operation by utilizing a touch sensitive device (such as a touch sensitive display) and used for managing and editing media files in a computing device or system; more particularly, the gesture input by human hands on the touch/proximity sensitive device can be used for controlling editing and operating files, such as the media files including but not limited to graphic files, photograph files and video files.

Description

手持移动通信装置 A handheld mobile communication device

技术领域 FIELD

本实用新型涉及通过在触摸敏感装置上使用手势来管理、操纵和编辑媒体对象(例如在显示器上的图形对象)的系统。 The present invention relates to the use of gestures on a touch-sensitive device to manage, manipulate and edit the media object (e.g. a graphics object on a display) system.

背景技术 Background technique

现今具有许多类型的输入装置用于在计算机系统中进行操作。 The input device is used nowadays with many types of computer operating systems. 这些操作一般是在显示屏上移动光标并进行选择。 These operations are typically performed to move the cursor and select on the display screen. 这些操作也可以包括分页、巻动、扫视、缩放等等。 These operations may also include paging, Volume moving, panning, zooming and the like. 例如,输入装置可以包括按钮、开关、 键盘、鼠标、轨迹球、触摸垫、游戏杆、触摸屏等。 For example, the input device may include buttons, switches, a keyboard, a mouse, a trackball, a touch pad, a joystick, a touch screen. 这些装置的每一个都具有优点和缺点,这是当设计计算机系统时必须考虑的。 Each of these devices has advantages and disadvantages that must be considered when designing the computer system.

按钮和开关一般是机械性质的,并对于光标的移动和进行选择提供有限的控制。 Buttons and switches are generally mechanical in nature and for the movement of a cursor and making selections provide limited control. 例如,它们一般专用于沿特定方向移动光标(例如箭头键),或者进行特定的选择(例如输入、删除、编号等等)。 For example, they are generally dedicated to moving the cursor in a specific direction (e.g., arrow keys), or by selecting a specific (e.g., enter, delete, number, etc.).

在使用鼠标装置时,在显示器上输入指针的运动一般对应于当用户沿着一个表面移动鼠标时鼠标的相对运动。 When using a mouse device, input pointer on the display of motion generally corresponds to the relative movement of the mouse when the user moves the mouse along the one surface. 在使用轨迹球装置时, 输入指针在显示器上的运动一般对应于当用户在一个壳体内移动轨迹球时轨迹球的相对运动。 In use the trackball device, the movement of the input pointer on the display generally corresponding to a user in a case when the relative movement of the trackball moves the trackball. 鼠标和轨迹球装置一般还包括一个或多个用于进行选择的按钮。 Mouse and trackball devices generally further comprise one or more buttons for selection. 鼠标装置还可以包括巻动轮,其允许用户借助于向前或向后滚动巻动轮来巻动被显示的内容。 The mouse device may further comprise Volume wheel, which allows the user to scroll forward or backward by means of Volume Volume movable actuator wheels displayed content.

利用触摸垫装置,例如在个人便携式计算机上的触摸垫,在显示器上输入指针的运动一般对应于当用户的手指在触摸垫的表面上运动时用户手指(或铁笔)的相对运动。 Apparatus using a touch pad, for example on a portable personal computer touch pad, the input pointer on the display generally corresponding to a user moving a finger (or a stylus) when relative movement of the user's finger motion on the surface of the touch pad. 在另一方面,触摸屏可以是一种类型的显示屏,其一般包括覆盖着显示屏的触摸敏感的透明板(或"皮肤,,)。当使用触摸屏时,用户一般通过直接点击(通常用手指或铁笔)在屏幕上显示的对象(例如GUI对象)在显示屏上进行选择。 In another aspect, the touch screen may be a type of display screen, which typically includes a display screen covered with a touch-sensitive transparent plate (or "skin ,,). When using a touch screen, typically by clicking directly on the user (typically with a finger or a stylus) objects (e.g., GUI object) displayed on the screen is selected on the display screen.

为了提供附加的功能, 一些输入装置实现了手势。 In order to provide additional functionality, some of the input device to achieve a gesture. 例如,在触摸垫中,当在触摸垫的表面上可以检测到一个或多个轻击时可以进行选择。 For example, the touch pad when the touch pad on the surface to be detected may be one or more selected light when hit. 在一些情况下,可以轻击触摸垫的任何部分。 In some cases, any portion of the touch pad can tap. 除去选择之外,借助于使用手指在触摸垫边沿的运动可以启动巻动。 Addition selectively removed, by means of a movable finger motion can be started Volume touch pad edge.

授予苹果计算机公司的美国专利5612719和55卯219描述了手势的一些其它的使用,美国专利5612719披露了一种屏上按钮,其响应 Apple Computer Inc. awarded US Patent 5,612,719, and 55 d 219 describes the use of some other gesture, US Patent 5,612,719 discloses one kind of screen buttons on its response

在屏幕上在按钮上或按钮附近的至少两个不同的按钮手势。 Button on the screen on or near the button at least two different button gestures. 美国专利 US Pat.

5590219披露了一种用于辨认在计算机系统的显示屏上输入的椭圆形手势的方法。 5,590,219 discloses a method for recognizing an ellipse gesture input on a computer system display screen.

近来,实现了一些更先进的手势。 Recently, to achieve some of the more advanced gestures. 例如,通过把4个手指放在触摸垫上,从而认出巻动手势,此后在触摸垫上移动这些手指,可以启动巻动,以便执行巻动事件。 For example, by the four fingers on the touch pad, thereby Volume recognized gesture, thereafter moving these fingers on the touch pad, you can start moving Volume, Volume movable in order to perform event. 不过,用于实现这些先进的手势的方法可能受到限制,并且在许多情况下可能是违反直觉的。 However, the methods for achieving these advanced gestures may be limited, and in many cases may be counterintuitive. 在某些应用中, 特别是涉及使用计算机系统管理或编辑媒体文件的应用中,使用触摸屏的手势可以使用户能够更有效地和精确地实现所需的操作。 In some applications, especially applications involving the use of a computer system or management editing media files, using a touch screen gestures may enable the user to more accurately and efficiently achieve the desired operation.

基于上述,需要进行改进,使得手势可以在触摸敏感装置上被执行,特别是关于管理和编辑媒体文件。 Based on the above, a need for improvement, such a gesture may be performed on a touch-sensitive device, in particular on the management and editing media files.

实用新型内容 SUMMARY

本申请涉及用于通过触摸敏感装置(例如触摸敏感显示器)实现手势的系统和软件,用于在计算机系统上管理和编辑媒体文件。 The present application relates to systems and software gesture with the touch-sensitive device (e.g., touch-sensitive display), on a computer system for managing and editing media files. 具体地说,在触摸/接近敏感装置上人手的手势输入可以用来控制、编辑和处理文件(例如媒体文件,包括但不限于照片文件和视频文件)。 Specifically, the touch / proximity gesture of the hand-sensitive input device may be used to control, edit and process files (e.g., media files, including, but not limited to, video files and photo files).

按照一个实施例,在触摸敏感的计算机桌面应用显示器上的手势输入用于实现常规的鼠标/轨迹球操作,例如目标、选择、右点击操作、 巻动等等。 According to one embodiment, a gesture on the touch-sensitive computer input display desktop applications for achieving regular mouse / trackball, such as target, selected, right-click operation, Volume moving the like.

按照另一个实施例,在触摸敏感显示器上的手势输入用于实现用于编辑图像文件例如照片文件的编辑指令。 According to another embodiment, the gesture on the touch-sensitive display for implementing the editing instruction input such as a photo file for editing an image file. 手势输入可以通过用户界面(UI)元件例如滑动条被辨别。 Gesture input may (UI) elements such as sliders are distinguished by the user interface. 手势输入可以借助于UI元件通过改变在UI元件上触摸点的数量被改变。 Gesture input can be changed by the number of touch points on the UI element is changed by means of the UI element.

按照另一个实施例,手势输入包括UI元件的激活,在此之后和相关的UI元件的手势的相互作用可以实现其它的功能。 According to another embodiment, the gesture input comprises activation UI elements, after which the interaction of gestures and associated UI element other functions may be implemented.

根据本发明的一个方面,提供了一种手持移动通信装置,其特征 According to one aspect of the invention, there is provided a handheld mobile communication device, characterized in

在于:触摸敏感的显示屏;用于使显示屏显示媒体文件的一部分的装置,所述媒体文件包括文本项和图形项至少之一;用于检测在显示屏的表面上的触摸巻动输入的装置,所述触摸巻动输入包括在显示屏的表面上的人的手指的触屏点,该触屏点对应于显示屏上媒体文件的所述部分被显示的位置;用于检测人的手指在显示屏上的触屏点的拖拉运动的装置,所述拖拉运动跨过正被显示的媒体文件的所述部分的一部分,并包括垂直的和水平的矢量分量;用于确定手指触屏点的拖拉运动从而指示巻动操作的装置;用于使媒体文件在显示屏上巻动的装200720194296.0 Comprising: a touch-sensitive display screen; display means for displaying a portion of the media file, the media file and text entry comprises at least one of the graphics item; for detecting a touch on a surface of the display screen of the input moving Volume means the touch input Volume movable touch point on the surface of the display screen, including a human's finger, the touch point on the display screen corresponding to the position of the portion of the media file to be displayed; means for detecting a person's finger means drag motion of touch points on the display screen, the drag motion across a portion of the portion of the media file being displayed, and comprising a horizontal and vertical vector components; means for determining the touch point of a finger drag motion indicating means operated movable Volume; Volume for moving the media file on the display screen mounted 200720194296.0

置,其中所示巻动被限制于垂直和水平方向之一。 Position, wherein the movable Volume to be limited to one shown in vertical and horizontal directions.

根据本发明的另一个方面,提供了一种手持移动通信装置,其特 According to another aspect of the invention, there is provided a handheld mobile communication device Laid

征在于:触摸敏感的显示屏;用于使显示屏显示媒体文件的一部分的装置,所述媒体文件包括文本项和图形项至少之一;用于检测在显示屏的表面上的触摸巻动输入的装置,所述触摸巻动输入包括在显示屏的表面上的人的手指的触屏点,该触屏点对应于显示屏上媒体文件的所述部分被显示的位置;用于检测人的手指在显示屏上的触屏点的拖拉运动的装置,所述拖拉运动跨过正被显示的媒体文件的所述部分的一部分;用于检测人的手指的触屏点的拖拉运动的方向的装置,其中拖拉运动的方向包括垂直分量矢量和水平分量矢量;以及用于使媒体文件在显示屏上按照检测的拖拉运动的方向巻动的装置。 Characterized in that: the touch sensitive screen; display means for displaying a portion of the media file, the media file comprises at least one text entry and graphical items; Volume for detecting a touch input on the surface of the movable display screen means, the touch movement input comprises a touch screen Volume points on the surface of human finger the display screen of the touch point on the display screen corresponding to the position of the portion of the media file to be displayed; for detection of human means drag motion finger touch point on the display screen, the drag motion across a portion of the portion of the media file being displayed; dragging movement direction for detecting touch points of a person's finger apparatus, wherein the direction of dragging motion vector includes a vertical component and a horizontal component vector; and dragging on the display screen in the direction of movement of the movable Volume detection means for media files.

附图说明 BRIEF DESCRIPTION

图l是按照本发明的示例的实施例的计算机系统的方块图; Figure l is a block diagram of a computer system according to the exemplary embodiment of the present invention;

图2表示按照本发明的另一个示例的实施例的计算机系统; Figure 2 shows a computer system according to another exemplary embodiment of the present invention;

图3表示按照本发明的一个示例的实施例的多点处理方法; 3 shows a multi-processing method according to an exemplary embodiment of the invention according to;

图4A,4B表示按照本发明的一个实施例的检测的触摸图像; 4A, 4B, an image showing detecting a touch according to an embodiment of the present invention;

图5表示按照本发明的一个实施例的一组特征; Figure 5 shows a set of features in accordance with one embodiment of the present invention;

图6表示按照本发明一个实施例的参数计算方法; Figure 6 shows the parameters of the calculation method according to one embodiment of the present invention;

图7A-7E和7I-7K表示按照本发明的一个实施例用于指定目标 Figures 7A-7E and 7I-7K shows an example of a target according to one embodiment of the present invention.

和/或选择任务的多种手势; And / or selection of a variety of tasks gesture;

图7F-7H表示用于辨别和实现图7A-E的手势输入的方法; FIG. 7F-7H represent implemented method for recognizing and FIGS. 7A-E gesture input;

图8A-8G表示按照本发明的一个实施例的转动姿式; FIGS. 8A-8G represents a rotation posture according to an embodiment of the present invention;

图9表示按照本发明一个实施例的基于触摸的方法; 9 shows a touch-based method of an embodiment according to the present invention;

图10表示按照本发明一个实施例的基于触摸的方法; Figure 10 shows a touch-based method according to one embodiment according to the invention;

图1l是按照本发明一个实施例的基于触摸的方法; FIG 1l is a touch-based method of the present embodiment of the invention according to embodiment;

图12表示按照本发明一个实施例的缩放手势方法; 12 shows a zoom gesture method according to the present invention, an embodiment of the embodiment;

图13A-13H表示按照本发明一个实施例的缩放顺序; FIGS 13A-13H represent scaling sequence according to the present embodiment of the invention, an embodiment;

图14表示按照本发明一个实施例的扫视方法; 14 shows a method of panning according to the embodiment of the invention, an embodiment of the present;

图15A-15D表示按照本发明一个实施例的扫视顺序; FIGS 15A-15D represents the sequence of panning according to the present invention, an embodiment of the embodiment;

图16表示按照本发明一个实施例的转动方法; 16 shows rotation of the method according to the embodiment of the present invention, an embodiment;

图17A-17C表示按照本发明一个实施例的转动顺序; FIGS 17A-17C represent the rotation sequence of the embodiment according to the present invention, an embodiment;

图17D-17E表示按照本发明一个实施例的用于转动可选目标的 FIGS. 17D-17E according to the present invention, showing an alternative embodiment for the embodiment of the rotatable target

方法; method;

图18A和18B表示按照本发明一个实施例的用于编辑照片文件的手势输入; 18A and 18B represent a gesture input according to a file for editing photos embodiment of the present invention;

图18C表示用于辨别和实现图18A,18B的手势输入的方法; 18C shows a discrimination and achieve Figs. 18A, 18B gesture input method;

图18D和18E表示按照本发明一个实施例在照片应用内用于近摄和远摄照片文件的手势输入; FIGS. 18D and 18E shows an embodiment according to the present invention and a telephoto close-up photo files gesture input within the photo application;

图19A-19D表示按照本发明一个实施例用于通过再现顺序文件巻动的手势输入; FIGS 19A-19D shows an embodiment according to the present invention for a gesture by moving Volume file reproduction order inputted;

图19E和19F表示按照本发明一个实施例用于在数字照相机显示器上通过再现照片文件巻动的手势输入; FIGS. 19E and 19F shows an embodiment according to the present invention for display on a digital camera by reproducing the moving picture file Volume gesture input;

图19G表示按照本发明一个实施例用于在再现期间标记或删除照片文件的手势输入; FIG 19G shows an embodiment according to the present invention, for marking a file or delete photos gesture input during the reproduction;

图19H表示按照本发明另一个实施例用于在再现期间标记或删除照片文件的另一个手势输入; FIG 19H shows an example for marking or deleting pictures during reproduction of a file to another gesture input according to another embodiment of the present invention;

图20是表示按照本发明一个实施例用于实现图18A-19F的方法的总图; FIG 20 shows an example for implementing the general view of the method of FIG. 18A-19F according to a embodiment of the present invention;

图21A-21D表示按照本发明一个实施例使用视频应用用于控制/编辑视频的手势输入; FIGS 21A-21D shows an embodiment using a video application for gesture control / input video editing in accordance with the present invention;

图22A和22B表示用于实现图21A-21D的手势输入的方法;以及 22A and 22B showing a method for implementing a gesture input FIGS. 21A-21D; and

图23表示按照本发明一个实施例用于使用音频应用控制/编辑音频的手势输入。 Example 23 shows gestures for application control using the audio / audio editing according to the present invention, an input embodiment.

具体实施方式 Detailed ways

在下面的优选实施例的说明中,参考构成本说明的一部分的附图,其中通过说明示出了可以实现本发明的特定实施例。 In the preferred embodiment described below, with reference to the accompanying drawings forming a part of the present description, which is shown by way of illustration a specific embodiment of the present invention may be implemented. FIG. 应当理解, 不脱离本发明的优选实施例的范围,可以利用其它的实施例,可以进行结构的改变。 It should be appreciated that, without departing from the scope of the preferred embodiment of the present invention, other embodiments may be utilized, and structural changes may be made.

图l是按照本发明一个实施例的计算机系统50的方块图。 Figure l is a block diagram according to the present invention, a computer system 50 of the embodiment. 计算机系统50可以是个人计算机系统,例如台式机、{吏携计算机、图形输入板或手持计算机。 The computer system 50 may be a personal computer system, such as a desktop, portable computer {officials, tablet or handheld computer. 计算机系统也可以是计算装置例如蜂窝电话、 PDA、专用媒体播放器、用户电子装置等等。 The computer system may also be a computing device such as a cellular phone, PDA, dedicated media player, consumer electronic devices and the like.

图l所示的示例的计算机系统50可以包括处理器56,其被配置用于执行指令,并用于执行和计算机系统50有关的操作。 Figure l exemplary computer system 50 shown in FIG. 56 may include a processor configured to execute instructions, and for executing a computer system 50 and related operations. 例如使用例如从存储器检索的指令,处理器56可以控制在计算机系统50的元件之间的输入和输出数据的接收和处理。 For example, using the retrieved from the instruction memory, the processor 56 may control the reception and processing of input and output data between components of the computer system 50. 处理器56可以在单个芯片、 多个芯片上实现或者由多个电气元件来实现。 The processor 56 may be implemented or be implemented by a plurality of electrical components on a single chip, a plurality of chips. 例如,处理器56可以使用多种体系结构,包括专用的或嵌入式处理器、单用途处理器、控制器、ASIC等等。 For example, the processor 56 may use a variety of architectures, including dedicated or embedded processor, single purpose processor, controller, an ASIC and the like.

在大多数情况下,处理器56和操作系统一起工作,以执行计算机代码并产生和使用数据。 In most cases, the processor and operating system 56 work together to execute computer code and produce and use data. 操作系统一般是熟知的,因而不再详细说明。 Operating systems are generally well known and therefore not described in detail. 例如,操作系统可以是OS/2、 DOS、 Unix、 Palm OS等等。 For example, the operating system may be OS / 2, DOS, Unix, Palm OS and the like. 操作系统还可以是特殊用途的操作系统,例如可用于受限用途的设备型计算装置的操作系统。 The operating system may also be a special purpose operating system, such as the operating system uses device-type computing device may be used is limited. 操作系统、其它计算机代码和数据可以驻留在在操作上和处理器56相连的存储器块58内。 Operating system, other computer code and data may reside within a memory block 58 and operatively coupled to the processor 56. 存储器块58 —般提供用于存储计算机代码和可以由计算机系统50使用的数据的位置。 Memory blocks 58 - generally provide a location for storing computer code and data may be used by a computer system 50. 例如,存储器块58可以包括只读存储器(ROM)、随机存取存储器(RAM)、 硬盘装置等等。 For example, memory block 58 may include read only memory (ROM), a random access memory (RAM), a hard disk device and the like. 信息也可以驻留在可除去的存储介质上,当需要时被下载或安装到计算机系统50上。 Information may also reside on a removable storage medium, when needed to be installed or downloaded to a computer system 50. 可除去的存储介质例如包括CD-ROM、 PC-CARD 、存储卡、软盘、磁带和网络元件。 Removable storage medium, for example, comprises a CD-ROM, PC-CARD, memory card, floppy disk, magnetic tape, and a network element.

计算机系统50还可以包括可以在操作上和处理器56相连的显示装置68。 The computer system 50 may further include a display device 68 and the processor 56 may be operatively coupled. 显示装置68可以是液晶显示器(LCD)(例如有源矩阵、无源矩阵等)。 The display device 68 may be a liquid crystal display (the LCD) (e.g. an active matrix, passive matrix and the like). 或者,显示装置68可以是监视器,例如单色显示器、 彩色图形适配器(CGA)显示器、增强的图形适配器(EGA)显示器、可变图形阵列(VGA)显示器、超级VGA显示器、阴极射线管(CRT)等。 Alternatively, the display device 68 may be a monitor, for example, a monochrome display, color graphics adapter (CGA) display, enhanced graphics adapter (EGA) display, variable-graphics-array (VGA) display, super VGA display, cathode ray tube (CRT )Wait. 显示装置还可以是等离子显示器或利用电子链接实现的显示器。 The display device may also be a plasma display or a display using electronic links achieved.

显示装置68—般可被配置用于显示图形用户界面69,其使得容易使用在计算机系统的用户和操作系统或在操作系统上运行的应用程序之间的用户界面。 68- The display device may be generally configured to display a graphical user interface 69, which makes it easy to use the user interface between the user and the computer system operating system or application program running on the operating system. 一般地说,GUI69代表程序、文件、以及具有图形图像、对象或矢量表示的可操作的选择。 In general, representatives GUI69 programs, files, and selecting the operable graphic image or vector objects represented. 图形图像可以包括窗口、 字段、会话框、菜单、图标、按钮、巻动条等。 Graphic images may include windows, fields, session boxes, menus, icons, buttons, scroll bars, etc. Volume. 这种图像可以以预定 Such an image may be predetermined

的布局被管理,或者可以被动态地产生,以用于用户进行的特定操作。 Layout is managed, or may be dynamically generated, for a particular operation by the user. 在操作期间,用户可以选择和/或激活多种图形图像,以便启动功能以及和功能相关联的任务。 During operation, the user may select and / or activate various graphical images in order to initiate functions and tasks and associated functionality. 例如,用户可以选择打开、关闭、最小化或 For example, a user may choose to open, close, minimize, or

最大化窗口的按钮,或者选择启动特定程序的图标。 Button to maximize the window, or select the icon to launch a specific program. GUI6P可以在显示装置18上对用户附带地或者另外地显示信息,例如非交互式的文本和图形。 Incidentally, the user may be GUI6P or otherwise display information on the display device 18, such as non interactive text and graphics.

计算机系统50还可以包括在操作上可以和处理器56相连的输入装置70。 The computer system 50 may also include input means may be operatively coupled to the processor 56 and 70. 输入装置70可被配置用于从外部世界向计算机系统50传递数据。 The input device 70 may be configured to pass from the outside world into the computer system 50 data. 输入装置70例如可用于进行跟踪以及在显示器68上对GUI 69 进行选择。 The input device 70 may be used, for example, as well as track selection GUI 69 on the display 68. 输入装置70还可用于在计算机系统50中发送指令。 The input device 70 may also be a computer system 50 for transmitting instructions. 输入装置70可以包括触摸感知装置,其被配置用于接收来自用户的触摸的输入,并把这个信息发送到处理器56。 The input device 70 may include a touch sensing device, which is configured for receiving a touch input from a user, and sends this information to the processor 56. 例如,触摸感知装置可以是触摸垫或触摸屏。 For example, the touch sensing means may be a touch pad or a touch screen. 在许多情况下,触摸感知装置辨别触摸以及在触摸感知表面上触摸的位置和大小。 In many cases, the touch and the touch sensing means to identify the location and size of the touch sensing on a touch surface. 触摸感知装置检测并向处理器56报告触摸,处理器56则按照其程序解释触摸。 The touch sensing means reports detection of a touch to the processor 56, the processor 56 interprets the touches in accordance with its. 例如,处理器56可以按照特定的触摸启动任务。 For example, the processor 56 may initiate a task in accordance with a particular touch. 可以使用专用处理器局部地处理触摸,并降 Dedicated processor may be used to process touches locally and reduce

低对计算机系统的主处理器的要求。 Low demands on the computer system's main processor.

触摸感知装置可以基于感知技术,包括但不限于电容感测、电阻感测、表面声波感测、压力感测、光感测等等。 The touch sensing device may be based on sensing technologies including but not limited to capacitive sensing, resistive sensing, surface acoustic wave sensing, pressure sensing, optical sensing and the like. 此外,触摸感知装置可用于单点感测或多点感测。 Further, the touch sensing means may be used for single-point or multi-point sensing sensing. 单点感测只能辨别一个触摸,而多点感 Single point sensing can only distinguish a touch, and multi-sense

测能够辨别同时发生的多个触摸。 Measurement can distinguish multiple touches simultaneously.

如上所述,输入装置70可以是触摸屏,其位置显示器68的上方或前方,和显示装置68集成在一起,或者是一个单独的元件,例如触摸垫。 As described above, the input device 70 may be a touch screen, the display position above or in front of the 68, 68 and the display device integrated with, or a separate element, such as a touch pad.

计算机系统50优选地还包括用于和一个或多个I/O装置80耦合的电容。 The computer system 50 also preferably includes a capacitive coupling for one or more I / O devices 80. 例如,1/O装置80可以是键盘、打印机、扫描仪、照相机、 麦克风、扬声器等等。 For example, 1 / O device 80 may be a keyboard, a printer, a scanner, a camera, a microphone, a speaker, and the like. 1/O装置80可以和计算机系统50集成在一起, 或者是单独的元件(例如外围装置)。 1 / O device 80 may be integrated with the computer system 50, or a separate element (e.g., peripheral devices). 在一些情况下,1/0装置训可以通过有线连接(例如电缆/端口)和计算机系统50相连。 In some cases, 1/0 training device can be connected through wired (e.g., cables / ports) and a computer system 50. 在其它情况下,1/O装置80可以通过无线链接和计算机系统80相连。 In other cases, 1 / O devices 80 may be connected via wireless links, and the computer system 80. 例如, 数据链接可以是PS/2、 USB、 IR、火线、RF、蓝牙等。 For example, the data link may be a PS / 2, USB, IR, Firewire, RF, Bluetooth or the like.

按照本发明的一个实施例,计算机系统50被设计用于辨别提供给输入装置70的手势85,并根据手势85控制计算机系统50的各个方面。 50 is designed for discriminating device 85 is supplied to the input gesture 70 and 85 controls the computer system 50 in accordance with various aspects of the gesture embodiment, the computer system according to an embodiment of the present invention. 在一些情况下,手势可被定义为可被映射成一个或多个特定的计算操作的和输入装置的被风格化的相互作用。 In some cases, the gesture may be defined as the interaction can be mapped to be a stylized or more specific computing operations and the input device. 手势85可以通过各种手(更具体地说手指)的运动被构成。 85 by a variety of hand gestures (and more particularly the fingers) of the movement is constituted. 额外地或者替换地,手势可以借助于铁笔而被构成。 Additionally or alternatively, the gesture may be configured by means of a stylus. 在所有这些情况下,输入装置70接收手势85,处理器56执行和手势85相关的操作的指令。 In all these cases, the input device 70 receives the gestures 85 and the processor 56 performs the gesture 85 associated instruction operation. 此外,存储器块58 可以包括手势操作的程序88,其可以是操作系统的一部分,或者是一个单独的应用程序。 In addition, the memory block 58 may include a gesture operation program 88, which may be part of an operating system or a separate application. 手势操作程序88 —般可以包括一组指令,该指令辨别手势85的发生并把手势85和/或响应手势85而进行的操作通知一个或多个软件代理。 Gesture Procedure 88-- may generally comprise a set of instructions to identify the occurrence of gestures 85 and the gestures 85 and / or 85 in response to the gesture operation notification carried out one or more software agents. 有关可以作为输入指令使用的各种手势的其它细节将在下面被进一步讨论。 For it is discussed further below as further details of an input command using various gestures.

按照优选实施例,当用户进行一个或多个手势时,输入装置70 把手势信息传递到处理器56。 According to a preferred embodiment, when a user performs one or more gestures, the gesture information inputting means 70 is transmitted to the processor 56. 处理器56使用来自存储器58的指令, 更具体地说,使用手势操作的程序88,解释手势85,并根据手势85 控制计算机系统50的不同的元件,例如存储器58、显示器68和I/0 装置80。 The processor 56 uses the instruction from the memory 58 and, more specifically, a gesture operation program 88, 85 to explain the gesture and the gesture element 85 depending on the control computer system 50, such as a memory 58, a display 68 and I / 0 devices 80. 手势85可被识别为指令,用于执行在存储器58中存储的应用程序中的操作、修改在显示器68上显示的图像对象,修改在存储器58中存储的数据,和/或在1/0装置80中进行操作。 85 gesture may be identified as an instruction for performing operations in an application stored in the memory 58, edit the object image displayed on the display 68, modifying data stored in the memory 58, and / or means 1/0 80 in operation.

此外,虽然为了说明的目的图l作为两个单独的方块示出了输入装置70和显示器69,但这两个方块可以在一个装置上被实现。 Further, while for purposes of illustration in FIG. L as two separate boxes illustrating the input device 70 and a display 69, these two blocks may be implemented on a device.

图2表示使用多触摸板作为手势输入装置的示例的计算系统10, 多触摸板24可以同时是一个显示板。 2 shows a computing system using a multi-touch panel as an example of a gesture input apparatus 10, a multi-touch panel 24 may be a display panel simultaneously. 计算系统10可以包括专用于多触摸子系统27的一个或多个多触摸板处理器12。 The computing system 10 may include a multi-touch subsystem dedicated to a multi-touch panel 27 of the processor 12 or more. 或者,多触摸板处理器的功能可以由专用逻辑例如状态机来实现。 Alternatively, the multi-touch panel processor functionality can be implemented by a state machine, for example, special purpose logic. 外围设备11可以包括但不限于随机存取存储器(RAM)或其它类型的存储器、监视定时器等。 Peripheral 11 can include, but are not limited to, random access memory (RAM) or other types of memory, watchdog timer and the like. 多触摸子系统27可以包括但不限于一个或多个模拟通道17、通道扫描逻辑18和驱动器逻辑19。 Multi-touch subsystem 27 may include, but is not limited to one or more analog channels 17, channel scan logic 18 and driver logic 19. 通道扫描逻辑18可以访问RAM 16, 从模拟通道自动地读数据并对模拟通道提供控制。 Channel scan logic 18 may access RAM 16, and the data is automatically read from the analog control channel provides the analog channels. 该控制可以包括把多触摸板24的列多路传输到模拟通道17。 The control may include a touchpad the plurality of column multiplexer 24 to an analog transmission channel 17. 此外,通道扫描逻辑18可以控制驱动器逻辑以及被选择地提供给多触摸板24的行的模拟信号。 In addition, channel scan logic 18 may control the driver logic and is selectively supplied to the analog signal line 24 of the multi-touch panel. 在一些实施例中,多触摸子系统27、多触摸板处理器12和外围设备11可以被集成在一个应用特定的集成电路(ASIC)中。 In some embodiments, the multi-touch subsystem 27, a multi-touch panel processor 12 and the peripheral device 11 may be integrated in an application specific integrated circuit (ASIC) in the.

驱动器逻辑19可以提供多个多触摸子系统输出20,可以提供驱动高压驱动器的专有界面,高压驱动器优选地包括译码器21和后续的电平移动器和驱动器级22,虽然电平移动功能可以在译码器功能之前被执行。 Driver logic 19 may provide a plurality of multi-touch subsystem output 20, can provide a driving high voltage driver proprietary interface, a high voltage driver 22 is preferably, although a level shift function comprises a decoder 21 and a subsequent level shifter and driver stage It may be performed before decoder function. 电平移动器和驱动器22可以提供从低电压电平(例如CMOS电平)到较高电压电平的电平移动,提供较好的信噪比以便减少噪声。 Level shifter and driver 22 may be provided from a low voltage level (e.g. CMOS level) higher voltage level to the power level shifting to provide better signal to noise ratio in order to reduce noise. 译码器21可以把驱动界面信号译码成N个输出之一,其中N可以是板中的最大的行数。 The decoder 21 can be driven interface signal into a one of the N outputs, where N is the maximum number of rows may be plate. 译码器21可用于减少在高压驱动器和多触摸板24之间所需的驱动线的数量。 Decoder 21 may be used to reduce the number of required between the high voltage driver 24 and a plurality of drive lines of the touch panel. 每个多触摸板行输入23可以驱动多触摸板24中的一个或多个行。 Each multi-line input touch pad 23 can be driven in a multi-touch panel 24 or a plurality of rows. 应当注意,驱动器22和译码器21可被集成为一个ASIC,被集成在驱动器逻辑19中,或者在一些实 It should be noted that the driver 22 and the decoder 21 may be integrated as a an ASIC, it is integrated in the drive logic 19, or, in some real

例中可能是不需要的。 Examples may not be required.

多触摸板24可以包括电容感测介质,具有多个行轨迹或行驱动线,以及多个列轨迹或感测线,虽然也可以使用其它的感测介质。 Multi-touch panel 24 may include a capacitive sensing medium having a plurality of lines of tracks or row wire, and a plurality of rows of tracks or sensing lines, although also other sensing media. 行轨迹和列轨迹可以由透明的导电介质构成,例如铟锡氧化物(ITO)或锑锡氧化物(ATO),虽然也可以使用其它透明的和非透明的材料例如铜。 Row and column trace track may be formed of a transparent conductive medium such as indium tin oxide (ITO) or antimony tin oxide (ATO), although other transparent and may be used a non-transparent material such as copper. 在一些实施例中,行轨迹和列轨迹可以在介电材料的相对侧上被形成,并且可以相互垂直,虽然在其它实施例中,其它的非笛卡儿方位也是可能的。 In some embodiments, the row and column trace track may be formed on the opposite side of the dielectric material, and may be perpendicular to each other, although in other embodiments other non-Cartesian orientations are also possible. 例如,在极座标系统中,感测线可以是同心圓,驱动线可以是沿径向延伸的线(或反之亦然)。 For example, in the polar coordinate system, the sensing lines can be concentric circles, the driving line may be a line (or vice versa) extending radially. 因此,应当理解,这里使用的术语"行"和"列"、"第一维"和"第二维"、"第一轴线"和"第二轴线,,旨在不仅包括正交的栅格,而且包括具有第一维和第二维其它几何结构的相交的轨迹(例如极座标排列的同心线和径线)。行和列可以在衬底的一侧上被形成,或者可以在由介电材料隔开的两个单独的衬底上被形成。在一些例子中, 一个附加的介电覆盖层可被置于行轨迹或列轨迹上,以增强该结构并保护整个组件不被破坏。 Accordingly, it should be understood that the terminology used herein "row" and "column," "first dimension" and "second dimension", the "first axis" and "second axis ,, is intended to include not only orthogonal grids , but also having a first dimension and intersects the track (e.g. concentric lines and radial lines arranged in polar coordinates) in the second dimension other geometries. rows and columns may be formed on a side of the substrate, or can be mediated by is formed on two separate substrates separated by the dielectric material. in some instances, an additional dielectric cap layer may be placed on a row or column trace track to enhance and protect the entire assembly of the structure is not destroyed.

在多触摸板24的"交点",即上下轨迹互相通过(跨过)(但不进行相互直接电接触)的位置,轨迹基本上形成两个电极(虽然两个以上的轨迹也可以交叉)。 In the multi-touch panel "intersection point" 24, i.e., track each other through the vertical (crossing) (without direct electrical contact with each other) position, the track is formed substantially two electrodes (although more than two tracks can cross). 行轨迹或列轨迹的每个交点可以提供电容感测节点,并且可被视为一个图像元素(像素)26,当多触摸板24 被看作捕获触摸的"图像"时这尤其是有用的。 Each intersection of row or column trace locus may provide capacitive sensing node and can be viewed as a picture element (pixel) 26, when the multi-touched the touch panel 24 is captured regarded as an "image" This is particularly useful. 换句话说,在多触摸子系统27确定在多触摸板内的每个触摸传感器是否检测到触摸事件之后,在发生了触摸事件的多触摸板中的触摸传感器的图案可被视为触摸的"图像"(例如触摸多触摸板的手指的图案)。 In other words, after a multi-touch subsystem 27 determining each touch sensor in the touch panel detecting whether a multi-touch event, the touch event occurred in a multi-touch panel of a touch sensor pattern may be considered as touched " image "(e.g. a pattern of fingers touching the multi-touch panel). 当给定的行被保持在DC下时,在行电极和列电极之间的电容似乎是在所有列上的杂散电容,当给定的行利用AC信号激励时,则似乎是共有电容Csig。 When a given row is held at DC, their capacitances between the row and column electrodes appears to be a stray capacitance on all columns, a given row when using the AC excitation signal, it seems to be a total capacitance Csig . 在多触摸板上或附近手指或其它物体的存在可以通过测量改变为Csig 而被检测。 The presence or near the finger or other object on the multi-touch panel can be changed to be detected by measuring Csig. 多触摸子系统27中的多触摸板124的列可以驱动一个或多个模拟通道17(这里也叫做事件检测和解调电路)。 Multiple multi-touch subsystem 124, touch panel 27 in the columns can drive one or more analog channels 17 (also referred to herein as event detection and demodulation circuit). 在一些实现中, 每个列可被耦联到一个专用的模拟通道17。 In some implementations, each column can be coupled to one dedicated analog channel 17. 不过,在其它实现中,这些列可以通过模拟开关耦联到较少的模拟通道17。 However, in other implementations, fewer columns can be coupled to the analog channel 17 through an analog switch.

计算系统10还可以包括主处理器14,用于接收来自多触摸板处理器12的输出并根据该输出进行操作,包括但不限于移动对象例如光标或指针、巻动或扫视、调节控制设置、打开文件或文档、浏览菜单、进行选择、执行指令、操作和主设备相连的外围设备等。 The computing system 10 may further include a main processor 14 for receiving outputs from the processor 12 of the multi-touch panel and the operation according to the output, including but not limited to moving an object such as a cursor or pointer, or a movable Volume panning, adjusting control settings, opening a file or document, browsing a menu, making a selection, executing instructions, operating the master device and peripheral devices connected to it. 主处理器14,其可以是个人计算机的CPU,也可以执行和多触摸板处理无关的附加功能,并且可以和程序存储器15以及显示装置13例如LCD 显示器相连,以便向设备的用户提供用户界面(UI)。 Master processor 14, which may be a personal computer's CPU, may also perform additional functions and a plurality of independent touch panel processing, and can be connected and a program memory 15 and a display device 13 such as an LCD display to provide a user interface to a user equipment ( UI).

应当注意,虽然图2示出了专用的MT板处理器12,多触摸子系统可被主处理器14直接控制。 It should be noted that, while FIG. 2 shows a dedicated processor MT plate 12, a multi-touch subsystem may be a direct control of the main processor 14. 此外,应当注意,多触摸板24和显示装置13可被集成在一个触摸屏显示装置中。 Further, it should be noted that the multi-touch panel 24 and the display device 13 may be integrated in a touch screen display device. 多触摸传感器检测的其它细节,包括由触摸板进行的接近检测,在共同转让的未决申请中被描述了,包括申请号10/840862 ,其美国专利公开号为US2006/0097991 , 申请号为11/428522 , 美国专利公开号US2006/0238522,以及在2007年1月3日提交的名称为"Proximity and Multi-Touch Sensor Detection and Demodulation(接近与多触摸传感器检测和解调)"的专利申请,所有这些专利申请的全部内容通过引用被包括在此。 Other details of the multi-touch sensor detection comprises a proximity detection by a touch panel, in commonly assigned copending applications are described, including Application No. 10/840862, which is U.S. Patent Publication No. US2006 / 0097991, Application No. 11 / 428 522, US Patent Publication No. US2006 / 0238522, as well as the name of the January 3, 2007, filed as "proximity and multi-touch sensor detection and demodulation (close to the multi-touch sensor to detect and demodulate)" patent application, all the entire contents of these patent applications are incorporated herein by reference.

图3表示按照本发明的一个实施例的多点处理方法100。 3 shows a multi-processing method according to an embodiment of the present invention 100. 多点处理方法100例如可以在图l或图2所示的系统中被执行。 Multipoint processing method 100 may be performed, for example, in the system shown in FIG. 2 or FIG. L. 多点处理方法100 —般在块102开始,此时可以从多点输入装置即多点触摸屏读出图像。 Multipoint processing method 100 - as beginning at block 102, i.e., this case can be a multipoint touch screen read out the image from the multi-point input means. 虽然使用了"图像"这个术语,应当注意数据可以呈其它的形式。 Although the use of an "image" of this term, it should be noted that the data may be in other forms. 在大多数情况下,从触摸屏读出的图像对于触摸屏的每个检测点或像素提供作为位置(x,y)的函数的幅值(Z),该幅值例如可以反映在每个点测量的电容。 In most cases, the image read from the touch screen provides magnitude as a function of position (x, y) of (Z) for each detection point or pixel of the touch screen, for example, may reflect the magnitude at each point of measurement capacitance.

在块102之后,多点处理方法100前进到块104,此时可以把图像转换成特征集合或特征列表。 Following block 102, multipoint processing method 100 proceeds to block 104, then the image can be converted into a feature list or feature set. 每个特征代表不同的输入例如触摸。 Each feature represents a distinct input such as a touch. 在大多数情况下,每个特征可以包括其自身的唯一标识符(ID)、 y座标、x座标、Z幅值、角度9、面积A等。 In most cases, each feature may include its own unique identifier (ID), y coordinates, x coordinate, Z magnitude, angle 9, the area A and the like. 例如,图4A,4B实时地表示一个具体图像120。 For example, FIG. 4A, 4B showing a specific real-time image 120. 在图像120中,可以具有两个基于两个不同触摸的特征122。 In the image 120, it may have two features based on two distinct touches 122. 这些触摸例如可以由触摸所述触摸屏的一对手指形成。 The touch may be formed of a touch panel of the touch finger. 如图所示,每个特征122可以包括唯一的标识符(ID)、 x座标、y座标、 Z幅值、角度e、以及面积A。 As shown, each feature 122 may include a unique identifier (ID), x coordinate, y coordinate, Z magnitude, angle E, and the area A. 更具体地说,第一特征122A可以由IDhXhYhZh0hAi表示,第二特征12B可以由ID2,X2,Y2,Z2,e2,A2表示。 More specifically, the first feature 122A may be represented by IDhXhYhZh0hAi, 12B may be represented by the second feature ID2, X2, Y2, Z2, e2, A2. 这些数据例如可以使用多触摸协议被输出。 These data may be output using a multi-touch protocol.

从数据或图像到特征的转换可以使用在申请号为10/840862、公开号为US2006/007991的未决的美国专利申请中所述的方法来实现, 该专利申请也通过引用被包括在此。 From data or images to features may be used in the conversion of Application No. 10/840862, publication number pending the method described in U.S. Patent Application US2006 / 007991 is achieved, which patent application is also incorporated herein by reference. 如该专利申请中所述,原始数据一般以数字化的形式被接收,并且可以包括关于触摸屏的每个节点的值。 As described in that patent application, the original data is typically received in a digitized form, and may include a value for each node of the touch screen. 这些值可以在0和256之间,其中O等于没有触摸压力,256等于全部的触摸压力。 These values ​​may be between 0 and 256, where O equals no touch pressure, touch 256 equal to the total pressure. 此后,原始数据可被滤波以便减少噪声。 Thereafter, the raw data can be filtered to reduce noise. 一旦经过滤波,便可以产生指示每组连接点的拓朴的梯度数据。 Once filtered, gradient data can generate a topology indicating a connection point of each set. 此后,可以根据梯度数据计算触摸区域的边界(即进行这样的确定,确定哪些点可被分成一组,以形成每个触摸区域)例如,可以使用分水呤算法。 Thereafter, the boundary may be calculated based on the gradient of the touch area data (i.e., for such a determination, can determine which points are grouped to form each touch region) For example, a watershed algorithm methotrexate. 一旦边界被确定,便可以计算关于每个触摸区域的数据(例如X,Y,Z,θ,A)。 Once the boundaries are determined, the data can be calculated with respect to each of the touch area (e.g., X, Y, Z, θ, A).

在块104之后,多点处理方法100前进到块106,在此可以执行特征分类和分组处理。 Following block 104, multipoint processing method 100 proceeds to block 106 where feature classification and can perform packet processing. 在分类期间,可以确定每个特征的特性。 During the classification, it is possible to determine the characteristics of each feature. 例如, 特征可被分类为具体的手指、拇指、手掌或其它物体。 For example, features may be classified as a particular finger, thumb, palm or other object. 一旦被分类, 便可以对特征分组。 Once classified, it can be grouped feature. 构成组的方式可以是多种多样的。 The configuration mode set can be varied. 在大多数情况下,可以根据一些标准(例如它们具有类似的属性)对特征分组。 In most cases, according to some criteria (e.g., they have similar properties) to the packet characteristic. 例如,图4A,4B所示的两个特征可被分为一组,这是因为这些特征的每一个可被置于另一个附近,或者因为它们来自同一只手。 E.g., 4A, 4B two features shown may be divided into a group, because each of these features may be placed near the other, or because they are from the same hand. 分组可以包括某种程度的滤波,以滤除不是触摸事件的一部分的特征。 Packet may include some level of filtering to filter out features that are not part of the touch event. 在滤波时, 可以拒绝一个或多个特征,因为它们满足一些预定的准则,或者因为它们不满足一些准则。 When filtering, one or more features may be rejected because they meet some predefined criteria or because they do not meet some of the criteria. 例如,其中的一个特征可被分类为位于输入板PC边沿的拇指。 For example, one of the features may be classified as a thumb located at the input edge of the PC board. 因为拇指用于保持着设备,而不用于执行任务,由其产生的特征被拒绝,即不被认为是被处理的触摸事件的一部分。 Since the device for holding the thumb and not for performing a task, the feature generated therefrom is rejected, i.e., is not considered part of the touch event being processed.

在块106之后,多点处理方法100前进到块108,此时可以计算特征组的关键参数。 Following block 106, multipoint processing method 100 proceeds to block 108, at this time may be calculated feature set of key parameters. 关键参数可以包括特征之间的距离、所有特征的x/y质心、特征转动、所述组的总压力(例如在质心的压力)等。 The key parameters may include distance between features, x all features / y centroid, wherein the rotation, total pressure (e.g. pressure centroid) of the set and the like. 如图5所示,该计算可以包括求出质心C,确定每个虛线(D1,D2)的距离D,然后求出距离D1, D2的平均值。 5, the calculation may include obtaining the centroid C, determined for each broken line (D1, D2) of the distance D, and obtains distances D1, D2 of the average value. 一旦参数被算出,便可以报告参数值。 Once the parameters are calculated, they can report parameter values. 参数值一般和组标识(GID)以及在每组内的特征数目(本例中为3个)一起被报告。 General parameters and group identification (GID) and number of features within each group (in this case three) are reported together. 在大多数情况下,报告初始的和当前的参数值。 In most cases, the initial report and the current parameter values. 初始参数值可以基于落地(set down),即当用户把其手指置于触摸屏上时,当前值可以基于在落地之后发生的动作内的任一点。 Initial parameter values ​​may be based on ground (set down), i.e., when a user put his or her finger on the touch screen, the current value may be based on any of the operations occurring after the landing point.

如应当理解的那样,块102- 108在用户的动作期间可被重复地执行,借以产生多个按顺序配置的信号。 As should be appreciated, blocks 102-108 may be performed repeatedly during the operation of the user, thereby generating a plurality of sequentially configured signals. 在后面的步骤中,可以使初始的和当前的参数进行比较,以便在系统中进行操作。 In a later step, and the initial current can compare the parameters, in order to operate the system.

在块108之后,处理流程前进到块110,在此可以使所述组和用户界面(UI)元件相关联。 Following block 108, the process flow proceeds to block 110 where the user groups and may cause the interface (UI) element is associated. UI元件可以是按钮块、表、滑动块、滚轮、 扳钮等。 UI may be a button element block table, slider, roller, paddle and the like. 每个UI元件代表用户界面的元件或控制。 Representative each UI element or control elements of the user interface. 在UI元件后面的应用程序可以访问在块108计算的参数数据。 You can access the parameter data calculated in block 108 in a later application UI element. 在一个实现中,应用程序对触摸数据对和与其相应的UI元件的关联排序。 In one implementation, the application associated data and sort the touch UI element corresponding thereto. 该排序可以基于一些预定的准则。 The ranking may be based on some predetermined criteria. 排序可以包括产生优值,并且不管哪个UI元件具有最高的优值,只允许其访问所述组。 Ordering may include generating merit, and whichever UI element has the highest figure of merit, which only allow access to the group. 甚至还具有某种程度的滞后(一旦所述UI元件之一要求控制那个组,该组便粘住该UI元件,直到另一个UI元件具有更高的排序)。 Even with a certain degree of hysteresis (once one of the UI elements claims control of that group, the group will stick to the UI element until another UI element has a higher ranking). 例如,排序可以包括确定质心(或特征)到与UI元件关联的图像对象的接近度。 For example, the ordering may include determining the centroid (or features) to the proximity of the image of an object associated with the UI element.

在块110之后,多点处理方法前进到块112和114。 Following block 110, multipoint processing method 114 proceeds to block 112 and. 块112和114 可以净皮大致地同时执行。 Block 112 and 114 may be performed substantially simultaneously net skin. 在一个实施例中,从用户看来,块112和114 似乎被同时执行。 In one embodiment, from a user's perspective, blocks 112 and 114 appear to be performed simultaneously. 在块112中,可以根据在初始的和当前的参数值之间的差值执行一个或多个操作,也可以根据和其关联的UI元件被执行(如果有的话)。 In block 112, may perform one or more operations based on a difference between the initial and current parameter values, and may be in accordance with its associated UI element is executed (if any). 在块114中可以提供关于正被执行的一个或多个操作用户的反馈。 In block 114 may provide feedback regarding one or more user operation being performed. 例如,用户反馈可以包括显示、音频、触觉反馈等。 For example, user feedback may include display, audio, tactile feedback.

附图6表示按照本发明的一个实施例的参数计算方法150。 Figure 6 shows an example of the parameter calculation method 150 according to an embodiment of the present invention. 参数计算方法150例如可以对应于图3所示的块108。 Parameter calculation method 150 may, for example, correspond to the block 3108 shown in FIG. 参数计算方法150 一般在块152开始,在此可以接收特征组。 Parameter calculation method 150 generally begins at block 152, wherein this group may be received. 在块152之后,参数计算方法150前进到块154,确定在特征组内的特征数目是否发生了改变。 After block 152, the parameter calculation method 150 proceeds to block 154, determines whether the number of features within the feature set has changed. 例如,由于用户抬起或放置一个附加的手指而使特征数目发生改变。 For example, since the user lifts or placing an additional finger changes the number of features. 可能需要不同的手指进行不同的控制(例如跟踪、作手势)。 It may require a different finger for different controls (such as tracking, gesturing). 如果特征数目改变,则参数计算方法前进到块156,在此可以计算初始参数值。 If the number of feature change, the parameter calculation method proceeds to block 156 where the initial parameter values ​​may be calculated. 如果数目保持相同,则参数计算方法150前进到块158,可以计算当前参数值。 If the number remains the same, the parameter calculation method 150 proceeds to block 158, the current parameter value may be calculated. 此后,参数计算方法150前进到块160,可以报告初始和当前参数值。 Thereafter, the parameter calculation method 150 proceeds to block 160, and can report the initial current parameter values. 例如,初始参数值可以包含点之间的平均初始距离(或初始距离(AVG)),当前参数值可以包含点之间的平均当前距离 For example, the initial parameter values ​​may contain the average initial distance (or the initial distance (the AVG)) between points, the current parameter values ​​may contain the average current distance between points

(或当前距离(AVG))。 (Or the current distance (AVG)). 这些可以在以后的步骤中被比较,以便控制一个计算机系统的各个方面。 These may be compared in subsequent steps in order to control various aspects of a computer system.

上述方法和技术可用于实现任何数量的GUI界面对象和操作。 The above-described methods and techniques may be used to implement any number of GUI interface objects and actions.

例如,可以产生手势,以便检测和实现用户指令,以改变窗口的尺寸、 巻动一个显示、转动一个对象、拉近和推远一个显示的视图、删除或插入文本或其它对象等。 For example, a gesture may be generated, in order to detect and implementing user commands to change the window size, Volume moving a display, rotation of an object, zoom in and zoom out a displayed view, delete or insert text or other objects.

手势的基本种类应当使用户能够输入可以通过使用常规的鼠标 The basic type of the gesture can be input by the user to enable use of a conventional mouse

或轨迹球装置输入的常用的指令。 Instruction input means or conventional trackball. 图7表示用于处理鼠标点击操作的流程图表。 7 shows a flow chart for processing a mouse click operation. 图7F表示用于处理鼠标点击操作的检测的流程图。 FIG. 7F flowchart showing a process for detecting the click operation of the mouse. 由块710开始,可以进行手指的一个或两个触摸的检测,如果在711确定检测的触摸是一个手指,则712确定该触摸是否在与可选的文件对象关联的被显示图形对象的预定接近度之内,如果是,则在714进行选择操作。 Starting from block 710 may detect a touch of a finger or two, if determined that the touch is detected at a finger 711, 712 determines whether the touch is close to the optional file object associated with the graphical object is displayed in a predetermined within degrees, if so, at 714 the selection operation. 如果在716检测到和可选对象关联的双击操作,则718可以调用双击操作。 If the selectable object 716 is detected and the associated double-click operation, a double click operation 718 may call. 双击操作可以通过检测手指离开触摸屏并立即再次触摸屏幕来检测。 Double-click operation can detect a finger leaves the touch screen by touching the screen again and immediately be detected. 按照另一个实施例,如果检测到触摸选择的对象的手指停留的时间大于一个预定的时间间隔,则可以调用双击操作。 According to another embodiment, a finger touch is detected if the selected object residence time is greater than a predetermined time interval, a double click operation may be invoked.

如图7G所示,如果检测到手指触摸不和一个可选文件对象相关, 而是在720确定和一个网络地址超级链接相关,则调用单点击操作, 借以启动超级链接。 As shown, if not detected finger touch and an optional file object related, but a network to identify and address relevant hyperlinks in 720, is called 7G single click operation, so as to activate the hyperlink. 如果在非浏览器环境内超级链接被触摸,则应当 If the hyperlink is touched in a non-browser environment, you should

运行浏览器应用程序。 Running browser application.

如果在711检测到两个手指触摸,则在713如果至少一个落地点和可选文件对象相关,则在715选择该对象。 If the two finger touch is detected 711, then at 713, and if at least one alternative landing point associated file object, then the object 715 selected. 如果在717检测到在触敏显示器上手指之一的一个或多个点击,同时落地点被保持,则可以调用右点击鼠标操作。 If the finger 717 is detected one or more of a click on the touch-sensitive display while the landing point is maintained, then the call can right-click the mouse.

按照优选实施例,如果检测到的一个或多个触摸不与任何可选文件对象或超级链接相关,则如图7H所示,在722确定落地点是否和可巻动的区域(例如文本编辑应用窗口、文件列表窗口或者互联网网页)相关。 According to a preferred embodiment, if the detected one or more touch is not associated with any optional file object or the hyperlinks shown in FIG. 7H, determining whether the falling point and the region may be movable in Volume 722 (e.g., a text editing application window, the file list window or an Internet page) related.

巻动一般涉及在显示屏上的观察区域上移动显示的数据或图像, 使得可以在观察区域看到一组新的数据。 Volume movable generally relates to a mobile display on the viewing area on a display screen or image data, so that you can see a set of new data in the observation area. 在大多数情况下, 一旦观看区域成为满的,则每个新的数据组便出现在观看区域的边沿,并且所有的其它数据组向上移动一个位置。 In most cases, once the viewing area becomes full, each new set of data will appear in the edge of the viewing area and all other sets of data move up one position. 即,出现新的数据组来代替移出观看区域的每个数据组。 That is, the emergence of new sets of data out of view to replace each data set region. 实质上,这些功能使得用户能够看到当前在观看区域之外的相继的数据组。 In essence, these features enable the user to see the current sequential data set outside the viewing area. 在大多数情况下,用户借助于快速移动其手指能够加速其对这些数据组的遍历。 In most cases, the user quickly moves his finger by means of which can accelerate traversal of the data sets. 通过列表进行巻动的例子 For example by moving Volume List

可以在申请号为2003/0076303A1, 2003/0076301A1,2003/0095096A1 的美国专利申请中找到,这些专利申请通过引用被包括在此。 Can Application No. 2003 / 0076303A1, US Patent Application 2003 / 0076301A1,2003 / 0095096A1 found in these patent applications are included herein by reference.

如果落地点能够/可以在可巻动的区域内,则可以和下压常规鼠标装置上的巻动轮类似地在723调用巻动操作。 If the landing point can be / can be in the region of the movable Volume, Volume may be depressed and wheel on a conventional mouse device 723 similarly to calling Volume movable operation. 如果可巻动的区域只能沿一个方向巻动(例如上下),则被调用的巻动操作是单向巻动。 If the movable region can be Volume Volume movable (e.g., vertical) in one direction, the movable operation call were Volume Volume motion is unidirectional. 如果可巻动区域可以沿两个方向巻动,则调用的巻动操作是全方向的。 If the area may be movable Volume Volume movable in two directions, the movable operation call Volume is omnidirectional.

在把巻动约束为垂直方向(即Y轴)的单向巻动操作中,只有被跟踪的触摸运动的垂直矢量分量被用作实现垂直巻动的输入。 Volume constrained to move in the vertical direction (Y-axis) Volume movable operation way, only the vertical vector component of the touch movement is tracked Volume is used to achieve vertical movement input. 类似地,在被约束为水平方向的巻动的单向巻动操作中,只有被跟踪的触摸运动的水平矢量分量被用作实现水平巻动的输入。 Similarly, in the horizontal direction is constrained to a one-way operation of the movable Volume Volume movable in only the horizontal motion vector components of the touch tracked is used to achieve the level of the input moving Volume. 如果巻动操作是全向的,则实现的巻动操作将跟踪被跟踪的触摸的运动。 If the operation is a moving Volume Volume movable operation is achieved omnidirectional tracking motion of touches being tracked.

按照优选实施例,如果检测到的触摸是一个手指触摸,则在724 巻动操作可以准备以正常的或者1X速度进行。 According to a preferred embodiment, if the detected touch is the touch of a finger, the movable operation in Volume 724 can be prepared at normal or 1X speed. 如果并且一旦落地的手指开始的触摸屏上运动,则可以通过跟踪在触摸屏上落地点的运动进行巻动操作。 If the movement of the floor and once the finger starts a touch screen, the operation may be performed by tracking the movement of the movable Volume on the touch screen of the landing point. 如果检测到的触摸是两个手指的触摸,则在725可以以两倍或2X速度进行巻动操作。 If the detected touch is a touch two fingers, Volume can be operated to move twice the speed at 725 or 2X. 还可以增加附加的手指,以便进行更快的巻动操作,其中检测到四手指触摸可被解释成在多页文件窗口内的"上翻页"或"下翻页"指令。 May also add additional fingers, for faster Volume movable operation wherein four finger touch is detected can be interpreted as a multi-page document in the window, "next page," "next page" or instructions.

按照另一个实施例,即使当从触摸屏上除去手指时,显示的数据也继续运动。 According to another embodiment, even when the finger is removed from the touch screen, the displayed data continues moving. 该继续运动可以至少部分地基于以前的运动。 The movement continues to be at least partially based on the previous motion. 例如,可以以相同的方向和速度继续巻动。 For example, Volume may continue moving in the same direction and speed. 在一些情况下,巻动随时间变慢, 即通过媒体项目的遍历越来越慢,直到最终停止巻动而留下一个静止的表。 In some cases, Volume slow motion over time, that is, by traversing the media items getting slower and slower until it eventually stops moving Volume leaving a stationary table. 例如,进入视区的每个新的媒体项可以逐渐增加地减少速度。 For example, each new media item enters the viewport may incrementally decrease the speed. 额外地或者替换地,当手指放回触摸屏上时,显示数据停止运动。 Additionally or alternatively, when the finger back on the touch screen, the display data stops moving. 即, 在触摸屏上把手指放回可以实现制动,其停止或者减慢继续操作的运 That is, put your finger on the touch screen can be achieved back brake, to stop or slow down the operation to continue operations

动。 move.

下面通过例子说明上述的手势操作,如图7A所示,使用触摸屏(例如图2所示的多触摸屏24),由手指501在图像对象(例如文件表500 )上进行的一个手指的点按可被解释为等同于鼠标的一个点击, 在本例中其可以表示一个选择,其一般通过加亮选择的文件或图像对 The following examples illustrate the above-described gesture by the operation, shown in Figure 7A, a touch screen (e.g., a multi-touch screen shown in FIG. 24), by the finger 501 in the finger image of an object point (e.g., the file table 500) may be performed on the press is interpreted as equivalent to a mouse click, in the present embodiment, it may represent a choice, generally by highlighting the image of the selected file or

象来表示。 Like to represent. 检测到的图像对象上的两次点按可被解释为等同于鼠标的两次点击,其可以引起和点按的图像对象相关的应用程序的运行。 Two points on an object detected by the image may be interpreted as being equivalent to two mouse clicks, and which may cause the image of the object point by operating the associated application. 例如,对屏幕上列出的一个文件(例如照片文件)的两次点按可以引起运行照片浏览应用程序和打开照片文件。 For example, two points for a file (for example, file photo) listed on the screen can be caused by running the photo browsing application and open the photo file.

在至少一个手指内,借助于保持触摸,如图7B所示,通过触摸与要被落地的对象相关的图像可以调用拖放功能以及图形地把对象拖到所需的落地位置,显示了文件表501从文件夹窗口502被拖放到文件夹窗口503。 At least one finger, by means of a holding the touch, 7B, drag and drop function can be invoked by touching the image related to the object to be ground, and the graphic object onto the desired landing position, the file table shows 501 window 502 window 503 is dragged to a folder from the folder.

某些鼠标功能可能需要两次触摸才能完成。 Some mouse functions may require two touches to complete. 例如图7C所示,利用两个手指可以作出"右点击"手势,其中一个手指作为落地手指506, 第二手指507轻击屏幕至少一次,以表示右点击操作。 FIG. 7C for example, two fingers may be made to "right-click" gesture, where a finger as the finger floor 506, a second finger tap the screen 507 at least once to a right click operation. 图7D表示在可以进行右点击操作之后,可以调用操作窗口504,此后第一手指可以移动到调用的窗口504,以便利用一个手指506选择和轻击操作项505。 7D shows right-click can be performed after the operation, the operation can be called a window 504, after which the first finger to move the window to call the 504, 506 in order to use a finger to select items 505 and tap operation. 按照本发明的一个实施例,只有当检测到的轻击位于检测到的落地点附近,并且只有当检测到的轻击位于落地手指的左方(从用户的观察点看落地手指的右方)时,才能实现右点击操作。 According to one embodiment of the present invention, only when the detected near a tap to the landing point on the detector, and only when the detected finger tap is located on the left landing (viewed from the user point of view of the right landing finger) when, in order to achieve right-click operation.

通常要求鼠标和键盘操作组合的其它选择功能可以只使用触摸操作来实现。 Other selection function usually requires a combination of mouse and keyboard operations can only be realized using a touch operation. 例如,在微软视窗环境下,为了选择文件窗口502内的多个文件,用户一般需要按住移动(shift)按钮的同时在要被选择的序列文件上拖动鼠标图标。 For example, in a Microsoft Windows environment, in order to select a plurality of the files in a window 502, the user typically needs to hold the movement (Shift) button while dragging the mouse on the icon to be selected sequence file. 不按住移动(shift)按钮,鼠标图标的拖动可被解释为拖放操作。 Without holding the mobile (Shift) dragging the button, the mouse icon can be interpreted as a drag and drop operation. 如图7E所示,按照本发明的实施例,检测到文件表的两个接近的相关触摸拖动可被解释为用于选择一组文件508的多选择操作。 As shown in FIG 7E, according to an embodiment of the present invention, the detection of the two closest relevant file table touch drag can be interpreted as a set of files selected 508 for a multi-selection operation. 为了避免把所述二触摸操作错误地解释为其它的指令,例如转动操作,优选地,只有当检测到的两个触摸彼此相当接近时才调用二触摸多选择功能。 In order to avoid the two touch operation misinterpreted as other commands, e.g. rotational operation, preferably only when the two detected touch fairly close to one another two multi-touch selection function call.

参见图7H、 71和7J表示的巻动操作,在可巻动的窗口内一个或两个手指着地可以引起窗口的显示内容以不同的速度巻动。 Referring to Figure 7H, 71, and 7J Volume movable operation represented within a movable window Volume two fingers or the ground may cause the display of the content window Volume moving at different speeds. 具体地说, 一旦在723调用巻动操作,如果确定在触敏显示器上只检测到一个手指(或一个落地点),则在724以1X的速度巻动,如果检测到两个手指(或两个落地点),则以2X的速度巻动。 Specifically, once the call Volume movable operation 723, if it is determined to only detect a finger (or a landing point) on the touch-sensitive display 724 at a speed of 1X Volume motion, if the detected two fingers (or two a landing point), places the movable Volume 2X speed. 按照优选实施例, 在巻动操作期间,巻动条727和728沿与巻动方向一致的方向运动。 According to a preferred embodiment, during the operation of the movable Volume, Volume direction scroll bar 727 and 728 along the same direction of movement of the movable Volume.

最后,使用能够进行接近度检测的多触摸显示器,例如在前述的并通过引用被包括在本说明中的共同转让的申请号为10/840862 (美国专利公开号US2006/0097991 )专利申请以及在2007年1月3日提交的名称为"接近和多触摸传感器检测和解调"的专利申请中描述的板,手指的姿式也可用于引起等效于使鼠标图标悬停在图像对象上的悬停操作。 Finally, a multi-touch display can be performed using the proximity detection, and for example, in the aforementioned commonly assigned by reference including description of the present Application No. 10/840862 (U.S. Patent Publication No. US2006 / 0097991) and in Patent Application 2007 Title Patent application filed on January 3, as "proximity and touch sensors to detect and demodulate multiple" described in the plate, the finger posture may also be used to induce equivalent to make the mouse icon over the image object hanging stop operation.

例如,参见图7K,桌面729内应用图标731上方用户手指501 的接近度检测可被解释为悬停操作,其引起悬停的应用图标730的滚动弹出。 For example, referring to FIG. 7K, 729 within the desktop application icons 731 over the user's finger proximity detector 501 may be interpreted as hovering operation, which causes the rolling hover application icon 730 pops up. 如果用户触摸弹出的图标,则可以调用双击操作,借以运行该应用程序。 If the user touches an icon pops up, you can call double-click operation, in order to run the application. 对于应用特定的情况,可以应用类似的构思,例如当在照片管理软件内以缩略图格式显示照片文件时,检测到在缩略图上方手指接近则调用悬停操作,借以可以放大悬停的照片缩略图的尺寸(但是不选择)。 For application-specific circumstances, a similar concept can be applied, for example, when a picture is displayed in the picture file management software in the thumbnail format, the thumbnail detected in proximity the finger above the hovering operation is called, thereby making it possible to enlarge the picture compression hover FIG size slightly (but not selected).

手势还可以用于调用和操纵虚拟控制界面例如音量按钮、开关、 滑块、鍵盘以及其它可被产生用于帮助人和计算机系统或用户电子选项进行相互作用的虛拟界面。 Call and gesture can also be used to manipulate a virtual interface such as volume control buttons, switches, sliders, keyboards, and other may be used to help humans to produce a computer system or electronic user interface options for virtual interaction. 例如,使用手势调用虚拟控制界面,参见图8A-8H,说明了在输入板PC175的显示器174的GUI界面上用于控制虚拟音量按钮170的转动手势。 For example, a gesture using the virtual call control interface, see FIG. 8A-8H, described virtual volume button for controlling the rotation gesture 170 on the GUI input interface 174 of the display panel PC175. 为了启动按钮170,用户把手指176放到多点触摸屏178上。 To start button 170, the user 176 onto the finger multi-touch screen 178. 虛拟控制按钮可能已被显示,或者特定的数字、落地的手指的方位或轮廓、或者落地之后瞬间手指的运动、 或者这些与用户的相互作用的其它特征的一些组合可调用要被显示的虚拟控制按钮。 Virtual control button may have been displayed, or a specific number, some combination of landing position or contour of a finger, the finger moment or movement after landing, or other features of these interactions with the user may invoke the virtual control to be displayed button. 在每种情况下,计算系统把手指组和虚拟控制按钮相关联,并确定用户要使用虛拟音量按钮。 In each case, the computing system associated with the button finger groups and virtual control, and determine the user wants to use a virtual volume buttons.

所述关联也可以部分地基于计算装置在输入时刻的模式或当前状态。 The association may also be based in part on the computing device at the time of mode or current state of the input. 例如,相同的手势当在计算装置上正在播放歌曲时可被解释为音量按钮,或者如果正在执行对象编辑应用程序则被解释为转动指令。 For example, when the same gesture may be interpreted on a computing device when a song is playing for the volume button, or if an object editing application is being executed is interpreted as rotation command. 可以提供其它的用户反馈,例如包括听觉或触觉反馈。 Other user feedback may be provided, including for example audible or tactile feedback.

一旦显示按钮170,如图8A所示,用户的手指176便可以位于按钮170的周围,好象它是一个实际的按钮或转盘一样,然后可以在按钮170周围转动,以模拟转动按钮170。 Once the display button 170, shown in Figure 8A, the user's finger 176 can located around the button 170, if it is an actual dial buttons or the same, and can be rotated around the button 170, button 170 is rotated to simulate. 此外,当按钮170被"转动" 时,可以提供例如点击声音形式的听觉反馈、或振动形式的触觉反馈。 Further, when the button 170 is "rotated", such as a click sound may be provided in the form of auditory feedback, or tactile feedback in the form of vibration. 用户还可以使用另一只手保持输入板PC 175。 Users can also use the other hand to keep the tablet PC 175.

如图8B所示,多触摸屏178检测到至少一对图像。 8B, the multi-touch screen 178 detects at least a pair of images. 具体地说, 第一图像180在落地时被产生,当使手指176转动时,可以产生至少一个另外的图像182。 Specifically, the first image 180 is generated in the landing, when the finger 176 is rotated, may produce at least one additional image 182. 虽然只示出了两个图4象,在大多数情况下,具有在这两个图像之间渐增地出现的许多更多的图像。 Although only two are shown in FIG. 4 as, in most cases, has many more image between the two images occur incrementally. 每个图像表示在一个特定时刻和触摸屏接触的手指的轮廓。 Each image represents a profile in a particular time and touch screen contact fingers. 这些图像还可被称为触摸图像。 These images may also be referred to as a touch image. 应当理解,术语"图像,,不是指在屏幕178上被显示的轮廓(而是由触敏装置形成的图像)。还应当注意,虽然使用了"图像"这个术语,但是数据可以呈代表不同时刻的触摸平面的其它形式。 It should be understood that the term "image not refer ,, profile (but by the touch-sensitive image forming apparatus) is displayed on the screen 178. It should also be noted that, although the use of an" image "of the term, but may be in data representing different time other forms of the touch plane.

如图8C所示,每个图像180和182可被转换成特征184的集合。 8C, each set of images 180 and 182 may be converted into a feature 184. 每个特征184可以和特定触摸相关联,例如在按钮170的周围每个手指176的指尖和用于保持输入板PC175的另一只手177的拇指。 Each feature 184 is associated particular touch and can, for example around each button 170 of the finger 176 and a thumb finger holding plate PC175 input 177 of the other hand.

如图8D所示,特征184被分类,即每个手指/拇指被识别,并对图像180和182的每一个分组。 Shown, wherein FIG. 8D 184 are classified, i.e., each finger / thumb is identified, and the images 180 and 182 of each packet. 在这种特定情况下,和按钮170关联的特征184A可被分成一组,以形成组188,和拇指关联的特征184B 可被滤除。 In this particular case, the button 170 and associated features may be divided into a group 184A to form a feature set 188, the thumb and 184B may be associated filtered. 在替换结构中,拇指特征184B可以借助于其自身(或在另一组中)被作为单独的特征来对待,例如,为了改变系统的输入模式或操作模式,或者为了实现另一个手势,例如和在拇指(或其它手指)区域内在屏幕上显示的均衡滑块关联的滑块手势。 In an alternative arrangement, the thumb feature 184B (or in another group) are treated as separate features itself by means of, for example, to change the input mode or the operating mode of the system, or to implement another gesture, and e.g. balanced slider associated displayed on the thumb (or other finger) area of ​​the screen at a slider gesture.

如图8E所示,可以对于每个图4象180、 182计算特征组188的关键参数。 As shown, the group key parameter 188 for 8E as 180, 182 is calculated for each feature in FIG. 4. 和第一图像关联的关键参数表示初始状态,和第二图像182 关联的关键参数表示当前状态。 And key parameters associated with the first image represents an initial state, and a second key parameters associated with the image 182 represent the current state.

也如图8E所示,按钮170是和特征组188关联的UI元件,这是因为其和按钮170接近。 As also shown, the UI element 170 and the feature set 188 is associated with the button. 8E, and because it is close button 170. 此后,如图8F所示,来自每个图像180、 182的特征组188的关键参数值可以被比较,以确定转动矢量,即从初始状态到当前状态顺时针转动5度的特征组。 Thereafter, as shown in FIG. 8F, from each image 180, 182 key parameter values ​​of the feature set 188 may be compared to determine the rotation vector, the rotation characteristic of the group 5, i.e., from the initial state to the current state clockwise. 在图8F中,用虛线示出了初始特征组(图像180),而用实线示出了当前特征组(图像182)。 In FIG. 8F, by dotted lines shows the initial feature group (image 180), and the solid line shows the current feature group (image 182).

如图8G所示,根据转动矢量,输入板PC175的扬声器192按照手指176的转动量增加(或减小)其输出,即,根据5度的转动,使音量增加5 % 。 , According to the rotation vector the speaker 192 of the tablet PC175 according to the rotation amount of the finger 176 in FIG. 8G increases (or decreases) its output, i.e., 5 degrees of rotation in accordance with the volume increase of 5%. 输入板PC175的显示器174也可以按照手指176的转动量调节按钮170的转动,即,使按钮170的位置转动5度。 Tablet PC175 display 174 may also be adjusted according to the rotation of the rotary knob 170 of the amount of the finger 176, i.e., the position of the button 170 is rotated 5 degrees. 在大多数情况下,按钮的转动和手指的转动同时发生,即,手指转动1度, 按钮也转动l度。 In most cases, the rotation and simultaneous rotation of the finger buttons, i.e., a degree of rotation of the finger, the button also rotates l degrees. 实质上,虚拟控制按钮跟随着在屏幕上发生的手势。 In essence, the virtual control buttons with gestures as occurring on the screen. 此外,输入板PC的音频单元194可以对每个转动单位提供点击声, 例如根据5度的转动,提供5个点击。 Additionally, tablet PC audio input unit 194 may provide a clicking sound for each unit of rotation, for example according to the rotation of 5 degrees, to provide five clicks. 此外,输入板PC175的触觉单元196可以对于每个点击提供一定量的振动或其它触觉反馈,借以模拟实际按钮。 Furthermore, the input plate PC175 haptic unit 196 may provide a certain amount of vibration or other tactile feedback for each click, thereby simulate actual button.

应当注意,在进行虛拟控制按钮手势的同时可以进行附加的手势。 It should be noted that, during the virtual control buttons gesture at the same time can make additional gestures. 例如,可以使用两只手同时控制一个以上的虚拟控制按钮,即, 一只手用于一个虛拟控制按钮。 For example, you can use both hands simultaneously control more than one virtual control buttons, namely, a hand for a virtual control buttons. 额外地或者替换地, 一个或多个滑动条可以作为虛拟控制按钮被同时控制,即, 一只手操作虛拟控制按钮, 而另一只手的至少一个手指或者一个以上的手指操作至少一个滑动块或一个以上的滑动条,例如每个手指一个滑动条。 Additionally or alternatively, one or more control buttons as a virtual slider bar may be controlled simultaneously, i.e., one hand operation of the virtual control button, and the other hand of at least one finger or one or more fingers to operate at least one sliding block or more of a slider, for example, each finger a slider.

还应当注意,虽然使用虛拟控制按钮说明了本实施例,在另一个实施例中,UI元件可以是虛拟巻动轮。 It should also be noted that, although the virtual control buttons described embodiment of the present embodiment, in another embodiment, the UI element can be a virtual Volume wheel. 作为例子,虚拟巻动轮可以模拟实际的巻动轮,例如专利y〉开号US2003/0076303A1, US2003/0076301A1,以及US2003/0095096A1的专利申请所述,这些专利申请通过引用被包括在此。 By way of example, a virtual wheel Volume Volume can simulate an actual wheel, for example, patent y> US2003 / 0076303A1, US2003 / 0076301A1, and US2003 / 0095096A1 Patent No. herein, these patent applications are incorporated herein by reference.

图9表示按照本发明的一个实施例的基于触摸的方法200。 9 shows a touch-based method in accordance with one embodiment of the present invention 200. 该方法在块202开始,在此可以检测在多点触敏装置上发生的用户输入。 The method begins at block 202, a user input can be detected in this occurred on the multi-touch sensitive device. 用户输入可以包括一个或多个触摸输入,每个触摸输入具有唯一的标识。 The user input may comprise one or more touch inputs, each touch input having a unique identifier. 在块202之后,基于触摸的方法200前进到块204,在此对用户输入进行分类,当用户输入包括一个唯一标识时被分类为跟踪或选择输入,当用户输入包括至少两个唯一标识时(一个以上的触摸输入) 被分类为手势输入。 Following block 202, touch-based method 200 proceeds to block 204 where the user input classified, when the user input comprises a unique time flag is classified as a tracking or selecting input when the user input comprises at least two unique identification when ( more than one touch input) is classified as a gesture input. 如果用户输入可被分类为跟踪输入,则基于触摸的方法200前进到块206,在此进行对应于用户输入的跟踪。 If the user input may be classified as a tracking input, the touch-based method 200 proceeds to block 206, a user input corresponding to this track.

如果用户输入被分类为手势输入,则基于触摸的方法200前进到块208,在此进行对应于用户输入的一个或多个手势控制操作。 If the user input is classified as a gesture input, the touch-based method 200 proceeds to block 208 where one or more gestures performed corresponding to a user input control operation. 手势控制操作至少部分地基于由所述至少两个唯一标识或者在所述至少两个唯一标识之间发生的改变。 Gesture control operation based on a change at least in part by a unique identification of said at least two or at least between two of the unique identifier.

图10标识按照本发明一个实施例的基于触摸的方法250。 FIG touch-based method of identifying one embodiment 10 according to the embodiment of the present invention 250. 基于触摸的方法250在块252开始,在此在触敏表面上进行的输入敲击期间可以捕获初始图像。 Touch-based method 250 begins at block 252, during the input of this tap is performed on the touch-sensitive surface may capture an initial image. 在块252之后,基于触摸的方法250前进到块254,在此基于初始图像确定触摸模式。 Following block 252, touch-based method 250 proceeds to block 254, the initial image is determined based on this touch pattern. 例如,如果初始图像包括一个唯一标识,则触摸模式对应于跟踪或选择模式。 For example, if the initial image includes a unique identifier, then the touch mode corresponds to a tracking or selection mode. 在另一方面,如果图像包括一个以上的唯一标识,则触摸模式对应于手势模式。 On the other hand, if the image includes more than one unique identifier, then the touch mode corresponds to the gesture mode.

在块254之后,基于触摸的方法250前进到块256,在此在触敏表面上进行输入敲击期间可以捕获下一个图像。 Following block 254, touch-based method 250 proceeds to block 256, carried out during the input stroke can capture an image on the touch-sensitive surface here. 在敲击期间一般可以按照顺序捕获图像,因而可以具有和敲击相关的多个图像。 During tap may generally be in the order of the captured image, and therefore may have a plurality of images associated tap.

在块256之后,基于触摸的方法250前进到块258,在此确定触摸模式是否在初始图像和下一个图像捕获期间发生了改变。 Following block 256, touch-based method 250 proceeds to block 258, where it is determined during the touch mode changed in the initial image and whether to capture the next image. 如果触摸模式发生了改变,则基于触摸的方法250前进到块260,在此可以把下一个图像设置为初始图像,此后在块254基于新的初始图像再次被确定。 If the touch mode changed, the touch-based method 250 proceeds to block 260 where the next image can be set as the initial image, and thereafter at block 254 is determined again based on the new initial image. 如果触摸模式保持相同,该方法则前进到块262,在此初始图像和下一个图像进行比较,并根据比较结果产生一个或多个控制信号。 If the touch mode remains the same, the method proceeds to block 262, this initial comparison image and the next image, and generates one or more control signals according to the comparison result.

图11表示按照本发明的一个实施例的基于触摸的方法300。 11 shows an embodiment of the present invention is a touch-based method 300. 该方法在块302开始,在此输入可以是GUI对象的图像对象。 The method begins at block 302, where the input image of the object may be a GUI object. 例如,处理器可以命令显示器显示特定的图像对象。 For example, the processor may instruct the display to display a specific image object. 在块302之后,方法300 前进到块304,在此通过图像对象接收手势输入。 Following block 302, the method 300 proceeds to block 304 where a gesture input by the image receiving object. 例如,用户可以在触摸屏的表面上同时在显示图像对象上方以手势方式着地或移动其手指。 For example, a user may simultaneously displayed above the image of the object in a manner or gesture moves his finger on the surface of the touchscreen. 手势输入可以包括连续发生的一个或多个单个手势,或者同时发生的多个手势。 Gesture input may include one or more single gestures that occur continuously, or multiple gestures that occur simultaneously. 一般每个手势具有特定的顺序、运动或与其相关的方位。 Generally speaking, each gesture having a specific sequence, motion, or orientation associated therewith. 例如,手势可以包括分开手指或者手指闭合在一起的手势,转动手指、平移手指的手势等。 For example, a gesture may include spreading the fingers apart or closing fingers together gesture, the finger is rotated, the finger translation gesture and the like.

在块304之后,方法300前进到块306,在此根据手势输入并和手势输入一致地修改图像对象。 Following block 304, the method 300 proceeds to block 306 where a gesture input, and according to the same gesture input and modify the image object. 这里的修改意味着图像对象按照正在进行的特定手势而改变。 The fix means that the image objects in a particular gesture is in progress and change. 这里的"一致地"意味着所述的改变几乎在进行所述手势的同时发生。 Here "match" means that the changes occur almost simultaneously performing the gesture. 在大多数情况下,在手势和图像对象发生的改变之间具有一对一的关系,并且它们基本上同时发生。 In most cases, the change between the gesture and the image of the object having a one to one relationship occurs, and they occur substantially simultaneously. 实质上,图像对象跟随着手势的运动。 In essence, the image object following the motion gesture. 例如,散开的手指可以同时放大对象、闭合的手指可以同时缩小图像对象、转动手指可以同时转动对象、平移手指可以允许同时扫视或巻动图像对象。 For example, the object may be exaggerated spread fingers simultaneously, the fingers can be closed simultaneously reduced image of the object, the object may be rotated while the finger is rotated, translating the fingers may allow simultaneous panning or moving image object Volume.

在一个实施例中,块306包括确定哪个图像对象与正在进行的手势相关,此后把显示对象锁定在位于其上方的手指上,从而该图像对象按照手势输入而改变。 In one embodiment, block 306 includes determining which image object associated with the gesture is in progress, after which the display object located above the lock on the fingers, so that the image of the object is changed in accordance with the gesture input. 借助于锁定手指或使手指和图像对象相关联,图像对象可以按照在触摸屏上手指的动作继续调节其自身。 Or the finger means of the locking finger and the image associated with an object, the image object may continue to adjust itself in accordance with movement of the finger on the touch screen. 通常所述确定和锁定在手指落下时发生,即当手指位于触摸屏上时发生。 Typically the determination and locking occurs when the finger-down occurs i.e. when the finger on the touch screen.

图12表示按照本发明的一个实施例的缩放(zoom)手势方法350。 12 shows an embodiment of scaling (Zoom) gesture method 350 according to the present invention. 缩放手势可以在多点触摸屏例如图2所示的多触摸板24上被执行。 Zoom gesture may be multi-touch panel, for example, as shown in FIG 2 is performed in 24 multi-touch screen. 该方法在块352开始,在此检测至少第一手指和第二手指在触敏表面上同时存在。 The method begins at block 352 where the detection of at least a first finger and a second finger is present on the touch-sensitive surface simultaneously. 至少两个手指的存在可被配置用于表示该触摸是手势触摸而不是基于一个手指的跟踪触摸。 There are at least two fingers may be configured to indicate that the touch is not a touch gesture tracking touch based on one finger. 在一些情况下,只有两个手指存在表示触摸是手势触摸。 In some cases, the presence of only two fingers indicates touch gestures touch. 在另一些情况下,两个以上的任何数量的手指表示触摸是手势触摸。 In other cases, two or more of any number of fingers indicating that the touch is a touch gesture. 事实上,手势触摸可被配置使得在2个、 3个、4个或更多个手指触摸时都能操作,即使在手势期间数量发生改变,即,在手势期间在任何时刻最少只需要两个手指。 In fact, the touch gesture may be configured such that the touch operation can be two, three, four or more fingers, the number is changed even during the gesture, i.e., only you need a minimum of gesture during two at any time finger.

在块352之后,该方法350前进到块354,在此比较在至少两个手指之间的距离。 Following block 352, the method 350 proceeds to block 354, a distance comparison between the at least two fingers here. 该距离可以是从手指到手指的距离,或者是从每个手指到另一个参考点例如质心的距离。 The distance may be the distance from the finger to the finger, or the distance from the reference point of each finger, for example, to another centroid. 如果在两个手指之间的距离增加(散开手指),则产生拉近信号,如块356所示。 If the increase (finger spread) the distance between the two fingers, a signal is generated to narrow, as shown in block 356. 如果两个手指之间的距离减少(闭合手指),则产生推远信号,如块358所示。 If the distance between two fingers decreases (close fingers), the signal is generated farther away, as shown in block 358. 在大多数情况下,手指的落下将把手指关联或锁定到正被显示的一个特定图像对象。 In most cases, falling fingers will associate or lock the fingers to a particular image object being displayed. 例如,触敏表面可以是触摸屏,图像对象可以在触摸屏上显示。 For example, a touch-sensitive surface may be a touch screen, the object image may be displayed on the touch screen. 这一般在至少一个手指位于图像对象的上方时发生。 This generally occurs when at least one finger is located above the image of the object. 结果,当手指移动而分开时,拉近信号可被用于增加图像对象中的嵌入特征的尺寸,当手指捏在一起时,推远信号可被用于减小在对象中嵌入特征的尺寸。 As a result, when the fingers move apart to narrow the signal can be used to increase the size of features embedded in the image of the object, when the finger pinched together, farther away signal can be used to reduce the size of embedded features in the object. 缩放一般在预定的边界内进行,例如显示器的周边、窗口的周边、图像对象的边沿等。 Scaling is generally carried out within a predetermined boundary, e.g. outside, like an edge image of an object outside the display, the window. 嵌入特征可被形成在多层上,其中的每一个代表不同的缩放等级。 Embedded features may be formed on the multilayer, different zoom levels each of which is a representative.

在大多数情况下,缩放量按照两个对象之间的距离而改变。 In most cases, the amount of scaling in accordance with the distance between the two objects is changed. 此外, 缩放一般基本上和对象的运动同时地进行。 Further, scaling and general moving object substantially simultaneously. 例如,当手指分开或闭合在一起时,对象在同时被拉近或推远。 For example, when the fingers apart or closing together the object is at the same zoom in or out. 虽然这种方法针对缩放,应当注意,其也可以用于放大或缩小。 Although this method for scaling, it should be noted that it may also be used to zoom in or out. 缩放手势方法300在图形程序例如出版、照片和制图程序中是尤其有用的。 Zoom gesture method 300 in a graphics program such as publishing, photos and mapping program is especially useful. 此外,缩放可用于控制外围设备例如照相机,即,当手指分开时,照相机推远,当手指闭合时, 照相4几拉近。 In addition, scaling may be used to control peripheral devices such as a camera, i.e., when the fingers apart, the camera zooms, when the fingers are closed the camera 4 several narrow.

图13A-13H表示使用上述方法的缩放顺序。 FIGS 13A-13H scaling indication of order of the above method. 图13A表示具有呈北美地图形式的图像对象364的显示,其中具有嵌入的可被缩放的层次。 13A shows the form of a map of North America with the form image object display 364, having embedded may be scaled level. 在一些例子中,如图所示,图像对象可位于构成图像对象364的边界的窗口内。 In some examples, as shown, it may be located within the object image window border constituting the image object 364. 图13B表示用户把手指置于北美368的上方,具体地说在美国370 (更具体地说加利福尼亚372)的上方。 13B shows the user the finger placed over 368 in North America, specifically in the above (and more specifically California, 372) of the United States 370. 为了在加利福尼亚372上拉近,用户开始分开其手指366,如图13C所示。 In order to narrow in on California 372, the user starts to separate his finger 366, shown in Figure 13C. 随着手指366的分开(检测到距离增加),地图在北加利福尼亚上被放大, 然后到北加利福尼亚374的一个特定区域,再到海弯区域376,再到半岛378 (例如在旧金山和San Jose Area之间的区域),再到位于旧金山和San Jose之间的San Carlos市区380,如图13D-13H所示。 With the fingers 366 apart (detected distance increases), the map is enlarged in Northern California, and then to a specific area of ​​Northern California 374, 376 and then to the Gulf region, to the peninsula 378 (such as San Francisco and San Jose Area region between), and then to downtown San Carlos 380 located between San Francisco and San Jose, 13D-13H as shown in FIG. 为了缩小San Carlos380并回到北美368,在上述的顺序之后,手指366闭合在一起,不过沿相反的方向。 In order to narrow San Carlos380 368 and back to North America, after the above sequence, the fingers 366 are closed together, but in opposite directions.

图14表示按照本发明的一个实施例的扫视(pan)方法400。 14 shows an example of panning (PAN) method 400 according to an embodiment of the present invention. 扫视手势可以在多点触摸屏上进行。 Glance gesture can be performed on multi-touch screen. 扫视方法400在块402开始,在此检测在触敏表面上同时存在至少第一对象和第二对象。 Panning method 400 begins at block 402 where the presence of at least detecting first and second objects on the touch-sensitive surface simultaneously. 至少两个对象的存在可被配置用于表示触摸是手势触摸而不是基于一个手指的跟踪触摸。 There are at least two objects may be configured for indicating a touch the touch gesture is not tracking touch based on one finger. 在一些情况下,只存在两个手指表示触摸是手势触摸。 In some cases, there are only two fingers indicates touch gestures touch. 在另外一些情况下,两个以上的任何数量的手指表示触摸是手势触摸。 In other cases, two or more of any number of fingers indicating that the touch is a touch gesture. 实际上,手势触摸可被配置使得在2个、3个、4个或更多个手指触摸时都能操作,即使在手势期间数量改变,即,最少只需要两个手指。 In fact, the touch gesture may be configured such that the touch operation can be two, three, four or more fingers, the number of changed even during the gesture, i.e., only need a minimum of two fingers.

在块402之后,该方法前进到块404,在此当对象一起在触摸屏上移动时监视两个对象的位置。 Following block 402, the method proceeds to block 404, where the two objects when the object is moved together with the monitoring at a position on the touch screen. 在块404之后,方法400前进到块406, 在此当两个对象的位置相对于初始位置改变时产生扫视信号。 Following block 404, the method 400 proceeds to block 406 where the position of the object when two saccade is generated when the signal changes with respect to the initial position. 在大多数情况下,手指的落下将把手指关联或锁定到在触摸屏上显示的特定图像对象。 In most cases, falling fingers will associate or lock the fingers to a particular image of the object displayed on the touch screen. 典型地,当至少一个手指位于所述图像对象的位置上方时。 Typically, when a finger is located above the position of at least the image of the object. 结果,当手指在触摸屏上移动时,扫视信号被用于沿手指的方向移动图像。 As a result, when the finger moves on the touch screen, scanning signals are used along the direction of the finger moving image. 在大多数情况下,扫视量按照两个对象移动的距离而改变。 In most cases, according to two glance the amount of movement of the object distance changes. 此外,扫视基本上和对象的运动同时发生。 Further, panning and moving objects substantially simultaneously. 例如,当手指运动时,对象同时随着手指运动。 For example, when the finger movement, objects and with the finger movement.

图15A-15D表示基于上述的扫视方法400的扫^L顺序。 FIGS 15A-15D represent scan 400 based on the above-described method of panning ^ L sequence. 使用图13A的地图,图15A表示用户把手指置于地图上方。 Using the map of FIG. 13A, 15A shows a user to place a finger over the map. 在手指被定位之后,手指366被锁定到地图。 After the finger is positioned, the finger 366 is locked to the map. 如图15B所示,当手指366垂直向上移动时,整个地图364向上移动,借以使地图364的以前看得见的部分被置于观看区域的外部,而以前看不见的部分被置于观看区域内。 As shown in FIG. 15B, when the fingers 366 are moved vertically upward, the entire map 364 is moved upward, whereby the previously visible portion of the map 364 to be placed outside the viewing area, previously unseen portion is placed in the viewing area Inside. 如图15C所示,当手指366沿侧向水平移动时,整个地图364可以沿侧向移动,借以使地图364的以前看得见的部分被置于观看区域的外部, 而以前看不见的部分被置于观看区域内。 15C, when the fingers 366 laterally moved horizontally, the entire map 364 can move laterally, whereby the map previously visible portion 364 is placed outside the viewing area, previously unseen part It is placed within the viewing area. 如图15D所示,当手指366沿对角线方向移动时,整个地图364沿对角线方向移动,借以使地图364的以前看得见的部分被置于观看区域的外部,而以前看不见的部分被置于观看区域内。 , When the fingers 366 are moved diagonally, the entire map 364 moves in a diagonal direction in FIG. 15D, whereby the previously visible portion of the map 364 to be placed outside the viewing area, previously unseen the portion is placed within the viewing area. 应当理解,地图364的运动跟随着手指366的运动。 It should be understood, moving map 364 with 366 as the finger movement. 这种处理和使一张纸沿着桌面滑动类似。 Such a paper making process and the like sliding along the table. 手指施加在纸上的压力把纸锁定到手指上,当手指在桌面上滑动时,这张纸随手指而运动。 Finger pressure applied to the paper sheet to the locking finger, when the finger slides on the table, the piece of paper moves with the fingers.

图16表示按照本发明一个实施例的转动方法450。 16 shows rotation of the method according to the embodiment of the present invention, a 450 embodiment. 转动手势可以在多点触摸屏上进行。 Rotation gesture may be performed on a multipoint touch screen. 转动方法450在块452开始,在此检测同时存在第一对象和第二对象。 Method 452 rotation begins at block 450, in this assay the presence of the first and second objects at the same time. 至少两个手指的存在可被配置用于表示触摸是手势触摸而不是基于一个手指的跟踪触摸。 There are at least two fingers may be configured for indicating a touch the touch gesture is not tracking touch based on one finger. 在一些情况下,只存在两个手指便表示触摸是手势触摸。 In some cases, it would mean there are only two fingers are touching gesture touch. 在另一些情况下,两个以上的任何数量的手指的存在表示触摸是手势触摸。 In other cases, there are more than two fingers indicates touch any number of touch gestures. 还在另一些情况下,手势触摸可被配置使得在2个、3个、4个或更多个手指触摸时都能操作, 即使在手势期间数量发生改变,即,在手势期间在任何时刻最少只需要两个手指。 Still others cases, the touch gesture may be configured such that the touch operation can be two, three, four or more fingers, the number is changed even during the gesture, i.e., at least at any time during the gesture only two fingers.

在块452之后,转动方法450前进到块454,在此设置每个手指的角度。 After block 452, the method 450 proceeds to block rotation 454, this setting angle of each finger. 该角度一般相对于一个参考点被确定。 This angle generally relative to a reference point is determined. 在块454之后,该方法前进到块456,在此当至少一个对象的角度相对于参考点改变时便产生转动信号。 Following block 454, the method proceeds to block 456 where the at least one object when the angle with respect to the reference signal will produce rotation point changes. 在大多数情况下,手指的安放将使得把手指锁定或关联到在触摸屏上显示的一个特定的图像对象。 In most cases, the finger is placed such that the fingers will associate or lock the image to a specific object displayed on the touch screen. 一般地说,当至少一个手指位于图像对象上的闺像上方时,该图像对象便被锁定或关联到该手指。 In general, when at least one finger is positioned on the image of the subject image Gui is over, then the image of the object is locked or associated to the finger. 结果,当手指转动时,便使用转动信号沿手指转动的方向(例如顺时针、反时针)转动所述对象。 As a result, when the finger is rotated, it is rotated using the rotation of the finger along a direction signal (e.g., clockwise, counterclockwise) rotation of the object. 在大多数情况下,对象的转动量随手指的转动量而改变,即,如果手指转动5度,则对象也转动5度。 In most cases, the amount of rotation of the object with the amount of finger rotation is changed, i.e., if the finger is rotated 5 degrees, 5 degrees, the object is also rotated. 此外,转动一般基本上和手指的运动同时进行。 Further, the rotation and movement of the finger is generally substantially simultaneously. 例如,当手指转动时, 对象同时随手指转动。 For example, when the finger is rotated, the object rotates with the fingers at the same time.

图17A-17C表示基于上述的方法的转动顺序。 FIGS 17A-17C represent the order based on the rotation of the above-described method. 使用图13的地图, 图17A表示用户把其手指366置于地图364的上方。 Use the map 13, 17A indicates the user to place their finger over the map 366 364. 在安放之后,手指366便被锁定到地图364。 After the placement, the finger 366 will be locked to the map 364. 如图17B所示,当手指366沿顺时针方向转动时,整个地图364按照转动的手指沿顺时针方向转动。 As shown in FIG. 17B, when the fingers 366 are rotated in the clockwise direction, the entire map 364 is rotated in the clockwise rotation of the finger. 如图17C所示,当手指366沿反时针方向转动时,整个地图364按照转动的手指沿反时针方向转动。 17C, when the fingers 366 are rotated in the counterclockwise direction, the entire map 364 is rotated according to the rotation of the finger counterclockwise direction.

应当注意,虽然图17A-17C所示使用拇指和食指作出转动手势, 也可以使用两个手指例如食指和中指作出转动手势。 It should be noted that although FIGS. 17A-17C is rotated using the thumb and forefinger making a gesture, the two may be used, for example, the index and middle fingers to the rotation gesture.

此外,在某种特定应用中,不需要使用两个手指产生转动手势。 Further, in certain applications, no need to use two fingers to generate a gesture rotation. 例如,按照优选实施例并如图17D和17E所示,利用一个手指手势可以使照片缩略图转动到所需的方位(例如从风景画方位转动到肖像方位)。 For example, according to a preferred embodiment and as shown in FIG. 17D and 17E, a finger gesture can be made using photo thumbnail rotated to a desired orientation (e.g., rotated from the portrait orientation to a landscape orientation). 具体地说,在检测到与可选的照片缩略图图标741有关的触摸, 并且其中触摸输入是手势,使得检测的触摸围绕缩略图的中心部分形成转动的弧或放射状的孤时,则该输入被解释为用于使缩略图按照转动的弧或放射状的孤的方向转动的指令。 More specifically, when the detected associated with optional photo thumbnail icon 741 touched and where the touch input is a gesture, the touch detection is formed such that rotation of the arc or radial about the central portion of the solitary thumbnail, the input It is interpreted as instructions for causing a thumbnail image in the direction of rotation of the arc or radial solitary rotating. 按照优选实施例,缩略图图标的转动还可以使对应的文件对象改变方位配置。 According to a preferred embodiment, rotation of the thumbnails of the corresponding icons may also change the orientation of the object configuration file. 按照另一个实施例,在照片管理的应用程序内,检测到转动手势将产生快移(snap) 指令,其使得照片缩略图朝向转动方向自动转动90度。 According to another embodiment, the photo management application detects the rotation gesture produce rapid traverse (SNAP) instruction, which causes the rotational direction toward the photo thumbnails automatically rotated 90 degrees.

图18A和18B表示按照如图IO所示的本发明的示例的实施例通过UI元件使用手势输入编辑媒体文件例如照片的另一个例子。 18A and 18B show another example of an input editing media files such as photos using gestures in accordance with an exemplary embodiment of the present invention shown in FIG IO through the UI element. 具体地说,如图18A所示,在可以打开以便编辑照片图像文件(例如JPEG 文件)752的照片编辑器环境750内,可以提供UI元件751,用于编辑照片的各方面。 Specifically, as shown in FIG 18A, can be opened in order to edit a photo image files (e.g., JPEG file) within the photo editor environment 750,752, the UI elements 751 may be provided for various aspects of editing photos. UI元件751可以是一个水平滑动条,用于调节照片的某个方面的水平。 UI element 751 may be a horizontal slider bar for adjusting the level of some aspect of the picture. 在图18A所示的例子中,UI元件751可以是用于接收触摸手势的界面,用于调节照片的亮度。 In the example shown in FIG. 18A, the UI element 751 may be configured to receive a touch gesture interface for adjusting the brightness of the picture. 具体地说,当被跟踪的手指触摸在条上向左移动时,亮度减小,而当跟踪的触摸在UI元件上向右移动时,亮度增加。 Specifically, when the finger touch being tracked moves to the left on the bar, the brightness is reduced, and when the track moves to the right on the touch UI element, the luminance is increased. 按照一个实施例,UI元件最好是半透明的,以便用户可以看到在UI元件后面的照片的图像。 According to one embodiment, UI elements are preferably translucent, so that the user can see the image behind the UI element photograph. 在另一个实施例中,在屏幕上被显示照片的尺寸可被减小,以为单独显示的UI元件留出位置,其可以紧挨着位于被显示照片的下方。 In another embodiment, the size of the displayed picture can be reduced, that the individual UI elements displayed aside position, it may be located immediately below the displayed picture on the screen.

图18B表示通过选择地使用一个或多个落地点通过UI元件751 转换手势输入模式的能力。 18B shows landing point gesture input mode conversion capability 751 by the UI element by selectively using one or more. 具体地说,如图18B所示,检测到在UI 元件751上的第二落地点将使操作模式从亮度调节转换到对比度调节。 More specifically, as shown in FIG. 18B, the second landing point is detected on the UI element 751 will cause the operating mode to adjust the conversion from the luminance contrast adjustment. 在这个例子中,两个落地点向左或向右的运动将分别使得照片的对比度减少或增加。 In this case, the two landing points leftward or rightward movement, respectively, such that the contrast of the picture is reduced or increased. 检测到附加的落地点(例如3个或4个手指)也可以被解释为用于转换其它操作模式的指令(例如缩放、色调调节、 伽马值调节等)。 Additional landing point is detected (e.g., three or four fingers) can be interpreted as an instruction for switching to other operation mode (e.g. scaling, tone adjustment, the gamma value adjustment, etc.). 应当注意,虽然图18A,18B表示通过UI元件751 调节亮度和对比度,用户可对UI元件编程或者定制UI元件751,使得把落地点的数量解释为其它形式的操作模式。 It should be noted that, while Figures 18A, 18B through the UI represents brightness and contrast adjustment element 751, the UI element can be user programmed or custom UI element 751, so that the number of landing dots construed as other forms of operating modes. 还应当注意,滑动条UI元件751可以呈其它形式,例如虛的巻动轮。 It should also be noted that the slide bar UI element 751 may be in other forms, such Volume virtual wheel.

图18C表示和上述的图18A,18B的特定例子相关的算法流程图。 18C shows a specific example of the above-described FIG 18A, 18B is a flowchart related algorithms. 具体地说,如图18C所示,在760在屏幕上输出UI元件751。 Specifically, as shown in the UI element 751 18C 760 output on the screen. 如果在761检测到手势输入触摸,则在762 - 765确定和该触摸相关的落地点数量。 If it is detected in the input touch gesture 761, then at 762--765 determine the number and the touch-related landing point. 奉767- 769根据检测到的落地点的数量,启动对应的操作模式。 Instructions 767-769 according to the number of the detected landing point, start the corresponding operation mode. 一旦合适的操作模式被启动,在770便检测落地点的跟踪, 以按照操作模式在771实现对应的调节。 Once the appropriate operation mode is started, then at 770 the detected tracking landing point, in order to achieve a corresponding adjustment according to the operation mode 771. 应当注意,在编辑处理期间, 在任何时刻都能转换操作模式,因而如果在772检测到改变的落地点的数量,则在762- 764处理向回循环,以便启动新的操作模式。 It should be noted that during the editing process, can be converted at any time mode of operation, so if the landing point 772 detects that the number of changes, the process loops back at 762-764, in order to start a new mode of operation.

图18D和18E表示使用上面说明的同一个UI元件751通过输入其它手势指令引起附加操作。 FIGS. 18D and 18E represents a UI element using the same described above cause additional 751 operated by other input gesture command. 具体地说,在调节显示照片的亮度的同时,可以使用第二手指实现拉近或推远操作。 Specifically, while adjusting the brightness of the display picture can be achieved using a second finger zoom in or out operation. 可以通过检测第二落地点和在两个落地点之间的接近距离的改变来引起拉近和推远。 It can be induced by changing the closer and farther away landing point and detecting the second proximity distance between the two landing points. 按照上面说明的以及图12所示的方法,两个落地点之间的距离改变可被解释为拉近或推远操作。 The method shown in FIG. 12 and described above, the distance between the two landing points changes may be interpreted as zoom in or out operation. 应当注意,按照一个实施例,如果检测到的第二落地点和第一落地点之间的距离保持不变,则不引起缩放操作,在这种情况下,手势将被解释为用于启动第二操作方式的输入(例如从亮度调节改变为对比度调节,如图18A,18B所示)。 It should be noted that, according to one embodiment, if the detected distance between the landing point and the second point of the first landing unchanged scaling operation is not caused, in this case, the gesture would be interpreted as a first start enter the second operating mode (e.g. adjust the luminance is changed to adjust the contrast, FIG. 18A, 18B shown).

图19A,19B表示使用手势输入通过媒体文件(例如在照片编辑器内显示照片文件)巻动的例子。 19A, 19B, indicates the use of the gesture input via the media file (e.g., photo file displayed in Photo Editor) Volume moving examples. 具体地说,如图19A,19B所示,触摸检测区域754可专用于巻动操作,借以使得在触摸屏750的显示的照片752上手指的上下运动的手势可被解释为用于巻动到下一个照片753的手势输入。 Specifically, FIG. 19A, 19B, the touch area 754 may be dedicated to the detection movable Volume operation, whereby such a touch screen on the display pictures 752 750 vertical movement of the finger gesture may be interpreted as moving to the next Volume 753 a photograph of gesture input. 按照优选实施例,不需要显示引起巻动操作方式的UI元件,而是,检测到手指在触摸检测区域754内的向下滑动操作便足以自动地引起巻动操作。 According to a preferred embodiment, UI elements need not be displayed to cause the movable Volume mode of operation, but rather, slides down the operating finger is detected in the touch detecting area 754 is sufficient to cause automatically Volume movable operation. 按照另一个实施例,UI元件在屏幕上可以虚的垂直滑动条被显示,以向用户指示已经启动了巻动操作,以及用于继续巻动操作的触摸检测区域754的面积。 According to another embodiment, the UI element in the virtual screen can be displayed vertical scroll bar is to indicate to the user operation has started moving Volume, Volume and area for continued operation of the movable detection area 754 of the touch.

按照优选实施例,如果检测到的向下跟踪运动具有一个以上的落地点(例如两个手指滑动手势),则滑动以2X速度进行,与上述的关于在可巻动区域内引起巻动操作的方式类似。 According to the preferred embodiment, if the detected movement of the tracking downward landing point having one or more (e.g., two finger swipe gesture), the sliding at 2X speed, on the causes of the above-mentioned Volume Volume may be movable within the area of ​​the movable operation in a similar manner.

图19C和19D表示另一种形式的UI元件,即虛拟巻动轮755, 用于接收手势输入以巻动照片显示。 19C and 19D are showing another form of UI elements, i.e., the virtual wheel Volume 755, for receiving an input gesture moving pictures displayed Volume. 在本实施例中,可以通过利用一个手指在照片上执行圆形触摸或者用3个手指向下触摸的简单的手势来产生虚拟巻动轮。 In the present embodiment, may be performed by using a finger touch on the circular photos or simple gesture with three fingers touch down generates a virtual Volume wheel. 一旦出现虛拟巻动轮UI元件755,用户便可以"转动,,虛拟巻动轮以通过所述照片巻动。在这个特定的实施例中,巻动的速度不由检测到的巻动轮755上的落地点的数量控制,而是由落地点围绕虛拟巻动轮755的中心转动的速度控制。 Landing point on Once the virtual Volume wheel UI element occurs 755, the user can "pivot ,, Virtual Volume driving wheel through said photo Volume movable. In this particular embodiment, Volume moving speed help detected Volume wheel 755 the number of control but Volume virtual center wheel rotation speed control 755 is surrounded by the landing point.

图19E和19F表示在数字照相机780的显示屏781上图19A和19B的构思。 FIGS. 19E and 19F represent spirit 19A and 19B of the digital camera on the display screen 781,780. 按照优选实施例,数字照相机780的显示屏781可以由多触敏板构成,例如上面图2所示的多触摸板2。 According to a preferred embodiment, the digital camera displays 781,780 may be formed of a multi-touch sensitive panel, such as a multi touch panel 2 shown in FIG 2 above.

图19E表示一个实施例,其中在数字照相机780的播放方式下, 检测到在触摸检测区域782内至少一个手指的垂直向下重击的手势输入引起播放巻动操作,借以可显示下一张照片。 FIG 19E shows an embodiment in which the digital camera in playback mode at 780, is detected in the touch detecting area of ​​at least one vertical finger 782 downwardly causes blow gesture input playback Volume movable operation, thereby displaying a picture can be . 按照另一个实施例, 在显示器781的任何部分上的向下手势输入将自动地引起巻动操作。 According to another embodiment, down gesture input on any portion of the display 781 will automatically cause Volume movable operation.

图19F表示图19E的一个可替代的实施例,其中需要检测两个触摸以便产生播放巻动。 FIG. 19F showing an embodiment of FIG. 19E alternative embodiment in which two touches to be detected so as to generate playback moving Volume. 具体地说,在向下触摸区域783的下触摸点和沿着下触摸区域782上或附近的向下滑动输入的组合可以引起巻动操作,以l更显示下一个照片。 Specifically, the touch-down area 783 of the touch point on the touch area and compositions along or down the slide 782 near the input may cause the movable operation Volume, l more to display the next picture. 应当注意,图19A到19E所述的方法不形成特定因素,因为该方法可以在PC监视器、便携式监视器、数字照相机或具有触摸屏的任何类型的装置上被实现。 It should be noted that the method of FIGS. 19A to 19E do not form a specific factor, since the method may be implemented on a PC monitor, the portable monitor, a digital camera, or any type of device having a touch screen.

图19G表示按照另一个实施例可以在媒体文件(例如照片文件) 的播放期间输入的附加手势。 FIG. 19G indicates additional embodiment gesture that can be entered during playback of media files (e.g., photo files) according to another embodiment. 具体地说,和图18A,18B所示的实施例类似,借助于辨别在触摸敏感显示器上的落地点的数量(即手指的数量),可以不同地解释相同的运动。 In particular, the embodiments shown and 18A, 18B is similar to FIG., The number of landing dots (i.e. the number of fingers) on the touch-sensitive display by means of the discrimination can be interpreted differently the same motion. 在本例中,用两个手指进行的垂直落地点重击手势可被解释为用于删除照片文件、标记照片文件(例如编辑相册)的手势,或任何其它有用指令。 In the present embodiment, the vertical landing point with two fingers hit the gesture may be interpreted as a file delete photos, photo files tag (e.g. album editing) the gesture, or any other useful instruction.

图19H表示使用触敏显示器的其它指定UI区来检测其它附加的手势。 FIG. 19H indication specified UI areas other touch-sensitive display to detect other additional gestures. 在本例中,检测到在另一个指定区756的落地点可把解释为删除、标记或其它有用的指令。 In the present embodiment, it is detected may be interpreted as the other landing point deletion designation area 756, a mark or other useful instructions. 按照一个实施例,多个落地点区可被显示为所述照片文件的半透明的覆盖图。 According to one embodiment, a plurality of landing points of the regions may be displayed as a picture file translucent overlay.

应当注意,虽然图19表示沿垂直向下方向的重击手势,也可以设想,沿垂直向上方向或沿水平方向的重击可被指定为相同指令的手势输入。 It should be noted that, although FIG. 19 shows a vertically downward gesture blow direction may be contemplated, may be designated as the same gesture input instruction in the vertical upward direction or horizontal direction of the blow.

图20表示用于实现图19A-19F的一种可能的算法。 20 shows for implementing a method of FIGS. 19A-19F possible algorithm. 具体地说, 在第一步790,在触敏显示器上显示多张照片中的一张照片。 Specifically, in a first step 790, display multiple pictures in a picture on the touch-sensitive display. 如果在791检测到在显示屏上的触摸,则在792确定该触摸是否是手势输入, 并在793接收手势输入的类型(例如向下跟踪的滑动操作、圆形跟踪的转动操作等)。 If a touch is detected on the display screen 791, then at 792 determines whether the touch gesture is input, and receives the type (e.g., downward sliding operation of the track, a circular track of the turning operation, etc.) in the gesture input 793. 按照检测的手势输入,在794根据需要输出UI元件(例如滑动条或垂直巻动轮),此后在795产生对应于UI元件使用或手势输入的操作。 In accordance with the detected gesture input, output UI elements required (e.g. Volume slider or vertical wheel) according to the operation is generated after a corresponding use of the UI element 795 in the input gesture or 794.

应当注意,图18-20所述的方法也可以在视频环境内实现。 It should be noted that the method of FIGS. 18-20 may also be implemented in a video environment. 具体地说,在视频文件播放期间,可以产生并显示UI元件例如图18A 所示的水平滑动条,借以根据检测到的落地点的数量,启动用于改变视频的某些可调节方面的操作方式,例如亮度、对比度等。 Specifically, the video file during playback, and display the UI element may be generated, for example, the horizontal scroll bar shown in Figs. 18A, thereby detecting the number of the landing point for the start mode change certain aspects of the video may be adjusted , such as brightness, contrast and the like. 与此同时, 也可以用类似方式实现图19A-19F所示的巻动和缩放方法,虽然代替巻动,也可以进行重绕和快进操作。 At the same time, and it may also be implemented Volume movable zooming method shown in FIGS. 19A-19F In a similar manner, although instead of moving Volume may be carried out rewinding and fast-forward operation.

使用在某些预先存在的控制元件上的手势输入可以实现视频文件的附加的编辑/播放功能。 Additional use edits on some pre-existing control element may be implemented gesture input video files / playback. 按照优选实施例,借助于选择地缩小或扩大播放时间线指示条,可以实现视频文件的非线性时间播放。 According to a preferred embodiment, by selecting the play to reduce or expand the timeline bar can be achieved for nonlinear time playing video files. 具体地说,图21A表示视频应用790(例如视频播放应用程序)和进展条792 一起显示视频播放791,其上播放队列793指示视频播放的时间进展。 Specifically, FIG. 21A shows a video application 790 (e.g., a video player application) and a progress bar 792 displayed along a video player 791, queue 793 indicating progression of time on which the video player play.

按照优选实施例,播放队列793可以在进展条792上前后移动, 以反映视频的快进和重绕。 According to a preferred embodiment, the play queue 793 can move forward and backward in the progress bar 792, to reflect the video fast forward and rewind. 播放队列可被保持在相同的位置,或者以非线性速度被调整,以实现视频的可变速播放或暂停。 Play queue can be held in the same position, or at non-linear speed is adjusted in order to achieve a variable speed video playback, or pause. 按照优选实施例,视频应用790可在触敏显示器上显示,播放队列793的位置可以通过手501的手指在屏幕上显示的队列的位置对队列进行触摸而被操纵。 According to the preferred embodiment, video application 790 may be displayed on the touch-sensitive display, the position of the play queue of the queue 793 may be displayed on a screen 501 by a finger of the hand touching the queue is manipulated. 即,播放队列793可作为进展指示器和用于控制视频播放的速度和临时位置的UI元件。 That is, the play queue as the UI element 793 can control the speed of video playback and temporary location for the indicator and the progress.

按照优选实施例,整个进展条792可以作为UI元件,借以用户可以借助于扩大或缩小进展条的一个或多个部分来实现视频的非线性播放。 According to a preferred embodiment, the entire progress bar as the UI element 792 may be, whereby the user can expand or shrink by means of one or more portions of the progress bar to achieve non-linear video. 具体地说,如图21B所示,UI元件进展条792可以通过两个手指的拉近或推远手势(如上面参照图12所述)来操作。 Specifically, as shown, the UI element progress bar 792 may be operated by two fingers gesture zoom in or out (as described above with reference to FIG. 12) 21B. 在图21B 所示的例子中,拉近手势引起在60分钟标记和80分钟标记之间播放时间延长。 In the example shown in FIG. 21B, closer to the gesture causing playback time between 60 minutes and 80 minute mark numerals. 在图21B所示的例子中,视频的播放速度成为非线性的, 这是因为在60和80分钟标记之间的时间间隔期间视频的播放速度可以变慢。 In the example shown in FIG. 21B, the playback speed of the video becomes non-linear because the video playback speed can be slowed during the time between the intervals 60 and 80 minute mark. 或者,在0和60分钟标记之间以及在80分钟标记之后的视频的播放速度可被加速,而在60和80分钟标记之间的播放速度是标准的。 Alternatively, between 0 and 60 minute mark, and the speed of the video at 80 minutes after the marker can be accelerated, and the playback speed between 60 and 80 minute mark is standard.

图21C表示在视频应用790内显示的附加UI元件794。 FIG 21C shows an additional 794 UI elements displayed in the video application 790. 在本例中,UI元件794可以是虚拟的巻动轮,借以用户能够进一步控制视频的播放速度。 In the present embodiment, the UI element 794 may be a virtual Volume wheel, whereby the user can further control the playback speed of the video. 和进展条792的操纵相结合,用户可以首先指定播放速度被变慢的视频部分,因而用户可以使用巻动轮794进一步调整播放队列793以控制视频的播放方向和/或速度。 Manipulation and progress bar 792 are combined, the user may specify the first portion of the video playback speed is slow, and thus the user can further adjust Volume wheel 794 to control the play queue 793 of video playback direction and / or speed.

图21D表示可以为编辑目的添加于视频应用790上的其它附加触敏UI元件。 May be added to FIG. 21D showing further additional element on the touch-sensitive video application UI 790 for the purpose of editing. 例如,如图21D所示,滑动条UI元件796可^皮添加用于检测用于引起水平调整的手势输入,例如扫视(pan)调整或亮度、色度、对比度、伽马等类型的调整。 For example, as shown in FIG. 21D, the slider UI element 796 may be added transdermal ^ for detecting a gesture for adjusting the input level due, e.g. panning (PAN), or to adjust the brightness, color, contrast, gamma and other types of adjustments. 和参照图18A-18E讨论的UI元件751类似,滑动条UI元件796可用于通过改变在其上的落地点数量引起不同的操作方式。 UI elements and discussed with reference to FIGS. 18A-18E is similar to 751, UI element 796 may be used for the slider by changing the number of points on the floor due to the different mode of operation.

UI元件795也可以在视频应用790内便被显示,以实现视频的 UI element 795 may then be displayed in the video application 790, in order to achieve the video

声音编辑。 Sound editing. 具体地说,UI元件795可以包括多个音平调整,用于播放不同的通道或与视频混和的声音或音乐。 Specifically, the UI element 795 may comprise a plurality of sound level adjustment for the different channels or playing video or music sound mixing.

按照优选实施例,视频应用7卯的用户可以定制4皮显示的UI元件,并还可以额外地对UI元件编程以实现所需的功能。 According to the preferred embodiment, video applications, users can customize the sockets 7 UI display element 4 skin, and also to the UI element additionally programmed to achieve the desired functionality.

图22A和22B表示用于实现参照图21A-21D所述的方法的示例算法800。 22A and 22B show an example of a method implemented with reference to FIGS. 21A-21D of the algorithm 800. 具体地说,如图22A所示,在802,浮见频应用7卯可被启动以提供视频播放和/或编辑。 Specifically, as shown, at 802, the floating-band applications see sockets 22A 7 may be activated to provide video playback and / or editing. 在803,进展条792被显示。 In 803, the progress bar 792 is displayed. 在804如果检测到进展条792上的触摸,则在805确定该触摸是拉近还是推远指令。 If a touch is detected on the progress bar 792, 805 is determined at 804 that the touch command is closer or farther away. 如果未检测到是拉近或推远的指令的触摸,则可以按照跟踪触摸输入操纵播放队列。 If a command is not detected, zoom in or out of touch, the player can manipulate the queue according to a tracking touch input. 如果检测到的触摸是缩放手势,则被检测到该触摸的所述进展条的部分可被操纵以按照所述手势输入进行扩大或缩小。 If the detected touch is the pinch gesture, were detected in this portion of the progress bar touch input may be manipulated to expand or shrink according to the gesture.

如图22B所示,可以进行步骤808 -810,以选择地分别显示附加的UI元件,例如巻动轮、混声器、以及滑动条水平调整。 22B, the steps 808-810 may be performed to select additional displays UI elements, e.g. Volume wheel, sound mixers, and horizontal adjustment slider respectively. 在步骤811-813可以检测触摸,此后可以调用合适的功能814-818。 Can detect a touch at step 811-813, thereafter calls the appropriate function 814-818.

图23表示用于操纵显示器和音频或音乐文件的记录的本发明的另一个实施例。 23 shows a further display of the present invention to manipulate and record music or audio files according to an embodiment. 如图23所示,音乐应用830可以显示一对虚拟转盘842和843,其上正在播放两个音乐记录834和835,这些记录是单个记录或LP记录之一。 23, a music application 830 may display a pair of imaginary turntable 842 and 843, two music being played on the recording 834 and 835, the record is a single record or one LP record. 记录834和835可以是数字音乐文件的图形表示(例如歌曲A和歌曲B),其通过音乐应用830正被播放。 Records 834 and 835 may be a graphical representation of digital music files (e.g., song A and song B), which is being played by the music application 830. 换句话说,该记录可以是音乐文件的图形印刻,好象音乐文件被印刻在物理记录上。 In other words, the recording pattern may be imprinted music file if the music file is engraved on the physical records.

如同一对物理转盘,唱针844和855可以是播放队列的图形图标表示,其位置可以通过在触敏显示屏上触摸播放队列并把图标拖放到图形记录上的所需位置来改变。 Like a physical dial needle 844 and 855 may be a graphical icon indicates the play queue, which queue playback position by touching on the touch sensitive display screen and drag the icon to the desired position on the recording pattern to change. 唱针的移动将引起对应的歌曲的播放点的跳跃,如同在物理的转盘上那样。 Movement will cause the needle skip playback point corresponding to the song, as in the physical disk.

也如同一对物理转盘,可以由一个或多个手指触摸开始/停止按钮838和839,从而引起歌曲再现的停止/暂停。 But also as a pair of physical turntable, by one or more fingers touch start / stop button 838, and 839, thereby causing the song playback stop / pause. 速度改变条840和841 可被线性地调整,以控制歌曲的播放速度。 840 and speed changing section 841 may be linearly adjusted to control the tempo of the song. 窗口831和833可以图形地再现被再现歌曲的频率表示,同时窗口832可以显示音乐应用832 的实际输出的频率表示,其可以简单地是一个正被再现的歌曲,或者是歌曲的混和/组合。 Windows 831 and 833 may be graphically reproduced frequency is reproduced song represented, while window 832 can display the actual frequency of the output of the music application 832 is represented, which may simply be a song one being played back, or the song mixing / combination. 混和/摇摄(pan)条850可被操纵,以便调制或解调正被再现的两个歌曲。 Mixing / panning (PAN) strip 850 may be manipulated to modulate or demodulate two songs being reproduced.

在歌曲再现期间,记录834和835可以类似于物理记录被操纵。 During song playback, records 834 and 835 may be manipulated like a physical record. 例如,记录的快回和快进可以引起记录"损伤"的声音效果,如同盘操作员经常在物理转盘上进行的那样。 For example, fast-forward and fast back recorded sound effects may cause "injury", the operator often like disc on the turntable as the physical records.

应当注意,上述的方法可以在相同的手势触击期间同时被实现。 It should be noted that the above methods may be simultaneously implemented during the same gestural touch. 即,在手势触击期间,可以进行选择、跟踪、缩放、转动和扫视,其可以包括散开、转动和滑动手指。 That is, during the gestural touch may be selected, tracked, zooming, rotating and panning, which may include spreading, rotating and sliding fingers. 例如,在至少两个手指安放之后, 被显示的对象(地图)可以和该两个手指相关联或者被锁定于该两个手指。 For example, after mounting the at least two fingers, the object (map) is displayed and the two fingers may be associated with or locked to the two fingers. 为了缩放,用户可以散开或闭合其手指。 In order to zoom, the user can spread or close their fingers. 这些操作的每一个可以在连续运动中同时发生。 Each of these operations can occur simultaneously in a continuous motion. 例如,用户可以散开和闭合其手指,同时在触摸屏上转动和滑动手指。 For example, the user can spread and close their fingers while rotating and sliding a finger on the touch screen. 或者,用户可以对这些运动中的每一个进行分段,而不必使手势触击复位。 Alternatively, the user can segment each of these movements, without having to reset the gestural touch. 例如,用户可以首先散开其手指, 然后转动该手指,然后闭合该手指,然后滑动该手指等等。 For example, the user can first spread their fingers, then rotate the finger, the finger is then closed, and the sliding of the finger and the like.

还应当注意,不必总是使用人的手指实现手势输入。 It should also be noted that the need to always use human finger gesture input to achieve. 在可能的情况下,使用点击装置例如铁笔实现手势输入也就足够了。 Where possible, the use of a pointing device such as a stylus gesture input will be enough to achieve.

包括和UI元件(例如虚拟的巻动轮)进行交互作用的可被用作 And including UI elements (e.g. Volume virtual wheel) may be used as interact

用于实现界面指令的手势触击的附加例子在共同在审的申请号为10/卯3964 、美国专利7>开号为US2006/0026521以及申请号为11/038590、美国专利公开号为US2006/0026535的未决专利申请中描述了,这些专利申请的全部内容通过引用被包括在此。 Additional examples of a gesture interface instructions for implementing the strike in co-pending Application No. 10 / d 3964, U.S. Patent No. 7> open No. Application No. US2006 0026521, and / as 11/038590, U.S. Patent Publication No. US2006 / 0,026,535 the entire contents of copending patent application are described in these patent applications are incorporated herein by reference.

不脱离本发明的范围和构思,本领域技术人员可以作出许多改变和改型。 Without departing from the scope and spirit of the invention, those skilled in the art that many changes and modifications may be made. 因此,必须理解,所提出的实施例仅仅是一些例子,而不应当用于限制如权利要求限定的本发明。 Therefore, it must be understood that the embodiments presented are merely examples, and should not be used to limit the present invention as defined in the claims. 例如,虽然其中针对个人计算装置说明了本发明的实施例,应当理解,本发明不限于台式计算机或便携式计算机,而是可以应用于其它的计算应用例如移动通信设备、 独立的多媒体再现装置等。 For example, although described for personal computing devices embodiments of the present invention, it should be understood that the present invention is not limited to a desktop or portable computer, but may be applied to other communication apparatus such as a mobile computing application, an independent multimedia playback devices.

本说明使用的用于描述本发明及其各个实施例的词语应当理解为不仅包括其通常定义的意义,而且还包括在通常定义的意义之外的由在本说明的结构、材料或操作中的特殊的定义。 This description is used to describe the present invention and its various embodiments, the words should be understood to include not only the meaning which is generally defined, but also outside the normally defined by meaning in structures, materials, or operations described in the present special definition. 因而,如果一个元件在本说明的上下文中可被理解为包括一个以上的意义,那么在权利要求中其使用必须理解为由说明书和该词语本身支持的所有可能的意义。 Thus, if an element in the context of the present description may be understood as comprising more than one meaning, then its use must be understood as meaning all possible word itself supports the specification and in the appended claims.

因此,下面权利要求的词语或元件的定义被在本说明中定义了, 其不仅包括字面上提出的元件的组合,而且包括用于以基本相同的方式实现基本相同的功能从而获得基本相同的结果的所有的等效结构、 材料或操作。 Thus, the definition of the words or elements of the following claims is defined in this specification, includes not only the combination of elements which are literally set forth, but also for substantially the same way to achieve substantially the same function so as to obtain substantially the same result all equivalent structures, materials, or operations. 在这个意义上,对于在下面权利要求中的任何一个元件, 可以设想,可以作出两个或多个元件的等效替代物,或者可以用一个 In this sense, for any one element in the following claims, it is contemplated that equivalents may be made of two or more alternative element, or may be a

元件替代权利要求中的两个或两个以上的元件。 Alternatively elements as claimed in two or more of the claims.

在本领域普通技术人员看来,对于权利要求的主题的非实质的改 In the opinion of ordinary skill in the art, for the claimed subject matter insubstantial change

变,现在已知的或者以后想出的,都应当认为被包括在权利要求的范围内。 Variant, now known or later come up, that should be included within the scope of the claims. 因此,对于本领域普通技术人员,现在已知的或者以后已知的各种替代方案,都应当被限定在被定义的权利要求的元件的范围内。 Accordingly, those of ordinary skill in the art, now known or later known various alternatives, are to be defined within the scope of the claim element is defined claims.

因而,权利要求应当被理解为包括上面具体说明和描述的、在构思上等效的、以及显然可被替代的技术方案。 Accordingly, the claims should be understood to include specified above and in the equivalent concepts, and the apparent technical solution alternatives can be described. 例如,权利要求中提及的术语"计算机,,或"计算机系统"应当至少包括台式计算机、便携式计算机、或任何移动计算装置例如移动通信装置(例如蜂窝电话或 For example, mentioned in the claims the term "computer ,, or" computer system "shall include at least a desktop computer, a portable computer, or any mobile computing device, for example, a mobile communication device (e.g., a cellular phone or

Fi/Skype电话、电子邮件通信装置、个人数字助理装置),以及多媒体再现装置(例如iPod,MP3播放器,或任何数字图形/光学再现装置)。 Fi / Skype phone, email communication device, a personal digital assistant device), and a multimedia reproducing apparatus (e.g. iPod, MP3 player, or any digital graphics / reproducing optical apparatus).

Claims (6)

1.一种手持移动通信装置,其特征在于: 触摸敏感的显示屏; 用于使显示屏显示媒体文件的一部分的装置,所述媒体文件包括文本项和图形项至少之一; 用于检测在显示屏的表面上的触摸卷动输入的装置,所述触摸卷动输入包括在显示屏的表面上的人的手指的触屏点,该触屏点对应于显示屏上媒体文件的所述部分被显示的位置; 用于检测人的手指在显示屏上的触屏点的拖拉运动的装置,所述拖拉运动跨过正被显示的媒体文件的所述部分的一部分,并包括垂直的和水平的矢量分量; 用于确定手指触屏点的拖拉运动从而指示卷动操作的装置; 用于使媒体文件在显示屏上卷动的装置,其中所示卷动被限制于垂直和水平方向之一。 A handheld mobile communication device, comprising: touch-sensitive display screen; display means for displaying a portion of the media file, the media file comprises at least one text entry and graphical items; means for detecting moving a touch input means on the roll surface of the panel, the touch scroll input comprises human touch points on the surface of the display screen of the finger, the touch point on the display screen corresponding to the portion of the media file positions are displayed; dragging means for detecting movement of the touch point of a person's finger on the display screen, said dragging across a portion of the motion portion of the media file being displayed, and comprising vertical and horizontal the vector components; means for determining the drag motion of the finger touch point so that scrolling operation of the pointing device; for media files on a display screen scrolling means, wherein the movable coil is limited to one shown in vertical and horizontal directions .
2. 如权利要求1所述的手持移动通信装置,还包括用于确定所述触摸巻动输入是否在媒体文件的预定邻域内,并且如果是,则进行对于该媒体文件的选择操作的装置。 2. The hand-held mobile communication device according to claim 1, further comprising means for determining whether the touch input Volume movable predetermined neighborhood of media files, and if so, means for selecting the media file operation is performed.
3. 如权利要求1所述的手持移动通信装置,还包括只利用拖拉运动的水平分量或者只利用拖拉运动的垂直分量作为输入以便分别实现沿水平或垂直方向的巻动的装置。 The handheld mobile communication device according to claim 1, further comprising using only the horizontal component of the motion drag, or drag using only the vertical component of the motion as an input device for Volume horizontal or vertical direction movable were achieved.
4. 一种手持移动通信装置,其特征在于: 触摸敏感的显示屏;用于使显示屏显示媒体文件的一部分的装置,所述媒体文件包括文本项和图形项至少之一;用于检测在显示屏的表面上的触摸巻动输入的装置,所述触摸巻动输入包括在显示屏的表面上的人的手指的触屏点,该触屏点对应于显示屏上媒体文件的所述部分被显示的位置;用于检测人的手指在显示屏上的触屏点的拖拉运动的装置,所述拖拉运动跨过正被显示的媒体文件的所述部分的一部分;用于检测人的手指的触屏点的拖拉运动的方向的装置,其中拖拉运动的方向包括垂直分量矢量和水平分量矢量;以及用于使媒体文件在显示屏上按照检测的拖拉运动的方向巻动的装置。 A handheld mobile communication device, comprising: touch-sensitive display screen; display means for displaying a portion of the media file, the media file comprises at least one text entry and graphical items; means for detecting Volume touch movement input device on the surface of the panel, the touch input Volume movable touch point on the surface of the display screen, including a human's finger, the touch point on the display screen corresponding to the portion of the media file display position; detecting a person's finger; means for moving the dragging touch points detected person's finger on the display screen for the dragging motion across a portion of the portion of the media file being displayed It means the direction of movement of the drag touch point, wherein the direction of dragging motion vector includes a vertical component and a horizontal component vector; and for media files on the display screen in the direction of the drag motion detection Volume movable means.
5. 如权利要求4所述的手持移动通信装置,还包括用于确定触摸巻动输入是否在媒体文件的预定邻域内的装置,并且如果是,则进行对于媒体文件的选择操作。 The hand-held mobile communication device according to claim 4, further comprising means for determining whether the media file in a predetermined neighborhood Volume movable touch input, and if so, the selection operation for the media file.
6. 如权利要求4所述的手持移动通信装置,还包括只利用拖拉运动的水平分量或者只利用拖拉运动的垂直分量作为输入以便分别实现沿水平或垂直方向的巻动的装置。 The handheld mobile communication device according to claim 4, further comprising using only the horizontal component of the motion drag, or drag using only the vertical component of the motion as an input device for Volume horizontal or vertical direction movable were achieved.
CN 200720194296 2007-01-05 2007-12-05 Hand-hold mobile communicating device CN201181467Y (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US87875407P true 2007-01-05 2007-01-05
US60/878,754 2007-01-05
US11/818,342 2007-06-13

Publications (1)

Publication Number Publication Date
CN201181467Y true CN201181467Y (en) 2009-01-14

Family

ID=38860004

Family Applications (2)

Application Number Title Priority Date Filing Date
CN 200720194296 CN201181467Y (en) 2007-01-05 2007-12-05 Hand-hold mobile communicating device
CN 200780051755 CN101611373B (en) 2007-01-05 2007-12-28 Controlling, manipulating, and editing gestures of media files using touch sensitive devices

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN 200780051755 CN101611373B (en) 2007-01-05 2007-12-28 Controlling, manipulating, and editing gestures of media files using touch sensitive devices

Country Status (2)

Country Link
CN (2) CN201181467Y (en)
DE (1) DE202007014957U1 (en)

Cited By (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101847055A (en) * 2009-03-24 2010-09-29 鸿富锦精密工业(深圳)有限公司;鸿海精密工业股份有限公司 Input method based on touch screen
CN101996033A (en) * 2009-08-03 2011-03-30 Lg电子株式会社 Mobile terminal and controlling method thereof
WO2011035723A1 (en) * 2009-09-23 2011-03-31 Han Dingnan Method and interface for man-machine interaction
CN102043510A (en) * 2009-10-09 2011-05-04 禾瑞亚科技股份有限公司 Method and device for analyzing two-dimension sensing information
CN102063248A (en) * 2009-11-16 2011-05-18 索尼公司 Information processing apparatus, information processing method, and program
CN102193714A (en) * 2010-03-11 2011-09-21 龙旗科技(上海)有限公司 Man-machine interactive mode for data grouping management of mobile terminal
CN102200882A (en) * 2010-03-24 2011-09-28 Nec卡西欧移动通信株式会社 Terminal device and control program thereof
CN102243662A (en) * 2011-07-27 2011-11-16 北京风灵创景科技有限公司 Method for displaying browser interface on mobile equipment
CN102243573A (en) * 2011-07-27 2011-11-16 北京风灵创景科技有限公司 Method and device for managing element attribute in application program
CN102270081A (en) * 2010-06-03 2011-12-07 腾讯科技(深圳)有限公司 A method and apparatus for adjusting the size of the list elements
CN102439859A (en) * 2009-05-19 2012-05-02 三星电子株式会社 Mobile device and method for executing particular function through touch event on communication related list
CN102439555A (en) * 2009-05-19 2012-05-02 三星电子株式会社 Method of operating a portable terminal and portable terminal supporting the same
CN102549538A (en) * 2009-07-21 2012-07-04 思科技术公司 Gradual proximity touch screen
CN102750096A (en) * 2012-06-15 2012-10-24 深圳乐投卡尔科技有限公司 Vehicle-mounted Android platform multi-point gesture control method
CN101799727B (en) 2009-02-11 2012-11-07 晨星半导体股份有限公司 Signal processing device and method of multipoint touch interface and selecting method of user interface image
CN102770837A (en) * 2010-02-25 2012-11-07 微软公司 Multi-screen pinch and expand gestures
CN102799299A (en) * 2011-05-27 2012-11-28 华硕电脑股份有限公司 Computer system with touch screen and processing method for gestures of computer system
CN102884499A (en) * 2010-03-26 2013-01-16 诺基亚公司 Apparatus and method for proximity based input
CN102292693B (en) 2009-01-21 2013-03-13 微软公司 Bi-modal multiscreen interactivity
US8400424B2 (en) 2009-10-09 2013-03-19 Egalax—Empia Technology Inc. Method and device for analyzing positions
CN103069491A (en) * 2010-08-27 2013-04-24 三星电子株式会社 Method and apparatus for playing contents
US8471826B2 (en) 2009-10-09 2013-06-25 Egalax—Empia Technology Inc. Method and device for position detection
US8537131B2 (en) 2009-10-09 2013-09-17 Egalax—Empia Technology Inc. Method and device for converting sensing information
CN103329075A (en) * 2011-01-06 2013-09-25 Tivo有限公司 Method and apparatus for gesture based controls
CN103376945A (en) * 2012-04-13 2013-10-30 佳能株式会社 Information processing apparatus and method for controlling the same
US8587555B2 (en) 2009-10-09 2013-11-19 Egalax—Empia Technology Inc. Method and device for capacitive position detection
US8643613B2 (en) 2009-10-09 2014-02-04 Egalax—Empia Technology Inc. Method and device for dual-differential sensing
CN103733163A (en) * 2011-08-05 2014-04-16 三星电子株式会社 Electronic apparatus using motion recognition and method for controlling electronic apparatus thereof
CN104035696A (en) * 2013-03-04 2014-09-10 观致汽车有限公司 Display method and device of vehicle-mounted message center on touch display interface
US9075522B2 (en) 2010-02-25 2015-07-07 Microsoft Technology Licensing, Llc Multi-screen bookmark hold gesture
US9261964B2 (en) 2005-12-30 2016-02-16 Microsoft Technology Licensing, Llc Unintentional touch rejection
US9274682B2 (en) 2010-02-19 2016-03-01 Microsoft Technology Licensing, Llc Off-screen gestures to create on-screen input
CN105378634A (en) * 2013-05-17 2016-03-02 思杰系统有限公司 Remoting or localizing touch gestures at a virtualization client agent
US9310994B2 (en) 2010-02-19 2016-04-12 Microsoft Technology Licensing, Llc Use of bezel as an input mechanism
US9367205B2 (en) 2010-02-19 2016-06-14 Microsoft Technolgoy Licensing, Llc Radial menus with bezel gestures
US9411504B2 (en) 2010-01-28 2016-08-09 Microsoft Technology Licensing, Llc Copy and staple gestures
US9411498B2 (en) 2010-01-28 2016-08-09 Microsoft Technology Licensing, Llc Brush, carbon-copy, and fill gestures
US9454304B2 (en) 2010-02-25 2016-09-27 Microsoft Technology Licensing, Llc Multi-screen dual tap gesture
US9477337B2 (en) 2014-03-14 2016-10-25 Microsoft Technology Licensing, Llc Conductive trace routing for display and bezel sensors
US9483152B2 (en) 2009-10-09 2016-11-01 Egalax_Empia Technology Inc. Method and device for dual-differential sensing
US9519356B2 (en) 2010-02-04 2016-12-13 Microsoft Technology Licensing, Llc Link gestures
US9582122B2 (en) 2012-11-12 2017-02-28 Microsoft Technology Licensing, Llc Touch-sensitive bezel techniques
US9733895B2 (en) 2011-08-05 2017-08-15 Samsung Electronics Co., Ltd. Method for controlling electronic apparatus based on voice recognition and motion recognition, and electronic apparatus applying the same
US9864471B2 (en) 2009-10-09 2018-01-09 Egalax_Empia Technology Inc. Method and processor for analyzing two-dimension information
US9965165B2 (en) 2010-02-19 2018-05-08 Microsoft Technology Licensing, Llc Multi-finger gestures

Families Citing this family (58)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI363983B (en) * 2008-04-25 2012-05-11 Benq Corp Interactive electronic apparatus and interaction method thereof
DE102008032451C5 (en) * 2008-07-10 2017-10-19 Rational Ag Display method and cooking appliance therefor
EP2863289A1 (en) 2008-11-18 2015-04-22 Studer Professional Audio GmbH Input device and method of detecting a user input with an input device
US8957865B2 (en) 2009-01-05 2015-02-17 Apple Inc. Device, method, and graphical user interface for manipulating a user interface object
KR20100086678A (en) * 2009-01-23 2010-08-02 삼성전자주식회사 Apparatus and method for playing of multimedia item
KR101691938B1 (en) * 2010-01-06 2017-01-03 삼성전자주식회사 Method and apparatus for setting of repeat playing section in a portable terminal
US8786559B2 (en) 2010-01-06 2014-07-22 Apple Inc. Device, method, and graphical user interface for manipulating tables using multi-contact gestures
CN101853128A (en) * 2010-05-08 2010-10-06 杭州惠道科技有限公司 Multi-touch method for human-computer interface of slide-wheel
US20110298720A1 (en) * 2010-06-02 2011-12-08 Rockwell Automation Technologies, Inc. System and method for the operation of a touch screen
EP2395440A3 (en) 2010-06-14 2012-01-11 Lg Electronics Inc. Mobile terminal and conrolling method thereof
CN101957718A (en) * 2010-06-22 2011-01-26 宇龙计算机通信科技(深圳)有限公司 Method and device for moving icons and digital terminal
US8773370B2 (en) 2010-07-13 2014-07-08 Apple Inc. Table editing systems with gesture-based insertion and deletion of columns and rows
CN101986249A (en) * 2010-07-14 2011-03-16 上海无戒空间信息技术有限公司 Method for controlling computer by using gesture object and corresponding computer system
US8614693B2 (en) * 2010-08-27 2013-12-24 Apple Inc. Touch and hover signal drift compensation
US8767019B2 (en) 2010-08-31 2014-07-01 Sovanta Ag Computer-implemented method for specifying a processing operation
US8972467B2 (en) 2010-08-31 2015-03-03 Sovanta Ag Method for selecting a data set from a plurality of data sets by means of an input device
US9710154B2 (en) 2010-09-03 2017-07-18 Microsoft Technology Licensing, Llc Dynamic gesture parameters
CN101945499A (en) * 2010-09-06 2011-01-12 深圳市同洲电子股份有限公司 Method, terminal and system for transferring files
KR101685991B1 (en) * 2010-09-30 2016-12-13 엘지전자 주식회사 Mobile terminal and control method for mobile terminal
CN102467327A (en) * 2010-11-10 2012-05-23 上海无戒空间信息技术有限公司 Method for generating and editing gesture object and operation method of audio data
CN102025831A (en) * 2010-11-18 2011-04-20 华为终端有限公司 Multimedia playing method and terminal
KR20120075839A (en) * 2010-12-29 2012-07-09 삼성전자주식회사 Method and apparatus for providing mouse right click function in touch screen terminal
CN102681748B (en) * 2011-03-09 2015-01-28 联想(北京)有限公司 Information processing equipment and information processing method
US9281010B2 (en) 2011-05-31 2016-03-08 Samsung Electronics Co., Ltd. Timeline-based content control method and apparatus using dynamic distortion of timeline bar, and method and apparatus for controlling video and audio clips using the same
CN103001933A (en) * 2011-09-15 2013-03-27 北京同步科技有限公司 Interactive multimedia information distribution terminal and information distribution method thereof
CN102890694A (en) * 2011-09-22 2013-01-23 北京师科阳光信息技术有限公司 Time shaft system and implementation method thereof
US9052810B2 (en) * 2011-09-28 2015-06-09 Sonos, Inc. Methods and apparatus to manage zones of a multi-zone media playback system
CN103092389A (en) * 2011-11-04 2013-05-08 德尔福技术有限公司 Touch screen device and method for achieving virtual mouse action
US9405463B2 (en) * 2011-11-25 2016-08-02 Samsung Electronics Co., Ltd. Device and method for gesturally changing object attributes
CN103247310A (en) * 2012-02-14 2013-08-14 索尼爱立信移动通讯有限公司 Multimedia playing control method, playing control module and playing terminal
CN102609143A (en) * 2012-02-15 2012-07-25 张群 Handheld electronic equipment and video playing and controlling method thereof
JP6004693B2 (en) * 2012-03-23 2016-10-12 キヤノン株式会社 Display control apparatus and control method thereof
US20130257792A1 (en) * 2012-04-02 2013-10-03 Synaptics Incorporated Systems and methods for determining user input using position information and force sensing
CN102866988B (en) * 2012-08-28 2015-10-21 中兴通讯股份有限公司 A terminal implemented method and copy and paste the text boxes
US20140109012A1 (en) * 2012-10-16 2014-04-17 Microsoft Corporation Thumbnail and document map based navigation in a document
US20140118265A1 (en) * 2012-10-29 2014-05-01 Compal Electronics, Inc. Electronic apparatus with proximity sensing capability and proximity sensing control method therefor
CN103035273B (en) * 2012-12-12 2016-05-25 宁波高新区百瑞音响科技有限公司 Apparatus using encoded digital switch knob for switching the audio file
KR20140077697A (en) * 2012-12-14 2014-06-24 삼성전자주식회사 Mobile terminal for controlling haptic of an input unit and method therefor
CN103885623A (en) * 2012-12-24 2014-06-25 腾讯科技(深圳)有限公司 Mobile terminal, system and method for processing sliding event into editing gesture
CN103902173B (en) * 2012-12-26 2017-12-26 联想(北京)有限公司 The portable terminal and the information processing method and a display processing method
CN103076985B (en) * 2013-01-31 2016-03-02 北京魔力时间科技有限公司 Touch-screen display based on the precise control and video playback apparatus and method of progress
EP2963530A4 (en) * 2013-02-27 2016-10-26 Alps Electric Co Ltd Operation detection device
US20140250398A1 (en) * 2013-03-03 2014-09-04 Microsoft Corporation Enhanced canvas environments
CN104123088B (en) * 2013-04-24 2018-01-02 华为技术有限公司 Mouse implemented method and apparatus and a touch screen terminal
CN104216625A (en) * 2013-05-31 2014-12-17 华为技术有限公司 Display object display position adjusting method and terminal equipment
CN103327247B (en) * 2013-06-17 2017-01-11 神思依图(北京)科技有限公司 Operating device and method for photograph
JP6189680B2 (en) * 2013-08-23 2017-08-30 シャープ株式会社 Interface device, interface method, interface program, and computer-readable recording medium storing the program
US9519420B2 (en) * 2013-10-16 2016-12-13 Samsung Electronics Co., Ltd. Apparatus and method for editing synchronous media
CN104902331B (en) * 2014-03-07 2018-08-10 联想(北京)有限公司 Kinds of playback progress adjustment method and electronic equipment
CN104077028A (en) * 2014-05-28 2014-10-01 天津三星通信技术研究有限公司 Equipment and method for controlling display item in electronic equipment
CN105653111A (en) * 2014-11-14 2016-06-08 神讯电脑(昆山)有限公司 Touch control input method and electronic device thereof
CN104571871A (en) * 2015-01-26 2015-04-29 深圳市中兴移动通信有限公司 Method and system for selecting files
CN105045513B (en) * 2015-08-27 2019-02-12 Oppo广东移动通信有限公司 Touch operation method and handheld device
CN105224220A (en) * 2015-09-08 2016-01-06 深圳市金立通信设备有限公司 Method and apparatus for controlling media playing
CN106612425B (en) * 2015-10-23 2019-04-12 腾讯科技(深圳)有限公司 Image adjusting method and terminal device
CN105573616B (en) * 2015-12-10 2018-05-29 广东欧珀移动通信有限公司 Playlists control method and a mobile terminal
CN105573631A (en) * 2015-12-14 2016-05-11 联想(北京)有限公司 Touch display electronic device and control method thereof
CN106527917A (en) * 2016-09-23 2017-03-22 北京仁光科技有限公司 Multi-finger touch operation identification method for screen interactive system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5900875A (en) 1997-01-29 1999-05-04 3Com Corporation Method and apparatus for interacting with a portable computer system

Cited By (91)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10019080B2 (en) 2005-12-30 2018-07-10 Microsoft Technology Licensing, Llc Unintentional touch rejection
US9261964B2 (en) 2005-12-30 2016-02-16 Microsoft Technology Licensing, Llc Unintentional touch rejection
US9952718B2 (en) 2005-12-30 2018-04-24 Microsoft Technology Licensing, Llc Unintentional touch rejection
US9946370B2 (en) 2005-12-30 2018-04-17 Microsoft Technology Licensing, Llc Unintentional touch rejection
US9594457B2 (en) 2005-12-30 2017-03-14 Microsoft Technology Licensing, Llc Unintentional touch rejection
CN102292693B (en) 2009-01-21 2013-03-13 微软公司 Bi-modal multiscreen interactivity
CN101799727B (en) 2009-02-11 2012-11-07 晨星半导体股份有限公司 Signal processing device and method of multipoint touch interface and selecting method of user interface image
CN101847055A (en) * 2009-03-24 2010-09-29 鸿富锦精密工业(深圳)有限公司;鸿海精密工业股份有限公司 Input method based on touch screen
CN102439555B (en) * 2009-05-19 2015-07-15 三星电子株式会社 Method of operating a portable terminal and portable terminal supporting the same
US8910068B2 (en) 2009-05-19 2014-12-09 Samsung Electronics Co., Ltd. Method of operating a portable terminal and portable terminal supporting the same
CN102439859A (en) * 2009-05-19 2012-05-02 三星电子株式会社 Mobile device and method for executing particular function through touch event on communication related list
CN102439555A (en) * 2009-05-19 2012-05-02 三星电子株式会社 Method of operating a portable terminal and portable terminal supporting the same
US9817546B2 (en) 2009-05-19 2017-11-14 Samsung Electronics Co., Ltd. Mobile device and method for executing particular function through touch event on communication related list
CN102549538B (en) * 2009-07-21 2016-04-27 思科技术公司 Asymptotic touch screen
CN102549538A (en) * 2009-07-21 2012-07-04 思科技术公司 Gradual proximity touch screen
US8595646B2 (en) 2009-08-03 2013-11-26 Lg Electronics Inc. Mobile terminal and method of receiving input in the mobile terminal
CN101996033A (en) * 2009-08-03 2011-03-30 Lg电子株式会社 Mobile terminal and controlling method thereof
CN102812426A (en) * 2009-09-23 2012-12-05 韩鼎楠 Method And Interface For Man-machine Interaction
WO2011035723A1 (en) * 2009-09-23 2011-03-31 Han Dingnan Method and interface for man-machine interaction
US9081441B2 (en) 2009-10-09 2015-07-14 Egalax—Empia Technology Inc. Method and device for analyzing two-dimension sensing information
US8400424B2 (en) 2009-10-09 2013-03-19 Egalax—Empia Technology Inc. Method and device for analyzing positions
US8400423B2 (en) 2009-10-09 2013-03-19 Egalax—Empia Technology Inc. Method and device for analyzing positions
US8400425B2 (en) 2009-10-09 2013-03-19 Egalax—Empia Technology Inc. Method and device for analyzing positions
US8400422B2 (en) 2009-10-09 2013-03-19 Egalax—Empia Technology Inc. Method and device for analyzing positions
US9606692B2 (en) 2009-10-09 2017-03-28 Egalax_Empia Technology Inc. Controller for position detection
US8473243B2 (en) 2009-10-09 2013-06-25 Egalax—Empia Technology Inc. Method and device for analyzing positions
US8471826B2 (en) 2009-10-09 2013-06-25 Egalax—Empia Technology Inc. Method and device for position detection
US8497851B2 (en) 2009-10-09 2013-07-30 Egalax—Empia Technology Inc. Method and device for analyzing positions
US8537131B2 (en) 2009-10-09 2013-09-17 Egalax—Empia Technology Inc. Method and device for converting sensing information
CN102043510A (en) * 2009-10-09 2011-05-04 禾瑞亚科技股份有限公司 Method and device for analyzing two-dimension sensing information
US8564564B2 (en) 2009-10-09 2013-10-22 Egalax—Empia Technology Inc. Method and device for position detection
US8570289B2 (en) 2009-10-09 2013-10-29 Egalax—Empia Technology Inc. Method and device for position detection
US10310693B2 (en) 2009-10-09 2019-06-04 Egalax_Empia Technology Inc. Controller for position detection
US8583401B2 (en) 2009-10-09 2013-11-12 Egalax—Empia Technology Inc. Method and device for analyzing positions
US8587555B2 (en) 2009-10-09 2013-11-19 Egalax—Empia Technology Inc. Method and device for capacitive position detection
US9141216B2 (en) 2009-10-09 2015-09-22 Egalax—Empia Technology Inc. Method and device for dual-differential sensing
US8600698B2 (en) 2009-10-09 2013-12-03 Egalax—Empia Technology Inc. Method and device for analyzing positions
US8633917B2 (en) 2009-10-09 2014-01-21 Egalax—Empia Technology Inc. Method and device for capacitive position detection
US8643613B2 (en) 2009-10-09 2014-02-04 Egalax—Empia Technology Inc. Method and device for dual-differential sensing
US9864471B2 (en) 2009-10-09 2018-01-09 Egalax_Empia Technology Inc. Method and processor for analyzing two-dimension information
CN104331183B (en) * 2009-10-09 2017-12-15 禾瑞亚科技股份有限公司 Method and apparatus for two dimensional sensing information bis difference analysis
US9977556B2 (en) 2009-10-09 2018-05-22 Egalax_Empia Technology Inc. Controller for position detection
US8890821B2 (en) 2009-10-09 2014-11-18 Egalax—Empia Technology Inc. Method and device for dual-differential sensing
US10101372B2 (en) 2009-10-09 2018-10-16 Egalax_Empia Technology Inc. Method and device for analyzing positions
US8941597B2 (en) 2009-10-09 2015-01-27 Egalax—Empia Technology Inc. Method and device for analyzing two-dimension sensing information
US9798427B2 (en) 2009-10-09 2017-10-24 Egalax_Empia Technology Inc. Method and device for dual-differential sensing
US9069410B2 (en) 2009-10-09 2015-06-30 Egalax—Empia Technology Inc. Method and device for analyzing two-dimension sensing information
US8872776B2 (en) 2009-10-09 2014-10-28 Egalax—Empia Technology Inc. Method and device for analyzing two-dimension sensing information
US9483152B2 (en) 2009-10-09 2016-11-01 Egalax_Empia Technology Inc. Method and device for dual-differential sensing
CN102063248A (en) * 2009-11-16 2011-05-18 索尼公司 Information processing apparatus, information processing method, and program
US9411498B2 (en) 2010-01-28 2016-08-09 Microsoft Technology Licensing, Llc Brush, carbon-copy, and fill gestures
US9857970B2 (en) 2010-01-28 2018-01-02 Microsoft Technology Licensing, Llc Copy and staple gestures
US9411504B2 (en) 2010-01-28 2016-08-09 Microsoft Technology Licensing, Llc Copy and staple gestures
US10282086B2 (en) 2010-01-28 2019-05-07 Microsoft Technology Licensing, Llc Brush, carbon-copy, and fill gestures
US9519356B2 (en) 2010-02-04 2016-12-13 Microsoft Technology Licensing, Llc Link gestures
US9367205B2 (en) 2010-02-19 2016-06-14 Microsoft Technolgoy Licensing, Llc Radial menus with bezel gestures
US10268367B2 (en) 2010-02-19 2019-04-23 Microsoft Technology Licensing, Llc Radial menus with bezel gestures
US9274682B2 (en) 2010-02-19 2016-03-01 Microsoft Technology Licensing, Llc Off-screen gestures to create on-screen input
US9965165B2 (en) 2010-02-19 2018-05-08 Microsoft Technology Licensing, Llc Multi-finger gestures
US9310994B2 (en) 2010-02-19 2016-04-12 Microsoft Technology Licensing, Llc Use of bezel as an input mechanism
CN102770837A (en) * 2010-02-25 2012-11-07 微软公司 Multi-screen pinch and expand gestures
US9075522B2 (en) 2010-02-25 2015-07-07 Microsoft Technology Licensing, Llc Multi-screen bookmark hold gesture
US9454304B2 (en) 2010-02-25 2016-09-27 Microsoft Technology Licensing, Llc Multi-screen dual tap gesture
CN102770837B (en) * 2010-02-25 2016-12-21 微软技术许可有限责任公司 Multi-screen pinch gesture
CN102193714A (en) * 2010-03-11 2011-09-21 龙旗科技(上海)有限公司 Man-machine interactive mode for data grouping management of mobile terminal
CN102200882A (en) * 2010-03-24 2011-09-28 Nec卡西欧移动通信株式会社 Terminal device and control program thereof
CN102200882B (en) * 2010-03-24 2015-03-11 Nec卡西欧移动通信株式会社 Terminal device and control program thereof
CN102884499A (en) * 2010-03-26 2013-01-16 诺基亚公司 Apparatus and method for proximity based input
CN102270081B (en) * 2010-06-03 2015-09-23 腾讯科技(深圳)有限公司 A method and apparatus for adjusting the size of the list elements
CN102270081A (en) * 2010-06-03 2011-12-07 腾讯科技(深圳)有限公司 A method and apparatus for adjusting the size of the list elements
CN103069491A (en) * 2010-08-27 2013-04-24 三星电子株式会社 Method and apparatus for playing contents
CN103329075B (en) * 2011-01-06 2017-12-26 TiVo解决方案有限公司 A method for controlling a gesture-based device, and
CN103329075A (en) * 2011-01-06 2013-09-25 Tivo有限公司 Method and apparatus for gesture based controls
CN102799299B (en) * 2011-05-27 2015-11-25 华硕电脑股份有限公司 Treatment with a touch screen computer systems and gesture
CN102799299A (en) * 2011-05-27 2012-11-28 华硕电脑股份有限公司 Computer system with touch screen and processing method for gestures of computer system
CN102243662A (en) * 2011-07-27 2011-11-16 北京风灵创景科技有限公司 Method for displaying browser interface on mobile equipment
CN102243573A (en) * 2011-07-27 2011-11-16 北京风灵创景科技有限公司 Method and device for managing element attribute in application program
CN103733163A (en) * 2011-08-05 2014-04-16 三星电子株式会社 Electronic apparatus using motion recognition and method for controlling electronic apparatus thereof
US9733895B2 (en) 2011-08-05 2017-08-15 Samsung Electronics Co., Ltd. Method for controlling electronic apparatus based on voice recognition and motion recognition, and electronic apparatus applying the same
CN103376945A (en) * 2012-04-13 2013-10-30 佳能株式会社 Information processing apparatus and method for controlling the same
US9195381B2 (en) 2012-04-13 2015-11-24 Canon Kabushiki Kaisha Information processing apparatus, method for controlling the same, and storage medium to receive a touch operation for rotating a displayed image
CN103376945B (en) * 2012-04-13 2016-08-03 佳能株式会社 The information processing apparatus and a control method
CN102750096A (en) * 2012-06-15 2012-10-24 深圳乐投卡尔科技有限公司 Vehicle-mounted Android platform multi-point gesture control method
US9582122B2 (en) 2012-11-12 2017-02-28 Microsoft Technology Licensing, Llc Touch-sensitive bezel techniques
CN104035696A (en) * 2013-03-04 2014-09-10 观致汽车有限公司 Display method and device of vehicle-mounted message center on touch display interface
CN104035696B (en) * 2013-03-04 2017-12-19 观致汽车有限公司 Onboard display method and message center apparatus interface displayed on the touch
US10180728B2 (en) 2013-05-17 2019-01-15 Citrix Systems, Inc. Remoting or localizing touch gestures at a virtualization client agent
CN105378634B (en) * 2013-05-17 2019-03-29 思杰系统有限公司 Long-range or localization virtualization client Agency touch gestures
CN105378634A (en) * 2013-05-17 2016-03-02 思杰系统有限公司 Remoting or localizing touch gestures at a virtualization client agent
US9946383B2 (en) 2014-03-14 2018-04-17 Microsoft Technology Licensing, Llc Conductive trace routing for display and bezel sensors
US9477337B2 (en) 2014-03-14 2016-10-25 Microsoft Technology Licensing, Llc Conductive trace routing for display and bezel sensors

Also Published As

Publication number Publication date
CN101611373B (en) 2014-01-29
DE202007014957U1 (en) 2007-12-27
CN101611373A (en) 2009-12-23

Similar Documents

Publication Publication Date Title
Ramos et al. Zliding: fluid zooming and sliding for high precision parameter manipulation
US10101887B2 (en) Device, method, and graphical user interface for navigating user interface hierarchies
US8681104B2 (en) Pinch-throw and translation gestures
KR101806350B1 (en) Device, method, and graphical user interface for selecting user interface objects
US8736561B2 (en) Device, method, and graphical user interface with content display modes and display rotation heuristics
US9612741B2 (en) Device, method, and graphical user interface for displaying additional information in response to a user contact
US7256770B2 (en) Method for displaying information responsive to sensing a physical presence proximate to a computer input device
CN102460367B (en) Touch directional remote control
US8438500B2 (en) Device, method, and graphical user interface for manipulation of user interface objects with activation regions
US8438504B2 (en) Device, method, and graphical user interface for navigating through multiple viewing areas
KR101470088B1 (en) Device, method, and graphical user interface for configuring restricted interaction with a user interface
EP2539801B1 (en) Multi-screen dual tap gesture
US9513799B2 (en) Devices, methods, and graphical user interfaces for providing control of a touch-based user interface absent physical touch capabilities
CN101410781B (en) Gesturing with a multipoint sensing device
US10416860B2 (en) Device, method, and graphical user interface for navigating through a user interface using a dynamic object selection indicator
US9436374B2 (en) Device, method, and graphical user interface for scrolling a multi-section document
US8539385B2 (en) Device, method, and graphical user interface for precise positioning of objects
US10140301B2 (en) Device, method, and graphical user interface for selecting and using sets of media player controls
US7877705B2 (en) System and methods for interacting with a control environment
US9477404B2 (en) Device, method, and graphical user interface for managing concurrently open software applications
CA2788137C (en) Off-screen gestures to create on-screen input
EP2539799B1 (en) Multi-screen pinch and expand gestures
CN104885050B (en) It is used to determine the scroll or selection of equipment, methods and graphical user interface
EP2539803B1 (en) Multi-screen hold and page-flip gesture
EP2539802B1 (en) Multi-screen hold and tap gesture

Legal Events

Date Code Title Description
C14 Grant of patent or utility model
CX01