CN102187647A - Systems and methods for mapping message contents to virtual physical properties for vibrotactile messaging - Google Patents

Systems and methods for mapping message contents to virtual physical properties for vibrotactile messaging Download PDF

Info

Publication number
CN102187647A
CN102187647A CN2009801279781A CN200980127978A CN102187647A CN 102187647 A CN102187647 A CN 102187647A CN 2009801279781 A CN2009801279781 A CN 2009801279781A CN 200980127978 A CN200980127978 A CN 200980127978A CN 102187647 A CN102187647 A CN 102187647A
Authority
CN
China
Prior art keywords
virtual
message
sensor
configured
message object
Prior art date
Application number
CN2009801279781A
Other languages
Chinese (zh)
Other versions
CN102187647B (en
Inventor
大卫·比恩鲍姆
克里斯托弗·J·乌尔里希
丹尼·格雷特
Original Assignee
伊梅森公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
Priority to US61/080,985 priority Critical
Priority to US61/080,981 priority
Priority to US8098708P priority
Priority to US8097808P priority
Priority to US8098108P priority
Priority to US8098508P priority
Priority to US61/080,987 priority
Priority to US61/080,978 priority
Priority to US14831209P priority
Priority to US61/148,312 priority
Priority to US18128009P priority
Priority to US61/181,280 priority
Application filed by 伊梅森公司 filed Critical 伊梅森公司
Priority to PCT/US2009/050564 priority patent/WO2010009145A1/en
Publication of CN102187647A publication Critical patent/CN102187647A/en
Application granted granted Critical
Publication of CN102187647B publication Critical patent/CN102187647B/en
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=41119917&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=CN102187647(A) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 – G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object or an image, setting a parameter value or selecting a range
    • G06F3/04842Selection of a displayed object
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object or an image, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object or an image, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for entering handwritten data, e.g. gestures, text
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the screen or tablet into independently controllable areas, e.g. virtual keyboards, menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B6/00Tactile signalling systems, e.g. personal calling systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers; Analogous equipment at exchanges
    • H04M1/72Substation extension arrangements; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selecting
    • H04M1/725Cordless telephones
    • H04M1/72519Portable communication terminals with improved user interface to control a main telephone operation mode or to indicate the communication status
    • H04M1/72522With means for supporting locally a plurality of applications to increase the functionality
    • H04M1/72544With means for supporting locally a plurality of applications to increase the functionality for supporting a game or graphical animation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers; Analogous equipment at exchanges
    • H04M1/72Substation extension arrangements; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selecting
    • H04M1/725Cordless telephones
    • H04M1/72519Portable communication terminals with improved user interface to control a main telephone operation mode or to indicate the communication status
    • H04M1/72522With means for supporting locally a plurality of applications to increase the functionality
    • H04M1/72547With means for supporting locally a plurality of applications to increase the functionality with interactive input/output means for internally managing multimedia messages
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers; Analogous equipment at exchanges
    • H04M1/72Substation extension arrangements; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selecting
    • H04M1/725Cordless telephones
    • H04M1/72519Portable communication terminals with improved user interface to control a main telephone operation mode or to indicate the communication status
    • H04M1/72563Portable communication terminals with improved user interface to control a main telephone operation mode or to indicate the communication status with means for adapting by the user the functionality or the communication capability of the terminal under specific circumstances
    • H04M1/72572Portable communication terminals with improved user interface to control a main telephone operation mode or to indicate the communication status with means for adapting by the user the functionality or the communication capability of the terminal under specific circumstances according to a geographic location
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M19/00Current supply arrangements for telephone systems
    • H04M19/02Current supply arrangements for telephone systems providing ringing current or supervisory tones, e.g. dialling tone, busy tone
    • H04M19/04Current supply arrangements for telephone systems providing ringing current or supervisory tones, e.g. dialling tone, busy tone ringing-current generated at substation
    • H04M19/047Vibrating means for incoming calls
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/20Services signaling; Auxiliary data signalling, i.e. transmitting data via a non-traffic channel
    • H04W4/21Services signaling; Auxiliary data signalling, i.e. transmitting data via a non-traffic channel for social networking applications
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/163Indexing scheme relating to constructional details of the computer
    • G06F2200/1637Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/014Force feedback applied to GUI
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/041012.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04104Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04106Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04808Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/12Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion

Abstract

Systems and methods for mapping message contents to virtual physical properties for vibrotactile messaging are disclosed. For example, one disclosed method includes the steps of receiving a sensor signal from a sensor, the sensor configured to detect an interaction with a messaging device, determining a virtual physical property of a virtual message object based at least in part on the sensor signal, determining a haptic effect based at least in part on the virtual physical parameter; and generating a haptic signal configured to cause an actuator to output the haptic effect.

Description

用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的系统和方法 For mapping virtual to physical properties of the contents of the message to a system and method for message transmission vibrotactile

[0001] 相关申请的交叉引用 CROSS [0001] REFERENCE TO RELATED APPLICATIONS

[0002] 本专利申请要求以下的优先权:2008年7月15日提交的题为“Systems and Methods for Physics-Based Tactile Messaging” 的美国临时专利申请No. 61/080,978 ; 2008 年7 月15 日提交的题为"Systems and Methods for Mapping Message Contents to Virtual Physical Properties for Vibrotactile Messaging,,的美国临时专利申请No. 61/080,981 ;2008 年7 月15 日提交的题为“Systems and Methods for Shifting Sensor Haptic Feedback Function Between Passive and Active Modes,,的美国临时专利申请No. 61/080,985 ;2008 年7 月15 日提交的题为“Systems and Methods for Gesture Indication of Message Recipients” 的美国临时专利申请No. 61/080,987 ;2009 年1 月29 日提交的题为"Systems and Methods for Pseudo-Telepresence in a Shared Space,, 的美国临时专利申请No. 61/148,312 ;以及2009年5月沈日提交的题为Systems and Methods for Transmitting Haptic Messages“的美国临时专利申请No. 61/181, [0002] This application claims priority to the following: 2008, entitled, filed July 15 "Systems and Methods for Physics-Based Tactile Messaging" of US Provisional Patent Application No. 61 / 080,978; July 2008 filed 15 May entitled "US provisional Patent Systems and Methods for Mapping Message Contents to Virtual Physical Properties for vibrotactile Messaging ,, application No. 61 / 080,981; 2008, entitled, filed July 15" Systems and Methods for Shifting US provisional Patent Sensor Haptic Feedback Function Between Passive and Active Modes ,, application No. 61 / 080,985; 2008, entitled, filed July 15 "Systems and Methods for Gesture Indication of Message Recipients" of US provisional Patent application No. 61 / 080,987; entitled January 29, 2009 filed "Systems and Methods for Pseudo-Telepresence in a Shared Space ,, US provisional Patent application No. 61 / 148,312; and in May 2009 Shen filed entitled Systems and Methods for Transmitting Haptic Messages "of US provisional Patent application No. 61/181, 0,其全部内容通过弓I用的方式被结合到本文中。 0, the entire contents of a mode I bow is incorporated herein.

技术领域 FIELD

[0003] 本发明一般地涉及消息发送(messaging),并且更具体地涉及用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的系统和方法。 [0003] The present invention relates generally to messaging (messaging), and more particularly relates to message content for mapping virtual to physical properties of a system and method vibrotactile message transmission.

背景技术 Background technique

[0004] 通过消息接收者的消息发送设备上的设定来确定消息发送系统中的常规触觉反馈,其可以使不同类型的消息与特定振动相关联。 [0004] The conventional haptic feedback message to determine the transmission system by setting the message sending device on the recipient of the message, which allows different types of messages associated with a specific vibration. 这些振动可以是一般的,和/或基于消息发送设备所包括的振动效果的预封装库。 These vibrations may be general, and / or based on the vibration effect of the message transmitting device comprises a pre-packaged library. 此类振动不是由用户创作的,并且因此其对于消息的发送者或接收者来说可能未被视为是个人的。 Such vibration is not created by the user, and therefore for the sender or receiver of a message, it may not be regarded as personal. 此外,此类振动不是由消息内容的性质生成。 Moreover, such vibration is not generated by the nature of the message content. 因此,需要用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的系统和方法。 Therefore, for mapping virtual to physical properties of the contents of the message to a system and method vibrotactile message transmission.

发明内容 SUMMARY

[0005] 本发明的实施例提供用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的系统和方法。 Example [0005] The present invention provides for mapping virtual to physical properties of the contents of the message to a system and method vibrotactile message transmission. 例如,在一个实施例中,一种用于基于物理的触觉消息发送的方法包括:从被配置成感测与消息发送设备的交互的传感器接收传感器信号;至少部分地基于该传感器信号来确定虚拟消息对象的虚拟物理参数;至少部分地基于该虚拟物理参数来确定触觉效果,以及生成被配置成使得致动器输出触觉效果的触觉信号。 For example, in one embodiment, a physically based approach for haptic message transmission comprises: receiving a sensor signal from the sensor is configured to sense the interaction message sending device; at least in part on the sensor signal to determine which virtual physical parameters of the virtual message object; at least partially based on the physical parameters of the virtual determine a haptic effect, and generate a haptic signal is configured such that the actuator to output a haptic effect. 在另一实施例中,一种计算机可读介质包括用于执行此类方法的程序代码。 In another embodiment, a computer-readable medium comprising program code for performing such a method.

[0006] 提及这些说明性实施例并不是为了限制或限定本发明,而是提供示例以帮助对其的理解。 [0006] These illustrative embodiments mentioned are not intended to limit or define the invention, but to provide examples to aid understanding thereof. 在具体实施方式中讨论了说明性实施例,并且在那里提供了本发明的进一步描述。 In a specific embodiment discussed illustrative embodiments, and further description of the invention provided there. 可以通过研究本说明书来进一步理解由本发明的各种实施例提供的优点。 It can be further appreciated that the advantages provided by various embodiments of the present invention is implemented by examining this specification.

附图说明 BRIEF DESCRIPTION

[0007] 当参考附图来阅读以下具体实施方式时,将更好地理解本发明的这些及其它特征、方面、和优点,在附图中: [0007] When read the following detailed description with reference to the accompanying drawings, will be better understood and other features of the present invention, aspects, and advantages of the drawings in which:

[0008] 图1是根据本发明的一个实施例的用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的系统的框图; [0008] FIG. 1 is used to map the virtual to physical properties of the contents of the message to the system block diagram of a vibrotactile message sent in accordance with one embodiment of the present invention;

[0009] 图2是根据本发明的一个实施例的用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的系统的图示; [0009] FIG 2 is a message content for mapping virtual to physical properties for vibrotactile illustration of a system message transmitted in accordance with one embodiment of the present invention;

[0010] 图3是根据本发明的一个实施例的用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的系统的图示; [0010] FIG. 3 is used to map the virtual to physical properties of the message content diagram of a system for vibrotactile message transmitted in accordance with one embodiment of the present invention;

[0011] 图4是根据本发明的一个实施例的用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的方法的流程图; [0011] FIG. 4 is a message content for mapping virtual to physical properties flowchart of a method for vibrotactile message transmitted in accordance with one embodiment of the present invention;

[0012] 图5是根据本发明的一个实施例的用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的方法的流程图; [0012] FIG. 5 is a message content for mapping virtual to physical properties flowchart of a method for vibrotactile message transmitted in accordance with one embodiment of the present invention;

[0013] 图6是根据本发明的一个实施例的用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的系统的图示;以及 [0013] FIG. 6 is an illustration of a system for vibrotactile message transmitted according to an embodiment of the present invention for mapping virtual to physical properties of the contents of the message; and

[0014] 图7是根据本发明的一个实施例的用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的系统的图示。 [0014] FIG. 7 is used to map the virtual to physical properties of the message content diagram of a system for vibrotactile message transmitted in accordance with one embodiment of the present invention.

具体实施方式 Detailed ways

[0015] 本发明的实施例提供用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的系统和方法。 Example [0015] The present invention provides for mapping virtual to physical properties of the contents of the message to a system and method vibrotactile message transmission.

[0016] 振动触觉消息发送的说明性实施例 Illustrative [0016] vibrotactile message transmitted Example

[0017] 在本发明的一个说明性实施例中,诸如移动电话的一种消息发送设备包括与传感器和致动器通信的处理器。 [0017] In one illustrative embodiment of the present invention, such as a mobile telephone message transmitting device comprising a sensor and a processor in communication with the actuator. 所述致动器被配置成生成触觉效果。 The actuator is configured to generate a haptic effect. 在一个此类说明性实施例中,所述消息发送设备包括装配有Immersion公司的VibeTonz ®振动触觉反馈系统的SamsungSGH-i710移动计算机。 In one such illustrative embodiment, the message transmitting apparatus comprises SamsungSGH-i710 equipped with a mobile computer Immersion Corp. VibeTonz ® vibrotactile feedback system. 在另一实施例中,所述消息发送设备包括也称为Immersion TouchSense ®振动触觉反馈系统的Immersion公司TouchSense ®技术系统。 In another embodiment, the message transmitting device comprises also referred Immersion TouchSense ® vibrotactile feedback system Immersion Corporation TouchSense ® technology systems. 可以利用其它消息发送设备和触觉反馈系统。 Other devices may be utilized and tactile feedback message transmission systems.

[0018] 该消息发送设备能够产生表示为虚拟消息对象的消息并将其与其它消息发送设备交换。 [0018] The message transmission apparatus capable of generating a virtual message object is represented as a message and send it to other devices to exchange messages. 采取球、管、或蛋的形式的虚拟消息对象可以表示各种类型的消息,诸如非言语消息(例如,微笑)、文本消息、或具有文件附件的消息。 Take ball, tube, or in the form of egg virtual message object may represent various types of messages, such as a non-verbal message message (e.g., smile), a text message, or an attachment file. 除其形状和外观之外,虚拟消息对象可以具有其它性质或虚拟物理参数,诸如大小、质量、碰撞行为、和/或纹理。 In addition to its shape and appearance, the virtual message object may have other properties or virtual physical parameters, such as size, quality, impact behavior, and / or texture.

[0019] 当产生了新的虚拟消息对象时,用户可以通过在触摸屏或设备本身上的姿势来定义对象的一个或多个虚拟参数。 [0019] when a new virtual message object, the user may define one or more virtual objects by parameters gesture on the touch screen or the device itself. 处理器可以以传感器信号的形式接收此类姿势,并至少部分地基于传感器信号来确定新虚拟消息对象的虚拟物理参数。 The processor may be received in the form of such a posture sensor signal, and at least partially determining a physical parameter of the virtual message object based on the new virtual sensor signal. 例如,用户可以产生新的虚拟消息球。 For example, users can create new virtual message ball. 接下来,用户摇动消息发送设备以定义新虚拟消息球的弹性。 Next, the user shakes the device to send a message to define a new virtual news elastic ball. 诸如加速度计或陀螺仪的传感器检测该摇动作为加速度、倾斜度、惯性、或位置的变化并传送传感器信号。 Such as an accelerometer or a sensor for detecting the change of the count of the rocking gyroscope as acceleration, tilt, inertial, or position sensor signal and transmitted. 该处理器接收传感器信号,并确定新虚拟消息对象的虚拟物理参数,诸如弹性表面或行为,模仿真实橡皮球。 The processor receives the sensor signals and determining a virtual physical parameters of the new virtual message object, such as a surface or an elastic behavior, imitate the real rubber ball.

[0020] 在至少部分地基于传感器信号来确定新的虚拟消息对象的虚拟物理参数之后,处理器至少部分地基于虚拟物理参数来确定触觉效果。 After [0020] to determine the new virtual physical parameters of the virtual message object based at least in part, a sensor signal, the processor determines at least in part based on the physical parameters of the virtual haptic effect. 基于快速戳动运动,处理器可以确定新的虚拟消息对象是脆性或易碎的。 Fast poke up movement, the processor may determine a new virtual message object is brittle or fragile. 基于脆性或易碎虚拟物理参数的触觉效果可以包括模仿蛋碎裂或窗户破裂的振动。 Based brittle or frangible virtual physical parameter haptic effect may include a vibration imitation egg chipping or cracking of the window. 如果将虚拟消息对象定义为小的和弹性的,则相应的触觉效果可以模仿橡皮球从墙壁弹回。 If the virtual message object is defined as a small and flexible, the corresponding haptic effect may mimic the rubber ball bouncing off the wall. 处理器可以将虚拟物理性质中的一个、一些、或全部映射或转换成与虚拟消息对象相关联的触觉效果。 The processor may be a virtual physical properties of some or all of the mapped or converted to a haptic effect associated with the virtual message object.

[0021] 最后,处理器生成被配置成使得致动器输出触觉效应的触觉信号。 [0021] Finally, the processor generates a haptic signal is configured such that the actuator to output the haptic effect. 然后,触觉信号被输出到产生触觉效果的致动器。 Then, the haptic signal is output to generate a haptic effect actuator. 例如,在通过触摸屏来接触虚拟消息对象时,消息发送设备可以振动或摇动,模拟触摸或感觉虚拟消息对象的效果。 For example, when a virtual message object via the contact to the touch screen, a message transmission device may vibrate or shake, simulate the effect of a touch or feeling of the virtual message object. 通过生成触觉反馈,消息发送设备能够传送与虚拟消息相关联的一个或多个虚拟物理参数。 By generating haptic feedback, send a message with a virtual device to transmit one or more messages associated with the virtual physical parameters.

[0022] 给出本说明性示例是为了向读者介绍本文所讨论的一般主题。 [0022] The present illustrative example is given to introduce the general subject matter discussed herein to the reader. 本发明不限于本示例。 The present invention is not limited to this example. 以下小节描述用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的方法和系统的各种附加实施例和示例。 The following sections describe the contents of the message for mapping virtual to physical properties for various additional embodiments and examples of the methods and systems of the vibrotactile message.

[0023] 将消息内容映射到虚拟物理性质 [0023] The message content is mapped to the virtual physical properties

[0024] 本文呈现的本发明的实施例提供了用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的系统和方法。 [0024] Embodiments of the invention presented herein provides for mapping virtual to physical properties of the contents of the message to a system and method vibrotactile message transmission. 用于映射消息内容的应用可以将传感器数据当作输入, 从传感器数据提取特征,将该特征映射到虚拟物理参数,并基于该虚拟物理参数来合成触觉效果。 Application of the message content may be used to map the sensor data as input, extracts features from the sensor data, map the virtual to physical characteristic parameter, and based on the synthesized virtual physical parameter haptic effect. 将消息内容映射到虚拟物理性质能够促进通过音频、视觉、和触觉反馈进行的模拟物理象征(metaphor)的非语言通信。 The contents of the message can be mapped to a virtual physical properties of the non-verbal communications facilitate simulation performed by a physical symbol of audio, visual, and tactile feedback (Metaphor) a.

[0025] 虚拟消息对象和虚拟物理性质 [0025] The virtual message object and the virtual physical properties

[0026] 在物理象征中,虚拟对象可以表现得像真实的物理对象。 [0026] In the physical symbol of the virtual objects can behave like real physical object. 每个虚拟对象的性质或虚拟物理参数告知每个虚拟消息对象如何表现。 Nature or virtual physical parameters of each virtual object inform each virtual message object how to behave. 因此,在消息发送系统的物理象征中,可以将诸如文本消息、语音邮件、或文件附件的消息表示为具有虚拟物理参数的虚拟消息对象。 Thus, the physical symbol messaging system, such as a text message may be a message, voice mail, or file attachment is represented as a virtual message object with a virtual physical parameters. 此类虚拟消息对象可以填充多维消息收件箱、或虚拟消息环境。 Such virtual message object can be filled with a multi-dimensional message inbox, messages or virtual environment. 在虚拟消息环境内部,虚拟消息对象可以彼此相交互并表现得像真实的物理对象。 Inside the virtual message environment, the virtual message object can interact with each other and behave like real physical object.

[0027] 每个虚拟消息对象可以表示单独的消息,诸如文本消息、图片消息、视频消息、语音邮件、提醒、或诸如笑脸或皱眉的非言语消息。 [0027] Each virtual message object may represent a separate message, such as text messages, picture messages, video messages, voice mail, reminders, such as a smiley face or a frown or non-verbal messages. 例如,采取管或卷起的卷轴形式的虚拟消息对象可以表示文本消息。 For example, take the form of a tube or rolled scroll a virtual message object may represent a text message. 并且,采取蛋或囊状物(capsule)形式的虚拟消息对象可以表示具有附件的消息,诸如视频、图片、或音乐文件。 And, taking eggs or bladder (capsule) in the form of a virtual message object may represent a message with an attachment, such as videos, pictures, or music files. 虚拟消息对象还可以表示各种形式的非言语通信,诸如姿势、面部表情、或情绪。 Virtual message object may also represent various forms of non-verbal communication, such as gestures, facial expressions or emotions. 虚拟消息球可以对应于诸如嬉闹的指示的非言语消息。 Virtual message may correspond to the ball such as an indication of non-verbal message playfulness. 或者,虚拟消息箭头可以表示戳刺或戳动姿势(即以请求或要求注意)。 Alternatively, an arrow may indicate the virtual message or stabbing movable stamp posture (i.e., to request or require attention). 一些有效的虚拟消息对象可以具有可容易地识别的视觉和/或触觉性质和/或效果。 Some valid virtual message object may have easily recognizable visual and / or haptic properties and / or effects. 这些性质帮助用户在实际上不看设备的情况下直观地理解消息的内容。 These properties help the user intuitively understand the content of the message without actually look at the device. 例如,采取打字机形式的虚拟消息对象的叮当作响的键可以表示来自工作或文字处理文件的消息。 For example, jingling take the form of virtual typewriter key message object may represent a message from work or word processing files.

[0028] 在虚拟消息环境内部,虚拟消息对象可以诸如通过通过弹回、滚动、乃至破裂与彼此以及环境相交互。 [0028] In the internal virtual messaging environments, such as virtual message object may pass through the bounce, roll, and even rupture interact with each other and the environment. 虚拟消息对象的行为或其如何交互至少部分地基于每个虚拟消息对象的性质或虚拟物理参数。 Behavior of the virtual message object or how to interact at least partially physical property or parameter of each virtual virtual message object based. 诸如大小、质量、形状、碰撞行为、纹理、或视觉表示的一些虚拟物理参数是相对静态的参数,或者是虚拟消息对象本身的固有性质。 Some virtual physical parameters such as size, mass, shape, impact behavior, texture, or the visual representation is relatively static parameters, or the inherent properties of the virtual message object itself. 诸如紧急性、使用期、和/或姿态的其它虚拟物理参数可以是短暂或暂时的参数。 Such as urgency, lifetime, and other virtual physical parameter / or posture may be transient or temporary parameters. 可以使此类可变虚拟物理参数与如何从一个设备到另一设备发送或接收虚拟消息对象相关联。 Such variable allows virtual physical parameters and how to receive from the virtual message object associated with a device to another device or transmitting. 虚拟消息对象的虚拟物理参数可以至少部分地基于消息本身的性质。 Virtual physical parameters of the virtual message object may be at least in part, on the nature of the message itself. 例如,消息附件的文件大小、文本消息的长度、图片附件的面积或分辨率、歌曲附件的长度、或视频附件的长度可以用于确定虚拟消息对象的大小或质量。 For example, the length of a message attachment file size or resolution, the length of the text messages, pictures, accessories, accessories length song, or video attachment can be used to determine the size or quality of the virtual message object.

[0029] 在一些实施例中,基于在用户与消息发送设备相交互时生成的传感器信号来确定虚拟物理参数。 [0029] In some embodiments, based on the sensor signal generated when the user interacts with the device transmitting the message to determine the virtual physical parameters. 例如,用户可以移动设备或与设备相交互以产生和/或定义新的虚拟消息对象。 For example, a mobile device or a user can interact with the device to generate and / or define new virtual message object. 在一个实施例中,用户在麦克风上吹气以使新的虚拟消息气球充气。 In one embodiment, the user blowing on the microphone so that the new virtual message balloon is inflated. 该虚拟消息气球的虚拟物理尺寸可以直接与用户在麦克风上吹气的时间长度相关联。 Virtual physical dimensions of the balloon may be virtual message to the user blowing directly on the length of time associated with the microphone. 在另一实施例中, 具有可视电话的用户可以通过拍摄图片来定义新的虚拟消息对象。 In another embodiment, a user having a videophone can define new virtual message object by capturing images. 例如,在拍摄篮球的图片之后,消息发送设备被指配从图片的性质提取的或至少部分地基于图片的性质的性质, 诸如大小、纹理、或外观。 For example, after photographing basketball image, message sending device is assigned is extracted from the nature of the image, or at least in part, on the nature of the nature of the image, such as size, texture, or appearance.

[0030] 虚拟消息环境还实现用于其内容的标志物(token)象征。 (Token) symbol [0030] virtual message environment also achieved for its contents markers. 在标志物象征中,在设备之间来回传递虚拟对象,模仿明确物理对象的交换。 In symbolic markers, passing a virtual object back and forth between devices that mimic a clear physical object exchange. 可以将诸如虚拟消息对象的标志物从一个消息发送设备传递至另一个。 The virtual message object may pass, such as from a marker message to another device. 当一个消息发送设备向另一消息发送设备发送虚拟消息对象时,虚拟消息对象从发送消息的设备消失,如同其实际上被传递至接收消息的设备一样。 When a message transmitting device transmits the virtual message object is sent a message to another device, the virtual message object from a message sent by the disappearance, as it is actually transmitted to the receiving apparatus as a message.

[0031] 当消息发送设备接收到新的虚拟消息对象时,消息发送设备可以输出诸如触觉效果的效果,以表示新的虚拟消息对象已经被接收到,并且处于虚拟消息环境中。 [0031] When a device receives a message is sent to the new virtual message object, the message transmission device may output a haptic effect such as effect to represent a new virtual message object has been received, and in the virtual message environment. 例如,当接收到虚拟消息球时,可以播放声音和触觉效果以模仿反弹球,向用户表示已经接收到新的虚拟消息球。 For example, when receiving the virtual message ball, you can play a sound and tactile effects to mimic the bouncing ball, a user said that it has received a new virtual message ball.

[0032] 可以至少部分地基于虚拟消息对象的一个或多个虚拟消息性质来确定与虚拟消息对象相关联的音频、视觉、和/或触觉效果。 [0032] at least in part to determine the audio object associated with the virtual message, visual, and / or a haptic effect based on one or more virtual message object virtual message properties. 薄的蛋壳状虚拟消息对象可以在与虚拟消息环境撞击时碎裂或破裂。 Thin eggshell virtual message object may be cracked or broken upon impact with the virtual message environment. 替代地,玩具球或乒乓球可以连续地从虚拟消息环境的边界弹回。 Alternatively, toys or table tennis balls can bounce back from the border continuously virtual message environment. 可以使采取气泡形式的虚拟消息对象与短暂的尖锐的触觉效果相关联,指示气泡爆裂。 You can take the form of bubbles virtual message object associated with a short sharp haptic effect, indicating the bubble burst.

[0033] 用于将消息内容映射到虚拟物理性质的说明性系统 [0033] The message content is used to map the virtual to physical properties of the illustrative system

[0034] 现在参考附图,其中相同的附图标记遍及多个图指示相同的元件,图1是根据本发明的一个实施例的用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的系统的框图。 [0034] Referring now to the drawings, wherein like reference numerals throughout the several views indicate identical elements, FIG. 1 is an embodiment of the message content to be mapped virtual physical properties for vibrotactile message in accordance with the present invention a transmission the block diagram of the system. 如图1所示,系统100包括消息发送设备102,诸如移动电话、便携式数字助理(PDA)、便携式媒体播放器、或便携式游戏设备。 1, system 100 comprises a messaging device 102, such as a mobile phone, a portable digital assistant (PDA), a portable media player as shown, or portable gaming device. 消息发送设备102包括处理器110。 Message sending device 102 includes a processor 110. 处理器110与网络连接112、传感器114、显示器116、致动器118、和扬声器120通信。 The processor 110 is connected to network 112, a sensor 114, a display 116, an actuator 118, a speaker 120, and communication. 消息发送设备102可以示出由处理器110在显示器116上生成的虚拟消息环境。 Message sending apparatus 102 may be shown on the display 116 generated by the processor 110 the virtual message environment.

[0035] 处理器110与网络连接112通信。 [0035] The processor 110 and 112 connected to the communication network. 网络连接112可以包括一个或多个移动通信方法,诸如红外线、无线电、Wi-Fi、或蜂窝式网络通信。 Network connection 112 may be, such as infrared, radio, Wi-Fi, or cellular communications network comprising one or more mobile communication methods. 在其它变体中,网络连接112包括有线网络连接,诸如以太网连接或调制解调器。 In other variations, the network connection 112 includes a wired network connection, such as a modem or an Ethernet connection. 消息发送设备102可以被配置成在诸如蜂窝式网络或因特网的网络上与其它消息发送设备(未示出)交换消息,诸如语音消息、文本消息、数据消息、或虚拟消息对象。 Message sending device 102 may be configured in such as a cellular network or the Internet exchange messages with other messaging devices (not shown), such as a voice message, a text message, data message, or virtual message objects.

[0036] 处理器110还与一个或多个传感器114通信。 [0036] The processor 110 with one or more further sensors 114 communicate. 传感器114可以包括加速度计、陀螺仪、GPS传感器、触摸敏感输入设备(例如触摸屏、触摸板)、纹理触控笔、成像传感器、或某种其它类型的传感器。 Sensor 114 may include an accelerometer, a gyro, GPS sensor, a touch-sensitive input device (e.g., a touch screen, a touch pad), texture stylus, an imaging sensor, or some other type of sensor. 一个或多个传感器114可以被配置成检测加速度、倾斜度、惯性、 或位置的变化。 One or more sensors 114 may be configured to detect acceleration, tilt, inertial, or change in position. 例如,消息发送设备102可以包括被配置成测量消息发送设备102的加速度的加速度计。 For example, the messaging device 102 may comprise an accelerometer configured to measure the acceleration of the messaging device 102. 或者,消息发送设备102可以包括位置传感器、旋转速度传感器、光传感器、 压力传感器、纹理传感器、照相机、麦克风、或其它类型的传感器。 Alternatively, the messaging device 102 may comprise a position sensor, a rotation speed sensor, a light sensor, a pressure sensor, a texture sensor, a camera, a microphone, or other types of sensors. 在所示的实施例中,一个或多个传感器114被配置成向处理器110发送传感器信号。 In the illustrated embodiment, the one or more sensors 114 are configured to transmit a sensor signal to the processor 110. 处理器110可以被配置成从一个或多个传感器114接收传感器信号。 The processor 110 may be configured to receive sensor signals from one or more sensors 114.

[0037] 在本发明的一些实施例中,用户通过交互来记录虚拟消息对象的虚拟物理参数, 诸如移动或姿势。 [0037] In some embodiments of the present invention, the user to record physical parameters of the virtual virtual message object through the interaction, such as a mobile or gesture. 由一个或多个传感器114来检测这些物理交互。 By one or more sensors 114 to detect these physical interactions. 随着消息发送设备102 被倾斜、摇动、或以其它方式移动,一个或多个传感器114可以检测这些移动并至少部分地基于消息发送设备102的移动来生成传感器信号。 As the messaging device 102 is tilted, shaken, or otherwise moved, the one or more sensors 114 may detect the moving part and the mobile device 102 transmits a message generated based on at least the sensor signal. 在一个实施例中,加速度计传感器被配置成检测消息发送设备102的倾斜度和加速度。 In one embodiment, an accelerometer sensor configured to detect inclination of the message sending device 102 and the acceleration. 随着消息发送设备102被倾斜,加速度计可以被配置成至少部分地基于消息发送设备102的倾斜和/或加速度来向处理器发送信号。 As the messaging device 102 is tilted, the accelerometer may be configured to partially transmit a signal to the processor at least based on the inclination and / or acceleration of the messaging device 102. 在另一个实施例中,显示器116包括被配置成检测姿势或位置输入的触摸屏。 In yet another embodiment, display 116 is configured to detect the posture including a position input, or a touch screen. 随着手指位于触摸屏显示器116上或在触摸屏显示器116上拖动,触摸屏被配置成至少部分地基于手指的移动向处理器110发送信号。 With the finger on the touch screen display 116 or drag on the touch screen display 116, a touch screen configured to at least partially based on the movement of the finger 110 sends a signal to the processor.

[0038] 在接收到传感器信号时,处理器110可以被配置成至少部分地基于传感器信号来确定虚拟消息对象的虚拟物理参数。 [0038] Upon receiving the sensor signal, the processor 110 may be configured to determine the physical parameter of the at least virtual message object based on the virtual sensor signal part. 可以基于从传感器提取的诸如色彩、纹理、或速度的特征来确定各种物理参数。 Various physical parameters may be determined based on features extracted from the sensors such as color, texture, or speed. 在确定虚拟物理参数之后,处理器110可以被配置成至少部分地基于虚拟物理参数来确定触觉效果。 After determining the virtual physical parameters, the processor 110 may be configured to at least partially determine a haptic effect based virtual physical parameters. 该触觉效果可以通过振动或硬的不规则摇晃来模拟纹理粗糙的虚拟消息。 Shaking the haptic effect may be simulated virtual message coarse-grained hard or irregular vibration.

[0039] 在一个实施例中,用户从菜单中选择新的虚拟消息蛋。 [0039] In one embodiment, the user selects a new virtual message egg from the menu. 接下来,用户可以以大的圆圈或椭圆形移动消息发送设备102,以指示虚拟消息蛋的大小。 Next, the user may move a large circle or oval messaging device 102, the message to indicate the size of the virtual egg. 在基于消息发送设备102的大的移动来确定虚拟消息蛋的大尺寸之后,处理器110可以确定诸如通过许多振动来模拟大的蛋碎裂的触觉效果。 After determining the large size of the virtual message egg large movement based on the message sending device 102, the processor 110 may determine as to simulate large eggs broken by a number of vibration haptic effects.

[0040] 如图1所示,处理器110与显示器116通信。 , 116 Communication [0040] 1 and the display processor 110. 处理器110可以被配置成生成将在显示器116上显示的虚拟消息环境的图形表示。 Graphics processor 110 may be configured to generate on the display a virtual message environment 116 of FIG. 显示器116可以包括触摸敏感输入设备, 诸如触摸屏,其被配置成发送和从处理器110接收信号。 Display 116 may include a touch-sensitive input device, such as a touch screen, which is configured to transmit and receive signals from the processor 110. 可以通过触摸屏来直接操纵在显示器116上显示的虚拟消息对象。 Messages can directly manipulate virtual objects displayed on the display 116 through the touch screen. 例如,触摸屏显示器上的二维手指姿势可以在虚拟消息环境内选择、触摸、感觉、拖动、或投掷虚拟消息对象。 For example, two-dimensional finger gestures on the touch screen display can be selected in the virtual message environment, touch, feel, dragging or throwing virtual message object.

[0041] 处理器110还与一个或多个致动器118通信。 [0041] The processor 110 is also in communication with one or more actuators 118. 处理器110可以向一个或多个致动器Iio传送与触觉效果相关联的触觉信号。 The processor 110 may signal one or more haptic actuators Iio haptic effect associated with the transfer to one. 致动器118接收与触觉效果相关联的触觉信号,并然后输出触觉效果。 The actuator 118 receives haptic effect associated with the haptic signal, and then output a haptic effect. 致动器118可以是例如电动机、电磁致动器、音圈、线性谐振致动器、压电致动器、形状记忆合金、电活性聚合物、螺线管、偏心旋转质量电动机(ERM)、或线性谐振致动器(LRA)。 The actuator 118 may be, for example, an electric motor, an electromagnetic actuator, a voice coil, a linear resonant actuator, a piezoelectric actuator, a shape memory alloy, an electroactive polymer, a solenoid, an eccentric rotating mass of the motor (the ERM), or a linear resonant actuators (LRA).

[0042] 最后,在所示的实施例中,处理器110与扬声器120通信。 [0042] Finally, in the embodiment shown, the communication processor 110 and the speaker 120. 处理器110可以被配置成至少部分地基于虚拟消息对象与虚拟消息环境之间的交互来确定声音效果,并且至少部分地基于该声音效果来向扬声器发送音频信号。 The processor 110 may be configured to at least partially determine the interaction between the sound and the virtual message object based on the virtual message environment, at least in part to send audio signals to the speaker based on the sound effect. 扬声器120可以被配置成至少部分地基于由处理器110生成的音频信号来生成声音效果。 Speaker 120 may be configured to at least partially based on the audio signal generated by the processor 110 generates sound effects. 可以与触觉效果同时协调或生成声音效果和触觉效果的输出。 Coordination can simultaneously generate an output sound effect or a haptic effect and a haptic effect. 在一个实施例中,扬声器可以与致动器生成触觉效果基本上同时地生成声音效果。 In one embodiment, the speaker may generate a haptic effect with the actuator substantially simultaneously generate sound effects.

[0043] 由处理器110生成的声音效果可以模拟虚拟消息对象与虚拟消息环境之间的交互,和/或第一虚拟消息对象与一个或多个其它虚拟消息对象之间的交互。 [0043] generated by the sound effect processor 110 can simulate the interaction between the interaction and / or a first virtual message objects between the virtual message object and the virtual message environment with one or more other virtual message object. 声音效果的示例包括球从墙壁弹回、箭以砰击声(thud)击中墙壁、或蛋碎裂。 Examples of sound effects includes a ball bouncing off the wall, the arrow to thuds (thud) hits a wall, or broken eggs. 例如,消息发送设备102可以从另一消息发送设备以水球的形式接收虚拟消息对象。 For example, messaging device 102 may send a message from another device receiving a virtual message object in the form of water polo. 在虚拟消息对象到达时,可以与模拟飞溅的振动同时地生成水球飞溅在墙壁上的声音效果。 When the virtual message object arrives, splashing may be generated on the balloon wall simultaneously with the sound vibration simulation splash.

[0044] 图2是根据本发明的一个实施例的用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的系统的图示。 [0044] FIG 2 is a message content for mapping virtual to physical properties for vibrotactile illustration of a system message transmitted in accordance with one embodiment of the present invention. 参考图1所描绘的系统来描述系统200的元件。 The system depicted in FIG. 1 with reference to elements of system 200 will be described. 多种其它实现是可能的。 A variety of other implementations are possible.

[0045] 如图2所示,系统200包括消息发送设备102,诸如移动电话、便携式数字助理(PDA)、便携式媒体播放器、或便携式游戏设备。 As shown in the system [0045] 2 102 200 comprises a message transmission device, such as a mobile phone, a portable digital assistant (PDA), a portable media player, or portable gaming device. 消息发送设备102可以被配置成在诸如蜂窝式网络或因特网的网络上发送和接收信号,诸如语音邮件、文本消息、及其它数据消息。 Message sending device 102 may be configured to transmit on a network such as a cellular network or the Internet and receiving signals, such as voice mail, text messaging, and other data messages. 消息发送设备102可以包括无线和/或有线网络连接112。 Message transmission device 102 may include wireless and / or wired network connection 112. 虽然设备102在图2中被图示为手持式消息发送设备,但其它实施例可以使用其它设备,诸如视频游戏系统、视频游戏控制器、个人媒体播放器、个人数字助理、和/或个人计算机以发送和接收虚拟消息对象。 While the device 102 in FIG. 2 is illustrated as a hand-held messaging device, but other embodiments may use other devices, such as a video game system, video game consoles, personal media players, personal digital assistants, and / or a personal computer to transmit and receive the virtual message object.

[0046] 如图2所示,消息发送设备102包括显示器116、按钮12加、122b、122c、122d、和轨迹球124。 [0046] 2, the message transmission device 102 includes a display 116, plus button 12, 122b, 122c, 122d, 124 and the trackball. 除按钮122a、122b、122c、122d、和轨迹球1¾之外,消息发送设备102可以包括定向板、触摸板、滚轮、摇杆开关、操纵杆、或其它形式的输入设备(图2中未示出)。 In addition to the button 122a, 122b, 122c, 122d, and trackball 1¾, messaging device 102 may include a guide plate, a touchpad, a jog wheel, a rocker switch, a joystick, or other form of input device (not shown in FIG. 2 out).

[0047] 移动设备102的显示器116可以包括诸如触摸屏的触摸敏感输入设备。 [0047] The display 116 of mobile device 102 may include a touch-sensitive input device such as a touch screen. 显示器116 可以被配置成从处理器110接收信号,并生成图形环境,诸如收件箱、浏览器、游戏环境、虚拟消息环境。 Display 116 may be configured to receive signals from the processor 110, and generates a graphical environment, such as the inbox, browser, games, virtual message environment. 显示器116还可以被配置成生成虚拟消息创作环境250。 Display 116 may also be configured to generate a virtual message authoring environment 250. 虚拟消息创作环境250可以包括用于选择要创作或产生的一种类型的虚拟消息对象的菜单252。 Menu virtual message object 252 is a type of virtual message authoring environment 250 may include for selecting creation or production. 如图2所示, 菜单252包括用于创作新虚拟消息球25½、新虚拟消息管254b、或新虚拟消息蛋25½的选项。 2, the menu 252 includes a 25½, a new virtual message tube 254b, or a new virtual message egg 25½ option to create new virtual message ball. 菜单252可以包括诸如心或水球(图2中未示出)的其它类型的虚拟消息对象。 Menu 252 may include a core such as a balloon or other type of virtual message object (not shown in FIG. 2) of the.

[0048] 虚拟消息创作环境250可以包括创作指示器256。 [0048] virtual message authoring environment 250 may include the creation of an indicator 256. 创作指示器256可以警告用户消息发送设备102处于创作或记录模式。 Creation indicator 256 may alert the user that the message sending device 102 is in recording mode or creation. 如图2所示,创作指示器256包括位于菜单252上的警告条,在虚拟消息创作环境250的顶部。 As shown, the creation of a warning indicator 2562 includes a strip 252 on the menu at the top 250 of the virtual message authoring environment. 虚拟消息创作环境可以被配置成在传感器正在记录或捕获与虚拟消息对象相关联的信息时显示创作指示器256。 Virtual message authoring environment may be configured to display the pointer 256 in the creation of sensor information being recorded or captured with the virtual message object is associated. 在一种情况下,当记录按钮122c被按下或激活时,进入记录模式,并且出现创作指示器256。 In one case, when the record button 122c is pressed or activated, entering the recording mode, and writing the pointer 256 appears. 当记录模式停止时, 创作指示器256可以淡化或消失。 When the recording mode is stopped, the creation indicator 256 may fade or disappear.

[0049] 当消息发送设备102处于记录模式时,一个或多个传感器114可以记录或捕获与虚拟物理参数相关联的信息,诸如姿势。 [0049] When the message transmitting device 102 is in recording mode, the one or more sensors 114 may record or capture information associated with the virtual physical parameter, such as a gesture. 一些姿势包括由触摸屏接收到的二维姿势。 Some gestures include received by the two-dimensional touch screen gesture. 二维姿势的示例包括指示方向(即位置输入)或绘画。 Examples include a two-dimensional gesture indicating a direction (i.e. input position), or painting. 其它姿势可以包括由加速度计、陀螺仪、 或某种其它传感器测量的三维姿势。 Other gestures may comprises an accelerometer, a gyroscope, or some other three-dimensional posture sensor measurements. 三维姿势可以包括旋转、轻弹、戳动、或以其它方式移动整个消息发送设备102。 Three-dimensional posture may include rotation, flick, poke moving, or moving the entire message sending device 102 in other manners. 一个或多个传感器114还可以诸如通过感测压力传感器上的压力、用照相机拍照、或用麦克风记录声音来记录其它非言语信息。 One or more sensors 114 may also be, such as by sensing the pressure on pressure sensor, photographed with a camera, a microphone or a voice recording to record other non-verbal information.

[0050] 虚拟消息创作环境250还可以包括新的虚拟消息对象管道258。 [0050] virtual message authoring environment 250 may also include a new virtual message object pipe 258. 随着产生一个或多个新的虚拟消息对象,其可以表现得如同其从新的虚拟消息对象管道258出来并进入虚拟消息创作环境250 —样。 With the emergence of one or more new virtual message object which may behave as if the virtual message object from a new conduit 258 and into the virtual message authoring environment 250-- like. 新的虚拟消息对象管道258可以加强虚拟消息对象的标志物象征。 The new virtual message object pipe 258 can enhance the virtual message object marker symbol. 例如,当产生新的虚拟消息且其从新的虚拟消息对象管道258显现时,消息发送设备102的用户可以直观地推断出新的虚拟消息对象表示可以在不同的消息发送设备之间来回传递的物理标志物。 For example, when a new virtual message and which message from the new virtual objects appear conduit 258, the user device 102 may send a message directly infer new virtual message object may represent a physical transfer back and forth between different messaging device landmark.

[0051] 图3是根据本发明的一个实施例的用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的系统的图示。 [0051] FIG. 3 is used to map the virtual to physical properties of the message content diagram of a system for vibrotactile message transmitted in accordance with one embodiment of the present invention. 如图3所示,系统300包括具有触摸屏显示器316、纹理传感器314、和轨迹球324的消息发送设备302。 3, system 300 includes a touch screen display 316, texture sensor 314, trackball 324 and the message transmission device 302.

[0052] 触摸屏显示器316正在显示虚拟消息创作环境350。 [0052] The touch screen display 316 is displaying a virtual message authoring environment 350. 如图3所示,虚拟消息创作环境350包括用于选择新的虚拟消息对象的类型的菜单352。 3, the virtual message authoring environment 350 includes means for selecting a new virtual message object 352 of the type of menu. 在菜单352中,用户可以选择新的虚拟消息球35½、新的虚拟消息管354b、或新的虚拟消息蛋35如。 In the menu 352, the user can select a new virtual message ball 35½, a new virtual message tube 354b, or a new virtual message 35 such as egg. 虽然菜单352图示了三种类型的虚拟消息对象,但是可以选择其它类型的虚拟消息对象(图3未示出)。 While menu 352 illustrate three types of virtual message object, but other types can be selected virtual message object (not shown in FIG. 3). 虚拟消息创作环境350还包括新的虚拟消息管道358。 Virtual message authoring environment 350 also includes new virtual message pipeline 358. 当选择了新的虚拟消息球35½时,可以显示离开新的虚拟消息管道358的新的虚拟消息球360。 When selecting a new virtual message ball 35½, you may display a message to leave the new virtual pipe 358 new virtual ball 360 message.

[0053] 在诸如新虚拟消息球360的新虚拟消息对象的创作期间,虚拟消息创作环境350 可以显示滑动条362。 [0053] During the creation of new virtual message ball new virtual message object 360 such as a virtual message authoring environment 350 can display a slide bar 362. 用户可以调整该滑动条362以改变新的虚拟消息对象的一个或多个虚拟物理性质。 The user may adjust the slider 362 to change a new virtual message object or a plurality of virtual physical properties. 在图3中,使用滑动条362来调整虚拟消息对象360的纹理。 In Figure 3, the texture using the slider 360 adjusts the virtual message object 362. 在滑动条的一端上,被示为一堆岩石的图标36½图示了可以被指配给新的虚拟消息对象360的一个纹理。 On one end of the slider, it is shown as an icon illustrating 36½ rock pile may be assigned to the new virtual message object 360 of a texture. 在滑动条362的中间,被示为一堆粗砂的第二图标364b图示了可以指配给虚拟消息对象360的第二纹理。 In the middle of the slider 362, it is shown as a stack of a second icon 364b shown grit that may be assigned to a virtual message object 360 of the second texture. 在滑动条的另一端处,被示为一堆细沙的图标36½图示了可以指配给虚拟消息对象360的第三纹理。 At the other end of the slider, a pile of sand is shown as an icon 36½ illustrates a virtual message object may be assigned to the third texture 360.

[0054] 可以通过触摸屏316、通过轨迹球423、或通过某种其它手段来操纵或占用滑动条362。 [0054] The touch screen 316 may be, or to manipulate the slider 362 occupied by the trackball 423, or by some other means. 替代地,可以通过触摸屏316来占用(engage)图标36^、364b、36k中的一个。 Alternatively, it can take up (engage) icon 36 ^, 364b, 36k is a touch screen 316. 随着滑动条362被占用,触摸敏感传感器向消息发送设备302的处理器发送信号。 As the slider 362 is occupied, the touch-sensitive sensor sends a message to the device processor 302 sends a signal. 该处理器接收传感器信号,并可以至少部分地基于与滑动条输入相关联的传感器信号来确定虚拟消息对象的虚拟物理性质。 The processor receives the sensor signals and may be determined at least in part the physical properties of the virtual message object based on the virtual sensor signals associated with a slider input.

[0055] 用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的说明性方法 [0055] The message content is used to map the virtual to physical properties for an illustrative method of message transmission vibrotactile

[0056] 图4是根据本发明的一个实施例的用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的方法的流程图。 [0056] FIG. 4 is a message content for mapping virtual to physical properties flowchart of a method for vibrotactile message transmitted in accordance with one embodiment of the present invention. 在方法400中,处理器从传感器接收传感器信号402。 In the method 400, the processor 402 receives the sensor signals from the sensor. 处理器可以与一个或多个传感器通信,诸如加速度计、陀螺仪、GPS传感器、触摸敏感输入设备(例如,触摸屏、触摸板)、纹理触控笔、压力传感器、成像传感器、麦克风、或某种其它类型的传感器。 The processor may be in communication with one or more sensors, such as accelerometers, gyroscopes, GPS sensor, a touch-sensitive input device (e.g., a touch screen, a touch pad), texture stylus, a pressure sensor, an imaging sensor, a microphone, or some other types of sensors. 用户可以通过从菜单中选择水球类型、进入记录模式并将消息发送设备向下翻转以填充水球来产生新的虚拟消息对象。 The user can select from the menu balloon type, entering the recording mode is turned upside down and sends a message to fill the balloon device generates a new virtual message object. 加速度计或陀螺仪可以检测倾斜度的改变,触摸屏可以检测在其表面上绘制的图,或者麦克风可以检测声音。 An accelerometer or a gyroscope can detect changes in inclination, the touch screen can be detected on the surface of the drawn map, or the microphone may detect sound. 在检测此类姿势或动作之后,可以向消息发送设备的处理器传送传感器信号。 After the detection of such actions or gestures, the processor may transmit a message to the device a sensor signal.

[0057] 接下来,处理器至少部分地基于传感器信号来确定虚拟消息对象的虚拟物理参数404。 [0057] Next, the processor determines at least in part to the virtual physical parameters of the virtual message object 404 based on the sensor signal. 在从传感器接收到传感器信号之后,处理器可以从传感器信号提取姿势和/或环境特征。 After receiving the sensor signal from the sensor, the processor may pose and / or environmental features are extracted from the sensor signals. 姿势特征可以包括与设备的移动、或设备上的移动有关的信息。 Wherein the gesture information may include mobile, mobile device or on a device associated. 环境特征可以包括与设备的周围环境或条件有关的信息。 Environmental characteristics may include information about the surrounding environment or conditions relating to the device. 可以向从传感器接收到的数据应用姿势和/或环境提取算法。 Extraction algorithm to be received from the pose sensor data applications and / or environments. 可以从传感器信号提取诸如图片中的对象的形状或颜色的环境特征。 Environmental characteristics such as shape or color image objects can be extracted from the sensor signals. 替代地,可以从传感器信号提取移动消息发送设备的方向、或在触摸屏上输入的字符。 Alternatively, the character input on the touch screen may extract the direction of the mobile device message transmitted from the sensor signal, or. 可以设置阈值, 使得某个加速度、定向、或定期性触发标志物的产生。 Threshold may be set such that an acceleration, orientation, or a periodic trigger generation markers. 例如,如果设备仅移动很小的距离,则处理器可以确定移动是无意中做的,或者并不意图触发标志物的产生。 For example, if the device moves only a small distance, the processor may determine whether the mobile inadvertently made, or is not intended to trigger the generation of a marker. 如果设备移动了很大的距离,则处理器可以确定该移动意图触发标志物的产生。 If the device has moved a great distance, the processor can determine the intent trigger generation mobile markers.

[0058] 处理器可以通过将从传感器信号提取的姿势和/或环境特征映射到虚拟物理参数来确定新的虚拟消息对象的虚拟物理参数。 [0058] The processor may be extracted by the signal from the sensor pose and / or environmental characteristics mapped to a virtual physical parameters to determine the physical parameters of the new virtual virtual message object. 例如,可以将预定的姿势和/或环境特征集合连同相应的虚拟物理参数一起存储在数据存储中。 For example, a predetermined posture and / or a set of environmental characteristics may be virtual physical parameter with the corresponding stored together in the data store. 当提取了姿势和/或环境特征时,搜索数据存储,并确定适当的虚拟物理参数。 When extracting the posture and / or environmental characteristics, the search data storage, and determines the appropriate virtual physical parameters. 该确定可以至少部分地基于姿势的动态(dynamics),诸如触摸屏接触的速度、移动的速度、移动的大小、移动的定期性、或移动的重复性。 The velocity determination may be based at least in part dynamic gesture (Dynamics), such as a touch screen contact, the moving speed, the size of the movement, the moving periodic or repetitive movement.

[0059] 作为一个示例,用户可以通过平缓、重复的运动来产生多个新的虚拟消息对象,诸如心或气球。 [0059] As one example, a user may generate a plurality of new virtual message object through the gentle, repetitive motion, such as a heart or a balloon. 用每个循环或重复姿势,处理器可以产生新的虚拟消息对象,潜在地导致多个气球装满虚拟消息创作环境。 Repeat with each cycle or gesture, the processor can generate a new virtual message object, potentially leading to more balloons filled with virtual message authoring environment. 在进一步的示例中,用户可以通过触摸屏显示器来占用或触摸每个气球。 In a further example, the user may be occupied by each balloon or touch the touch screen display. 通过在触摸屏上向上或向下缓慢地拖动气球,处理器可以确定气球的虚拟物理重量。 Slowly downwardly through the virtual physical wt balloon upward drag on the touch screen or the processor may determine the balloon. 如果气球被缓慢地向上拖动,则处理器可以确定气球是轻的,并且应在虚拟消息环境中到处漂浮。 If the balloon is slowly dragged on, the processor may determine the balloon is light, and the message should be floating around in the virtual environment. 替代地,如果气球被快速地拖动至显示器的底部,则处理器可以确定气球是稠密的和/或重的,并且应沉到虚拟消息环境的底部。 Alternatively, if the balloon is rapidly dragged to the bottom of the display, the processor may determine that the balloon is dense and / or heavy, and should sink to the bottom of the virtual message environment.

[0060] 虚拟消息对象的虚拟物理参数可以至少部分地基于其它因素。 Virtual physical parameter [0060] The virtual message object may at least partially be based on other factors. 可以使诸如视频文件或图像文件的文件与虚拟消息对象相关联,诸如虚拟消息囊状物。 It can be made such as a video file or image file associated with the virtual message object, such as a virtual message capsule. 处理器可以从文件提取元数据,使用元数据来确定虚拟物理参数。 The processor may extract metadata from a file, using the metadata to determine the virtual physical parameters. 在一个示例中,用户产生新的虚拟消息囊状物。 In one example, the user generates a new virtual message bladder. 接下来,用户滚动整个文件列表,并选择特定的文件以通过将其拖动到虚拟消息囊状物上来附着于虚拟消息囊状物。 Next, the user scrolls through the list file, and select a particular file by dragging it onto the virtual message bladder attached to the virtual message bladder. 处理器可以至少部分地基于被拖动到虚拟消息对象上的特定文件的大小来确定虚拟消息囊状物的大小。 The processor may at least partially determine the size of the virtual message object based on the size of the bladder particular file is dragged onto the virtual message object. 作为另一示例,处理器可以基于与囊状物相关联的类型来确定虚拟消息囊状物的纹理或颜色。 As another example, the processor may determine the texture or color of the virtual message object based on the type of capsule material associated with the bladder.

[0061] 在确定虚拟物理参数之后,处理器至少部分地基于虚拟物理参数来确定触觉效果406。 [0061] After determining the physical parameters of the virtual processor virtual physical parameter at least partially determined based on the haptic effect 406. 例如,用户可以产生新的虚拟消息球并摇晃设备以定义用于新虚拟消息球的弹性碰撞行为。 For example, the user can generate a new virtual message ball and shaken for an elastic device to define a new virtual message ball collision behavior. 处理器可以确定模拟虚拟消息球从虚拟消息环境弹回的触觉效果,模仿用来在虚拟消息球产生时对其进行定义的姿势。 The processor may determine a simulated virtual message ball rebounding from the virtual message environment haptic effect, when the virtual message to imitate ball in its posture definition.

[0062] 如果虚拟消息环境包含诸如大的脆性蛋的单个虚拟消息对象,则处理器可以确定模拟蛋破裂的触觉效果(例如,单个大的裂缝)。 [0062] If a single virtual message objects comprises a virtual message environment such as a large brittle eggs, the processor may determine a haptic effect simulated egg broken (e.g., a single large cracks). 作为另一示例,如果存在包括运动弹性球的许多虚拟消息对象,则处理器可以确定许多小的快速振动是适当的,以模拟运动的球从环境弹回并相互反弹。 As another example, if the virtual message object comprises a number of resilient ball motion exists, the processor may determine the number of small fast vibration is appropriate to simulate the movement of the ball bounce and rebound from another environment. 通过使触觉效果与虚拟消息对象的虚拟物理参数相关联,用户可以使某些触觉效果与某些类型的对象相关联。 Haptic effect by the virtual message object associated with the virtual physical parameters, the user can cause some haptic effect associated with certain types of objects. 例如,当致动器输出模拟跳动的心的触觉效果时,用户可以在不看消息发送设备的情况下立即猜到她已接收到亲密消息或虚拟消息对象。 For example, when the analog output of the actuator haptic effect beating heart, the user can instantly guessed she has received the message or close the virtual message object without looking at the message transmitting device.

[0063] 处理器生成被配置成使得致动器输出触觉效果的触觉信号408。 [0063] The processor generates a haptic signal is configured such that the actuator 408 outputs the haptic effect. 最后,处理器110 向被配置成输出触觉效果的一个或多个致动器传送触觉信号410。 Finally, the processor 110 is configured to output a haptic effect or more actuators 410 transmits a haptic signal. 在一个变体中,处理器确定模拟箭击中墙壁的触觉效果,诸如砰击声,并生成被配置成使得致动器输出该砰击声的触觉信号。 In a variant, the processor determines a haptic effect simulation arrow hit a wall, such as the slamming sound and generating is configured such that the actuator outputs the haptic slamming acoustic signal. 然后,该触觉信号被传送到输出触觉效果的致动器。 Then, the haptic signal is transmitted to output the haptic effect actuator.

[0064] 图5是根据本发明的一个实施例的用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的方法的流程图。 [0064] FIG. 5 is according to one embodiment of the present invention for mapping virtual to physical properties of the message content flowchart of a method for haptic message transmission of vibration. 在方法500中,产生新的虚拟消息对象502。 In the method 500, a new virtual message object 502. 可以在虚拟消息创作环境中产生新的虚拟消息对象。 It can generate new virtual message object in the virtual message authoring environment. 虚拟消息创作环境可以使多维收件箱或虚拟消息环境的物理模型悬浮。 Virtual message authoring environment allows multi-dimensional physical model of a suspension or inbox virtual message environment. 通过使物理模型悬浮,可以使传感器信号与新的虚拟消息对象的虚拟物理参数相关联,而不是使传感器信号与和虚拟消息环境内的现有虚拟消息对象的交互相关联。 By making a physical model of the suspension, the sensor can signal a new virtual message object associated with the virtual physical parameters, rather than associated with the interaction of an existing virtual message object within the sensor signals and the virtual message environment.

[0065] 可以通过从菜单中选择选项来创作新的虚拟消息对象。 [0065] You can create a new virtual message object by selecting Options from the menu. 该虚拟消息创作环境可以显示用于选择多种类型的现有虚拟消息对象中的一个的滚动菜单和/或用于创作新类型的虚拟消息对象的选项。 The virtual message authoring environment can be used to select display various types of existing virtual message object in a scrolling menus and / or options for the creation of a new type of virtual message object. 如图5所示,可以产生新的虚拟消息球50½、新的虚拟消息管504b、或新的虚拟消息囊状物5(Mc。在其它实施例中,可以产生其它类型的虚拟消息对象。 例如,新的虚拟消息对象可以包括心、箭、水球、或篮球。每种类型的虚拟消息对象可以具有与之相关联的特定虚拟消息性质。例如,虚拟消息篮球可以具有模拟真实篮球的虚拟物理纹理。 5, the message can generate new virtual ball 50½, a new virtual message tube 504b, or a new virtual message bladder 5 (Mc. In other embodiments, other types may be generated virtual message object. E.g. the new virtual message object may include a heart, arrows, water polo, or basketball. each type of virtual message object may have properties of a particular virtual message associated therewith. For example, virtual message simulate real basketball may have a virtual physical texture basketball .

[0066] 在一些情况下,用户从预定义的虚拟消息对象类型列表中选择虚拟消息对象。 [0066] In some cases, the user selects the virtual message object from a predefined virtual message object type list. 通过使用预定义虚拟消息对象类型,用户能够快速地且明确地定义新的虚拟消息对象的特定方面,其可以被映射或转换成一个或多个虚拟物理参数。 Particular aspect by using a predefined virtual message object type, and the user can explicitly define new virtual message object quickly, or it may be mapped into one or more virtual physical parameters. 在其它情况下,用户可以从头开始创作新类型的虚拟消息对象。 In other cases, users can create from scratch a new type of virtual message object. 用户能够至少部分地基于来自触摸屏、加速度计、陀螺仪、GPS 传感器、或某种其它类型的传感器的信号用特定的个性化虚拟物理参数来定义虚拟消息对象。 The user is able to at least partially define a virtual message object with a specific personalized virtual physical parameter based on signals from the touch screen, an accelerometer, a gyro, GPS sensor, or some other type of sensor.

[0067] 在产生50½新的虚拟消息球之后,将记录506a该虚拟消息球的特征。 [0067] After generating the new virtual message ball 50½, the characteristic of the virtual message ball 506a records. 可以由消息发送设备的一个或多个传感器来记录特征。 Message can be recorded by one or more sensors transmitting device features. 可以从光传感器记录色彩特征,可以从纹理触控笔传感器记录纹理特征,或者可以从加速度计记录姿势。 Color features can be recorded from the optical sensor, characterized in texture from the texture can record a stylus sensor, or may be from the meter record posture acceleration.

[0068] 在步骤504b中,产生新的虚拟消息管。 [0068] In step 504b, the message generates a new virtual pipe. 采取管、或卷轴形式的虚拟消息对象可以表示文本消息。 Take the tube, or reel in the form of a virtual message object may represent a text message. 因此,如果产生504b 了新的虚拟消息管,则可以输入506b文本消息。 Thus, if a new virtual message 504b tube 506b may enter a text message. 用户可以通过附着于消息发送设备的键盘、通过在触摸屏显示器上显示的虚拟键盘、或通过某种其它手段来输入文本。 The user can send a message to a keyboard apparatus by attaching, to enter text using the virtual keyboard displayed on a touch screen display, or by some other means.

[0069] 在步骤5(Mc中,产生虚拟消息囊状物。采取囊状物或蛋形式的虚拟消息对象可以表示具有文件附件的消息。因此,如果产生5(Mc 了新的虚拟消息囊状物,则选择560c要附加(或包括在囊状物内部)的文件。虚拟消息囊状物可以包括具有诸如视频文件、声音文件、或图像文件的文件附件的消息。用户可以通过滚动整个文件列表、或将文件拖动到虚拟消息囊状物上来选择文件附件。作为一个替代,用户可以拍摄图片并选择要装入文件囊状物内部的图片。 [0069] In step 5 (Mc, producing a virtual message bladder. The bladder, or egg take the form of a virtual message object may represent a message has an attachment file. Thus, if a 5 (Mc new virtual message capsule was select 560c to be attached (or included within the bladder) files. the bladder virtual message may include a message having a file attachment, such as a video file, audio file, or image file. users can scroll through the entire list of files , or drag a file into the virtual attachment message selected file onto the bladder. as an alternative, the user can take a picture and select files to be loaded the interior of the bladder image.

[0070] 在记录506a、输入506b、或选择506c 了关于新的虚拟消息对象的信息之后,确定新的虚拟消息对象的虚拟物理参数508。 After the [0070] recording 506a, 506b input, or information regarding new virtual message object 506c is selected, and determining a virtual physical parameters of the new virtual message object 508. 可以至少部分地基于从传感器接收到的信息来确定虚拟物理参数。 At least in part based on information received from the sensors to determine the virtual to physical parameters. 当传感器记录了虚拟消息球的特征时506a,可以至少部分地基于由传感器记录的信息来确定虚拟物理参数。 When the sensor records a virtual message ball features 506a, at least in part on information recorded by the sensor to determine the virtual physical parameters. 例如,用户可以使消息发送设备倾斜或用消息发送设备做姿势以记录与新的虚拟消息对象的大小相关联的特征。 For example, a user may tilt the device so that message transmission characteristic posture or to do with the size of the recording new virtual message object associated with a message transmission device. 然后,新的虚拟消息对象的虚拟物理尺寸可以对应于该姿势或移动的大小,消息发送设备的小的移动可以产生小的虚拟消息对象,而消息发送设备的大的移动或姿势可以产生大的虚拟消息对象。 Then, the virtual physical dimensions of the new virtual message object may correspond to the gesture or movement of the size, the small mobile messaging device can produce a small virtual message object, the message transmitting apparatus large movement or gesture may generate a large virtual message object.

[0071] 当产生506b 了新的虚拟消息管时,文本消息的长度(诸如行数或字数)可以至少部分地确定新的虚拟消息管的一个或多个虚拟物理参数,诸如管的大小或长度。 [0071] When generating a new virtual message 506b tube, the length of the text message (such as the number of lines or words) may at least partially determine a new virtual message tube or a plurality of virtual physical parameters, such as the size or length of the tube . 可以确定基于虚拟消息管的大小或长度的触觉效果。 It may be determined based on the size or length of the haptic effect virtual message tube. 因此,触觉感觉可以传达关于虚拟消息管的信肩、ο Therefore, the tactile sensation can convey a letter shoulder on virtual message tube, ο

[0072] 在新的虚拟消息囊状物5(Mc的情况下,所选择506c的文件的大小可以确定新虚拟消息对象的虚拟质量。由于触觉效果可以至少部分地基于虚拟消息对象的虚拟质量,所以可以产生为该虚拟消息对象特别设计的触觉效果。结果得到的触觉感觉可以传达关于文件囊状物的信息,诸如其包含的数据量或数据类型。 [0072] In the bladder 5 (Mc case where the new virtual message, the size of the selected file 506c may determine the quality of the new virtual virtual message object. Since the haptic effect may at least partially virtual mass virtual message object based, a haptic effect may be generated for the virtual message object is specially designed. the results obtained haptic sensation can convey information about the file bladder, the amount of data or data type which contains such.

[0073] 至少部分地基于新虚拟消息对象的虚拟物理参数来生成触觉信号以使得致动器输出触觉效果510。 [0073] at least in part to generate a haptic signal based on the virtual physical parameters of the new virtual message object such that the actuator to output a haptic effect 510. 最后,向被配置成输出触觉效果的致动器传送触觉信号512。 Finally, to transmit a haptic signal 512 is configured to output a haptic effect actuators. 该触觉效果可以至少部分地基于虚拟消息对象与虚拟消息环境之间的交互。 The haptic effect may at least partially the interaction between the virtual message object based on the virtual message environment. 虚拟消息对象的行为可以至少部分地基于虚拟消息对象的虚拟物理参数。 Behavior of the virtual message object may be at least in part based on the virtual physical parameters of the virtual message object. 蛋壳状虚拟消息对象可以在与虚拟消息环境撞击时碎裂或破裂。 Virtual message objects may eggshell chipping or cracking upon impact with the virtual message environment. 替代地,虚拟消息箭可以以一个响亮的砰击声到达。 Alternatively, the virtual news arrow can be reached with a loud thuds. 可以使虚拟消息气泡与短暂、尖锐的触觉效果相关联,指示气泡爆裂。 You can make a virtual message bubbles with short, sharp haptic effects associated instructions bubble burst.

[0074] 如果新的虚拟消息对象是大球,则可以生成触觉信号以使得致动器输出模仿大球从虚拟消息环境弹回和/或到处滚动的触觉效果。 [0074] If the new virtual message object is a large ball, a tactile signal may be generated to cause the actuator output to imitate the ball rebounding from the virtual message environment and / or rolling around a haptic effect. 如果新的虚拟消息对象是小囊状物,则可以生成触觉信号以使得致动器输出模仿小囊状物在虚拟消息环境内部破裂的触觉效果。 If the new virtual message object is small bladder, tactile signals may be generated to cause the actuator output to mimic small bladder rupture inside the virtual message environment haptic effect.

[0075] 可以使触觉效果与虚拟消息对象相关联。 [0075] This allows haptic effect associated with the virtual message object. 可以随着在消息发送设备之间交换虚拟消息对象而保存触觉效果。 With the virtual message object may be exchanged between the sending device and stored message haptic effect. 例如,处理器可以使虚拟消息囊状物与特定的触觉效果相关联。 For example, the processor may bladder virtual message associated with a particular haptic effect. 当囊状物从一个移动设备被发送到另一个时,还向接收设备发送触觉数据。 When the bladder is transmitted from one mobile device to another, further haptic data transmitted to the receiving device. 此触觉数据可以用来在接收设备中生成触觉反馈。 This haptic data can be used to generate haptic feedback in the receiving device.

[0076] 图6是根据本发明的一个实施例的用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的系统的图示。 [0076] FIG. 6 is used to map the virtual to physical properties of the message content diagram of a system for vibrotactile message transmitted in accordance with one embodiment of the present invention. 如图6所示,系统600包括消息发送设备602。 6, system 600 comprises a messaging device 602. 消息发送设备602显示虚拟消息创作环境650。 Message sending apparatus 602 displays the virtual message authoring environment 650. 消息发送设备602包括一个或多个处理器(图6未示出)。 Message sending apparatus 602 includes one or more processors (not shown in FIG. 6).

[0077] 另外,消息发送设备602可以包括一个或多个处理器(图6未示出)。 [0077] Further, the message transmission device 602 may include one or more processors (not shown in FIG. 6). 诸如加速度计的传感器可以被配置成检测消息发送设备的加速度、倾斜度、惯性、或位置的变化。 An acceleration sensor such as a meter may be configured to detect an acceleration of the messaging device, the inclination changes, inertia, or location. 作为其它示例,消息发送设备可以包括气压传感器、位置传感器、旋转速度传感器、图像传感器、 压力传感器、或某种其它类型的传感器。 As other examples, the messaging device may comprise an air pressure sensor, a position sensor, a rotation speed sensor, an image sensor, a pressure sensor, or some other type of sensor. 传感器被配置成向处理器发送传感器信号。 Sensor is configured to transmit a sensor signal to the processor.

[0078] 在一个变体中,加速度感测可以用于捕获与产生虚拟消息对象相关联的姿势或移动。 [0078] In one variant, the acceleration sensing may be used to capture gestures associated with the moving object or the virtual generated associated message. 在另一变体中,使用诸如触摸屏的触摸敏感输入设备来获取与新虚拟消息对象相关联的绘画。 In another variant, using a touch-sensitive input device such as a touch screen painting and acquires new virtual message object is associated. 陀螺仪传感器可以检测X和y平面中的消息发送设备的定向变化。 The gyro sensor may detect a change in orientation of the message sending device X and y plane. 如图6所示, 移动设备602在根据箭头610的方向上移动。 6, the mobile device 602 is moved in the direction according to arrow 610. 处理器可以确定从图6所示的姿势产生的虚拟消息对象是大的、圆的、并且容易地在虚拟消息环境中到处滚动。 Virtual message object processor may determine the posture shown in FIG. 6 is produced in large, round, and easily rolling around in the virtual message environment. 相应的触觉效果可以是轻柔、平稳的振动。 Corresponding haptic effect may be gentle, steady vibration.

[0079] 图7是根据本发明的一个实施例的用于将消息内容映射到虚拟物理性质以进行振动触觉消息发送的系统的图示。 [0079] FIG. 7 is used to map the virtual to physical properties of the message content diagram of a system for vibrotactile message transmitted in accordance with one embodiment of the present invention. 如图7所示,系统700包括消息发送设备702。 As shown in FIG 7, the system 700 includes a message sending apparatus 702. 消息发送设备显示虚拟消息创作环境750。 Message sending device displays a virtual message authoring environment 750. 消息发送设备702可以包括一个或多个处理器(图7中未示出)和一个或多个传感器(图7中未示出)。 Message transmission device 702 may include one or more processors (not shown in FIG. 7), and one or more sensors (not shown in FIG. 7).

[0080] 如图7所示,用户以由箭头710的方向所指示的短的水平运动来移动或摇动消息发送设备。 [0080] As shown in FIG. 7, the horizontal movement of the user by the short direction of arrow 710 as indicated by message sending device or shaking movement. 从图7所示的每个移动或姿势提取的传感器数据可以用来产生具有特定虚拟物理性质的新的虚拟消息对象。 Extracted from each movement or posture shown in FIG. 7 the sensor data may be used to generate a new virtual message object having a particular virtual physical properties. 处理器可以确定从图7所示的姿势产生的虚拟消息对象可以是小的粗糙对象。 The processor may determine the virtual message object generated from the posture shown in FIG. 7 may be small rough objects. 相应的触觉效果可以是连续的快速摇晃。 Corresponding haptic effect may be continuous rapid shaking.

[0081] 可以使每个触觉效果与虚拟消息对象相关联并进行保存。 [0081] each haptic effect can be a virtual message object is associated with and stored. 例如,可以将触觉效果包括在虚拟消息对象的概况(profile)中。 For example, the haptic effect may be included in the message before the virtual object (profile). 这样,接收到虚拟消息对象的消息发送设备还接收对应于与该虚拟消息对象相关联的触觉效果的信号。 Thus, the virtual message object receives the message sending device also receives a signal corresponding to a haptic effect with the virtual objects associated with the message. 以这种方式,用户可以通过非言语触觉消息进行通信。 In this manner, a user may communicate via nonverbal tactile message.

[0082] 可以在数字电子电路或在计算机硬件、固件、软件、或其组合中实现本发明的实施例。 [0082] or may be implemented in digital electronic circuitry of the present invention in computer hardware, firmware, software, or a combination thereof embodiment. 在一个实施例中,计算机可以包括一个或多个处理器。 In one embodiment, a computer may include one or more processors. 处理器可以包括计算机可读介质,诸如被耦合到处理器的随机存取存储器(RAM)。 The processor may include a computer-readable medium, such as a random access memory coupled to the processor (RAM). 处理器执行被存储在存储器中的计算机可执行程序指令,诸如执行用于消息发送的一个或多个计算机程序。 The processor can execute computer-executable stored in the memory program instructions, such as executing one or more computer programs for message transmission. 此类处理器可以包括微处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)、 以及状态机。 Such processors may include a microprocessor, a digital signal processor (DSP), application specific integrated circuit (ASIC), a field programmable gate array (the FPGA), and a state machine. 此类处理器可以进一步包括可编程电子器件,诸如PLC、可编程中断控制器(PIC)、可编程逻辑器件(PLD)、可编程只读存储器(PR0M)、电可编程只读存储器(EPR0M或EEPR0M)、或其它类似器件。 Such processors may further comprise programmable electronic devices such as PLC, Programmable Interrupt Controller (the PIC), programmable logic devices (PLD), programmable read only memory (PR0M), electrically programmable read only memory (or EPR0M EEPR0M), or other similar devices.

[0083] 此类处理器可以包括介质,或者可以与介质通信,例如计算机可读介质,其可以存储在被处理器执行时能够使得处理器执行在本文中被描述为由处理器执行或辅助的步骤的指令。 [0083] Such medium may include a processor, or may be in communication with media, for example computer-readable media, which may be stored, when executed by a processor cause the processor to be described can be executed by a processor or by an auxiliary herein instruction step. 计算机可读介质的实施例可以包括但不限于电子、光学、磁性、或能够为诸如网络服务器中的处理器的处理器提供计算机可读指令的其它存储或传输设备。 Embodiments of computer-readable media can include but are not limited to, an electronic, optical, magnetic, or other storage or transmission to provide devices, such as computer-readable instructions for a processor in a web server processor. 介质的其它示例包括但不限于软盘、CD-ROM、磁盘、存储器芯片、ROM、RAM、ASIC、已配置处理器、所有光学介质、所有磁带或其它磁性介质、或计算机处理器可以从中进行读取的任何其它介质。 Other examples of media comprise, but are not limited to a flexible disk, CD-ROM, magnetic disk, memory chip, ROM, RAM, ASIC, configured processor, all optical media, all magnetic tape or other magnetic media, or from which a computer processor can read any other medium. 而且, 各种其它设备可以包括计算机可读介质,诸如路由器、私用或公共网络、或其它传输设备。 Also, various other devices may include a computer-readable medium, such as a router, private or public network, or other transmission devices. 所述处理器和处理可以在一个或多个结构中,并且可以散布于一个或多个结构。 The processor and the treatment may be in one or more structures, and may be dispersed in one or more structures. 处理器可以包括用于执行本文所述的方法(或方法的一部分)中的一个或多个的代码。 One or more codes (or a portion of the method) may comprise a processor for performing the method described herein in.

[0084]纖 [0084] Fiber

[0085] 已经仅仅出于图示和描述的目的呈现了本发明的实施例的前述描述,包括优选实施例,并且其并不意图是穷尽的,也不意图使本发明局限于所公开的精确形式。 Objective [0085] have been described merely for illustration and the foregoing description of embodiments of the present embodiment of the present invention, including the preferred embodiments, and are not intended to be exhaustive nor intended to limit the invention to the precise disclosed form. 在不脱离本发明的精神和范围的情况下,其许多修改和调整对于本领域的技术人员来说将是显而易见的。 Without departing from the spirit and scope of the invention, numerous modifications and adjustments to those skilled in the art it will be apparent.

Claims (23)

1. 一种方法,包括:从被配置成感测与消息发送设备的交互的传感器接收传感器信号; 至少部分地基于所述传感器信号来确定虚拟消息对象的虚拟物理参数; 至少部分地基于所述虚拟物理参数来确定触觉效果;以及生成被配置成使得致动器输出所述触觉反馈效果的触觉信号。 1. A method, comprising: receiving a sensor signal from the sensor is configured to sense the interaction message sending device; at least in part be determined virtual physical parameters of the virtual message object based on the sensor signal; at least in part on the virtual physical parameter to determine a haptic effect; and generating is configured such that the actuator to output the haptic effect of haptic feedback signal.
2.根据权利要求1所述的方法,进一步包括向被配置成输出所述触觉效果的致动器传送所述触觉信号,并输出所述触觉效果。 2. A method according to claim 1, further comprising transmitting the signal to the haptic is configured to output the haptic effect actuator, and outputs the haptic effect.
3.根据权利要求1所述的方法,其中,所述传感器被配置成检测:接触、压力、加速度、 倾斜度、惯性、或位置。 3. The method according to claim 1, wherein the sensor is configured to detect: a contact, pressure, acceleration, tilt, inertial, or location.
4.根据权利要求1所述的方法,其中,所述传感器包括:加速度计、陀螺仪、触摸敏感输入设备、照相机、或GPS传感器。 4. The method according to claim 1, wherein said sensor comprises: an accelerometer, a gyroscope, a touch-sensitive input device, a camera, or a GPS sensor.
5.根据权利要求1所述的方法,其中,所述传感器信号与姿势相关联。 The method according to claim 1, wherein the sensor signal is associated with the gesture.
6.根据权利要求5所述的系统,其中,所述姿势是二维姿势,包括:手指位置或手指姿势。 6. A system as claimed in claim 5, wherein the gesture is a two-dimensional position, comprising: a hand position or posture of the finger.
7.根据权利要求5所述的方法,其中,所述姿势是三维姿势,包括:设备姿势或设备定向。 7. The method according to claim 5, wherein the gesture is a three-dimensional posture, comprising: a device position or orientation of the device.
8.根据权利要求1所述的方法,其中,所述虚拟物理性质包括:大小、质量、形状、碰撞行为、或纹理。 8. The method according to claim 1, wherein the virtual physical properties include: the size, mass, shape, impact behavior, or texture.
9.根据权利要求1所述的方法,其中,所述虚拟消息对象包括:球、管、或囊状物。 9. The method according to claim 1, wherein the virtual message object comprises: a ball, a tube, or bladder.
10.根据权利要求1所述的方法,其中,所述虚拟物理性质至少部分地基于与所述虚拟消息对象相关联的文件大小、与所述虚拟消息对象相关联的文本消息的长度、与所述虚拟消息对象相关联的图像的宽度和长度、与所述虚拟消息对象相关联的歌曲的长度、或与所述虚拟消息对象相关联的视频的长度。 10. The method according to claim 1, wherein the virtual physical properties at least in part based on the file size associated with the virtual message object, the virtual message object and the length of the text message associated with the length width and length of the image of said virtual message object associated with the song associated with the virtual message object, or the length of the video associated with the virtual message object.
11. 一种包括程序代码的计算机可读介质,所述程序代码包括:用于从被配置成感测与消息发送设备的交互的传感器接收传感器信号的程序代码; 用于至少部分地基于所述传感器信号来确定虚拟消息对象的虚拟物理性质的程序代码;用于至少部分地基于所述虚拟物理性质来确定触觉效果的程序代码;以及用于生成被配置成使得致动器输出所述触觉效果的触觉信号的程序代码。 11. A computer-readable medium of program code, the program code comprising: program code to receive a sensor signal from the sensor is configured to sense the interaction message sending device; means for at least partially based on the program code to determine a virtual sensor signal to a virtual message object's physical properties; program code to determine a haptic effect based on the virtual physical properties at least in part; and means for generating is configured such that the actuator outputs the haptic effect actuation program code haptic signal.
12. —种系统,包括:处理器,所述处理器被配置成:从被配置成感测与消息发送设备的交互的传感器接收传感器信号; 至少部分地基于所述传感器信号来确定虚拟消息对象的虚拟物理性质; 至少部分地基于所述虚拟物理性质来确定触觉效果; 生成被配置成使得致动器输出所述触觉效果的触觉信号;以及致动器,所述致动器被配置成接收所述触觉信号并输出所述触觉效果。 12. - kind of system, comprising: a processor configured to: receive a sensor signal from the sensor is configured to sense the interaction message sending device; at least in part based on the sensor signal to determine a virtual message object virtual physical properties; be determined at least in part based on the physical properties of the virtual haptic effect; generating a haptic signal is configured such that the actuator to output a haptic effect; and an actuator, the actuator is configured to receive the haptic signal and to output the haptic effect.
13.根据权利要求12所述的系统,进一步包括:与所述处理器通信的传感器。 13. The system according to claim 12, further comprising: a sensor in communication with the processor.
14.根据权利要求13所述的系统,其中,所述传感器被配置成检测:接触、压力、加速度、倾斜度、惯性、或位置。 14. The system according to claim 13, wherein the sensor is configured to detect: a contact, pressure, acceleration, tilt, inertial, or location.
15.根据权利要求13所述的系统,其中,所述传感器包括:加速度计、陀螺仪、触摸敏感输入设备、照相机、或GPS传感器。 15. The system according to claim 13, wherein said sensor comprises: an accelerometer, a gyroscope, a touch-sensitive input device, a camera, or a GPS sensor.
16.根据权利要求12所述的系统,其中,所述消息发送设备进一步包括显示器。 16. The system according to claim 12, wherein the transmitting apparatus further comprises a display message.
17.根据权利要求16所述的系统,其中,所述显示器包括触摸屏。 17. The system according to claim 16, wherein said display includes a touch screen.
18.根据权利要求12所述的系统,其中,所述虚拟物理性质包括:大小、质量、形状、碰撞行为、或纹理。 18. The system according to claim 12, wherein the virtual physical properties include: the size, mass, shape, impact behavior, or texture.
19.根据权利要求12所述的系统,其中,所述虚拟消息对象包括:球、管、或囊状物。 19. The system according to claim 12, wherein the virtual message object comprises: a ball, a tube, or bladder.
20.根据权利要求12所述的系统,其中,所述传感器信号与姿势相关联。 20. The system according to claim 12, wherein the sensor signal is associated with the gesture.
21.根据权利要求20所述的系统,其中,所述姿势是二维姿势,包括:手指位置或手指姿势。 21. The system according to claim 20, wherein the gesture is a two-dimensional position, comprising: a hand position or posture of the finger.
22.根据权利要求20所述的系统,其中,所述姿势是三维姿势,包括:设备姿势或设备定向。 22. The system according to claim 20, wherein the gesture is a three-dimensional posture, comprising: a device position or orientation of the device.
23.根据权利要求12所述的系统,其中,所述消息发送设备进一步包括被配置成生成与所述触觉效果协调的声音效果的扬声器。 23. The system of claim 12, wherein said apparatus further comprises a message transmission is configured to generate a haptic effect in coordination with the sound effect of the speaker.
CN200980127978.1A 2008-07-15 2009-07-14 Systems and methods for mapping message contents to virtual physical properties for vibrotactile messaging CN102187647B (en)

Priority Applications (13)

Application Number Priority Date Filing Date Title
US8098708P true 2008-07-15 2008-07-15
US8097808P true 2008-07-15 2008-07-15
US8098108P true 2008-07-15 2008-07-15
US8098508P true 2008-07-15 2008-07-15
US61/080,985 2008-07-15
US61/080,981 2008-07-15
US61/080,987 2008-07-15
US61/080,978 2008-07-15
US14831209P true 2009-01-29 2009-01-29
US61/148,312 2009-01-29
US18128009P true 2009-05-26 2009-05-26
US61/181,280 2009-05-26
PCT/US2009/050564 WO2010009145A1 (en) 2008-07-15 2009-07-14 Systems and methods for mapping message contents to virtual physical properties for vibrotactile messaging

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410262007.0A CN104111726B (en) 2008-07-15 2009-07-14 A method and a system output a haptic effect

Publications (2)

Publication Number Publication Date
CN102187647A true CN102187647A (en) 2011-09-14
CN102187647B CN102187647B (en) 2014-07-23

Family

ID=41119917

Family Applications (10)

Application Number Title Priority Date Filing Date
CN200980127923.0A CN102099766B (en) 2008-07-15 2009-07-14 Systems and methods for shifting haptic feedback function between passive and active modes
CN200980127978.1A CN102187647B (en) 2008-07-15 2009-07-14 Systems and methods for mapping message contents to virtual physical properties for vibrotactile messaging
CN201410262007.0A CN104111726B (en) 2008-07-15 2009-07-14 A method and a system output a haptic effect
CN200980128008.3A CN102160366B (en) 2008-07-15 2009-07-14 Systems and methods for transmitting haptic messages
CN201410153123.9A CN103970209B (en) 2008-07-15 2009-07-14 Systems and methods for haptic message transmission
CN201610959363.7A CN107066035A (en) 2008-07-15 2009-07-14 Systems and methods for physics-based tactile messaging
CN201610915344.4A CN106990811A (en) 2008-07-15 2009-07-14 Systems and methods for haptic message transmission
CN201510019130.4A CN104571336A (en) 2008-07-15 2009-07-14 Systems and methods for shifting haptic feedback function between passive and active modes
CN2009801279391A CN102099767A (en) 2008-07-15 2009-07-14 Systems and methods for physics-based tactile messaging
CN2009801279387A CN102100055A (en) 2008-07-15 2009-07-14 Systems and methods for haptic message transmission

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN200980127923.0A CN102099766B (en) 2008-07-15 2009-07-14 Systems and methods for shifting haptic feedback function between passive and active modes

Family Applications After (8)

Application Number Title Priority Date Filing Date
CN201410262007.0A CN104111726B (en) 2008-07-15 2009-07-14 A method and a system output a haptic effect
CN200980128008.3A CN102160366B (en) 2008-07-15 2009-07-14 Systems and methods for transmitting haptic messages
CN201410153123.9A CN103970209B (en) 2008-07-15 2009-07-14 Systems and methods for haptic message transmission
CN201610959363.7A CN107066035A (en) 2008-07-15 2009-07-14 Systems and methods for physics-based tactile messaging
CN201610915344.4A CN106990811A (en) 2008-07-15 2009-07-14 Systems and methods for haptic message transmission
CN201510019130.4A CN104571336A (en) 2008-07-15 2009-07-14 Systems and methods for shifting haptic feedback function between passive and active modes
CN2009801279391A CN102099767A (en) 2008-07-15 2009-07-14 Systems and methods for physics-based tactile messaging
CN2009801279387A CN102100055A (en) 2008-07-15 2009-07-14 Systems and methods for haptic message transmission

Country Status (6)

Country Link
US (20) US8638301B2 (en)
EP (13) EP2327201B1 (en)
JP (20) JP5410520B2 (en)
KR (18) KR101404367B1 (en)
CN (10) CN102099766B (en)
WO (5) WO2010009152A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103227960A (en) * 2012-01-31 2013-07-31 三星电子株式会社 Display apparatus, upgrading apparatus, control method thereof and display system
CN105144033A (en) * 2013-03-15 2015-12-09 高通股份有限公司 Extending interactive inputs via sensor fusion
CN106133636A (en) * 2014-03-21 2016-11-16 意美森公司 Systems and methods for haptically-enabled curved devices
CN106468780A (en) * 2015-08-20 2017-03-01 联发科技股份有限公司 Portable device and related vibration detecting method

Families Citing this family (187)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0864145A4 (en) * 1995-11-30 1998-12-16 Virtual Technologies Inc Tactile feedback man-machine interface device
US20100312129A1 (en) 2005-01-26 2010-12-09 Schecter Stuart O Cardiovascular haptic handle system
BRPI0804355A2 (en) * 2008-03-10 2009-11-03 Lg Electronics Inc terminal and control method of the same
US8594740B2 (en) 2008-06-11 2013-11-26 Pantech Co., Ltd. Mobile communication terminal and data input method
CN102099766B (en) * 2008-07-15 2015-01-14 意美森公司 Systems and methods for shifting haptic feedback function between passive and active modes
US8004391B2 (en) * 2008-11-19 2011-08-23 Immersion Corporation Method and apparatus for generating mood-based haptic feedback
US20100146437A1 (en) * 2008-12-04 2010-06-10 Microsoft Corporation Glanceable animated notifications on a locked device
US9197738B2 (en) * 2008-12-04 2015-11-24 Microsoft Technology Licensing, Llc Providing selected data through a locked display
KR20100086161A (en) * 2009-01-22 2010-07-30 주식회사 팬택 Apparatus and method for controlling operation using cognition of wind
US8572493B2 (en) * 2009-01-29 2013-10-29 Rick Qureshi Mobile device messaging application
JP4706985B2 (en) * 2009-03-04 2011-06-22 コニカミノルタビジネステクノロジーズ株式会社 The content display device
US9696803B2 (en) 2009-03-12 2017-07-04 Immersion Corporation Systems and methods for friction displays and additional haptic effects
KR101593598B1 (en) * 2009-04-03 2016-02-12 삼성전자주식회사 Function execution method using a gesture in the portable terminal
JP5639151B2 (en) * 2009-04-15 2014-12-10 コーニンクレッカ フィリップス エヌ ヴェ Foldable tactile display
US8762886B2 (en) * 2009-07-30 2014-06-24 Lenovo (Singapore) Pte. Ltd. Emulating fundamental forces of physics on a virtual, touchable object
US8656314B2 (en) * 2009-07-30 2014-02-18 Lenovo (Singapore) Pte. Ltd. Finger touch gesture for joining and unjoining discrete touch objects
US20110029904A1 (en) * 2009-07-30 2011-02-03 Adam Miles Smith Behavior and Appearance of Touch-Optimized User Interface Elements for Controlling Computer Function
US20110029864A1 (en) * 2009-07-30 2011-02-03 Aaron Michael Stewart Touch-Optimized Approach for Controlling Computer Function Using Touch Sensitive Tiles
US20110084962A1 (en) * 2009-10-12 2011-04-14 Jong Hwan Kim Mobile terminal and image processing method therein
US9201584B2 (en) * 2009-11-06 2015-12-01 Bose Corporation Audio/visual device user interface with tactile feedback
US20110112821A1 (en) * 2009-11-11 2011-05-12 Andrea Basso Method and apparatus for multimodal content translation
US9621706B2 (en) * 2009-11-18 2017-04-11 Qualcomm Incorporated System and method of haptic communication at a portable computing device
US9046923B2 (en) * 2009-12-31 2015-06-02 Verizon Patent And Licensing Inc. Haptic/voice-over navigation assistance
US9436280B2 (en) * 2010-01-07 2016-09-06 Qualcomm Incorporated Simulation of three-dimensional touch sensation using haptics
JP5665322B2 (en) * 2010-01-25 2015-02-04 京セラ株式会社 Electronics
CA2787831A1 (en) * 2010-01-28 2011-08-04 Liquor Monitor, Llc Dispensing monitor
KR101785751B1 (en) 2010-02-09 2017-10-17 더 트러스티스 오브 더 유니버시티 오브 펜실바니아 Systems and methods for providing vibration feedback in robotic systems
US9990856B2 (en) 2011-02-08 2018-06-05 The Trustees Of The University Of Pennsylvania Systems and methods for providing vibration feedback in robotic systems
US8839150B2 (en) * 2010-02-10 2014-09-16 Apple Inc. Graphical objects that respond to touch or motion input
US8185596B2 (en) * 2010-02-22 2012-05-22 Samsung Electronics Co., Ltd. Location-based communication method and system
US9361018B2 (en) 2010-03-01 2016-06-07 Blackberry Limited Method of providing tactile feedback and apparatus
EP2369444B1 (en) * 2010-03-01 2017-11-22 BlackBerry Limited Method of providing tactile feedback and apparatus
JP5859512B2 (en) * 2010-03-16 2016-02-10 イマージョン コーポレーションImmersion Corporation System and method for the tactile information Preview
JP2011197777A (en) * 2010-03-17 2011-10-06 Sony Corp Information processing device, information processing method and program
KR101640043B1 (en) * 2010-04-14 2016-07-15 삼성전자주식회사 Method and Apparatus for Processing Virtual World
WO2011130752A1 (en) * 2010-04-16 2011-10-20 Mastandrea Nicholas J Wearable motion sensing computing interface
US9733705B2 (en) 2010-04-26 2017-08-15 Nokia Technologies Oy Apparatus, method, computer program and user interface
US9791928B2 (en) 2010-04-26 2017-10-17 Nokia Technologies Oy Apparatus, method, computer program and user interface
US9715275B2 (en) 2010-04-26 2017-07-25 Nokia Technologies Oy Apparatus, method, computer program and user interface
JP2012003508A (en) * 2010-06-16 2012-01-05 Toshiba Corp Information processor, method and program
US20120001856A1 (en) * 2010-07-02 2012-01-05 Nokia Corporation Responding to tactile inputs
KR20120005124A (en) * 2010-07-08 2012-01-16 삼성전자주식회사 Apparatus and method for operation according to movement in portable terminal
US8798534B2 (en) * 2010-07-09 2014-08-05 Digimarc Corporation Mobile devices and methods employing haptics
US8988445B2 (en) * 2010-07-30 2015-03-24 The Trustees Of The University Of Pennsylvania Systems and methods for capturing and recreating the feel of surfaces
US9329721B1 (en) * 2010-08-05 2016-05-03 Amazon Technologies, Inc. Reduction of touch-sensor interference from stable display
US8917249B1 (en) 2010-08-05 2014-12-23 Amazon Technologies, Inc. Reduction of touch-sensor interference from active display
TWI492100B (en) * 2010-08-25 2015-07-11 Fih Hong Kong Ltd Electronic device and method for unlocking the electronic device
US20120054667A1 (en) * 2010-08-31 2012-03-01 Blackboard Inc. Separate and simultaneous control of windows in windowing systems
US10318002B2 (en) * 2010-09-15 2019-06-11 Inventus Engineering Gmbh Magnetorheological transmission device
KR101708821B1 (en) * 2010-09-30 2017-02-21 엘지전자 주식회사 Mobile terminal and method for controlling thereof
US8564535B2 (en) * 2010-10-05 2013-10-22 Immersion Corporation Physical model based gesture recognition
US9483786B2 (en) 2011-10-13 2016-11-01 Gift Card Impressions, LLC Gift card ordering system and method
US8565392B2 (en) * 2010-11-09 2013-10-22 WOOW Inc. Limited Apparatus and method for physical interaction over a distance using a telecommunication device
RU2596994C2 (en) * 2010-11-09 2016-09-10 Конинклейке Филипс Электроникс Н.В. User interface with tactile feedback
JP5479414B2 (en) * 2010-11-24 2014-04-23 キヤノン株式会社 The information processing apparatus and control method thereof
US9201467B2 (en) 2011-01-26 2015-12-01 Sony Corporation Portable terminal having user interface function, display method, and computer program
JP5654886B2 (en) * 2011-01-26 2015-01-14 株式会社ソニー・コンピュータエンタテインメント Mobile terminal, display method, and computer program
JP5809079B2 (en) * 2011-02-10 2015-11-10 京セラ株式会社 Method of controlling an electronic equipment and electronic equipment
EP2678970A4 (en) * 2011-02-24 2017-03-15 Empire Technology Development LLC Authentication using mobile devices
EP2498250A1 (en) * 2011-03-07 2012-09-12 Accenture Global Services Limited Client and server system for natural language-based control of a digital network of devices
US8872854B1 (en) * 2011-03-24 2014-10-28 David A. Levitt Methods for real-time navigation and display of virtual worlds
US8942828B1 (en) 2011-04-13 2015-01-27 Stuart Schecter, LLC Minimally invasive cardiovascular support system with true haptic coupling
US9448713B2 (en) * 2011-04-22 2016-09-20 Immersion Corporation Electro-vibrotactile display
JP2012242927A (en) * 2011-05-17 2012-12-10 Seiko Epson Corp Mobile terminal device, control method for mobile terminal device, and program
US8710967B2 (en) 2011-05-18 2014-04-29 Blackberry Limited Non-visual presentation of information on an electronic wireless device
US10191546B2 (en) * 2011-06-20 2019-01-29 Immersion Corporation Haptic theme framework
US20130033366A1 (en) * 2011-08-01 2013-02-07 Mcdonough Colin Albright Method and system for providing haptic feedback of variable intensity
WO2013022021A1 (en) * 2011-08-09 2013-02-14 株式会社ニコン Electronic device
US9762719B2 (en) 2011-09-09 2017-09-12 Qualcomm Incorporated Systems and methods to enhance electronic communications with emotional context
US9501150B2 (en) 2011-10-01 2016-11-22 Oracle International Corporation Moving an object about a display frame by combining classical mechanics of motion
CN103842937A (en) * 2011-10-04 2014-06-04 株式会社 尼康 Electronic device
US9582178B2 (en) * 2011-11-07 2017-02-28 Immersion Corporation Systems and methods for multi-pressure interaction on touch-sensitive surfaces
CN102692997A (en) * 2011-11-25 2012-09-26 北京十分科技有限公司 Method for controlling operation of terminal
US8381102B1 (en) 2011-12-06 2013-02-19 Google Inc. Systems and methods for visually scrolling through a stack of items displayed on a device
US20150205473A1 (en) * 2011-12-06 2015-07-23 Google Inc. Systems and methods for visually scrolling through a stack of items displayed on a device
US20130227409A1 (en) * 2011-12-07 2013-08-29 Qualcomm Incorporated Integrating sensation functionalities into social networking services and applications
US20130227411A1 (en) * 2011-12-07 2013-08-29 Qualcomm Incorporated Sensation enhanced messaging
GB2511663A (en) * 2011-12-20 2014-09-10 Intel Corp Local sensor augmentation of stored content and AR communication
EP2795936B1 (en) * 2011-12-20 2019-06-26 Intel Corporation User-to-user communication enhancement with augmented reality
KR101655876B1 (en) * 2012-01-05 2016-09-09 삼성전자 주식회사 Operating Method For Conversation based on a Message and Device supporting the same
JP5777217B2 (en) * 2012-01-26 2015-09-09 Kddi株式会社 Operation mode pressing a user interface device can be activated, the operation mode activation method and program
US9083546B2 (en) 2012-01-31 2015-07-14 Rajendra Padma Sadhu System and method for communicating health parameters of an occupant in an automobile and a dynamic operation of the automobile and home automation
US20130196293A1 (en) * 2012-01-31 2013-08-01 Michael C. Wood Phonic learning using a mobile computing device having motion sensing capabilities
US8711118B2 (en) * 2012-02-15 2014-04-29 Immersion Corporation Interactivity model for shared feedback on mobile devices
US20120223880A1 (en) * 2012-02-15 2012-09-06 Immersion Corporation Method and apparatus for producing a dynamic haptic effect
EP2629178B1 (en) * 2012-02-15 2018-01-10 Immersion Corporation High definition haptic effects generation using primitives
TWI626591B (en) * 2012-03-01 2018-06-11 Chiun Mai Communication Systems Inc System and method for switching applications
US9702723B2 (en) * 2012-03-01 2017-07-11 Nokia Technologies Oy Method and apparatus for receiving user estimation of navigational instructions
CN102624981A (en) * 2012-03-07 2012-08-01 华为终端有限公司 Data transmission method and device
US20130254233A1 (en) * 2012-03-20 2013-09-26 Avaya Inc. System and method for context-sensitive address book
CN102662578B (en) * 2012-03-29 2015-06-17 华为终端有限公司 Switching control method of desktop container and terminal
CN102662576B (en) * 2012-03-29 2015-04-29 华为终端有限公司 Method and device for sending out information based on touch
CN103389849B (en) * 2012-05-07 2018-10-16 腾讯科技(北京)有限公司 The image display method based on a mobile terminal, system and mobile terminal
WO2013169843A1 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for manipulating framed graphical objects
AU2013259630B2 (en) 2012-05-09 2016-07-07 Apple Inc. Device, method, and graphical user interface for transitioning between display states in response to gesture
WO2013169842A2 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for selecting object within a group of objects
DE112013002430T5 (en) * 2012-05-11 2015-02-19 Semiconductor Energy Laboratory Co., Ltd. Electronic device, storage medium, program and notification procedures
US8570296B2 (en) 2012-05-16 2013-10-29 Immersion Corporation System and method for display of multiple data channels on a single haptic display
US9313290B2 (en) * 2012-05-17 2016-04-12 Ncr Corporation Data transfer between devices
US10013082B2 (en) 2012-06-05 2018-07-03 Stuart Schecter, LLC Operating system with haptic interface for minimally invasive, hand-held surgical instrument
JPWO2014006709A1 (en) * 2012-07-04 2016-06-02 株式会社Hugg Messaging system and message transmission method
US9030428B2 (en) * 2012-07-11 2015-05-12 Immersion Corporation Generating haptic effects for dynamic events
US8914453B2 (en) * 2012-07-18 2014-12-16 Blackberry Limited Method and apparatus for motion based ping during chat mode
EP2688321B1 (en) * 2012-07-18 2015-06-24 BlackBerry Limited Method and apparatus for motion based ping during chat mode
US8493354B1 (en) * 2012-08-23 2013-07-23 Immersion Corporation Interactivity model for shared feedback on mobile devices
GB201215283D0 (en) * 2012-08-28 2012-10-10 Microsoft Corp Searching at a user device
US9116546B2 (en) * 2012-08-29 2015-08-25 Immersion Corporation System for haptically representing sensor input
CN103677242A (en) * 2012-09-24 2014-03-26 联想(北京)有限公司 Method for determining feedback modes and electronic equipment
US8842969B2 (en) * 2012-09-28 2014-09-23 Intel Corporation Haptic playback of video
US9430991B2 (en) * 2012-10-02 2016-08-30 Futurewei Technologies, Inc. User interface display composition with device sensor/state based graphical effects
US10168775B2 (en) * 2012-10-10 2019-01-01 Innovative Devices Inc. Wearable motion sensing computing interface
CN103777797B (en) * 2012-10-23 2017-06-27 联想(北京)有限公司 An information processing method for an electronic device, and
KR20140068410A (en) * 2012-11-28 2014-06-09 삼성전자주식회사 Method for providing user interface based on physical engine and an electronic device thereof
WO2014084374A1 (en) * 2012-11-30 2014-06-05 日本電気株式会社 Communication system, communication method, communication device, program, and recording medium
WO2014088469A1 (en) * 2012-12-07 2014-06-12 Yota Devices Ipr Ltd Display surface contains a cut out region reformatting display data
US9046926B2 (en) 2012-12-17 2015-06-02 International Business Machines Corporation System and method of dynamically generating a frequency pattern to realize the sense of touch in a computing device
CN103902081B (en) * 2012-12-27 2018-04-27 联想(北京)有限公司 The method of tactile feedback and electronic equipment
EP2939096A1 (en) 2012-12-29 2015-11-04 Apple Inc. Device, method, and graphical user interface for determining whether to scroll or select contents
US9501201B2 (en) * 2013-02-18 2016-11-22 Ebay Inc. System and method of modifying a user experience based on physical environment
US9202352B2 (en) 2013-03-11 2015-12-01 Immersion Corporation Automatic haptic effect adjustment system
US9189098B2 (en) 2013-03-14 2015-11-17 Immersion Corporation Systems and methods for syncing haptic feedback calls
US9547366B2 (en) * 2013-03-14 2017-01-17 Immersion Corporation Systems and methods for haptic and gesture-driven paper simulation
US9866924B2 (en) * 2013-03-14 2018-01-09 Immersion Corporation Systems and methods for enhanced television interaction
FR3003362B1 (en) * 2013-03-14 2015-04-03 Univ Compiegne Tech Method and system of tactile communication
JP2014194363A (en) * 2013-03-28 2014-10-09 Fujitsu Ltd Guidance device, guidance method, and program
CN103220424B (en) * 2013-04-10 2016-03-02 广东欧珀移动通信有限公司 Information transmission method and a mobile terminal apparatus
US9939900B2 (en) * 2013-04-26 2018-04-10 Immersion Corporation System and method for a haptically-enabled deformable surface
WO2014190293A2 (en) 2013-05-24 2014-11-27 New York University Haptic force-feedback for computing interfaces
US9729730B2 (en) 2013-07-02 2017-08-08 Immersion Corporation Systems and methods for perceptual normalization of haptic effects
US20150043311A1 (en) * 2013-08-09 2015-02-12 Your Voice S.P.A. Execution of commands in an electronic device
US10037081B2 (en) * 2013-08-12 2018-07-31 Immersion Corporation Systems and methods for haptic fiddling
WO2015029573A1 (en) * 2013-08-29 2015-03-05 ソニー株式会社 Wristband-type information processing device, information processing system, information processing method, and program
US9652945B2 (en) 2013-09-06 2017-05-16 Immersion Corporation Method and system for providing haptic effects based on information complementary to multimedia content
US9443401B2 (en) * 2013-09-06 2016-09-13 Immersion Corporation Automatic remote sensing and haptic conversion system
EP3049882A1 (en) * 2013-09-26 2016-08-03 Longsand Limited Device notifications
US9888333B2 (en) * 2013-11-11 2018-02-06 Google Technology Holdings LLC Three-dimensional audio rendering techniques
US9639158B2 (en) 2013-11-26 2017-05-02 Immersion Corporation Systems and methods for generating friction and vibrotactile effects
US9374688B2 (en) 2013-11-28 2016-06-21 Lg Electronics Inc. Mobile terminal and method for controlling the same
US9996973B2 (en) * 2013-11-30 2018-06-12 Empire Technology Development Llc Augmented reality objects based on biometric feedback
CN103645833B (en) * 2013-12-27 2017-06-27 联想(北京)有限公司 An information processing method and an electronic device
CN103713822B (en) 2013-12-27 2017-09-29 联想(北京)有限公司 An information processing method, and a first electronic device
JP6289100B2 (en) * 2014-01-06 2018-03-07 キヤノン株式会社 The information processing apparatus, information processing method, and program
US20150199024A1 (en) * 2014-01-16 2015-07-16 Immersion Corporation Systems and Methods for User Generated Content Authoring
CN103885708A (en) * 2014-02-28 2014-06-25 宇龙计算机通信科技(深圳)有限公司 Touch interaction method and touch interaction system
CN104902064A (en) * 2014-03-07 2015-09-09 宇龙计算机通信科技(深圳)有限公司 Short message display system and method and terminal
US10067566B2 (en) 2014-03-19 2018-09-04 Immersion Corporation Systems and methods for a shared haptic experience
US9471144B2 (en) 2014-03-31 2016-10-18 Gift Card Impressions, LLC System and method for digital delivery of reveal videos for online gifting
US9606710B1 (en) * 2014-03-31 2017-03-28 Amazon Technologies, Inc. Configuring movement-based user interface control
US9104237B1 (en) * 2014-03-31 2015-08-11 Gift Card Impressions, LLC System and method for digital delivery of reveal videos for online gifting
US20150332534A1 (en) * 2014-05-15 2015-11-19 Narvii Inc. Systems and methods implementing user interface objects
KR20150137913A (en) 2014-05-31 2015-12-09 삼성전자주식회사 Electronic device and method for executing a application
JP2017531930A (en) 2014-07-07 2017-10-26 イマージョン コーポレーションImmersion Corporation Second screen tactile
USD763885S1 (en) * 2014-07-24 2016-08-16 Beijing Qihoo Technology Co. Ltd Display screen with a graphical user interface
US9690381B2 (en) * 2014-08-21 2017-06-27 Immersion Corporation Systems and methods for shape input and output for a haptically-enabled deformable surface
EP3189395A2 (en) 2014-09-02 2017-07-12 Apple Inc. Semantic framework for variable haptic output
DE202015006141U1 (en) 2014-09-02 2015-12-14 Apple Inc. Electronic touch communication
CN105396289A (en) * 2014-09-15 2016-03-16 掌赢信息科技(上海)有限公司 Method and device for achieving special effects in process of real-time games and multimedia sessions
US9535550B2 (en) 2014-11-25 2017-01-03 Immersion Corporation Systems and methods for deformation-based haptic effects
US9971406B2 (en) * 2014-12-05 2018-05-15 International Business Machines Corporation Visually enhanced tactile feedback
GB2533572A (en) * 2014-12-22 2016-06-29 Nokia Technologies Oy Haptic output methods and devices
KR20160088081A (en) * 2015-01-15 2016-07-25 삼성전자주식회사 Haptic interface of image photographing device and method for controlling image photogrqphing device thereof
US9632664B2 (en) 2015-03-08 2017-04-25 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
JP6133344B2 (en) * 2015-03-10 2017-05-24 株式会社コロプラ User interface display method for displaying to the head-mounted display, and program
US9639184B2 (en) 2015-03-19 2017-05-02 Apple Inc. Touch input cursor manipulation
KR20170139508A (en) 2015-04-21 2017-12-19 임머숀 코퍼레이션 Dynamic rendering of etching type
US10200598B2 (en) 2015-06-07 2019-02-05 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US9891811B2 (en) 2015-06-07 2018-02-13 Apple Inc. Devices and methods for navigating between user interfaces
JP5945621B2 (en) * 2015-06-15 2016-07-05 Kddi株式会社 User interface device capable of switching the operating state by the pressing operation, the operation state switching method, and program
US9473625B1 (en) 2015-06-24 2016-10-18 Mast Mobile, Inc. Outgoing call management in a communication environment with unified communication interfaces
US10235035B2 (en) 2015-08-10 2019-03-19 Apple Inc. Devices, methods, and graphical user interfaces for content navigation and manipulation
US20170045981A1 (en) 2015-08-10 2017-02-16 Apple Inc. Devices and Methods for Processing Touch Inputs Based on Their Intensities
US9880735B2 (en) 2015-08-10 2018-01-30 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10248308B2 (en) 2015-08-10 2019-04-02 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interfaces with physical gestures
US10303345B2 (en) 2015-08-28 2019-05-28 Google Llc Transferring notifications between devices
US10248207B2 (en) * 2015-10-28 2019-04-02 Capital One Services, Llc Systems and methods for providing variable haptic feedback
US10102722B2 (en) 2015-12-18 2018-10-16 Immersion Corporation Wearable article having an actuator that performs non-haptic and haptic operations
US9679547B1 (en) * 2016-04-04 2017-06-13 Disney Enterprises, Inc. Augmented reality music composition
WO2017183821A1 (en) * 2016-04-21 2017-10-26 주식회사 씨케이머티리얼즈랩 Method and apparatus for providing tactile message
US9983675B2 (en) 2016-06-10 2018-05-29 Immersion Corporation Systems and methods for monitoring insulation integrity for electrostatic friction
DK201670729A1 (en) 2016-06-12 2018-01-22 Apple Inc Devices, Methods, and Graphical User Interfaces for Providing Haptic Feedback
DK201770369A1 (en) 2016-06-12 2018-02-05 Apple Inc Devices, methods, and graphical user interfaces for providing haptic feedback
US10073525B2 (en) 2016-06-16 2018-09-11 Immersion Corporation Systems and methods for a low profile haptic actuator
JP6401758B2 (en) * 2016-08-25 2018-10-10 株式会社ファセテラピー Tactile content generation apparatus, tactile content generation method and tactile content using apparatus
DK179278B1 (en) 2016-09-06 2018-03-26 Apple Inc Devices, methods and graphical user interfaces for haptic mixture
DK201670720A1 (en) 2016-09-06 2018-03-26 Apple Inc Devices, Methods, and Graphical User Interfaces for Generating Tactile Outputs
CN107015639A (en) * 2017-01-24 2017-08-04 瑞声科技(新加坡)有限公司 Tactile feedback controlling method of dynamic range, tactile feedback system and electronic terminal
WO2019011396A1 (en) * 2017-07-10 2019-01-17 Telefonaktiebolaget Lm Ericsson (Publ) Improved transmission of haptic input

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020177471A1 (en) * 2001-05-23 2002-11-28 Nokia Corporation Mobile phone using tactile icons
WO2006013363A1 (en) * 2004-08-05 2006-02-09 Vodafone Group Plc Haptic input and haptic output in a communications networks
CN1938675A (en) * 2004-03-26 2007-03-28 索尼株式会社 Input device having tactile function, information input method, and electronic device

Family Cites Families (196)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US2001A (en) * 1841-03-12 Sawmill
DE3333538C2 (en) * 1983-09-16 1987-02-05 Bandag Inc., Muscatine, Ia., Us
US4873623A (en) 1985-04-30 1989-10-10 Prometrix Corporation Process control interface with simultaneously displayed three level dynamic menu
JPH04249835A (en) 1990-12-28 1992-09-04 Nec Corp Heat-conductive cooling type microwave tube device
JP3085481B2 (en) * 1991-09-28 2000-09-11 株式会社ニコン Catadioptric reduction projection optical system, and an exposure apparatus having the optical system
JP2827612B2 (en) 1991-10-07 1998-11-25 富士通株式会社 How objects are displayed in the touch panel device and a touch panel device.
JPH05152054A (en) 1991-11-29 1993-06-18 Tokyo Tekko Kk Discharge electrode for static eliminator and manufacture thereof
JP2502914B2 (en) 1992-07-31 1996-05-29 インターナショナル・ビジネス・マシーンズ・コーポレイション De - data transfer method and apparatus
US6433771B1 (en) 1992-12-02 2002-08-13 Cybernet Haptic Systems Corporation Haptic device attribute control
US6374255B1 (en) * 1996-05-21 2002-04-16 Immersion Corporation Haptic authoring
JPH06242886A (en) 1993-02-10 1994-09-02 Canon Inc Electronic mail system
US5999168A (en) * 1995-09-27 1999-12-07 Immersion Corporation Haptic accelerator for force feedback computer peripherals
US6903723B1 (en) 1995-03-27 2005-06-07 Donald K. Forest Data entry method and apparatus
US5666499A (en) 1995-08-04 1997-09-09 Silicon Graphics, Inc. Clickaround tool-based graphical interface with two cursors
JPH10240434A (en) 1997-02-27 1998-09-11 Matsushita Electric Ind Co Ltd Command menu selecting method
US6522417B1 (en) * 1997-04-28 2003-02-18 Matsushita Electric Industrial Co., Ltd. Communication terminal device that processes received images and transmits physical quantities that affect the receiving communication terminal device
JPH1115600A (en) 1997-04-28 1999-01-22 Matsushita Electric Ind Co Ltd Communication terminal which transmits physical quantity operating on one terminal and which can work received picture and transmission terminal/reception temrinal supplied for the same
JPH10341253A (en) 1997-06-05 1998-12-22 Rikuruuto:Kk Electronic mail client device and server device sending/ receiving electronic mail whose destination and sender are not specified and electronic mail system formed by connecting them
JP3655438B2 (en) 1997-07-17 2005-06-02 任天堂株式会社 Video game system
JP4149574B2 (en) 1997-08-29 2008-09-10 ゼロックス コーポレイションXerox Corporation User interface support device, and an information input method
JP3216084B2 (en) * 1998-01-19 2001-10-09 株式会社ネットワークコミュニティクリエイション Chat screen display method
US6545669B1 (en) 1999-03-26 2003-04-08 Husam Kinawi Object-drag continuity between discontinuous touch-screens
US6429846B2 (en) 1998-06-23 2002-08-06 Immersion Corporation Haptic feedback for touchpads and other touch controls
US6211861B1 (en) * 1998-06-23 2001-04-03 Immersion Corporation Tactile mouse device
US6822635B2 (en) 2000-01-19 2004-11-23 Immersion Corporation Haptic interface for laptop computers and other portable devices
US6573883B1 (en) 1998-06-24 2003-06-03 Hewlett Packard Development Company, L.P. Method and apparatus for controlling a computing device with gestures
JP3449937B2 (en) * 1999-01-14 2003-09-22 日本電信電話株式会社 Panoramic image production method and surroundings transfer method using a panoramic image and recording medium storing these methods
US20060279542A1 (en) 1999-02-12 2006-12-14 Vega Vista, Inc. Cellular phones and mobile devices with motion driven control
JP4244784B2 (en) * 1999-03-17 2009-03-25 富士ゼロックス株式会社 Driving force generation device
JP2000325653A (en) 1999-05-19 2000-11-28 Enix Corp Portable videogame device and storage medium with program stored therein
JP4233000B2 (en) * 1999-07-05 2009-03-04 日本電信電話株式会社 Force display device according to the wind pressure in the virtual space
US6496200B1 (en) * 1999-11-02 2002-12-17 Interval Research Corp. Flexible variation of haptic interface resolution
JP2001350570A (en) 2000-06-08 2001-12-21 Yazaki Corp Multifunctional switch device
US20040125120A1 (en) * 2001-06-08 2004-07-01 Michael Weiner Method and apparatus for interactive transmission and reception of tactile information
US7159008B1 (en) 2000-06-30 2007-01-02 Immersion Corporation Chat interface with haptic feedback functionality
JP3949912B2 (en) * 2000-08-08 2007-07-25 株式会社エヌ・ティ・ティ・ドコモ Portable electronic devices, electronic devices, vibration generators, notification method and the notification control method by vibration
US6639582B1 (en) * 2000-08-10 2003-10-28 International Business Machines Corporation System for combining haptic sensory-motor effects from two separate input devices into resultant sensory-motor effects and for feedback of such resultant effects between the input devices
JP2002140166A (en) * 2000-11-02 2002-05-17 Kddi Corp Device for giving feel to finger touching touch panel display
WO2002056272A1 (en) 2000-12-27 2002-07-18 Nokia Corporation Portable vibrating device with adjustable amplitude
AU2002249960A1 (en) * 2001-01-16 2002-07-30 Immersion Corporation Controlling haptic feedback for enhancing navigation in a graphical environment
JP2002334097A (en) * 2001-02-09 2002-11-22 Seiko Epson Corp Service providing system, management terminal, moving body, service providing program, and method for providing service
US7068294B2 (en) 2001-03-30 2006-06-27 Koninklijke Philips Electronics N.V. One-to-one direct communication
FI20010817A (en) * 2001-04-20 2003-02-14 Nokia Corp A method for displaying information on the display of the electronic device and the electronic device
JP2002366852A (en) * 2001-06-11 2002-12-20 Hiitoshinku:Kk Method, system, and program for information acquisition, and information storage medium
GB0117543D0 (en) * 2001-07-18 2001-09-12 Hewlett Packard Co Document viewing device
JP2003051027A (en) * 2001-08-03 2003-02-21 Namco Ltd Game information, information storage medium and game device
JP2003078960A (en) * 2001-09-03 2003-03-14 Ntt Power & Building Facilities Inc Mail system by portable terminal
JP2003085590A (en) * 2001-09-13 2003-03-20 Nippon Telegr & Teleph Corp <Ntt> Method and device for operating 3d information operating program, and recording medium therefor
US7032188B2 (en) * 2001-09-28 2006-04-18 Nokia Corporation Multilevel sorting and displaying of contextual objects
US20030063067A1 (en) * 2001-10-02 2003-04-03 Ping-Yang Chuang Real-time handwritten communication system
US7225115B2 (en) * 2001-10-04 2007-05-29 Novint Technologies, Inc. Coordinating haptics with visual images in a human-computer interface
NO315679B1 (en) 2001-10-19 2003-10-06 Dmates As Rich internet communications
FI115861B (en) 2001-11-12 2005-07-29 Myorigo Oy A method and apparatus for generating a feedback
US8000724B1 (en) 2001-11-14 2011-08-16 Sprint Spectrum L.P. Method and system for subnet-based transmission of mobile station location
JP2003177864A (en) 2001-12-13 2003-06-27 Fuji Photo Film Co Ltd Information terminal system
JP2003188945A (en) 2001-12-13 2003-07-04 Samsung Yokohama Research Institute Co Ltd Portable terminal device
JP2003188946A (en) 2001-12-17 2003-07-04 Nec Corp Cellular phone terminal and its function setting method
JP3975480B2 (en) 2001-12-20 2007-09-12 ソニー株式会社 An information processing apparatus and method, recording medium, and program
US7002553B2 (en) 2001-12-27 2006-02-21 Mark Shkolnikov Active keyboard system for handheld electronic devices
US7347815B2 (en) 2002-02-12 2008-03-25 Razz Serbanescu Method and apparatus for converting sense-perceived thoughts and actions into physical sensory stimulation
US7542773B2 (en) 2002-03-29 2009-06-02 At&T Intellectual Property I, L.P. Customized alerts for incoming data messages
US6904823B2 (en) * 2002-04-03 2005-06-14 Immersion Corporation Haptic shifting devices
US20030211888A1 (en) 2002-05-13 2003-11-13 Interactive Telegames, Llc Method and apparatus using insertably-removable auxiliary devices to play games over a communications link
US7456823B2 (en) * 2002-06-14 2008-11-25 Sony Corporation User interface apparatus and portable information apparatus
AU2002345285A1 (en) * 2002-07-11 2004-02-02 Nokia Corporation Method and device for automatically changing a digital content on a mobile device according to sensor data
JP3838173B2 (en) 2002-07-31 2006-10-25 ソニー株式会社 An information processing apparatus and method, recording medium, and program
JP3937982B2 (en) * 2002-08-29 2007-06-27 ソニー株式会社 An electronic device having input and output device and an input-output device
KR20040025398A (en) 2002-09-19 2004-03-24 삼성전자주식회사 Method for informing incoming call
KR100459560B1 (en) * 2002-10-22 2004-12-03 삼성전자주식회사 Wireless communication apparatus capable of providing service for distinguishing a kind of received sms using indicator icons and method for displaying the indicator icons using that
JP4117352B2 (en) * 2002-11-12 2008-07-16 株式会社ソニー・コンピュータエンタテインメント Available devices this method and file processing method
JP2004177992A (en) 2002-11-22 2004-06-24 Ntt Docomo Inc Mobile terminal with wind pressure sensor, and program executable by mobile terminal with wind pressure sensor
AU2003293449A1 (en) * 2002-12-08 2004-06-30 Immersion Corporation Methods and systems for providing a virtual touch haptic effect to handheld communication devices
US8830161B2 (en) * 2002-12-08 2014-09-09 Immersion Corporation Methods and systems for providing a virtual touch haptic effect to handheld communication devices
US8059088B2 (en) 2002-12-08 2011-11-15 Immersion Corporation Methods and systems for providing haptic messaging to handheld communication devices
GB0229572D0 (en) 2002-12-19 2003-01-22 Cognima Ltd Quality of service provisioning
US7339574B2 (en) * 2003-01-16 2008-03-04 Korean Advanced Institute Of Science And Technology Haptic mouse interface system for providing force and tactile feedbacks to user's fingers and arm
JP3639280B2 (en) 2003-02-12 2005-04-20 任天堂株式会社 Game message display method, and a game program
WO2004075169A2 (en) 2003-02-19 2004-09-02 Koninklijke Philips Electronics, N.V. System for ad hoc sharing of content items between portable devices and interaction methods therefor
EP1637002A1 (en) * 2003-06-20 2006-03-22 Nokia Corporation Mobile device for mapping sms characters to e.g. sound, vibration, or graphical effects
JP2005020563A (en) 2003-06-27 2005-01-20 Casio Comput Co Ltd Mobile terminal and program
US20070168118A1 (en) 2003-06-27 2007-07-19 Dirk Lappe System for coordinating the routes of navigation devices
JP2005078310A (en) * 2003-08-29 2005-03-24 Fuji Xerox Co Ltd Tactile presentation device, tactile presentation method and program thereof
GB0322489D0 (en) * 2003-09-25 2003-10-29 British Telecomm Haptics transmission systems
JP4401728B2 (en) 2003-09-30 2010-01-20 キヤノン株式会社 Mixed reality space image generating method and a mixed reality system
JP4124092B2 (en) 2003-10-16 2008-07-23 沖電気工業株式会社 Driving circuit of the liquid crystal display device
US7532196B2 (en) * 2003-10-30 2009-05-12 Microsoft Corporation Distributed sensing techniques for mobile devices
EP1678654A4 (en) 2003-10-31 2008-07-02 Iota Wireless Llc Concurrent data entry for a portable device
US7128266B2 (en) 2003-11-13 2006-10-31 Metrologic Instruments. Inc. Hand-supportable digital imaging-based bar code symbol reader supporting narrow-area and wide-area modes of illumination and image capture
US7752544B2 (en) * 2003-11-17 2010-07-06 International Business Machines Corporation Method, system, and apparatus for remote interactions
JP3953024B2 (en) * 2003-11-20 2007-08-01 ソニー株式会社 Emotion calculation device and emotional calculation method, and a portable communication device
US7814419B2 (en) * 2003-11-26 2010-10-12 Nokia Corporation Changing an orientation of a user interface via a course of motion
KR20050054731A (en) 2003-12-05 2005-06-10 한국전자통신연구원 Haptic simulation system and method for providing real-time haptic interaction in virtual simulation
US7982711B2 (en) * 2003-12-19 2011-07-19 Immersion Corporation Haptic profiling system and method
US7791588B2 (en) 2003-12-22 2010-09-07 Immersion Corporation System and method for mapping instructions associated with haptic feedback
GB0405004D0 (en) 2004-03-05 2004-04-07 Marconi Comm Ltd Improvements in or relating to a telecommunication network
JP4325449B2 (en) 2004-03-19 2009-09-02 ソニー株式会社 Display control device, display control method, a recording medium
JP2007531113A (en) 2004-03-23 2007-11-01 富士通株式会社 Identification of tilt and translation components of the portable device
US7176886B2 (en) * 2004-03-23 2007-02-13 Fujitsu Limited Spatial signatures
US7176888B2 (en) 2004-03-23 2007-02-13 Fujitsu Limited Selective engagement of motion detection
US7571213B2 (en) * 2004-03-26 2009-08-04 Microsoft Corporation Interactive electronic bubble messaging
US20050219211A1 (en) * 2004-03-31 2005-10-06 Kotzin Michael D Method and apparatus for content management and control
US20050251850A1 (en) 2004-03-31 2005-11-10 Microsoft Corporation System and method for providing REA model based security
US20050219223A1 (en) * 2004-03-31 2005-10-06 Kotzin Michael D Method and apparatus for determining the context of a device
US20060061545A1 (en) 2004-04-02 2006-03-23 Media Lab Europe Limited ( In Voluntary Liquidation). Motion-activated control with haptic feedback
KR100538351B1 (en) * 2004-04-20 2005-12-21 광주과학기술원 method of stabilizing haptic interface and haptic system thereof
US8095081B2 (en) 2004-04-29 2012-01-10 Sony Ericsson Mobile Communications Ab Device and method for hands-free push-to-talk functionality
JP4439351B2 (en) 2004-07-28 2010-03-24 アルパイン株式会社 Vibration imparting method for the vibrating function touch panel input device and the operation input
US7844914B2 (en) * 2004-07-30 2010-11-30 Apple Inc. Activating virtual keys of a touch-screen virtual keyboard
JP2006047534A (en) 2004-08-03 2006-02-16 Alpine Electronics Inc Display control system
WO2006051581A1 (en) 2004-11-09 2006-05-18 Takahiko Suzuki Tactile feedback controller, method of controlling the feedback controller, and method of transmitting message using tactile feedback controller
JP2006163579A (en) 2004-12-03 2006-06-22 Sony Corp Information processing system, information processor and information processing method
KR100670821B1 (en) * 2004-12-21 2007-01-19 한국전자통신연구원 User interface design and evaluation system and hand interaction based user interface design and evaluation system
JP2006201912A (en) 2005-01-19 2006-08-03 Nippon Telegr & Teleph Corp <Ntt> Processing method for three-dimensional virtual object information providing service, three-dimensional virtual object providing system, and program
GB0503253D0 (en) * 2005-02-17 2005-03-23 Univ Northumbria Newcastle User control of a hand-held device
KR101984833B1 (en) 2005-03-04 2019-06-03 애플 인크. Multi-functional hand-held device
KR20060106010A (en) * 2005-04-04 2006-10-12 한국과학기술원 Interactive table set for communication
US20060241864A1 (en) 2005-04-22 2006-10-26 Outland Research, Llc Method and apparatus for point-and-send data transfer within an ubiquitous computing environment
US8339363B2 (en) 2005-05-13 2012-12-25 Robert Bosch Gmbh Sensor-initiated exchange of information between devices
JP2006333355A (en) 2005-05-30 2006-12-07 Toshiba Corp Portable information processing apparatus and operating method thereof
JP4507992B2 (en) 2005-06-09 2010-07-21 ソニー株式会社 An information processing apparatus and method, and program
US20060279476A1 (en) * 2005-06-10 2006-12-14 Gemini Mobile Technologies, Inc. Systems and methods for conveying message composer's state information
US7685530B2 (en) * 2005-06-10 2010-03-23 T-Mobile Usa, Inc. Preferred contact group centric interface
US7779480B2 (en) 2005-06-30 2010-08-17 Microsoft Corporation Identifying dependencies of an application upon a given security context
US20070040810A1 (en) 2005-08-18 2007-02-22 Eastman Kodak Company Touch controlled display device
US20070049301A1 (en) * 2005-08-30 2007-03-01 Motorola, Inc. Articulating emotional response to messages
US7933632B2 (en) 2005-09-16 2011-04-26 Microsoft Corporation Tile space user interface for mobile devices
US8116740B2 (en) 2005-09-21 2012-02-14 Nokia Corporation Mobile communication terminal and method
US7276886B2 (en) 2005-10-03 2007-10-02 Texas Instruments Incorporated Dual buck-boost converter with single inductor
US7636794B2 (en) * 2005-10-31 2009-12-22 Microsoft Corporation Distributed sensing techniques for mobile devices
US20070139366A1 (en) * 2005-12-21 2007-06-21 Dunko Gregory A Sharing information between devices
CN101341799B (en) 2005-12-22 2012-01-11 皇家飞利浦电子股份有限公司 User interface and method for control of light systems
US7509588B2 (en) 2005-12-30 2009-03-24 Apple Inc. Portable electronic device with interface reconfiguration mode
CN101379461A (en) * 2005-12-30 2009-03-04 苹果公司 Portable electronic device with multi-touch input
EP1806643B1 (en) * 2006-01-06 2014-10-08 Drnc Holdings, Inc. Method for entering commands and/or characters for a portable communication device equipped with a tilt sensor
JP2007188126A (en) 2006-01-11 2007-07-26 Fujifilm Corp Image brightness calculation device, method, and program
US7525425B2 (en) 2006-01-20 2009-04-28 Perdiem Llc System and method for defining an event based on relationship between an object location and a user-defined zone
US8587526B2 (en) * 2006-04-12 2013-11-19 N-Trig Ltd. Gesture recognition feedback for a dual mode digitizer
JP2007301270A (en) 2006-05-15 2007-11-22 Sony Computer Entertainment Inc Game control program, game control method, and game apparatus
KR100775190B1 (en) 2006-05-24 2007-11-12 엘지전자 주식회사 Method for multimedia synthesis and terminal using the same
US8571580B2 (en) 2006-06-01 2013-10-29 Loopt Llc. Displaying the location of individuals on an interactive map display on a mobile communication device
US8271902B1 (en) * 2006-07-20 2012-09-18 Adobe Systems Incorporated Communication of emotions with data
JP2008033739A (en) * 2006-07-31 2008-02-14 Sony Corp Touch screen interaction method and apparatus based on tactile force feedback and pressure measurement
US9304675B2 (en) 2006-09-06 2016-04-05 Apple Inc. Portable electronic device for instant messaging
JP4986555B2 (en) * 2006-09-13 2012-07-25 ソニーモバイルコミュニケーションズ株式会社 Communication device, the process executing method and process executing program
US7468573B2 (en) 2006-10-30 2008-12-23 Motorola, Inc. Method of providing tactile feedback
FR2910160A1 (en) 2006-12-13 2008-06-20 France Telecom Telecommunication system for mutual transmission of emotions, has communication interface provided with access unit accessing trajectory traced by user, and with restitution unit restituting trajectory of user to another user
KR101345341B1 (en) 2006-12-13 2013-12-27 삼성전자 주식회사 Apparatus and method for providing a user interface for file transfer
US20080153520A1 (en) * 2006-12-21 2008-06-26 Yahoo! Inc. Targeted short messaging service advertisements
EP1936929A1 (en) 2006-12-21 2008-06-25 Samsung Electronics Co., Ltd Haptic generation method and system for mobile phone
KR101402243B1 (en) 2006-12-21 2014-06-02 삼성전자주식회사 Mobile terminal for providing haptic service and method thereof
US7877707B2 (en) * 2007-01-06 2011-01-25 Apple Inc. Detecting and interpreting real-world and security gestures on touch and hover sensitive devices
KR101364885B1 (en) * 2007-02-21 2014-02-19 엘지전자 주식회사 Method and terminal for displaying received message to icon
US8933891B2 (en) * 2007-03-02 2015-01-13 Lg Electronics Inc. Terminal and method of controlling terminal
US7966638B2 (en) * 2007-03-30 2011-06-21 Google Inc. Interactive media display across devices
CN101290553A (en) * 2007-04-17 2008-10-22 索尼(中国)有限公司 Electronic equipment possessing display screen
WO2008132540A1 (en) * 2007-04-26 2008-11-06 Nokia Corporation Method and mobile terminal with user input based on movement of the terminal detected by a sensor
US7941000B2 (en) * 2007-05-11 2011-05-10 Koninklijke Philips Electronics N.V. Method for producing an image and system for producing an image
US8315652B2 (en) * 2007-05-18 2012-11-20 Immersion Corporation Haptically enabled messaging
US9317110B2 (en) * 2007-05-29 2016-04-19 Cfph, Llc Game with hand motion control
US9965132B2 (en) * 2007-06-08 2018-05-08 Apple Inc. Presenting text messages
JP2009003799A (en) 2007-06-22 2009-01-08 Aplix Corp Portable equipment and method of providing virtual space in portable equipment
US7788032B2 (en) * 2007-09-14 2010-08-31 Palm, Inc. Targeting location through haptic feedback signals
US8201108B2 (en) * 2007-10-01 2012-06-12 Vsee Lab, Llc Automatic communication notification and answering method in communication correspondance
US8631358B2 (en) 2007-10-10 2014-01-14 Apple Inc. Variable device graphical user interface
KR101430452B1 (en) 2007-10-15 2014-08-14 엘지전자 주식회사 Communication device and method of providing location information thereof
US20090140986A1 (en) * 2007-11-30 2009-06-04 Nokia Corporation Method, apparatus and computer program product for transferring files between devices via drag and drop
CN101178615A (en) 2007-12-12 2008-05-14 美新半导体(无锡)有限公司 Gesture, movement induction system and portable electronic apparatus using same
US9569086B2 (en) 2007-12-12 2017-02-14 Nokia Technologies Oy User interface having realistic physical effects
US9170649B2 (en) 2007-12-28 2015-10-27 Nokia Technologies Oy Audio and tactile feedback based on visual environment
US8373549B2 (en) * 2007-12-31 2013-02-12 Apple Inc. Tactile feedback in an electronic device
KR100952698B1 (en) 2008-03-10 2010-04-13 한국표준과학연구원 Tactile transmission method using tactile feedback apparatus and the system thereof
US8239769B2 (en) * 2008-04-22 2012-08-07 Verizon Patent And Licensing Inc. System and method for selling preference-based virtual objects
JP5045559B2 (en) 2008-06-02 2012-10-10 富士通モバイルコミュニケーションズ株式会社 Mobile terminal
US20090309825A1 (en) 2008-06-13 2009-12-17 Sony Ericsson Mobile Communications Ab User interface, method, and computer program for controlling apparatus, and apparatus
US8306576B2 (en) 2008-06-27 2012-11-06 Lg Electronics Inc. Mobile terminal capable of providing haptic effect and method of controlling the mobile terminal
US8532637B2 (en) 2008-07-02 2013-09-10 T-Mobile Usa, Inc. System and method for interactive messaging
CN102099766B (en) * 2008-07-15 2015-01-14 意美森公司 Systems and methods for shifting haptic feedback function between passive and active modes
KR101899506B1 (en) 2009-01-29 2018-09-20 임머숀 코퍼레이션 Systems and methods for interpreting physical interactions with a graphical user interface
US20100214243A1 (en) 2008-07-15 2010-08-26 Immersion Corporation Systems and Methods For Interpreting Physical Interactions With A Graphical User Interface
US8274484B2 (en) 2008-07-18 2012-09-25 Microsoft Corporation Tracking input in a screen-reflective interface environment
US8587601B1 (en) * 2009-01-05 2013-11-19 Dp Technologies, Inc. Sharing of three dimensional objects
US8516396B2 (en) * 2009-01-30 2013-08-20 International Business Machines Corporation Object organization based on user interactions within a virtual environment
US8123614B2 (en) 2010-04-13 2012-02-28 Kulas Charles J Gamepiece controller using a movable position-sensing display device including a movement currency mode of movement
US8266551B2 (en) * 2010-06-10 2012-09-11 Nokia Corporation Method and apparatus for binding user interface elements and granular reflective processing
EP2629178B1 (en) 2012-02-15 2018-01-10 Immersion Corporation High definition haptic effects generation using primitives
US8711118B2 (en) 2012-02-15 2014-04-29 Immersion Corporation Interactivity model for shared feedback on mobile devices
US9245428B2 (en) 2012-08-02 2016-01-26 Immersion Corporation Systems and methods for haptic remote control gaming
US8493354B1 (en) 2012-08-23 2013-07-23 Immersion Corporation Interactivity model for shared feedback on mobile devices
US9116546B2 (en) 2012-08-29 2015-08-25 Immersion Corporation System for haptically representing sensor input
US9330544B2 (en) 2012-11-20 2016-05-03 Immersion Corporation System and method for simulated physical interactions with haptic effects
US9836150B2 (en) 2012-11-20 2017-12-05 Immersion Corporation System and method for feedforward and feedback with haptic effects
US20140139451A1 (en) 2012-11-20 2014-05-22 Vincent Levesque Systems and Methods For Providing Mode or State Awareness With Programmable Surface Texture
US20140198130A1 (en) 2013-01-15 2014-07-17 Immersion Corporation Augmented reality user interface with haptic feedback
US9880623B2 (en) 2013-01-24 2018-01-30 Immersion Corporation Friction modulation for three dimensional relief in a haptic device
US9041647B2 (en) 2013-03-15 2015-05-26 Immersion Corporation User interface device provided with surface haptic sensations
US9645647B2 (en) 2015-05-13 2017-05-09 Immersion Corporation Systems and methods for haptic feedback for modular devices

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020177471A1 (en) * 2001-05-23 2002-11-28 Nokia Corporation Mobile phone using tactile icons
CN1938675A (en) * 2004-03-26 2007-03-28 索尼株式会社 Input device having tactile function, information input method, and electronic device
WO2006013363A1 (en) * 2004-08-05 2006-02-09 Vodafone Group Plc Haptic input and haptic output in a communications networks

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
JOHN WILLIAMSON 等: "Excitatory Multimodal Interaction on Mobile Devices", 《PROCEEDINGS OF CHI 2007》 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103227960A (en) * 2012-01-31 2013-07-31 三星电子株式会社 Display apparatus, upgrading apparatus, control method thereof and display system
CN105144033A (en) * 2013-03-15 2015-12-09 高通股份有限公司 Extending interactive inputs via sensor fusion
CN106133636A (en) * 2014-03-21 2016-11-16 意美森公司 Systems and methods for haptically-enabled curved devices
CN106468780A (en) * 2015-08-20 2017-03-01 联发科技股份有限公司 Portable device and related vibration detecting method
US10007304B2 (en) 2015-08-20 2018-06-26 Mediatek Inc. Portable device and related vibration detecting method
CN106468780B (en) * 2015-08-20 2018-11-30 联发科技股份有限公司 A portable device associated with shock detection method

Also Published As

Publication number Publication date
JP2011528537A (en) 2011-11-17
US20170031445A1 (en) 2017-02-02
EP2741177B1 (en) 2019-06-26
KR101838425B1 (en) 2018-03-13
US20150378437A1 (en) 2015-12-31
KR101661368B1 (en) 2016-09-29
JP2017199378A (en) 2017-11-02
EP2329637A1 (en) 2011-06-08
JP2015212956A (en) 2015-11-26
US8587417B2 (en) 2013-11-19
KR20180071416A (en) 2018-06-27
CN102099766B (en) 2015-01-14
CN102160366A (en) 2011-08-17
CN102100055A (en) 2011-06-15
US20180348870A1 (en) 2018-12-06
US10203756B2 (en) 2019-02-12
US9612662B2 (en) 2017-04-04
KR20110036115A (en) 2011-04-06
CN103970209A (en) 2014-08-06
US20150268727A1 (en) 2015-09-24
EP2329339A1 (en) 2011-06-08
JP2017004547A (en) 2017-01-05
JP2014170560A (en) 2014-09-18
KR20180051675A (en) 2018-05-16
JP6433556B2 (en) 2018-12-05
JP5897631B2 (en) 2016-03-30
US9229532B1 (en) 2016-01-05
JP5642252B2 (en) 2014-12-17
JP2014002770A (en) 2014-01-09
WO2010009163A1 (en) 2010-01-21
EP2327201A2 (en) 2011-06-01
CN102099766A (en) 2011-06-15
JP5899253B2 (en) 2016-04-06
US20180004295A1 (en) 2018-01-04
EP2313820A1 (en) 2011-04-27
KR20160114738A (en) 2016-10-05
JP2014139797A (en) 2014-07-31
JP5997898B2 (en) 2016-09-28
US10198078B2 (en) 2019-02-05
KR20180029101A (en) 2018-03-19
US20130201141A1 (en) 2013-08-08
US9785238B2 (en) 2017-10-10
US20100013653A1 (en) 2010-01-21
JP2016149135A (en) 2016-08-18
US8462125B2 (en) 2013-06-11
US8866602B2 (en) 2014-10-21
US9063571B2 (en) 2015-06-23
WO2010009152A1 (en) 2010-01-21
EP2723107A1 (en) 2014-04-23
JP2018026142A (en) 2018-02-15
EP3130983A1 (en) 2017-02-15
EP3480680A1 (en) 2019-05-08
JP5410520B2 (en) 2014-02-05
CN102099767A (en) 2011-06-15
JP2011528476A (en) 2011-11-17
US20170168579A1 (en) 2017-06-15
EP3496376A1 (en) 2019-06-12
JP6043763B2 (en) 2016-12-14
CN107066035A (en) 2017-08-18
WO2010009149A3 (en) 2010-04-01
EP2327201B1 (en) 2018-09-05
EP2313820B1 (en) 2017-04-05
KR20110031979A (en) 2011-03-29
EP3220616A1 (en) 2017-09-20
EP3206381A1 (en) 2017-08-16
CN104111726B (en) 2017-05-24
JP6449934B2 (en) 2019-01-09
JP2015007998A (en) 2015-01-15
US20100017489A1 (en) 2010-01-21
KR20110036617A (en) 2011-04-07
US20180260029A1 (en) 2018-09-13
EP3236337A1 (en) 2017-10-25
US9910496B2 (en) 2018-03-06
KR101788995B1 (en) 2017-10-20
KR101956999B1 (en) 2019-03-11
US8638301B2 (en) 2014-01-28
KR20160018842A (en) 2016-02-17
CN104111726A (en) 2014-10-22
US20100013761A1 (en) 2010-01-21
KR20160120798A (en) 2016-10-18
JP2011528475A (en) 2011-11-17
US20150002280A1 (en) 2015-01-01
US9477309B2 (en) 2016-10-25
JP6272960B2 (en) 2018-01-31
JP2019057302A (en) 2019-04-11
JP5337877B2 (en) 2013-11-06
EP3130983B1 (en) 2018-11-14
JP2019071076A (en) 2019-05-09
JP5762285B2 (en) 2015-08-12
US9134803B2 (en) 2015-09-15
US20190179413A1 (en) 2019-06-13
EP2741177A1 (en) 2014-06-11
JP2011528474A (en) 2011-11-17
JP2014067430A (en) 2014-04-17
KR20140141658A (en) 2014-12-10
US20190121440A1 (en) 2019-04-25
KR20110052629A (en) 2011-05-18
JP2011528477A (en) 2011-11-17
JP2015057719A (en) 2015-03-26
CN104571336A (en) 2015-04-29
JP5690726B2 (en) 2015-03-25
KR20170031800A (en) 2017-03-21
KR101989763B1 (en) 2019-06-14
KR101404367B1 (en) 2014-06-20
KR101690469B1 (en) 2016-12-27
US10248203B2 (en) 2019-04-02
KR20180127533A (en) 2018-11-28
CN106990811A (en) 2017-07-28
US10019061B2 (en) 2018-07-10
US20100045619A1 (en) 2010-02-25
KR20160018829A (en) 2016-02-17
JP6180360B2 (en) 2017-08-16
KR101300429B1 (en) 2013-08-26
KR20170129273A (en) 2017-11-24
KR101871646B1 (en) 2018-06-26
JP2014194785A (en) 2014-10-09
KR101600226B1 (en) 2016-03-11
KR20160031027A (en) 2016-03-21
JP6109877B2 (en) 2017-04-05
US8976112B2 (en) 2015-03-10
JP5599922B2 (en) 2014-10-01
US20160109950A1 (en) 2016-04-21
WO2010009149A2 (en) 2010-01-21
KR20110031978A (en) 2011-03-29
JP2018088260A (en) 2018-06-07
US20100017759A1 (en) 2010-01-21
CN103970209B (en) 2017-09-19
US20140091914A1 (en) 2014-04-03
US20140104162A1 (en) 2014-04-17
KR101522145B1 (en) 2015-05-20
JP5955369B2 (en) 2016-07-20
WO2010009157A1 (en) 2010-01-21
KR20140027543A (en) 2014-03-06
EP2723107B1 (en) 2019-05-15
CN102160366B (en) 2014-05-14
JP6208791B2 (en) 2017-10-04
WO2010009145A1 (en) 2010-01-21
EP2329636A1 (en) 2011-06-08
US20150199013A1 (en) 2015-07-16
CN102187647B (en) 2014-07-23

Similar Documents

Publication Publication Date Title
Williamson et al. Shoogle: excitatory multimodal interaction on mobile devices
US9170649B2 (en) Audio and tactile feedback based on visual environment
US9582178B2 (en) Systems and methods for multi-pressure interaction on touch-sensitive surfaces
US9927873B2 (en) Systems and methods for using textures in graphical user interface widgets
US9354839B2 (en) Storage medium storing object movement controlling program and information processing apparatus
KR101098015B1 (en) Touchless gesture based input
JP6499392B2 (en) System and method for simulated physical interactions with haptic effects
US9330478B2 (en) Augmented reality creation using a real scene
US20140189506A1 (en) Systems And Methods For Interpreting Physical Interactions With A Graphical User Interface
US8549419B2 (en) Mobile terminal providing graphic user interface and method of providing graphic user interface using the same
JP2019050003A (en) Simulation of tangible user interface interactions and gestures using array of haptic cells
US10101873B2 (en) Portable terminal having user interface function, display method, and computer program
CN105556423B (en) System and method for the haptic effect based on pressure
CN103246472B (en) Method and device for haptic pinch gesture
KR101491189B1 (en) Haptical content in a text message
US20090256809A1 (en) Three-dimensional touch interface
US20110199342A1 (en) Apparatus and method for providing elevated, indented or texturized sensations to an object near a display device or input detection using ultrasound
JP4561888B2 (en) Vibration control method in an information processing apparatus, and an information processing apparatus
US9134797B2 (en) Systems and methods for providing haptic feedback to touch-sensitive input devices
JP6092506B2 (en) Tactilely enhanced bi-directional bi-directional content
JP2019067436A (en) Display device and display method thereof
US9367233B2 (en) Display apparatus and method thereof
JP2012123564A (en) Information processing program, information processor, information processing system and information processing method
CN107102721A (en) Systems and methods for providing haptic effects
CN102822784A (en) Apparatuses, methods and computer programs for a virtual stylus

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
C14 Grant of patent or utility model
C56 Change in the name or address of the patentee

Owner name: YIMEISEN CO., LTD.

Free format text: FORMER NAME: IMMERSION CORP.