JP6131270B2 - Integrating sensing functions using haptic sleeves into mobile devices - Google Patents

Description

Priority claim under 35 U.S.C. 119 This application is incorporated by reference herein in its entirety for all purposes and is named “Integrating Sensation Functionalities into a Mobile Device Using a Haptic Sleeve”. Claims priority to US Provisional Patent Application No. 61 / 577,615, filed on December 19, 2011.

  Aspects of the present disclosure relate to computing technology. In particular, aspects of the present disclosure relate to mobile computing device technologies, such as systems, methods, apparatuses, and computer readable media for integrating sensing functions into mobile devices using a haptic sleeve.

  Currently, mobile devices such as mobile phones, smartphones, tablet computers, and other mobile computing devices can only provide limited haptic functions, even if they provide some haptic functions. For example, a mobile device may provide simple haptic feedback in a limited environment (e.g., temporarily to notify a user that a text message has been received or a telephone call is incoming). Vibrate), but in some cases there may be a lack of software and / or hardware that may be necessary to provide a more advanced haptic effect. In addition or alternatively, the mobile device may lack the components necessary to capture the sensing input. For example, the mobile device may not include one or more sensors that allow the mobile device to receive sensing input in the form of deformations or protrusions, thermal effects, and the like. By implementing one or more aspects of the present disclosure, e.g., using a haptic sleeve to integrate sensing functionality into the mobile device, increasing functionality and flexibility for mobile device users , And increased convenience.

  Systems, methods, apparatus, and computer readable media for integrating sensing functions into a mobile device using a haptic sleeve are presented. As mentioned above, current mobile devices such as mobile phones, smartphones, tablet computers, and other mobile computing devices can only provide limited haptic functions. For example, a mobile device may provide simple haptic feedback in a limited environment (e.g., temporarily to notify a user that a text message has been received or a telephone call is incoming). In some cases, there may be a lack of software and / or hardware that may provide a higher haptic effect or may be necessary to capture the sensing input. Aspects of the present disclosure provide a more convenient and effective way to provide and receive higher sense haptic feedback for sensing input from a user of a mobile device using peripheral accessories such as a haptic sleeve A simple and easy-to-use method.

  In accordance with one or more aspects of the present disclosure, a haptic sleeve may be provided to enable and / or improve the haptic function of a mobile device. In one or more configurations, such haptic sleeves may in some cases have some haptic effects (e.g., touch sensing, pressure sensing, moisture sensing, adhesion sensing, thermal sensing, vibration sensing, and Mobile devices that lack hardware and / or software that may be needed to reproduce (and / or any other effects that a person can sense using a person's haptics) and / or capture sensing input As a peripheral accessory. The sensory input can be received and / or received by, for example, a mobile device and / or a haptic sleeve, and a particular surface feel (e.g., the haptic sleeve and / or one or more included therein). Tactile characteristics of an object or event, such as a specific lug or rag touch that touches the sensor of the sensor) or a specific deformation event (for example, a deformation with a specific duration and magnitude that simulates pork or tap sensing) And / or includes one or more electrical signals that define it. Although these types of sensing inputs are described herein as examples, other types of sensing inputs are similarly haptic sleeves in place of and / or in addition to the types of sensing inputs described herein. Can be captured by.

  As described in more detail below, the haptic sleeve may, for example, provide the haptic feedback to the user as output and / or receive haptic data from the user as input. Can include one or more haptic components that allow the haptic sleeve to communicate with the mobile device, extract power from the mobile device, and / or be controlled by the mobile device And a data interface. Additionally or alternatively, the haptic sleeve may be configured to be molded, molded, stitched, assembled, and / or possibly physically engaged with the mobile device. For example, a haptic sleeve may clip on and / or in some cases slide or mate around one or more sides and / or surfaces of a mobile device Can be configured. Advantageously, these and other features described herein may provide enhanced functionality, flexibility, and convenience to users of mobile devices.

  In accordance with one or more aspects of the present disclosure, a computing device, such as a smartphone, tablet computer, or other mobile device, receives one or more haptic forces of the haptic sleeve via the haptic sleeve. Sensing input captured by the sense component can be received. Subsequently, the computing device can store haptic data corresponding to the received sensing input. For example, when storing such haptic data, the computing device is received via one or more haptic components of the haptic sleeve during a period of time corresponding to a particular event. Information representing one or more electrical signals to be stored can be stored, such as the magnitude, position, duration, and / or type of sensing captured during that time period, It may reflect various characteristics of the sensing input received by the computing device in connection with a particular event.

  Subsequently, in one or more configurations, the computing device can cause the at least one receiving device to send haptic data corresponding to the received sensing input. Additionally or alternatively, the haptic data may be configured to cause at least one receiving device to provide haptic feedback based on the received sensing input.

  In one or more additional and / or alternative configurations, the computing device can cause the receiving device to send haptic data corresponding to the received sensing input, the haptic data being transmitted to the receiving device. Based on a sensing input received via a second haptic sleeve communicatively coupled to the receiving device, the receiving device may be configured to provide haptic feedback. In this way, the user sends haptic communications and / or other haptic messages in a “sleeve to sleeve” or from one haptic sleeve to another. May be possible to receive.

  In at least one configuration, the haptic sleeve can include a curvilinear housing that includes one or more haptic components and can be configured to engage a computing device. Additionally or alternatively, the haptic sleeve may include an input / output interface configured to communicatively couple the haptic sleeve to the computing device.

  In one or more additional and / or alternative configurations, storing haptic data corresponding to the received sensing input includes at least one position value, at least one intensity value, and at least one duration value. Can be stored. These values may represent, for example, one or more vectors that represent sensed inputs received during a particular time period.

  Further, in one or more additional and / or alternative configurations, the computing device can receive image data associated with the received sensing input. Subsequently, the computing device may store the received image data. In at least one configuration, storing the received image data may include aligning the image data with the received sensing input and storing the matched image data. In this way, the computing device not only captures how the object "looks" (e.g., by storing an image of the object), but may also be aligned with the image of the object (e.g., Can capture how an object "feels" (by recording the object's feel).

  Further, in one or more configurations, storing haptic data corresponding to the received sensing input may include storing haptic data representing at least one non-vibration sensing. “Non-vibration” sensing may include any sensing that includes at least one effect that does not involve causing vibration.

  Further, in one or more additional and / or alternative configurations, the computing device can establish a connection with at least one recipient device, followed by haptic data corresponding to the received sensory input. Can be sent to at least one recipient device. The computing device can then receive additional sensing input captured by one or more haptic components of the haptic sleeve via the haptic sleeve. The computing device can then stream additional haptic data corresponding to the additional sensing input to the at least one receiving device via the established connection. In this way, users may be able to send and receive haptic communications and / or other haptic messages in real time with each other.

  According to one or more additional aspects of the present disclosure, a haptic sleeve may be provided. The haptic sleeve may include a curved housing, one or more haptic components included in the curved housing, and an input / output interface. The input / output interface is configured to allow the computing device to activate one or more haptic components, and the curved housing engages the computing device. Can be configured.

  In one or more configurations, the one or more haptic components are configured to provide haptic feedback to a user of the computing device. In one configuration, haptic feedback may include pork sensing. In another configuration, the haptic feedback is provided by a second user of the second computing device and corresponds to a sensing input received by a second haptic sleeve associated with the second computing device. obtain.

  In one or more configurations, the computing device may be a smartphone and / or the input / output interface may be a universal serial bus (USB) interface. In some configurations, the curved housing may be configured to form a rigid plastic shell for at least one side of the computing device, while in other configurations, the curved housing is the computing device's It can be configured to form a soft foam case for at least one side. In at least one configuration, the input / output interface may be further configured to allow the computing device to receive sensing input from one or more haptic components.

  According to one or more additional aspects of the present disclosure, feedback means for providing haptic feedback, interface means for enabling a computing device to control the feedback means, and computing A device may be provided that may include a receiving means for engaging the device. In one or more configurations, the containing means may contain feedback means and interface means.

  According to one or more additional aspects of the present disclosure, a device such as a haptic sleeve may establish a data connection with a computing device. Subsequently, the device can receive a haptic input from a user and the device can send the haptic input to the computing device. In one or more configurations, a data connection may be established via a USB interface and / or an APPLE iPod Dock connector interface. Additionally or alternatively, the computing device may not include a component that can receive haptic input.

  In at least one configuration, the device may physically engage the computing device prior to establishing a data connection with the computing device. In at least one additional or alternative configuration, the device can receive one or more haptic commands from the computing device, and the device is based on the one or more received haptic commands. One or more tactile sensations can be provided to the user. Additionally or alternatively, the device may not include components that can provide one or more haptic sensing.

  According to one or more additional aspects of the present disclosure, a haptic force can be received at the first haptic sleeve and corresponding to the haptic input at the second haptic sleeve. Sense feedback can be provided. In at least one configuration, the haptic input may be transmitted from the first haptic sleeve to the second haptic sleeve.

  Aspects of the present disclosure are shown by way of example. In the accompanying drawings, like reference numbers indicate like elements.

FIG. 3 illustrates an example of a haptic sleeve for integrating sensing functionality into a mobile device, according to one or more exemplary aspects of the present disclosure. FIG. 3 illustrates an example of a system including a haptic sleeve according to one or more exemplary aspects of the present disclosure. FIG. 6 illustrates an example method for integrating sensing functionality into a mobile device using a haptic sleeve, according to one or more example aspects of the present disclosure. FIG. 4 illustrates an exemplary method for providing haptic communication using a haptic sleeve, according to one or more exemplary aspects of the present disclosure. FIG. 6 illustrates a further example of a haptic sleeve according to one or more exemplary aspects of the present disclosure. FIG. 6 illustrates a further example of a haptic sleeve according to one or more exemplary aspects of the present disclosure. FIG. 3 illustrates an example method for receiving and storing sensed inputs according to one or more example aspects of the present disclosure. FIG. 3 illustrates an example of receiving a sensing input via a haptic sleeve according to one or more exemplary aspects of the present disclosure. FIG. 4 illustrates an example of haptic data corresponding to a received sensing input, according to one or more exemplary aspects of the present disclosure. FIG. 11 illustrates an example system for providing haptic communication in accordance with one or more example aspects of the present disclosure. FIG. 4 illustrates an example method for receiving haptic data and providing haptic feedback according to one or more example aspects of the present disclosure. FIG. 3 illustrates an example of receiving a sense input via a haptic sleeve and providing haptic feedback according to one or more exemplary aspects of the present disclosure. FIG. 3 illustrates an example of receiving a sense input via a haptic sleeve and providing haptic feedback according to one or more exemplary aspects of the present disclosure. FIG. 6 illustrates an example method for providing haptic communication according to one or more example aspects of the present disclosure. FIG. 11 illustrates an example computing system in which one or more aspects of the present disclosure can be implemented.

  Several exemplary embodiments will be described with reference to the accompanying drawings, which form a part hereof. Specific embodiments in which one or more aspects of the disclosure may be implemented are described below, but other embodiments may be used without departing from the scope of the disclosure or the scope of the appended claims. And various changes can be made.

  FIG. 1A illustrates an example of a haptic sleeve for integrating sensing functionality into a mobile device, according to one or more exemplary aspects of the present disclosure. In one or more configurations, the haptic sleeve 100 is formed by a curved housing 105 and / or may include a curved housing 105 as the case may be. In some configurations, the curved housing 105 may be formed from a relatively hard plastic material (eg, such that the curved housing 105 forms a hard plastic shell for a computing device). In other configurations, the curved housing 105 may be a relatively soft cloth material (e.g., nylon) and / or a foam or rubber material (e.g., such as to form a soft foam case for a computing device). Neoprene).

  In addition, haptic sleeve 100 and / or curvilinear housing 105 may further include one or more haptic components, such as haptic components 115, 120, 125, and 130. Each of the one or more haptic components may be configured to provide one or more haptic effects and / or receive one or more forms of haptic input Can be configured. In one or more configurations, any and / or all of the haptic components provide one or more haptic sensing as a haptic output to a user of the computing device and / or from the user To receive tactile information as a tactile force input, stitched into, embedded in, and / or optionally contained within, the curved housing 105 of the tactile sleeve 100 and / or a curved housing 105 may be disposed along one or more outer surfaces. In at least one configuration, the haptic component is configured such that the first component capable of outputting a particular haptic sense and the second component capable of receiving an input corresponding to the same particular haptic sense; It can be provided in input / output pairs as provided in combination. For example, haptic sleeve 100 and / or curvilinear housing 105 may include input / output pairs of thermal haptic components such as component 115 and component 120, and components 125 and 130, etc. And an input / output pair of protrusion haptic components. As examples of haptic components that may be included in the haptic sleeve 100, these components are described herein, but instead of and / or in addition to the components shown in FIG. Other components may be included in the haptic sleeve 100.

  In at least one configuration, one or more of the haptic components are woven into the haptic sleeve 100, molded therein, or optionally attached thereto, commercially available haptic output. It can be an actuator and / or a tactile input sensor. Examples of such commercially available haptic output actuators and haptic input sensors are manufactured and / or sold by companies such as Pressure Profile Systems, Inc., Los Angeles, California and Senseg Ltd., Helsinki, Finland, Actuators, sensors, and other components are included. Other companies that manufacture and / or sell biometric devices and / or touch sensors, such as ST Microelectronics and Bosch, may also provide such commercially available haptic output actuators and haptic input sensors.

  In addition, the haptic sleeve 100 and / or the curved housing 105 may also include an input / output interface 110. The input / output interface 110, for example, enables a computing device to establish a connection (eg, a data connection) with the haptic sleeve 100 and / or is included in the haptic sleeve 100. It may be possible to control one or more of the elements. For example, the input / output interface 110 allows a computing device connected to the haptic sleeve 100 to activate one or more of the haptic components (e.g., to generate various haptic senses). And may receive sensing data corresponding to input received by one or more of the haptic components. In at least one configuration, the input / output interface 110 may include a universal serial bus (USB) interface. In one or more additional or alternative configurations, the input / output interface 110 may include any other interface that allows the haptic sleeve 100 to establish a connection with a mobile device, such as an APPLE iPod Dock interface, for example. .

  In some embodiments, the input / output interface 110 of the haptic sleeve 100 may allow power to be supplied to the haptic sleeve 100. For example, power may be supplied to the haptic sleeve 100 from one or more devices connected to the haptic sleeve via the input / output interface 110. In some configurations, a computing device connected to the haptic sleeve 100 selectively activates and / or in some cases selectively powers the haptic sleeve 100 Can do. For example, the connected computing device cannot power on the haptic sleeve 100 if the power level of the computing device falls below a certain level. In addition or alternatively, to conserve power, the connected computing device can only provide some haptic effects at some power levels (e.g., low power levels) Only one or more haptic components of the haptic sleeve 100 may be selectively activated and / or selectively powered.

  In some embodiments, the haptic sleeve 100 can be activated and / or powered on demand, for example, instead of being continuously powered. In some configurations, the haptic sleeve 100 may receive certain user input, such as a computing device connected to the haptic sleeve 100 and / or gestures made on the haptic sleeve 100 itself. Can be activated in response. For example, a user may perform a swipe gesture on the haptic sleeve 100 and / or touch a hot corner of the haptic sleeve 100 to power on the haptic sleeve 100. In other additional and / or alternative configurations, the haptic sleeve 100 may include a button or switch that activates and / or deactivates it.

  In some configurations, a device connected to the haptic sleeve 100 may power up the haptic sleeve 100 in response to receiving specific data, such as a specific message. For example, a device connected to the haptic sleeve 100 activates the haptic sleeve 100 in response to receiving a message, or other content that includes haptic data, and / or possibly haptics. It may be determined to power on the haptic sleeve 100 (and subsequently supply power to the haptic sleeve 100).

  In some embodiments, the haptic sleeve 100 may further include one or more batteries and / or other power sources and / or hardware. In some configurations, the battery included in the haptic sleeve 100 can only be used when powering the haptic sleeve 100 itself, while in other configurations, the battery included in the haptic sleeve 100 is It can also be used when powering the computing device to which the haptic sleeve 100 is connected. For example, in some embodiments, the haptic sleeve 100 can be used as a battery pack for the computing device to which it is connected. In configurations where both the computing device to which the haptic sleeve 100 is connected and the haptic sleeve 100 itself have separate batteries and / or other power sources, the haptic sleeve 100 is connected to the haptic sleeve 100. Included in the device to which the haptic sleeve 100 is connected (e.g., one or more batteries and / or power management hardware included in a smartphone to which the haptic sleeve 100 can be connected) The extracted power (from other hardware) may be used to charge and / or recharge the battery or batteries.

  In some embodiments, the haptic sleeve 100 can take the form of a backplate for a smartphone, tablet computer, or other mobile device to which it can be connected. In particular, the haptic sleeve 100 may be configured to cover all or a portion of one or more sides of the mobile device. Additionally or alternatively, for example, the haptic sleeve 100 can be a compatible part of the housing of the mobile device to which it can be connected. For example, the haptic sleeve 100 can be configured to cover one or more inner and / or outer portions of a mobile device to which it can be connected. Further, the haptic sleeve 100 may form and / or optionally provide an outer surface of a mobile device to which it can be connected.

  In some embodiments, the haptic sleeve 100 may be connected via one or more wired connections and / or one or more wired communication interfaces (e.g., a USB or APPLE iPod Docket interface as described above). ) To and / or communicate with one or more computing devices. Additionally or alternatively, the haptic sleeve 100 can be connected via one or more wireless connections and / or via one or more wireless communication interfaces (eg, Bluetooth®, Zigbee® ) Or the like) may be connected to and / or communicate with one or more computing devices. As described below, the haptic sleeve 100 delivers haptic communication to one or more other haptic sleeves and / or one or more other users of such sleeves, And / or may be used when receiving haptic communications from them. These communications may be transmitted over one or more networks in some cases, and in other cases peer-to-peer connections between one or more haptic sleeves (e.g., direct wired connections and / or Or wireless connection). In at least one configuration, a peer-to-peer connection to another haptic sleeve may be established via the input / output interface 110 of the haptic sleeve 100. Additionally or alternatively, in some cases, such sleeve-to-sleeve haptic communication can be point-to-point communication (e.g., from one haptic sleeve to another haptic sleeve) In other cases, there may be point-to-multipoint communication (eg, from one haptic sleeve to several other haptic sleeves).

  FIG. 1B illustrates an example of a system 150 that includes a haptic sleeve 155 in accordance with one or more exemplary aspects of the present disclosure. As can be seen in FIG. 1B, the system 150 can also include a mobile device 160 to which a haptic sleeve 155 can be communicatively coupled. In some configurations, mobile device 160 may be a mobile computing device such as a smartphone, tablet computer, laptop computer, or any other type of computing device. In addition, the system 150, the haptic sleeve 155, and / or the mobile device 160 may incorporate one or more embodiments described herein.

  In some embodiments, the mobile device 160 may include one or more subsystems including a sleeve control subsystem 165, a sense control subsystem 170, and a sense sharing subsystem 175. One or more communication paths may be provided that allow one or more subsystems to communicate with each other and exchange data. In addition, the various subsystems shown in FIG. 1B may be implemented in software, hardware, or a combination thereof. In at least one configuration, each of the subsystems shown in FIG. 1B may be provided by one or more processors and / or memory units included in mobile device 160. A single processor included in mobile device 160 may provide, for example, all of these subsystems in some cases, but in other cases, each subsystem may be a separate processor in mobile device 160. As and / or provided by another processor. In some cases, mobile device 160 may include subsystems other than the subsystem shown in FIG. 1B. In addition, the embodiment shown in FIG. 1B is just one example of a system that can include some embodiments, in other embodiments the system 150 and / or mobile device 160 are shown in FIG. 1B. There can be more or fewer subsystems than subsystems, two or more subsystems can be combined, or have different configurations or arrangements of subsystems.

  In some embodiments, the sleeve control subsystem 165 receives a sensing input from the haptic sleeve 155 that the mobile device 160 captures by one or more haptic components included in the haptic sleeve 155. It may be possible to receive. For example, the sleeve control subsystem 165 receives, interprets, and / or optionally processes one or more signals received from one or more haptic components included in the haptic sleeve 155. Such a signal can correspond to a sensing input provided via the haptic sleeve 155. In addition, the sleeve control subsystem 165 may allow the mobile device 160 to provide haptic feedback via the haptic sleeve 155. For example, the sleeve control subsystem 165 can operate via the haptic sleeve 155 by actuating and / or possibly controlling one or more haptic components included in the haptic sleeve 155. Tactile feedback can be provided.

  In some embodiments, the sense control subsystem 170 may allow the mobile device 160 to store haptic data associated with one or more senses that may be provided as haptic feedback. For example, the sensing control subsystem 170 may store haptic data corresponding in some instances to sensing inputs received by the sleeve control subsystem 165 of the mobile device 160 from the haptic sleeve 155. In some cases, the sensing control subsystem 170 may include one or more predefined sensing and / or one or more user-defined that may be provided as haptic feedback via the haptic sleeve 155. It is also possible to store haptic data corresponding to the perception.

  In some embodiments, the sensing sharing subsystem 175 may allow the mobile device 160 to send haptic data to one or more other devices. For example, the sensing sharing subsystem 175 may allow the mobile device 160 to send haptic data to one or more recipient devices for sensing input received via the haptic sleeve 155. In addition, the sensing sharing subsystem 175 may allow the mobile device 160 to receive haptic data from one or more other devices. Such haptic data can represent, for example, one or more senses provided as haptic feedback via the haptic sleeve 155 (eg, to a user of the mobile device 160).

  The embodiment shown in FIG. 1B and the example described above illustrate various subsystems as included in the mobile device 160, but in some additional and / or alternative embodiments, any of these subsystems may be used. Alternatively, and / or all may be incorporated into the haptic sleeve 155 and / or possibly provided by the haptic sleeve 155. For example, in some additional and / or alternative embodiments, the haptic sleeve 155 may include a sleeve control subsystem 165, a sense control subsystem 170, and a sense sharing subsystem 175. Additionally or alternatively, the haptic sleeve 155 may include various hardware and / or software for implementing any and / or all of these subsystems.

  FIG. 2 illustrates an exemplary method for integrating sensing functionality into a mobile device using a haptic sleeve. In step 205, the haptic sleeve 100 may physically engage the computing device (e.g., the curved housing 105 of the haptic sleeve 100 may include one or more sides of the computing device and / or Or attached to a surface and / or optionally combined with them). In step 210, the haptic sleeve 100 may establish a data connection with the computing device (eg, via the input / output interface 110). In step 215, the haptic sleeve 100 (e.g., via one or more haptic components included in the haptic sleeve 100, such as the heat input component 115 and the protrusion input component 125). Haptic user input can be received. In step 220, the haptic sleeve 100 may send haptic user input to the computing device (eg, via the input / output interface 110).

  In step 225, the haptic sleeve 100 may receive one or more haptic commands (eg, from a computing device via the input / output interface 110). In at least one configuration, the one or more instructions are transmitted to the haptic sleeve 100, such as one or more senses defined by a second user of the second computing device, such as It can be configured to provide haptic feedback including multiple sensing. Additionally or alternatively, the haptic feedback is a sensory input provided by the second user, connected to the second computing device and / or possibly associated with the second computing device. The sensory input received by the second computing device via the two haptic sleeves may be accommodated. Subsequently, in step 230, the haptic sleeve 100 is one (e.g., by activating and / or modulating one or more of the haptic components included in the haptic sleeve 100). Alternatively, one or more haptic senses corresponding to multiple haptic commands may be provided. In this way, haptic sleeves may be provided to computing devices that may not be able to provide one or more types of haptic feedback in that case. Can be provided.

  FIG. 3 illustrates an exemplary method for providing haptic communication using a haptic sleeve, according to one or more exemplary aspects of the present disclosure. In step 305, the first haptic sleeve may receive a haptic input from a first user (eg, “User A”). The first haptic sleeve may perform one or more functions of the haptic sleeve 100 described above, for example. Additionally or alternatively, the first haptic sleeve can be physically engaged with, attached to, and / or possibly coupled to the first computing device, The computing device may be, for example, a mobile phone or tablet computer that implements one or more aspects of the computer system 1100 described below. Further, the first haptic sleeve may establish a data connection with the first computing device (eg, via a USB interface), for example.

  After receiving the haptic input, the first haptic sleeve may output haptic data corresponding to the received haptic input to the first computing device in step 310. The first computing device can receive haptic data from the first haptic sleeve, and in step 315, the first computing device can store the haptic data. For example, the first computing device may be working so that haptic data can be modified by the first computing device and / or shared with one or more other devices and / or users. Haptic data can be stored in the memory.

  In step 320, the first computing device uses the stored tactile sensation data, for example, a second computing device (eg, another mobile device) that may be used by a second user (eg, “User B”). Phone or tablet computer). For example, the first computing device stores via a wired and / or wireless data connection (eg, using a wireless local area network, Bluetooth connection, NFC connection, cellular data connection, etc.) Transmitted haptic data may be transmitted to a second computing device. Subsequently, in step 325, the second computing device can receive haptic data from the first computing device. Additionally or alternatively, the second computing device is equipped with a second haptic sleeve (e.g., similar to the manner in which the first computing device can be equipped with the first haptic sleeve). obtain.

  In step 330, the second computing device provides haptic feedback to the second haptic sleeve based on the received haptic data (e.g., the user of the second computing device and / or the first The second haptic sleeve may be controlled to provide a second haptic sleeve. For example, in step 330, the second computing device causes the second haptic sleeve to provide one or more haptic senses defined by the received haptic data. One or more haptic components included in the haptic sleeve may be electronically activated. Subsequently, in step 335, the second haptic sleeve is electronically (e.g., one or more haptic components included in the second haptic sleeve by the second computing device). One or more tactile sensations may be provided to the second user (as a result of actuating). In this way, the first haptic sleeve connected to the first computing device can, for example, touch a second user of the second computing device that can be provided with a second haptic sleeve. It can be used by the first user to provide haptic feedback.

  Here, an example has been described in which a haptic sleeve is used to provide haptic communication, but the sensing input is captured using the haptic sleeve and subsequently communicatively coupled to the haptic sleeve. A method that can be stored by a particular computing device is described with respect to FIG.

  FIG. 5 illustrates an example method for receiving and storing sense inputs according to one or more example aspects of the present disclosure. At step 505, a user of the computing device may sense a tactile sensation on the computing device that may implement and / or implement one or more aspects of the example computer system 1100, described in more detail below, for example. A sleeve can be connected. In one or more configurations, connecting the haptic sleeve to the computing device couples the haptic sleeve to the computing device such that the haptic sleeve physically engages the computing device. Can be included. Additionally or alternatively, connecting the haptic sleeve to the computing device may include communicatively coupling the input / output interface of the haptic sleeve to the input / output interface of the computing device. For example, if the computing device is a smartphone or tablet computer, connecting the haptic sleeve to the computing device may connect one or more electrical connectors of the haptic sleeve to one or more of the computing device. It may include inserting into a port or vice versa.

  In step 510, the computing device may enter a sense capture mode. In one or more configurations, the sense capture mode monitors and / or stores measurements received by the computing device via one or more haptic components of the connected haptic sleeve. It can be in a state of getting. For example, measurements may include analog signal amplitudes and / or changes (e.g., starting amounts and / or subsequent changes in current and / or voltage received via one or more haptic components), and / or Or it may represent an initial value and / or a change in the digital signal (eg, the starting amount and / or subsequent change in digital data received via one or more haptic components). In at least one configuration, the computing device automatically enters a sense acquisition mode in response to detecting that the haptic sleeve is connected (and / or possibly based on detection). Can be configured. Additionally or alternatively, the computing device is provided by the user, such as a menu item or user selection of a specific application provided and / or executed by the computing device to which the haptic sleeve is connected. May be configured to enter a sense acquisition mode in response to (and / or possibly based on) the command.

  In step 515, the computing device may receive sensing input captured by one or more components of the haptic sleeve. As described above, the sensing input captured by one or more components of the haptic sleeve and received by the computing device can be analog signal information and / or can be digital signal information. There is sex. If the computing device receives analog signal information as a sensing input, the computing device may, for example, have one or more amplitude and / or direction values of the sensing input at a particular time and / or a particular location of the haptic sleeve. The analog signal information can be processed digitally to identify For example, the computing device can calculate one or more vectors representing the sensory input, and can be certain (e.g., known to be at a particular location on the haptic sleeve) The vector component of the vector can be determined based at least in part on the starting amount and / or subsequent change in analog current and / or voltage measured by the haptic component. In another example, if the computing device receives digital signal information as a sensing input, the computing device calculates a similar vector representing the sensing input (and may be at a particular location on the haptic sleeve). The vector component of the vector can be determined based at least in part on the initial value and / or subsequent changes in the digital data output by a particular haptic component (which may be known). In at least one configuration, the digital data output by a particular haptic component may further include location information, and the computing device may include a location included in the digital data received from the haptic component. The vector component can be determined based at least in part on the information.

  In one or more configurations, the sensing input captured by one or more components of the haptic sleeve may reflect non-vibration sensing and / or correspond to non-vibration sensing. “Non-vibration” sensing may include any sensing that includes at least one effect that does not involve causing vibration. Examples of non-vibration sensing include touch sensing, pressure sensing, moisture sensing, sticky sensing, and thermal sensing, generated alone or in combination with each other or in combination with one or more vibration sensing. For example, touch sensing or protrusion effects generated alone or in combination (eg, with each other) may be considered non-vibrating haptic sensing. As another example, protrusion effects and vibration sensing generated in combination (e.g., with each other) can be considered non-vibrating haptic sensing, but the generated vibration sensing itself is non-vibrating haptic sensing. May not be considered.

  In step 520, the computing device may store haptic data corresponding to the received sensory input. In one or more configurations, storing haptic data corresponding to the received sensing input stores one or more position, intensity, and / or duration values representing the received sensing input Can include. For example, the computing device may store a calculated and / or possibly determined vector and / or vector component representing the received sensing input.

  In step 525, the computing device may exit a sense capture mode. For example, in step 525, the computing device stops monitoring and / or storing measurements received via one or more haptic components of the connected haptic sleeve. there is a possibility. In some configurations, a computing device may have a predetermined amount of time since it entered sensed capture mode or since a sensing input was last received via one or more haptic components. There is a possibility of exiting the sense acquisition mode based on determining that it has elapsed. In other configurations, the computing device may exit a sense capture mode based on a user-initiated command, such as, for example, a user selection of a menu item displayed by the computing device as part of the user interface.

  In optional step 530, the computing device may capture image data, such as image data stored in association with haptic data. As described in more detail below, by capturing image data and / or storing such image data associated with haptic data, a computing device can detect objects, events, or other scenes. It is possible to capture both the “appearance” and “feel” of the. Additionally or alternatively, the computing device can then display the image data and provide relevant feedback to play both the “look” and “feel” of the captured object, event, or scene. Can be. In one or more configurations, capturing image data may include capturing an image of a scene using one or more integrated or possibly connected cameras. In addition or alternatively, capturing image data can be an image file (e.g., from a location in the memory of the computing device, via a network such as the Internet, from a removable memory device attached to the computing device, etc.) Receiving.

  In optional step 535, the computing device may store the captured image data. In one or more configurations, storing the captured image data may include aligning the image data with the sensed input and storing the aligned image data. For example, how objects, events, or scenes in an image feel differently to more accurately capture the “look” and “feel” of the objects, events, or scenes captured in the image data It may be desirable to match the image data with the sensing input such that the tactile sensation data corresponding to the sensing input more closely reflects. In some configurations, the computing device, for example, captures image data with an integrated camera and sensed input with the haptic sleeve at about the same time, and then the integrated camera and the haptic sleeve identify the image data. The image data can be automatically aligned with the haptic data by using a pre-determined equation for correlating the points or pixels with specific points of the sensing input. In other configurations, the computing device may display or possibly provide a user interface that allows a user to manually align image data with haptic data. For example, the computing device moves images corresponding to haptic data and image data associated with received sensory input, which can be shown in a user interface using, for example, one or more icons, and / or Alternatively, a user interface that prompts the user to scale can be displayed.

  Subsequently, at step 540, the computing device may send the stored haptic data and stored image data to one or more receiving devices. In some cases, the computing device may send only stored haptic data to one or more recipient devices (e.g., image data is captured and / or optional at steps 530 and / or 535). Or if it was not remembered). In one or more configurations, haptic data may include information that enables one or more recipient devices to provide haptic feedback that reflects the received sensory input. For example, if the sensed input received corresponds to the user poke or stroke the haptic sleeve in a particular way (eg, in a particular rhythm or in a particular shape such as a heart) Haptic data is connected to tactile feedback (e.g., connected to the receiving device) that the receiving device feels like a pork or stroke in a particular way (e.g., in a particular rhythm or of a particular shape). May be provided to a receiving user who touches or holds the haptic sleeve that has been made.

  In one or more additional configurations, when both haptic data and image data are sent to one or more receiving devices, the combination of haptic data and image data is one or more. Allows the receiving device to not only reflect the received sensing input, but also to provide tactile feedback that closely matches or in some cases corresponds to the captured image features Information may be included. For example, if the image data includes a carpet photo and the haptic data corresponds to the carpet touch, the image data and the haptic data may be stored in the carpet touch while the receiving device displays the carpet photo simultaneously. It may be possible to provide tactile feedback that feels the same. In this way, the user of the receiving device can feel how the various parts of the object included in the image can actually feel.

  Although an exemplary method has been described in which a sensing input can be captured using a haptic sleeve and subsequently stored by a computing device communicatively coupled to the haptic sleeve, such sensing input. Some examples of how can be captured and stored are described with respect to FIGS. 6A and 6B.

  FIG. 6A illustrates an example of receiving sensing input via a haptic sleeve according to one or more exemplary aspects of the present disclosure. For example, as can be seen in FIG. 6A, the mobile computing device 600 and the haptic sleeve 610 can be connected. In one or more configurations, the haptic sleeve 610 can physically engage the mobile device 600, and can substantially cover the back side of the mobile device 600, for example.

  Once the haptic sleeve 610 and the mobile device 600 are connected, a user of the mobile device 600 may provide a sensing input to the mobile device 600 by interacting with the haptic sleeve 610. For example, in the example shown in FIG. 6A, the user can use his / her finger 615 to poke the haptic sleeve 610, thereby resulting in a deformation 620 of the surface of the haptic sleeve. The deformation 620 can then be received as a sensing input by the mobile device 600 via the haptic sleeve 610. Additionally or alternatively, mobile device 600 may store haptic data or deformation 620 corresponding to the sensing input by performing one or more steps of the exemplary method described above.

  An example of haptic data that can be captured and stored when a user provides sensing input in this manner via the haptic sleeve is shown in FIG. 6B. In particular, FIG. 6B illustrates an example of haptic data corresponding to a received sensing input, according to one or more exemplary aspects of the present disclosure.

  For example, as can be seen in FIG. 6B, when receiving and storing haptic data corresponding to the deformation 620 received as the sensing input in the example described above, the mobile computing device 600 receives the received sensing input or deformation 620. A series of values representing can be received and stored. The value received and stored by the computing device 600 receives information, for example, information about one or more specific haptic effects (eg, deformation or “pork” haptic effects) that represent the received sense. Information about the position (e.g. in coordinates mapped to the surface of the haptic sleeve 610), information about the magnitude of the haptic effect representing the received sense (e.g. in the case of the deformation 620 shown in this example) May include information about the duration of the haptic effect that represents the received sense (e.g., the number of seconds or milliseconds received a particular sense) . As can be seen in the example shown in FIG. 6B, the various values associated with the sensing input are such that these values are substantially discrete effects (e.g., discrete increases or decreases in the temperature of the haptic sleeve 610). ) In addition to combined movements (e.g., strengthened and then weakened poke movements, or when a user moves his / her finger in a pattern shape, such as a heart or a figure drawn over a short period of time When dynamic perception (such as a moving contour) can be represented, it can change over time.

  As described above, after the computing device receives and stores the sensory inputs, it sends haptic data corresponding to the stored sensory inputs and / or in some cases, those data may be transmitted to the haptic sensor. It can be shared with one or more other devices that can be configured to provide haptic feedback based on the data. An example of a system in which one user can provide sensing input on one haptic sleeve to allow another user to receive corresponding haptic feedback on the haptic sleeve will now be described with respect to FIG. Is done.

  FIG. 7 illustrates an example system for providing haptic communication according to one or more example aspects of the present disclosure. In the system 700, a first haptic sleeve 705 can be connected to a first computing device 710, which can receive sensing input via the haptic sleeve 705. . In addition, the first computing device 710 may store haptic data representing such sensed input, for example, by performing one or more steps of the exemplary method described above. And / or haptic data can be sent to the message server 715. Subsequently, message server 715 may send haptic data to a second computing device 720 that may receive and decode haptic data, as described below. Subsequently, the second computing device 720 provides haptic feedback to the user of the second computing device 720 via the second haptic sleeve 725 connected thereto based on the haptic data. Can be provided. In this way, one user can configure the first haptic sleeve 705 to cause another user to receive specific haptic feedback via the other user's own haptic sleeve 725. Can be used. Additionally or alternatively, other users may similarly use the haptic sleeve 725 to cause the first user to receive specific haptic feedback via the first haptic sleeve 705. Can be.

  An example of steps that a computing device may perform in receiving haptic data and subsequently providing haptic feedback based on the haptic data is now described with respect to FIG.

  FIG. 8 illustrates an exemplary method for receiving haptic data and providing haptic feedback according to one or more exemplary aspects of the present disclosure. At step 805, a user of the computing device may sense a tactile sensation on the computing device that may implement and / or implement one or more aspects of the exemplary computer system 1100, described in more detail below, for example. Sleeves can be connected and the haptic sleeve can be connected to a computing device in a manner similar to how such a haptic sleeve can be connected in step 505 of the exemplary method described above.

  In step 810, the computing device may receive haptic data. In one or more configurations, the haptic data is as part of an electronic message, such as a text message or email that may be received by the computing device (e.g., as content embedded within the electronic message, or as electronic Can be received as a message attachment). In one or more additional and / or alternative configurations, haptic data may be received as part of a stream session or via a peer-to-peer connection with another computing device. In at least one configuration, receiving the haptic data can include receiving image data associated with the haptic data, and in some cases, the image data is as described above, Can be matched with haptic data.

  In step 815, the computing device may decrypt the received haptic data. In at least one configuration, decoding the haptic data may include one or more data structures included in the haptic data (e.g., on the haptic sleeve in providing haptic feedback). It may include decomposing into individual vectors and / or vector components that can be mapped to one or more specific haptic effects (reproduced).

  Subsequently, at step 820, the computing device may determine to provide specific haptic feedback based on the haptic data. For example, in some cases, the computing device may decide to provide haptic feedback that matches the haptic feedback defined by the haptic data, while in other cases, the computing device The wing device may decide to provide an alternative haptic feedback that is similar to, but not necessarily matched to, the haptic feedback defined by the haptic data. In one or more configurations, the computing device provides specific haptic feedback based on one or more user preferences, the function of the connected haptic sleeve, and / or other information Can be determined. For example, the haptic data specifies that thermal sensing should be provided as haptic feedback, the user sets a preference that specifies that thermal effects should not be provided, and / or the haptic sleeve is heated. If it does not include the components necessary to reproduce the effect, the computing device may decide to provide an alternative haptic feedback that does not include thermal sensing as defined in the haptic data.

  Thereafter, in step 825, the computing device provides haptic feedback (e.g., haptic feedback determined by the computing device to provide in step 820) via the connected haptic sleeve. obtain. In instances where the computing device also received image data along with the haptic data, such as image data that is aligned with the haptic data, the computing device provides haptic feedback via the haptic sleeve. In addition, the image data can be further displayed.

  Having described exemplary methods that a computing device may perform in receiving haptic data and providing haptic feedback based on the haptic data, how a sensory input is a single haptic An example will now be described with respect to FIGS. 9A and 9B showing how it can be captured on a haptic sleeve and replayed on another haptic sleeve.

  In particular, FIGS. 9A and 9B illustrate an example of receiving sensation input and providing haptic feedback via a haptic sleeve according to one or more exemplary aspects of the present disclosure. As can be seen in FIG. 9A, the mobile computing device 900 can capture a sensing input via a connected haptic sleeve 910 that pokes the haptic sleeve 910 and It may include a pork effect corresponding to the user's finger 915 resulting in a deformation 920 of the sleeve 910. Subsequently, the mobile computing device 900 can store haptic data corresponding to the captured sensory input and send the haptic data to another computing device, eg, as described above.

  Subsequently, as can be seen in FIG. 9B, the receiving mobile computing device 950 can receive haptic data from the first mobile computing device 900. The receiving mobile computing device 950 is connected to the haptic sleeve 960 and may be based on haptic data received from the first mobile computing device 900. Tactile force feedback may be provided based on the force data. For example, when providing such haptic feedback, the mobile computing device 950 can cause the haptic sleeve 960 to form a protrusion 970 that has a position, size (e.g., length, In width and / or depth) and / or duration may correspond to deformation 920 received as a sensing input on other haptic sleeves 910.

  Referring now to FIG. 10, an example of providing real-time haptic communication between a haptic sleeve and a corresponding computing device via a streaming peer-to-peer data connection will now be described.

  FIG. 10 illustrates an example method for providing haptic communication according to one or more example aspects of the present disclosure. In step 1005, a user of the computing device may sense a tactile sensation on the computing device that may implement and / or implement one or more aspects of the example computer system 1100, described in further detail below, for example. Sleeves can be connected and the haptic sleeve can be connected to a computing device in a manner similar to how such a haptic sleeve can be connected in step 505 of the exemplary method described above. In the following exemplary method description, for convenience of reference, this computing device may be referred to as a “source device”.

  In step 1010, the source device may establish a connection with another computing device that may be referred to as a “target device”. In one or more configurations, the target device can comprise its own haptic sleeve, and / or possibly its haptic force, similar to the way the source device can be connected to the haptic sleeve. Can be connected to a sense sleeve. According to one or more aspects, the connection established between the source device and the target device enables the source device and the target device to exchange information including haptic data in real time. There may be a streaming peer-to-peer data connection. By establishing such a connection, the user of the source device can send a tactile sensation instant message to the user of the target device and / or receive the instant message from the user and vice versa. You can also. Additionally or alternatively, the sensing input and haptic feedback output may be captured and / or provided by a haptic sleeve at both the source device and the target device.

  For example, in step 1015, the source device can receive a sensing input captured by a haptic sleeve connected thereto. For example, the source device can receive sensing input in the form of protrusions, as in the example described above.

  Subsequently, in step 1020, the source device can store haptic data corresponding to the received sensing input. For example, the source device may store haptic data representing the protrusion received as a sensing input in step 1015.

  In step 1025, the source device may send haptic data to the target device via the connection established in step 1010. In one or more configurations, the source device may send haptic data substantially simultaneously when a sensing input is received. For example, the source device may have a position of deformation on the haptic sleeve of the source device (e.g., when the user slides his / her finger along the surface of the haptic sleeve), on the haptic sleeve of the source device. The magnitude of the deformation (e.g., if the user is increasing or decreasing the pressure applied to the surface of the haptic sleeve with his / her finger thereby changing the pressure and / or depth of the deformation), and / or Or the aspect of the protrusion, such as the duration of deformation on the haptic sleeve of the source device (e.g., the user is changing the position and / or pressure applied to the haptic sleeve at different time intervals) Even when it may have changed, haptic data representing the protrusion received as a sensing input in step 1015 may be sent.

  In step 1030, the target device may receive haptic data sent by the source device via a connection established between the two devices. Then, in step 1035, the target device can provide haptic feedback via a haptic sleeve connected to the target device, which can be based on haptic data received from the source device. There is sex. For example, if the haptic data includes information about the protrusion described in the above example, the target device can reproduce the protrusion on the haptic sleeve corresponding to the protrusion represented by the haptic data. .

  In step 1040, the target device may receive a sensing input via its haptic sleeve. Such sensory input may represent, for example, a response to the user of the source device by the user of the target device. For example, in response to receiving a pork from a user at the source device, the user at the target device can have his / her finger traced over the target device's haptic sleeve in the shape of a smiley face. Received as sensing input by the device.

  In step 1045, the target device may store haptic data representing the sensed input received at 1040. Subsequently, in step 1050, the target device may send this haptic data to the source device via a connection established between the two devices. As described above, in one or more configurations, the target device may send haptic data to the source device substantially simultaneously when sensing input is received by the target device.

  Thereafter, in step 1055, the source device can receive haptic data, and in step 1060, the source device can provide haptic feedback to the user of the source device via the haptic sleeve. The haptic feedback provided to the source device user via the haptic sleeve is based on haptic data received from the target.

  Although various methods and examples have been described for receiving, storing and providing haptic feedback using haptic sleeves and other features that may be provided by a computing device and / or haptic sleeve Several additional aspects of the present disclosure will now be described.

  As explained above, haptic feedback may be missing from current mobile device platforms. Including such feedback may provide a new communication dimension. Haptic feedback can include anything that a human can feel (eg, with one or both hands), such as pressure, hand, pressure, heat, slip, shape, corners, and the like. Aspects of the present disclosure relate to incorporating these sensing into cellular messaging services provided via mobile devices.

  According to one or more aspects, haptic sensing can be incorporated into a mobile device by integrating a haptic feedback sensor into the mobile device sleeve accessory. This improves user interaction with the mobile device and may allow multiple interface designs to improve, customize and enhance tactile sensing usability. Additionally or alternatively, sleeve-to-sleeve interaction (eg, “peer-to-peer” mode) may simplify the transmission and replication of haptic feedback from one mobile device to another mobile device or group of mobile devices. Further, the sleeve accessory can provide compatibility across multiple handset manufacturers and platforms and / or can provide operating system (OS) independence.

  In one or more configurations, haptic feedback may be added to the mobile device by the addition of a mobile accessory (eg, peripheral) device such as a sleeve. Currently, basic sleeves (eg, not including haptic functions) can be a common accessory for mobile devices. In addition, the mobile phone accessory industry has grown rapidly to meet the ever-increasing needs of consumers, with the addition of popular culture, science, and marketing. For example, the adoption of touch screens has exploded, but current touch screens may not provide any kind of tactile feedback (e.g. one person may be in a video conversation or any other social media May not feel human touch at the remote end). According to one or more aspects, phones and / or mobile devices can be expanded with this dimension (eg, haptic haptic feedback), including peripheral devices.

  Currently, many mobile devices can be used to power and / or control the haptic sleeve, Universal Serial Bus (USB) port and / or APPLE iPod Dock connector port (e.g. Power / USB port). The haptic sleeve can then function as a transducer by providing and / or capturing haptic sensing.

  FIG. 4A illustrates how an exemplary haptic sleeve 400 may fit around a mobile device 405 that is configured to be held in a user's hand 410. FIG. 4B shows an example of an array 450 of mobile phone “skins” that can be modified to be haptic sleeves and / or replaced with haptic sleeves.

  Application and / or user interface array design may be possible using these devices (eg, haptic sleeves). For example, a mobile device may provide a customizable touch tone (eg, not just a plane vibration) instead of and / or in addition to a ring tone.

  Accordingly, aspects of the present disclosure allow and include at least one haptic / tactile feedback sensor in a peripheral device of a mobile device. In at least one configuration, the mobile device peripheral can be designed as a mobile device sleeve. In one or more configurations, the mobile device peripheral may be connected to the mobile device interface. In some configurations, the mobile device interface may be a USB port. Additionally or alternatively, the mobile device interface can provide power to the mobile device peripheral and / or the mobile device interface can provide a means for recording and / or playing haptic feedback. it can.

  According to one or more additional aspects of the present disclosure, at least one of the mobile device peripherals may be used to record haptic feedback. The recorded haptic feedback can be transmitted to at least one other mobile device. The recorded haptic feedback may be received as a haptic feedback message. The received haptic feedback information may be interpreted by the mobile device and communicated with a peripheral device (eg, a peripheral device connected to the mobile device). Subsequently, haptic feedback can be played on the peripheral of the receiving mobile device.

  Additional aspects of the present disclosure include communication via USB and / or other connected interfaces and / or via a number of technologies such as WiFi, Bluetooth, near field communication (NFC), etc. Including, for example, between a haptic sleeve and a computing device, between a haptic sleeve and another haptic sleeve). Further additional and / or alternative embodiments are that when the haptic accessory is turned on and / or the phone (or other mobile device) comprises a haptic sleeve and the phone (or other mobile device) Only when held in the user's hand, enables and includes the haptic effect to be interpreted by the user and communicated to the user. Additionally or alternatively, the user / recipient chooses to turn on and / or off receipt of haptic effects based on one or more filters and / or such haptic effects Can be used as a touch tone instead of and / or in addition to a ring tone.

  Having described multiple aspects of using a haptic sleeve to integrate sensing functionality into a mobile device, referring now to FIG. 11, for an example computing system in which various aspects of the present disclosure may be implemented explain. According to one or more aspects, the computer system shown in FIG. 11 may be incorporated as part of a computing device, and any of the features, methods, and / or method steps described herein. And / or all may be implemented, implemented, and / or implemented. For example, computer system 1100 can represent some of the components of a handheld device. A handheld device may be any computing device with an input sensory unit, such as a camera and / or display unit. Examples of handheld devices include, but are not limited to, video game consoles, tablets, smartphones, and mobile devices. In one embodiment, the computer system 1100 is configured to implement the haptic sleeve 100 described above. For example, the computer system 1100 may include one or more components of the haptic sleeve 100 described above, including one or more haptic components such as components 115, 120, 125, and 130. May be included. FIG. 11 may perform the methods provided by various other embodiments as described herein, and / or a host computer system, remote kiosk / terminal, point-of-sale device, mobile FIG. 6 provides a schematic diagram of an embodiment of a computer system 1100 that can serve the functions of a device, set-top box, and / or computer system. FIG. 11 is only meant to provide a generalized view of the various components, some and / or all of which can be utilized as needed. FIG. 11 thus roughly shows how individual system elements can be implemented in a relatively individualized or relatively more integrated manner.

  Computer system 1100 is illustrated as comprising hardware elements that may be electrically coupled via bus 1105 (or may be in some other form of communication, as appropriate). These hardware elements include, without limitation, one or more general purpose processors and / or one or more dedicated processors (such as digital signal processing chips, graphics acceleration processors, and / or the like). One or more processors 1110, including, without limitation, one or more input devices 1115, which may include, without limitation, cameras, mice, keyboards, and / or the like, and display units, printers And / or may include one or more output devices 1120.

  The computer system 1100 can include, without limitation, local and / or network accessible storage and / or without limitation, disk drives, drive arrays, optical storage devices, programmable, flash rewritable One or more non-transitory, which may include solid state storage devices such as random access memory (“RAM”) and / or read only memory (“ROM”), and / or the like Storage device 1125 may further be provided (and / or communicated). Such storage devices may be configured to implement suitable data storage, including, without limitation, various file systems, database structures, and / or the like.

  Computer system 1100 includes, but is not limited to, a modem, network card (wireless or wired), infrared communication device, wireless communication device and / or chipset (Bluetooth® device, 802.11 device, Wi-Fi device, A communication subsystem 1130 may also be included, which may include WiMAX devices, cellular communication facilities, etc.) and / or the like. The communication subsystem 1130 allows data to be exchanged with a network (such as the network described below), other computer systems, and / or any other device described herein. Can be. In many embodiments, the computer system 1100 further comprises a non-transitory working memory 1135 that may include a RAM or ROM device as described above.

  Computer system 1100 may include an operating system 1140, device drivers, executable libraries, and / or computer programs provided by various embodiments and / or implement methods as described herein. And / or currently located in working memory 1135, including other code, such as one or more application programs 1145, that may be designed to configure a system implemented by other embodiments Software elements may also be provided, illustrated as By way of example only, for example, one or more of the procedures described with respect to the methods described above with respect to FIGS. 2, 3, 5, 8, and / or 10 may be performed on a computer (and / or in a computer). Code) and / or instructions executable by a processor), and in certain aspects, such code and / or instructions may then be executed to perform one or more operations according to the described methods. It can be used to configure and / or adapt a general purpose computer (or other device).

  A set of these instructions and / or code may also be stored on a computer-readable storage medium, such as the storage device 1125 described above. In some cases, the storage medium may be incorporated within a computer system such as computer system 1100. In other embodiments, the storage medium may be separated from the computer system (e.g., such that the storage medium may be used to program, configure, and / or apply a general purpose computer having instructions / code stored thereon (e.g., Removable media such as compact discs) and / or in an installation package. These instructions are executable on computer system 1100 and / or on computer system 1100 (eg, using any of a variety of commonly available compilers, installation programs, compression / decompression utilities, etc.). Compiling and / or installing can take the form of executable code, which can take the form of source code and / or installable code, which can take the form of executable code.

  Significant variations can be made according to specific requirements. For example, customized hardware may also be used and / or certain elements may be implemented in hardware, software (including portable software such as applets), or both. In addition, connections to other computing devices such as network input / output devices may be used.

  Some embodiments may use a computer system (such as computer system 1100) to perform the method according to the present disclosure. For example, some or all of the described method steps may include one or more sequences of one or more instructions (operating system 1140, and / or other application programs 1145, etc.) contained in working memory 1135. Can be executed by the computer system 1100 in response to the processor 1110 executing (which may be incorporated into the code). Such instructions may be read into working memory 1135 from another computer-readable medium, such as one or more of storage devices 1125. By way of example only, execution of a sequence of instructions contained in working memory 1135 may be performed by a method described herein for processor 1110, such as the method described with respect to FIGS. 2, 3, 5, 8, and / or FIG. One or more procedures may be performed.

  The terms “machine-readable medium” and “computer-readable medium” as used herein refer to any medium that participates in providing data that causes a machine to operation in a specific fashion. In one embodiment implemented using computer system 1100, various computer readable media are involved in providing instructions / code to processor 1110 for execution and / or such instructions / code (e.g., May be used to store and / or carry signals). In many implementations, the computer-readable medium is a physical and / or tangible storage medium. Such a medium may take many forms, including but not limited to, non-volatile media, volatile media, and transmission media. Non-volatile media includes, for example, optical disks such as storage device 1125 and / or magnetic disks. Volatile media includes, but is not limited to, dynamic memory such as working memory 1135. Transmission media include, but are not limited to, coaxial cables, copper wire, and optical fiber, including the wires that make up bus 1105, and various components of communication subsystem 1130 (and / or communication subsystem 1130 may be other devices. Medium used when communicating with the device). Thus, the transmission medium may also take the form of waves (including but not limited to radio waves, sound waves, and / or light waves as generated during radio wave and infrared data communications).

  Common forms of physical and / or tangible computer readable media include, for example, floppy disks, flexible disks, hard disks, magnetic tapes, or any other magnetic medium, CD-ROM, other optical media, punch cards, Paper tape, other physical media perforated in some pattern, RAM, PROM, EPROM, FLASH-EPROM, other memory chips or cartridges, carrier wave as described below, or computer instructions and / or code Other media that can read are included.

  Various forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to processor 1110 for execution. By way of example only, the instructions may initially be carried on a remote computer magnetic disk and / or optical disk. The remote computer may load the instructions into its dynamic memory and send the instructions as a signal on a transmission medium received and / or executed by computer system 1100. These signals, which can be in the form of electromagnetic signals, acoustic signals, optical signals, etc., are all examples of carrier waves on which instructions can be encoded, according to various embodiments of the invention.

  Communication subsystem 1130 (and / or their components) generally receives the signal, and then bus 1105 carries the signal (and / or data, instructions, etc. carried by that signal) to working memory 1135, From working memory 1135, processor 1110 may retrieve and execute instructions. The instructions received by working memory 1135 may optionally be stored on non-transitory storage device 1125 either before or after execution by processor 1110.

  The methods, systems, and devices discussed above are examples. In various embodiments, various procedures or components may be omitted, replaced, or added as appropriate. For example, in alternative configurations, the described methods may be performed in a different order than described, and / or various stages may be added, omitted, and / or combined. Also, features described in connection with some embodiments may be combined with various other embodiments. Various aspects and elements of the embodiments can be combined in a similar manner. Also, technology has evolved, and thus many of the elements are examples that do not limit the scope of the present disclosure to those specific examples.

  Specific details are given in the description to provide a thorough understanding of the embodiments. However, embodiments may be practiced without these specific details. For example, well-known circuits, processes, algorithms, structures, and techniques have been shown without unnecessary detail in order to avoid obscuring the embodiments. This description provides only exemplary embodiments and does not limit the scope, applicability, or configuration of the invention. Rather, the above description of these embodiments will provide those skilled in the art with an enabling description for implementing embodiments of the invention. Various changes can be made in the function and configuration of the elements without departing from the spirit and scope of the invention.

  Also, some embodiments have been described as processes shown as flow diagrams or block diagrams. Each may describe the operations as a sequential process, but many of the operations may be performed in parallel or concurrently. In addition, the order of operations can be rearranged. The process can have additional steps not included in the figure. Further, embodiments of the method may be implemented by hardware, software, firmware, middleware, microcode, hardware description language, or any combination thereof. When implemented in software, firmware, middleware, or microcode, program code or code segments that perform related tasks may be stored on a computer-readable medium, such as a storage medium. The processor may perform related tasks.

  Although several embodiments have been described, various modifications, alternative constructions, and equivalents can be used without departing from the spirit of the present disclosure. For example, the above elements may simply be components of a larger system, and other rules may override the application of the present invention or otherwise modify the application of the present invention. Also, several steps can be performed before, during, or after the above factors are considered. Accordingly, the above description does not limit the scope of the disclosure.

100 haptic sleeve
105 Curved housing
110 Input / output interface
115 Thermal haptic components (input)
120 Thermal haptic component (output)
125 Protrusion haptic component (input)
130 Protrusion tactile force component (output)
150 system
155 haptic sleeve
160 Mobile devices
165 Sleeve control subsystem
170 Sensing control subsystem
175 Sensitive Sharing Subsystem

Claims (43)

Receiving a sensing input captured by one or more haptic components of the haptic sleeve via a haptic sleeve, the sensing input including at least one non-vibrating sensing input; , Steps and
Capturing image data; and
Storing haptic data corresponding to the received sensing input, including storing a position value, an intensity value, and a duration value associated with the received sensing input ; ,
Aligning the image data for the received sensory input, comprising associating a particular point of the captured image data with the received sensory input;
Storing the aligned image data . The method of claim 1, further comprising sending the haptic data corresponding to the received sensing input to at least one receiving device.   The method of claim 2, wherein the haptic data is configured to cause the at least one receiving device to provide haptic feedback based on the received sensing input. Further it viewed including the touch step of sending the force sense data to the recipient device corresponding to the received sensing input,
The haptic data is adapted to cause the receiving device to provide haptic feedback based on a sensing input received via a second haptic sleeve that is communicatively coupled to the receiving device. Composed,
The method of claim 1. The sensing input is received by a computing device;
The haptic sleeve is
Wherein one or more comprise a haptic components, and the computing device and the curved housing that is configured to engage,
The method of claim 1, further comprising an input / output interface configured to communicatively couple the haptic sleeve to the computing device. The touch force sleeve is selectively powered by the computing device, The method of claim 5. Step includes the step of storing the tactile force sense data representative of at least one non-vibration detecting method according to claim 1 for storing the tactile force sense data corresponding to the received sensed inputs. Establishing a connection with at least one recipient device;
Sending the haptic data corresponding to the received sensing input to the at least one receiving device;
Receiving, via the haptic sleeve, additional sensing input captured by the one or more haptic components of the haptic sleeve;
The method further comprises: streaming additional haptic data corresponding to the additional sensing input to the at least one receiving device via the established connection. the method of. The method further comprises: calculating a vector representing the received sensing input based on the position value associated with the received sensing input, the intensity value, and the duration value. The method described in 1. Transmitting the calculated vector to a receiving device associated with a second haptic sleeve, wherein the calculated vector corresponds to the received sensing input by the second haptic sleeve. 10. The method of claim 9 , further comprising the step of transmitting, enabling the particular haptic effect to be played . The matching step comprises determining a correlation of one or more pixels of the captured image data with the position value associated with the position value of the received sensing input. The method described. Providing a user interface configured to allow a user to manually match the captured image data with the position value of the received sensing input.
The method of claim 1, further comprising: The user interface manually aligns the captured image data with the position value of the received sensing input to the user by one or more of moving and scaling the captured image data. 13. The method of claim 12, further configured to allow A device,
At least one processor;
When executed by the at least one processor, to said device,
Via SawachikaraSatoshi sleeve, a Rukoto receive the captured sensitive input by one or more haptic elements of the touch force sleeve, said sensing input at least one non-vibrating sensitive input including, and to receive,
Capturing image data;
And storing the haptic data corresponding to the received sensing input,
Storing the received image data, wherein the haptic data includes a position value, an intensity value, and a duration value associated with the received sensing input;
Aligning the image data for the received sense input by associating a particular point of the captured image data with the received sense input;
Storing the matched image data;
And a memory for storing computer readable instructions for performing the processing. When the memory is executed by the at least one processor, the memory further includes:
Causing at least one receiving device to transmit the haptic data corresponding to the received sensing input;
Storing computer readable instructions additional Apparatus according to claim 14. 16. The apparatus of claim 15 , wherein the haptic data is configured to cause the at least one receiving device to provide haptic feedback based on the received sensing input. When the memory is executed by the at least one processor, the memory further includes:
Storing the additional computer-readable instructions for sending the tactile force sense data corresponding to the received sensed inputs to the recipient device,
The haptic data causes the receiving device to provide haptic feedback based on the received sensing input via a second haptic sleeve communicatively coupled to the receiving device. 15. The device of claim 14 , wherein the device is configured as follows. The haptic sleeve is
And the one or more include a haptic component, and the device and configured curved housing to engage,
15. The apparatus of claim 14 , further comprising an input / output interface configured to communicatively couple the haptic sleeve to the at least one processor. 19. The device of claim 18 , wherein the haptic sleeve is selectively powered by the device. The apparatus of claim 14 , wherein storing the haptic data corresponding to the received sensing input includes storing haptic data representing at least one non-vibration sensing. When the memory is executed by the at least one processor, the memory further includes:
Establishing a connection with at least one recipient device;
Sending the haptic data corresponding to the received sensing input to the at least one receiving device;
Through the touch force sleeve, and Rukoto receive the one or more haptic additional captured by objective component sensitive input of said touch force sleeve,
Streaming additional haptic data corresponding to the additional sensing input to the at least one recipient device via the established connection ;
15. The apparatus of claim 14 , storing additional computer readable instructions that cause When the memory is executed by the at least one processor, the memory
Calculating a vector representing the received sensing input based on the position value associated with the received sensing input, the intensity value, and the duration value;
15. The apparatus of claim 14, storing additional computer readable instructions that further cause When the memory is executed by the at least one processor, the memory
Sending the calculated vector to a receiving device associated with a second haptic sleeve, wherein the calculated vector corresponds to the received sensing input by the second haptic sleeve. Allows you to play a specific haptic effect to send
23. The apparatus of claim 22, storing additional computer readable instructions for causing When executed, to at least one computing device
Via SawachikaraSatoshi sleeve, a Rukoto receive the captured sensitive input by one or more haptic elements of the touch force sleeve, said sensing input at least one non-vibrating sensitive input including, and to receive,
Capturing image data;
Storing haptic data corresponding to the received sensing input, the haptic data including a position value, an intensity value, and a duration value associated with the received sensing input. To do
Aligning the image data for the received sense input by associating a particular point of the captured image data with the received sense input;
Storing the matched image data;
Storing computer-executable instructions to perform at least one computer-readable storage medium. When executed, further to said at least one computing device,
25. At least one computer-readable storage medium according to claim 24 , storing additional computer-executable instructions that cause the at least one receiving device to transmit the haptic data corresponding to the received sensing input. 26. At least one computer readable storage medium according to claim 25 , wherein the haptic data is configured to cause the at least one receiving device to provide haptic feedback based on the received sensing input. . When executed, further to said at least one computing device,
Causing the receiving device to send the haptic data corresponding to the received sensing input;
Storing the additional computer-executable instructions,
The haptic data causes the receiving device to provide haptic feedback based on the received sensing input via a second haptic sleeve communicatively coupled to the receiving device. 25. At least one computer readable storage medium as defined in claim 24 , wherein The haptic sleeve is
Wherein one or include a plurality of haptic elements, and wherein at least one of the configured curved housing for a computing device engages,
25. The at least one computer readable storage medium of claim 24 , further comprising an input / output interface configured to communicatively couple the haptic sleeve to the at least one computing device. 29. At least one computer readable storage medium according to claim 28 , wherein the haptic sleeve is selectively powered by the at least one computing device. 25. At least one computer readable storage according to claim 24 , wherein storing the haptic data corresponding to the received sensing input comprises storing haptic data representing at least one non-vibration sensing. Medium. When executed, further to said at least one computing device,
Establishing a connection with at least one recipient device;
Sending the haptic data corresponding to the received sensing input to the at least one receiving device;
Through the touch force sleeve, and Rukoto receive the one or more haptic additional captured by objective component sensitive input of said touch force sleeve,
Streaming additional haptic data corresponding to the additional sensing input to the at least one recipient device via the established connection ;
25. At least one computer readable storage medium as recited in claim 24 , wherein additional computer executable instructions are stored for causing When executed, the at least one computing device
Calculating a vector representing the received sensing input based on the position value associated with the received sensing input, the intensity value, and the duration value;
25. At least one computer readable storage medium as recited in claim 24, wherein additional computer executable instructions for further performing are stored. When executed, the at least one computing device
Sending the calculated vector to a receiving device associated with a second haptic sleeve, wherein the calculated vector corresponds to the received sensing input by the second haptic sleeve. Allows you to play a specific haptic effect to send
33. At least one computer readable storage medium as claimed in claim 32, wherein additional computer executable instructions for further performing the steps are stored. Means for receiving via a haptic sleeve a sensing input captured by one or more haptic components of said haptic sleeve, wherein said sensing input is at least one non-vibrating sensing input Means for receiving , including
Means for capturing image data;
Means for storing haptic data corresponding to the received sensing input, comprising storing a position value, an intensity value, and a duration value associated with the received sensing input and means for,
Means for aligning the image data for the received sense input, the method comprising: associating a particular point of the captured image data with the received sense input;
Means for storing the aligned image data .   35. The system of claim 34, further comprising means for causing the at least one receiving device to transmit the haptic data corresponding to the received sensing input.   36. The system of claim 35, wherein the haptic data is configured to cause the at least one receiving device to provide haptic feedback based on the received sensing input. Further seen including a means for sending to the recipient device the touch force data corresponding to the received sensing input,
The haptic data causes the receiving device to provide haptic feedback based on the received sensing input via a second haptic sleeve communicatively coupled to the receiving device. 35. The system of claim 34, wherein the system is configured as follows. The sensing input is received by a computing device;
The haptic sleeve is
Wherein one or more comprise a haptic components, and the computing device and the curved housing that is configured to engage,
35. The system of claim 34, further comprising an input / output interface configured to communicatively couple the haptic sleeve to the computing device. The touch force sleeve is selectively powered by the computing device, system according to claim 38.   35. The system of claim 34, wherein the means for storing the haptic data corresponding to the received sensing input includes means for storing haptic data representing at least one non-vibration sensing. Means for establishing a connection with at least one recipient device;
Means for causing the at least one receiving device to send the haptic data corresponding to the received sensing input;
Means for receiving, via the haptic sleeve, additional sensing input captured by the one or more haptic components of the haptic sleeve;
35. The system of claim 34, further comprising means for streaming additional haptic data corresponding to the additional sensing input to the at least one recipient device via the established connection. . Means for calculating a vector representing the received sensing input based on the position value associated with the received sensing input, the intensity value, and the duration value.
35. The system of claim 34, further comprising: Means for transmitting the calculated vector to a receiving device associated with a second haptic sleeve, wherein the calculated vector is the sensing input received by the second haptic sleeve. Means for transmitting, allowing to play a specific haptic effect corresponding to
43. The system of claim 42, further comprising:

Images