TWI530860B - With eye piece for augmented and virtual reality and a method using the system - Google Patents

Description

Eyepiece system for augmenting reality and virtual reality and method of using the same [Cross-reference related applications]

U.S. Non-Provisional Patent Application No. 13/829,918, filed on Apr. 13, 2013, entitled "Eye Piece for Augmented and Virtual Reality", U.S. Patent Application Serial No. 2013/3/14 No. 13/830,190, entitled "Tactile Elements for a Wearable Eyepiece", and US Non-Provisional Patent Application No. 13/830,370, filed on Dec. 2013/3, entitled "Visual Cortex Thought Detector Interface" It is incorporated herein by reference for reference.

The present invention relates to systems and methods for generating and manipulating amplification or virtual reality displays.

The increasing computing power of microprocessors and the precision of data transfer systems have allowed portable devices such as tablets and smartphones to evolve to replace traditional desktop and laptop computers for personal computing and business purposes. The extent of the preferred device. In a further evolution, wearable computing devices capable of presenting additional information (eg, from the Internet) have emerged that enhance the user's real-world viewing experience. Augmented reality glasses are used to create overlays in the field of view of the eye to present additional information or to collect and record information from the real world. In order to solve the processing requirements of such portable devices, a cloud computing system is used to be at a central location and remote from the user. Performs processing-intensive tasks associated with data manipulation while distributing the results of processing tasks among various portable devices.

The present invention is directed to a wearable computing system that provides content that is obtained locally or from a network source in synchronization with haptic feedback. The wearable computing device includes at least one eyewear that can be worn. The wearable eyepiece further includes a flexible frame configured to mate with an eye socket shape of a human wearer such that substantially no ambient light transmission is blocked between the frame and the eye socket. The display screen is secured to a hole in the frame such that the display of the shape of the mating flexible frame encompasses the field of view of the eye. A first processor that facilitates processing of the data and a display on the display screen and a processor readable storage medium for storing program logic are also included in the wearable computing system. Additionally, the plurality of haptic elements are responsive to the program logic disposed on the flexible frame, the haptic elements being communicatively coupled to the first processor and responsive to display on the display screen for selective activation by the first processor. Accordingly, the tactile element control logic is included in program logic stored on a processor readable storage medium and executable by the first processor for controlling the tactile elements.

In one embodiment, the flexible frame includes an eye pad such that a plurality of tactile elements are disposed on the rim of the eye pad. The eye pad promotes matching with the eye socket and blocks ambient light. In an embodiment, the flexible frame further includes a bridge member that includes a first processor. The flexible frame also includes a transceiver that allows the transceiver to receive and transmit communication signals. At least one speaker and a microphone are also disposed on the flexible frame such that the speaker produces an audio signal and the microphone is operable to receive an audio input.

In an embodiment, the wearable computing system includes two wearable eyepieces arranged side by side and configured to mate with each of the two eye sockets of the human wearer.

In one embodiment, a detection module detects movement of the eye socket and the eye of the wearer. In an embodiment, the detection module includes a camera. In an embodiment, the detection module also includes a plurality of tactile elements.

In one embodiment, the program logic further includes image manipulation logic that is executed by the first processor to control display on the display screen in response to movement detected by the detection module. In one embodiment, the program logic also includes a haptic component mapping logic that is executed by the first processor for mapping each of the plurality of haptic elements to different portions of the image projected onto the display screen. Enabling one of the activation images initiates each of the tactile elements.

In an embodiment, a method of providing content is disclosed. The method includes displaying, by a processor, visual content on a display screen of a flexible frame secured to a wearable computing device to a user. The flexible frame is engaged in a configuration that matches the shape of at least one of the eyes of the user. The method further includes providing, by the processor, tactile feedback around the eyes of the user to the user, the tactile feedback being provided in synchronization with the visual content. In an embodiment, the haptic feedback is provided by activating a tactile element attached to the flexible frame, for example by vibrating or heating at least a subset of the tactile elements.

In one embodiment, each of the haptic elements is mapped to a particular portion of a virtual user included in the visual content, and providing haptic feedback in synchronization with the visual content further includes based on the virtual user in the visual content The experience of a particular portion of the particular part of the particular tactile element is initiated.

In one embodiment, the method further includes detecting, by the processor, one or more movements of the facial muscles around the eyes and the eyes, and performing specific tasks in response to the detected movements. In one embodiment, detecting movement of the eye and facial muscles further includes collecting from a camera by the processor Information about the movement of one or more of the eyes and facial muscles. The particular task performed by the processor includes, at least by the processor, manipulating the display on the display screen based on the detected movement. In an embodiment, the specific task performed by the processor can also include mapping, by the processor, each tactile component to a specific portion of a virtual user included in the visual content; and responding to the detected movement And manipulating a specific part of a virtual user contained in the visual content.

In one embodiment, a non-transitory computer readable storage medium is disclosed that includes processor executable instructions. The storage medium includes instructions for causing the processor to display visual content to a user on a display screen attached to a flexible frame of a wearable computing device, the flexible frame employing one of at least one eye of the user The shapes match the configuration to engage. The instructions also cause the processor to provide tactile feedback around the user's eyes to the user, and the tactile feedback is provided in synchronization with the visual content.

In an embodiment, the haptic feedback is initiated by the processor to activate the tactile elements attached to the flexible frame, for example, by vibrating or heating at least a subset of the tactile elements. In one embodiment, each of the haptic elements is mapped to a particular portion of a virtual user included in the visual content, and providing haptic feedback in synchronization with the visual content further includes based on the virtual user in the visual content The experience of a particular part to initiate a particular one of the tactile elements.

In one embodiment, the method further includes detecting, by the processor, one or more movements of the facial muscles around the eyes and the eyes, and performing specific tasks in response to the detected movements. In one embodiment, detecting movement of the eye and facial muscles further includes collecting, by the processor, information about movement of one or more of the eye and facial muscles from a camera. The particular task performed by the processor includes at least manipulating the display on the display screen based on the detected movement by the processor. In an embodiment, the specific tasks performed by the processor can also include the haptic elements by the processor. Each of the pieces is mapped to a particular portion of a virtual user contained in the visual content; and a particular portion of a virtual user contained in the visual content is manipulated in response to the detected movement.

In one embodiment, a system is disclosed that includes at least one tactile element mounted to a flexible frame that can be worn with an eyepiece. At least one haptic element is mounted on the periphery of one of the displayable eyepiece display screens. The haptic element is communicatively coupled to a processor and the flexible frame is configured to mate with an eye socket shape of a human wearer such that ambient light is blocked. The tactile element includes a base, a neck and a head, the tactile element attaching the flexible frame to the base such that the head of the tactile element contacts the wearer's skin. A bi-directional actuation mechanism includes a current carrying coil, a pair of magnets, and a signal contact plate included in the base of the tactile element. The two-way actuation mechanism is configured to actuate the tactile elements and detect muscle movement in the eye socket of the wearer.

In one embodiment, the two-way actuation mechanism further includes a spherical body for actuating the tactile element within the signal contact plate. At least one magnet is attached to the spherical body. The spherical body and the signal contact plate are configured such that the spherical body is free to rotate along a plurality of axes within the signal contact plate. In an embodiment, the system can further include a plurality of speakers. A connecting wire connects the spherical body to the plurality of speakers, and a gel pad is configured such that the gel pad is in contact with the wearer and the surface of the speaker is in the gel pad. In an embodiment, the tactile element comprises a heating element.

In an embodiment, the at least one tactile element comprises a plurality of tactile elements. A subset of the plurality of tactile elements has a surface in contact with the wearer's skin, which is constructed in a manner different from the surface in contact with the wearer's skin of a different subset of the plurality of tactile elements. In an embodiment, the tactile element is a suction cup. In an embodiment, the tactile element is a pinhole on the flexible frame.

In an embodiment, a method of providing content is disclosed. Method includes providing one The tactile element is on a flexible frame that can be worn with eyepieces that fits into the eye socket shape of one of the human wearers such that ambient light is blocked. The method further proposes to activate the tactile element in synchronization with the video content displayed on the display screen of one of the wearable eyepieces by a processor; and by detecting the coil contained in the tactile element due to physical actuation The induced current is actuated by the entity of the tactile element caused by the movement of the muscles of the eye socket.

In an embodiment, initiating the tactile element in synchronization with the video content further comprises causing a current to vibrate the tactile element by the processor through a coil contained within the tactile element. In an embodiment, initiating the tactile element in synchronization with the video content further includes heating, by the processor, a heating element contained within the tactile element. In an embodiment, initiating the tactile element in synchronization with the video content further comprises generating a suction by the processor via a tactile element that attracts the skin of the wearer. In an embodiment, initiating the tactile element in synchronization with the video content further includes providing audio feedback to the wearer through the speaker contained within the tactile element.

In one embodiment, a computer readable storage medium is disclosed. The computer readable medium includes instructions for causing a processor to activate a tactile component in synchronization with video content displayed on a display screen of a wearable eyepiece when the processor executes the instructions; and detecting muscle movement of the eye socket The entity of the tactile element is actuated. The tactile element is attached to a flexible frame that can be worn with eyepieces that fits into the eye socket shape of one of the human wearers such that ambient light is blocked.

In one embodiment, a system is disclosed that includes at least one wearable eyepiece. The eyepiece includes a flexible frame; a display screen secured to a hole in the frame; and a visual cortical input detection module attached to the flexible frame for detecting input from the wearer's visual cortex . The flexible frame is configured to mate with one of the eye socket shapes of a human wearer such that substantially no ambient light transmission is blocked between the frame and the eye socket. First communication with visual cortex input detection module The processor is further included in the system such that the first processor facilitates processing input and generates a display on the display screen based on program logic stored on a processor readable storage medium also embodied within the system.

In one embodiment, the program logic includes a visual cortical display generation logic for generating a display on the display screen based on input from the wearer's visual cortex. The visual cortex display generation logic further includes virtual user manipulation logic for manipulating a virtual user displayed on the display screen based on input from the wearer's visual cortex. The program logic also includes a visual cortical input storage logic for storing input from the visual cortex in a computer readable storage medium; and an auxiliary display generation logic for based on a second user different from one of the wearers A visual cortex obtains the stored input to produce a display.

In one embodiment, the system further includes a plurality of tactile elements attached to the flexible frame, the tactile elements being communicatively coupled to the first processor and selectively activated by the first processor in response to the display on the display screen. The tactile element manipulation logic is contained within the program logic and executed by the first processor to manipulate the tactile elements based on input from the wearer's visual cortex.

In an embodiment, a method of providing content is disclosed. The method comprises various processor executable steps comprising: obtaining, by a first processor, an input from a visual cortex of a first user as an electrical signal; interpreting the electrical signal to produce a visual from the first user An image of the input of the cortex and based on the image to display or store at least one of the visual content to the first user on a display screen. The display screen is secured to a flexible frame that can be worn with a computing device that is configured to mate with a shape that matches at least one of the eyes of the first user. In an embodiment, image based visual content can be stored. In an embodiment, the visual content is an image. In an embodiment, the display includes a virtual user. In an embodiment, based on The image to display the visual content to the first user further includes, by the first processor, using the input to manipulate a display displayed to the first user prior to obtaining input from the visual cortex. In one embodiment, manipulating a display further includes changing, by the first processor, a visual attribute of the component included in the display based on input from the visual cortex. In an embodiment, the visual content includes a pattern that is obtained as input from a visual cortex of the first user. The method further includes actuating, by the first processor, a tactile element attached to the flexible frame based on input from the visual cortex.

According to an embodiment, the method also includes transmitting the visual content to a second user different from the first user by a second processor. In an embodiment, the second processor is different from the first processor. The method further includes the steps performed by the second processor. The step includes: receiving input from a visual cortex of one of the second users; changing the visual content to generate new visual content based on input from the visual cortex of the second user; and storing the new visual content in a processor readable storage In the media.

In one embodiment, a computer readable storage medium is disclosed, comprising processor executable instructions. When a processor executes the instructions, causing the processor to obtain an input from a visual cortex of a first user as an electrical signal, by interpreting the electrical signal to produce one of the inputs from the visual cortex of the first user An image; and displaying an image on the screen based on one of a flexible frame fixed to a wearable computing device to display visual content. The flexible frame is engaged in a configuration that matches a shape of at least one of the eyes of the first user.

These and other embodiments will be apparent to those skilled in the art in the <RTIgt;

100‧‧‧ Wearable computing system

102‧‧‧Users

104‧‧‧ eyepiece

106‧‧‧ eyepiece

108‧‧‧Bridge components

110‧‧‧Tactile components

114‧‧‧Display screen

116‧‧‧Display screen

124‧‧‧Frame

126‧‧‧Frame

152‧‧ points

154‧‧ points

156‧‧ points

158‧‧ points

204‧‧‧ eye pads

206‧‧‧ eye pads

220‧‧‧Visual Cortex Thought Detector

222‧‧‧带带

232‧‧‧End

234‧‧‧End

302‧‧‧ eyepiece ring structure

304‧‧‧ hole

306‧‧‧ close view

402‧‧‧ view

404‧‧‧ view

406‧‧‧ view

408‧‧ view

410‧‧‧Base section

412‧‧‧ neck

414‧‧‧ head

420‧‧‧ pattern

502‧‧‧Signal Contact Board

504‧‧‧Speaker array

506‧‧‧ gel pad

508‧‧‧ magnet

510‧‧‧Spherical body

516‧‧‧ coil

520‧‧‧Connecting wires

522‧‧‧ frame side

532‧‧‧Speaker

534‧‧‧Speakers

536‧‧‧Speaker

Section 540‧‧‧

542‧‧‧Speaker

544‧‧‧Speaker

546‧‧‧Speaker

600‧‧‧virtual users

602‧‧‧ head

604‧‧‧Tactile components

700‧‧‧ processor

702‧‧‧Input/Output (I/O) Module

704‧‧‧Control Module

706‧‧‧ imaging module

730‧‧‧display screen

740‧‧‧audio components

750‧‧‧ storage media

760‧‧‧Power supply

770‧‧‧ transceiver

780‧‧‧Detection system

810‧‧‧Remote Server

820‧‧‧Network

In the figures, the same reference numerals are used to refer to like elements in the drawings, in which: FIG. 1A is used in humans with a computing system/device according to an embodiment of the present invention. Illustration of the person; Figure 1B shows a profile of a user with a wearable computing system; Figure 2A shows a view of another view of a user-oriented wearable computing system in accordance with an embodiment of the present invention 2B shows an illustration of a user of a wearable computing system that includes a visual cortex mind detector; the third figure shows a diagram of some exemplary details of the tactile element 110 in accordance with an embodiment of the present invention. The fourth figure shows various views of a tactile element according to an embodiment of the present invention; the fifth figure shows a schematic view of a cross section of one of the tactile elements 110 according to an embodiment of the present invention; An illustration of a plurality of tactile elements provided to a user in accordance with an embodiment of the present invention, the tactile feedback being synchronized with a particular display comprising a virtual user; the seventh drawing depicting an applicability in accordance with an embodiment of the present invention A block diagram of some exemplary modules within a computing device; an eighth diagram showing a schematic representation of a wearable computing device in communication with a remote server in accordance with an embodiment of the present invention; A flowchart of an embodiment of a method of providing content to a user performed by a computing device; The tenth diagram shows a flowchart illustrating an embodiment of a method of providing interactive content to a user as performed by a wearable computing device in accordance with an embodiment; an eleventh diagram showing an example of execution of a wearable computing device in accordance with an embodiment A flowchart of an embodiment of a method of providing interactive content to a user; FIG. 12 shows a flowchart 1200 illustrating an embodiment of a processor-executable method of providing haptic feedback in synchronization with display of a virtual user.

The subject matter will now be described more fully hereinafter with reference to the accompanying drawings. However, the subject matter may be embodied in a variety of different forms, and thus, the subject matter that is encompassed or claimed is not to be construed as limited to any of the exemplary embodiments set forth herein. The exemplary embodiments are merely provided as illustrative. of. As such, it is expected that there will be a reasonable and broad range of subject matter claimed or covered. Further, for example, a subject matter can be implemented as a method, apparatus, component, or system. Thereby, embodiments may take the form of, for example, a hardware, a soft body, a firmware, or any combination of the above. Thus, the following detailed description is not intended to be limiting.

In the figures, some features may be exaggerated to show details of particular elements (and any dimensions, materials and similar details shown in the figures are considered as illustrative and not limiting). Therefore, the specific structural and functional details disclosed in the specification are not to be construed as limiting, but only as a representative basis, and are used to illustrate various embodiments of the disclosed embodiments.

The present invention is described below with reference to the block diagrams and <RTIgt; It should be understood that each block of the block diagram or the operation diagram, and the combination of the blocks in the block diagram or the operation diagram can be realized by analog or digital hardware and computer program instructions. Work. These computer program instructions can be provided to a general purpose computer, a special purpose computer, an ASIC, or other programmable data processing device processor for execution of a block diagram or operation via instructions executed by a computer or other programmable data processing device processor. The function/action specified by the box.

In some other implementations, the functions/acts noted in the blocks may occur out of the order noted in the figures. For example, the two blocks shown in the order can be executed substantially simultaneously or the blocks can sometimes be executed in the reverse order, depending on the function/action involved. Further, embodiments of the method as presented and described in the flowchart of the present invention are presented by way of example to provide a more complete understanding of the present technology. The disclosed methods are not limited to the operations and logic flows presented in this specification. In view of other embodiments, the order of the various operations may vary and the sub-operations described therein as being part of a larger operation are performed independently.

The computing device may be capable of transmitting or receiving signals, for example, via a wired or wireless network, or may be capable of processing or storing signals, such as in memory, depending on the physical memory state, and may thus operate like a server. Thus, a device capable of operating like a server may include, for example, a dedicated rack server, a desktop computer, a laptop computer, a set-top box, an integrated body incorporating various features, such as two or more features of the above-described devices. Device, or the like. The server may vary greatly in configuration or capability, but the server may typically include one or more central processing units and memory. The server may also include one or more mass storage devices, one or more power sources, one or more wired or wireless network interfaces, one or more input/output interfaces, or one or more operating systems, such as Windows. Server, Mac OS X, Unix, Linux, FreeBSD, or the like.

Throughout the specification and the scope of the patent application, the term may have the meaning of the nuances suggested or implied by the context of the clearly defined meaning. Similarly, the phrase "in an embodiment" as used in the specification is not necessarily referring to the same embodiment, and The phrase "in another embodiment" does not necessarily mean a different embodiment. For example, it is contemplated that the claimed subject matter includes all or a combination of exemplary embodiments. In general, terms can be understood at least in part from the usage in the text. For example, the terms "and", "or", or "and/or" as used in the specification may include a plurality of meanings, which may depend, at least in part, on the context in which the above terms are used. Usually, "or" if used to associate a series, such as A, B, or C, means A, B, and C (here used to include meaning), and A, B, or C (here used for mutual exclusion) significance). In addition, the words "a" or "an" or "an" The combination. Similarly, words such as "a" or "the" can again be considered to convey a single usage or convey a plural usage, which depends, at least in part, on the context. In addition, the term "based on" may be considered as not necessarily conveying a unique set of factors, and conversely, allowing for additional factors that are not necessarily explicitly described again, depending, at least in part, on the context.

Cloud computing has emerged in recent years as a solution to the situation where processor-intensive tasks must be performed in the world of mobile computing. It is used for personal computing tasks and is used by businesses for storage and data processing needs. In personal computing, games on the cloud have gained great popularity in view of the high processing resources required by graphics-intensive gaming systems. The graphics are generated and presented at a central location and the rendered images are transmitted to the user device, thereby reducing the need for high end processors on the user device.

It can be worn with computing and networking devices as another emerging aspect of the computing world. These wearable devices can be carried on the body of the user wearing the device. Although wearable devices can be paired with external displays, they typically include their own different sized displays to present information. In some embodiments, it is designed as a spectacles that amplifies use by generating an overlay with appropriate information. The existing real world vision. In all of the various embodiments, the wearable computing device requires a user gesture, such as clicking a finger, touching a surface, or pressing a button to perform various tasks, such as turning the display on or off, launching the application, exiting the application, or connecting another Device.

Wearable computing systems designed to be worn as eyepieces and methods associated with such computing systems are disclosed in accordance with various embodiments described herein. The wearable computing system is not only designed to provide passive audio-video experience, but is also used to provide tactile feedback consistent with audio-video experience. The computing system is also interactive because it receives input from a user or wearer of the computing system and reacts to incoming input. In one embodiment, the input can be received by monitoring the wearer's eye and the eye socket surrounding the flexible frame of the computing system. In an embodiment, the input can be received by monitoring an electrical signal generated in the visual cortex of the wearer.

The first A diagram is an illustration of a human user 102 that can wear the computing system/device 100. The computing system includes two symmetrical eyepieces 104 and 106, each of which is used alone or in conjunction with another symmetrical eyepiece. In an embodiment, the eyepieces 104, 106 can all comprise the same elements. In an embodiment, the various components of the wearable computing system 100 can be asymmetrically distributed between the two eyepieces 104, 106 such that each eyepiece 104 or 106 is configured for use in addition to other applications. Specific usage. In an embodiment, eyepieces 104 and 106 are detachably coupled to bridging element 108 to facilitate flexible usage. Each of the eyepieces 104, 106 includes a respective frame 124, 126 that includes respective display screens 114 and 116 that form a stereoscopic display to the user 102 when the eyepieces 104, 106 are used together. The frames 124, 126 are made of a flexible material such that they are configured to fit the orbital shape of the user 102 such that substantially no ambient light transmission is blocked between the frame and the socket. Thus, the frame 124/126 is configured to conform to the shape of the eye socket of the user 102 in a manner that blocks the ambient light surrounding the user 102 from leaking to the field of view of the user 102. In an embodiment, The ambient light around the user 102 can be light that is typically present in an environment with or without a source of visible light. Thus, if the user 102 is viewing the content on the display screens 114, 116 in a virtual reality environment, the user 102 can be completely immersed in the environment and not be viewed from the environment outside the field of view of the user 102 or Foreign light interferes. In an embodiment, the frames 124 and 126 may be hollow and have a space therebetween to allow for electrical interconnection between the various component parts of the computing system 100 that may be worn.

In an embodiment, the display screens 114, 116 may be flexible OLEDs (organic light emitting diodes) to conform to the shape of the face of the user 102 along the flexible frames 124, 126. Since OLED displays operate without backlighting, they can be thinner and lighter than liquid crystal displays (LCDs) and achieve higher contrast in low ambient light conditions. With a sufficiently dense display screen 114, 116 and a speaker or earphone or headset (not shown) containing features such as noise cancellation features, the user 102 can thereby interact with the content, for example, as if Watch a movie or play a video game in the context of a movie theater regardless of the actual location where the user 102 can be located. In an embodiment, the screens 114, 116 can have a variable degree of opacity or transparency to facilitate the use of the wearable computing system 100 in both the virtual reality environment and the augmented reality environment. Applying a charge to the OLED display screen 114/116 can change the transparency it uses in different settings.

The wearable computing system 100 also additionally includes a plurality of tactile elements 110 that provide tactile feedback around the eyes of the user 102 to the user 102, wherein the tactile elements 110 contact the skin of the user 102. For example, a subset of the tactile elements can convert electrical energy into mechanical motion (such as vibration or other forms of energy (eg, thermal energy)) to provide tactile feedback to the user 102. In an embodiment, the tactile element 110 is a small structure having different physical characteristics that includes physical and electrical connections to the frames 124/126, as will be described in further detail in this specification. In an embodiment, the tactile element 110 At least a subset can move independently. In an embodiment, all of the tactile elements 110 can be employed simultaneously to provide tactile feedback or to select a particular tactile element 110 at any time to provide tactile feedback to the user 102. Various tactile feedbacks can be provided to the user 102 based on the functions built into the different tactile elements 110. By way of example and not limitation, a first subset of tactile elements 110 can include a heating element, a second subset of tactile elements can be movable or configured to vibrate at different frequencies, or a third subset of tactile elements. put pressure on. Again, it can be appreciated that different tactile elements 110 can have different feedback mechanisms associated with them or all of the tactile elements can each have all of the tactile feedback mechanisms built into them such that a combination of different tactile elements can be used to provide a particular type of tactile feedback. .

The haptic feedback provided to the user 102 is related to the content such that the plurality of haptic elements 110 are launched in concert with the display content, such as a movie or video game, to add additional dimensions to the user experience. In an embodiment, the various tactile elements 110 can be mapped to different portions of a virtual user (not shown) with which the user 102 is interacting or associated, such that the experience of the virtual user in the virtual world can be via the tactile element 110. Transfer to user 102 or user 102 to experience or feel. Thus, the touch pressure, touch location, and touch texture experienced by the virtual user are transferred to the user 102 as part of the user experience in an immersive environment in which the computing device 100 can be worn. The virtual user can additionally interact with virtual users of other users and can further modify the haptic feedback provided to the user 102 based on interactions between the virtual user of the user 102 and the virtual users of other users.

The user 102 can employ a wearable computing system 100 for displaying and interacting with various types of material, such as text, images, or videos about web pages or other content such as movies or video games. In an embodiment, the local area network (LAN) that can be connected to the wearable computing system 100 can be connected The console (not shown) plays the content. In one embodiment, a communication component (not shown) built into the wearable computing system 100 can be used to connect directly from the Internet or via a WiFi connection to an intermediary device such as a laptop or cellular telephone. The content is transferred to the wearable computing system 100.

In one embodiment, the wearable computing system 100 not only provides content and related haptic feedback to the user 102, but also facilitates the user 102 interacting with the content. In one embodiment, the wearable computing system 100 includes a detection module (not shown) for detecting movement of various parts of the eye or eye socket of the user 102, which facilitates interaction of the user 102 with the displayed content. As will be further detailed below. In one embodiment, the detection module can include a camera and a photodiode for tracking movement of various parts of the user's 102 eyes. For example, the eye movement of the user 102 causes the user 102 to look at the small graphic on the display screen 114/116 for a predetermined period of time to have a gesture like a mouse click that enables the processor to perform a specific task related to the gesture. (such as choosing a small graphic). Similarly, the eye movement of the user 102 after the selection described can cause the selected thumbnail to move in the direction of movement of the eyeball of the user 102 and the user 102 subsequently stops moving at a particular second point for use at this particular point. Drop the small picture. The detection module can also constitute a finer difference or nuance of detecting the movement of different parts of the eye socket covered by the wearable computing system 100, such as the user 102 or the wearer closing the eye for different time periods, blinking Raise one or more eyebrows.

In one embodiment, the tactile element 110 can also be configured to detect a portion of the detection module of the user's movement even when the user 102 is provided with a tactile sensation. The plurality of tactile elements 110 can have a subset of elements of different shapes that include different types of transducers that collect different vectors for eye movements of the user 102 or postures of the eye muscles. For example, the tactile element 110 can also include a transducer in contact with the facial muscle entity of the user 102 to detect movement of such muscles and generate corresponding electrical signals that can be fed back to the processor, and thereby can manipulate the display Screen 114, 116 The display on the top. In one embodiment, the position and signal strength of the tactile elements that transmit the electrical signals can be used to detect a particular movement of the facial muscles of the user 102 that can be mapped to provide a particular input to the processor. Various eye movements and gestures can thus be tracked and mapped to specific types of inputs that can be used to manipulate content in a particular manner. Thus, the wearable computing system 100 can eliminate or supplement other devices such as joysticks or data gloves, which are typically used with such wearable computing systems to receive user input.

In one embodiment, the wearable computing system 100 further includes a mind detector (not shown) that detects the user's 102 thoughts and changes the display on the screens 114, 116 based on the recorded ideas described above. In one embodiment, the thought detector can include elements that record electrical activity of the brain via wires that contact the posterior portion of the head where the visual cortex of the brain is located. Techniques such as EEG (electroencephalograph) are known which provide a means of non-invasively observing human brain activity. For example, technologies such as Emotiv EPOC that are provided with headphones and related computer interfaces from Emotiv Lifescience can be adapted for use with the wearable computing system 100 to record ideas and manipulate content as will be further detailed in this specification.

According to an embodiment, the wearable computing system 100 can additionally facilitate storing a user experience, recreating a user experience, and exchanging a user experience. In an embodiment, the user experience can include content items with their associated audio and tactile feedback material. This allows the user 102 to consume content items, interact with content items, and change content items to create new content items via the wearable computer 100, which can be stored in a processor or storage device on a local storage device or LAN. (It can constitute one or more of the remote processor readable storage located on one or more servers located at the far end of the user 102 and transmitting the content to the wearable computing device 100). The new content item or user experience established by the user 102 can be shared with other users. For example, user 102 The video game consumed can have some tactile feedback associated with certain parts. If desired, the user 102 can change the video game to layer additional tactile feedback and store the video game with the changed tactile feedback information as a user experience that can be further shared with other users. In an embodiment, the stored/shared user experience can include additional content obtained from an external source. For example, images or sounds obtained from other content can be added to a particular content item. In one embodiment, new content added to the user experience can be obtained from the user 102's thoughts by the thought detector associated with the wearable computing system 100.

The first B diagram shows the outline of a user 102 having a wearable computing system 100. The wearable computing system 100 contacts the skin of the user 102 at a plurality of points. When the wearable computing system 100 mates the eye socket shape of the user 102, the frame 126 conforms to the shape of the eye socket of the user 102 and contacts the skin surrounding the eye socket of the user 102, as shown in the cross-sectional profile shown in FIG. Points 152 and 154 are referred to. The shape conforms to the configuration system operation to substantially block ambient light leakage to the field of view of the user 102. Additional contact points include points 156, 158 in which the tactile element 110 contacts the skin of the user 102. The various haptic sensations transmitted to the user 102 via the haptic element 110 are thus perceived by the user 102, for example, at points 156, 158.

The second A diagram shows an illustration of another view of the wearable computing system 100 facing the user 102 while the user 102 is wearing the wearable computing system 100 on his/her body. The flexible frames 124, 126 each include a suction mechanism or eye pads 204, 206 that facilitate the wearable computing system/device 100 to securely attach the face of the user 102 such that little or no ambient light is leaking to the user 102. The field of view leaks into the space between the eyes of the user 102 and the display screens 114, 116. Additionally, the wearable computing system 100 can include a speaker located in a suitable location, such as near the ear, to provide audible feedback to the user. The wearable computing system 100 is at the bridging member 108 A power source, one or more processors can also be included for performing tasks such as controlling display screens 114, 116, providing WiFi, infrared or other wireless communication, and controlling such as tactile elements 110 on wearable computing system 100. Other processing tasks for other components.

By way of illustration and not limitation, FIG. 2B shows a profile of a user 102 holding a wearable computing system 100, the wearable computing system 10 including detachably coupled to the wearable computing system 100 (eg, A visual cortex mind detector 220 via a coupling tool such as strap 222. Both ends of the strap 222 can be detachably coupled to the ends 232 and 234 of the wearable computing system 100 in such a manner that the strap 222 can surround the rear of the head of the user 102. This configuration causes the visual cortex thought detector 220 to record the thoughts from the visual cortex located on the posterior side of the brain of the user 102. Although the visual cortex mind detector 220 is shown as a single component that is located in one of the wearable computing systems 100 and contacts the brain of the user 102, it is understood that this is not necessary. The visual cortex thought detector 220 can include a plurality of sensors that can contact a plurality of portions of the brain of the user 102 to collect thought information as needed.

In one embodiment, a technique that can be used for EEG (electroencephalograph) can be employed within the visual cortex mind detector 220. Brain cells talk to each other by exchanging tiny electrical signals and EEG is a non-invasive procedure used in the medical field to record such electrical activity. Some electrodes are located at different points on the scalp of the human body to detect voltage fluctuations caused by current flow of current between brain cells. Experiments have found that when people visually imagine something, their eyes move in such a way that they actually move as if they were looking at their imagination. For example, if a person imagines a skyscraper, the person's eyes move in a top-down manner. Similarly, if the person imagines a train, the person's eyes will move from one side to the other. The occipital cortex (also known as the visual cortex) located behind the head is one of the first regions of the human brain, and information entered from the eyes of the user 102 will arrive here and A lot of work to understand what the user 102 is looking at continues here. Experiments on brain activity have also shown that when people imagine or look at objects in their minds, the visual cortex of the brain is particularly active. Thus, the visual cortex thought detector 220 is located behind the head of the user 102 near the visual cortex. However, the wearable computing system 100 can have additional electrodes located relative to other portions of the brain for collecting information from the locations to detect the thoughts and/or images desired by the user 102 and to manipulate them for use. The display of computing system 100 is worn.

The third figure shows an illustration of some exemplary details of the tactile element 110. A plurality of tactile elements 110 are disposed along the eyepiece ring structure 302 contained within the eye pads 204, 206 along the perimeter of the aperture 304. When one of the eye pads 204, 206 is used in the wearable computing system 100, the aperture 304 will include a display screen 114/116. The plurality of tactile elements 110 can have different structural details to provide different tactile sensations. By way of illustration and not limitation, different tactile elements can be made of different materials, as shown in close-up view 306 of eyepiece ring 302, bent at different angles or having different contact surfaces. This variability in the structure of the tactile element 110 facilitates producing different pressure levels or providing different contact areas or different textures associated with the sensation provided by the tactile feedback to the user 102. In an embodiment, the different tactile elements 110 can have different shapes and can be configured on the frame 124/126 in different ways. For example, the tactile element 110 can be configured such that the length of the tactile element 110 gradually changes from one tactile element to an adjacent element or the angle of inclination of the tactile element can be gradually changed as shown on the frame 124 of 306.

The fourth figure illustrates various views of one of the haptic elements 110 in accordance with an embodiment of the present invention. In various embodiments, the tactile element 110 can be made of an elastomeric polymer or metal or a combination thereof (such as a metal arm coated with a gel-filled polymer skin) that includes some degree of elasticity to not only withstand when provided The vibration generated when the haptic feedback is transmitted, and the vibration generated by the user 102 is transmitted. Move as a different type of user input.

Views 402, 404, 406, and 408 together show a ring view of one of the tactile elements 110. In particular, the 406 and 408 series 402 and 404 are cross-sectional views as seen from the points of view A and B, respectively. Each tactile element 400 has a base portion 410, a neck portion 412, and a head portion 414. In one embodiment, the entire length of the tactile element 400 from the center of the base portion 410 to the top end of the head 414 can vary from about 1-3 centimeters. In an embodiment, different tactile elements may have different lengths based on their position on the frame 124/126 and the area in which the tactile elements may contact. The base portion 410 connects the tactile element 400 to the frame 124/126 of the eyepiece 104/106. In an embodiment, the base portion 410 is hollow to allow the tactile element 400 to be electrically coupled to other components of the wearable computing system 100, such as a processor in the bridge portion 108. Thus, the base portion 410 not only facilitates the physical connection of the tactile element 400 to the frame 124/126, but also facilitates electrically coupling the tactile element 400 to other components of the wearable computing system 100.

The neck portion 412 connects the base portion 410 to the head 414 of the tactile element 400. Different tactile elements 110 can have different lengths associated with the neck portion. The various tactile elements 110 can also bend their necks at different angles to vary the type of sensation provided to the user 102 based on tactile feedback. In an embodiment, the neck 412 can also be hollow to electrically couple the head 414 to other components that can be worn with the computing system 100. In an embodiment, the neck 412 can be a solid structure that connects the head 414 to the base portion 410.

The head 414 of the tactile element 400 contacts the skin of the user 102 to provide tactile feedback. In an embodiment, the head 414 can be made of a material similar to other portions of the tactile element 400, but can be constructed using a particular pattern 420 to provide a particular type of sensation on the user's skin. Different patterns can be formed on the head portions of different tactile elements, such as for tactile elements The head portion of 110. In an embodiment, the head 414 can be configured from a different material than the other components of the tactile element 400. In one embodiment, the head 414 can be made of the same material as the rest of the tactile element 400, but can be coated or coated with another material. In an embodiment, the head portions of the different tactile elements 110 can be constructed in accordance with different embodiments to establish various types of tactile sensations.

As described above, the tactile element 110 can also be a portion of the system for detecting the movement of the facial muscles of the user. By way of illustration and not limitation, movement of the skin of the user 102 can cause movement of the tactile element 110. Thereby, the reaction properties of the user 102, such as the intensity and duration of facial muscle movement, can be detected and recorded. Different feedbacks including one or more visual, audio or tactile modes can be provided based on attributes of the user's movement.

The fifth figure shows a schematic view of a cross section of one of the tactile elements 110 (e.g., 400) in accordance with an embodiment of the present invention. As described above, the tactile element 400 includes a hollow base portion 410, a neck portion 412, and a head portion 414. The base portion 410 not only connects the tactile element 400 to the frame of the eyepiece 102/104, but also houses the actuation mechanism. The actuation mechanism can be configured in a two-way manner such that not only haptic feedback is provided to the user 102, but also user input is collected via various movements performed by the muscles around the eyes of the user 102. The neck 412 connects the base to the head 414 so that the head 414 can be actuated to provide appropriate tactile feedback or, conversely, the movement of the head 414 can be detected to record the necessary attributes entered by the user.

According to an embodiment, the actuation mechanism includes a signal contact plate 502 that positively contacts the spherical body 510 to form a ball and socket engagement. The spherical body 510 can be freely rotated not only along the axes passing through A, but also along different axes within the signal contact plate 502. When a current is passed through the coil 516, a pair of magnets 508 along with the electrical coil 516 provides mechanical actuation of the rotating spherical body 510. One of the pair of magnets 508 is attached to the rotating spherical body 510, and the other magnet is fixed to the base. The bottom of the 410. Conversely, when the rotating spherical body 510 moves due to mechanical movement of the head 414 and the neck 412 caused by user input (eg, the user 102 moves the muscles of the eye socket in contact with the tactile element 400), the pair of magnets 508 It is also used to induce current in the coil 516.

A connecting wire 520 including a bezel 522 is attached to the rotating spherical body 510 and runs through the length of the neck 412 and interconnects at least a portion of the head 414 of the various components therein. The wire 510 is rotated within the signal contact plate 502 by flowing a current through the coil 516, thereby pulling or pushing the wire 520, thereby actuating the neck 412 and the head 414 along the vertical axis XY. In addition to providing mechanical actuation, the connecting wires 520 can also include electrical connections for the speaker array 504.

In an embodiment, the speaker array 504 can include one or more speakers 532, 534, and 536 configured to provide tactile feedback, such as vibration. In one embodiment, the transmitted vibrations contribute to bone conduction such that audio feedback can also be provided through one or more speakers in array 504. It can be appreciated that the speakers 532, 534, and 536 can constitute audio feedback for conduction via the bone based on the position of the tactile element 110. For example, the tactile element 110 that is in contact with the softer muscle portion of the orbital socket (such as under the eye) may not constitute an audio feedback for conduction through the bone, but rather a tactile sensation on the upper portion of the frame 124/126 that contacts the eyebrow or bone bridge of the user 102. The components can be configured for bone conduction in accordance with embodiments described herein. The different speakers 532, 534, and 536 can vary in size and power properties to provide a wide variety of tactile vibrations based on the power and contact area of each of the arrays of speakers 504. In one embodiment, the head 414 can be made of a metal combination of plastic and/or portion 540 of the skin that does not contact the user 102, while the front faces of the speakers 542, 544, and 546 are disposed within the gel pad 506. User 102 provides a softer feel. In an embodiment, the gel pad 506 can include additional components (such as heating elements (not shown)) to provide an additional type of tactile feedback to the user 102.

It will be appreciated that the structures in the fourth and fifth figures are shown by way of illustration only and not limitation, and that the tactile element 110 can constitute other structures having embodiments in accordance with the present specification. For example, the tactile element 110 can be configured to include a spherical or cylindrical or other shaped protrusion on the frame 124, 126. In an embodiment, different ones of the plurality of tactile elements 110 can have different shapes and can be configured in different ways on the frame 124/126, as discussed above. In an embodiment, the tactile element 110 can include an electric chuck to provide a particular type of tactile feedback by pulling the skin of the user 102. In an embodiment, the tactile element 110 can include tiny pinholes located on the frame 124/126.

The sixth diagram shows an illustration of a plurality of tactile elements 110 that provide tactile feedback to the user 102, the tactile feedback being synchronized with a particular display containing the virtual user 600. In the present embodiment, each of the plurality of haptic elements 110 is mapped to provide haptic feedback associated with, for example, a virtual world experience of the virtual user 600 that may be relevant to the user 102. Each of the plurality of tactile elements 110 is associated with a particular one of the body parts of the virtual user 600 such that if a particular body part of the virtual user 600 (e.g., the head 602) experiences a virtual world, such as the user 102 is displaying a screen The particular sensation seen on one or more of 114 and 116 initiates a tactile element 604 that is mapped to the head 602 to give the user 102 a tactile contact point between the tactile element 604 and the area above the right eye of the user 102. Feedback. For example, if the virtual user 600 touches the object with his head portion 602, the tactile element 604 can be activated to apply pressure to the brow of the user 102 at the point of contact. Likewise, the user 102 can be provided with the experience of heat, pressure, or another biological or non-living touch or other physical sensation of the virtual user 600 via appropriate activation of one or more of the haptic elements 110. It will be appreciated that the human virtual user 600 is shown by way of example only and not limitation, and that the plurality of tactile elements 110 can be mapped to other biotic or non-virtual virtual users and the virtual world of the virtual user described above The boundary experience can be transferred not only to the user 102 via a visual or audio channel, but also as a tactile sensation through the tactile element 110. This can contribute to providing the user 102 with a touch of other creatures (such as a bird flight) or a sense of a non-living body (such as a racing car).

In one embodiment, the virtual user 600 can be enabled to interact with the virtual world displayed on the screen 114/116 via the movement of the user's 102 eyes and gaze tracking. For example, a user 102 staring at a virtual user 600 for a predetermined period of time can facilitate selection of a virtual user 600 for interaction. Similarly, moving the line of sight in a particular direction after selection can properly move the virtual user 600 and gaze at the point for a predetermined period of time to fix the virtual user 600 to the position where the line of sight of the user 102 is stationary or to provoke the user 102. The eyebrows enable the virtual user 600 to jump. When the eye moves quickly, the time period associated with the user's gesture is about a few seconds. Haptic feedback and gesture mapping can be programmed to fit the content provided by computing system 100. For example, a video game application or movie can be created for use with a wearable computing system 100 that incorporates tactile feedback and user interaction mechanisms built into it.

In embodiments in which the computing system 100 displaying the virtual user 600 includes a visual cortex thought detector 220, the virtual user 600 can be manipulated based on input provided by the visual cortex thought detector 200. As described above, electrical signals generated by the visual cortex of the user 102 can be detected and interpreted to thereby change the state of the virtual user 600. By way of illustration and not limitation, virtual user 600 can move up or down or sideways, or can change the size of virtual user 600 based on input from visual cortex mind detector 220.

The seventh diagram depicts a block diagram of certain exemplary modules within the wearable computing device 100 in accordance with an embodiment. It should be appreciated that certain embodiments of the wearable computing system/device 100 can include more or fewer modules than shown in the seventh diagram. The wearable computing system 100 includes a processor 700, a tactile sense The component 110, the display screen 730, the visual cortex thought detector 200, the audio component 740, the storage medium 750, the power source 760, the transceiver 770, and the detection module/system 780. Despite the schematic of the seventh diagram, the wearable computing system 100 is shown as containing a single eyepiece due to a display screen 730. However, the wearable computing system 100 can include two eyepieces having display screens, each of which can have all of the modules described in this specification, or the eyepieces can be used together and can include each of the above modules to avoid Repeat the module.

The wearable computing system 100 can constitute a processor 700 that includes a suitable location (e.g., located at the bridging component 108). The processor 700 further includes an input/output (I/O) module 702, a control module 704, and an imaging module 706. Moreover, it should be understood that although only one processor 700 is shown, the wearable computing system 100 can include multiple processors or the processor 700 can include a particular task sub-processor. For example, processor 700 can include a general purpose sub-processor for controlling various devices contained within wearable computing system 100, and a dedicated graphics processor for generating and manipulating displays on display screen 730. The I/O module 702 included in the processor 700 can be configured to receive different types of inputs from various components, such as user gesture input from the detection system 780, user input from the visual cortex thought detector 220. Or an audio input from an audio component 740 such as a microphone. The processor 700 can also receive content related input from a local storage medium 750 or via a transceiver 770 from a remote server (not shown) for display on a display screen. The processor 700 can additionally receive input from the tactile element 110 regarding the muscle movement of the user monitored by the tactile element 110 as part of the detection system 780. The processor 700 is also configured to provide appropriate output to different modules of the wearable computing system 100 and other network resources such as remote servers (not shown).

Thus, the various inputs received from the different modules can be processed by appropriate programming or processing logic within the control module 704 of the processor 700 that provides the reactive output, as will be further detailed below. Said. The program logic can be stored in the memory unit, i.e., on the motherboard, the processor 700 or program logic can be stored in the external processor readable storage device/media 750 and can be loaded by the processor 700 as needed. In one embodiment, in addition to the tactile element control logic, the processor 700 can execute program logic to display the content transmitted by the remote server on the display screen 730 to activate the associated tactile element 110 in an appropriate manner and with The displayed content provides tactile feedback to the user simultaneously. Commands relating to activation of the haptic element 110 can be provided from a remote server, and the haptic element control logic stored on the storage medium 750 and executed by the processor 700 can interpret the command to properly activate the haptic element 110.

In an embodiment, the imaging module 706 also included in the processor can include program logic (such as display manipulation logic executed by the processor 700) to be based on one of the slave detection system 780 and the visual cortex thought detector 220. Or more than the input obtained to create or manipulate the display. The input received from detection system 780 is related to eye tracking and muscle movement around the eyes of user 102. Based on the direction of eye movement or the direction and force of muscle movement around the eye, the display manipulation logic of imaging module 706 can perform various tasks, typically performed by a mouse or joystick or other user input mechanism. Thus, the user 102 can perform tasks related to the computing device, such as by moving his/her eyes or muscles around the eyes to produce text or image material.

In another embodiment, imaging module 706 can be employed to alter an existing display to generate new elements in the display based on input received from visual cortex mind detector 220. For example, the user 102 can close his/her eyes to imagine a geometric pattern with a particular color. Although the detection system 780 may not be able to provide user input to the processor 700 with the user's eyes closed and without any muscle movement, the visual cortex thought detector 200 can still obtain information about the user 102's imagination. And the imaging module 706 can execute to display the user's imagination on the display screen 730. In one embodiment, imaging module 706 can execute program logic to reconstruct the imagination of user 102 on display screen 730. In one embodiment, input from the visual cortex mind recorder 220 can be transmitted by the transceiver 770 to a remote server (not shown), wherein the input is interpreted and the display based on the input is established and transmitted back The computing system 100 is worn. In this case, the imaging module 706 is employed to display the received display on the display screen 730 to the user 102. In one embodiment, the I/O module 702 can further form the user experience/imagination obtained by storing the visual cortical detector 220 on a local storage device 750 or a remote server (not shown).

The eighth diagram shows a schematic diagram of a wearable computing device 100 in communication with a remote server 810. The transceiver 770 included in the wearable computing device 100 facilitates the wearable computing device 100 to communicate with the remote server 810 via the network cloud 820. According to various embodiments, remote server 810 can be configured to perform various tasks as detailed in this specification. In an embodiment, wearable computing device 100 transmits content from remote server 810, which can include audio/video (AV) content associated with synchronized haptic feedback information. The processor 700 not only displays the transmitted AV content, but also activates the tactile element 110 to provide a different type of sensation to the user 102. The wearable computing system 100 also constitutes detecting user feedback and performing tasks, such as manipulating the display or storing the displayed display in the local storage of the wearable computing system 100 or transmitting user feedback to the remote server 810. For further processing or storage.

The ninth diagram shows a flowchart 900 illustrating an embodiment of a method of providing content to a user 102 as performed by the wearable computing device 100. The method begins at step 902 by providing content to the user 102 via the display screen 114/116 and/or the audio component 740. In various embodiments, the content provided to the user 102 can include one or more audio and video content associated with the haptic feedback material. According to an embodiment described in this specification, it can be from a local storage device 770 or a remote server 810 gets the content. At step 904, an instruction to provide haptic feedback is also taken with the content. The received content is provided to the user 102 and at the same time the haptic feedback is provided to the user via activation of the appropriate tactile element 110, as shown at 906. In accordance with an embodiment described herein, at step 906, various sensations of pressure, heat, prolonged or momentary sensations of contact with biotics and non-living bodies can be provided by actuating the haptic elements 110.

The tenth diagram shows a flowchart 1000 illustrating an embodiment of a method of providing interactive content to a user 102 as performed by the wearable computing device 100. This method can be performed in conjunction with the method of Figure 9 above. The method begins at step 1002 by using the detection module/system 780 described herein to view or monitor the movement of the user's eyes 102 and the movement of the face around the user's eyes. As in step 1004, motion of the eye and/or eye posture is detected. At step 1006, it is determined whether the eye movement of the user 102 is mapped to a particular task related gesture. It is not limited to closing the eyes for a predetermined period of time, which may include expanding the eyes, moving the eyes at a particular speed in a particular direction, staring at the small figure, picking up one or two eyebrows, blinking or a combination of the above. For example, in the case of a gesture combination, the user 102 stares at the object on the screen 114/116 for a predetermined period of time to enable the item to be selected and then move the eye in a particular direction to cause the item to move on the screen in a corresponding manner. Some gestures can be accidental or unintentional movements that do not reflect any user intent. The wearable computing system 100 can be configured to distinguish between the unintentional gestures and the intentional gestures, for example, by associating a particular gesture with a predetermined time period. In step 1006, if it is determined that the particular gesture is associated with a particular task, then at step 1008, the wearable computing device 100 responds to the detected eye gesture or eye movement to perform the task described above, otherwise the gesture or motion is ignored as shown in step 1010. . In either case, the wearable computing system 100 continues to monitor user movement at step 1002.

An eleventh diagram shows an example of a user who is executed by the wearable computing device 100 A flowchart 1100 of an embodiment of a method of providing interactive content. The method begins in step 1102 with the wearable computing system 100 receiving a user input. A visual cortex located behind the head of the user 102 can produce a visual image. If the instrument that records the electrical signal from the visual cortex of the brain of the user 102 is located behind his/her head, a graphical image can be generated that is visualized by the user 102's imaginary pattern or in the user's brain. . Thus, the user can perform tasks such as text input only by visualizing appropriate letters, and the wearable computing system 100 will be able to detect and generate text files that are visualized by the user 102. Similarly, user 102 can visualize patterns, colors, or other graphics that can be detected and played by visual cortex thought detector 720. For example, the user 102 can visualize the vertical movement of the virtual user based on electrical signals from the brain of the user 102, thereby enabling the virtual user to be moved. As shown in step 1104, the electrical signals are interpreted or detected to obtain patterns and/or color information regarding the input of the user 102 as obtained by the visual cortex thought detector 720. At step 1106, a graphical image of the user 102's imagination is generated and displayed on display screen 114/116, as shown in step 1108.

In an embodiment, the method of the eleventh figure can be used in conjunction with the method outlined in the ninth figure. The content with or without tactile feedback can be provided to the user 102 via the wearable computing system 100, as detailed in the ninth figure, and the content provided by the user 102 can be used to change the provided content, as shown in FIG. Detailed. Content changed according to the imagination of the user 102 can be displayed on the display screen 114/116.

In one embodiment, the functionality of the visual cortex thought detector 720 can be distributed over the network 820 such that the visual cortex detector 720 that can be worn with the computing system 100 only detects electrical power from the visual cortex of the user 102. Signals, while performing other tasks in the server 810, such as interpreting signals, playing the imagination of the user 102, and generating graphics based on the detected signals. Server The resulting graphics are transmitted back to the wearable computing system 100 for display on the screen 114/116.

A twelfth diagram shows a flowchart 1200 illustrating an embodiment of a processor-executable method of providing haptic feedback in synchronization with display of a virtual user 600. The method begins in step 1202, where a display containing the virtual user 600 is displayed to the user 102, and at step 1204, user input is received to manipulate the virtual user 600. As described in this specification, virtual user 600 can be manipulated using inputs from various modules, such as detection system/module 780. At step 1206, the virtual user 600 is manipulated based on user input. For example, user 102 can move his eyes in a manner that moves virtual user 600 in a particular direction. At step 1208, an experience is received when the virtual user 600 is manipulated based on user input. For example, the virtual user 600 can enter into contact with an object entity in the virtual world when moving based on user input, as described above. At step 1210, the portion of the virtual user 600 that is affected by the experience is identified, and at step 1212, the tactile elements of the plurality of tactile elements corresponding to the affected portion of the virtual user 600 are determined. At step 1214, based on the experience of the virtual user 600, the corresponding tactile element can be activated. In various embodiments, a plurality of tactile elements 110 can be activated or a subset of the plurality of tactile elements 110 can also be activated. In another embodiment, different tactile elements can be activated in a unique manner to provide various tactile sensations to the user 102.

It should be appreciated that in an embodiment, the process described by flowchart 1200 can be performed by wearable computing system 100. In an embodiment, the process described by flowchart 1200 can be performed by wearable computing system 100 along with remote server 810. For example, wearable computing system 100 is operable to provide display at step 1202, collect user input at step 1204, and manipulate the virtual user as shown in step 1206. The collected user input can be communicated to the remote server 810, which receives the experience of the virtual user 600 at step 1208, and the identification is entered at step 1210. A portion of the affected virtual user 600, and at step 1212, a tactile element corresponding to the affected portion is identified. In the present embodiment, the remote server 810 can transmit instructions to the wearable computing system 100 to activate the tactile elements corresponding to the affected portion, as shown at step 1214.

For the purposes of the present invention, a computer readable medium stores computer data, the data of which can include computer code executable in a machine readable form for execution by a computer. By way of example and not limitation, a computer-readable medium may comprise a computer-readable storage medium for physical or invariant data storage, or a communication medium for transient interpretation of coded signals. As used in this specification, a computer-readable storage medium refers to physical or tangible storage (as opposed to a signal) and includes, but is not limited to, for information (such as computer readable instructions, data structures, program modules, or other materials). Volatile and non-volatile, removable and non-removable media implemented by any method or technique of tangible storage. Computer readable storage media includes, but is not limited to, RAM, ROM, EPROM, EEPROM, flash memory or other solid state memory technology, CD-ROM, DVD, or other optical storage, magnetic cassette, magnetic tape, disk storage Or other magnetic storage device, or any other physical or material medium, which can be used to tangibly store desired information or data or instructions and can be accessed by a computer or processor.

For the purposes of the present invention, a module is a software, hardware, or firmware (or combination of) system, program or function, or elements thereof that perform or facilitate the procedures, features, and/or functions described in the specification. (with or without human interaction or amplification). The module can include sub-modules. The software components of the module can be stored on a computer readable medium. A module may be necessary to construct one or more servers as a whole or loaded and executed by one or more servers. One or more modules can be grouped into an engine or application.

It will be appreciated by those skilled in the art that the methods and systems of the present invention can be implemented in many ways and are thus not limited to the exemplary embodiments and examples described above. In other words, in hardware and software or tough Among the various combinations of bodies, functional elements and individual functions performed by a single or multiple components may be distributed between software applications located at the client or server or both. In this regard, some of the features of the various embodiments described in this specification can be incorporated into a single or multiple embodiments, and other embodiments having fewer or more than all of the features described in this specification are possible. The functions may also be distributed, in whole or in part, between a plurality of elements, either now known or in a known manner. Therefore, a myriad of software/hardware/firmware combinations may implement the functions, features, interfaces, and preferences described in this specification. In addition, the scope of the present invention is intended to cover such features and functions and interfaces, as well as hardware or soft or firmware elements that may be described in the present specification as will become apparent to those skilled in the art. Those changes and modifications made.

Although the system and method have been described with respect to one or more embodiments, it should be understood that the invention is not necessarily limited to the disclosed embodiments. Various modifications and similar arrangements are intended to be included within the spirit and scope of the invention. The present invention includes any and all embodiments of the scope of the following claims.

100‧‧‧ Wearable computing system

102‧‧‧Users

104‧‧‧ eyepiece

106‧‧‧ eyepiece

108‧‧‧Bridge components

110‧‧‧Tactile components

114‧‧‧Display screen

116‧‧‧Display screen

124‧‧‧Frame

126‧‧‧Frame

Claims (64)

An eyepiece system for augmenting reality and virtual reality, comprising: a wearable eyepiece comprising: a flexible frame forming a shape for fitting an eye socket of a human wearer such that the frame Substantially blocking the transmission of ambient light from the socket; a display screen is fixed to a hole in the frame such that the display of the flexible frame covers the field of view of the eye; and a first processor that facilitates processing of the data and facilitates Generating a display on the display screen; a processor readable storage medium for storing program logic; and a plurality of tactile elements responsive to the program logic disposed on the flexible frame, the tactile elements being communicatively coupled The first processor is responsive to the display on the screen and selectively activated by the first processor; and a bidirectional actuation mechanism includes a current carrying coil, a pair of magnets, and a signal contact plate, the bidirectional The actuation mechanism constitutes a muscle movement for actuating the tactile elements and detecting the orbit of the human wearer. The eyepiece system of claim 1, wherein the processor readable storage medium comprises haptic component control logic executable by the first processor for controlling the haptic elements. The eyepiece system of claim 1, wherein the flexible frame includes an eye pad that cooperates with the eye socket and blocks the ambient light, and the plurality of tactile elements are disposed on a frame edge of the eye pad. The eyepiece system of claim 1, wherein the flexible frame further comprises a bridge member. It contains the first processor. The eyepiece system of claim 1 further includes two eyepieces that can be worn side by side and that each of the two eye sockets that pair the human wearer. The eyepiece system of claim 1, further comprising: a detection module that detects movement of the eye socket and the eye of the human wearer. For example, in the eyepiece system of claim 6, the program logic further includes: image manipulation logic executed by the first processor for responding to the movement detected by the detection module to control the display screen. Display. For example, in the eyepiece system of claim 6, the detection module includes a camera. For example, in the eyepiece system of claim 6, the detection module includes the plurality of tactile elements. For example, in the eyepiece system of claim 1, the program logic further includes: a tactile component mapping logic executed by the first processor for mapping each of the plurality of tactile components to the projection The display displays a different portion of one of the images on the screen such that activation of a portion of the image initiates each of the tactile elements. The eyepiece system of claim 1, wherein the tactile element comprises a transducer for converting electrical energy into mechanical motion. In the eyepiece system of claim 1, the subset of the tactile elements comprises a heating element. The eyepiece system of claim 1, further comprising: a transceiver disposed on the flexible frame, the transceiver receiving and transmitting a communication signal. The eyepiece system of claim 1, further comprising a speaker disposed on the On the sexual framework, the speaker is used to generate an audio signal. In the eyepiece system of claim 1, a microphone is disposed on the flexible frame for receiving an audio input. A method of providing content, comprising: displaying, by a processor, visual content on a display of a flexible frame fixed to a wearable computing device by a user, the flexible frame being Having a shape matching of at least one eye of the user to engage; selectively enabling one or more of the plurality of haptic elements in synchronization with the visual content by the processor; and using the processor by the processor A tactile feedback around the user's eyes is provided, the tactile feedback being provided in synchronization with the visual content. In the method of claim 16, the providing the tactile feedback further comprises: actuating the tactile element attached to the flexible frame by the processor. In the method of claim 17, the actuating the haptic elements further comprises: vibrating at least a subset of the haptic elements by the processor. In the method of claim 17, the actuating the haptic elements further comprises: heating at least a subset of the haptic elements by the processor. The method of claim 17, further comprising: mapping, by the processor, each of the haptic elements to a specific portion of a virtual user included in the visual content. For example, in the method of claim 20, providing tactile feedback in synchronization with the visual content further includes: A particular one of the tactile elements is activated by the processor based on experience of the particular portion of the virtual user in the visual content. The method of claim 16, further comprising: detecting, by the processor, one or more eyes and movement of facial muscles around the eyes; and responding to the detected by the processor These moves to perform specific tasks. For example, in the method of claim 22, detecting the movement of the eyes and facial muscles further includes: collecting, by the processor, movement of one or more of the eyes and the facial muscles from a camera data of. In the method of claim 22, the specific tasks performed by the processor include at least: manipulating the display on the display screen by the processor based on the detected movements. In the method of claim 22, the specific tasks performed by the processor include at least: mapping, by the processor, each of the tactile elements to a virtual user included in the visual content. a particular portion; and manipulating a particular portion of a virtual user contained in the visual content in response to the detected movements by the processor. A computer readable storage medium, comprising instructions, when executed by a processor, to cause the processor to: display a visual content to a user to a flexible frame that is fixed to a wearable computing device One of the shelves is displayed on the screen, the flexible frame being configured to match a shape of at least one eye of the user; selectively initiating one or more of the plurality of tactile elements in synchronization with the visual content; The user is provided with tactile feedback around the user's eyes, the tactile feedback being provided in synchronization with the visual content. An eyepiece system for augmenting reality and virtual reality, comprising: at least one tactile component mounted on a flexible frame of the wearable eyepiece on a periphery of a display eyepiece display screen, the tactile sensation The component is communicatively coupled to a processor and the flexible frame is configured to fit a shape of an eye socket of a human wearer such that ambient light is blocked; the tactile component includes a base, a neck and a head The touch element attaches the flexible frame to the base such that the head of the tactile element contacts the skin of the human wearer; and a bidirectional actuating mechanism includes a current carrying coil, a pair of magnets, and A signal contact plate that constitutes a muscle movement for actuating the tactile element and detecting the orbit of the human wearer. The eyepiece system of claim 27, wherein the bidirectional actuation mechanism is included in the base of the tactile element. The eyepiece system of claim 28, the bidirectional actuation mechanism further comprising a spherical body within the signal contact plate for actuating the tactile element. In the eyepiece system of claim 29, at least one of the magnets is attached to the spherical body. The eyepiece system of claim 30, wherein the spherical body and the signal contact plate are configured such that the spherical body is free to rotate along a plurality of axes within the signal contact plate. For example, the eyepiece system of claim 30 includes a plurality of speakers. The eyepiece system of claim 32, further comprising a connecting wire connecting the spherical body and the plurality of speakers. The eyepiece system of claim 32, further comprising a gel pad disposed such that the gel pad contacts the human wearer and the surface of the speaker is in the gel pad. The eyepiece system of claim 27, wherein the tactile element comprises a heating element. For example, the eyepiece system of claim 27 includes the processor. The eyepiece system of claim 27, wherein the at least one tactile element comprises a plurality of tactile elements. An eyepiece system of claim 37, wherein a subset of the plurality of tactile elements has a surface in contact with the skin of the human wearer, different from a different one of the plurality of tactile elements Constructed in such a way as to contact the surface of the human wearer's skin. For example, in the eyepiece system of claim 27, the tactile element is a suction cup. The eyepiece system of claim 27, wherein the tactile element is a pinhole on the flexible frame. A method of using an eyepiece for augmenting reality and virtual reality, comprising: providing a tactile element on a flexible frame that can be worn with an eyepiece that is mated to the shape of an eye socket of a human wearer So that the surrounding light is blocked; by a processor and within the video displayed on one of the displayable eyepieces The touch element is synchronously activated; the processor is used to detect physical actuation of the tactile element caused by muscle movement of the eye socket. The method of claim 41, wherein the synchronizing element is synchronized with the video content further comprises: vibrating the tactile element by causing a current through a coil contained in the tactile element. The method of claim 41, wherein simultaneously starting the tactile element with the video content further comprises: heating, by the processor, a heating element contained in the tactile element. In the method of claim 41, the actuating the tactile element in synchronization with the video content further comprises: by the processor, generating a suction force by the tactile element that attracts the skin of the human wearer. The method of claim 41, wherein synchronizing the tactile element with the video content further comprises: providing audio feedback to the wearer through the speaker included in the tactile element. The method of claim 41, wherein the detecting, by the processor, the physical actuation of the haptic element comprises: detecting, by the processor, one of the tactile elements included in the tactile element due to the physical actuation The current induced in the coil. A computer readable storage medium comprising instructions, when executed by a processor, causing the processor to: initiate a tactile element in synchronization with video content displayed on a display screen of a wearable eyepiece, the tactile element being fixed to A flexible frame that can be fitted with an eyepiece that is adapted to the shape of an eye socket of a human wearer such that ambient light is blocked; detecting physical actuation of the tactile element caused by muscle movement of the eye socket. An eyepiece system for augmenting reality and virtual reality, comprising: a wearable eyepiece comprising: a flexible frame forming a shape for fitting an eye socket of a human wearer such that the frame Substantially blocking the transmission of ambient light between the eye socket; a display screen fixed to a hole in the frame; a visual cortical input detecting component attached to the flexible frame, the visual cortical input detecting component detecting An input from the visual wearer of the human wearer; a first processor in communication with the visual cortical input detecting component that facilitates processing the input and generating a display on the display screen based on the input; a processor readable storage medium for storing program logic; a plurality of tactile elements responsive to the program logic disposed on the flexible frame, the tactile elements being communicatively coupled to the first processor and corresponding to the display screen The display is selectively activated by the first processor; and a bidirectional actuation mechanism includes a current carrying coil, a pair of magnets, and a signal contact plate, the bidirectional actuation mechanism Such tactile element for actuating and detecting the movement of the muscles of the human wearer's eye socket. The eyepiece system of claim 48, the program logic comprising: a visual cortical display generation logic executed by the first processor for based on the input from the visual cortex of the human wearer A display is generated on the display screen. For example, in the eyepiece system of claim 49, the visual cortex display generation logic further includes: virtual user manipulation logic executed by the first processor for based on the visual cortex from the wearer Input to manipulate a virtual user displayed on the display screen. The eyepiece system of claim 49, the program logic comprising: a visual cortical input storage logic executed by the first processor for storing the input from the visual cortex in a computer readable storage medium in. For example, in the eyepiece system of claim 49, the visual cortex display generation logic further includes: an auxiliary display generation logic executed by the first processor to be based on one from different from the human wearer The input of a stored visual cortex obtained by the user produces the display. The eyepiece system of claim 48, further comprising: a plurality of tactile elements attached to the flexible frame, the tactile elements being communicatively coupled to the first processor and responsive to the display on the display screen And selectively activated by the first processor. The eyepiece system of claim 53, the program logic further comprising: tactile component manipulation logic executed by the first processor to manipulate the input based on the visual cortex from the wearer Such as tactile components. A method of providing content, comprising: obtaining, by an first processor, an input from a visual cortex of a first user as an electrical signal; and interpreting the electrical signal by the first processor to generate from the first An image of the input of the visual cortex of the user; the first processor is configured to display the image on the screen based on one of a flexible frame fixed to a wearable computing device Displaying visual content by the user, the flexible frame is configured to be engaged with at least one eye of the first user; and the visual content is transmitted to the first user by a second processor a second user; receiving, by the second processor, input from a visual cortex of the second user; by the second processor, by based on the visual cortex from the second user The input changes the visual content to generate new visual content; and the second visual processor stores the new visual content in a processor readable storage medium. The visual content is the image as claimed in claim 55. The method of claim 55, the displaying the visual content to the first user based on the image further comprises: using the input by the first processor before obtaining the input from the visual cortex Manipulating a display displayed to the first user. As shown in the method of claim 57, the display includes a virtual user. For example, in the method of claim 57, the manipulation of a display further includes: With the first processor, a visual attribute of one of the elements included in the display is changed based on the input from the visual cortex. In the method of claim 55, the visual content includes a pattern that is obtained as input from the visual cortex of the first user. The method of claim 55, further comprising: actuating, by the first processor, a tactile element attached to the flexible frame based on the input from the visual cortex. The method of claim 55, further comprising: storing, by the first processor, the visual content based on the image. A computer readable storage medium comprising instructions, when executed by a processor, causing the processor to: obtain an input from a visual cortex of a first user as an electrical signal; by interpreting the electrical signal to generate An image of the input from the visual cortex of the first user; displaying the visual content based on the image displayed on one of a flexible frame fixed to a wearable computing device, the flexible frame And engaging at least one eye of the first user with a shape matching configuration; transmitting the visual content to a second user different from the first user by a second processor; a second processor receiving input from a visual cortex of the second user; the second processor generating new vision by changing the visual content based on the input from the visual cortex of the second user Content; and The new visual content is stored in a processor readable storage medium by the second processor. The computer readable medium of claim 66, wherein the visual content is the image.