TWI581173B - A system with eye piece for augmented and virtual reality and a method using the system - Google Patents

Description

Eyepiece system for augmenting reality and virtual reality and method of using the same [Cross-reference related applications]

U.S. Non-Provisional Patent Application No. 13/829,918, filed on Apr. 13, 2013, entitled "Eye Piece for Augmented and Virtual Reality", U.S. Patent Application Serial No. 2013/3/14 No. 13/830,190, entitled "Tactile Elements for a Wearable Eyepiece", and US Non-Provisional Patent Application No. 13/830,370, filed on Dec. 2013/3, entitled "Visual Cortex Thought Detector Interface" It is incorporated herein by reference for reference.

The present invention relates to systems and methods for generating and manipulating amplification or virtual reality displays.

The increasing computing power of microprocessors and the precision of data transfer systems have allowed portable devices such as tablets and smartphones to evolve to replace traditional desktop and laptop computers for personal computing and business purposes. The extent of the preferred device. In a further evolution, wearable computing devices capable of presenting additional information (eg, from the Internet) have emerged that enhance the user's real-world viewing experience. Augmented reality glasses are used to create overlays in the field of view of the eye to present additional information or to collect and record information from the real world. In order to solve this kind of The processing requirements of the portable device use a cloud computing system to perform processing-intensive tasks associated with data manipulation at a central location, remote from the user, while distributing the results of processing tasks among various portable devices.

The present invention is directed to a wearable computing system that provides content that is obtained locally or from a network source in synchronization with haptic feedback. The wearable computing device includes at least one eyewear that can be worn. The wearable eyepiece further includes a flexible frame configured to mate with an eye socket shape of a human wearer such that substantially no ambient light transmission is blocked between the frame and the eye socket. The display screen is secured to a hole in the frame such that the display of the shape of the mating flexible frame encompasses the field of view of the eye. A first processor that facilitates processing of the data and a display on the display screen and a processor readable storage medium for storing program logic are also included in the wearable computing system. Additionally, the plurality of haptic elements are responsive to the program logic disposed on the flexible frame, the haptic elements being communicatively coupled to the first processor and responsive to display on the display screen for selective activation by the first processor. Accordingly, the tactile element control logic is included in program logic stored on a processor readable storage medium and executable by the first processor for controlling the tactile elements.

In one embodiment, the flexible frame includes an eye pad such that a plurality of tactile elements are disposed on the rim of the eye pad. The eye pad promotes matching with the eye socket and blocks ambient light. In an embodiment, the flexible frame further includes a bridge member that includes a first processor. The flexible frame also includes a transceiver that allows the transceiver to receive and transmit communication signals. At least one speaker and a microphone are also disposed on the flexible frame such that the speaker produces an audio signal and the microphone is operable to receive an audio input.

In one embodiment, the wearable computing system includes two eyepieces that can be worn and lined up. It is configured to match each of the two eye sockets of the human wearer.

In one embodiment, a detection module detects movement of the eye socket and the eye of the wearer. In an embodiment, the detection module includes a camera. In an embodiment, the detection module also includes a plurality of tactile elements.

In one embodiment, the program logic further includes image manipulation logic that is executed by the first processor to control display on the display screen in response to movement detected by the detection module. In one embodiment, the program logic also includes a haptic component mapping logic that is executed by the first processor for mapping each of the plurality of haptic elements to different portions of the image projected onto the display screen. Enabling one of the activation images initiates each of the tactile elements.

In an embodiment, a method of providing content is disclosed. The method includes displaying, by a processor, visual content on a display screen of a flexible frame secured to a wearable computing device to a user. The flexible frame is engaged in a configuration that matches the shape of at least one of the eyes of the user. The method further includes providing, by the processor, tactile feedback around the eyes of the user to the user, the tactile feedback being provided in synchronization with the visual content. In an embodiment, the haptic feedback is provided by activating a tactile element attached to the flexible frame, for example by vibrating or heating at least a subset of the tactile elements.

In one embodiment, each of the haptic elements is mapped to a particular portion of a virtual user included in the visual content, and providing haptic feedback in synchronization with the visual content further includes based on the virtual user in the visual content The experience of a particular portion of the particular part of the particular tactile element is initiated.

In one embodiment, the method further includes detecting, by the processor, one or more movements of the facial muscles around the eyes and the eyes, and performing specific tasks in response to the detected movements. in In one embodiment, detecting movement of the eye and facial muscles further includes collecting, by the processor, information about movement of one or more of the eye and facial muscles from a camera. The particular task performed by the processor includes, at least by the processor, manipulating the display on the display screen based on the detected movement. In an embodiment, the specific task performed by the processor can also include mapping, by the processor, each tactile component to a specific portion of a virtual user included in the visual content; and responding to the detected movement And manipulating a specific part of a virtual user contained in the visual content.

In one embodiment, a non-transitory computer readable storage medium is disclosed that includes processor executable instructions. The storage medium includes instructions for causing the processor to display visual content to a user on a display screen attached to a flexible frame of a wearable computing device, the flexible frame employing one of at least one eye of the user The shapes match the configuration to engage. The instructions also cause the processor to provide tactile feedback around the user's eyes to the user, and the tactile feedback is provided in synchronization with the visual content.

In an embodiment, the haptic feedback is initiated by the processor to activate the tactile elements attached to the flexible frame, for example, by vibrating or heating at least a subset of the tactile elements. In one embodiment, each of the haptic elements is mapped to a particular portion of a virtual user included in the visual content, and providing haptic feedback in synchronization with the visual content further includes based on the virtual user in the visual content The experience of a particular part to initiate a particular one of the tactile elements.

In one embodiment, the method further includes detecting, by the processor, one or more movements of the facial muscles around the eyes and the eyes, and performing specific tasks in response to the detected movements. In one embodiment, detecting movement of the eye and facial muscles further includes collecting, by the processor, information about movement of one or more of the eye and facial muscles from a camera. The particular task performed by the processor includes at least manipulating the display on the display screen based on the detected movement by the processor. In a In an embodiment, the specific task performed by the processor can also include, by the processor, mapping each of the tactile elements to a specific part of a virtual user included in the visual content; and responding to the detected The measured movement manipulates a particular portion of a virtual user contained in the visual content.

In one embodiment, a system is disclosed that includes at least one tactile element mounted to a flexible frame that can be worn with an eyepiece. At least one haptic element is mounted on the periphery of one of the displayable eyepiece display screens. The haptic element is communicatively coupled to a processor and the flexible frame is configured to mate with an eye socket shape of a human wearer such that ambient light is blocked. The tactile element includes a base, a neck and a head, the tactile element attaching the flexible frame to the base such that the head of the tactile element contacts the wearer's skin. A bi-directional actuation mechanism includes a current carrying coil, a pair of magnets, and a signal contact plate included in the base of the tactile element. The two-way actuation mechanism is configured to actuate the tactile elements and detect muscle movement in the eye socket of the wearer.

In one embodiment, the two-way actuation mechanism further includes a spherical body for actuating the tactile element within the signal contact plate. At least one magnet is attached to the spherical body. The spherical body and the signal contact plate are configured such that the spherical body is free to rotate along a plurality of axes within the signal contact plate. In an embodiment, the system can further include a plurality of speakers. A connecting wire connects the spherical body to the plurality of speakers, and a gel pad is configured such that the gel pad is in contact with the wearer and the surface of the speaker is in the gel pad. In an embodiment, the tactile element comprises a heating element.

In an embodiment, the at least one tactile element comprises a plurality of tactile elements. A subset of the plurality of tactile elements has a surface in contact with the wearer's skin, which is constructed in a manner different from the surface in contact with the wearer's skin of a different subset of the plurality of tactile elements. In an embodiment, the tactile element is a suction cup. In an embodiment, the tactile element is a pinhole on the flexible frame.

In an embodiment, a method of providing content is disclosed. The method includes providing a tactile element on a flexible frame that can be worn with an eyepiece that mates with an eye socket shape of a human wearer such that ambient light is blocked. The method further proposes to activate the tactile element in synchronization with the video content displayed on the display screen of one of the wearable eyepieces by a processor; and by detecting the coil contained in the tactile element due to physical actuation The induced current is actuated by the entity of the tactile element caused by the movement of the muscles of the eye socket.

In an embodiment, initiating the tactile element in synchronization with the video content further comprises causing a current to vibrate the tactile element by the processor through a coil contained within the tactile element. In an embodiment, initiating the tactile element in synchronization with the video content further includes heating, by the processor, a heating element contained within the tactile element. In an embodiment, initiating the tactile element in synchronization with the video content further comprises generating a suction by the processor via a tactile element that attracts the skin of the wearer. In an embodiment, initiating the tactile element in synchronization with the video content further includes providing audio feedback to the wearer through the speaker contained within the tactile element.

In one embodiment, a computer readable storage medium is disclosed. The computer readable medium includes instructions for causing a processor to activate a tactile component in synchronization with video content displayed on a display screen of a wearable eyepiece when the processor executes the instructions; and detecting muscle movement of the eye socket The entity of the tactile element is actuated. The tactile element is attached to a flexible frame that can be worn with eyepieces that fits into the eye socket shape of one of the human wearers such that ambient light is blocked.

In one embodiment, a system is disclosed that includes at least one wearable eyepiece. The eyepiece includes a flexible frame; a display screen secured to a hole in the frame; and a visual cortical input detection module attached to the flexible frame for detecting input from the wearer's visual cortex . The flexible frame is configured to fit one of the human wearer's eye socket shapes so that the frame is The transmission of ambient light is substantially blocked between the eye sockets. A first processor in communication with the visual cortical input detection module is further included in the system such that the first processor facilitates processing input and based on program logic stored on a processor readable storage medium also included in the system Produce a display on the display screen.

In one embodiment, the program logic includes a visual cortical display generation logic for generating a display on the display screen based on input from the wearer's visual cortex. The visual cortex display generation logic further includes virtual user manipulation logic for manipulating a virtual user displayed on the display screen based on input from the wearer's visual cortex. The program logic also includes a visual cortical input storage logic for storing input from the visual cortex in a computer readable storage medium; and an auxiliary display generation logic for based on a second user different from one of the wearers A visual cortex obtains the stored input to produce a display.

In one embodiment, the system further includes a plurality of tactile elements attached to the flexible frame, the tactile elements being communicatively coupled to the first processor and selectively activated by the first processor in response to the display on the display screen. The tactile element manipulation logic is contained within the program logic and executed by the first processor to manipulate the tactile elements based on input from the wearer's visual cortex.

In an embodiment, a method of providing content is disclosed. The method comprises various processor executable steps comprising: obtaining, by a first processor, an input from a visual cortex of a first user as an electrical signal; interpreting the electrical signal to produce a visual from the first user An image of the input of the cortex and based on the image to display or store at least one of the visual content to the first user on a display screen. The display screen is secured to a flexible frame that can be worn with a computing device that is configured to mate with a shape that matches at least one of the eyes of the first user. In an embodiment, image based visual content can be stored. In an embodiment, within the visual Tolerance image. In an embodiment, the display includes a virtual user. In an embodiment, displaying the visual content to the first user based on the image further includes using the input to manipulate a display displayed to the first user by the first processor prior to obtaining the input from the visual cortex. In one embodiment, manipulating a display further includes changing, by the first processor, a visual attribute of the component included in the display based on input from the visual cortex. In an embodiment, the visual content includes a pattern that is obtained as input from a visual cortex of the first user. The method further includes actuating, by the first processor, a tactile element attached to the flexible frame based on input from the visual cortex.

According to an embodiment, the method also includes transmitting the visual content to a second user different from the first user by a second processor. In an embodiment, the second processor is different from the first processor. The method further includes the steps performed by the second processor. The step includes: receiving input from a visual cortex of one of the second users; changing the visual content to generate new visual content based on input from the visual cortex of the second user; and storing the new visual content in a processor readable storage In the media.

In one embodiment, a computer readable storage medium is disclosed, comprising processor executable instructions. When a processor executes the instructions, causing the processor to obtain an input from a visual cortex of a first user as an electrical signal, by interpreting the electrical signal to produce one of the inputs from the visual cortex of the first user An image; and displaying an image on the screen based on one of a flexible frame fixed to a wearable computing device to display visual content. The flexible frame is engaged in a configuration that matches a shape of at least one of the eyes of the first user.

These and other embodiments will be apparent to those skilled in the art in the <RTIgt;

100‧‧‧ Wearable computing system

102‧‧‧Users

104‧‧‧ eyepiece

106‧‧‧ eyepiece

108‧‧‧Bridge components

110‧‧‧Tactile components

114‧‧‧Display screen

116‧‧‧Display screen

124‧‧‧Frame

126‧‧‧Frame

152‧‧ points

154‧‧ points

156‧‧ points

158‧‧ points

204‧‧‧ eye pads

206‧‧‧ eye pads

220‧‧‧Visual Cortex Thought Detector

222‧‧‧带带

232‧‧‧End

234‧‧‧End

302‧‧‧ eyepiece ring structure

304‧‧‧ hole

306‧‧‧ close view

402‧‧‧ view

404‧‧‧ view

406‧‧‧ view

408‧‧ view

410‧‧‧Base section

412‧‧‧ neck

414‧‧‧ head

420‧‧‧ pattern

502‧‧‧Signal Contact Board

504‧‧‧Speaker array

506‧‧‧ gel pad

508‧‧‧ magnet

510‧‧‧Spherical body

516‧‧‧ coil

520‧‧‧Connecting wires

522‧‧‧ frame side

532‧‧‧Speaker

534‧‧‧Speakers

536‧‧‧Speaker

Section 540‧‧‧

542‧‧‧Speaker

544‧‧‧Speaker

546‧‧‧Speaker

600‧‧‧virtual users

602‧‧‧ head

604‧‧‧Tactile components

700‧‧‧ processor

702‧‧‧Input/Output (I/O) Module

704‧‧‧Control Module

706‧‧‧ imaging module

730‧‧‧display screen

740‧‧‧audio components

750‧‧‧ storage media

760‧‧‧Power supply

770‧‧‧ transceiver

780‧‧‧Detection system

810‧‧‧Remote Server

820‧‧‧Network

In the figures, the same reference numerals are used to refer to like elements in the drawings, in which: FIG. 1A is used in humans with a computing system/device according to an embodiment of the present invention. Illustration of the person; Figure 1B shows a profile of a user with a wearable computing system; Figure 2A shows a view of another view of a user-oriented wearable computing system in accordance with an embodiment of the present invention 2B shows an illustration of a user of a wearable computing system that includes a visual cortex mind detector; the third figure shows a diagram of some exemplary details of the tactile element 110 in accordance with an embodiment of the present invention. The fourth figure shows various views of a tactile element according to an embodiment of the present invention; the fifth figure shows a schematic view of a cross section of one of the tactile elements 110 according to an embodiment of the present invention; An illustration of a plurality of tactile elements provided to a user in accordance with an embodiment of the present invention, the tactile feedback being synchronized with a particular display comprising a virtual user; the seventh drawing depicting an applicability in accordance with an embodiment of the present invention A block diagram of some exemplary modules within a computing device; an eighth diagram showing a schematic representation of a wearable computing device in communication with a remote server in accordance with an embodiment of the present invention; Can be worn by a computing device A flowchart of an embodiment of a method of providing content; a tenth diagram showing a flowchart illustrating an embodiment of a method of providing interactive content to a user performed by a wearable computing device in accordance with an embodiment; A flowchart of an embodiment of a method of providing interactive content to a user performed by a computing device, according to an embodiment; a twelfth image showing a processor exemplifying providing haptic feedback in synchronization with a display including a virtual user A flowchart 1200 of an embodiment of a method of execution is performed.

The subject matter will now be described more fully hereinafter with reference to the accompanying drawings. However, the subject matter may be embodied in a variety of different forms, and thus, the subject matter that is encompassed or claimed is not to be construed as limited to any of the exemplary embodiments set forth herein. The exemplary embodiments are merely provided as illustrative. of. As such, it is expected that there will be a reasonable and broad range of subject matter claimed or covered. Further, for example, a subject matter can be implemented as a method, apparatus, component, or system. Thereby, embodiments may take the form of, for example, a hardware, a soft body, a firmware, or any combination of the above. Thus, the following detailed description is not intended to be limiting.

In the figures, some features may be exaggerated to show details of particular elements (and any dimensions, materials and similar details shown in the figures are considered as illustrative and not limiting). Therefore, the specific structural and functional details disclosed in the specification are not to be construed as limiting, but only as a representative basis, and are used to illustrate various embodiments of the disclosed embodiments.

The present invention is described below with reference to the block diagrams and <RTIgt; It should be understood that each block of the block diagram or the operation diagram, and The combination of blocks in a block diagram or an operation diagram can be implemented by analog or digital hardware and computer program instructions. These computer program instructions can be provided to a general purpose computer, a special purpose computer, an ASIC, or other programmable data processing device processor for execution of a block diagram or operation via instructions executed by a computer or other programmable data processing device processor. The function/action specified by the box.

In some other implementations, the functions/acts noted in the blocks may occur out of the order noted in the figures. For example, the two blocks shown in the order can be executed substantially simultaneously or the blocks can sometimes be executed in the reverse order, depending on the function/action involved. Further, embodiments of the method as presented and described in the flowchart of the present invention are presented by way of example to provide a more complete understanding of the present technology. The disclosed methods are not limited to the operations and logic flows presented in this specification. In view of other embodiments, the order of the various operations may vary and the sub-operations described therein as being part of a larger operation are performed independently.

The computing device may be capable of transmitting or receiving signals, for example, via a wired or wireless network, or may be capable of processing or storing signals, such as in memory, depending on the physical memory state, and may thus operate like a server. Thus, a device capable of operating like a server may include, for example, a dedicated rack server, a desktop computer, a laptop computer, a set-top box, an integrated body incorporating various features, such as two or more features of the above-described devices. Device, or the like. The server may vary greatly in configuration or capability, but the server may typically include one or more central processing units and memory. The server may also include one or more mass storage devices, one or more power sources, one or more wired or wireless network interfaces, one or more input/output interfaces, or one or more operating systems, such as Windows. Server, Mac OS X, Unix, Linux, FreeBSD, or the like.

Throughout the specification and the scope of the patent application, the term may have the meaning of the nuances suggested or implied by the context of the clearly defined meaning. Similarly, as used in this specification The phrase "in an embodiment" does not necessarily mean the same embodiment, and the term "in another embodiment" as used in the specification does not necessarily mean a different embodiment. For example, it is contemplated that the claimed subject matter includes all or a combination of exemplary embodiments. In general, terms can be understood at least in part from the usage in the text. For example, the terms "and", "or", or "and/or" as used in the specification may include a plurality of meanings, which may depend, at least in part, on the context in which the above terms are used. Usually, "or" if used to associate a series, such as A, B, or C, means A, B, and C (here used to include meaning), and A, B, or C (here used for mutual exclusion) significance). In addition, the words "a" or "an" or "an" The combination. Similarly, words such as "a" or "the" can again be considered to convey a single usage or convey a plural usage, which depends, at least in part, on the context. In addition, the term "based on" may be considered as not necessarily conveying a unique set of factors, and conversely, allowing for additional factors that are not necessarily explicitly described again, depending, at least in part, on the context.

Cloud computing has emerged in recent years as a solution to the situation where processor-intensive tasks must be performed in the world of mobile computing. It is used for personal computing tasks and is used by businesses for storage and data processing needs. In personal computing, games on the cloud have gained great popularity in view of the high processing resources required by graphics-intensive gaming systems. The graphics are generated and presented at a central location and the rendered images are transmitted to the user device, thereby reducing the need for high end processors on the user device.

It can be worn with computing and networking devices as another emerging aspect of the computing world. These wearable devices can be carried on the body of the user wearing the device. Although wearable devices can be paired with external displays, they typically include their own different sized displays to present information. In a certain In some embodiments, it is designed as a spectacles that augments the user's existing real-world view by generating an overlay with appropriate information. In all of the various embodiments, the wearable computing device requires a user gesture, such as clicking a finger, touching a surface, or pressing a button to perform various tasks, such as turning the display on or off, launching the application, exiting the application, or connecting another Device.

Wearable computing systems designed to be worn as eyepieces and methods associated with such computing systems are disclosed in accordance with various embodiments described herein. The wearable computing system is not only designed to provide passive audio-video experience, but is also used to provide tactile feedback consistent with audio-video experience. The computing system is also interactive because it receives input from a user or wearer of the computing system and reacts to incoming input. In one embodiment, the input can be received by monitoring the wearer's eye and the eye socket surrounding the flexible frame of the computing system. In an embodiment, the input can be received by monitoring an electrical signal generated in the visual cortex of the wearer.

The first A diagram is an illustration of a human user 102 that can wear the computing system/device 100. The computing system includes two symmetrical eyepieces 104 and 106, each of which is used alone or in conjunction with another symmetrical eyepiece. In an embodiment, the eyepieces 104, 106 can all comprise the same elements. In an embodiment, the various components of the wearable computing system 100 can be asymmetrically distributed between the two eyepieces 104, 106 such that each eyepiece 104 or 106 is configured for use in addition to other applications. Specific usage. In an embodiment, eyepieces 104 and 106 are detachably coupled to bridging element 108 to facilitate flexible usage. Each of the eyepieces 104, 106 includes a respective frame 124, 126 that includes respective display screens 114 and 116 that form a stereoscopic display to the user 102 when the eyepieces 104, 106 are used together. The frames 124, 126 are made of a flexible material such that they are configured to fit the orbital shape of the user 102 such that substantially no ambient light transmission is blocked between the frame and the socket. Thus, the frame 124/126 is configured to be able to block leakage of ambient light around the user 102 to The shape of the user's 102 is adapted to the shape of the eye socket of the user 102. In an embodiment, ambient light surrounding the user 102 may be light that is typically present in an environment with or without a source of visible light. Thus, if the user 102 is viewing the content on the display screens 114, 116 in a virtual reality environment, the user 102 can be completely immersed in the environment and not be viewed from the environment outside the field of view of the user 102 or Foreign light interferes. In an embodiment, the frames 124 and 126 may be hollow and have a space therebetween to allow for electrical interconnection between the various component parts of the computing system 100 that may be worn.

In an embodiment, the display screens 114, 116 may be flexible OLEDs (organic light emitting diodes) to conform to the shape of the face of the user 102 along the flexible frames 124, 126. Since OLED displays operate without backlighting, they can be thinner and lighter than liquid crystal displays (LCDs) and achieve higher contrast in low ambient light conditions. With a sufficiently dense display screen 114, 116 and a speaker or earphone or headset (not shown) containing features such as noise cancellation features, the user 102 can thereby interact with the content, for example, as if Watch a movie or play a video game in the context of a movie theater regardless of the actual location where the user 102 can be located. In an embodiment, the screens 114, 116 can have a variable degree of opacity or transparency to facilitate the use of the wearable computing system 100 in both the virtual reality environment and the augmented reality environment. Applying a charge to the OLED display screen 114/116 can change the transparency it uses in different settings.

The wearable computing system 100 also additionally includes a plurality of tactile elements 110 that provide tactile feedback around the eyes of the user 102 to the user 102, wherein the tactile elements 110 contact the skin of the user 102. For example, a subset of the tactile elements can convert electrical energy into mechanical motion (such as vibration or other forms of energy (eg, thermal energy)) to provide tactile feedback to the user 102. In an embodiment, the tactile element 110 is a small structure having different physical characteristics, including the entity and the frame 124/126 Electrical connections, as will be further detailed in this specification. In an embodiment, at least a subset of the tactile elements 110 are capable of moving independently. In an embodiment, all of the tactile elements 110 can be employed simultaneously to provide tactile feedback or to select a particular tactile element 110 at any time to provide tactile feedback to the user 102. Various tactile feedbacks can be provided to the user 102 based on the functions built into the different tactile elements 110. By way of example and not limitation, a first subset of tactile elements 110 can include a heating element, a second subset of tactile elements can be movable or configured to vibrate at different frequencies, or a third subset of tactile elements. put pressure on. Again, it can be appreciated that different tactile elements 110 can have different feedback mechanisms associated with them or all of the tactile elements can each have all of the tactile feedback mechanisms built into them such that a combination of different tactile elements can be used to provide a particular type of tactile feedback. .

The haptic feedback provided to the user 102 is related to the content such that the plurality of haptic elements 110 are launched in concert with the display content, such as a movie or video game, to add additional dimensions to the user experience. In an embodiment, the various tactile elements 110 can be mapped to different portions of a virtual user (not shown) with which the user 102 is interacting or associated, such that the experience of the virtual user in the virtual world can be via the tactile element 110. Transfer to user 102 or user 102 to experience or feel. Thus, the touch pressure, touch location, and touch texture experienced by the virtual user are transferred to the user 102 as part of the user experience in an immersive environment in which the computing device 100 can be worn. The virtual user can additionally interact with virtual users of other users and can further modify the haptic feedback provided to the user 102 based on interactions between the virtual user of the user 102 and the virtual users of other users.

The user 102 can employ a wearable computing system 100 for displaying and interacting with various types of material (eg, text, images, or videos about web pages or other content such as movies or video games). interactive. In an embodiment, content can be played from a console (not shown) connected to a local area network (LAN) that can be worn with computing system 100. In one embodiment, a communication component (not shown) built into the wearable computing system 100 can be used to connect directly from the Internet or via a WiFi connection to an intermediary device such as a laptop or cellular telephone. The content is transferred to the wearable computing system 100.

In one embodiment, the wearable computing system 100 not only provides content and related haptic feedback to the user 102, but also facilitates the user 102 interacting with the content. In one embodiment, the wearable computing system 100 includes a detection module (not shown) for detecting movement of various parts of the eye or eye socket of the user 102, which facilitates interaction of the user 102 with the displayed content. As will be further detailed below. In one embodiment, the detection module can include a camera and a photodiode for tracking movement of various parts of the user's 102 eyes. For example, the eye movement of the user 102 causes the user 102 to look at the small graphic on the display screen 114/116 for a predetermined period of time to have a gesture like a mouse click that enables the processor to perform a specific task related to the gesture. (such as choosing a small graphic). Similarly, the eye movement of the user 102 after the selection described can cause the selected thumbnail to move in the direction of movement of the eyeball of the user 102 and the user 102 subsequently stops moving at a particular second point for use at this particular point. Drop the small picture. The detection module can also constitute a finer difference or nuance of detecting the movement of different parts of the eye socket covered by the wearable computing system 100, such as the user 102 or the wearer closing the eye for different time periods, blinking Raise one or more eyebrows.

In one embodiment, the tactile element 110 can also be configured to detect a portion of the detection module of the user's movement even when the user 102 is provided with a tactile sensation. The plurality of tactile elements 110 can have a subset of elements of different shapes that include different types of transducers that collect different vectors for eye movements of the user 102 or postures of the eye muscles. For example, the tactile element 110 can also include a transducer in contact with the facial muscle entity of the user 102 to detect movement of such muscles. And generating a corresponding electrical signal that can be fed back to the processor, and thereby enabling manipulation of the display on the display screens 114, 116. In one embodiment, the position and signal strength of the tactile elements that transmit the electrical signals can be used to detect a particular movement of the facial muscles of the user 102 that can be mapped to provide a particular input to the processor. Various eye movements and gestures can thus be tracked and mapped to specific types of inputs that can be used to manipulate content in a particular manner. Thus, the wearable computing system 100 can eliminate or supplement other devices such as joysticks or data gloves, which are typically used with such wearable computing systems to receive user input.

In one embodiment, the wearable computing system 100 further includes a mind detector (not shown) that detects the user's 102 thoughts and changes the display on the screens 114, 116 based on the recorded ideas described above. In one embodiment, the thought detector can include elements that record electrical activity of the brain via wires that contact the posterior portion of the head where the visual cortex of the brain is located. Techniques such as EEG (electroencephalograph) are known which provide a means of non-invasively observing human brain activity. For example, technologies such as Emotiv EPOC that are provided with headphones and related computer interfaces from Emotiv Lifescience can be adapted for use with the wearable computing system 100 to record ideas and manipulate content as will be further detailed in this specification.

According to an embodiment, the wearable computing system 100 can additionally facilitate storing a user experience, recreating a user experience, and exchanging a user experience. In an embodiment, the user experience can include content items with their associated audio and tactile feedback material. This allows the user 102 to consume content items, interact with content items, and change content items to create new content items via the wearable computer 100, which can be stored in a processor or storage device on a local storage device or LAN. (It can constitute one or more of the remote processor readable storage located on one or more servers located at the far end of the user 102 and transmitting the content to the wearable computing device 100). User 102 built The above new content items or user experience can be shared with other users. For example, a video game consumed by user 102 can have some tactile feedback associated with certain portions. If desired, the user 102 can change the video game to layer additional tactile feedback and store the video game with the changed tactile feedback information as a user experience that can be further shared with other users. In an embodiment, the stored/shared user experience can include additional content obtained from an external source. For example, images or sounds obtained from other content can be added to a particular content item. In one embodiment, new content added to the user experience can be obtained from the user 102's thoughts by the thought detector associated with the wearable computing system 100.

The first B diagram shows the outline of a user 102 having a wearable computing system 100. The wearable computing system 100 contacts the skin of the user 102 at a plurality of points. When the wearable computing system 100 mates the eye socket shape of the user 102, the frame 126 conforms to the shape of the eye socket of the user 102 and contacts the skin surrounding the eye socket of the user 102, as shown in the cross-sectional profile shown in FIG. Points 152 and 154 are referred to. The shape conforms to the configuration system operation to substantially block ambient light leakage to the field of view of the user 102. Additional contact points include points 156, 158 in which the tactile element 110 contacts the skin of the user 102. The various haptic sensations transmitted to the user 102 via the haptic element 110 are thus perceived by the user 102, for example, at points 156, 158.

The second A diagram shows an illustration of another view of the wearable computing system 100 facing the user 102 while the user 102 is wearing the wearable computing system 100 on his/her body. The flexible frames 124, 126 each include a suction mechanism or eye pads 204, 206 that facilitate the wearable computing system/device 100 to securely attach the face of the user 102 such that little or no ambient light is leaking to the user 102. The field of view leaks into the space between the eyes of the user 102 and the display screens 114, 116. Additionally, the wearable computing system 100 can be included in a suitable location (eg, near the ear) Speakers to provide audible feedback to the user. The wearable computing system 100 can also include a power source, one or more processors within the bridge member 108 for performing tasks such as controlling the display screens 114, 116, providing WiFi, infrared, or other wireless communication, and Other processing tasks on the computing system 100 that control other components such as the tactile component 110 are worn.

By way of illustration and not limitation, FIG. 2B shows a profile of a user 102 holding a wearable computing system 100, the wearable computing system 10 including detachably coupled to the wearable computing system 100 (eg, A visual cortex mind detector 220 via a coupling tool such as strap 222. Both ends of the strap 222 can be detachably coupled to the ends 232 and 234 of the wearable computing system 100 in such a manner that the strap 222 can surround the rear of the head of the user 102. This configuration causes the visual cortex thought detector 220 to record the thoughts from the visual cortex located on the posterior side of the brain of the user 102. Although the visual cortex mind detector 220 is shown as a single component that is located in one of the wearable computing systems 100 and contacts the brain of the user 102, it is understood that this is not necessary. The visual cortex thought detector 220 can include a plurality of sensors that can contact a plurality of portions of the brain of the user 102 to collect thought information as needed.

In one embodiment, a technique that can be used for EEG (electroencephalograph) can be employed within the visual cortex mind detector 220. Brain cells talk to each other by exchanging tiny electrical signals and EEG is a non-invasive procedure used in the medical field to record such electrical activity. Some electrodes are located at different points on the scalp of the human body to detect voltage fluctuations caused by current flow of current between brain cells. Experiments have found that when people visually imagine something, their eyes move in such a way that they actually move as if they were looking at their imagination. For example, if a person imagines a skyscraper, the person's eyes move in a top-down manner. Similarly, if the person imagines a train, the person's eyes will move from one side to the other. Occipital cortex (also known as visual skin) located behind the head One of the first areas of the human brain, the information entered from the eyes of the user 102 will arrive here and a lot of work to understand what the user 102 is looking at continues here. Experiments on brain activity have also shown that when people imagine or look at objects in their minds, the visual cortex of the brain is particularly active. Thus, the visual cortex thought detector 220 is located behind the head of the user 102 near the visual cortex. However, the wearable computing system 100 can have additional electrodes located relative to other portions of the brain for collecting information from the locations to detect the thoughts and/or images desired by the user 102 and to manipulate them for use. The display of computing system 100 is worn.

The third figure shows an illustration of some exemplary details of the tactile element 110. A plurality of tactile elements 110 are disposed along the eyepiece ring structure 302 contained within the eye pads 204, 206 along the perimeter of the aperture 304. When one of the eye pads 204, 206 is used in the wearable computing system 100, the aperture 304 will include a display screen 114/116. The plurality of tactile elements 110 can have different structural details to provide different tactile sensations. By way of illustration and not limitation, different tactile elements can be made of different materials, as shown in close-up view 306 of eyepiece ring 302, bent at different angles or having different contact surfaces. This variability in the structure of the tactile element 110 facilitates producing different pressure levels or providing different contact areas or different textures associated with the sensation provided by the tactile feedback to the user 102. In an embodiment, the different tactile elements 110 can have different shapes and can be configured on the frame 124/126 in different ways. For example, the tactile element 110 can be configured such that the length of the tactile element 110 gradually changes from one tactile element to an adjacent element or the angle of inclination of the tactile element can be gradually changed as shown on the frame 124 of 306.

The fourth figure illustrates various views of one of the haptic elements 110 in accordance with an embodiment of the present invention. In various embodiments, the tactile element 110 can be made of an elastomeric polymer or metal or a combination thereof (such as a metal arm coated with a gel-filled polymer skin) that includes some degree of elasticity In order to not only withstand the vibrations generated when tactile feedback is provided, but also to transmit the vibrations generated by the user 102 as different types of user inputs.

Views 402, 404, 406, and 408 together show a ring view of one of the tactile elements 110. In particular, the 406 and 408 series 402 and 404 are cross-sectional views as seen from the points of view A and B, respectively. Each tactile element 400 has a base portion 410, a neck portion 412, and a head portion 414. In one embodiment, the entire length of the tactile element 400 from the center of the base portion 410 to the top end of the head 414 can vary from about 1-3 centimeters. In an embodiment, different tactile elements may have different lengths based on their position on the frame 124/126 and the area in which the tactile elements may contact. The base portion 410 connects the tactile element 400 to the frame 124/126 of the eyepiece 104/106. In an embodiment, the base portion 410 is hollow to allow the tactile element 400 to be electrically coupled to other components of the wearable computing system 100, such as a processor in the bridge portion 108. Thus, the base portion 410 not only facilitates the physical connection of the tactile element 400 to the frame 124/126, but also facilitates electrically coupling the tactile element 400 to other components of the wearable computing system 100.

The neck portion 412 connects the base portion 410 to the head 414 of the tactile element 400. Different tactile elements 110 can have different lengths associated with the neck portion. The various tactile elements 110 can also bend their necks at different angles to vary the type of sensation provided to the user 102 based on tactile feedback. In an embodiment, the neck 412 can also be hollow to electrically couple the head 414 to other components that can be worn with the computing system 100. In an embodiment, the neck 412 can be a solid structure that connects the head 414 to the base portion 410.

The head 414 of the tactile element 400 contacts the skin of the user 102 to provide tactile feedback. In one embodiment, the head 414 can be formed from a material similar to other portions of the tactile element 400, but can be constructed using a particular pattern 420 to provide a particular type of feel on the user's skin. feel. Different patterns can be formed on the head portions of the different tactile elements, such as the head portion for the tactile elements 110. In an embodiment, the head 414 can be configured from a different material than the other components of the tactile element 400. In one embodiment, the head 414 can be made of the same material as the rest of the tactile element 400, but can be coated or coated with another material. In an embodiment, the head portions of the different tactile elements 110 can be constructed in accordance with different embodiments to establish various types of tactile sensations.

As described above, the tactile element 110 can also be a portion of the system for detecting the movement of the facial muscles of the user. By way of illustration and not limitation, movement of the skin of the user 102 can cause movement of the tactile element 110. Thereby, the reaction properties of the user 102, such as the intensity and duration of facial muscle movement, can be detected and recorded. Different feedbacks including one or more visual, audio or tactile modes can be provided based on attributes of the user's movement.

The fifth figure shows a schematic view of a cross section of one of the tactile elements 110 (e.g., 400) in accordance with an embodiment of the present invention. As described above, the tactile element 400 includes a hollow base portion 410, a neck portion 412, and a head portion 414. The base portion 410 not only connects the tactile element 400 to the frame of the eyepiece 102/104, but also houses the actuation mechanism. The actuation mechanism can be configured in a two-way manner such that not only haptic feedback is provided to the user 102, but also user input is collected via various movements performed by the muscles around the eyes of the user 102. The neck 412 connects the base to the head 414 so that the head 414 can be actuated to provide appropriate tactile feedback or, conversely, the movement of the head 414 can be detected to record the necessary attributes entered by the user.

According to an embodiment, the actuation mechanism includes a signal contact plate 502 that positively contacts the spherical body 510 to form a ball and socket engagement. The spherical body 510 can be freely rotated not only along the axes passing through A, but also along different axes within the signal contact plate 502. When a current is passed through the coil 516, a pair of magnets 508 along with the electrical coil 516 provides mechanical mechanism to the rotating spherical body 510. Actuated. One of the pair of magnets 508 is attached to the rotating spherical body 510, and the other magnet is fixed to the bottom of the base 410. Conversely, when the rotating spherical body 510 moves due to mechanical movement of the head 414 and the neck 412 caused by user input (eg, the user 102 moves the muscles of the eye socket in contact with the tactile element 400), the pair of magnets 508 It is also used to induce current in the coil 516.

A connecting wire 520 including a bezel 522 is attached to the rotating spherical body 510 and runs through the length of the neck 412 and interconnects at least a portion of the head 414 of the various components therein. The wire 510 is rotated within the signal contact plate 502 by flowing a current through the coil 516, thereby pulling or pushing the wire 520, thereby actuating the neck 412 and the head 414 along the vertical axis XY. In addition to providing mechanical actuation, the connecting wires 520 can also include electrical connections for the speaker array 504.

In an embodiment, the speaker array 504 can include one or more speakers 532, 534, and 536 configured to provide tactile feedback, such as vibration. In one embodiment, the transmitted vibrations contribute to bone conduction such that audio feedback can also be provided through one or more speakers in array 504. It can be appreciated that the speakers 532, 534, and 536 can constitute audio feedback for conduction via the bone based on the position of the tactile element 110. For example, the tactile element 110 that is in contact with the softer muscle portion of the orbital socket (such as under the eye) may not constitute an audio feedback for conduction through the bone, but rather a tactile sensation on the upper portion of the frame 124/126 that contacts the eyebrow or bone bridge of the user 102. The components can be configured for bone conduction in accordance with embodiments described herein. The different speakers 532, 534, and 536 can vary in size and power properties to provide a wide variety of tactile vibrations based on the power and contact area of each of the arrays of speakers 504. In one embodiment, the head 414 can be made of a metal combination of plastic and/or portion 540 of the skin that does not contact the user 102, while the front faces of the speakers 542, 544, and 546 are disposed within the gel pad 506. User 102 provides a softer feel. In an embodiment, the gel pad 506 can include additional components (such as heating elements (not shown)) to provide an additional type of tactile response to the user 102. Feed.

It will be appreciated that the structures in the fourth and fifth figures are shown by way of illustration only and not limitation, and that the tactile element 110 can constitute other structures having embodiments in accordance with the present specification. For example, the tactile element 110 can be configured to include a spherical or cylindrical or other shaped protrusion on the frame 124, 126. In an embodiment, different ones of the plurality of tactile elements 110 can have different shapes and can be configured in different ways on the frame 124/126, as discussed above. In an embodiment, the tactile element 110 can include an electric chuck to provide a particular type of tactile feedback by pulling the skin of the user 102. In an embodiment, the tactile element 110 can include tiny pinholes located on the frame 124/126.

The sixth diagram shows an illustration of a plurality of tactile elements 110 that provide tactile feedback to the user 102, the tactile feedback being synchronized with a particular display containing the virtual user 600. In the present embodiment, each of the plurality of haptic elements 110 is mapped to provide haptic feedback associated with, for example, a virtual world experience of the virtual user 600 that may be relevant to the user 102. Each of the plurality of tactile elements 110 is associated with a particular one of the body parts of the virtual user 600 such that if a particular body part of the virtual user 600 (e.g., the head 602) experiences a virtual world, such as the user 102 is displaying a screen The particular sensation seen on one or more of 114 and 116 initiates a tactile element 604 that is mapped to the head 602 to give the user 102 a tactile contact point between the tactile element 604 and the area above the right eye of the user 102. Feedback. For example, if the virtual user 600 touches the object with his head portion 602, the tactile element 604 can be activated to apply pressure to the brow of the user 102 at the point of contact. Likewise, the user 102 can be provided with the experience of heat, pressure, or another biological or non-living touch or other physical sensation of the virtual user 600 via appropriate activation of one or more of the haptic elements 110. It can be appreciated that the human virtual user 600 is displayed by way of example only and not limitation, and the plurality of haptic elements The piece 110 can be mapped to other biotic or non-virtual virtual users and the virtual world experience of the virtual user can be transferred to the user 102 not only via visual or audio channels, but also as a tactile sensation through the tactile element 110. This can contribute to providing the user 102 with a touch of other creatures (such as a bird flight) or a sense of a non-living body (such as a racing car).

In one embodiment, the virtual user 600 can be enabled to interact with the virtual world displayed on the screen 114/116 via the movement of the user's 102 eyes and gaze tracking. For example, a user 102 staring at a virtual user 600 for a predetermined period of time can facilitate selection of a virtual user 600 for interaction. Similarly, moving the line of sight in a particular direction after selection can properly move the virtual user 600 and gaze at the point for a predetermined period of time to fix the virtual user 600 to the position where the line of sight of the user 102 is stationary or to provoke the user 102. The eyebrows enable the virtual user 600 to jump. When the eye moves quickly, the time period associated with the user's gesture is about a few seconds. Haptic feedback and gesture mapping can be programmed to fit the content provided by computing system 100. For example, a video game application or movie can be created for use with a wearable computing system 100 that incorporates tactile feedback and user interaction mechanisms built into it.

In embodiments in which the computing system 100 displaying the virtual user 600 includes a visual cortex thought detector 220, the virtual user 600 can be manipulated based on input provided by the visual cortex thought detector 200. As described above, electrical signals generated by the visual cortex of the user 102 can be detected and interpreted to thereby change the state of the virtual user 600. By way of illustration and not limitation, virtual user 600 can move up or down or sideways, or can change the size of virtual user 600 based on input from visual cortex mind detector 220.

The seventh diagram depicts a block diagram of certain exemplary modules within the wearable computing device 100 in accordance with an embodiment. It should be appreciated that certain embodiments of the wearable computing system/device 100 can include ratios Figure 7 shows more or fewer modules. The wearable computing system 100 includes a processor 700, a tactile component 110, a display screen 730, a visual cortex detector 200, an audio component 740, a storage medium 750, a power source 760, a transceiver 770, and a detection module/system 780. Despite the schematic of the seventh diagram, the wearable computing system 100 is shown as containing a single eyepiece due to a display screen 730. However, the wearable computing system 100 can include two eyepieces having display screens, each of which can have all of the modules described in this specification, or the eyepieces can be used together and can include each of the above modules to avoid Repeat the module.

The wearable computing system 100 can constitute a processor 700 that includes a suitable location (e.g., located at the bridging component 108). The processor 700 further includes an input/output (I/O) module 702, a control module 704, and an imaging module 706. Moreover, it should be understood that although only one processor 700 is shown, the wearable computing system 100 can include multiple processors or the processor 700 can include a particular task sub-processor. For example, processor 700 can include a general purpose sub-processor for controlling various devices contained within wearable computing system 100, and a dedicated graphics processor for generating and manipulating displays on display screen 730. The I/O module 702 included in the processor 700 can be configured to receive different types of inputs from various components, such as user gesture input from the detection system 780, user input from the visual cortex thought detector 220. Or an audio input from an audio component 740 such as a microphone. The processor 700 can also receive content related input from a local storage medium 750 or via a transceiver 770 from a remote server (not shown) for display on a display screen. The processor 700 can additionally receive input from the tactile element 110 regarding the muscle movement of the user monitored by the tactile element 110 as part of the detection system 780. The processor 700 is also configured to provide appropriate output to different modules of the wearable computing system 100 and other network resources such as remote servers (not shown).

Thus various inputs received from different modules can be processed by providing a response output Appropriate programming or processing logic within control module 704 of device 700, as will be described in further detail below. The program logic can be stored in the memory unit, i.e., on the motherboard, the processor 700 or program logic can be stored in the external processor readable storage device/media 750 and can be loaded by the processor 700 as needed. In one embodiment, in addition to the tactile element control logic, the processor 700 can execute program logic to display the content transmitted by the remote server on the display screen 730 to activate the associated tactile element 110 in an appropriate manner and with The displayed content provides tactile feedback to the user simultaneously. Commands relating to activation of the haptic element 110 can be provided from a remote server, and the haptic element control logic stored on the storage medium 750 and executed by the processor 700 can interpret the command to properly activate the haptic element 110.

In an embodiment, the imaging module 706 also included in the processor can include program logic (such as display manipulation logic executed by the processor 700) to be based on one of the slave detection system 780 and the visual cortex thought detector 220. Or more than the input obtained to create or manipulate the display. The input received from detection system 780 is related to eye tracking and muscle movement around the eyes of user 102. Based on the direction of eye movement or the direction and force of muscle movement around the eye, the display manipulation logic of imaging module 706 can perform various tasks, typically performed by a mouse or joystick or other user input mechanism. Thus, the user 102 can perform tasks related to the computing device, such as by moving his/her eyes or muscles around the eyes to produce text or image material.

In another embodiment, imaging module 706 can be employed to alter an existing display to generate new elements in the display based on input received from visual cortex mind detector 220. For example, the user 102 can close his/her eyes to imagine a geometric pattern with a particular color. Although the detection system 780 may not be able to provide user input to the processor 700 without closing the user's eyes and without any muscle movement, the visual cortex thought detector 200 can still obtain information about the user 102. Information like the image, and the imaging module 706 can be executed to display the user's imagination on the display screen 730. In one embodiment, imaging module 706 can execute program logic to reconstruct the imagination of user 102 on display screen 730. In one embodiment, input from the visual cortex mind recorder 220 can be transmitted by the transceiver 770 to a remote server (not shown), wherein the input is interpreted and the display based on the input is established and transmitted back The computing system 100 is worn. In this case, the imaging module 706 is employed to display the received display on the display screen 730 to the user 102. In one embodiment, the I/O module 702 can further form the user experience/imagination obtained by storing the visual cortical detector 220 on a local storage device 750 or a remote server (not shown).

The eighth diagram shows a schematic diagram of a wearable computing device 100 in communication with a remote server 810. The transceiver 770 included in the wearable computing device 100 facilitates the wearable computing device 100 to communicate with the remote server 810 via the network cloud 820. According to various embodiments, remote server 810 can be configured to perform various tasks as detailed in this specification. In an embodiment, wearable computing device 100 transmits content from remote server 810, which can include audio/video (AV) content associated with synchronized haptic feedback information. The processor 700 not only displays the transmitted AV content, but also activates the tactile element 110 to provide a different type of sensation to the user 102. The wearable computing system 100 also constitutes detecting user feedback and performing tasks, such as manipulating the display or storing the displayed display in the local storage of the wearable computing system 100 or transmitting user feedback to the remote server 810. For further processing or storage.

The ninth diagram shows a flowchart 900 illustrating an embodiment of a method of providing content to a user 102 as performed by the wearable computing device 100. The method begins at step 902 by providing content to the user 102 via the display screen 114/116 and/or the audio component 740. In various embodiments, the content provided to the user 102 can include one or more audio and visual associations associated with the haptic feedback material. Frequency content. According to embodiments described herein, content can be retrieved from local storage device 770 or remote server 810. At step 904, an instruction to provide haptic feedback is also taken with the content. The received content is provided to the user 102 and at the same time the haptic feedback is provided to the user via activation of the appropriate tactile element 110, as shown at 906. In accordance with an embodiment described herein, at step 906, various sensations of pressure, heat, prolonged or momentary sensations of contact with biotics and non-living bodies can be provided by actuating the haptic elements 110.

The tenth diagram shows a flowchart 1000 illustrating an embodiment of a method of providing interactive content to a user 102 as performed by the wearable computing device 100. This method can be performed in conjunction with the method of Figure 9 above. The method begins at step 1002 by using the detection module/system 780 described herein to view or monitor the movement of the user's eyes 102 and the movement of the face around the user's eyes. As in step 1004, motion of the eye and/or eye posture is detected. At step 1006, it is determined whether the eye movement of the user 102 is mapped to a particular task related gesture. It is not limited to closing the eyes for a predetermined period of time, which may include expanding the eyes, moving the eyes at a particular speed in a particular direction, staring at the small figure, picking up one or two eyebrows, blinking or a combination of the above. For example, in the case of a gesture combination, the user 102 stares at the object on the screen 114/116 for a predetermined period of time to enable the item to be selected and then move the eye in a particular direction to cause the item to move on the screen in a corresponding manner. Some gestures can be accidental or unintentional movements that do not reflect any user intent. The wearable computing system 100 can be configured to distinguish between the unintentional gestures and the intentional gestures, for example, by associating a particular gesture with a predetermined time period. In step 1006, if it is determined that the particular gesture is associated with a particular task, then at step 1008, the wearable computing device 100 responds to the detected eye gesture or eye movement to perform the task described above, otherwise the gesture or motion is ignored as shown in step 1010. . In either case, the wearable computing system 100 continues to monitor user movement at step 1002.

The eleventh diagram shows a flowchart 1100 illustrating an embodiment of a method of providing interactive content to a user 102 as performed by the wearable computing device 100. The method begins in step 1102 with the wearable computing system 100 receiving a user input. A visual cortex located behind the head of the user 102 can produce a visual image. If the instrument that records the electrical signal from the visual cortex of the brain of the user 102 is located behind his/her head, a graphical image can be generated that is visualized by the user 102's imaginary pattern or in the user's brain. . Thus, the user can perform tasks such as text input only by visualizing appropriate letters, and the wearable computing system 100 will be able to detect and generate text files that are visualized by the user 102. Similarly, user 102 can visualize patterns, colors, or other graphics that can be detected and played by visual cortex thought detector 720. For example, the user 102 can visualize the vertical movement of the virtual user based on electrical signals from the brain of the user 102, thereby enabling the virtual user to be moved. As shown in step 1104, the electrical signals are interpreted or detected to obtain patterns and/or color information regarding the input of the user 102 as obtained by the visual cortex thought detector 720. At step 1106, a graphical image of the user 102's imagination is generated and displayed on display screen 114/116, as shown in step 1108.

In an embodiment, the method of the eleventh figure can be used in conjunction with the method outlined in the ninth figure. The content with or without tactile feedback can be provided to the user 102 via the wearable computing system 100, as detailed in the ninth figure, and the content provided by the user 102 can be used to change the provided content, as shown in FIG. Detailed. Content changed according to the imagination of the user 102 can be displayed on the display screen 114/116.

In one embodiment, the functionality of the visual cortex thought detector 720 can be distributed over the network 820 such that the visual cortex detector 720 that can be worn with the computing system 100 only detects electrical power from the visual cortex of the user 102. Signal, while performing other tasks in server 810, such as interpreting The signal, the user 102's imagination are played and a graphic is generated based on the detected signal. The resulting graphics can be transmitted back to the wearable computing system 100 by the server 810 for display on the screen 114/116.

A twelfth diagram shows a flowchart 1200 illustrating an embodiment of a processor-executable method of providing haptic feedback in synchronization with display of a virtual user 600. The method begins in step 1202, where a display containing the virtual user 600 is displayed to the user 102, and at step 1204, user input is received to manipulate the virtual user 600. As described in this specification, virtual user 600 can be manipulated using inputs from various modules, such as detection system/module 780. At step 1206, the virtual user 600 is manipulated based on user input. For example, user 102 can move his eyes in a manner that moves virtual user 600 in a particular direction. At step 1208, an experience is received when the virtual user 600 is manipulated based on user input. For example, the virtual user 600 can enter into contact with an object entity in the virtual world when moving based on user input, as described above. At step 1210, the portion of the virtual user 600 that is affected by the experience is identified, and at step 1212, the tactile elements of the plurality of tactile elements corresponding to the affected portion of the virtual user 600 are determined. At step 1214, based on the experience of the virtual user 600, the corresponding tactile element can be activated. In various embodiments, a plurality of tactile elements 110 can be activated or a subset of the plurality of tactile elements 110 can also be activated. In another embodiment, different tactile elements can be activated in a unique manner to provide various tactile sensations to the user 102.

It should be appreciated that in an embodiment, the process described by flowchart 1200 can be performed by wearable computing system 100. In an embodiment, the process described by flowchart 1200 can be performed by wearable computing system 100 along with remote server 810. For example, wearable computing system 100 is operable to provide display at step 1202, collect user input at step 1204, and manipulate the virtual user as shown in step 1206. The collected user input can be transmitted to the remote server 810, which is far The end server receives the experience of the virtual user 600 at step 1208, identifies the portion of the virtual user 600 that was affected by the input at step 1210, and identifies the tactile element corresponding to the affected portion at step 1212. In the present embodiment, the remote server 810 can transmit instructions to the wearable computing system 100 to activate the tactile elements corresponding to the affected portion, as shown at step 1214.

For the purposes of the present invention, a computer readable medium stores computer data, the data of which can include computer code executable in a machine readable form for execution by a computer. By way of example and not limitation, a computer-readable medium may comprise a computer-readable storage medium for physical or invariant data storage, or a communication medium for transient interpretation of coded signals. As used in this specification, a computer-readable storage medium refers to physical or tangible storage (as opposed to a signal) and includes, but is not limited to, for information (such as computer readable instructions, data structures, program modules, or other materials). Volatile and non-volatile, removable and non-removable media implemented by any method or technique of tangible storage. Computer readable storage media includes, but is not limited to, RAM, ROM, EPROM, EEPROM, flash memory or other solid state memory technology, CD-ROM, DVD, or other optical storage, magnetic cassette, magnetic tape, disk storage Or other magnetic storage device, or any other physical or material medium, which can be used to tangibly store desired information or data or instructions and can be accessed by a computer or processor.

For the purposes of the present invention, a module is a software, hardware, or firmware (or combination of) system, program or function, or elements thereof that perform or facilitate the procedures, features, and/or functions described in the specification. (with or without human interaction or amplification). The module can include sub-modules. The software components of the module can be stored on a computer readable medium. A module may be necessary to construct one or more servers as a whole or loaded and executed by one or more servers. One or more modules can be grouped into an engine or application.

Those skilled in the art will appreciate that the methods and systems of the present invention can be implemented in a number of ways. The present invention is not limited to the above exemplary embodiments and examples. In other words, in various combinations of hardware and software or firmware, functional elements and individual functions performed by a single or multiple components may be distributed between software applications located at the client or server or both. In this regard, some of the features of the various embodiments described in this specification can be incorporated into a single or multiple embodiments, and other embodiments having fewer or more than all of the features described in this specification are possible. The functions may also be distributed, in whole or in part, between a plurality of elements, either now known or in a known manner. Therefore, a myriad of software/hardware/firmware combinations may implement the functions, features, interfaces, and preferences described in this specification. In addition, the scope of the present invention is intended to cover such features and functions and interfaces, as well as hardware or soft or firmware elements that may be described in the present specification as will become apparent to those skilled in the art. Those changes and modifications made.

Although the system and method have been described with respect to one or more embodiments, it should be understood that the invention is not necessarily limited to the disclosed embodiments. Various modifications and similar arrangements are intended to be included within the spirit and scope of the invention. The present invention includes any and all embodiments of the scope of the following claims.

100‧‧‧ Wearable computing system

102‧‧‧Users

104‧‧‧ eyepiece

106‧‧‧ eyepiece

108‧‧‧Bridge components

110‧‧‧Tactile components

114‧‧‧Display screen

116‧‧‧Display screen

124‧‧‧Frame

126‧‧‧Frame

Claims (28)

An eyepiece system for augmenting reality and virtual reality, comprising: a wearable eyepiece comprising: a display screen secured to a hole in a flexible frame such that a display engages the shape in a form fit a flexible frame and the display covers the visual field of the user's eyes; a first processor that facilitates processing of the data and causes the display to be produced on the display screen; a plurality of tactile elements disposed on the flexible frame and communicatively coupled The first processor, by initiating the tactile elements disposed on the flexible frame, is selectively activated by the first processor to provide tactile feedback to the user, and the display on the screen should be displayed; And a bidirectional actuating mechanism comprising a current carrying coil, a pair of magnets, and a signal contact plate, the bidirectional actuating mechanism actuating the tactile elements and detecting muscle movement of the orbit of the user. The eyepiece system of claim 1, wherein the flexible frame includes an eye pad that facilitates engagement with the user's eye socket and blocks the ambient light, and the plurality of tactile elements are disposed on the frame edge of the eye pad. . The eyepiece system of claim 1, wherein the flexible frame further comprises a bridge member comprising the first processor. For example, the eyepiece system of claim 1 includes two eyepieces that can be worn side by side and each of which constitutes a pair of users. For example, the eyepiece system of claim 1 of the patent scope includes: A detection module that detects movement of the user's eyes. For example, in the eyepiece system of claim 5, the detection module includes a camera. For example, in the eyepiece system of claim 5, the detection module includes the plurality of tactile elements. The eyepiece system of claim 1, wherein the tactile element comprises a transducer for converting electrical energy into mechanical motion. In the eyepiece system of claim 1, the subset of the tactile elements comprises a heating element. The eyepiece system of claim 1, further comprising: a transceiver disposed on the flexible frame, the transceiver receiving and transmitting a communication signal. The eyepiece system of claim 1, further comprising a speaker disposed on the flexible frame for generating an audio signal. In the eyepiece system of claim 1, a microphone is disposed on the flexible frame for receiving an audio input. A method of providing content, comprising: selectively activating one or more plurality of tactile elements in synchronization with visual content displayed on a display screen of a wearable eyepiece by a processor; and The processor provides tactile feedback to the user by activating the tactile elements around the user's eyes, the tactile feedback being provided in synchronization with the visual content. In the method of claim 13, the providing the haptic feedback further comprises: actuating the tactile elements attached to a flexible frame by the processor. For example, in the method of claim 14, the activation of the tactile elements further includes: At least a subset of the tactile elements are vibrated by the processor. In the method of claim 14, the actuating the haptic elements further comprises: heating at least a subset of the haptic elements by the processor. The method of claim 14, further comprising: mapping, by the processor, each of the tactile elements to a specific portion of a virtual user included in the visual content. The method of claim 17, wherein providing the haptic feedback in synchronization with the visual content further comprises: actuating the tactile elements by the processor based on experience of the particular portion of the virtual user in the visual content The specific one. The method of claim 13, further comprising: detecting, by the processor, movement of one or more eyes and facial muscles around the eyes of the user; and responding to the detected by the processor These movements are measured to perform specific tasks. In the method of claim 19, detecting the movement of the eyes and facial muscles further comprises: collecting, by the processor, movement of one or more of the eyes and the facial muscles from a camera data of. In the method of claim 19, the specific tasks performed by the processor include at least: manipulating a display on the display screen based on the detected movements by the processor. The method of claim 19, wherein the specific tasks performed by the processor include at least: mapping, by the processor, each of the tactile elements to a virtual user included in the visual content a particular portion; and manipulating a particular portion of a virtual user contained in the visual content in response to the detected movements by the processor. A method of using an eyepiece for augmenting reality and virtual reality, comprising: selectively activating one or more by synchronizing with video content displayed on a display screen that can be worn on an eyepiece by a processor a plurality of plurality of tactile elements; and the processor is configured to detect physical actuation of the tactile element caused by muscle movement of the user's eyes. The method of claim 23, wherein the synchronizing element starts synchronously with the video content, and the processor further vibrates the tactile element by causing a current through a coil included in the tactile element. The method of claim 23, wherein simultaneously starting the tactile element with the video content further comprises: heating, by the processor, a heating element contained in the tactile element. In the method of claim 23, the actuating the tactile element in synchronization with the video content further comprises: by the processor, generating a suction force by the tactile element that attracts the skin of the user. For example, in the method of claim 23, the tactile element is activated in synchronization with the video content. The method includes: providing, by the processor, audio feedback to the user through a speaker included in the tactile element. The method of claim 23, wherein the detecting, by the processor, the physical actuation of the haptic element comprises: detecting, by the processor, the inclusion in the haptic element due to actuation of the entity The current caused in a coil.