JP2022543738A - Hardware architecture for modular eyewear systems, devices and methods - Google Patents

Abstract

Systems, apparatus, and methods are taught for providing reconfigurable components in eyeglass devices. Reconfigurable components for use in eyeglass devices include embedded electronic systems. The embedded electronic system is configured for wireless communication and processing of sensor signals. The embedded electronic system was incorporated into a component of the eyeglass device. Multiple sensors were incorporated into one or more of the reconfigurable component and the eyeglass device. The plurality of sensors are in electrical communication with the embedded electronic system. The embedded electronic system further includes a processor. The processor is configured to receive outputs from the plurality of sensors and to determine system control parameters from outputs of at least one of the plurality of sensors.

Description

[Cross reference to related application]
This application is a continuation of U.S. patent application entitled "Modularized Eyeglass System, Apparatus, and Method," No. 16/711,340, filed Dec. 11, 2019, and this application is hereby incorporated by reference. The application is U.S. Provisional Patent Application No. 62/778,709, filed December 12, 2018, entitled "Interchangeable Frames and Embedded Electronics for Mobile Audio-Visual Augmentation and Assisted Reality." claiming priority from "a modular eyeglass system comprising temples. U.S. Provisional Patent Application No. 62/778,709, entitled "Modularized Eyewear System with Interchangeable Frames and Temples with Embedded Electronics for Mobile Audio-Visual Augmented and Assisted Reality," , all incorporated herein by reference. This application claims priority from U.S. Provisional Patent Application No. 62/873,889, entitled "Wearable Device Apparatus, System, and Method," filed July 13, 2019. US Provisional Patent Application No. 62/873,889, entitled "Wearable Device Apparatus, System, and Method," is hereby incorporated by reference in its entirety. US patent application Ser. No. 16/711,340, entitled "Modularized Eyeglass System, Apparatus, and Method," is hereby incorporated by reference in its entirety.

TECHNICAL FIELD The present invention relates generally to eyeglass devices, and more particularly to apparatus, methods, and systems for providing information to users via modularized eyeglass devices.

The pace of modern life is fast. A person is often under time pressure, his or her hands are occupied, and information is difficult for the person to obtain. This can cause problems. Currently available eyeglasses are expensive and prescription eyeglasses, such as prescription reading glasses and prescription sunglasses, are not easily reconfigured to meet the needs of different users. it can cause problems. Personalized audio transmission is often performed using occlusive in-ear devices called earphones or earphones. Such devices can block the ear canal and prevent the user from hearing far-field sounds. it can cause problems. Therefore, there are problems that require technical solutions. Those technical solutions use technical means to produce technical effects.

The invention may best be understood by referring to the following description and accompanying drawings that are used to describe embodiments of the invention. The present invention is illustrated by way of example in embodiments and not limited to the accompanying drawings as follows. In the accompanying drawings, same reference numerals indicate similar elements.

1 illustrates a modular, reconfigurable eyeglass system, according to an embodiment of the present invention; Fig. 3 shows a reconfigurable component for use in an eyeglass device, according to an embodiment of the invention; 1 illustrates a plurality of reconfigurable components for use in an eyeglass device, according to embodiments of the present invention; Fig. 3 shows another modular reconfigurable eyeglass system, according to an embodiment of the present invention; 5 shows perspective and top views of the modular reconfigurable eyeglass system from FIG. 4, according to an embodiment of the present invention; FIG. Fig. 3 shows a system architecture for use with a modularized eyeglass device, according to an embodiment of the present invention; 6B illustrates a wireless network corresponding to building a system for use with the modularized eyewear device of FIG. 6A, according to an embodiment of the present invention; 5 illustrates another system architecture for use with the modularized eyeglass device of FIG. 4, according to an embodiment of the present invention; FIG. 4 shows a block diagram of a temple insertion module, according to an embodiment of the present invention; Fig. 3 shows a modularized eyeglass device fitted with a back neck module assembly, according to an embodiment of the present invention; FIG. 10 shows a perspective view of a back neck module assembly for positioning a wearable device, according to an embodiment of the present invention; FIG. 11 illustrates coupling a temple interlock to a temple, according to an embodiment of the present invention; FIG. FIG. 4 illustrates how the back neck module assembly is coupled to the electronics contained in the temples, in accordance with an embodiment of the present invention; FIG. FIG. 4 shows a schematic diagram of how the back neck module assembly is combined with the temple electronics, according to an embodiment of the present invention; 4 illustrates a user interface for the back neck module assembly, according to an embodiment of the present invention; FIG. 4 shows a block diagram of a back neck electronic unit, according to an embodiment of the present invention; 1 shows a schematic block diagram, according to an embodiment of the present invention; FIG. 1 shows a schematic block diagram of wake-up control, according to an embodiment of the present invention; FIG. FIG. 4 shows a state diagram of button actuation, according to an embodiment of the present invention. FIG. 4 shows a state diagram of touch sensor operation, according to an embodiment of the present invention. FIG. 4 shows a state diagram of proximity sensor operation, according to an embodiment of the present invention. 4 illustrates the location of buttons, according to an embodiment of the present invention.

In the following detailed description of embodiments of the invention, reference is made to the accompanying drawings, in which like references indicate like elements, and specific embodiments in which the invention can be practiced are , shown as an example. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. In other instances, well-known circuits, structures, and techniques have not been shown in detail so as not to obscure the understanding of this description. Therefore, the following detailed description should not be taken in a limiting sense, and the scope of the invention is limited only by the appended claims.

In one or more embodiments, methods, apparatus, and systems are described that provide users with modularity of eyewear systems. Various combinations and configurations of electronics are taught for incorporation into eyeglass devices, as described in the description of the embodiments below. Some electronic configurations can be removably coupled to the eyeglass device. In some embodiments, an arrangement of electronics is integrated into the eyeglass device. In still other embodiments, the back neck module assembly can be removably coupled with an eyeglass device. In various embodiments, a modular, reconfigurable eyeglass device provides information to a user through the eyeglass device. As used in the description of the embodiments, information includes streaming audio in the form of music, information includes, but is not limited to, heart rate, breathing rate, posture, steps, cadence, The information may also include parameters of the user's biology (e.g., physiological biometrics, biomechanics, etc.) such as, for example, the user's Information about the vehicle is, for example, engine parameters such as bicycle revolutions per minute (RPM), RPM, oil pressure, coolant temperature, wind speed, water depth, airspeed. In various embodiments, information is presented to the user by, for example, an audio broadcast that the user hears and a video broadcast to a display that the user sees on the eyeglass device or an image that is projected into the pupil of the user's eye. Therefore, within the embodiments taught herein, information should be given a broad meaning.

FIG. 1 shows a modular reconfigurable eyewear system according to an embodiment of the invention. Referring to FIG. 1, a modularized eyeglass device is shown at 100 in perspective view. Modularized eyewear device 100 has a frame chassis 102 . In various embodiments, frame chassis 102 is ophthalmically configured to provide a frame rim portion that holds lens 120 and lens 122 . Lenses 120 and 122 may provide any of the functions provided by eyeglass devices, including, but not limited to, safety glass lenses, prescription lenses, sunglass lenses, welded glass lenses, and the like. . The ophthalmic device can also include a singlet lens instead of the doublet lens shown. In some embodiments, nose pads are provided to provide cushioning to the contact area with the user's nose. In some embodiments, the nose pads are made of a flexible material such as silicone rubber.

Temple 104 (left temple) and temple 114 (right temple) are connected to frame chassis 102 . Temples 104 and 114 are flexibly coupled to frame chassis 102 by hinges as shown, or temples 104 and 114 can be provided to be oriented and fixed with respect to frame chassis 102 .

In various embodiments, one or more of the temples (104 and 114) and chassis frame 102 can be fitted with electronics as described below. In view 100, a left temple insert module (TIM) 106 has a left temple 104 positioned thereon, and a right temple insert module (TIM) 116 has a right temple 114 positioned thereon. Temple Insertion Modules (TIMs) are described in detail in conjunction with the following figures.

With continued reference to FIG. 1, a modularized eyeglass device is shown at 130 in a perspective view. Frame chassis 132 is ophthalmically configured to surround lens 140 and lens 142 with a frame rim to secure lens 140 and lens 142 thereto. A brow bar 146 is secured to the frame chassis 132 in a variety of ways, via assembly fasteners, adhesives, or the like. Temple 144 includes a left temple connector 152 that is rotatably couplable with a left chassis connector 150 . Left chassis connector 150 along with left temple connector 152 form a rotatable mechanical and electrical connection between chassis 132 and left temple 144 for connecting frame chassis 132 to left temple 144 . provide one or more electrical paths for Similarly, right temple 134 may be rotatably coupled to frame chassis 132 via right hinge assembly 148 .

In some embodiments, the modularized eyeglass device allows each temple to be detached from the hinge via an electrical/mechanical connector having one or more electrical contacts not shown for clarity. Note that it is configured as These electrical contacts can be made using, for example, pins, points, pads, slots, contact devices, and the like. For example, the line indicated at 154 demarcates the junction between the right temple connector and right temple 134 . Similarly, the line indicated at 156 demarcates the junction between left temple connector 152 and left temple 144 .

By providing an electrical/mechanical connector between each temple, such as 134, 144, and the frame chassis 132, the temples can be replaced with an eyeglass device. The function allows the user to exchange one temple for another. Different temples can be configured with different electronics to provide the different functions described herein. Either temple can be configured to accommodate a variety of electronics configurations. For example, in one or more embodiments, the right interchangeable temple houses an electronic package that includes biosensors, biomechanical sensors, vehicle sensors, environmental sensors, temperature sensors, acoustic sensors, motion sensors. , optical sensor, touch sensor, proximity sensor, speed sensor, acceleration sensor, rotation sensor, magnetic field sensor, global position system (GPS) receiver, cable, microphone, micro speaker, power supply (battery), camera, micro It may include one or more of a display, a head-up display (HUD) module, a multi-axis inertial measurement unit, and a wireless communication system. Note that the TIM can also include the electronic packages and sensors described above. In various embodiments, one or more wireless communication systems are provided, such as Near Field Communication (NFC) using the Industrial, Scientific and Medical (ISM) frequency of 13.56 MHz, adaptive network topology (ANT) Wireless communications using the ANT+ wireless standard, the Bluetooth® standard, the Bluetooth Low Energy standard (BLE), wireless communications using the Wi-Fi standard, and 3G, 4G, Long Term Evolution (LTE) , 5G or other wireless standards. In some embodiments, the electrical pathway from the electronics exits the temple through a lumen in the sheath, goes to the temple sheath, and continues to a lumen in the brow bar sheath. The right interchangeable temple includes a brow bar 146 and a hinge connector 148 that secures to the chassis frame 132 .

In one or more embodiments, the right interchangeable temple is attached to the front of the frame chassis via a hinge connector that provides power and power to the left interchangeable temple via a modularized brow bar. Allow data to be transferred. A hinge connector mechanically interlocks with the frame chassis to allow electrical pin conductors and power/data connections. In one or more embodiments, when placed in an open orientation when worn, the hinged connector senses the open state of the device and allows power or data to be transferred. When in the closed position (temples folded inwards), the hinged connector, along with signals received from one or more proximity and motion sensors, allow the system to sense the state of user-device interaction. and terminate power or data transfer. Its features reduce power consumption when folded and stowed, and can automatically turn on when the user wears the device on their head. In addition to switchable data or power transfer from the hinge connector, the hinge connector can provide flexible circuitry and wired micro connectors that provide stable, uninterrupted power and/or data transfer.

In some embodiments, it is convenient to route electrical pathways within the volume of brow bar 146 . In some embodiments, brow bar 146 is configured to provide a channel along its length into which electrical pathways are routed. Thus, brow bar 146 may provide one or more sheaths, channels, etc. along its length to house electrical pathways and sensors therein. By way of example, and not limitation, electrical pathways may include wires, printed circuit boards, flexible printed circuit boards, and the like. In various embodiments, it may be advantageous to attach one or more sensors to the browbar 146 to create an electrical subassembly for the frame chassis 132 . In some embodiments, additional electrical paths from frame chassis 132 are combined with electrical paths included in brow bar 146 . In some embodiments, a flexible electronic circuit is adhered to the lower upper surface of the brow bar and exits the brow bar through left and right sheath lumens. Alternatively, or in combination, fully embedded flexible electronics can be cast into the brow bar, with integrated contact points exiting the brow bar near each hinge. When these integrated contacts on either side of the brow bar are contacted with integrated contacts on the left and right temples, data or power transmission is permitted. In addition to facilitating connections with electronics, the brow bar can conceal an optional pupil module with a fixed flange, allowing the user to view the micro-display through the brow bar's pupil opening. .

Similarly, the left temple is configured as a left interchangeable temple to be connected to the front frame of the spectacles by a left hinge connector. In various embodiments, the left interchangeable temple can include the same electronic configurations/functions as the right interchangeable temple, or the interchangeable temples can include different electronic configurations and different functionality.

With continued reference to FIG. 1, left temple 164 and right temple 174 are configured as shown at 160 . Each of temples 164 and 174 includes electronics configured to provide information and functionality to the user of the eyeglass system. The left temple 164 has a temple door (not shown), shown at 160, which has been removed to expose the electronic package, shown at 186. FIG. Temple doors protect electronics from environmental exposure and hazards. The temple doors are secured to the temple assembly by mechanical fasteners suitable for the given application. In some embodiments, the temple door provides a water ingress rating via an IP code from IEC Standard 60529 International Protective Marking. A power supply (battery) is indicated at 184 and an audio speaker and port are indicated at 182 . Audio speakers and ports 182 are typically located at the rear end of the temple and in some embodiments are integrated directional projection speakers that direct the sound personally to the user's ears. Projection stereo speakers can convey various audio signals to the user, such as, but not limited to, voice prompts, streaming music, smart audio assistance, and data. Note that the projection speaker design does not block the user's ears. Thus, the user can hear far-field sound, which is not degraded like currently available earbud headphones that block the user's ears.

The right temple 174 is also provided with an electronics package (not shown). An electronics package is contained within the right temple 174 . The right temple is provided with an audio speaker with an audio speaker port 184, which can be an integrated directional projection speaker. In one or more embodiments, right temple 174 is configured to receive external assembly 190 including micro-display assembly 192 . Similarly, the left temple can be configured to accommodate the external assembly 190 and micro display assembly 192 .

In various embodiments, the micro display assembly, e.g., 192,
A head-up display (HUD) Pupil® optical module that houses the optics, electronics, and micro-displays that form an optical system. The pupil mechanism can also accommodate cables, flexible circuit boards, or wires that enter the electronic contact path from the housing. In one or more embodiments, those electrical pathways are connected to the side of the left temple 174 so that the user has a see-through head-up display external accessory, enhancing the visual component of the mobile reality experience. can be

In one or more embodiments, the wiring exiting the brow bar is hidden in the left and right temple sheaths and enters the left and right temples through sheath lumens, thereby protecting the wiring from environmental hazards. A region near the contact point path can house a motion mechanism for customizing the interpupillary distance of the head-up micro-display module.

In various embodiments, front frame portions such as 102 or 132 (FIG. 1) or any similar configuration in the figures below and 104, 114, 134, 144, 164, 174 (FIG. 1) or any in the figures below. Right and left temple portions of similar construction are part of a set of interchangeable front frame and temple portions, each having the same or different device, accessory, performance and/or function combinations. Electronics boards, microphones, speakers, batteries, cameras, head-up display modules, wireless Wi-Fi radios, GPS chip sets, LTE cellular radios, multi-axis inertial measurement units, motion sensors, touch sensors, lights and At least one of a proximity sensor and the like can be included in any desired combination. It can further include electronics that enable a user to perform at least one of wirelessly connecting to cellular services, smart phones, smart watches, smart bracelets, mobile computers, and sensor peripherals. can. The electronics can display see-through augmented reality images via a modular head-up display (HUD), provide stereo audio content, or support one or more integrated projection micro-speakers. It can further include the ability to provide voice and audio notifications, including music, through the device. The front frame electrical contact device and the temple electrical contact device may include electrical contact points within or near their respective hinge connectors. The contact points are detached from each other to electrically transfer at least one of power, electrical signals and data between the temple portion and the front frame portion when the contact points are in the electrically closed position. Make electrical contact possible. In some embodiments, when assembled together, the front frame hinge connector, the front frame electrical contact device, the temple hinge connector, and the temple electrical contact device can form an electromechanical hinge, hinge connector, assembly or device. can. In some embodiments, folding the temple portion to the retracted position disconnects the contacts and powers off the system.

In some embodiments, at least one of the front frame electronics and the temple electronics includes a battery, a camera, a head up display module, a controller, digital storage electronics, a CPU, a projection microcontroller. Speakers, microphones, wireless Wi-Fi radios, GPS chip sets, LTE cellular radios, multi-axis inertial measurement systems or units, and/or sensory, motion, touch, light, proximity, temperature and pressure sensors, etc. can contain one.

In some embodiments, at least one temple can include a temple module insert (TIM) that houses selected temple electronics. In another embodiment, the neck smart cord is electrically connected to the back neck electronics module. The neck smart cord has left and right connectors or connector ends for mechanically or electrically interconnecting the back neck electronics module with the left and right temples of the eyewear device.

Figure 2 shows reconfigurable components for use in an eyeglass device according to an embodiment of the invention. Referring to 200 in FIG. 2, a temple 202 is provided with an engaging portion 204 . A temple insertion module, designated 210 and referred to as “TIM” in the description of this embodiment, is configured to be releasably coupleable with engagement portion 204 of temple 202 . TIM 210 is attached to temple 202 as indicated by arrows 212a and 212b. In various embodiments, the engagement portion 204 may include, but is not limited to, press fits, clips, mechanical interlocks, hook and loops, magnetic surfaces, external clamps to temples, flanges and temples. is achieved by a mechanical connection, such as mechanical interlocking of In yet another embodiment, engagement portion 204 and TIM 210 utilize magnetic surfaces to secure TIM 210 by magnetic force. The shape of the engaging portion indicated at 204, and the shape of the engaging portion shown elsewhere in the figures shown herein, are provided for illustrative purposes only and are not intended to limit embodiments of the present invention. do not have. In the view indicated at 200 , TIM 210 only mechanically connects with temple 202 and no electrical connection is provided between TIM 210 and temple 202 .

In some embodiments, TIM 210 is provided with a speaker and speaker port 214, which may be a micro-projection speaker. Speakers provide information to users through audio broadcasts. Note that the speakers provided here are speakers that are external to the user's ear, and therefore are not inserted into the user's ear like an inserted earphone. Located in TIM 210 is an electronic package that includes a processor, memory, power, and one or more wireless communication protocols that enable TIM 210 to wirelessly communicate 222 with one or more devices 220 . Device 220 can be, for example, but not limited to, a biometric or vehicle sensor, a local user device, a network node such as a wireless router, a remote network, or a mobile phone accessed via a network. can be an external sensor, such as a remote user device of Various sensors, networks, and remote devices are described in detail in conjunction with the following diagrams.

According to the architecture of 200 of FIG. 2, in some embodiments a second temple and a second TIM are provided. The two TIMs in such a system can participate in wireless communication between and between devices 220 as needed to provide a level of design functionality to the user. For example, in one embodiment, the left TIM includes sufficient wireless network functionality to communicate with remote device 220 using the first network protocol. Additionally, the left TIM and right TIM have wireless network capabilities to support communication utilizing a second network protocol. To save power, the first network protocol has a wider range than the second network protocol. Because the distance between the left TIM and the remote device is greater than the separation distance between the left TIM and the right TIM (nominally the width of the user's head). The architecture shown at 200 is called true wireless because there is no wired connection between the left TIM and the right TIM. In one or more embodiments, an audio stream is provided from the user device to the first TIM using the first wireless network. A second wireless audio stream is then provided from one TIM to the other TIM utilizing a second wireless network to provide audio streams to each of the left and right projection speakers of the eyewear device. be done.

As described in conjunction with the figures herein, the temples and TIMs described at 200 provide reconfigurable components for an eyeglass device. The front ends 206 of the temples 202 engage the frame chassis of the ophthalmic device described above. There may or may not be a connector between the temple and the frame. Thus, depending on the given design of the eyeglass, the temples 202 can have a fixed position relative to the frame chassis, or the temples can be rotatably coupled to the frame chassis.

Referring to 250 in FIG. 2, a temple 252 is provided with an engaging portion 254 . A temple insertion module TIM, indicated at 260 , is configured for removably coupling with engagement portion 254 of temple 252 . TIM 260 is attached to temple 252 as indicated by arrows 262a and 262b. In various embodiments, engagement portion 204 is accomplished through a combination of electrical and mechanical connections. Mechanical connections can be, for example, but not limited to, press fits, clips, mechanical interlocks, hook and loops, etc., as described in conjunction with 210/204. In yet another embodiment, engagement portion 254 and TIM 260 utilize magnetic surfaces to secure TIM 260 by magnetic force. Several electrical contacts 280 are provided for illustration purposes and are not meant to be limiting thereby. Electrical contacts 280 mate with corresponding electrical contacts in temple 252 to provide electrical connection to one or more electrical pathways (not shown) in temple 252 . Electrical paths in temple 252 facilitate electrical connections between TIM 260 and sensors 272 and 274, which may also represent sources of signals provided to one or more displays. Sensors 272 and 274 can be acoustic sensors such as microphones or any of the sensors described herein for use in conjunction with an electronic package comprising an eyeglass device. In one or more embodiments, one or more of 272 and 274 provide signals to a display such as a HUD.

In some embodiments, TIM 260 is provided with a speaker and speaker port 264, which can be a micro-projection speaker. Speakers provide information to users through open-ear audio broadcasts.

According to the architecture of 250 of FIG. 2, in some embodiments a second temple and a second TIM are provided as shown in FIG. 3 below. The two TIMs in such a system participate in wireless communication between and between devices 220 as needed to provide a level of design functionality to the user. As described in conjunction with the figures herein, the temples and TIMs described at 250 provide reconfigurable components for the eyeglass device. For example, the front ends 256 of the temples 252 engage the frame chassis of the eyeglass device described above. There may or may not be a connector between the temple and the frame. Thus, depending on the given design of the eyeglass, the temples 252 can have a fixed position relative to the frame chassis, or the temples can be rotatably coupled to the frame chassis.

FIG. 3 shows at 300 a plurality of reconfigurable components for use in an eyeglass device according to an embodiment of the invention. Referring to 300 in FIG. 3, the left reconfigurable component 250 of FIG. 2 is shown with an accompanying right reconfigurable component for an eyeglass device. The right temple 352 has an engaging portion not shown in FIG. 3 that is similar to the engaging portion 254 of the left temple 252 . A temple insertion module TIM, indicated at 360 , is configured for removably coupling with the engagement portion of the temple 352 . TIM 360 couples with temple 352 as indicated by arrows 362a and 362b. In various embodiments, engagement of temples 352 is achieved through a combination of electrical and mechanical connections. Mechanical connections can be, for example, but not limited to, press fits, clips, mechanical interlocks, hook and loops, etc., as provided in conjunction with 210/204 above. In yet another embodiment, the engagement portion of temple 352 and TIM 360 utilize magnetic surfaces to secure TIM 360 by magnetic force. Several electrical contacts 380 are provided for illustration purposes and are not meant to be limiting thereby. Electrical contacts 380 mate with corresponding electrical contacts in temple 352 to provide electrical connection to one or more electrical pathways (not shown) in temple 352 . Electrical pathways within temple 352 facilitate electrical connections between TIM 360 and one or more sensors 372 and 374 . Sensors 372 and 374 can be acoustic sensors such as microphones or any of the sensors described herein for use in conjunction with an electronic package comprising an eyeglass device. In various embodiments, TIM 360 is an electronic package that includes a processor, memory, power, and one or more wireless communication systems. The wireless communication system uses protocols that allow TIM 360 to wirelessly communicate with one or more devices as indicated by the wireless transmission at 222 . Additionally, TIM 360 and TIM 260 can be configured to have wireless communication capabilities to enable wireless communication between TIMs as indicated by wireless transmissions at 382 . In some embodiments, TIM 360 is provided with a speaker, which may be a micro-projection speaker, and a speaker port indicated at 364 . The speaker provides information to the user through an audio broadcast.

Referring to view 390 of FIG. 3, a schematic diagram of the electrical connections for each of TIM 260 and TIM 360 is shown. TIM 260 is electrically coupled to sensor 272 by electrical path 394 . Similarly, TIM 260 is electrically coupled to sensor 274 by electrical path 392 . The connections between the TIM 260 and the respective sensors make up the electrical schematic 384 of the left temple. Note that the left temple electrical schematic 384 may or may not be more complex than shown. Accordingly, the left temple electrical schematic is provided for illustrative purposes only and is not meant to be limiting thereby.

Similarly, TIM 360 is electrically coupled to sensor 372 by electrical path 398 . TIM 260 is electrically coupled to sensor 374 by electrical path 396 . The connections between the TIM 360 and the respective sensors make up the electrical schematic 386 of the right temple. Note that the right temple electrical schematic 386 may or may not be more complex than shown. Accordingly, the electrical schematic of the right temple is provided for illustrative purposes only and is not meant to be limiting thereby.

The two TIMs in such a system participate in wireless communication between and between devices 220 as needed to provide a level of design functionality to the user. For example, in one embodiment, the left TIM includes sufficient wireless network functionality to communicate with remote device 220 using the first network protocol. In addition, the left TIM and right TIM have wireless network capabilities to support wireless communication shown at 382 . Wireless communication 382 may be performed by a second network protocol different from that used at 222 . To save power, the first network protocol (222) has a wider range than the second network protocol (382). Because the distance between left TIM 260 and remote device 220 is greater than the separation distance between left TIM 260 and right TIM 360 . The latter is nominally the width of the user's head, and the former can be the same as the distance to a mobile phone's cellular tower.

FIG. 4 shows another modular reconfigurable eyewear system according to an embodiment of the invention. Referring to FIG. 4, one or more of the sensors, power components, and computing units are distributed throughout the eyewear device, including distributed throughout a frame chassis such as 402 . Frame chassis 402 is ophthalmically configured to surround lens 440 with a frame rim, thereby securing lens 440 thereto. Left temple 404 and right temple 414 are coupled to frame chassis 402 to form an eyeglass device. Left lens 404 is configured to have an engaging portion indicated at 408 . Left temple insertion module (TIM) 406 is configured to engage engagement portion 408 as described above, thereby providing both mechanical and electrical connection between TIM 406 and temple 404. . Similarly, right temple 426 is shown engaged with the engagement portion of right temple 414 . TIM 406 includes audio speakers and audio ports indicated at 410 and TIM 426 includes audio speakers and audio ports indicated at 430 . In various embodiments, audio speakers 410 and 430 are projection speakers. The eyewear device includes several sensors or displays, 462, 464, 466, 468, and 470, which extend from the left temple 404 through the frame chassis 402 to the right temple 414 integrated into the electrical pathway. In various embodiments, there may be more or fewer sensors than shown in FIG. The sensors and sensor locations shown in FIG. 4 are provided merely as examples and are not limiting embodiments of the present invention. As described above in conjunction with previous figures, at least one of temple insertion modules 406 and/or 426 includes the necessary set of electronics to provide wireless connection 222 to device 220. .

In the eyewear device 400 a high level view of the electrical pathway schematic is shown at 480 . Referring to 480 , left TIM 406 and right TIM 426 are electrically coupled with sensors 462 , 464 , 466 , 468 and 470 by electrical path elements 482 , 484 , 486 , 488 , 490 and 492 . Electrical routing elements such as 484 electrically connect sensors 464 . Together, the components shown at 480 provide a modular, reconfigurable set of components for an eyeglass device. In one or more embodiments, one or more acoustic sensors are located on at least one of frame chassis 402 , left temple 404 , and right temple 414 . Therefore, the acoustic sensor can be located anywhere on the temple (left or right) or frame chassis of the eyeglass device.

FIG. 5 shows perspective and top views, generally at 500, of the modularized eyewear system of FIG. 4 according to an embodiment of the present invention. Referring to FIG. 5, a modularized eyeglass device is shown at 130 in perspective view. The modularized nose pads 504 can be removably coupled with the modularized eyeglass device 502 as shown at 506 . The modularity of the nose pads allows the user to replace the nose pads to improve the fit between the eyeglasses and the user's nose and facial structures. By modularizing the nose pads of the eyeglass device, it is possible to achieve a more comfortable wearing experience. Additionally, the nose pads may be provided with other sensors, such as biosensors.

FIG. 6A shows, generally at 600, a system architecture for use with a modularized eyeglass device, according to an embodiment of the present invention. Referring to FIG. 6A, in various embodiments, a modular reconfigurable eyeglass device can include multiple wireless communication systems. In various embodiments, eyeglass device 602 has a high level block diagram architecture as shown at 604 . In various embodiments, eyeglass device 602 is configured to communicate with wireless sensor 640 and mobile device 670 . Wireless sensor 640 may include a single sensor or multiple sensors. Wireless sensor 640 may include, without limitation, any one or more sensors listed herein. For example, wireless sensor 640 can be a biometric or biomechanical sensor configured for use with a user, or a sensor configured for use with a vehicle or building. Some examples of biometric sensors include, but are not limited to, heart rate monitors, perspiration sensors, temperature sensors, and the like. Some examples of vehicle sensors include, but are not limited to, speed sensors, acceleration sensors, global positioning system signals, vehicle engine parameters, wind speed indicators, and the like. Some examples of sensors used with buildings include, but are not limited to, temperature readings from thermostats, water pressure readings, and the like. Some non-limiting examples of vehicles include, but are not limited to, scooters, bicycles, automobiles, boats, yachts, ships, airplanes, military vehicles, wingsuits, and the like. In some embodiments, data is received at 640 or 616 from a special purpose network. A special-purpose network shown for purposes of illustration is the National Marine Electronics Association's (NMEA) NMEA2000 network designed for ships such as yachts (power or sail). NMEA2000, also known in the art as "NMEA2k" or "N2K", is standardized as International Electrotechnical Commission (IEC) 61162-1. NMEA200 is a plug-and-play communication standard used to connect marine sensors and display units on ships, boats, yachts, and the like. Mobile device 670 may be, without limitation, any one or more of the mobile devices listed herein. For example, a mobile device can be a cell phone, watch, wrist band, bracelet, tablet computer, laptop computer, desktop computer, vehicle-mounted computer, and the like.

Eyewear device 602 has a high level architecture as shown at 604 and includes speaker 606 , central processing unit 608 , power supply 610 , acoustic sensor 608 , storage 614 and wireless communication system 616 . Wireless communication system 616 may include one or more of the following wireless communication systems. For example, a short-range communication system 618, a wireless communication system 620, 624 using a Wi-Fi communication protocol over a Bluetooth communication protocol, a cellular communication protocol 622, and the like. The wireless communication protocol specified at 622 by LTE is provided only as an example of wireless devices and is not a limitation of embodiments of the present invention. Those skilled in the art can recognize that one or more antennas are included in wireless communication system block 616 but are not shown for clarity.

Wireless sensor 640 has a high-level architecture as shown at 642 and includes one or more sensors 644 and wireless communication system 646 . Wireless communication system 646 may be a low data rate communication system such as a short-range communication system, BLE, ANT+, or the like. Alternatively, wireless communication system 646 can be provided as the higher data rate system required by sensor 644 .

Mobile device 670 has a high level architecture as indicated at 672 and includes a central processing unit 674 , a power source 676 , storage 678 and one or more wireless communication systems indicated at block 680 . Mobile device 670 can optionally be configured to reach remote networks such as those shown by cloud 689 . Wireless communication block 680 may include one or more of the following wireless communication systems. For example, a short-range communication system 682, a wireless communication system 684 using a Bluetooth communication protocol, a wireless communication system using a Wi-Fi communication protocol at 686, a cellular communication protocol at 688, and the like. The wireless communication protocol specified by LTE at 688 is provided only as an example of a communication system for mobile devices and is not intended to limit embodiments of the present invention. Those skilled in the art can recognize that one or more antennas are included in wireless communication system blocks 680 and 642, but are not shown for clarity.

In some embodiments, wireless sensor system 642 and eyeglass device 602 are initially configured by a user of mobile device 670 and mobile device user interface. In operation, as indicated by paths 652 a and 652 b , eyeglass device 602 wirelessly receives data from a suitable wireless communication system, such as near field communication system 618 , as indicated at 650 . Wireless data obtained from wireless sensor system 642 can be transmitted to user devices 670/672 by another wireless communication system, such as that indicated at 654 . Wireless communication, indicated at 654, uses, for example, the Bluetooth protocol at 620/684, the Wi-Fi protocol at 624/686, or the cellular communication protocol, indicated at 622/688, at higher data rates. - can be achieved in the channel; In various embodiments, data transferred from eyeglass device 602 is stored and analyzed on user device 670 and can have various application programs.

FIG. 6B shows, generally at 690, a wireless network corresponding to the system architecture of the modularized eyewear system of FIG. 6A, according to an embodiment of the present invention. Referring to FIG. 6B, the wireless communication block 616 can connect to multiple devices as shown. For example, one or more wireless sensors 640 may be connected to wireless communication block 616 using a low data rate near field communication network such as that shown at 618 . One or more user devices 670 can wirelessly communicate with the wireless communication block using the Bluetooth communication protocol such as that shown at 620 . As indicated at 624 , one or more wireless nodes, such as Wi-Fi nodes indicated at 692 , can wirelessly communicate with wireless communication block 616 . One or more remote networks 694 can wirelessly communicate with wireless communication block 616 using a cellular communication protocol such as that shown at 622 . Accordingly, the reconfigurable eyewear device can include one or more wireless communication systems, indicated at 690. FIG. For example, by replacing one TIM module with another, the eyeglass device can be reconfigured for different wireless communications. Alternatively, one or more temples can be interchanged with the frame chassis described above, thereby providing customized functionality to the eyeglass device.

FIG. 7 shows, generally at 700, another system architecture for use with the modularized eyeglass device of FIG. 4, according to an embodiment of the present invention. Referring to FIG. 7, the wireless communication block 616 of the eyeglass device 602 is configured to allow direct cellular communication over a cellular network without the need for a user device acting as an intermediary. For example, at 700 the eyeglass device 602 is configured to communicate with a remote device 702 , which may be a mobile phone, via a wireless communication system 622 , thereby directly communicating with the remote device 702 via an external network indicated by cloud 704 . connect to. No intermediary user's mobile device is required to support this line of communication. Such a configuration of the eyeglass device allows the user of the eyeglass device to make a call from the eyeglass device with the help of an interface such as a voice interface, one or more tactile interfaces such as buttons. A voice interface provides call command and control by converting the user's voice signals into commands that the device uses to facilitate operation of the wireless network for the call. Examples of such commands include, but are not limited to, select caller, place a call, increase volume, decrease volume, end call, and the like.

FIG. 8 shows, generally at 800, a block diagram of a temple insertion module (TIM) according to an embodiment of the invention. Referring to FIG. 8, as used in the description of this embodiment, a TIM can be based on a device such as a computer, and embodiments of the present invention can be used in that device. Block diagrams are high-level conceptual representations that can be implemented in different ways and with different architectures. Bus system 802 includes a central processing unit (CPU) 804 (also referred to herein as a processor), read only memory (ROM) 806, random access memory (RAM) 808, storage 810, audio 822, user Interconnect interface 824 and communication 830 . RAM 808 may also represent dynamic random access memory (DRAM) or other forms of memory. In various embodiments, user interface 824 can be a voice interface, a touch interface, physical buttons, or a combination thereof. It is understood that memory (not shown) may be included in CPU block 804 . Bus system 802 may include, for example, system bus, peripheral component interconnect (PCI), advanced graphics port (AGP), small computer system interface (SCSI), Institute of Electrical and Electronics Engineers (IEEE) standard number 994. (FireWire), Universal Serial Bus (USB), Universal Asynchronous Transceiver (UART), Serial Peripheral Interface (SPI), Inter-Integrated Circuit (I2C), or the like. CPU 804 may be single, multiple, or distributed computing resources. Storage 810 may be flash memory or the like. Note that the TIM may include some, all, more, or rearrangements of the components in the block diagrams, depending on the actual implementation of the TIM. Therefore, many variations of the system of FIG. 8 are possible.

A connection with one or more wireless networks 832 is obtained via communication (COMM) 830, whereby the TIM 800 wirelessly communicates with local sensors, local devices, and remote devices on remote networks. can do. In some embodiments, the 832/830 provides access to a remote speech-to-text system, which may be remote, cloud-based, for example. 832 and 830 flexibly represent wireless communication systems in various implementations, including various forms of telemetry, General Packet Radio Service (GPRS), Ethernet, Wide Area Network (WAN), Local area network (LAN), Internet connection, Wi-Fi, WiMAX (registered trademark), ZigBee (registered trademark), infrared, Bluetooth, short-range communication, 3G, 4G, LTE, mobile phone communication systems such as 5G, and combinations thereof. A touch interface is optionally provided at 824 in various embodiments. Signals from one or more sensors enter the system via 829 and 828 . At 826, Global Positioning System (GPS) information is received and entered into the system. Audio may refer to speakers such as the projection speakers or projection micro-speakers described herein.

In various embodiments, depending on the hardware configuration, different wireless protocols are used in the network, thereby providing the system illustrated in the above figures. One non-limiting embodiment of the technology used for wireless signal transmission is the Bluetooth wireless technology standard commonly known as the IEEE 802.15.1 standard. In another embodiment, a wireless signaling protocol known as Wi-Fi using the IEEE 802.11 standard is used. In another embodiment, the ZigBee communication protocol based on the IEEE 802.15.4 standard is used. These examples are merely illustrative and do not limit different embodiments. Transmission Control Protocol (TCP) and Internet Protocol (IP) are also used in various embodiments. Embodiments are not limited to the data communication protocols described herein and are readily used with other data communication protocols not specifically described herein.

In various embodiments, the components of the system and the system described in the previous figures (e.g., the temple insertion module (TIM)) are implemented in an integrated circuit device, the integrated circuit device comprising an integrated circuit package containing the integrated circuit. can be done. In some embodiments, the components of the system and the system are implemented on a single integrated circuit die. In other embodiments, system components and systems are implemented on multiple integrated circuit dies of an integrated circuit device, which may include a multi-chip package containing integrated circuits.

FIG. 9 shows a modularized eyeglass device fitted with a back neck module assembly, according to an embodiment of the present invention. Referring to FIG. 9, at 900 the back neck module assembly is attached to a set of passive glasses. Passive glasses represent no electronics placed in the glasses. Alternatively, the spectacles can be active or powered spectacles comprised of electronics packaged in one or more temples or temple insertion modules (TIMs) as described herein. The spectacles have a frame chassis 902 containing lenses 906 . Left temple 904 and right temple 914 are coupled to frame chassis 902 . The back neck module assembly includes behind the neck electronics pod (ePOD) 924, left temple interlock 920, right temple interlock 922, left smart cord 926, and right smart cord 928. . Left smart cord 926 electrically and mechanically couples ePOD 924 to left temple interlock 920 and right smart cord electrically and mechanically couples ePOD 924 to right temple interlock 922 .

Left temple interlock 920 includes an acoustic cavity, an audio speaker, and an acoustic port. The left audio speaker acoustic port is indicated at 930 . Left smart cord 926 includes electrical conductors that provide audio signals to an audio speaker contained within left temple interlock 920 . In one or more embodiments, the audio speaker included in the left temple interlock is a micro-projection speaker. Similarly, the sound port for the right audio speaker is indicated at 932 . Right smart cord 928 includes electrical conductors that provide audio signals to an audio speaker contained within right temple interlock 922 . In one or more embodiments, the audio speakers included in the right temple interlock are micro-projection speakers.

In various embodiments, ePOD 924 includes an electronic unit. The electronic unit contains the electronic components and functions for the temple insertion module (TIM) described herein. In other words, the electronic unit is a mechanically and electrically packaged TIM for use in the back neck module assembly.

Electronic units with different electronic configurations and functions can be interchanged into and out of the ePOD in a manner similar to the way various TIMs are interchangeably moved into and out of the temples of an eyeglass device.

At 950, length adjustments are provided to shorten or lengthen the right and left smart cords. A rear neck electronic pod (ePOD) 954 is provided with a left smart cord 956 and a right smart cord 958 emanating from the same end of the ePOD 954 . Such configuration of smart cords 956 and 958 allows slider 960 to move away from or toward the ePOD. Moving slider 960 away from ePOD 954 reduces the available free length of smart cord 965/958. Moving slider 960 toward ePOD 954 increases the available free length of smart cord 956/958.

In one or more embodiments, in operation, when in the "on" state, audio data is streamed to the electronic units of the ePOD 924 and directed to the left and right speakers, thereby causing the back neck module assembly to turn on. • Broadcast audio data to the user when attached to the wearable device and the user wears the eyeglass device.

FIG. 10 shows, in perspective view, a back neck module assembly, generally at 1000, on which a wearable device according to an embodiment of the invention is placed. Referring to FIG. 10, a first sensor 1050 is shown on ePOD 924 . A second sensor 1052 is shown incorporated into the right temple interlock 922 . A third sensor 1054 is shown incorporated into the left temple interlock 920 . Sensors 1050, 1052, and 1054 can be any sensors used directly in the TIM or temple built-in electronics previously described herein.

In the embodiment shown in FIG. 10, each temple interlock module module, such as 920 and 922, includes a through-hole into which the temple of the eyeglass is inserted. In this embodiment, temple interlock modules 920 and 922 are made from a flexible material such as elastomer or rubber that allows sufficient elongation to allow the temples to be inserted. For example, left temple interlock 920 includes a through hole 1040 into which left temple 904 is inserted. Right temple interlock 922 includes a through hole 1042 into which right temple 914 is inserted. Each temple interlock 920 and 922 is positioned on compatible eyeglasses such that each speaker port 930 and 932 is located in front of and near the user's ear. Compatible spectacles are spectacles that are compatible with the mechanical attachment provided to the temple interlock.

FIG. 11 shows generally at 1100 and 1150 coupling temple interlocks to temples according to embodiments of the present invention. Referring to FIG. 11, the magnetic temple interlock is shown at 1100. FIG. The magnetic temple interlock includes magnetic regions 1108 on the temples 1102 of the eyewear device. Temple interlock 1104 has corresponding magnetic regions 1106 . In operation, bringing magnetic regions 1106 and 1108 together, magnetic regions 1106 and 1108 are attracted to each other, thereby providing a clamping force between temple interlock 1104 and temple 1102 . A port of the acoustic cavity containing the speaker is indicated at 1110 .

Another clamping method is shown at 1150 . Temple interlock 1152 includes slot 1158 between first side 1156a and second side 1156b of compliant material. The shapes of 1158, 1156a, and 1156b form a U-shape into which the temples of the ophthalmic device can be inserted. The elasticity of the material 1152 provides a removable connection between the temple interlock 1152 and the temple of the eyeglass (not shown). An acoustic port of the acoustic cavity that houses the speaker is indicated at 1154 .

FIG. 12 shows generally at 1200 coupling the back neck module to the electronics contained within the temples according to an embodiment of the present invention. Referring to FIG. 12, the back neck module assembly is connected to electronics contained in the temples. A portion of the back neck module assembly is shown having a back neck electronic pod (ePOD) 1220, left smart cord 1222, and left temple interlock 1210. FIG. As previously mentioned, any electronics contained in the temple can be contained directly within the temple without the use of a temple insertion module (TIM). Alternatively, the electronics included in the temple can optionally be electronics made part of the TIM, as shown at 1204 . In either situation, the temple 1202 is provided with several electrical contacts indicated at 1206 . Left temple interlock 1210 is provided with a corresponding number of electrical contacts 1208 . A mechanical interlock is provided between temple 1202 and left temple interlock 1210 to allow the connection between 1210 and 1202 to be detachably coupled. In one or more embodiments, a magnetic coupling is provided near or at the locations of 1206/1208 to provide a removable coupling thereat.

FIG. 13 shows a schematic diagram, generally at 1300, for combining a back neck module assembly with temple electronics according to an embodiment of the present invention. Referring to FIG. 13, the outline of the eyeglass device is indicated at 1302. As shown in FIG. The left temple, right temple, and frame chassis of the eyeglass device 1302 contain electronics and/or electronic pathways. Outline 1302 includes the frame chassis, left temple, and right temple. In the illustrated system, electronic circuit path 1308 extends between the left and right temples of eyeglass device 1302 .

The eyeglass device includes a left temple insertion module (TIM) 1304 located on the left temple and a right TIM 1306 located on the right temple. A back neck module assembly with electronic unit (ePOD) is shown at 1310 . Left smart cord 1312 provides an electrical path between ePOD 1310 and left TIM 1304 . Right smart cord 1314 provides an electrical path between ePOD 1310 and right TIM 1306 . In various embodiments, both left TIM 1304 and right TIM 1306 are populated with one or more wireless communication network systems that enable wireless communication between left TIM 1304 and right TIM 1306, as shown at 1316. be done. Remote device 1320 represents one or more wireless sensors or wireless user devices, as described in conjunction with previous figures. Wireless communication 1322 is established between remote device 1320 and at least one of left TIM 1304 , right TIM 1306 and ePOD 1310 . All electronic system function descriptions for TIMs above are applicable to ePODs such as ePOD 1310 .

In some embodiments, the left temple is not electrically connected to the right temple, such as when electrical path 1308 is omitted from the electrical schematic shown at 1300 .

FIG. 14 shows, generally at 1400, the user interface of the back neck module assembly according to an embodiment of the present invention. Referring to FIG. 14, the back of the neck electronic pod (ePOD) is indicated at 1402 . ePOD 1402 comprises a display interface 1404 . In different embodiments, display interface 1404 can be implemented in various ways. In some embodiments, the user interface is tactile surface buttons. In some embodiments, the user interface is implemented by a touch screen, such as a capacitive touch screen that presents one or more controls to the user. , to convey information to the user. In still other embodiments, the user interface communicates information to a person viewing the user interface 1404 from behind the user wearing the ePOD 1402 . Examples of such information include, but are not limited to, pictograms, mood statuses, icons, etc. shown at 1406 .

FIG. 15 shows a block diagram of a back neck electronics unit, generally at 1500, in accordance with an embodiment of the present invention. Referring to FIG. 15, as used in the description of this embodiment, the back neck electronic unit can be based on a device such as a computer that can be used in embodiments of the present invention. Block diagrams are high-level conceptual representations that can be implemented in different ways and with different architectures. Bus system 1502 includes a central processing unit (CPU) 1504 (also referred to herein as a processor), read only memory (ROM) 1506, random access memory (RAM) 1508, storage 1510, audio 1522, user Interconnect interface 1524 and communication 1530 . RAM 808 may also represent dynamic random access memory (DRAM) or other forms of memory. In various embodiments, user interface 1524 can be a voice interface, a touch interface, physical buttons, or a combination thereof. It is understood that memory (not shown) can be included in CPU block 1504 . Bus system 1502 may include, for example, system bus, peripheral component interconnect (PCI), advanced graphics port (AGP), small computer system interface (SCSI), Institute of Electrical and Electronics Engineers (IEEE) standard number 994. (FireWire), Universal Serial Bus (USB), Universal Asynchronous Transceiver (UART), Serial Peripheral Interface (SPI), Inter-Integrated Circuit (I2C), etc. good. CPU 1504 may be single, multiple, or distributed computing resources. Storage 1510 may be flash memory or the like. Note that the TIM may include some, all, more, or rearrangements of the components in the block diagrams, depending on the actual implementation of the TIM. Therefore, many variations of the system of FIG. 15 are possible.

A connection with one or more wireless networks 1532 is obtained via communications (COMM) 1530, whereby the TIM 1500 wirelessly communicates with local sensors, local devices, and remote devices on remote networks. can do. In some embodiments, 1532/1530 provides access to a remote speech-to-text system, which may be remote, cloud-based, for example. 1532 and 1530 flexibly represent wireless communication systems in various implementations, including various forms of telemetry, General Packet Radio Service (GPRS), Ethernet, Wide Area Network (WAN), Local Area Network It can represent a network (LAN), Internet connection, Wi-Fi, WiMAX, ZigBee, infrared, Bluetooth, near field communication, cellular communication systems such as 3G, 4G, LTE, 5G, and combinations thereof. A touch interface is optionally provided at 1524 in various embodiments. An optional display is provided at 1520 . Signals from one or more sensors enter the system via 1529 and 1528 . At 1526, Global Positioning System (GPS) information is received and input into the system. Audio may refer to speakers such as the projection speakers or projection micro-speakers described herein.

In various embodiments, depending on the hardware configuration, different wireless protocols are used in the network, thereby providing the system illustrated in the above figures. One non-limiting embodiment of the technology used for wireless signal transmission is the Bluetooth wireless technology standard commonly known as the IEEE 802.15.1 standard. In another embodiment, a wireless signaling protocol known as Wi-Fi using the IEEE 802.11 standard is used. In another embodiment, the ZigBee communication protocol based on the IEEE 802.15.4 standard is used. These examples are merely illustrative and do not limit different embodiments. Transmission Control Protocol (TCP) and Internet Protocol (IP) are also used in various embodiments. Embodiments are not limited to the data communication protocols described herein and are readily used with other data communication protocols not specifically described herein.

In various embodiments, the components of the system and the system described in the previous figures (eg, the back neck electronics unit) are implemented in an integrated circuit device, which can include an integrated circuit package containing the integrated circuit. . In some embodiments, the components of the system and the system are implemented on a single integrated circuit die. In other embodiments, system components and systems are implemented on multiple integrated circuit dies of an integrated circuit device, which may include a multi-chip package containing integrated circuits.

In various embodiments, the descriptions of embodiments provided herein provide reconfigurable components for head-mounted devices. Reconfigurable components for head-mounted devices include, but are not limited to, removable temples, removable temple insertion modules (TIMs), back neck module assemblies, back neck module assemblies electronic pod ePOD, including a detachable electronic unit for the ePOD.

FIG. 16 shows a schematic block diagram of the system architecture, generally at 1600, according to an embodiment of the present invention. Referring to FIG. 16, embodiments of the present invention are used in system architectures customized for head-mounted devices, such as, but not limited to, smart head-mounted devices. glasses or other eye wear devices or head worn devices and the like. The system architecture described in conjunction with the following figures is used in combination with the reconfigurable components for head-mounted devices described above. Reconfigurable components for the above head-mounted devices include, but are not limited to, removable temples, removable temple insertion modules (TIMs), back neck module assemblies, back neck module assemblies, Including electronic pods ePOD for assembly and removable electronic units for ePODs.

Referring to FIG. 16, a mobile communication unit (MCU), an MCU comprising a digital signal processor (DSP) shown in various embodiments, is indicated at 1602 in FIG. System 1600, in various embodiments, includes one or more of the following sub-blocks.
・Central processing unit (CPU) + DSP chip 1634
- Voice Wake Up Chip 1608
Universal Serial Bus (USB) Type A magnetic pogo pin connector 1610 for battery charging and signal path to computer or mobile device
・Multi-function button 1614
A bicolor light source (e.g., red and blue) 1620, such as a light emitting diode (LED)
A stereo power amplifier 1630 for driving two speakers 1628
・Two microphones 1604/1606
・Sensor:
o touch sensor 1616
o proximity sensor 1618
o 6-axis sensor (3-axis accelerometer + 3-axis gyroscope) 1622
o 3-axis magnetometer 1620

In some embodiments, the core of the hardware architecture is a single chip with a CPU inside the device, a digital signal processor, and a Bluetooth RF module. The CPU and DSP (1634) can be separate chips or integrated into a single chip. In some embodiments, integrating the DSP into the CPU is employed to reduce costs. Note that the list of sub-blocks above is provided for illustrative purposes only, and that embodiments of the invention may include more or fewer sub-blocks than those listed above. want to be Interfaces such as General Purpose Input Output (GPIO), I Squared See (I2C), and Universal Asynchronous Transmit/Receive Circuit (UART) shown herein are provided as examples and limit embodiments of the present invention. not a thing Embodiments of the present invention are readily implemented using different interfaces and bus standards.

CPU tasks include task scheduling, GPIO control, sensor control data acquisition and manipulation, Bluetooth radio frequency (RF) management and power management. In various embodiments, the DSP handles signal processing tasks such as noise cancellation, acoustic echo cancellation, crosstalk correction, and all time consuming signal processing algorithms. A Bluetooth (BT) RF module 1632 handles the BT wireless communication protocol. In some embodiments, in addition to the Bluetooth module 1632, a cellular communication module is added to provide cellular communication directly from the system 1600 embedded in the head-mounted device. In another embodiment, Bluetooth module 1632 is replaced by a cellular communications module. Accordingly, system 1600 can comprise many different configurations of wireless communications. System 1600 can be configured with various sensors such as those listed below. Those skilled in the art will recognize that the system 1600 can be configured with more or fewer sensors than those shown in the list below.
• LED1620 - Via a GPIO output pin.
• Button 1614 - Via a GPIO input pin.
• Touch sensor 166 - via GPIO input and output pins.
• Voice Wake Up Chip 1608 - Via GPIO and UART.
• Proximity sensor 1618 - via the I2C bus.
• Microphones 1604/1606 & Speakers 1628 - via Analog-to-Digital Converters (ADC) 1640 and Digital-to-Analog Converters (DAC) 1636;
・6+3 axis sensor - Via I2C bus.

FIG. 17 shows a schematic block diagram of wake-up control, according to an embodiment of the present invention. Referring to FIG. 17, system 1702 enters sleep mode 1704 to conserve battery power. A voice wake up chip such as 1608 is used to detect a wake up word 1710 (eg "SOLOS" received on a microphone such as 1604 spoken by a user). If wake up word 1710 is detected at 1608 , the CPU/system is powered up and transitions to the “Run” state as indicated at 1706 .

The system 1700 , 1702 , or 1600 illustrated in conjunction with FIGS. 16 and 17 utilizes an embedded speech recognition system 1608 . Examples of embedded speech recognition systems for use in embodiments of the present invention are, but are not limited to, embedded speech recognition systems from NUANCE such as VoCon Hybrid or embedded speech recognition systems from other manufacturers. The NUANCE VoCon Hybrid data sheet is included herein as Appendix 1.

16 and 17, during operation, when idle, the system 1702 is in a "sleep" mode, but the DSP VoCon 1608 is always "on", thereby preventing noise from the connected microphone 1604. A wake up word 1710 can be detected via an input. When DSP VoCon system 1608 detects wake up word 1710 , wake up control signal 1714 is sent to transition system 1702 from “sleep” mode 1704 to “run” mode 1706 .

A built-in speech recognition system 1608 is used to process wake up words 1710 or to command and control the head-mounted device with commands extracted from the user's voice.

In various embodiments, the components of the system shown in Figures 16 and/or 17 are implemented in an integrated circuit device, which can include an integrated circuit package containing an integrated circuit. In some embodiments, the components of the system are implemented on a single integrated circuit die. In other embodiments, the components of the system are implemented on multiple integrated circuit dies of an integrated circuit device, which may include a multi-chip package containing integrated circuits.

In various embodiments, six (6) axis sensors indicated at 1624 and three (3) axis sensors indicated at 1622 are used to perform heading, tracking, and electronic compass functions. . In one embodiment, which is provided for illustrative purposes only and no limitation is implied thereby, the sensor captures the following 9-axis data (at a rate of 10 samples per second) and their The 9-axis data can be used by the mobile communication unit (MCU) 1602 to calculate the user's head movements. Nine (9) axis data includes, but is not limited to, acceleration data measured from accelerometers along the X, Y and Z axes; gyroscope data from the X, Y and Z axes; and magnetometer data from the Z axis. Those skilled in the art understand that the X, Y and Z axes refer to a Cartesian coordinate system. In some embodiments, those sensor data are used to track the trajectory of movement of the user wearing the head-mounted device.

FIG. 18 shows a state diagram of button actuation, generally at 1800, in accordance with an embodiment of the present invention. Buttons such as 1614 in FIG. 16 are designed to support multi-purpose functions. Descriptions of functions supported by a single button, touch slider, and proximity sensor in one or more embodiments are provided by way of example. Buttons, touch sensors, and proximity sensors can serve other functions. Different numbers of buttons, sliders, and sensors may also be provided in various embodiments to provide the required functionality for a given head-mounted device. The functions and state diagrams presented herein are provided merely as examples and are not limiting of embodiments of the present invention. The power on/off function 1802/1804 is illustrated as follows.

a) at 1802 by briefly pressing the "power button" for a predetermined time (in one or more embodiments, the predetermined time is two (2) seconds) until the "on" indicator light is activated; Enter the power "on" state. In one or more embodiments, the "on" indicator light is a blue light. In the "on" state 1082, the user can ask the system for the battery power level by voice command. For example, the system can be configured to return battery power levels quantized to various granularities. An example is quantization into three (3) battery power levels: low, medium, and high. Other quantizations are possible, and the example of using three battery power levels is provided merely for illustration and no limitation is implied thereby. Alternatively, the system may be configured to notify the user of the current battery power level via an audible voice message generated by the machine.

b) at 1804 by pressing and holding the "power button" for a predetermined time (in one or more embodiments, the predetermined time is three (3) seconds) until the "off" indicator light is activated; enter the power “off” state. In one or more embodiments, the "off" indicator light is a red light. The system may be configured to notify the user, via an audible machine-generated voice message, that the system is powering down to enter the "off" state.

Pairing/unpairing functions 1806/1807 with devices such as mobile phones are shown below.
i. "Pair" the system and the mobile device by pressing the "power button" longer than required to transition to the off state. Five seconds, provided here for purposes of example, is a reasonable amount of time to set up the system for "pairing," and five seconds is the time required to transition the system to the off state (2 seconds). Thus, in operation, the user presses the "power button" until the blue and red lights alternately flash, thereby pairing the system with the mobile device, as indicated at 1806 . After pairing, the system notifies the user that the pairing was successful by playing a machine-generated voice prompt. At 1807, pressing power for longer than required for pairing can transition the system to the "unpaired" state. Therefore, at 1807, the system can transition to the "unpaired" state in eight (8) seconds. Different times can be selected, and those predetermined times provided herein are provided merely as examples and are not intended to limit embodiments of the present invention.
ii. After successful pairing, the user plays music at 1808 and makes a call at 1810 utilizing the wireless connection between the head-worn device and the mobile phone or MCU (commonly referred to as the device). be able to. If the connection fails, head-worn devices such as smart glasses will automatically turn off after a preset time. In one embodiment, that preset time, provided merely as an example, is three (3) minutes.
iii. When the smart glasses are playing music at 1808, a short button press advances to the next song at 1812. iii. In one embodiment, for illustrative purposes only, there is no limitation implied by this, and the short button press time to advance to the next song is less than two (2) seconds.
iv. If there is an incoming call while the music is playing or in the idle state, pressing the button briefly for less than a predetermined time will answer the incoming call at 1814 . For illustration purposes, there is no limitation implied by this, and the predetermined time for a short button press is less than 2 seconds. If the user presses the button for longer than the predetermined time, the call is rejected at 1816 .

FIG. 19 illustrates, generally at 1900, a state diagram for touch sensor operation, according to an embodiment of the present invention. In one or more embodiments, the touch sensor is configured to provide simultaneous "slider" and "tap" functionality. An example of a touch sensor is 1616 in FIG.

In one or more embodiments, provided by way of example only and no limitation is implied thereby, the touch sensor supports two functions such as a touch slider, single-tap and double-tap operations. . In other embodiments, the touch sensor may be configured to support more or fewer functions than those of the sensors described herein. Referring to FIG. 19, a state diagram corresponding to touch sensor manipulation is shown. A volume control with a slider 1930 is configured on the eyeglass device 1940 . Slider 1930 is configured to accept a "slide" input registered by a user sliding a finger along the sensor area. In this example, the volume control has eight levels (level 1...level 8). Giving a "rapid slide" to the touch slider increases or decreases the volume by one level depending on the direction of the "rapid slide". For example, if the current volume is level 3, sliding forward quickly 1952/1954 will increase the volume 1904 and change the volume from level 3 to level 4. 1 represents minimum volume and 8 represents maximum volume. Similarly, sliding back quickly from level 3 decreases the volume 1906, thereby changing the volume from level 3 to level 2.

A "gradual slide" as applied by the user to the touch slider means a continuous increase or decrease in volume. For example, if the current volume is level 3, sliding forward slowly to the edge of the touch sensor area increases the volume 1904 and changes the volume from level 1 to level 8. Slowly sliding forward to the center of the touch sensor area increases the volume 1904 and changes the volume from level 1 to level 4.

If the current volume is level 4, then slowly sliding back 1962/1964 to the edge of the touch sensor area will decrease the volume 1906 and change the volume from level 4 to level 1.

From the incoming call state 1920, slide forward 1952/1954 and at 1924 answer the incoming call. From the call incoming state 1920, slide backward 1962/1964 and at 1922 reject the incoming call.

A double tap performed by the user on the touch slider area 1930 of the smart glasses 1940 is used to activate or disable the wake up chip. In one or more embodiments, a double tap applied to the touch slider area changes the voice wake up to the "on" state 1910 when the voice wake up is in the "off" state. Similarly, if voice wake up is in the “on” state 1910 , a double tap applied to the touch slider area changes voice wake up to the “off” state 1902 .

In various embodiments, a single tap is used to play music by transitioning the system to the music "playing" state 1902, or to enter the music "pause" state 1908, where the "pause" In state 1908, music playback is paused while waiting for further input from the user. If in the "pause" state, a subsequent single tap from the user returns control to the "play" state and resumes playing music at 1902 . Additional state changes are accomplished with subsequent single taps to transition from "play" to "pause" or vice versa as needed.

FIG. 20 shows a state diagram of proximity sensor operation, generally at 2000, in accordance with an embodiment of the present invention. In various embodiments, a proximity sensor (eg, 1618 in FIG. 16) is used to detect if the user is wearing a head-mounted device or if the user has removed the head-mounted device (glasses). used for In one example, for illustrative purposes only, and with no limitation implied by this, the logic of sensor operation proceeds as follows. If the output of the proximity sensor is "1", it means that the user is wearing glasses 2002 . If the output of the proximity sensor is '0', it means that the user has removed the glasses 2004 .

The logic is configured to turn "off" music playback when the user removes the glasses from the user's head. For example, if the user is wearing glasses 2002, music is "played" 2006, controlled by any of the sensors described above that control the music playback function. If the user removes the glasses 2004, the proximity sensor will output a '0', and if the '0' output continues for more than a predetermined time, the music will be 'stopped' and the system will be in a 'pause' state for music playback. It will be 2008. In one or more embodiments, the predetermined amount of time required to stop playing music is five (5) seconds. If the user puts on the glasses again, the music returns to the "playing" state at 2006, in which case the output of the proximity sensor changes to "1".

If the glasses are away from the user's head for more than a predetermined amount of time, the system powers down and enters the 'off' state at 2010 . In one or more embodiments, if the user is not wearing eyeglasses, the predetermined amount of time required to power off the system is 10 seconds or longer. Those skilled in the art will recognize that the above predetermined times are examples and that different predetermined times can be used in various embodiments. The times chosen for the examples provided herein are not meant to be limiting.

Figures 21A-21D show the location of the touch sensors and the multi-function button. Referring to FIG. 21A, the eyeglass device is shown at 2102 in rear-facing perspective. A multifunction button 2106 is shown located below the right temple 2108 . Touch sensor area 2104 is shown located on the outer surface of right temple 2108 . Both multi-function button 2106 and touch sensor area 2104 provide functionality as described in conjunction with the above figures.

Referring to FIG. 21B, an eyeglass device 2252 is indicated at 2200 in front perspective view and at 2275 in side view. A multifunction button 2276 is shown located under the right temple 2278 of the eyeglass device 2252 . Touch sensor area 2254 is shown located on the outer surface of right temple 2278 . Both multi-function button 2276 and touch sensor area 2254 provide functionality as described in conjunction with the figures above.

Referring to FIG. 21C, the eyeglass device is shown at 2300 in side view. Touch sensor area 2304 is shown as a rectangular area outside right temple 2378 . It should also be noted that the touch sensor area 2304 can be provided in shapes other than rectangular. The shape of rectangle 2304 is provided for illustration only and no limitation is implied thereby. The user utilizes finger 2306 to slide forward or backward as described in conjunction with the previous figure above to control volume and initiate tapping as described above.

Referring to FIG. 21D, eyeglass device 2402 is shown at 2400 in side view. A multi-function button 2404 is shown located below the right temple 2478 . The user presses button 2404 using finger 2406 as described in conjunction with the previous figure above to control the functionality of the eyewear system at 2402 .

It should also be noted that the multi-function button and/or touch sensor area may be located at other locations on the head-mounted device, such as, for example, the outer surface of the temple, the top surface of the temple, or the left temple.

For example, in one or more embodiments, the multifunction button is located on the top surface of the right temple. In use, the user grasps the right temple with two fingers, one finger resting on the bottom surface of the temple and the other finger resting on the top surface of the temple. For example, in one scenario, the user places the right thumb on the underside of the right temple and the right middle finger on the top surface of the right temple, thereby grasping the right temple. The user can use the index finger of the right hand to operate the multifunction button. The multi-function buttons so arranged are located behind the plane of the front frame so that when the temples are grasped as described above, the buttons are aligned with and operated by the user's index finger. obtain.

In various embodiments, such placement of the multifunction button is easier to operate when the user is operating the multifunction button while the user is engaged in an activity such as riding a bicycle.

In some embodiments, protrusions, indentations, or other shaped alignment marks were formed in the temples to serve as alignment points for one or more of the user's fingers relative to the location of the multi-function button. Placing the multifunction button at a specified distance from the aligned position allows the user to quickly locate the multifunction button when the glasses are on the user's head. In some embodiments, alignment is provided when the user grasps the temple with the thumb and middle finger at the junction of the temple and the front frame.

Although the multifunction button is shown located on the right temple, the multifunction button can also be located on the left temple of the eyewear device. A left-handed user may prefer to place the multi-function button and touch sensor on the left temple, while a right-handed user may prefer to place the multi-function button and touch sensor on the right temple. do not have. Accordingly, embodiments of the present invention are configured into any of the button/temple configurations.

Pose Detection In various embodiments, the hardware architecture includes touch sensors and multi-axis motion sensors as described above. In some embodiments, a nine (9) axis motion sensor is used. Sensor data is used to detect various head poses. Once the head pose is detected, the system performs the corresponding action. In one example, when a call comes in, the user can nod in one direction, such as up or down, to answer the call. Similarly, a left-to-right or right-to-left shake is interpreted by the system as rejecting the call. For example, when a phone call comes in, the user can answer the call by placing a finger on the touch sensor and nodding downward. Or, placing a finger on the touch sensor, the user rejects the call by shaking his or her head.

In some embodiments, multi-axis sensors are used for user pose detection. In various embodiments, the sensors collect and pass accelerometer, gyroscope, and magnetometer data to the system, which, as described in conjunction with the figures above, uses the central processing unit (CPU). , DSP, etc., to process those data. In some embodiments, the sensor is configured with three orthogonal axes. To detect the user's head pose, those data are processed using one or more of the following. Software algorithms, CPU and DSP. In various embodiments, if the user's head has not been in the proper position for too long, a voice message is generated and broadcast to the user via the speaker. For example, such a message to the user allows the user to take corrective action and improve their posture.

Audio Content As noted above, in various embodiments, head-worn devices (eyeglasses devices) are combined with mobile devices to facilitate phone calls with systems configured on the head-worn device. used. Content such as music can be streamed to the head-worn device via the mobile device. The content stream can also originate from the "cloud", ie the Internet, or a local network and be streamed to the head-worn device. Additionally, the local storage provided with the system (Fig. 16) or configured in the head-mounted device for use by the system (Fig. 16) may be incorporated into the head-mounted device. It can be used to provide a source of content to play to the user via speakers. Thus, in various embodiments, content is played to a user via a head-mounted device in combination with a mobile device, or the sole placement of the head-mounted device without the mobile device.

Answering Phone Calls In various embodiments, a phone call can be answered using a variety of methods. Calls can be answered and/or ended by a voice interface, which utilizes a local voice recognition system to receive calls using control words such as "ANSWER" and For example, use a control word to end a call. Alternatively, one or more of the physical sensors such as "touch sensors" and/or "buttons" may be used to answer the call. Alternatively, you can answer a call by analyzing your head posture using data output from accelerometers, gyroscopes, and the like. Note that one or more of the above (ie, speech recognition, sensor output, and pose identification) can be combined to answer a call. Similarly, one or more of the above may be combined to provide a user with selection and/or playback of audio content via systems embedded in head-mounted devices.

Command and Control System Control--A wake up word is used to wake up the system from a sleep state, for example, using a wake up word such as "SOLOS". Content Controls - "Play Running Music", "Skip Song", "Volume Up", "Volume Down", etc. Phone controls—eg, "Call 'name'" (the phone number corresponding to 'name' can be selected from, eg, Contacts), 'Volume up', 'Volume down'. Information control - for example, "browse the internet", check "temperature", check "weather", "navigation", etc. These examples are provided for illustration only and do not limit embodiments of the invention.

Magnetometer In various embodiments, a magnetometer was incorporated into a head-mounted device. In some embodiments, the magnetometer is a 3-axis magnetometer. Magnetometers in head-mounted devices are used for navigation, thereby ascertaining the user's orientation with respect to the earth's magnetic field. A magnetometer attached to a head-mounted device has a fixed pointing direction that aligns with the user's movements when worn by the user. Therefore, the output of a magnetometer from a head-worn device is a more useful signal than a magnetometer that can be built into a user's mobile phone, since the user's mobile phone is not necessarily aligned with the direction the user is pointing. I will provide a.

In various embodiments, for example, the output of a magnetometer is used within an application program that utilizes a map to display the user's orientation and a digital map as the user changes north. - Rotate the map.

Accelerometers In various embodiments, one or more accelerometers are provided in the head-mounted device. In some embodiments, a 3-axis accelerometer is provided.

Gyroscopes In various embodiments, one or more gyroscopes are provided in the head-mounted device. In some embodiments, a 3-axis gyroscope is provided.

Batteries Housed in One or More Temples In various embodiments, one or more batteries provided to power the system are housed within the volume of one or more temples. Batteries are composed of chemistries such as lithium-ion or other battery chemistries that support long life and allow many recharge cycles over the life of the battery. Several different sizes of temples can be provided for different applications, depending on the expected power required for the head-mounted device. For example, at some sporting events, the system may require more than 6 hours of "on" time. In such cases, the large temple houses a long-life battery. Temples with a smaller volume accommodate smaller batteries that have a shorter useful life between charge cycles. Head-mounted devices are configured for a variety of uses, such as sporting activities, business uses, home use, and commercial use. Some non-limiting examples of sports activities include, but are not limited to, bicycling, running, skiing, boating, hiking, and the like.

Distribution of the System Across the Head-Worn Device In one or more embodiments, the electronic system of the head-mounted device is distributed in the left temple, the front frame, and the right temple. In one or more embodiments, the left temple houses a battery, one or more microphones, and at least one speaker. The right temple houses the battery, system electronics, one or more microphones, and at least one speaker. In some embodiments, electrical connections between system components (temples and front frame) are provided in the form of removable connectors. In some embodiments, those connectors can be hinged.

For the purposes of discussing and understanding the different embodiments, it should be understood that various terms are used by those skilled in the art to describe techniques and approaches. Moreover, in the course of the description, numerous specific details are set forth for purposes of explanation to provide a thorough understanding of the embodiments. However, it will be apparent to one skilled in the art that the embodiments may be practiced without these specific details. In some embodiments, well-known structures and devices are shown in block diagram form, rather than in detail, in order to avoid obscurity. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention, and without departing from the scope of the invention by using other embodiments, the logical, mechanical, electrical, etc. , and other changes may be made.

Some portions of the descriptions may be presented in terms of algorithms and symbolic representations of operations on data bits, etc. within a computer memory. These algorithmic descriptions and representations are the means used by those skilled in the data processing arts to most effectively convey the substance of their work to others skilled in the art. Algorithms there are generally thought of as self-consistent sequences of actions leading to a desired outcome. Those acts are those requiring physical manipulations of physical quantities. Usually, though not necessarily, these quantities take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated. It has proven convenient at times, principally for reasons of common usage, to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, or the like.

Note, however, that all of these and similar terms are associated with appropriate physical quantities and are merely convenient labels applied to those quantities. Unless otherwise stated, it is clear from the discussion that throughout the description discussion using terms such as "processing" or "computing" or "calculating" or "determining" or "displaying" refers to computer systems or similar It can refer to the operations and processes of an electronic computing device, which computer system or similar electronic computing device processes data represented as physical (electronic) quantities in the computer system's registers and memory. Manipulate and transform into other data represented as physical (electronic) quantities within the memory or registers of a computer system or other such information storage, transmission, or display device.

Any device that performs the operations therein may implement the present invention. This apparatus may be specially constructed for the required purposes, or it may comprise a general purpose computer selectively activated or reconfigured by a computer program stored in the computer. A computer program can be stored on a computer-readable storage medium. Such computer readable storage media include, but are not limited to, floppy disks, hard disks, optical disks, compact disk read-only memories (CD-ROMs), magnetic disks, read-only memory (ROMs), random access memories (RAMs), dynamic random access memories (DRAM), electrically programmable read-only memories (EPROMs), electrically erasable programmable read-only memories ( Any type of disk including EEPROMs), flash memory, magnetic or optical cards, RAID, etc., or any type of media adapted for the storage of electronic instructions either local to the computer or remote to the computer.

The algorithms and displays presented herein are not inherently related to any particular computer or other apparatus. Various general-purpose systems may be used with the programs, or it may prove convenient to construct a more specialized apparatus to perform the required method in accordance with the teachings herein. For example, any of the methods according to the embodiments can be implemented by hardware circuitry obtained by programming a general-purpose processor, or any combination of hardware and software. Those skilled in the art will appreciate that embodiments are handheld devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, digital signal processing (DSP) devices, set top boxes, network PCs, minicomputers, main It will be readily appreciated that it can be implemented with other computer system configurations than those described, such as frame computers. The embodiments may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network.

The methods herein can be implemented using computer software. Instructions designed to implement those methods, when written in a programming language that conforms to a recognized standard, to run on a variety of hardware platforms and to interface with a variety of operating systems Sequences can be compiled. Additionally, the embodiments are not described with reference to any particular programming language. It should be appreciated that a variety of programming languages may be used to implement the teachings of the embodiments described herein. Further, in the art, software in one form or another (eg, programs, procedures, applications, drivers, etc.) is generally referred to as performing some action or causing some result. Such expressions are simply shorthand for how a computer's processor performs an action or produces a result by executing the software on the computer.

It should be appreciated that those of ordinary skill in the art use various terms and techniques to describe communications, protocols, applications, implementations, mechanisms, and the like. One such technique is to describe the implementation of the technique in terms of algorithms or formulas. That is, although techniques may be implemented, for example, as executing computer code, representations of the techniques may more appropriately and concisely be conveyed and conveyed as formulas, algorithms, or mathematical formulas. Thus, those skilled in the art will appreciate that the hardware and/or software implementation of representing A+B=C as an addition function block is to take two inputs (A and B) and produce a summation output (C). can recognize Accordingly, the use of any formula, algorithm, or mathematical formula as an illustration does not imply any physical should be understood as having a generic expression.

A non-transitory machine-readable medium is understood to include any mechanism for storing information (such as program code) in a form readable by a machine (eg, a computer). For example, machine-readable media, interchangeably referred to as computer-readable media, include read-only memory (ROM), random-access memory (RAM), magnetic disk storage media, optical storage media, flash memory devices, and propagated signals ( For example, electrical, optical, acoustic, or other forms of information transmission via carrier waves, infrared signals, digital signals, etc.).

As used in this description, "an embodiment" or "embodiment" or similar phrases mean that the feature being described is included in at least one embodiment of the invention. References to "one embodiment" in this description do not necessarily refer to the same embodiment. However, those embodiments are not mutually exclusive. Also, "one embodiment" does not imply a single embodiment of the invention. For example, features, configurations, acts, etc. described in "one embodiment" may also be included in other embodiments. Accordingly, the invention can include various combinations and/or integrations of the embodiments described herein.

Although the present invention has been described in several embodiments, those skilled in the art will appreciate that the invention is not limited to the described embodiments, but can be practiced with modification and alteration within the spirit and scope of the appended claims. It can be understood. Accordingly, the description should be regarded as illustrative rather than restrictive.

FIG. 4 shows another modular reconfigurable eyewear system according to an embodiment of the invention. Referring to FIG. 4, one or more of the sensors, power components, and computing units are distributed throughout the eyewear device, including distributed throughout a frame chassis such as 402 . Frame chassis 402 is ophthalmically configured to surround lens 440 with a frame rim, thereby securing lens 440 thereto. Left temple 404 and right temple 414 are coupled to frame chassis 402 to form an eyeglass device. Left lens 404 is configured to have an engaging portion indicated at 408 . Left temple insertion module (TIM) 406 is configured to engage engagement portion 408 as described above, thereby providing both mechanical and electrical connection between TIM 406 and temple 404. . Similarly, right temple 426 is shown engaged with the engagement portion of right temple 414 . TIM 406 includes audio speakers and audio ports indicated at 410 and TIM 426 includes audio speakers and audio ports indicated at 430 . In various embodiments, audio speakers 410 and 430 are projection speakers. The eyewear device includes several sensors or displays, 462, 464, 466, 468, and 470, which extend from the left temple 404 through the frame chassis 402 to the right temple 414 integrated into the electrical pathway. In various embodiments, there may be more or fewer sensors than shown in FIG. The sensors and sensor locations shown in FIG. 4 are provided merely as examples and are not limiting embodiments of the present invention. As described above in conjunction with previous figures, at least one of temple insertion modules 406 and/or 426 includes the necessary set of electronics to provide wireless connection 222 to device 220. .

CPU tasks include task scheduling, GPIO control, sensor control data acquisition and manipulation, Bluetooth® radio frequency (RF) management and power management. In various embodiments, the DSP handles signal processing tasks such as noise cancellation, acoustic echo cancellation, crosstalk correction, and all time consuming signal processing algorithms. A Bluetooth (BT) RF module 1632 handles the BT wireless communication protocol. In some embodiments, in addition to the Bluetooth module 1632, a cellular communication module is added to provide cellular communication directly from the system 1600 embedded in the head-mounted device. In another embodiment, Bluetooth module 1632 is replaced by a cellular communications module. Accordingly, system 1600 can comprise many different configurations of wireless communications. System 1600 can be configured with various sensors such as those listed below. Those skilled in the art will recognize that the system 1600 can be configured with more or fewer sensors than those shown in the list below.
• LED1620 - Via a GPIO output pin.
• Button 1614 - Via a GPIO input pin.
• Touch sensor 1616 - via GPIO input and output pins.
• Voice Wake Up Chip 1608 - Via GPIO and UART.
• Proximity sensor 1618 - via the I2C bus.
• Microphones 1604/1606 & Speakers 1628 - via Analog-to-Digital Converters (ADC) 1640 and Digital-to-Analog Converters (DAC) 1636;
・6+3 axis sensor - Via I2C bus.

Pairing/unpairing functions 1806/1807 with devices such as mobile phones are shown below.
i. "Pair" the system and the mobile device by pressing the "power button" longer than required to transition to the off state. Five seconds, provided here for purposes of example, is a reasonable amount of time to set up the system for "pairing," and five seconds is the time required to transition the system to the off state (2 seconds). Thus, in operation, the user presses the "power button" until the blue and red lights alternately flash, thereby pairing the system with the mobile device, as indicated at 1806 . After pairing, the system notifies the user that the pairing was successful by playing a machine-generated voice prompt. At 1807, pressing the power button for longer than required for pairing can transition the system to the "unpaired" state. Therefore, at 1807, the system can transition to the "unpaired" state in eight (8) seconds. Different times can be selected, and those predetermined times provided herein are provided merely as examples and are not intended to limit embodiments of the present invention.
ii. After successful pairing, the user plays music at 1808 and makes a call at 1810 utilizing the wireless connection between the head-worn device and the mobile phone or MCU (commonly referred to as the device). be able to. If the connection fails, head-worn devices such as smart glasses will automatically turn off after a preset time. In one embodiment, that preset time, provided merely as an example, is three (3) minutes.
iii. When the smart glasses are playing music at 1808, a short button press advances to the next song at 1812. iii. In one embodiment, for illustrative purposes only, there is no limitation implied by this, and the short button press time to advance to the next song is less than two (2) seconds.
iv. If there is an incoming call while the music is playing or in the idle state, pressing the button briefly for less than a predetermined time will answer the incoming call at 1814 . For illustration purposes, there is no limitation implied by this, and the predetermined time for a short button press is less than 2 seconds. If the user presses the button for longer than the predetermined time, the call is rejected at 1816 .

Claims (24)

A reconfigurable component for use in an eyeglass device comprising:
an embedded electronic system configured for wireless communication and processing of sensor signals and incorporated in a component of the eyewear device;
a plurality of sensors embedded in one or more of the reconfigurable component and the eyeglass device and in electrical communication with the embedded electronic system;
the embedded electronic system further comprising a processor;
A reconfigurable component, wherein the processor is configured to receive outputs from the plurality of sensors and to determine system control parameters from outputs of at least one of the plurality of sensors. 2. The processor of claim 1, wherein the processor extracts user head movement data from the plurality of sensors, and wherein the user head movement data is used by the system as a system control parameter. Reconfigurable component. 3. A reconfigurable component as recited in claim 2, wherein the system control parameter is used to answer an incoming call. 3. A reconfigurable component as recited in claim 2, wherein the system control parameter is used to reject incoming calls. 3. A reconfigurable component as recited in claim 2, wherein the system control parameter is used to control playback of music. 3. The reconfigurable component of claim 2, wherein at least one sensor is an accelerometer, at least one sensor is a gyroscope, and at least one sensor is a magnetometer. The plurality of sensors are
a sensor configured to measure acceleration along three mutually orthogonal axes X, Y, and Z;
a sensor configured for gyroscope output along three mutually orthogonal axes X, Y, and Z;
7. The reconfigurable component of claim 6, further comprising a sensor configured for magnetometer output along three mutually orthogonal axes X, Y, and Z. said embedded electronic system further comprising an embedded speech recognition system;
The embedded speech recognition system is configured to receive an audio signal from a microphone and transition the embedded electronic system to a run state if a wake up word is detected. The reconfigurable component of clause 1. The embedded speech recognition system is configured to receive audio signals from the microphone and the processor to facilitate operation of wireless voice communication when a command is identified by the embedded speech recognition system. 9. A reconfigurable component according to claim 8, characterized by: wherein the embedded speech recognition system is configured to receive an audio signal from the microphone to facilitate manipulation of content control when a command is identified by the embedded speech recognition system. 9. A reconfigurable component as claimed in claim 8. wherein the embedded speech recognition system is configured to receive an audio signal from the microphone to facilitate manipulation of information control when a command is identified by the embedded speech recognition system. 9. A reconfigurable component as claimed in claim 8. A reconfigurable component for use in an eyeglass device comprising:
contains a temple insertion module,
the temple insertion module is removably coupled to a temple engagement portion, the temple configured for use with the ophthalmic device;
The temple insertion module comprises:
an embedded electronic system configured for wireless communication and processing of sensor signals and incorporated in a component of the eyewear device;
a plurality of sensors embedded in one or more of the temple insertion module, the temples and the ophthalmic device and in electrical communication with the embedded electronic system;
the embedded electronic system further comprising a processor;
A reconfigurable component, wherein the processor is configured to receive outputs from the plurality of sensors and to determine system control parameters from outputs of at least one of the plurality of sensors. further including a multi-function button,
the processor is configured to receive a signal from the multifunction button;
the processor is configured to determine a length of time that the multifunction button is pressed by a user;
The length of time is determined by the processor to:
a.) pairing the mobile device;
b.) unpairing the mobile device;
c.) playing the content;
d.) selecting the next song;
e.) making phone calls;
13. The reconfigurable component of claim 12, wherein the reconfigurable component is used to initiate one or more of: d.) answering a call; and e.) rejecting a call. further comprising a touch sensor;
the processor configured to receive a signal from the touch sensor;
the processor is configured to process a tap input from a user to the touch-sensitive surface or a slide input from the user to the touch-sensitive surface;
the processor is configured to initiate one or more tap actions after receiving a tap input;
The tap action is
a.) playing the content;
b.) pausing playback of content; and c.) voice-controlled audio input;
The processor is configured to initiate one or more of the following slide actions after receiving slide input from a user:
The slide action is
d.) answering incoming calls;
e.) rejecting incoming calls;
13. The reconfigurable component of claim 12, comprising: f.) lowering the volume; and g.) increasing the volume. 15. The reconfigurable component of claim 14, wherein a tap input that toggles between playing content and pausing content is a single tap input. 15. The reconfigurable component of claim 14, wherein the tap input that initiates voice control is a double tap input. 15. The reconfigurable component of claim 14, wherein a short slide input yields more incremental changes in volume. 15. The reconfigurable component of claim 14, wherein a long slide input obtains a more continuous change in volume. further comprising a proximity sensor;
the processor configured to receive a signal from the proximity sensor;
The processor is configured to confirm the presence of a user by the output of the proximity sensor and perform an action;
Said action is
a.) when the user removes the eyeglass device from the user's head, pausing content playback;
b.) when the user puts the eyeglass device back on the user's head, resumes playing content;
c.) turning off playback of content after a first predetermined time while the eyeglass device is away from the user's head; and d.) while the eyeglass device is away from the user's head. 13. The reconfigurable component of claim 12, wherein the reconfigurable component of claim 12 is one of: , turning off the eyewear device when the time reaches a second predetermined time. A method of providing information to a user via an eyeglass device, comprising:
receiving outputs from a plurality of sensors with a processor contained within the temple insertion module;
determining a system control parameter using at least one output from the plurality of sensors;
using the system control parameters to control at least one function of the eyewear device;
the temple insertion module is contained within a temple of the eyewear device;
The method, wherein the plurality of sensors are configured using the eyeglass device. one of the plurality of sensors being a button, the processor configured to associate a length of time the button is pressed by a user with a system action;
The system action is
pairing with mobile devices,
unpairing from your mobile device,
playback of content,
Select next song,
make a call,
21. The method of claim 20, wherein one or more of answering the call and rejecting the call. one of the plurality of sensors is a touch sensor, the processor is configured to receive a signal from the touch sensor;
the processor is configured to process a tap input from a user to the touch-sensitive surface or a slide input from the user to the touch-sensitive surface;
the processor is configured to initiate one or more tap actions after receiving a tap input;
The tap action is
pairing with a mobile device; and
and unpairing from the mobile device. the processor is configured to initiate one or more tap actions after receiving a slide input to the touch-sensitive surface;
The tap action is
to answer incoming calls,
rejecting incoming calls,
23. The method of claim 22, comprising: reducing the volume of audio broadcasts from the eyeglass device; and increasing the volume of audio broadcasts from the eyeglass device. one of the plurality of sensors is a proximity sensor;
the processor is configured to receive a signal from the proximity sensor, confirm the presence of a user with the signal, and perform an action;
Said action is
pausing playback of content when the user removes the eyeglass device from the user's head;
resuming playback of content when the user places the eyeglass device back on the user's head;
turning off playback of content after a first predetermined time while the eyeglass device is away from the user's head; and 21. The method of claim 20, further comprising turning off the eyewear device after two predetermined times.

Images