WO2019108980A1 - Interactive smart glasses for diverse environments - Google Patents

Abstract

A smart glasses device can include a frame, a first arm, and a second arm, each arm comprising a respective hinge, temple, and tip, wherein the first arm connects with a first end of the frame by the first hinge and the second arm connects with a second end of the frame via the second hinge. A camera can be mounted in the frame and facing in a direction corresponding to a user's line of sight when worn, and a controller mounted in the first arm for processing visual data received from the camera. For connecting the camera with the controller, a data cable can be passed through an internal cavity in the hinge sized to allow the cable to collapse or expand within the cavity when the glasses are opened for wearing or folded for storage without straining a connection between the first data cable and the controller. The glasses can include a counterweight for balancing the first and second arms of the glasses to improve wearability.

Description

INTERACTIVE SMART GLASSES FOR DIVERSE ENVIRONMENTS

CROSS-REFERENCES TO RELATED APPLICATIONS

[0001] This PCT International Application claims priority to U.S. Provisional Application

No. 62/593,194, filed November 30, 2017, and also claims priority to U.S. Provisional Application No. 62/593,200, which was filed on November 30, 2017. The disclosures of the aforementioned applications, in their entirety, are hereby incorporated by reference.

BACKGROUND OF THE DISCLOSURE

[0002] Visually and/or audibly impaired persons may be in search of solutions to improve their independence in performing daily tasks. They may wish to overcome stereotypes that blind or visually impaired people are incompetent and reliant on others. Integrated solutions that help impaired users with simple tasks (such as finding the nearest restroom or walking around a neighborhood) as well complex tasks (such as travelling alone using public transportation) may provide impaired users with the independence they seek. Solutions that work for impaired users may also have more general applicability to assist users in other situations.

[0003] One such solution is the use of media streaming wearable devices from a user to a service that interprets and relays instructions, as described in U.S. Patent Pub. No. 2016-0063893 to MEDIA STREAMING METHODS, APPARATUS AND SYSTEMS, which is hereby incorporated by reference for all purposes, and which describes the use of a client-wearable device having a form factor similar to eye glasses and employing a video capture device. However, existing devices with this form factor have several limiting disadvantages including, but not limited to: limited comfort and balance due to the bulk and placement of hardware, limited compatibility with secondary wearable devices such as earpieces and the like, and fragility with respect to environmental factors. Accordingly, improvements in wearable technology are needed before such devices can become practical for widespread use.

BRIEF SUMMARY OF SOME EXAMPLE EMBODIMENTS

[0004] At least one embodiment herein described relates generally to a glasses device employing a balanced construction, in which a camera is positioned within the front portion of the glasses frame, and in which a driving electronic controller of the device is positioned along one arm. In some cases, the driving electronic controller of the device is positioned along the one arm opposite a balancing counterweight in the opposite arm. For instance, the smart glasses device is balanced across a centerline passing parallel and equidistant to the two arms when the smart glasses device is in an open configuration. In some embodiments, the smart glasses device has a center of gravity occurring between the two arms and behind the frame when the glasses are in an open configuration.

[0005] In at least one embodiment, the smart glasses device employs a protective hinge having an internal housing through which electronic cabling is routed from the driving electronics in one arm to the camera in the front portion of the frame. In some embodiments, this hinge includes a protective internal housing positioned proximate an axis of the hinge and defining an internal cavity sized to contain a portion of the first data cable, such that the first data cable can collapse into a compressed state within the cavity when the glasses are opened for wearing, and can expand into an extended state when the glasses are folded for storage. The data cable can run through the frame from a first end to a second end of the frame to promote balance, to provide connection points in the event that electronics are placed in the opposite arm rather than the first arm, and/or to provide dual connection points in the event electronics are placed in both arms.

[0006] In some embodiments, the counterweight opposite the main control element of the device can be replaced with various electronics including, but not limited to: a secondary controller including processing and memory, which can perform similar tasks as the primary controller; a battery element for powering the camera and/or controller; or some combination of both.

[0007] In various embodiments, the smart glasses device is arranged in a minimalist or low-profile configuration allowing for improved wearability. For example, in some embodiments, the smart glasses device includes a shaped frame having a minimalist cross section enabled by the flexible circuitry of the data cable running to the camera. Furthermore, the camera, when center- mounted within the bridge, can be larger than conventional wearable cameras. For example, in some embodiments, the camera can include a lens with an operational field of view of at least 120°. This camera can further include a raised lens edge arranged to match the elevation of the lens with an elevation of the bridge of the frame, so that even a relatively large camera is inconspicuous. The low-profile configuration can further include an input/output (IO) data cable routed through a temple of one of the device arms from the controller to an arm tip. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The present disclosure will be better understood in view of the appended non limiting figures, in which:

[0009] FIG. 1 is a cutaway perspective view illustrating an example pair of smart glasses, in accordance with at least one embodiment of the present disclosure; and

[0010] FIG. 2 is a partial cutaway view of the pair of smart glasses shown in FIG. 1, with a focus on a hinge element thereof.

DETAIFED DESCRIPTION

[0011] Certain aspects and embodiments of this disclosure are provided below. Some of these aspects and embodiments may be applied independently and some of them may be applied in combination as would be apparent to those of skill in the art. In the following description, for the purposes of explanation, specific details are set forth in order to provide a thorough understanding of embodiments of the invention. However, it will be apparent that various embodiments may be practiced without these specific details. The figures and description are not intended to be restrictive.

[0012] The ensuing description provides exemplary embodiments only, and is not intended to limit the scope, applicability, or configuration of the disclosure. Rather, the ensuing description of the exemplary embodiments will provide those skilled in the art with an enabling description for implementing an exemplary embodiment. It should be understood that various changes may be made in the function and arrangement of elements without departing from the spirit and scope of the invention as set forth in the appended claims.

[0013] Specific details are given in the following description to provide a thorough understanding of the embodiments. However, it will be understood by one of ordinary skill in the art that the embodiments may be practiced without these specific details. For example, circuits, systems, networks, processes, and other components may be shown as components in block diagram form in order not to obscure the embodiments in unnecessary detail. In other instances, well-known circuits, processes, algorithms, structures, and techniques may be shown without unnecessary detail in order to avoid obscuring the embodiments.

[0014] Also, it is noted that individual embodiments may be described as a process which is depicted as a flowchart, a flow diagram, a data flow diagram, a structure diagram, or a block diagram. Although a flowchart may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations may be re-arranged. A process is terminated when its operations are completed, but could have additional steps not included in a figure. A process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc. When a process corresponds to a function, its termination can correspond to a return of the function to the calling function or the main function.

[0015] The term“computer-readable medium” includes, but is not limited to, portable or non-portable storage devices, optical storage devices, and various other mediums capable of storing, containing, or carrying instruction(s) and/or data. A computer-readable medium may include a non-transitory medium in which data can be stored and that does not include carrier waves and/or transitory electronic signals propagating wirelessly or over wired connections. Examples of a non-transitory medium may include, but are not limited to, a magnetic disk or tape, optical storage media such as compact disk (CD) or digital versatile disk (DVD), flash memory, memory or memory devices. A computer-readable medium may have stored thereon code and/or machine-executable instructions that may represent a procedure, a function, a subprogram, a program, a routine, a subroutine, a module, a software package, a class, or any combination of instructions, data structures, or program statements. A code segment may be coupled to another code segment or a hardware circuit by passing and/or receiving information, data, arguments, parameters, or memory contents. Information, arguments, parameters, data, etc. may be passed, forwarded, or transmitted via any suitable means including memory sharing, message passing, token passing, network transmission, or the like.

[0016] Furthermore, embodiments may be implemented by hardware, software, firmware, middleware, microcode, hardware description languages, or any combination thereof. When implemented in software, firmware, middleware or microcode, the program code or code segments to perform the necessary tasks (e.g., a computer-program product) may be stored in a computer- readable or machine-readable medium. A processor(s) may perform the necessary tasks.

[0017] The following detailed description together with the accompanying drawings in which the same reference numerals are sometimes used in multiple figures to designate similar or identical structures structural elements, provide a better understanding of the nature and advantages of the present invention. [0018] Turning now to the drawings, FIG. 1 illustrates an example of a smart glasses device 10 in a cutaway perspective view, in accordance with at least one embodiment of the present disclosure. The smart glasses device 10 includes a central frame 16 connected at either end with a first arm 12 and a second arm 14 (right and left). A camera 46 is mounted in a forward-facing orientation, i.e. in a direction faced by a wearer when the device is being worn, within the central frame 16. In some embodiments, the camera 46 is mounted in the bridge 18 of the central frame 16. The smart glasses device 10 can include left and right frame components 40-1, 40-2 in a low- profile or minimalist design suitable for prolonged wear and containing lenses 42-1, 42-2, which may be corrective lenses, protective lenses, UV-protective lenses, clear lenses, or any other suitable form of lens.

[0019] Each arm 12, 14 is formed of a respective arm casing 22-1, 22-2 that is connected with the frame 16 by way of two respective hinges 32-1, 32-2. Each arm extends to respective temple portions 34-1, 34-2 portions, which can contain electronics therein. For example, the device 10 can contain a controller 20 made up of at least one control element 24 (i.e., controller board containing processing and memory, etc.) mounted within the first casing 22-1 of the first arm 12 proximate to the hinge 32-1. The control element 24 is operably connected with the camera 46 by way of a data cable 44 passing through the first hinge 32-1.

[0020] The control element 24 can connect with the camera 46 by way of a flexible data cable 44 that can pass through the frame 16 even when the frame incorporates a minimalist profile, i.e. a highly curved profile suitable for minimizing weight while supported the lenses 42-1, 42-2. This flexible data cable 44 can be routed from end-to-end in the frame 16 in order to preserve balance in the frame, and/or to enable electronic connection between the camera 46 and a control element positioned in either of the two arm casings 22-1, 22-2. In some embodiments, the cable 44 is routed above the lenses 42-1, 42-2.

[0021] In at least one embodiment, the smart glasses device 10 is water resistant or water impermeable around the controller 20 and related data connections by virtue of sealed connections between the arm casing 22-1 and frame 16. For example, in one embodiment, the first hinge 32-1, through which the data cable 44 passes, includes an internal housing 34-1 that wraps around the pivot axis of the hinge and that connects with the frame 16. The internal housing 34-1 pivots within a gasket connected to the frame 16 when the smart glasses device is folded for storage or unfolded for use, so that the data cable 44 the control element 24 are isolated from the external environment in a liquid-tight manner. Specific details concerning the layout of the internal housing 34-1 are provided below with reference to FIG. 2. An external cover or cosmetic insert 36-1, 36-2 can wrap around the hinge 32-1, 31-2.

[0022] In at least one embodiment, the smart glasses device 10 is balanced for improved wearability, e.g. by way of a counterweight 52 mounted in the second arm casing 22-2 opposite the control element 24. This counterweight 52 is aligned with a center of mass of the controller 20 to provide lateral balance centered on the bridge 18, and preferably to shift the center of mass of the smart glasses device 10 as a whole in the anterior direction, behind the frame 16, in order to reduce the tendency of the smart glasses device to fall or rotate forward when worn. This balancing problem is endemic to many existing wearable devices, which typically place both electronics and data collection modules in the same part of the device, e.g. in the central frame.

[0023] The smart glasses device 10 can include various components as alternatives in place of the counterweight 52. For example the second casing 22-2 can include secondary processing in the form of a secondary control element comparable to the primary control element 24, which may connect with the camera 46 by way of the main data cable 44 and pass through the second hinge 32-2 in much the same way that the data cable passes through the first hinge 32-1. In some embodiments, the counterweight 52 can be replaced with a battery for prolonging the operational period of the controller 20 during each charge. In some other embodiments, the counterweight 52 can be replaced with networking hardware, e.g. components for connecting the smart glasses device controller 20 with a network, such as but not limited to: a cellular network, an LTE network, a satellite network, a Bluetooth network, a WiFi network, or other suitable network.. Any suitable combination of the above components may be included in one more both of the arm casings 22- 1,2, and may be combined with counterweight elements as needed to balance weight between the arms 12, 14.

[0024] In one embodiment, the smart glasses device 10 can be connected with external media 60, e.g. a connective device such as a USB cable or comparable data bus for connecting the controller 20 with storage, processing, networking hardware, or the like, via an input/output (IO) port 30. The port 30 is connected with the control element 24 of the controller 20 via a data IO cable 26 housed within the first arm casing 22-1. The data IO cable 26 is preferably routed through the first temple portion 54-1 to terminate past a wearer’s ear when the smart glasses device 10 is worn, so that the external media 60 can be connected with the device while it is being worn and without distracting the wearer. The data 10 cable 26 can be sealed within the casing 22-1, e.g. via a sealant fill 28 within the casing that secures the cable in place and prevents water entry into the device from the port 30. The data 10 cable 26 is preferably sealed for only a portion of its length, near the port 30, and is partially collapsed in a wavy configuration near the control element 24, so that slack in the cable 26 allows the first arm 12 to flex without causing the cable to tug on the control element. Although shown only in the first arm 12, it will be understood that where electronics are present in the second arm 14, analogous data IO cabling and data 10 ports may be provided in the second arm casing 22-2.

[0025] The flexible cabling of the data IO cable 26 and its securement within the casing

22-1 contribute to the low-profile temple design of the arms for fitting over the ears of a wearer, preferably allowing greater clearance than conventional eyeglass designs for accommodating earpieces, headphones, and the like when worn. This low-profile design is enhanced by tapered shape of the control element 24, which narrows to fit within the low-profile design of the first arm casing 22-1. Similarly, the counterweight 52 (or substituted electronics) in the second arm casing 22-2 is also tapered for accommodating the low-profile design of the second arm 14.

[0026] The low-profile design of the smart glasses device 10 can extend to the elements housing the camera 46. For example, in various embodiments, the camera 46 is positioned within the bridge 18 of the frame 16 rather than at the ends, thus permitting a reduced profile around the hinges 36-1,2. The camera 46 can also be configured within the bridge 18 in a manner that minimizes the extension of the camera components out of the frame 16. For example, in one embodiment, the camera lens 48 includes a raised perimeter 50 that lays flush with the bridge 18, thus eliminating the hard gap or bevel between the lens and the frame 16 typical of devices that include cameras.

[0027] In accordance with various embodiments, the smart glasses device meets or improves on parameters for regular outdoor use. For example, the smart glasses device is generally operable at temperatures ranging at least from -l2.2°C to 48°C, thus, connecting sealants, gasket elements, and electronic components are selected from among components that are durable throughout that range of temperatures. The device is generally capable of withstanding general wetting, e.g. by environmental moisture or rain without liquid water penetrating the frame 16 or either arm casing 22-1,2. In some embodiments, the device is also waterproof when submerged. In accordance with at least one embodiment, the camera 46 and associated controller 20 are capable of capturing images at a resolution of at least 640x480 at a frame rate of at least 15 frames per second (fps), or alternatively, a resolution of at least 1280x720 at 2 fps, or at least 2560x1920 at a frame rate of at least 1 fps. The camera 46 can have a natural resolution of at least 5 MPixels and be capable of reliable image capture at distances from 30 cm to at least 30 m, in lighting conditions varying from nighttime, daytime, and indoor. Preferably, the power consumption of the combined camera 46 and controller 20 is less than 4.5 W when capturing video, more preferably less than 1 W, and more preferably less than 0.5 W. In a non-operating mode or standby mode, the combined camera 46 and controller 20 consume less than 0.25 W, more preferably less than 0.1 W. The overall weight of the device 10 is generally less than 150 grams, more preferably less than 120 grams.

[0028] As discussed above, the electronic components of the smart glasses device, i.e. the controller 20 and data cable 44, among others, are generally protected from an external environment by the enclosed arm casings 22-1 and/or 22-2, and in some cases by sealed connections between at least one of the arm casings and the frame 16. FIG. 2 is a partial cutaway view of the smart glasses device 10 shown in FIG. 1, with a focus on a hinge element thereof in order to show further detail of the internal housing 34-1 of the hinge 32-1.

[0029] As discussed above, in at least one embodiment of the present disclosure, the smart glasses device 10 is water resistant through the hinge 32-1 by way of a protective internal housing 34-1. The internal housing 34-1 takes the form of a curved conduit that forms a curved cavity 56-1 through which the flexible data cable 44 is routed between the control element 24 and the camera 46 in the frame 16. The curved cavity 56-1 remains fluidly isolated from the external environment by virtue of inserting into the frame 16 with a close clearance and/or gasket connection that prevents water entry into the internal housing 34-1. The flexible data cable 44 is inserted with slack that causes the cable to partially collapse in a wavy or accordion pattern within the curved cavity 56-1 when the smart glasses device 10 is open. This slack allows the flexible data cable 44 to extend around the hinge 32-1 when the smart glasses device is opened or closed, without tugging on any connected electronics or disturbing the watertight assembly of the hinge.

[0030] The application has now been described in detail for the purposes of clarity and understanding. However, those skilled in the art will appreciate that certain changes and modifications may be practiced within the scope of the appended claims. [0031] In the preceding description, for the purposes of explanation, numerous details have been set forth in order to provide an understanding of various embodiments of the present application. It will be apparent to one skilled in the art, however, that certain embodiments may be practiced without some of these details, or with additional details. Also, except where explicitly contraindicated, it will be understood that features of the various embodiments described herein may be combined.

[0032] Having disclosed several embodiments, it will be recognized by those of skill in the art that various modifications, alternative constructions, and equivalents may be used without departing from the spirit of the embodiments. Additionally, a number of well-known processes and elements have not been described in order to avoid unnecessarily obscuring the present application. Accordingly, the above description should not be taken as limiting the scope of the present application or claims.

[0033] Where a range of values is provided, it is understood that each intervening value, to the smallest fraction of the unit of the lower limit, unless the context clearly dictates otherwise, between the upper and lower limits of that range is also specifically disclosed. Any narrower range between any stated values or unstated intervening values in a stated range and any other stated or intervening value in that stated range is encompassed. The upper and lower limits of those smaller ranges may independently be included or excluded in the range, and each range where either, neither, or both limits are included in the smaller ranges is also encompassed within the present invention, subject to any specifically excluded limit in the stated range. Where the stated range includes one or both of the limits, ranges excluding either or both of those included limits are also included.

[0034] As used herein and in the appended claims, the singular forms“a”,“an”, and“the” include plural references unless the context clearly dictates otherwise. Also, the words“comprise,” “comprising,”“contains,”“containing,”“include,”“including,” and“includes,” when used in this specification and in the following claims, are intended to specify the presence of stated features, integers, components, or steps, but they do not preclude the presence or addition of one or more other features, integers, components, steps, acts, or groups.

Claims

Claims What is claimed is:

1. A smart glasses device comprising:

a frame, a first arm, a second arm, a first hinge connecting a first end of the frame with the first arm, and a second hinge connecting a second end of the frame with the second arm;

a camera mounted in the frame and facing in a direction corresponding to a user’s line of sight when worn;

a controller, mounted in the first arm, comprising memory and a processor configured to process visual data received therefrom; and

a first data cable operably connecting the camera with the controller through the first hinge, wherein:

the first hinge comprises an internal housing positioned proximate an axis of the first hinge and defining an internal cavity sized to contain a portion of the first data cable such that the first data cable can collapse into a compressed state within the internal cavity when the first arm and the second arm are opened for wearing and expand into an extended state when the first arm and the second arm are folded for storage without straining a connection between the first data cable and the controller.

2. The smart glasses device of claim 1, wherein the internal housing of the first hinge is sealed from an exterior environment of the smart glasses device.

3. The smart glasses device of any of the preceding claims, further comprising a counterweight mounted in the second arm opposite the first arm, the counterweight configured to balance the smart glasses device between the first and second arms when the smart glasses device is worn.

4. The smart glasses device of claim 3, wherein the counterweight comprises a battery configured to power at least one of the camera or controller, and wherein the battery is operably connected with the one of the camera or controller.

5. The smart glasses device of claim 3, wherein the counterweight comprises a second controller comprising a second memory and a second processor configured to process visual data received from the camera.

6. The smart glasses device of any of the preceding claims, wherein the smart glasses device is balanced across a centerline passing parallel and equidistant to the first arm and the second arm when the smart glasses device is in an open configuration.

7. The smart glasses device of any of the preceding claims, wherein the smart glasses device has a center of gravity occurring between first arm and the second arm and behind the frame when the first arm and the second arm are in an open configuration.

8. The smart glasses device of any of the preceding claims, wherein the first data cable is routed through the frame from the first end to the second end of the frame.

9. The smart glasses device of any of the preceding claims, wherein the camera comprises a raised lens edge circumscribing a lens of the camera and configured to match a surface height of the lens with a front surface of the frame.

10. The smart glasses device of any of the preceding claims, wherein the camera has an operating field of view of at least 120°.

11. The smart glasses device of any of the preceding claims, further comprising a data port for operably connecting the controller with an external device, wherein the data port is positioned in a tip of the first arm and operably connected with the controller by a second data cable routed through the first arm.

12. The smart glasses device of claim 11, wherein at least a portion of the second data cable is sealed within the first arm by a sealant that prevents liquid entry from the data port into the first arm.

13. The smart glasses device of any of the preceding claims, wherein a total weight of the smart glasses device does not exceed 150 grams.

14. A smart glasses device comprising:

a frame, a first arm, a second arm, a first hinge connecting a first end of the frame with the first arm, and a second hinge connecting a second end of the frame with the second arm;

a camera comprising a camera and a lens mounted in the frame and facing in a direction corresponding to a user’s line of sight when worn;

a controller mounted in the first arm, the controller comprising memory and a processor configured to process visual data received therefrom; and

a counterweight mounted in the second arm opposite the first arm, the counterweight configured to balance the smart glasses device between the first and second arms.

15. The smart glasses device of claim 14, wherein the smart glasses device is balanced across a centerline passing parallel and equidistant to first arm and the second arm when the smart glasses device is in an open configuration.

16. The smart glasses device of any of the preceding claims, wherein the smart glasses device has a center of gravity occurring between first arm and the second arm and behind the frame when the first arm and the second arm are in an open configuration.

17. The smart glasses device of any of the preceding claims, wherein the smart glasses device comprises a first data cable operably connecting the camera with the controller through the first hinge.

18. The smart glasses device of claim 17, wherein the first hinge comprises an internal housing positioned proximate an axis of the first hinge and defining an internal cavity sized to contain a portion of the first data cable such that the first data cable can collapse into a compressed state within the internal cavity when the first arm and the second arm are opened for wearing and expand into an extended state when the first arm and the second arm are folded for storage.

19. The smart glasses device of claim 17, wherein the first data cable is routed through the frame from the first end to the second end of the frame.

20. The smart glasses device of claim 19, wherein the counterweight mounted in the second arm comprises a battery configured to power at least one of the camera or controller, and wherein the battery is operably connected with the one of the camera or controller.

21. The smart glasses device of claim 19, wherein the counterweight mounted in the second arm comprises a second controller comprising a second memory and a second processor configured to process visual data received from the camera.

22. The smart glasses device of any of the preceding claims, wherein the camera comprises a raised lens edge circumscribing the lens and configured to match a surface height of the lens with a front surface of the frame.

23. The smart glasses device of any of the preceding claims, wherein the camera has an operating field of view of at least 120°.

24. The smart glasses device of any of the preceding claims, further comprising a data port for operably connecting the controller with an external device, wherein the data port is positioned in the tip of the first arm and operably connected with the controller by a second data cable routed through the first arm.

25. The smart glasses device of claim 24, wherein at least a portion of the second data cable is sealed within the first arm by a sealant that prevents liquid entry from the data port into the first arm.

26. The smart glasses device of any of the preceding claims, wherein a total weight of the smart glasses device does not exceed 150 grams.