TW202400084A - Techniques for incorporating stretchable conductive textile traces and textile-based sensors into knit structures - Google Patents

Abstract

An example wearable device that includes a conductive deformable fabric is described herein. The conductive deformable fabric has a conductive trace that has a non-extendable fixed length along a first axis, and the conductive trace is sewn into a fabric structure to produce a conductive deformable material. The fabric structure includes a stitch pattern that facilitates the conductive trace to unfold and fold in an oscillating fashion to allow the conductive trace to expand and contract, respectively, along the first axis without exceeding the fixed length of the conductive trace. The conductive deformable material is positioned within the wearable device such that when the wearable device is worn, the stitch pattern is over a joint of the user to allow the stitch pattern to expand or contract along with the movement of the joint.

Description

Technology for incorporating stretchable conductive fabric traces and fabric-based sensors into knitted structures

This patent relates generally to fabrics used in wearable devices including embedded electronics and corresponding manufacturing processes for such fabrics. Embedded electronics can be configured to provide input and other information about a wearer to an artificial reality headset for interacting with an artificial reality environment. These fabrics are made using specific hardware to create lightweight and seamless materials that are comfortable to wear over an extended period of time. Related applications

This application claims US Provisional Application No. 63/485,878 filed on February 17, 2023, US Provisional Application No. 63/485,875 filed on February 17, 2023, and US Provisional Application No. 63/485,875 filed on February 17, 2023. The priority of U.S. Provisional Application No. 63/485,880, filed on February 17, 2023, and U.S. Provisional Application No. 63/485,882, filed on February 17, 2023. Each of these applications is hereby incorporated by reference in its entirety.

This application also claims U.S. Provisional Application No. 63/314,199, filed on February 25, 2022, which is incorporated herein by reference in its entirety. This application further claims priority from U.S. Non-Provisional Application Nos. 18/174,592 and 18/174,593, filed on February 24, 2023, which U.S. non-provisional applications are hereby incorporated by reference in their entirety.

When interacting with artificial realities viewed at artificial reality headsets, input devices and sensors are required to interact with these environments. While controllers and other devices can be used to interact with these environments, they often reduce immersion in artificial reality environments. Therefore, there is a need for devices with immersive aspects that do not detract from the artificial reality environment. While glove-worn wearables attempt to improve these interactions, traditional glove-worn wearables can be large and bulky, and can also hinder movement, which also results in a less immersive experience. For example, a glove-worn wearable device may include multiple layers for different subgroups of components of the glove-worn wearable device. Multiple layers can also prove uncomfortable over longer periods of use (i.e., when interacting with artificial reality environments).

In addition, integrating electronic components with soft wearable devices can be a difficult challenge. Therefore, some wearable devices utilize electronic components that are separately attached to the soft components of the wearable device and are not integrated with or embedded in the soft components. This can increase the bulkiness of the wearable device and can also lead to latency issues and other performance flaws.

As such, one or more of the above identification challenges need to be addressed. The following description presents a brief overview of solutions to the above problems.

The devices, methods, systems, and manufacturing processes described herein address one of the deficiencies or disadvantages described above by allowing wearable devices configured to interact with artificial reality environments to be as lightweight and comfortable as possible Or more. The techniques described herein also allow the integration of electronic devices (e.g., integrated circuits for detecting and/or processing user-provided input) directly into fabrics (e.g., by making electrical components the fabric's structure). part), thereby providing a more comfortable and lightweight wearable device. Manufacturing these types of fabrics can also be difficult, especially at large scale, which is one reason why the manufacturing methods using multi-dimensional knitting machines described in this article are useful in encouraging wider adoption and acceptance of artificial reality systems. reason.

An example of a garment-integrated capacitive sensor that can be used to detect inputs, such as force-based or contact-based input based on changes in capacitance at the garment-integrated capacitive sensor, is described. Apparel-integrated capacitive sensors include a first knitted conductive electrode layer constructed using an insulating conductive fabric (e.g., the insulating conductive fabric may be composed of a compressible/stretchable core (e.g., elastane, thermoplastic polyurethane (TPU)) Structure, the insulating conductive fabric achieves yarn-level deformation, which enhances the performance of the capacitive sensor. In some embodiments, a high surface area insulated conductor (e.g., enamel-coated copper foil, etc.) wrapped around the core can be further Improved sensor performance. In some specific examples, compared to pure copper, tin-copper alloys, and silver-copper alloys, silver-copper alloy wires/foils provide balanced performance when considering conductivity, cost, and fatigue resistance. First The knitted conductive electrode layer has a first surface. The apparel-integrated capacitive sensor also includes a second knitted conductive electrode layer constructed using a non-insulating conductive fabric having a second surface configured to communicate with the first surface. Direct contact to produce a garment-integrated capacitive sensor. In some embodiments, the garment-integrated capacitive sensor is configured to communicate with the processor, and is configured to communicate with the garment-integrated capacitive sensor. Receive sensed values.

Having summarized a first aspect generally related to the use of garment-integrated capacitive sensors that can be used to detect inputs, a second aspect generally related to methods of making knitted fabrics including non-knitted structures has been summarized.

One example method of manufacturing a knitted fabric including a non-knitted structure includes, while knitting the fabric structure according to a programmed knitting sequence of a V-shaped knitting machine (e.g., or any other suitable multi-dimensional knitting machine): The fabric structure has a first The timing of the knitting part provides the V-shaped knitting machine with a non-knitted structure. The first knitted portion is formed based on a knitting pattern of the first type, and after providing the non-knitted structure, the method includes following a programmed knitting sequence to automatically adjust the V-shaped knitting machine to use a second knitting pattern different from the first type. A type of knit pattern such that the non-knitted structure is accommodated within a second knitted portion adjacent the first knitted portion within the fabric structure.

Having summarized a second aspect generally relating to the use of a method of making a knitted fabric including a non-knitted fabric as described above, a third aspect generally relating to a knitted dual density fabric including an overmolded structure is summarized.

In an example method of knitting a dual density fabric, the method includes, while knitting the fabric structure according to a programmed knitting sequence of a V-knitting machine (or other multi-dimensional knitting machine): knitting a third fabric structure having a first fabric density. a portion to include a three-dimensional pocket, and to automatically adjust a V-shaped knitting machine based on a programmed knitting sequence to knit a second portion of a fabric structure, the second portion of the fabric structure having a second fabric density that is different from the first fabric density, adjacent to the first part within the fabric structure. In some specific examples, the second section is knitted first. For example, knitting a second portion of a fabric structure having a second fabric density, and automatically adjusting a V-shaped knitting machine based on a programmed knitting sequence to knit the first portion of the fabric structure to include a three-dimensional pocket, the three-dimensional pocket having a shape different from The first fabric density of the second fabric density is adjacent to the first portion of the fabric structure. The method also includes overmolding the polymeric structure into the three-dimensional pocket, wherein the second portion of the fabric structure is temporarily secured to a device configured to attach the overmolded structure into the three-dimensional pocket. The method also includes removing the second portion of the fabric structure.

Having summarized the third aspect generally regarding the use of knitted dual-density fabrics including overmolded structures, we now summarize the fourth aspect generally regarding wearable devices including conductive deformable fabrics.

An example wearable device includes a conductive deformable fabric, and the conductive deformable fabric includes conductive traces having an inextensible fixed length along a first axis. Conductive traces are knitted into the fabric structure to create an electrically conductive deformable material. The fabric structure includes a weave pattern that promotes the expansion and folding of the conductive traces in an oscillatory manner to allow the conductive traces to expand and contract, respectively, along the first axis without exceeding a fixed length of the conductive traces (or not substantially exceeding (fixed length so that the conductive traces do not receive stretch or torsion), and the conductive deformable material is located within the wearable device such that when the wearable device is worn, the tissue pattern is positioned over the user's joints to allow the tissue pattern to follow Expansion or contraction of joints.

The description provided herein focuses on glove-worn wearable devices that can be used to control artificial real-world environments, but those of ordinary skill in the art will understand after reading this disclosure that many examples of wearable devices would benefit from The technology described herein includes other wearable devices, such as items of clothing (especially headbands, shirts, sweatshirts, sweatpants, socks, among others). Those of ordinary skill in the art will also understand upon reading this disclosure that the techniques described herein are applicable to any multi-dimensional knitting machine, although the primary example for use in conjunction with a manufacturing or assembly process is a V-shaped knitting machine.

The features and advantages set forth in the specification are not necessarily all-inclusive, and certain additional features and advantages will be apparent to a person of ordinary skill in the art in view of the drawings, description and patent claims. Furthermore, it should be noted that the language used in the instructions has been chosen primarily for readability and instructional purposes.

Having summarized the above example aspects, a brief description of the schema will now be presented.

Numerous details are described herein to provide a thorough understanding of the example embodiments illustrated in the accompanying drawings. However, some specific examples may be practiced without many specific details. Furthermore, well-known procedures, components, and materials are not necessarily described in detail so as not to obscure aspects of the specific examples described herein.

Embodiments of the present disclosure may include or be implemented in conjunction with various types or embodiments of artificial reality systems. As described herein, artificial reality is any overlapping functionality and/or sensory-detectable representation provided by an artificial reality system within the user's physical environment. Such Artificial Reality (AR) may include and/or represent Virtual Reality (VR), Augmented Reality, Mixed Artificial Reality (MAR), or some combination and/or variation thereof. For example, a user can perform a swipe gesture in the air (which can be detected using aspects of knitting structures described herein) to cause a song to be skipped by a song providing API that provides playback at, for example, a home speaker. In some embodiments of AR systems, ambient light (e.g., a real-time summary of the surrounding environment that a user would normally see) may pass through the display elements of individual head-worn devices that present various aspects of the AR system. In some embodiments, ambient light may pass through various aspects of the AR system. For example, visual user interface elements (eg, notification user interface elements) can be presented at the head wearable device, and a certain amount of ambient light (eg, 15-50% of ambient light) can pass through the user An interface element allows a user to distinguish at least a portion of the physical environment within which the user interface element is being displayed.

Artificial reality content may include fully generated content or generated content combined with captured (eg, real-world) content. Artificial reality content may include video, audio, tactile events, or some combination thereof, any of which may be presented in a single channel or in multiple channels (such as stereoscopic video that produces a three-dimensional effect to the viewer). Additionally, in some embodiments, artificial reality may also be associated with applications that are used, for example, to create content in the artificial reality and/or to otherwise use the artificial reality (e.g., to perform activities in the artificial reality), Products, accessories, services or a combination thereof.

As described herein, multidimensional knitting machines can be used to produce complex knitted structures that incorporate non-knitted structures, adjust knitted patterns and spacing without creating seams, and create complex garments without the need for re-orientation. Cases forming complex clothing (e.g., gloves), etc. Although many of the descriptions provided herein refer to knitted fabric structures produced using yarns, the same techniques applied to such knitted fabric structures can also be applied to woven fabric structures.

1A-1E illustrate knitted wearable glove devices including one or more garment-integrated capacitive sensors (e.g., the capacitive sensors may be configured to detect detecting force-based and contact-based input from the user's 118 fingers, and may do so in various quadrants for more granular detection of such input). The knitted wearable glove device 100 includes one or more of the respective respective fingertips (and thumbtips (hereinafter fingers and fingertips are also used to refer to thumb and thumbtips)) of the knitted wearable glove device. A clothing-integrated capacitive sensor assembly 102A to 102E. Each of one or more apparel-integrated capacitive sensor assemblies 102A-102E includes a plurality of contact areas on each of the respective apparel-integrated capacitive sensors (e.g., respective respective capacitive sensing The device includes four different contact quadrants, but various other numbers of contact areas can also be considered). For example, FIG. 1A shows an exploded view 104 illustrating a garment-integrated capacitive sensor assembly 102D having four different garment-integrated capacitive sensor contact areas 106A-106D, each of which has a corresponding garment-integrated capacitive sensor contact area 106A-106D. The respective contact areas of type capacitive sensors can be used for capacitance values. These clothing-integrated capacitive sensors can be used to determine precisely applied forces (for example, a finger rolling across a surface), which can be used to provide input to control artificial reality environments.

As will be explained in further detail in connection with the description and subsequent figures, one or more garment-integrated capacitive sensor assemblies 102A-102E in each respective fingertip are seamlessly integrated with the knitted wearable glove device 100. This seamless nature is illustrated in exploded view 104 , which shows one or more garment-integrated capacitive sensor assemblies each constructed from two knitted layers. The first knitted conductive electrode layer 108 is constructed using an insulating conductive fabric, and the second knitted conductive electrode layer 110 is constructed using a non-insulating conductive fabric. When combined, the first knitted conductive electrode layer 108 is configured to be in direct contact with the second knitted conductive electrode layer 110 to produce a garment-integrated capacitive sensor. Although in the example embodiment of FIG. 1A , the second knitted conductive electrode layer 110 is shown as an outer layer (i.e., on the exterior of the glove 100 ), in some other embodiments, the reverse configuration is possible (i.e., , the insulation layer is not the outer layer).

Turning now to FIG. 1B , there is shown the presence of a pair of knitted wearable glove devices 100 , one glove being shown in a perspective view depicting the palm side of the knitted wearable glove device 100 , and the other glove being depicted as a knitted wearable glove device 100 . A perspective view of the dorsal side of the hand of the device 100 is shown. The illustrated palm side of the first glove 112 is discussed above with reference to FIG. 1A. The second glove 114 on the dorsal side of the hand will now be described. The second glove 114 illustrating the dorsal side of the hand shows additional garment-integrated capacitive sensors 116A-116L disposed on one of its surfaces. As shown in this example, the capacitive sensor can be positioned close to the user's joints (e.g., finger knuckles) (e.g., within 0.2-5 mm or directly above them) such that the capacitive sensor can be used to measure Measures bending/stretching that occurs at or near joints. As will be discussed further below, the knitted wearable glove device 100 (including the garment-integrated capacitive sensor) can be produced on a multi-dimensional knitting machine (eg, a v- or x-type knitting machine), allowing production in a single knitting process including Knitted wearable glove device 100 with one or more garment-integrated capacitive sensors (eg, without the need to remove the wearable glove from the knitting machine for reorientation or completion). In some embodiments, additional garment-integrated capacitive sensors are located on the thumb portion of the glove and on the palm and wrist to provide additional input areas or sensor detection areas to allow for interaction with artificial reality environments. further flexibility.

In one example, soft capacitive sensors integrated with the gloves of Figures 1A and 1B can be used to assist in typing operations. This is illustrated in Figures 1C and 1D, which illustrate examples of using data provided by one or more apparel-integrated capacitive sensors to provide input to a user interface presented in an artificial reality environment. Figure 1C shows a user 118 wearing a knitted wearable glove device 100 pressing down on a surface 120 (eg, a table). One or more apparel-integrated capacitive sensor assemblies 102A-102E provide data (e.g., individual capacitance measurements produced by a user pressing down on surface 120), which measurements may be divided into individual capacitance measurements. The various contact areas of the sensor, as described above), indicate that force is applied to the fingertip 122 of the knitted wearable glove device 100. The measurement data can then be used to calculate a force value, as shown by curve 123 in plot 121 , which illustrates the detected force received in response to a touch event. 1C also shows that in response to force applied to the fingertip 122 of the knitted wearable glove device 100, input on the virtual keys of the virtual keyboard 124 is provided to the virtual display (e.g., indicated by the letter "H" 125 being displayed ).

FIG. 1D shows that the user 118 wearing the knitted wearable glove device 100 is no longer pressing down on the surface 120 (eg, a table). In response to no longer pressing down on surface 120, one or more garment-integrated capacitive sensor assemblies 102A-102E provide data (e.g., individual capacitance measurements) indicating that force is not being applied to the knitted wearable glove. Fingertip 122 of device 100 . The measurement data can then be used to calculate a force value, as shown in plot 126, which illustrates the detected force received in response to the end of the touch event. Therefore, the detected force is now less than the calculated force shown in plot 121 in Figure 1C.

Figure 1E illustrates lock-and-key knitting technology, which can be used to increase the contact surface area of one or more adjacent garment-integrated capacitive sensor assemblies (eg, 102A through 102E shown in Figure 1A). 1E shows two different apparel-integrated capacitive sensor assemblies (eg, a first apparel-integrated capacitive sensor 128 and a second apparel-integrated capacitive sensor 130 ), where the first apparel-integrated capacitive sensor The sensor 128 terminates in a first pattern 132 (eg, a key), and the second garment-integrated capacitive sensor 130 terminates in a second pattern 134 corresponding to the first pattern (eg, a pattern opposite to the first pattern). (e.g. lock). Although described in this example as being used to knit together two sensor assemblies, it should be understood that the lock-and-key knitting technique can also be used to knit together two contact areas within a single sensor assembly.

FIG. 1E also shows the first apparel-integrated capacitive sensor 128 and the second apparel-integrated capacitive sensor 130 assembled together in the combined apparel-integrated capacitive sensor assembly 136 . In some embodiments, this lock-key structure improves knitting resolution by taking advantage of the three-dimensional nature of knitted fabrics. In some embodiments, this lock-and-key structure increases the contact surface area between the first knitted conductive electrode layer 108 and the second knitted conductive electrode layer 110 of one or more apparel-integrated capacitive sensor assemblies 102A-102E. .

Attention is now directed to Figure 2, which illustrates, according to some specific examples, a multi-dimensional knitting machine configured to produce multi-dimensional knitted garments in an automated manner (e.g. without any manual knitting or other user requirements after the initial knitting procedure). Interventions, including integrated components that allow the automatic knitting of electronic components into multi-dimensional knitted garments). The Multi-Dimensional Knitting Machine 200 is a garment production device that is computer controlled and user programmable to allow the production of complex knitting structures (e.g. gloves, tubular fabrics, fabrics with embedded electronics, complex knitting patterns, special stretch characteristics, unique pattern structure, multi-line structure, etc.). The multi-dimensional knitting machine 200 includes a first axis needle bed 202, a second axis needle bed 208, and an N-axis needle bed (indicating that more than three needle beds are possible). Each of these needle beds (e.g., needles 204, needles 210, and needles 218) are configured to use a plurality of different types of knitting patterns (e.g., jersey knit, rib knit) based on a programmed sequence provided to the multi-dimensional knitting machine 200 , interlock knit, French terry knit, fleece knit, etc.), and variations of these knits can be used to form a single continuous garment (e.g., jersey and French terry knit and/or first variations of jersey and Combination of the second variation of jersey fabric). In some embodiments, these variations in knitwear within a single continuous garment can be accomplished without creating seams (eg, seamless wearable devices can be created). In some embodiments, the knitting machine is further configured to layer the fabric to produce a multi-layer wearable structure (eg, housing one or more electronic components). In some embodiments, each layer of a multi-layer wearable structure can be made from a different fabric, which in one example is produced using conductive yarns. For example, the multi-dimensional knitting machine 200 may be used to produce a double-knitted capacitive sensor in which the first and second layers use different wires (eg, coated conductive wires and uncoated conductive wires). For each of the needle beds, a plurality of fabric spools may be included (eg, fabric spool 204, fabric spool 212, and fabric spool 220). Multiple types of fabric spools are available for each needle bed, allowing the production of even more complex woven structures (also known as garments). In some embodiments, the fabric spool may also include elastic threads, allowing for the production of stretchable fabrics and/or fabrics with shape memory.

Each of the needle beds discussed above may also include one or more nonwoven insert components (eg, nonwoven insert component 206 , nonwoven insert component 214 , and nonwoven insert component 222 ) that Configured to allow the non-woven structure to be inserted into the needle bed such that the non-knitted structure can be knitted into the knitted structure (eg, apparel) at the same time that the knitted structure is being produced. For example, the nonwoven structure may include flexible printed circuit boards, rigid circuit boards, wires, structural ribs, sensors (eg, neuromuscular signal sensors, light sensors, PPG sensors, etc.), etc. In some embodiments, the weave pattern can be adjusted by a multi-dimensional knitting machine (e.g., according to a programmed sequence of knitting instructions provided to the machine) to accommodate such structures, which in some embodiments means such structures Knitted into the fabric rather than sewn onto the top of the knitted fabric. This allows the garment to be lighter, thinner, and more comfortable to wear (eg, by having fewer protrusions that exert uneven pressure on the wearer's skin). In some embodiments, these multi-dimensional knitting machines can also knit knitted structures along either or both vertical or horizontal axes, depending on the desired properties of the knitted structure. Knitting along the horizontal axis means that the garment will be produced from left to right (e.g., a glove would be produced starting with the little finger, then moving to the ring finger, then the middle finger, etc.) (e.g., as shown in the example sequence of Figure 3B). Vertical sewing means that the garment is produced in a top-down manner (e.g., a glove is produced starting at the top of the highest finger and moving down to the wrist portion of the glove (e.g., as shown at 228 in Figure 2)). Regarding the glove example, reverse manufacturing procedures are also considered (for example, the thumb is knitted first when knitting horizontally, and the wrist portion is knitted when knitting vertically). In some embodiments, the insert assembly may feed the non-knitted structure to the knitting machine, or in some other embodiments, the insert assembly may be fed with the non-knitted structure by the knitting machine. In the latter case, the insert is not integrated into the garment and is discarded. In some embodiments, the insertion component is not fed at all, but is an integrated component of a multi-dimensional knitting machine that is activated based on a programmed knitting sequence to then allow non-knitted components to be inserted into the knitted structure.

The multi-dimensional knitting machine 200 also includes a knitting logic module 224 that is user programmable to allow the user (which may be a manufacturing entity that mass-produces wearable structures) to define knitting sequences using the above Use any of the materials, tissue patterns, knitting techniques, etc. described in this article to produce clothing. As mentioned above, the knit logic module 224 allows for seamless combination of any of the techniques described above, thereby allowing for the production of unique complex knit structures in a single knit sequence (e.g., the user does not need to remove knitted structure and then reinserting and reorienting it to complete the knitted knitted structure). The multidimensional knitting machine 200 also includes an insertion logic module 226 that cooperates with the knit logic module 224 to allow seamless insertion of nonwoven components into the knitted structure while the knitted structure is knitted together. The insertion logic communicates with the knitting logic to allow the knitting to be adjusted based on where the nonwoven structure is inserted. In some specific examples, the user only needs to show where the nonwoven structure will be inserted into his or her solid model (e.g., at a user interface associated with a multidimensional knitting machine that allows for the creation and editing of stylized knitting sequence), and the knitting logic module 224 and the insertion logic module 226 automatically work together to allow the production of knitted structures.

Figure 3A illustrates a sequence of knitting a knitted wearable structure (eg, a glove) along a vertical axis, according to some specific examples. Vertical sewing means that the garment is produced in a top-down fashion (for example, a glove is produced from the top of the highest fingers and moves down to the wrist portion of the glove). For some knitted wearable structures, vertically knitted knitted structures are required. For some three-dimensional knitted structures (for example, pockets with certain openings), sewing on specific axes is necessary. Figure 3A illustrates a sequence 300 showing three snapshots (302A to 302C) along the vertical axis over sewing time.

Figure 3B illustrates the sequence of knitting a knitted wearable structure (eg, another glove) along a horizontal axis, according to some specific examples. Horizontal sewing means that the garment will be produced from left to right (e.g. a glove will be produced starting at the pinky finger, then moving to the ring finger, then the middle finger, etc.). For some knitted wearable structures, it is necessary to stitch the knitted structure laterally rather than vertically. Figure 3B illustrates sequence 304 showing two snapshots (306A to 306B) over horizontal sewing time. It will be appreciated that certain multi-dimensional knitting machines can be programmed to allow knitting combinations in both the horizontal and vertical directions even for a single wearable structure, such that certain aspects of wearable gloves (e.g., three-dimensional pockets) can Knit in a horizontal direction, and other aspects of wearable gloves (eg, non-knitted structures, such as printed circuit boards) may be knitted vertically.

Figure 4 illustrates, according to some specific examples, a non-knitted structure being inserted into a multi-dimensional knitting machine while the knitted structure is being knitted (e.g., also in an automated manner such that no user intervention is required to allow the initial knitting sequence to be Then integrate the non-knitted structure). 4 shows a schematic overview similar to FIG. 2 showing an insert assembly 402 (same as insert assemblies 206, 214, and 222 described with reference to FIG. 2) configured to interface with a multidimensional knitting machine 400. (same as the multi-dimensional knitting machine 200 discussed with reference to Figure 2).

Figure 4 illustrates the sequence of how to insert a non-knitted structure 405 into a multi-dimensional knitting machine while knitting a knitted fabric (eg, a glove 408). In the first pane 406A indicating a first point in time, the fingertips of the glove 408 are being produced, such as being knitted on a vertical axis. The second pane 406B, indicating the second point in time, shows the knitted structure 405 being knitted, and also shows the non-knitted structures 408A and 408B (which in this example may be individual conductive traces or a printed circuit board, which may be used Data from sensors, such as one or more of the soft capacitive sensors described previously as one example, is knitted (ie, inserted) into the knitted structure 405 . The second pane 406B also shows that in some embodiments, the threads of the knitted structure 405 are alternately knitted above or below the non-knitted structure 405, ensuring that the non-knitted structures 408A and 408B are integrated into a single layer of fabric. The third pane 406C, indicating the third point in time, further shows that the knitted structure 405 continues to be knitted together, and the non-knitted structures 408A and 408B continue to be knitted into the knitted structure 405. Ultimately, multidimensional knitting machine 400 along with insert assembly 402 will produce a complete glove 408 (eg, a three-dimensional glove) with embedded non-knitted structures 408A and 408B. In some embodiments, non-knitted structures 408A and 408B may include slits to allow threads to pass through to further secure non-knitted structures 408A and 408B to knitted fabric 405 .

According to some specific examples, Figure 4 also illustrates how the multi-dimensional knitting machine 200 can adjust the knitting pattern to different knitting patterns while still allowing non-knitted structures to be integrated into the knitted structures. Figure 4 illustrates in the fourth pane 406D indicating a fourth point in time that the second knit pattern 412 can switch to a mid-knit without a seam between the two knit patterns (e.g., the knit pattern can change and still Can produce seamless knitting). Varying the knit pattern in the knit can be beneficial to accommodate different bending requirements of the wearable structure (for example, locations on a glove corresponding to joints may require a different knit pattern to accommodate more movement than locations corresponding to phalanx bones). In some embodiments, the first knit pattern 414 is a tighter (e.g., denser) knit (e.g., a higher number of individual stitches per space area) than the second knit pattern 416 to accommodate additional movement (e.g., bending of the user's joints). In some embodiments, non-knitted structure 405 (eg, printed circuit board, wires, wire harnesses, semi-rigid supports, etc.) is constructed from a different material than the woven structure. For example, the non-knitted structure may be a printed circuit board, electrical wire, a bundle of steel wire, a semi-rigid support, or the like.

5A and 5B illustrate a knitted structure having a non-knitted structure having a first knitted portion surrounding it and a second knitted portion surrounding the first knitted portion, according to some specific examples. Figure 5A illustrates a structure 500 including a non-knitted structure 502 and a knitted structure 501. In the example depicted in FIGS. 5A-5B , the non-knitted structure 502 does not extend as much as the knitted structure 501 , so it is necessary to devise a technique that allows the knitted structure to extend without damaging the non-knitted structure 502 . Figure 5A shows knitted structure 501 that unfolds non-knitted structure 502 as knitted structure 501 is stretched, effectively allowing non-knitted structure 502 to not interfere with (ie, match) the stretching of knitted structure 501. Figure 5A shows a first knitted portion 506 having a first knitted pattern and a second knitted portion 508 having a second knitted pattern (different from the first knitted pattern) that accommodates a non-knitted structure 502. When combined with the non-knitted structure 502, the second knitted portion 508 is configured to stretch in substantially the same manner as the first knitted portion 506. For example, a looser knit pattern may be used in the second knitted portion 508 to accommodate the reduced stretch capabilities caused by the non-knitted structure 502 . To allow the non-knitted structure 502 to not receive undue stress when stretched, the non-knitted structure 502 may be oversized for a given area and placed in a zigzag pattern. The zigzag pattern allows the non-knitted structure 502 to move as the fabric is stretched without placing undue stress/strain on the non-knitted structure (e.g., when tied linearly, so that the maximum stretch length is equal to the non-knitted structure length). When non-knitted structures are used for sensing purposes, excessive stress and/or strain on the knitted structure can damage components or interfere with accurate measurements.

Figure 5B illustrates the structure 500 described with reference to Figure 5A in a stretched state (eg, as indicated by opposite arrows 510A and 510B), which shows the knitted structure 501 in its stretched state and its non-extended state. Knitted structure 502. Figure 5A also shows that the first knitted portion 506 and the second knitted portion 508 are stretched in the horizontal direction. Although stretch is shown in one direction, in some embodiments, the fabric can be configured to have bidirectional stretch.

6A-6B illustrate a first type of weave pattern (eg, a flat stitch weave pattern) for allowing accommodation of conductive traces, according to some specific examples. In some embodiments, the conductive traces may be knitted into yarns that mimic yarns in adjacent yarns in the fabric. In some specific examples, the yarn may be any conductive yarn described in U.S. Provisional Application No. 63/314,199, including those shown with reference to Figures 3 to 7 of U.S. Provisional Application No. 63/314,199. Yarn of description. This alternative provides another way to provide a seamless fabric structure that includes one or more electrical components. Figure 6A illustrates a sewing technique 600 for producing plain stitched fabric. Figure 6A also illustrates conductive yarn 602 as having a different appearance than surrounding yarn 604, ie, distinguishing it from surrounding yarns. However, in some embodiments, the conductive yarns may have the same appearance. The knitting needle 605 shown in Figure 6A (and also shown in Figure 6C) is a knitting needle corresponding to the knitting needles 204, 210 and 218 described with reference to Figure 2. Figure 6B shows the resulting fabric 606 using a single-needle jersey construction including conductive yarn 602 and surrounding yarn 604.

6C-6D illustrate a second type of weave pattern for allowing accommodation of conductive traces (eg, a plain stitch weave pattern that is different from the weave pattern depicted and described with reference to FIGS. 6A-6B) according to some specific examples. In some embodiments, the conductive traces may be knitted into yarns that mimic yarns in adjacent yarns in the fabric. This alternative provides another way to provide a seamless fabric structure that includes one or more electrical components. Figure 6C illustrates a stitching technique 608 for producing plain stitched fabric. Figure 6C also illustrates conductive yarn 610 as having a different appearance than surrounding yarn 612, ie, distinguishing it from surrounding yarns. However, in some embodiments, the conductive yarns may have the same appearance. Figure 6C also shows that some needles 605 are knitting conductive yarn 610 while other needles are knitting surrounding yarn 612. Figure 6D shows the resulting fabric 614 using a modified jersey construction including conductive yarn 602 and surrounding yarn 604. A modified jersey weave may allow for additional stretch (i.e., having a different weave around the conductive yarns may improve the overall stretchability of fabric 614).

Figure 6E illustrates another example of a weave pattern that adjusts stitch spacing to adjust the tensile properties of the resulting fabric, according to some specific examples. Figure 6E illustrates three different stitch sizes (eg, small stitch spacing 616, medium stitch spacing 618, large stitch spacing 620, etc.). For example, pitches up to 18 pitches or higher. In some specific examples, different stitch spacing may be used in the same garment depending on the requirements of the positive seam area (e.g., high movement areas (e.g., joints) may require larger spacing to allow for greater stitching than low movement areas). stretching).

6F illustrates an example of a fabric including a larger pitch knit 622 (eg, a larger pitch jersey) that allows for additional stretch characteristics to be accommodated, according to some specific examples. This larger knit jersey is evident when compared to the jersey shown in Figure 6B. Although several stitch spacings are stated, any spacing may be used based on the stretch requirements of the garment. Although primarily flat stitch weaves have been shown, other weaves mentioned above with respect to Figure 2 may also be used. In some specific examples, the knitted fabric as described in U.S. Provisional Application No. 63/314,199 can be formed using this larger pitch knitted plain stitch structure, such as described with reference to Figures 3 to 7 of U.S. Provisional Application No. 63/314,199 Those fabrics.

Figure 6G illustrates that conductive yarn 624 can be stitched in a vertical direction (eg, along the warp direction, such as opposite the weft direction) as described for stitching conductive yarns with reference to the example of Figures 6A-6F. The horizontal direction is opposite. In some specific examples, there may be both vertical and horizontal stitches, depending on the requirements of the garment. In some embodiments, the conductive yarns are coated so that they can contact each other without interfering with their respective signals. Figure 6H illustrates another way in which conductive yarn 626 (shaded) may be knitted other than a plain knit according to some specific examples.

7A-7G illustrate a sequence for producing a portion of an actuator configured for placement at a fingertip, according to some specific examples. Figures 7A-7C illustrate the progression of a produced knitted structure over time. The knitted structure 700 produced is composed of two different fabric components. The first fabric component 702 has a first knit pattern and is the desired final fabric product in the depicted example. In some embodiments, the first fabric component 702 is also sewn in a manner that produces a three-dimensional pocket that is preferably formed around the user's fingertips when completed. The second fabric component 704 may be a temporary piece configured to be removed at a later point of production. The second fabric component 704 may serve primarily as a guide during the overmolding step, which will be described in further detail later.

Figure 7B better illustrates the second fabric component 704 having its weave pattern altered at certain locations to add guide holes 706A through 706D, which are used to align the knitted structure in the overmolding machine to ensure consistent Place the overmolded structure in the correct location. Figure 7C further illustrates that the knitting procedure continues with the addition of more guide holes as the production of knitted structure 700 continues. Figure 7C also illustrates that one or more stress relief holes 707 can also be produced by a multi-dimensional knitting machine. In some embodiments, the one or more strain relief holes 707 may be used to route cables (eg, electronic, fluid, or pneumatic cables), or to allow the fabric to bend (eg, bend around a fingertip).

Figure 7D illustrates knitted structure 700 inserted into overmolding machine 708 to integrate one or more tactile feedback generator components 710 into first fabric component 702. As discussed, the second fabric component 704 includes guide holes 706A-706L corresponding to the positioning pins 712A-712L. The positioning pins 712A to 712L are inserted into the guide holes 706A to 706L of the second fabric component 704 to ensure that the overmolding machine 708 correctly places the overmolding structure on the first fabric component 702 .

Figure 7E shows overmolding machine 708 compressing down on knitted structure 700 (not visible in Figure 7E because it has been compressed by machine 708) to eject the overmolded structure (not visible in Figure 7E because it has been compressed). compressed by machine 708). When compressed down on the knitted structure 700, the injectable material with bendable properties (e.g., silicone, rubber, etc.) can flow onto/into the fabric in the shape of the mold provided by the overmolding machine 708 to create an overmolding. Structure (fuzzy). In some embodiments, additional components are added to the overmolder, which then secures the additional components to the knitted structure 700 via the molded structure.

7F illustrates the post-overmolded structure, which now includes overmolded structure 714 embedded in first fabric component 702 of knitted structure 704 to create a complete tactile fingertip structure 716. The overmolded structure 714 may be configured to include a matrix of tactile feedback generators (e.g., as illustrated by bubble array 717 , where individual bubbles may each be used to provide tactile feedback and/or sensory input), wherein each tactile feedback generator The generators can be individually controlled (eg, by inflating or deflating) to provide tactile sensing to a user wearing the intact tactile fingertip structure 716. In some embodiments, overmold structure 714 includes one or more sensors (eg, neuromuscular signal sensors that are secured during the overmold procedure). In some embodiments, one or more sensors are configured to detect both neuromuscular signals and non-neuromuscular signals. Figure 7F also shows two cords 718A and 718B, which in this example embodiment are configured as the only cords attaching the first fabric component 702 to the second fabric component 704. In some embodiments, there is only a single cord attaching the first fabric portion component 702 to the second fabric component 704 .

Figure 7G shows two ropes 718A and 718B being pulled from the knitted structure 700, and thus the first fabric component 702 and the second fabric component 704 are separated from each other. In some embodiments, a single cord may be configured to separate the first fabric component 702 from the second fabric component 704 . In some embodiments, the second fabric component is one continuous piece rather than two separate pieces. As previously mentioned, the second fabric component 704 is a temporary piece that is configured to be removed at a later production point and used only during the manufacturing process. Figure 7G also shows the complete process for producing a fabric with an integral overmolded structure 720. In some embodiments, cords 718A and 718B are loose cords from second fabric component 704 that allow second fabric component 704 to be untied (eg, by hand or machine) to remove second fabric component 704 from the first fabric component. Component 702 detaches.

8A-8B illustrate a fabric structure (eg, glove 800) including one or more portions made of a conductive deformable fabric (eg, conductive deformable fabric portion 802) and the fabric thereof, according to some specific examples. Favorable strain characteristics for structural adaptation. In some embodiments, the electrically conductive deformable fabric has a different amount of stretch along certain axes (eg, is more restrictive) compared to the surrounding material, but the stretch is still desired. In order to integrate conductive deformable fabrics, certain folding techniques can be used to achieve this goal, such as origami-derived folding techniques (e.g., when in the unstretched state, the fabric has alternating folds along at least one axis to reduce its occupied area (e.g., a first occupied area), and when in the stretched state, the alternating folds substantially unfold to increase its occupied area of the fabric (e.g., to a second occupied area that is greater along at least one axis than the first occupied area). In some embodiments, the fabric structure includes elastic bands that allow the fabric to be in a preset unstretched state.

In some embodiments, the conductive deformable fabric portion 802 can be configured as a strain sensor (ie, based on the unfolding of the fabric, the resistance of the fabric changes, which can be used to determine the occurrence of strain). In some specific examples, strain information can be used to determine hand posture (eg, strain can be used to determine whether a finger is in a curled/first state (eg, the higher the strain, the tighter the finger is curled)). In some embodiments, the conductive deformable fabric can also be configured to couple with the neuromuscular signal sensor, and the conductive deformable fabric can be configured to power the neuromuscular signal sensor and/or transmit signals from the nerve. Signal data of muscle signal sensor.

Figure 8A also shows that the user 801 has his hand clenched into a fist, and thus a portion of the glove 800 is extended into a stretched state. Plot 804 shows a prophetic illustration of curve 806 indicating (shown on x-axis 810 ) the measured/calculated strain that occurs at conductive deformable fabric portion 802 over time (shown on y-axis 808 out). Curve 806 shows that the strain increases as the hand is further tightened (ie, the conductive deformable fabric portion 802 is further in its stretched state). In some embodiments, multiple discrete strain sensors may be placed in different areas, as opposed to a continuous strip, as shown (e.g., individual strain sensors placed on each joint, or other parts of the hand). Soft part (top)) to perform multiple strain measurements and provide better images of hand posture. In some embodiments, multiple strain sensors may be placed at a single location (eg, a joint) to provide even more detailed (eg, higher resolution) measurements. In some embodiments, information provided by one or more strain sensors may be used to provide input to the artificial reality environment displayed at artificial reality headset 803 .

Figure 8B shows the user now spreading his hand, and thus the glove 800 returning to its unstretched state. Plot 804 shows a predictive curve 806 that now indicates the measured/calculated strain that occurs at conductive deformable fabric portion 802 over time. The curve shows a decrease in strain as the hand is further extended (ie, the conductive deformable fabric portion 802 is further in its unstretched state).

9A-9C illustrate a fabric structure 900 that includes one or more portions made of conductive deformable fabric 902 and is configured to have bidirectional stretch, according to some specific examples. The strain has favorable strain characteristics as shown by the plots in each of Figures 9A-9C. As discussed with reference to Figures 8A-8B, the fabric structure 900 is made stretchable by using a series of folds, with the unstretched state being a substantially folded state and the stretched state being a substantially unfolded state. As will be discussed, the fabric structure 900 may have a fold pattern that allows it to unfold in both the x- and y-directions, thereby allowing for bidirectional stretching.

Figure 9A shows the fabric structure 900 in a preset unstretched state. Curve 904 shown in Figure 9A is indicated by the dashed x-axis curve 906 and the solid y-axis curve 908, the measured/calculated strains that have not occurred in both the x-axis and y-axis of the fabric structure at time t1, respectively.

Figure 9B shows the fabric structure 900 in an extended state along the y-axis, and the plot 904 shown in Figure 9B is indicated by a solid y-axis curve 908 along which at time t2 there is a measured/calculated Strain. Figure 9B also shows that the dashed x-axis curve 906 at time t2 indicates that there is no measured/calculated strain occurring along the x-axis.

Figure 9C shows the fabric structure 900 in an extended state along both the x-axis and the y-axis, and the curve 904 shown in Figure 9C is indicated by the dashed x-axis curve 906 and the solid y-axis curve 908, at time t3, respectively. The measured/calculated strain that occurs on both the x- and y-axes of the fabric structure.

10A illustrates two views of a knitted fabric including a three-dimensional knitted fabric that can be configured to accommodate one or more non-knitted structures, according to some specific examples. The first view 1000 shows a top view of the knitted structure 1002 including the three-dimensional portion 1004. The raised portion 1004 acts as a pocket, allowing non-knitted structures (not shown) to be placed within the cavities of the raised portion. In some embodiments, the non-knitted structure is inserted via an insert assembly. In some embodiments, the non-knitted structure is a neuromuscular signal sensor (eg, an electromyography sensor).

Figure 10A also shows a second view 1006, which shows a side view of the knitted structure 1002 including the three-dimensional portion 1004. In some embodiments, the knitted structure 1002 is produced on a multi-dimensional knitting machine configured to adjust its knitting pattern while producing the knitted structure to produce the three-dimensional portion 1004 . In some embodiments, the three-dimensional portion has no seams or borders with adjacent portions because it is produced simply by changing the knit pattern (eg, a denser knit pattern surrounded by a portion with a looser knit pattern can produce a three-dimensional pocket).

Figure 10B illustrates specific examples according to some specific examples, wherein multiple three-dimensional portions are placed on a single knitted structure 1008. Multiple three-dimensional portions 1010A-1010C may allow multiple non-knitted structures to be placed in close proximity to each other. In some embodiments, the solid segments are placed in a grid array spanning both the x and y directions. In some embodiments, the solid portions are offset from each other along one or more axes.

The above description is intended to supplement the many manufacturing procedures and yarn types described in U.S. Provisional Application No. 63/314,199, allowing a variety of yarns (e.g., as described with reference to Figures 3 to 7 of U.S. Provisional Application No. 63/314,199 The different yarn materials that can be used) and manufacturing procedures (e.g., laser cutting, die cutting, and forming electrical connections as generally discussed with reference to Figures 8 through 55 of U.S. Provisional Application No. 63/314,199) can be combined with other methods described herein. Fabric construction and manufacturing procedures are discussed therein, and U.S. Provisional Application No. 63/314,199 is incorporated by reference in its entirety.

Figure 11 illustrates a flowchart 1100 of a method for detecting forces received at a garment, according to some specific examples.

(A1) According to some embodiments, a method (1102) of detecting a force received at a garment includes receiving (1104) a force at a sensor integrated into the garment, wherein the capacitive sensor includes: using A first knitted conductive electrode layer constructed of an insulating conductive fabric, wherein the first knitted conductive electrode layer has a first surface, and a second knitted conductive electrode layer constructed using a non-insulating conductive fabric having a second surface, wherein the second surface is structured The sensor is produced in direct contact with a first surface (e.g., knitted onto the same layer as the first layer that is a structural component of a wearable device (e.g., a glove)). The method also includes, in response to receiving a force at the sensor, transmitting (1106) a value corresponding to the received force to the processor. The method then includes determining (1108), via the processor, the calculated force value. References B1 to B17 below provide more details about the capacitive sensor of A1. U.S. Provisional Application No. 63/314,199 provides further details regarding example materials for producing fabric-based electrodes such that any of the example materials shown and described in U.S. Provisional Application No. 63/314,199 may be combined with those described herein Other fabric structures and/or used in conjunction with the manufacturing procedures and techniques described herein, as an addition to or in lieu of the manufacturing procedures and techniques described herein. For example, consider the conductive yarns described in Figures 3 to 7 of U.S. Provisional Application No. 63/314,199 (eg, silvertech+150–22 Tex or Statex Shieldex yarn 235/36 1-Ply).

(B1) According to some specific examples, a garment-integrated capacitive sensor includes a first knitted conductive electrode layer constructed using an insulating conductive fabric (e.g., the insulating conductive fabric may be composed of a compressible/stretchable core (e.g., elastic fiber, Constructed from thermoplastic polyurethane (TPU), the insulating conductive fabric achieves yarn-level deformation, which enhances capacitive sensor performance. In some embodiments, high surface area insulated conductors (e.g., coated Enameled copper foil, etc.) further improves sensor performance. In some specific examples, compared with pure copper, tin-copper alloy and silver-copper alloy, when considering conductivity, cost and fatigue resistance, silver-copper alloy wire/ The foil provides balanced performance. A first knitted conductive electrode layer has a first surface. The apparel-integrated capacitive sensor also includes a second knitted conductive electrode layer constructed using a non-insulating conductive fabric with a second surface. The garment-integrated capacitive sensor is configured to be in direct contact with the first surface to produce a garment-integrated capacitive sensor. In some embodiments, the garment-integrated capacitive sensor is configured to communicate with the processor, and is configured to automatically The capacitive sensor integrated with the clothing receives the sensing value.

For example, FIGS. 1A-1D illustrate examples of apparel-integrated capacitive sensors integrated into wearable devices and their uses according to some specific examples.

In some embodiments, the second knitted conductive electrode layer is constructed using materials such as: silver, platinum, gold, and the like. In some embodiments, a coating/plating is applied at each fiber layer (eg, each fiber of a knitted conductive electrode is coated/plated). In some embodiments, weldable yarns enable easier electrical interconnection. In some embodiments, the second knitted conductive electrode layer is constructed using conductive yarns made of silver-coated nylon. In some embodiments, the first knitted conductive electrode layer and the second knitted conductive electrode layer are made of yarn/threads with a TPU core, and the TPU core allows for adjustable compressibility. In some embodiments, electrical interconnections are made using ultrasonic bonding. In some embodiments, a yarn wrapping/twisting machine is used to wrap conductive or insulating wire/foil around it.

Clothing-integrated capacitive sensors without a separate dielectric have the ability to more easily conform to the human body (for example, curved parts such as fingertips). In some embodiments, fabric sensors with customized shapes are seamlessly knitted as part of a substrate (eg, glove fingertips, wristband) that is constructed in a single manufacturing step (eg, a single knitting sequence). Some disadvantages of using dielectric films in sensor construction (such as 3-layer sensor geometries) mean that whenever a knitted sensor is required, the machine must be stopped and the dielectric film needs to be manually inserted between the electrodes . Another disadvantage of the three-layer design is that the dielectric film may not be inserted properly since the space for inserting the dielectric film is only a few millimeters. When the dielectric film is not inserted properly, the sensor can short circuit. Additionally, it is difficult to diagnose improper construction of a three-layer design until the entire glove/sensor fabric swatch has been knitted. Additionally, this step requires the preparation of custom-sized dielectric films to accommodate sensors of different shapes/sizes. Additionally, three-layer sensor configurations are more time-consuming to produce and more difficult to automate.

(B2) In some embodiments of B1, when processed by the processor, the sensed values may infer the force received at the garment-integrated capacitive sensor. For example, FIGS. 1C and 1D are shown in plots 121 and 126 , respectively, illustrating the determined force received at glove 100 .

(B3) In some embodiments of any of B1 to B2, the sensed value, when processed by the processor, may determine whether the apparel-integrated capacitive sensor is in contact with the surface. For example, FIG. 1C illustrates display of the letter "H" 125 on a display (eg, a real display or in an artificial reality) in response to glove 100 contacting surface 120 at locations corresponding to virtual keys of virtual keyboard 124. out of the monitor).

(B4) In some embodiments of any of B1 to B3, the processor further communicates with an artificial reality head-mounted device that displays the artificial reality, and the sensed value from the apparel-integrated capacitive sensor is used Change the visual appearance of artificial reality. Figure 1C shows an example of a glove providing input to a display via a virtual keyboard (eg, displaying the letter "H" 125 on the display).

(B5) In some embodiments of B1 to B4, clothing-integrated capacitive sensors are seamlessly knitted into fabrics that are not capacitive sensors. For example, FIGS. 1A and 1B illustrate a knitted wearable glove device 100 that includes one or more garment-integrated capacitive sensors, where the garment-integrated capacitive sensors are seamlessly integrated (e.g., at least one of the glove). One surface does not have raised beading/tissue for tying the glove strings to one or more garment-integrated capacitive sensors).

(B6) In some specific examples of B1 to B5, the clothing-integrated capacitive sensor is integrated into a wearable device (for example, the glove 100 shown in FIGS. 1A to 1D ), wherein the wearable device includes a plurality of A clothing-integrated capacitive sensor. In some embodiments, a plurality of apparel-integrated capacitive sensors may be divided into quadrants, where the quadrants are configured to wrap around a fingertip in a three-dimensional manner. In some embodiments, a plurality of apparel-integrated capacitive sensors are continuously knitted together.

(B7) In some embodiments of B1 to B6, each of the plurality of garment-integrated capacitive sensors can detect pressure covering an area between 0.5 and 15 cm ² .

(B8) In some embodiments of B1 to B7, the second surface is configured to be in direct contact with the first surface without a separate dielectric sheet. For example, FIG. 1A shows a double-layer capacitive sensor having a first knitted conductive electrode layer 108 constructed using an insulating conductive fabric and a second knitted conductive electrode layer constructed using a non-insulating conductive fabric. 110.

(B9) In some embodiments of B1 to B8, the garment-integrated capacitive sensor is integrated into a wearable glove (eg, the glove 100 in FIGS. 1A to 1D).

(B10) In some embodiments of B9, additional clothing-integrated capacitive sensors are integrated into wearable gloves (for example, Figures 1A and 1B show a plurality of clothing-integrated capacitive sensor assemblies (for example, Figures 102A to 102E in 1A and clothing-integrated capacitive sensors 116A to 116L in FIG. 1B).

(B11) In some embodiments of B10, the apparel-integrated capacitive sensor and additional apparel-integrated capacitive sensors are located in separate fingertips of the wearable glove (e.g., apparel-integrated capacitive sensor assembly 102A to 102E). In some embodiments, the sensors are located at the fingertips of the glove. In some embodiments, the sensor is located on the palm side of the hand or the dorsal side of the hand.

(B12) In some specific examples of B1 to B9, a v-shaped knitting machine is used to knit the garment-integrated capacitive sensor with the non-sensor portion of the garment (for example, Figure 2 shows the use of a multi-dimensional knitting machine to produce gloves ).

(B13) In some embodiments of B12, a v-shaped knitting machine is used to knit multiple garment-integrated capacitive sensors together with non-sensor parts of the garment (for example, Figure 2 shows the use of a multi-dimensional knitting machine to produce gloves. ).

(B14) In some embodiments of B13, a lock-key knitting pattern is used to knit multiple garment-integrated capacitive sensors together (e.g., a lock-key knitting pattern increases the effectiveness of multiple garment-integrated capacitive sensors). surface area, thereby improving performance). In some embodiments, lock-key knitting patterns may be applied to improve energy storage in parallel electrodes, knitted components for energy harvesting, and the like. Figure 1E illustrates a lock-and-key structure for connecting multiple integrated capacitive sensors.

(B15) In some embodiments of B1 to B9, the insulating conductive fabric is constructed from conductors coated with insulating material. For example, a first knitted conductive electrode layer 108 constructed using an insulating conductive fabric is discussed with reference to FIG. 1A.

(B16) In some embodiments of B15, the insulating material does not change the flexibility of the conductive fabric.

(B17) In some embodiments of B1 to B9, the insulating conductive fabric is constructed from a conductor having an insulating shield surrounding the conductive fabric.

Figure 12 illustrates a method flow diagram 1200 for manufacturing knitted fabrics including non-knitted structures, according to some specific examples.

(C1) According to some embodiments, a method (1200) of manufacturing a knitted fabric including a non-knitted structure includes knitting in accordance with a stylized knitting sequence for a V-shaped knitting machine (e.g., or any other suitable multi-dimensional knitting machine). Concurrently with the fabric structure (1200): providing (1204) a non-knitted structure to the V-shaped knitting machine at a point in time when the fabric structure has a first knitted portion, wherein the first knitted portion is formed based on a knitting pattern of the first type, and upon providing After the non-knitted structure, follow (1208) the stylized knitting sequence to automatically adjust the V-shaped knitting machine to use a second type of knitting pattern different from the first type of knitting pattern, so that the non-knitted structure is accommodated within the fabric structure and The first knitted portion is adjacent to the second knitted portion. For example, Figure 2 illustrates a multi-dimensional knitting machine 200 that includes a plurality of nonwoven insert components for inserting nonwoven components into knitted fabric. Figure 4 also illustrates an example of how non-knitted structures 408A and 408B may be knitted (ie, inserted into) a knitted structure 405 (eg, a glove).

(C2) In some embodiments of C1, the non-knitted structure is provided to the V-shaped knitting machine via an insertion device different from the V-shaped knitting machine (eg, Figure 4 illustrates the insertion assembly 402 corresponding to the multi-dimensional knitting machine 400).

(C3) In some embodiments of any one of C1 to C2, the insertion device passes through a V-shaped knitting machine.

(C4) In some embodiments of any of C1 to C3, the insertion device is attached to a V-knitting machine and feeds non-knitted structures to the V-knitting machine according to a stylized knitting sequence (e.g., illustrated in Figure 4 The insert assembly 402 may be mounted on one of the knitting beds of the multi-dimensional knitting machine 402).

(C5) In some embodiments of any one of C1 to C4, the first type of knitting pattern has a higher knitting density than the second type of knitting pattern.

(C6) In some specific examples of any of C1 to C5, the first type of knitting pattern uses more (or less) knitting pattern stretch types than the second type of knitting pattern (e.g., Figure 4 in the fourth As shown in pane 406D, the first knit pattern 414 has a tighter (eg, denser) fabric than the second knit pattern 416 to accommodate additional movement).

(C7) In some embodiments of any one of C1 to C6, the non-knitted structure is a flexible circuit board (eg, FIG. 4 shows the non-knitted structure 405 (eg, a printed circuit board) inserted into the knitted structure).

(C8) In some embodiments of any of C1 to C7, the non-knitted structure is a wire or wire bundle (eg, Figure 4 shows a non-knitted structure 405 (eg, a wire or wire bundle) being inserted into the knitted structure ).

(C9) In some embodiments of any of C1 to C8, the non-knitted structure is a semi-rigid support for providing rigidity to the fabric structure (e.g., Figure 4 shows a non-knitted structure 405 (e.g., a semi-rigid support) pieces) are being inserted into the knitted structure).

(C10) In some embodiments of any one of C1 to C9, the non-knitted structures within the first knitted portion and the second knitted portion have substantially the same stretchability (e.g., unidirectional or bidirectional stretch) . For example, Figures 5A-5B illustrate that a first knitted portion that does not include a non-knitted structure can stretch at the same rate as a second knitted portion that includes a non-knitted structure.

(C11) In some specific examples of any one of C1 to C10, including after providing a non-knitted structure to the V-shaped knitting machine at a point in time when the fabric structure has a first knitted portion formed based on a knitting pattern of the first type , and before following a programmed knitting sequence to automatically adjust the V-shaped knitting machine to use the second type of knitting pattern. In some embodiments, the method also includes automatically forming a transition zone after the programmed knitting sequence in which the fabric has a second type of knitting pattern, wherein the second type of knitting pattern allows for more movement of the non-knitted structure. For example, Figure 4 shows the knitting pattern changing to accommodate non-knitted structures 408A and 408B.

(C12) In some embodiments of any of C1 to C11, the non-knitted structure is inserted such that it follows a zigzag pattern along the axis, wherein the zigzag pattern allows the non-knitted structure to stretch along the axis with the knitted portion of the fabric structure . For example, Figures 5A-5B illustrate a zigzag pattern that allows the non-knitted structure 502 to move as the fabric is stretched without placing undue stress/strain on the non-knitted structure.

(C13) In some embodiments of any of C1 to C12, the second type of knit pattern may be a three-dimensional knit to allow non-knitted structures to be placed within the volume of the three-dimensional knit. Figures 10A-10B illustrate that three-dimensional portions 1004 and 1010A-1010C can be produced to accommodate one or more non-knitted structures.

(C14) In some embodiments of any of C1 to C13, the stylized knitting sequence for the V-knitting machine is configured to accommodate multiple non-knitted structures when knitting the fabric structure (e.g., Figure 4 illustrates non-knitted structures 408A and 408B) knitted into (ie, inserted into) knitted structure 405).

(C15) In some embodiments of C14, one of the plurality of non-knitted structures is a different material than the non-knitted structure (e.g., as discussed with reference to Figure 4, the non-knitted structure 405 can be a printed circuit board, wire, Wire bundles, semi-rigid supports, etc., which are of different materials).

(C16) In some specific examples of C14, one of the plurality of non-knitted structures has a different shape from the non-knitted structure (for example, Figure 4 shows a non-knitted structure (e.g., wire, flexible printed circuit board, etc.) structure The shape is different from a knitted structure (for example, a glove made of thread).

(C17) According to some specific examples, the knitted fabric device including the non-knitted structure is configured according to any one of C1 to C16.

(D1) According to some specific examples, a method of manufacturing a knitting machine includes providing a V-shaped knitting machine and attaching an insertion mechanism to the V-shaped knitting machine. The method also includes interconnecting the V-knitting machine and the insertion mechanism to a processor, wherein the processor is configured to cause execution of the method. The method includes, while knitting a fabric structure according to a stylized knitting sequence for a V-knitting machine: providing a non-knitted structure to the V-knitting machine at a point in time when the fabric structure has a first knitted portion, the first knitted portion being based on the first type of knitting pattern to form, and after providing the non-knitted structure, following a programmed knitting sequence to automatically adjust the V-shaped knitting machine to use a second type of knitting pattern that is different from the first type of knitting pattern, so that the non-knitted structure Housed within a second knitted portion adjacent the first knitted portion within the fabric structure.

Figure 13 illustrates a method 1300 of a flow chart for knitting a dual density fabric including an overmolded structure, according to some specific examples.

(E1) According to some specific examples, a method (1300) of knitting a double density fabric (1302), the method comprising, while (1304) knitting a fabric structure using a stylized knitting sequence of a V-shaped knitting machine: knitting (1306) having A first portion of a fabric structure of a first fabric density to include a three-dimensional pocket (e.g., the first fabric component 702 is stitched in a manner to produce a three-dimensional pocket as described with reference to the discussion of FIGS. 7A-7G ), and automatically based on a programmed knitting sequence ( 1308 ) adjust the V-shaped knitting machine to knit a second portion of the fabric structure having a second fabric density that is different from the first fabric density adjacent the first portion of the fabric structure (e.g., Figures 7A to Figure 7G shows a second fabric component 704, which is a temporary piece). In some specific examples, the second section is knitted first. For example, knitting a second portion of a fabric structure having a second fabric density, and automatically adjusting a V-shaped knitting machine based on a programmed knitting sequence to knit the first portion of the fabric structure to include a three-dimensional pocket, the three-dimensional pocket having a shape different from The first fabric density of the second fabric density is adjacent to the first portion of the fabric structure. The method also includes overmolding (1310) a polymeric overmolding structure into the three-dimensional pocket (e.g., Figures 7F-7G illustrate that may be configured to include a matrix of tactile feedback generators (e.g., as provided by bubble array 717 The overmold structure 714 illustrated), wherein the second portion of the fabric structure is temporarily secured to a device configured to attach the overmold structure to the three-dimensional pocket. The method also includes removing (1312) a second portion of the fabric structure (e.g., Figure 7G shows two ropes 718A and 718B being pulled from the knitted structure 700, and thus the first fabric component 702 and the second fabric component 704 are separated from each other. ).

(E2) In some embodiments of E1, the three-dimensional pocket is configured to accommodate one or more sensors. For example, FIG. 7F includes an overmold structure 714 that may include one or more sensors (eg, embedded sensors).

(E3) In some embodiments of E2, the one or more sensors are neuromuscular sensors, and the neuromuscular sensors are configured to detect one or more neuromuscular signals of the user. For example, FIG. 7F includes an overmolded structure 714 that may include one or more sensors, where the sensors are neuromuscular signal sensors.

(E4) In some embodiments of E2, the one or more sensors are non-neuromuscular sensors, and the non-neuromuscular sensors are configured to detect one or more non-neuromuscular sensors associated with the user. Neuromuscular signaling. For example, FIG. 7F includes an overmolded structure 714 that may include one or more sensors, where the sensors are neuromuscular signal sensors (eg, temperature sensors, inertial measurement sensors, wait).

(E5) In some embodiments of any of E1 to E2, the polymer overmolded structure is a component of a tactile feedback generating system. For example, FIG. 7F includes an overmolded structure 714 that may include one or more tactile feedback generators (eg, as illustrated by bubble array 717).

(E6) In some embodiments of E5, the tactile feedback generating system is a pressure-activated system (eg, a pneumatic or hydraulic system).

(E7) In some embodiments of E5, the tactile feedback generating system is an electrically activated system (eg, a dielectric elastomer actuator (DEA)).

(E8) In some embodiments of E5, the tactile feedback generation system includes a matrix of tactile feedback generators (eg, expandable bubbles for applying pressure to the user's skin). For example, Figure 7F shows bubble array 717.

(E9) In some embodiments of any of E1 to E2, fabric density is determined by a combination of material weight and stitching. For example, Figures 6A-6H illustrate various types of stitches with different pitches.

(E10) In some embodiments of any of E1 to E2, the fabric structure is placed (e.g., automatically) in an injection molding machine prior to overmolding the polymeric overmolding structure into the three-dimensional pocket. (eg, Figure 7D illustrates knitted structure 700 inserted into overmolding machine 708).

(E11) In some embodiments of E10, placement of the fabric structure in the injection molding machine is accomplished based on knitting position guides (eg, holes in the fabric) integrated into the second part of the fabric structure. For example, Figure 7D shows a second fabric component 704 that includes guide holes 706A-706L corresponding to positioning pins 712A-712L.

(E12) In some embodiments of E11, guides are holes (or marks (e.g., different colored threads) or fabric bumps) used to secure the fabric structure in a specific position within the injection molding machine. In some embodiments, the holes are automatically knitted into the second fabric structure. For example, FIG. 7D shows positioning pins 712A to 712L inserted into the guide holes 706A-706L of the second fabric component 704 to ensure that the overmolding machine 708 correctly places the overmolding structure on the first fabric component 702 superior.

(E13) In some embodiments of any of E1 to E2, removing the second portion of the fabric structure does not damage the first portion of the fabric structure.

(E14) In some embodiments of E13, removal of the second portion of the fabric structure is accomplished by removing the removable attachment cord (e.g., Figure 7F also shows two cords 718A and 718B, which are assembled (the only cord used to attach the first fabric component 702 and the second fabric component 704). In some embodiments of E13, removing the second portion of the fabric structure is accomplished by uncoupling the second portion of the fabric structure while pulling on the cord.

(E15) In some embodiments of E14, the removable attachment thread is a single thread. For example, referring to the discussion of Figure 7G, alternative embodiments may include a single cord that may be configured to separate the first fabric component 702 from the second fabric component.

(E16) In some embodiments of any of E1 to E2, the first portion of the fabric structure includes a third density that is different from the first density. For example, the portion of the first fabric component having pockets (eg, three-dimensional pockets) may be implemented by changing the density of the fabric, similar to the three-dimensional pockets described with reference to Figures 10A-10B.

(E17) In some embodiments of any of E1 to E2, the first portion of the fabric structure includes one or more stress relief holes (or cuts) for wrapping the second fabric structure around the user's finger (e.g., refer to Figure 7C depicts one or more stress relief holes 707).

(E18) In some embodiments of any of E1 to E2, the first portion of the fabric is configured to wick moisture away from the polymer overmolded structure. In some embodiments, reducing moisture improves the performance of the tactile feedback generator.

(E19) According to some specific examples, the knitted dual-density fabric structure including the overmolded structure is configured according to any one of E1 to E18.

Another specific example of an electrically conductive deformable fabric will now be discussed below.

(F1) According to some specific examples, a wearable device includes a conductive deformable fabric (eg, FIGS. 8A-8B illustrates a device including one or more portions made of a conductive deformable fabric (eg, conductive deformable fabric portion 802) A fabric structure (eg, glove 800), and the conductive deformable fabric includes conductive traces having an inextensible fixed length along the first axis. The conductive traces are knitted into the fabric structure to create the conductive deformable Material. The fabric structure includes a weave pattern that promotes the expansion and folding of the conductive traces in an oscillatory manner to allow the conductive traces to expand and contract, respectively, along the first axis without exceeding a fixed length of the conductive traces, and the conductivity can The deformable material is located within the wearable device so that when the wearable device is worn, the tissue pattern is positioned over the user's joints, allowing the tissue pattern to expand or contract with the movement of the joint. While the joints are used to bend and cause the tissue to The pattern is a primary example of stretching a part of the body, but one of ordinary skill in the art will understand that the same principles can be applied to any part of the body that bends, expands, contracts, twists, etc. For example, Figures 9A to Figure 9C illustrates a fabric structure 900 that includes one or more portions made of conductive deformable fabric 902 and is configured to have bidirectional stretch.

(F2) In some embodiments of F1, the tissue pattern further promotes expansion and contraction of the conductive traces along a second axis perpendicular to the first axis without exceeding a fixed length of the conductive traces. For example, Figure 9C shows the fabric structure 900 in an extended state along both the x-axis and the y-axis.

(F3) In some embodiments of any of F1 to F2, the weave pattern of the fabric structure allows the fabric structure to be folded via alternating folds in which the conductive traces are folded along with the fabric structure. For example, Figures 9A-9C illustrate how conductive deformable fabric 902 is folded along with the fabric structure.

(F4) In some embodiments of any of F1 to F3, the fabric structure includes an elastic band that allows the conductive deformable fabric to return to a preset state.

(F5) In some embodiments of any of F1 through F4, the conductive traces are linear along the first axis along an inextensible fixed length (eg, Figures 9A through 9C illustrate conductive deformable fabric 902 linear along the first axis).

(F6) In some embodiments of any of F1 to F5, the weave pattern of the fabric structure is a plain stitch pattern (eg, a plain stitch weave, such as that described with reference to Figures 6A to 6H).

(F7) In some embodiments of any of F1 to F6, conductive traces are embroidered onto the fabric structure (e.g., Figures 8A-8B illustrate a fabric structure that includes one or more portions made of conductive deformable fabric fabric structure (e.g., gloves 800)).

(F8) In some embodiments of any of F1 to F7, a portion of the conductive trace is configured to attach to a neuromuscular signal sensor (e.g., an electrode (e.g., a soft electrode made of FKM) ).

(F9) In some embodiments of any of F1 to F8, the conductive traces are insulated copper magnet wires.

(F10) In some embodiments of any of F1 to F9, the wearable device is machine washable.

(F11) In some embodiments of any of F1 through F10, the electrically conductive deformable fabric is configured to shrink to a size that is 300% less than the fixed length of the conductive traces (e.g., Figures 9A through 9C illustrate the inclusion of A fabric structure (e.g., glove 800) made of one or more portions of a conductive deformable fabric that is configured to shrink to a size that is 300% less than the length of the conductive deformable fabric when fully extended) .

(F12) In some embodiments of any of F1 to F11, the first portion of the conductive trace is configured to contact the second portion of the conductive trace without electrically shorting.

(F13) In some embodiments of any of F1 to F12, the electrically conductive deformable fabric is configured to expand and fold in an oscillating manner for 8,000 to 20,000 cycles without performance degradation.

(F14) In some embodiments of any of F1 to F13, the resistivity of the conductive trace increases (or decreases) along a fixed length of the conductive trace according to the width of the conductive trace (e.g., thereby allowing Posture determination based on the resulting value of the resistivity change). For example, FIGS. 8A to 9C each illustrate how to calculate a strain value based on a change in resistivity based on a length change (eg, expansion) of a conductive deformable fabric.

(F15) In some embodiments of any of F1 to F14, the unfolding and folding in an oscillating manner follows an origami-based folding technique.

(F16) In some embodiments of any of F1 to F15, the conductive traces provide signals that can be used to determine the amount of strain at a fabric structure (eg, and thus at a wearable device). For example, FIGS. 8A to 9C each illustrate how to calculate a strain value based on a change in resistivity based on a length change (eg, expansion) of a conductive deformable fabric.

(F17) In some specific examples of F16, the amount of strain on the fabric structure is used to determine the motion of joints used to interact with the artificial reality environment. 8A-8B illustrate a user 801 wearing the artificial reality headset 103, and input to the artificial reality environment can be generated based on changes in the resistivity of his unfolded gloves.

The features described above with reference to A1 to F17 are interchangeable. For example, any technology involving multi-dimensional knitting machines can be used to produce any of the knitted fabrics/apparel described in references A1 to F17.

Those of ordinary skill in the art will appreciate that the methods of use, manufacturing methods and devices described above can be incorporated into a single wearable device and the manufacturing process of that device. For example, the knitting machine produced by the method of manufacturing a knitting machine described in reference D1 can be used to produce a wearable device (eg, a glove), the wearable device including two or more of the following: reference A1 to B17 The described force sensing device includes a knitted fabric of non-knitted structure produced by the manufacturing method described in references C1 to C16, a dual-density fabric described in the method described in references E1 to E18, and/or includes a knitted fabric of non-knitted structure produced by the manufacturing method described in references E1 to E18, and/or includes a knitted fabric of non-knitted structure produced by the manufacturing method described in references C1 to C16. Wearable device of conductive deformable fabric as described in F17.

In other embodiments described in US Provisional Application No. 63/314,199, a wristband may be provided. The wristband may include a fabric body; fabric electrodes located at a surface of the fabric body; a flexible printed circuit; and fabric conductive traces electrically connecting the fabric electrodes to the flexible printed circuit. The fabric conductive traces can be integrated into the knitted structure using the techniques described above, and additional details regarding the wristband are provided as described in U.S. Provisional Application No. 63/314,199. Fabric electrodes may be positioned along the inner surface of the fabric body. Fabric electrodes may include conductive yarns (such as described in US Provisional Application No. 63/314,199). The fabric body and fabric electrodes may be formed using a method selected from the group consisting of knitting, woven and embroidery. Flexible printed circuits can be integrated into the fabric body.

In another aspect, also described in US Provisional Application No. 63/314,199, fabric electrodes may be provided, including knitted, woven or embroidered fabrics.

The knitted structures described above can be implemented in a variety of forms and can be used in conjunction with artificial reality systems (eg, to provide soft wearable gloves for use as input and sensing devices with artificial reality systems). Accordingly, examples of wrist wearable devices, head-mounted devices, systems, and tactile feedback devices are described below to provide further context for systems in which the techniques described herein may be utilized. The specific operations described above may occur as a result of specific hardware, such hardware being described in further detail below. The devices described below are not limiting and features on these devices may be removed or additional features may be added to these devices. Example wrist wearable device

14A and 14B illustrate an example wrist wearable device 1450 according to some specific examples. Wrist wearable device 1450 is an example of a wearable device described herein, such that the wearable device should be understood to have the characteristics of wrist wearable device 1450 and vice versa. 14A illustrates a perspective view of a wrist wearable device 1450 that includes a watch body 1454 coupled to a watch band 1462. Watch body 1454 and band 1462 may have a substantially rectangular or circular shape and may be configured to allow a user to wear wrist wearable device 1450 on a body part such as a wrist. The wrist wearable device 1450 may include a retention mechanism 1467 (eg, loop buckle, press-fit strap fastener, etc.) for securing the watch band 1462 to the user's wrist. Wrist wearable device 1450 may also include a coupling mechanism 1460 (eg, a loop) for detachably coupling capsule or watch body 1454 (via a coupling surface of watch body 1454) to watch band 1462.

The wrist wearable device 1450 can perform various functions associated with navigating through the user interface and selectively opening applications. As will be described in greater detail below, operations performed by wrist wearable device 1450 may include, but are not limited to, displaying visual content to a user (e.g., visual content displayed on display 1456); sensing user input (e.g., sensing Touch on the peripheral button 1468, sensing biometric measurement data on the sensor 1464, sensing neuromuscular signals on the neuromuscular sensor 1465, etc.); message transmission (for example, text, voice, audio, etc.) ); image capture; wireless communications (e.g., cellular, near field, Wi-Fi, personal area network, etc.); location determination; financial transactions; providing tactile feedback; alarms; notifications; biometric measurement and identification; health monitoring; sleep monitoring; etc. These functions may be performed independently in the watch body 1454, independently in the watch band 1462, and/or in communication between the watch body 1454 and the watch band 1462. In some specific examples, functions can be performed on the wrist wearable device 1450 in conjunction with an artificial reality environment, including but not limited to a virtual reality (VR) environment (including non-immersive, semi-immersive and fully immersive). Immersive VR environment); augmented reality environment (including marker-based augmented reality environment, marker-less augmented reality environment, location-based augmented reality environment and projection-based augmented reality environment); Composite reality; and other types of mixed reality environments. As one of ordinary skill in the art will appreciate upon reading the description provided herein, the novel wearable devices described herein may be used with any of these types of artificial reality environments.

Watch band 1462 may be configured to be worn by a user such that the inner surface of watch band 1462 is in contact with the user's skin. When worn by the user, the sensor 1464 comes into contact with the user's skin. The sensor 1464 may be a biosensor that senses the user's heart rate, saturated oxygen level, temperature, sweat level, muscle effort, or a combination thereof. The watch band 1462 may include a plurality of sensors 1464, and the sensors may be distributed on the inner surface and/or the outer surface of the watch band 1462. Additionally or alternatively, watch body 1454 may include the same or different sensors as watch band 1462 (or in some embodiments, watch band 1462 may not include any sensors at all). For example, multiple sensors may be distributed on the inner surface and/or outer surface of the watch body 1454. As described below with reference to FIG. 14B and/or FIG. 14C , the watch body 1454 may include but is not limited to a front image sensor 1425A and/or a back image sensor 1425B, a biometric measurement sensor, an IMU, and a heart rate sensor. sensor, saturation oxygen sensor, neuromuscular sensor, altimeter sensor, temperature sensor, bioimpedance sensor, pedometer sensor, optical sensor (e.g., imaging sensor 14104) , touch sensors, sweat sensors, etc. Sensors 1464 may also include sensors that provide data about the user's environment, including the user's movement (eg, IMU), height, position, orientation, gait, or combinations thereof. Sensor 1464 may also include a light sensor (eg, infrared light sensor, visible light sensor) configured to track the position and/or movement of watch body 1454 and/or watch band 1462 . The watch band 1462 may use a wired communication method (e.g., universal asynchronous receiver/transmitter (UART), USB transceiver, etc.) and/or a wireless communication method (e.g., near field communication, Bluetooth, etc.) to connect the sensor 1464 to the sensor 1464 . The acquired data is transferred to table body 1454. Watch band 1462 may be configured to operate independently of whether watch body 1454 is coupled to or detached from watch band 1462 (eg, using sensors 1464 to collect data).

In some examples, watch band 1462 may include neuromuscular sensors 1465 (eg, EMG sensors, mechanical myocardial (MMG) sensors, sonomyotropic (SMG) sensors, etc.). The neuromuscular sensor 1465 can sense the user's intention to perform certain motor actions. The sensed muscle intent may be used to control certain user interfaces displayed on display 1456 of wrist wearable device 1450 and/or may be transmitted to a device responsible for presenting the artificial reality environment (e.g., a head-mounted display) to Actions are performed within the associated artificial reality environment, such as to control motion of a virtual device displayed to the user.

Signals from neuromuscular sensors 1465 may be used to provide users with enhanced interactions with physical objects and/or virtual objects in artificial reality applications generated by the artificial reality system (e.g., on display 1456 or another computing device (e.g., a user interface object presented on a smartphone). Signals from neuromuscular sensors 1465 may be obtained (eg, sensed and recorded) by one or more neuromuscular sensors 1465 of watchband 1462 . Although FIG. 14A shows one neuromuscular sensor 1465, the watch band 1462 may include a plurality of neuromuscular sensors 1465 circumferentially arranged on the inner surface of the watch band 1462 such that the plurality of neuromuscular sensors 1465 are in contact. The user's skin. The watch band 1462 may include a plurality of neuromuscular sensors 1465 circumferentially disposed on an inner surface of the watch band 1462 . Neuromuscular sensor 1465 can sense and record neuromuscular signals from the user when the user performs muscle activation (eg, movement, gesture, etc.). Muscle activation performed by the user may include static gestures, such as placing the user's palm down on a table; dynamic gestures, such as grasping a physical or virtual object; and covert gestures that are not detectable by another person, such as by co-contracting opposite directions. muscles or use submuscular activation to slightly tighten the joint. Muscle activations performed by a user may include symbolic gestures (eg, gestures that map to other gestures, interactions, or commands, eg, based on a gesture vocabulary that specifies the mapping of gestures to commands).

Watch band 1462 and/or watch body 1454 may include a haptic device 1463 (eg, vibrotactile actuator) configured to provide tactile feedback (eg, cutaneous and/or kinesthetic sensations, etc.) to the user skin. Sensors 1464 and 1465 and/or haptic device 1463 may be configured to operate in conjunction with multiple applications, including but not limited to health monitoring, social media, game playing, and artificial reality (e.g., applications associated with artificial reality) program).

Wrist wearable device 1450 may include a coupling mechanism (also referred to as a loop) for removably coupling watch body 1454 to watch band 1462 . The user can separate the watch body 1454 from the watch band 1462 to reduce the obstruction of the wrist wearable device 1450 to the user. Wrist wearable device 1450 may include coupling surfaces on watch body 1454 and/or coupling mechanisms 1460 (eg, loops, tracking straps, support bases, buckles). The user can perform any type of action to couple the watch body 1454 to the watch band 1462 and to decouple the watch body 1454 from the watch band 1462 . For example, the user may twist, slide, rotate, push, pull, or rotate the watch body 1454 relative to the watch band 1462, or a combination thereof, to attach the watch body 1454 to the watch band 1462 and to remove the watch body 1454 from the watch band 1462. With 1462 separated.

As shown in the example of FIG. 14A , watchband coupling mechanism 1460 may include a type of frame or housing that allows the coupling surface of watch body 1454 to be retained within watchband coupling mechanism 1460 . The watch body 1454 may be removably coupled by a friction fit, magnetic coupling, rotation-based connector, shear pin coupler, retaining spring, one or more magnets, clips, pins, hook and loop fasteners, or combinations thereof to strap 1462. In some examples, watch body 1454 can be decoupled from watch band 1462 by actuation of release mechanism 1470. Release mechanism 1470 may include, but is not limited to, a button, knob, plunger, handle, lever, fastener, buckle, dial, latch, or combinations thereof.

As shown in FIGS. 14A-14B , coupling mechanism 1460 may be configured to accept coupling proximate the bottom side of surface body 1454 (eg, the side opposite the front side of surface body 1454 on which display 1456 is located). surface, so that the user can push the watch body 1454 down into the coupling mechanism 1460 to attach the watch body 1454 to the coupling mechanism 1460 . In some embodiments, the coupling mechanism 1460 may be configured to receive the top side of the watch body 1454 (eg, the side close to the front side of the watch body 1454 on which the display 1456 is located), which is pushed upward into the hoop. As opposed to being pushed down into the coupling mechanism 1460 . In some embodiments, coupling mechanism 1460 is an integral component of watch band 1462 such that watch band 1462 and coupling mechanism 1460 are a single unitary structure.

The wrist wearable device 1450 may include a single release mechanism 1470 or multiple release mechanisms 1470 (eg, two release mechanisms 1470 located on opposite sides of the wrist wearable device 1450, such as a spring-loaded button). As shown in Figure 14A, the release mechanism 1470 may be located on the watch body 1454 and/or the watch band coupling mechanism 1460. Although FIG. 14A shows that the release mechanism 1470 is located at a corner of the watch body 1454 and a corner of the band coupling mechanism 1460, the release mechanism 1470 can be located on the watch body 1454 and/or the band coupling mechanism 1460 to facilitate wrist movement. Any position where the user of wearable device 1450 actuates. The user of wrist wearable device 1450 can actuate release mechanism 1470 by pushing, turning, lifting, depressing, moving, or performing other actions on release mechanism 1470 . Actuation of the release mechanism 1470 may release (eg, decouple) the watch body 1454 from the watch band coupling mechanism 1460 and the watch band 1462, thereby allowing the user to use the watch body 1454 independently of the watch band 1462. For example, decoupling the watch body 1454 from the watch band 1462 may allow the user to capture images using the rear-facing image sensor 1425B.

14B includes a top view of an example of a wrist wearable device 1450. An example of the wrist wearable device 1450 shown in FIGS. 14A-14B may include a coupling mechanism 1460 (as shown in FIG. 14B , the coupling mechanism may be shaped to correspond to the surface body 1454 of the wrist wearable device 1450 shape). Body 1454 may be removable by friction fit, magnetic coupling, rotation-based connector, shear pin coupler, retaining spring, one or more magnets, clips, pins, hook and loop fasteners, or any combination thereof Coupled to coupling structure 1460.

In some examples, watch body 1454 can be decoupled from coupling mechanism 1460 by actuation of release mechanism 1470 . Release mechanism 1470 may include, but is not limited to, a button, knob, plunger, handle, lever, fastener, buckle, dial, latch, or combinations thereof. In some examples, wristband system functions may be performed independently in the watch body 1454, independently in the coupling mechanism 1460, and/or in communication between the watch body 1454 and the coupling mechanism 1460. Coupling mechanism 1460 may be configured to operate independently of watch body 1454 (eg, perform functions independently). Additionally or alternatively, watch body 1454 may be configured to operate independently of coupling mechanism 1460 (eg, perform functions independently). As described below with reference to the block diagram of Figure 14A, coupling mechanism 1460 and/or surface body 1454 may each include independent resources required to independently perform functions. For example, coupling mechanism 1460 and/or watch body 1454 may each include a power source (eg, battery), memory, data storage, processor (eg, central processing unit (CPU)), communications, light source, and/or Input/output devices.

The wrist wearable device 1450 may have various peripheral buttons 1472, 1474, and 1476 for performing various operations at the wrist wearable device 1450. Additionally, various sensors, including one or both of sensors 1464 and 1465, may be located on the bottom of watch body 1454 and may be optionally used even when watch body 1454 is separated from watch band 1462.

Figure 14C is a block diagram of a computing system 14000 in accordance with at least one embodiment of the present disclosure. Computing system 14000 includes an electronic device 14002, which may be, for example, a wrist wearable device. The wrist wearable device 1450 described in detail above with respect to FIGS. 14A-14B is an example of an electronic device 14002, and thus the electronic device 14002 will be understood to include the components shown and described below with respect to the computing system 14000. In some embodiments, all or most of the components of computing system 14000 are included in a single integrated circuit. In some embodiments, the computing system 14000 may have a split architecture between the watch body (eg, watch body 1454 in FIGS. 14A-14B) and the watch band (eg, watch band 1462 in FIGS. 14A-14B). For example, split mechanical architecture, split electrical architecture). Electronic device 14002 may include a processor (eg, central processing unit 14004), a controller 14010, a peripheral interface 14014 including one or more sensors 14100 and various peripheral devices, a power source (eg, power system 14300), and operations including Memory (eg, memory 14400) for the system (eg, operating system 14402), data (eg, data 14410), and one or more applications (eg, application 14430).

In some embodiments, computing system 14000 includes a power system 14300 that includes a charger input 14302, a power management integrated circuit (PMIC) 14304, and a battery 14306.

In some specific examples, the watch body and the watch band can each be an electronic device 14002. Each electronic device has a separate battery (eg, battery 14306) and can share power with each other. The watch body and strap can receive electrical charges using a variety of techniques. In some specific examples, the watch body and the watch band may use a wired charging assembly (eg, a power cord) to receive charge. Alternatively or additionally, the watch body and/or band may be configured for wireless charging. For example, a portable charging device may be designed to mate with a portion of the watch body and/or watch band and wirelessly deliver available power to the battery of the watch body and/or watch band.

The watch body and watch band can have independent power systems 14300 so that they can operate independently. The watch body and band can also share power via separate PMICs 14304 (e.g., one can charge the other), which can share power via power and ground conductors and/or via wireless charging antennas.

In some examples, peripheral interface 14014 may include one or more sensors 14100. Sensors 14100 may include coupling sensors 14102 for detecting when electronic device 14002 is coupled to another electronic device 14002 (eg, a watch body may detect when it is coupled to a watch band and vice versa). Sensor 14100 may include an imaging sensor 14104, which may be the same device as one or more cameras 14218, for collecting imaging data. In some embodiments, imaging sensor 14104 may be separate from camera 14218. In some embodiments, the sensor includes SpO2 sensor 14106. In some embodiments, the sensor 14100 includes an EMG sensor 14108 for detecting muscle movements of, for example, a user of the electronic device 14002. In some embodiments, the sensor 14100 includes a capacitive sensor 14110 for detecting potential changes in a part of the user's body. In some embodiments, sensor 14100 includes heart rate sensor 14112. In some embodiments, the sensor 5100 includes an inertial measurement unit (IMU) sensor 14114 for detecting changes in acceleration of a user's hand, for example.

In some embodiments, peripheral interface 14014 includes near field communication (NFC) component 14202, global positioning system (GPS) component 14204, long term evolution (LTE) component 14206, and/or Wi-Fi or Bluetooth communication component 14208.

In some embodiments, the peripheral interface includes one or more buttons (eg, peripheral device buttons 1457, 1458, and 1459 in Figure 14B) that, when selected by the user, cause operations to be performed at electronic device 14002.

The electronic device 14002 may include at least one display 14212 for displaying visual affordances to the user, including user interface elements and/or three-dimensional virtual objects. The display may also include a touch screen for inputting user input, such as touch gestures, toggle gestures, and the like.

The electronic device 14002 may include at least one speaker 14214 and at least one microphone 14216 for providing audio signals to the user and receiving audio input from the user. The user can provide user input via microphone 14216 and can also receive audio output from speaker 14214 as part of the haptic events provided by haptic controller 14012.

The electronic device 14002 may include at least one camera 14218, including a front camera 14220 and a rear camera 14222. In some embodiments, electronic device 14002 may be a head wearable device, and one of cameras 14218 may be integrated with a lens assembly of the head wearable device.

One or more of the electronic devices 14002 may include one or more haptic controllers 14012 and for providing haptic events (e.g., vibration sensations in response to events at the electronic device 14002 ) at one or more of the electronic devices 14002 or audio output) associated component parts. The haptic controller 14012 may communicate with one or more electroacoustic devices, including one or more speakers 14214 and/or other audio components and/or electromechanical devices that convert energy into linear motion, such as motors, solenoids, Electroactive polymers, piezoelectric actuators, electrostatic actuators, or other tactile output-generating components (e.g., components that convert electrical signals into tactile output on a device). Tactile controller 14012 can provide tactile events that can be sensed by a user of electronic device 14002 . In some examples, one or more haptic controllers 14012 may receive input signals from applications in applications 14430.

Memory 14400 optionally includes high-speed random access memory, and optionally also includes non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Access to memory 14400 by other components of electronic device 14002 (such as one or more processors of central processing unit 14004) and peripheral device interface 14014 is optionally controlled by the memory controller of controller 14010.

In some examples, the software components stored in the memory 14400 may include one or more operating systems 14402 (eg, Linux-based operating systems, Android operating systems, etc.). Memory 14400 may also include data 14410, including structured data (eg, SQL database, MongoDB database, GraphQL data, JSON data, etc.). Data 14410 may include profile data 14412, sensor data 14414, and media profile data 14414.

In some embodiments, software components stored in memory 14400 include one or more applications 14430 configured to perform operations at electronic device 14002 . In some specific examples, one or more applications 14430 include one or more communication interface modules 14432, one or more graphics modules 14434, and one or more camera application modules 14436. In some embodiments, a plurality of applications 14430 may work in conjunction with each other to perform various tasks at one or more of the electronic devices 14002 .

It should be understood that electronic devices 14002 are only some examples of electronic devices 14002 within computing system 14000 and that other electronic devices 14002 that are part of computing system 14000 may have more or fewer components than shown, combining the two as appropriate. or more than two components, or components with different configurations or configurations as the case may be. The various components shown in Figure 14C are implemented in hardware, software, firmware, or a combination thereof, and include one or more signal processing and/or application specific integrated circuits.

As illustrated by the lower portion of Figure 14C, the various individual components of the wrist wearable device may be examples of electronic device 14002. For example, some or all of the components shown in electronic device 14002 may be housed or otherwise positioned in combination watch device 14002A, or within individual components of capsule device body 14002B, frame portion 14002C, and/or watch band. .

Figure 14D illustrates a wearable device 14170 according to some specific examples. In some embodiments, wearable device 14170 is used to generate control information (e.g., sensed data regarding neuromuscular signals or instructions to execute certain commands after sensing the data) to cause the computing device to perform one or more Enter the command. In some embodiments, wearable device 14170 includes a plurality of neuromuscular sensors 14176. In some embodiments, the plurality of neuromuscular sensors 14176 includes a predetermined number (eg, 16) of neuromuscular sensors (eg, EMG sensors) circumferentially arranged around the elastic band 14174 . The plurality of neuromuscular sensors 14176 may include any suitable number of neuromuscular sensors. In some embodiments, the number and configuration of neuromuscular sensors 14176 depends on the specific application in which wearable device 14170 is used. For example, a wearable device 14170 configured as an armband, wristband, or chest strap may include a plurality of neuromuscular sensors 14176 with different numbers of neuromuscular sensors and different sensors for each use case. Configurations such as medical use cases compared to gaming or general daily use cases. For example, at least 16 neuromuscular sensors 14176 may be circumferentially disposed around elastic band 14174.

In some embodiments, elastic band 14174 is configured to be worn around the user's lower arm or wrist. Elastic band 14174 may include a flexible electronic connector 14172. In some embodiments, flexible electronic connectors 14172 interconnect individual sensors and electronic circuitry enclosed in one or more sensor housings. Alternatively, in some embodiments, flexible electronic connectors 14172 interconnect individual sensors and electronic circuitry outside one or more sensor housings. Each neuromuscular sensor of plurality of neuromuscular sensors 14176 may include a skin contact surface including one or more electrodes. One or more of the plurality of neuromuscular sensors 14176 may be coupled together using soft electronics incorporated into the wearable device 14170 . In some embodiments, one or more of the neuromuscular sensors 14176 can be integrated into a knitted fabric, wherein one or more of the neuromuscular sensors 14176 are Knitted into the fabric and mimic the flexibility of the fabric (eg, one or more of the plurality of neuromuscular sensors 14176 may be constructed from a series of knitted yarn strands). In some embodiments, the sensor is flush with the surface of the fabric and is indistinguishable from the fabric when worn by the user.

Figure 14E illustrates a wearable device 14179 according to some specific examples. Wearable device 14179 includes paired sensor channels 14185a - 14185f along the inner surface of wearable structure 14175 that are configured to detect neuromuscular signals. Different numbers of paired sensor channels may be used (eg, one pair of sensors, three pairs of sensors, four pairs of sensors, or six pairs of sensors). The wearable structure 14175 may include a strap portion 14190, a capsule portion 14195, and a loop portion (not shown) coupled to the strap portion 14190 to allow the capsule portion 14195 to be removably coupled with the strap portion 14190. For embodiments in which capsule portion 14195 is removable, capsule portion 14195 may be referred to as a removable structure, such that in such embodiments, the wearable device includes a wearable portion (eg, strap portion 14190 and loop portion) and Removable structure (removable capsule part that can be removed from the hoop). In some embodiments, capsule portion 14195 includes one or more processors and/or other components of wearable device 1688 described above with reference to Figures 16A and 16B. Wearable structure 14175 is configured to be worn by user 1611 . More specifically, the wearable structure 14175 is configured to couple the wearable device 14179 to the wrist, arm, forearm, or other part of the user's body. Each paired sensor channel 14185a-14185f includes two electrodes 14180 (eg, electrodes 14180a-14180h) for sensing neuromuscular signals based on differential sensing within the respective corresponding sensor channel. According to some specific examples, wearable device 14170 further includes electrical ground and shielding electrodes.

Techniques as described above may be used with any device for sensing neuromuscular signals, including the arm wearable devices of Figures 14A-14C, but may also be used with other types of wearable devices for sensing neuromuscular signals. devices (such as body wearable or head wearable devices that may have neuromuscular sensors closer to the brain or spine).

In some embodiments, a wrist wearable device may be used in conjunction with a head wearable device described below, and the wrist wearable device may also be configured to allow the user to control aspects of the artificial reality ( For example, by using EMG-based gestures to control user interface objects in the artificial reality and/or by allowing the user to interact with the touch screen on a wrist wearable device to control aspects of the artificial reality). Having thus described example wrist wearable devices, attention now turns to example head wearable devices, such as AR glasses and VR headsets. Example head wearable device

15A illustrates an example AR system 1500 that can be controlled through the use of knitted structures (eg, wearable gloves or other wearable structures formed according to knitting techniques described herein), according to some specific examples. In Figure 15A, AR system 1500 includes an eyeglass device having a frame 1502 configured to hold left display device 1506-1 and right display device 1506-2 in front of the user's eyes. Display devices 1506-1 and 1506-2 can act together or independently to present an image or series of images to a user. Although AR system 1500 includes two displays, embodiments of the present disclosure may be implemented in an AR system with a single near-eye display (NED) or more than two NEDs.

In some embodiments, AR system 1500 includes one or more sensors, such as acoustic sensor 1504 . For example, acoustic sensors 1504 can generate measurement signals in response to motion of AR system 1500 and can be located on substantially any portion of frame 1502 . Any of the sensors may be a position sensor, an IMU, a depth camera assembly, or any combination thereof. In some embodiments, AR system 1500 includes more or fewer sensors than shown in Figure 15A. In specific examples where the sensor includes an IMU, the IMU can generate calibration data based on measurement signals from the sensor. Examples of sensors include, but are not limited to, accelerometers, gyroscopes, magnetometers, other suitable types of sensors for detecting motion, sensors used for error correction of the IMU, or some combination thereof.

In some embodiments, AR system 1500 includes a microphone array having a plurality of acoustic sensors 1504-1 through 1504-8, collectively referred to as acoustic sensors 1504. Acoustic sensor 1504 may be a transducer that detects air pressure changes caused by sound waves. In some embodiments, each acoustic sensor 1504 is configured to detect sound and convert the detected sound into an electronic format (eg, analog or digital format). In some embodiments, the microphone array includes ten acoustic sensors: 1504-1 and 1504-2, which are designed to be placed in corresponding ears of the user; acoustic sensors 1504-3, 1504-4, 1504-5, 1504-6, 1504-7, and 1504-8, located at various locations on the frame 1502; and acoustic sensors located on corresponding neckbands, where the neckband systems are not discussed herein. Optional components of the system in certain examples of artificial reality systems.

The configuration of the acoustic sensor 1504 of the microphone array may vary. Although AR system 1500 is shown in FIG. 15A as having ten acoustic sensors 1504, the number of acoustic sensors 1504 may be more or less than ten. In some cases, using more acoustic sensors 1504 increases the amount of audio information collected and/or the sensitivity and accuracy of the audio information. In comparison, using a lower number of acoustic sensors 1504 reduces the computing power required by the controller to process the collected audio information in some cases. In addition, the position of each acoustic sensor 1504 of the microphone array can be changed. For example, the location of acoustic sensors 1504 may include a defined location on the user, defined coordinates on frame 1502, an orientation associated with each acoustic sensor, or some combination thereof.

Acoustic sensors 1504-1 and 1504-2 can be located on different parts of the user's ear. In some embodiments, in addition to the acoustic sensor 1504 inside the ear canal, there are additional acoustic sensors on or around the ear. In some cases, positioning the acoustic sensor near the user's ear canal allows the microphone array to collect information about how sound reaches the ear canal. By positioning at least two of the acoustic sensors 1504 on either side of the user's head (eg, as binaural microphones), the AR device 1500 can simulate binaural hearing and capture the surroundings of the user's head. 3D stereo sound field. In some embodiments, acoustic sensors 1504-1 and 1504-2 are connected to AR system 1500 via wired connections, and in other embodiments, acoustic sensors 1504-1 and 1504-2 are connected via wireless connections (e.g., Bluetooth connection) to the AR System 1500. In some embodiments, AR system 1500 does not include acoustic sensors 1504-1 and 1504-2.

Acoustic sensors 1504 on frame 1502 may be positioned along the length of the temples, across the bridge of the nose, above or below display device 1506, or some combination thereof. Acoustic sensors 1504 can be oriented such that the microphone array can detect sounds in a wide range of directions surrounding the user wearing AR system 1500 . In some examples, a calibration procedure is performed during manufacturing of AR system 1500 to determine the relative positioning of each acoustic sensor 1504 in the microphone array.

In some embodiments, the eyewear device further includes, or is communicatively coupled to, an external device (eg, a pairing device), such as the optional neckband discussed above. In some embodiments, the optional neckband couples to the eyewear device via one or more connectors. The connector may be a wired or wireless connector, and may include electrical and/or non-electrical (eg, structural) components. In some embodiments, the eyewear device and neckband operate independently without any wired or wireless connection between them. In some embodiments, components of the eyewear device and neckband may be located on one or more additional peripheral devices paired with the eyewear device, neckband, or some combination thereof. Furthermore, neck strap is intended to mean any suitable type or form of pairing device. Therefore, the following discussion of neckbands may also apply to a variety of other paired devices, such as smart watches, smartphones, wristbands, other wearable devices, handheld controllers, tablets, or laptops, etc.

In some cases, pairing an external device, such as an optional neckband, with the AR glasses device allows the AR glasses device to achieve the form factor of a pair of glasses while still providing sufficient battery and computing power for expanded capabilities. Some or all of the battery power, computing resources, and/or additional features of the AR system 1500 may be provided by the paired device or shared between the paired device and the eyewear device, thereby reducing weight, heat distribution, and overall appearance size of the eyewear device, while Still maintaining the desired functionality. For example, a neck strap may allow components that would otherwise be included on an eyewear device to be included in the neck strap, thereby shifting the weight load from the user's head to the user's shoulders. In some embodiments, the neckband has a larger surface area over which heat is dissipated and dispersed into the surrounding environment. Therefore, the neckband may allow for greater battery and computing power than would otherwise be possible on a stand-alone eyewear device. Because the weight carried in the neckband may be less intrusive to the user than the weight carried in the eyewear device, the user can endure wearing the lighter eyewear device than the user would otherwise bear with a heavier stand-alone eyewear device. Carry or wear paired devices for longer periods of time, allowing artificial reality environments to be more fully integrated into users' daily activities.

In some embodiments, the optional neckband is communicatively coupled with eyewear devices and/or other devices. Other devices may provide certain functionality to AR system 1500 (eg, tracking, positioning, depth mapping, processing, storage, etc.). In some embodiments, the neckband includes a controller and a power source. In some embodiments, the neckband's acoustic sensor is configured to detect sound and convert the detected sound into an electronic format (analog or digital).

The controller of the neckband processes information generated by the sensors on the neckband and/or AR system 1500 . For example, the controller may process information from acoustic sensor 1504. For each detected sound, the controller may perform direction of arrival (DoA) estimation to estimate the direction in which the detected sound arrives at the microphone array. When the microphone array detects sound, the controller can use this information to populate the audio data set. In specific examples where AR system 1500 includes an IMU, the controller may calculate all inertial and spatial calculations from the IMU located on the eyewear device. Connectors pass information between the eyewear device and the neckband and between the eyewear device and the controller. The information may be in the form of optical data, electrical data, wireless data or any other transmittable data form. Moving the processing of information generated by the eyewear device to the neckband reduces weight and heat in the eyewear device, making it more comfortable and safer for the user.

In some embodiments, a power source in the neckband provides power to the eyewear device and the neckband. The power source may include, but is not limited to, lithium ion batteries, lithium polymer batteries, primary lithium batteries, alkaline batteries, or any other form of energy storage device. In some embodiments, the power source is a wired power source.

As mentioned, some artificial reality systems may instead blend artificial reality with actual reality, essentially replacing one or more of the user's sensory perceptions of the real world with a virtual experience. One example of this type of system is a head-mounted display system, such as VR system 1550 in Figure 15B, that covers most or all of the user's field of view.

15B illustrates a VR system 1550 (eg, also referred to herein as a VR headset or VR headset) according to some specific examples. VR system 1550 includes a head mounted display (HMD) 1552 . HMD 1552 includes a front body 1556 and a frame 1554 (eg, a strap or band) shaped to fit around the user's head. In some embodiments, HMD 1552 includes output audio transducers 1558-1 and 1558-2, as shown in Figure 15B (eg, transducers). In some embodiments, front body 1556 and/or frame 1554 include one or more electronic components, including one or more electronic displays, one or more IMUs, one or more tracking emitters or detectors, and/or or any other suitable device or sensor used to create an artificial reality experience.

Artificial reality systems can include various types of visual feedback mechanisms. For example, display devices in AR system 1500 and/or VR system 1550 may include one or more liquid crystal displays (LCDs), light emitting diode (LED) displays, organic LED (OLED) displays, and/or any other suitable Type of display screen. Artificial reality systems may include a single display screen for both eyes, or may provide a display screen for each eye, which may provide additional flexibility for zoom adjustments or correction of refractive errors associated with the user's vision. Some artificial reality systems also include an optical subsystem with one or more lenses (for example, conventional concave or convex lenses, Fresnel lenses, or adjustable liquid lenses) through which the user can view the display screen.

In addition to or instead of using display screens, some artificial reality systems may include one or more projection systems. For example, display devices in AR system 1500 and/or VR system 1550 may include micro-LED projectors that project light (eg, using waveguides) into the display device, such as clear combination lenses that allow ambient light to pass therethrough. The display device can refract the projected light toward the user's pupil, and can enable the user to view both artificial reality content and the real world at the same time. The artificial reality system may also be configured with any other suitable type or form of image projection system.

Artificial reality systems can also include various types of computer vision components and subsystems. For example, AR system 1500 and/or VR system 1550 may include one or more optical sensors, such as two-dimensional (2D) or three-dimensional (3D) cameras, time-of-flight depth sensors, single-beam or swept radars. radio rangefinder, 3D LiDAR sensor and/or any other suitable type or form of optical sensor. Artificial reality systems may process data from one or more of these sensors to identify the user's location, map the real world, provide the user with context about their real-world surroundings, and/or perform various other functions. For example, Figure 15B shows a VR system 1550 with cameras 1560-1 and 1560-2, which can be used to provide depth information to form a voxel field and a two-dimensional grid to provide object information to the user to avoid collision. Figure 15B also shows that the VR system includes one or more additional cameras 1562 configured to augment cameras 1560-1 and 1560-2 by providing more information. For example, additional camera 1562 may be used to provide color information that cameras 1560-1 and 1560-2 cannot discern. In some embodiments, cameras 1560-1 and 1560-2 and additional camera 1562 may include optional IR cut filters configured to remove IR light.

In some embodiments, AR system 1500 and/or VR system 1550 may include a tactile (tactile) feedback system that may be incorporated into headwear, gloves, bodysuits, handheld controllers, environmental devices (e.g., chairs, floors) pads, etc.), and/or any other type of device or system, such as the wearable devices discussed herein. Tactile feedback systems can provide various types of skin feedback, including vibration, force, traction, shear, texture and/or temperature. Tactile feedback systems can also provide various types of kinesthetic feedback, such as movement and compliance. Tactile feedback can be implemented using electric motors, piezoelectric actuators, fluidic systems, and/or various other types of feedback mechanisms. The haptic feedback system may be implemented independently of, within, and/or in conjunction with other artificial reality devices.

The techniques described above can be used with any device used to interact with artificial reality environments, including the head-worn device of Figures 15A-15B, but also with other types of devices used to sense neuromuscular signals. Used in conjunction with wearable devices (such as body wearable or head wearable devices that may have neuromuscular sensors closer to the brain or spine). Having now described an example wrist wearable device and a head wearable device, attention now turns to an example feedback system, which may be integrated into the devices described above or be a stand-alone device. Instance feedback device

17 illustrates additional components that may be used with the artificial reality system 1600 of FIGS. 16A and 16B (eg, additional components that allow for providing tactile feedback using aspects of the knitted structures described herein), according to some specific examples. schematic diagram. For ease of illustration, the components in Figure 17 are illustrated in a specific configuration, and one of ordinary skill in the art will appreciate that other configurations are possible. Additionally, while some example features are described, various other features are not described for the sake of brevity and so as not to obscure the related aspects of the example implementations disclosed herein.

The artificial reality system 1600 can also provide feedback to the user that actions have been performed. The feedback provided may be visual feedback via electronic displays in head mounted display 1611 (e.g., display of the simulated hand as it picks up and lifts a virtual coffee cup) and/or tactile sensation via haptic assembly 1722 in device 1720 Give back. For example, tactile feedback could prevent one or more of the user's fingers (or, at least impede/impede their movement) from curling beyond a certain point, simulating the sensation of touching a physical coffee cup. To do this, device 1720 changes (directly or indirectly) the pressurized state of one or more of haptic assemblies 1722 . Each of the haptic assemblies 1722 includes a mechanism that causes the respective haptic assembly 1722 to transition from a first pressurized state (e.g., atmospheric pressure or air leakage) to a second pressurized state (e.g., inflated to a threshold pressure). , the agency at least provides resistance. The structure of haptic assembly 1722 may be integrated into a variety of devices configured to contact or be in proximity to the user's skin, including but not limited to devices such as glove-worn devices, body-worn apparel devices, head-mounted devices (e.g., Figure 8A to a device such as the artificial reality head-mounted device 803 in Figure 8B.

As noted above, the haptic assembly 1722 described herein is configured to transition between a first pressurized state and a second pressurized state to provide tactile feedback to the user. Due to the ever-changing nature of artificial reality, haptic assembly 1722 may need to transition between two states hundreds, or possibly thousands, of times during a single use. Therefore, the haptic assembly 1722 described herein is durable and designed to transition from state to state quickly. To provide some context, in the first pressurized state, the haptic assembly 1722 does not impede the free movement of a part of the wearer's body. For example, one or more haptic assemblies 1722 integrated into the glove are made of a soft material that does not impede the free movement of the wearer's hands and fingers (eg, electrostatic zipper actuators). Haptic assembly 1722 is configured to conform to the shape of a portion of the wearer's body when in the first pressurized state. However, once in the second pressurized state, the haptic assembly 1722 is configured to impede free movement of that portion of the wearer's body. For example, when the haptic assembly 1722 is in the second pressurized state, the respective haptic assembly 1722 (or multiple respective haptic assemblies) can limit the movement of the wearer's fingers (eg, prevent the fingers from curling or extending). Additionally, once in the second pressurized state, the haptic assemblies 1722 can assume different shapes, with some haptic assemblies 1722 configured to assume a planar, rigid shape (eg, flat and rigid), and some other haptic assemblies 1722 1722 is configured to at least partially bend or bend.

As a non-limiting example, system 17 includes a plurality of devices 1720-A, 1720-B, ..., 1720-N, each device including apparel 1702 and one or more haptic assemblies 1722 (e.g., haptic assemblies 1722-A, 1722-B,…,1722-N). As explained above, haptic assembly 1722 is configured to provide tactile stimulation to the wearer of device 1720. The apparel 1702 of each device 1720 can be a variety of clothing items (eg, gloves, socks, shirts, or pants), and thus, a user can wear multiple devices 1720 that provide tactile stimulation to different parts of the body. Each haptic assembly 1722 is coupled to the garment 1702 (eg, embedded therein or attached thereto). Additionally, each haptic assembly 1722 includes a support structure 1704 and at least one bladder 1706. The bladder 1706 (eg, membrane) is a sealed, expandable bag made of a durable and puncture-resistant material, such as thermoplastic polyurethane (TPU), flexible polymer, or the like. The bladder 1706 contains a medium (eg, a fluid such as air, an inert gas, or even a liquid) that can be added to or removed from the bladder 1706 to change the pressure inside the bladder 1706 (eg, , fluid pressure). The support structure 1704 is made of a stronger and stiffer material than the material of the bladder 1706 . Respective support structures 1704 coupled to respective bladders 1706 are configured to strengthen the respective bladders as they change shape and size due to changes in pressure (eg, fluid pressure) inside the bladders. Item 1706.

System 1700 also includes a controller 1714 and a pressure changing device 1710. In some embodiments, controller 1714 is part of computer system 1730 (eg, the processor of computer system 1730). Controller 1714 is configured to control the operation of pressure changing device 1710 and, in turn, the operation of device 1720 . For example, the controller 1714 sends one or more signals to the pressure changing device 1710 to activate the pressure changing device 1710 (eg, turn it on and off). One or more signals may specify the desired pressure (eg, pounds per square inch) to be output by the pressure changing device 1710. The generation of one or more signals and thus the pressure output by the pressure changing device 1710 may be based on information collected by the sensor 1625 in Figures 16A and 16B. For example, based on the information collected by the sensor 1625 in FIGS. 16A and 16B (eg, the user contacts the artificial coffee cup), one or more signals may cause the pressure changing device 1710 to increase the first tactile sensation at the first time. The pressure within assembly 1722 (e.g., fluid pressure). Then, based on additional information collected by sensor 1714 and/or sensor 1724 (e.g., the user grasps and lifts the artificial coffee cup), the controller may send one or more additional signals to pressure changing device 1710 that The signal causes the pressure changing device 1710 to further increase the pressure inside the first tactile assembly 1722 at a second time after the first time. Additionally, one or more signals may cause the pressure changing device 1710 to inflate one or more bladders 1706 in the first device 1720-A while one or more bladders 1706 in the second device 1720-B remain inflated. change. Additionally, one or more signals may cause the pressure changing device 1710 to inflate one or more bladders 1706 in the first device 1720-A to a first pressure and to inflate one or more bladders 1706 in the first device 1720-A. Other bladders 1706 are inflated to a second pressure that is different from the first pressure. Depending on the number of devices 1720 serviced by the pressure changing device 1710 and the number of bladders therein, many different inflation configurations may be achieved via one or more signals, and the above examples are not meant to be limiting.

System 1700 may include an optional manifold 1712 between pressure changing device 1710 and device 1720 . Manifold 1712 may include one or more valves (not shown) that pneumatically couple each of haptic assemblies 1722 with pressure changing device 1710 via conduit 1708 . In some embodiments, manifold 1712 is in communication with controller 1714, and controller 1714 controls one or more valves of manifold 1712 (eg, the controller generates one or more control signals). Manifold 1712 is configured to switchably couple pressure changing device 1710 to one or more haptic assemblies 1722 of the same or different devices 1720 based on one or more control signals from controller 1714 . In some embodiments, instead of using manifold 1712 to pneumatically couple pressure changing device 1710 with haptic assembly 1722 , system 1700 may include multiple pressure changing devices 1710 , where each pressure changing device 1710 is associated with a single (or multiple) haptics. Assembly 1722 is directly pneumatically coupled. In some embodiments, pressure varying device 1710 and optional manifold 1712 may be configured as part of one or more of devices 1720 (not illustrated), while in other embodiments, pressure varying device 1710 and optional manifold 1712 may be configured as part of one or more of devices 1720 (not illustrated). Manifold 1712 may be configured external to device 1720. A single pressure changing device 1710 may be shared by multiple devices 1720.

In some embodiments, pressure changing device 1710 is a pneumatic device, a hydraulic device, a pneumatic hydraulic device, or some other device capable of adding and removing media (eg, fluid, liquid, gas) from one or more haptic assemblies 1722 .

The devices shown in Figure 17 may be coupled via wired connections (eg, via bus 1709). Alternatively, one or more of the devices shown in Figure 17 may be connected wirelessly (eg, via short-range communication signals). Having thus described an example wrist wearable device, an example head wearable device, and an example feedback device, attention now turns to an example system integrating one or more of the devices described above. Example system

16A and 16B are block diagrams illustrating an example artificial reality system according to some specific examples. According to some embodiments, system 1600 includes one or more devices for facilitating interactivity with an artificial reality environment. For example, the head wearable device 1611 may present a user interface within an artificial reality environment to the user 16015. As a non-limiting example, system 1600 includes one or more wearable devices that may be used in conjunction with one or more computing devices. In some embodiments, system 1600 provides functionality for a virtual reality device, an augmented reality device, a mixed reality device, a mixed reality device, or a combination thereof. In some embodiments, system 1600 provides a user interface and/or functionality for one or more user applications (eg, games, word processors, messaging applications, calendars, clocks, etc.).

System 1600 may include one or more servers 1670, electronic devices 1674 (e.g., computer 1674a, smartphone 1674b, controller 1674c, and/or other devices), head wearable device 1611 (e.g., AR system 1500 or VR system 1550), and/or wrist wearable device 1688 (e.g., wrist wearable device 16020). In some embodiments, one or more of server 1670, electronic device 1674, head wearable device 1611, and/or wrist wearable device 1688 are communicatively coupled via network 1672. In some embodiments, head wearable device 1611 is configured to cause communicatively coupled wrist wearable device 1688 to perform one or more operations, and/or both devices may also be connected to an intermediary device, such as a smart device. Cell phone 1674b, controller 1674c, or other device that provides instructions and data to and between the two devices. In some embodiments, head wearable device 1611 is configured to cause multiple devices to perform one or more operations in conjunction with wrist wearable device 1688 . In some embodiments, instructions that cause the performance of one or more operations are controlled via artificial reality processing module 1645 . Artificial reality processing module 1645 may be implemented in one or more devices, such as one or more of server 1670, electronic device 1674, head wearable device 1611, and/or wrist wearable device 1688. In some embodiments, one or more devices perform the operations of artificial reality processing module 1645 using one or more respective processors, alone or in combination with at least one other device described herein. In some embodiments, system 1600 includes other wearable devices not shown in Figures 16A and 16B, such as rings, collars, socks, gloves, and the like.

In some embodiments, system 1600 provides for controlling one or more computing devices 1674 based on determination of a user's motion actions or intended motion actions of a wearable device (eg, head wearable device 1611 or wrist wearable device 1688 ). Or provide it with the functionality of a command. A motor action is an intended motor action when the detected neuromuscular signal traveling through the neuromuscular pathway can be determined to be a motor action before the user performs the motor action or before the user completes the motor action. Motor actions may be detected based on the detected neuromuscular signals, but may additionally (using a fusion of various sensor inputs), or alternatively, use other types of sensors (e.g. focusing on observing the hand). a moving camera and/or use data from an inertial measurement unit that can detect characteristic vibration sequences or other data types that correspond to specific mid-air gestures). One or more computing devices include head mounted displays, smartphones, tablets, smart watches, laptops, computer systems, augmented reality systems, robots, vehicles, avatars, user interfaces, wrists One or more of wearable devices and/or other electronic devices and/or control interfaces.

In some specific examples, motor actions include finger movements, hand movements, wrist movements, arm movements, pinching gestures, index finger movements, middle finger movements, ring finger movements, little finger movements, thumb movements, making fists (or fists) with both hands, and waving. movements and/or other movements of the user's hands or arms.

In some specific examples, the user can use the learning module to define one or more gestures. In some embodiments, a user may enter a training phase in which the user-defined gesture is associated with one or more input commands that, when provided to the computing device, cause the computing device to perform an action. Similarly, one or more input commands associated with a user-defined gesture may be used to cause the wearable device to perform one or more actions locally. User-defined gestures are stored in memory 1660 once trained. Similar to motor actions, one or more processors 1650 may use neuromuscular signals detected by one or more sensors 1625 to determine that the user performed a user-defined gesture.

Electronic device 1674 may also include communication interface 1615, interface 1620 (e.g., including one or more displays, lights, speakers, and tactile generators), one or more sensors 1625, one or more applications 1635, artificial reality environment processing module 1645, one or more processors 1650, and memory 1660. Electronic device 1674 is configured to be communicatively coupled with wrist wearable device 1688 and/or head wearable device 1611 (or other devices) using communication interface 1615 . In some embodiments, electronic device 1674 is configured to be communicatively coupled with wrist wearable device 1688 and/or head wearable device 1611 (or other devices) via an application programming interface (API). In some embodiments, electronic device 1674 operates in conjunction with wrist wearable device 1688 and/or head wearable device 1611 to determine gestures and cause operations or actions to be performed at the communication coupling device.

The server 1670 includes a communication interface 1615, one or more applications 1635, an artificial reality processing module 1645, one or more processors 1650, and a memory 1660. In some embodiments, server 1670 is configured to receive sensor data from one or more devices, such as head wearable device 1611, wrist wearable device 1688, and/or electronic device 1674, and use the received Sensor data to recognize gestures or user input. Server 1670 can generate instructions that cause operations and actions associated with the determined gesture or user input to be performed at a communication coupling device, such as head wearable device 1611 .

The extended head wearable device 1611 includes smart glasses (eg, augmented reality glasses), artificial reality head-mounted devices (eg, VR/AR head-mounted devices), or other head-mounted devices. In some specific examples, one or more components of the head wearable device 1611 are housed within the body of the HMD 1614 (eg, the frame of smart glasses, the body of an AR head-mounted device, etc.). In some embodiments, one or more components of head wearable device 1611 are stored within or coupled to the lens of HMD 1614 . Alternatively or additionally, in some embodiments, one or more components of head wearable device 1611 are housed within modular housing 1606 . As discussed above, head wearable device 1611 is configured to be communicatively coupled with other electronic devices 1674 and/or server 1670 using communication interface 1615 .

Figure 16B depicts additional details of the HMD 1614 and modular housing 1606 described above with reference to 16A, according to some specific examples.

Housing 1606 includes a communications interface 1615, circuitry 1646, a power supply 1607 (e.g., a battery for powering one or more electronic components of housing 1606 and/or providing available power to HMD 1614), one or more processors 1650, and Memory 1660. In some embodiments, housing 1606 may include one or more supplementary components 1614 that add functionality to the HMD. For example, in some embodiments, the housing 1606 may include one or more sensors 1625, an AR processing module 1645, one or more tactile generators 1621, one or more imaging devices 1655, one or more Microphone 1613, one or more speakers 1617, etc. Housing 1606 is configured to couple with HMD 1614 via one or more retractable side straps. More specifically, the housing 1606 is a modular portion of the head wearable device 1611 that can be removed from the head wearable device 1611 and replaced with another housing that includes more or less functionality. Modularity of the housing 1606 allows the user to adjust the functionality of the head wearable device 1611 based on their needs.

In some embodiments, communication interface 1615 is configured to communicatively couple housing 1606 with HMD 1614, server 1670, and/or other electronic devices 1674 (eg, controller 1674c, tablet, computer, etc.). Communication interface 1615 is used to establish wired or wireless connections between housing 1606 and other devices. In some embodiments, the communication interface 1615 includes the ability to use various custom or standard wireless protocols (eg, IEEE 802.15.4, Wi-Fi, ZigBee, 6LoWPAN, Thread, Z-Wave, Bluetooth Smart, ISA100.11a, Hardware for data communication using WirelessHART or MiWi), custom or standard wired protocols (e.g., Ethernet or HomePlug), and/or any other suitable communication protocol. In some embodiments, housing 1606 is configured to communicatively couple with HMD 1614 and/or other electronic devices 1674 via an application programming interface (API).

In some embodiments, the power source 1607 is a battery. The power source 1607 may be a primary or secondary battery source for the HMD 1614. In some embodiments, power supply 1607 provides available power to one or more electrical components of housing 1606 or HMD 1614. For example, power supply 1607 can provide available power to sensor 1621, speaker 1617, HMD 1614, and microphone 1613. In some embodiments, the power source 1607 is a rechargeable battery. In some embodiments, the power supply 1607 is a modular battery that can be removed and replaced with a fully charged battery while charging alone.

One or more sensors 1625 may include a heart rate sensor, a neuromuscular signal sensor (eg, an electromyography (EMG) sensor), an SpO2 sensor, an altimeter, a thermal sensor or a thermocouple, Ambient light sensor, ambient noise sensor and/or inertial measurement unit (IMU). Additional non-limiting examples of one or more sensors 1625 include, for example, infrared, pyroelectric, ultrasonic, microphone, laser, optical, Doppler, gyroscope, accelerometer, resonant LC sensor, capacitive sensor , acoustic sensors and/or inductive sensors. In some embodiments, one or more sensors 1625 are configured to collect additional information about the user (eg, the impedance of the user's body). Examples of sensor data output by these sensors include body temperature data, infrared rangefinder data, location information, motion data, activity recognition data, contour detection and recognition data, gesture data, heart rate data, and other wearable Device data (e.g., biometric measurement readings and outputs, accelerometer data). One or more sensors 1625 may include a location sensing device (eg, GPS) configured to provide location information. In some embodiments, data measured or sensed by one or more sensors 1625 is stored in memory 1660 . In some embodiments, housing 1606 receives sensor data from a communication coupling device, such as HMD 1614, server 1670, and/or other electronic device 1674. Alternatively, housing 1606 may provide sensor data to HMD 1614, server 1670, and/or other electronic devices 1674.

One or more haptic generators 1621 may include one or more actuators (eg, eccentric rotating mass (ERM), linear resonant actuator (LRA), voice coil motor (VCM), piezoelectric haptic actuator, Thermoelectric devices, solenoid actuators, ultrasonic transducers or sensors, etc.). In some embodiments, one or more haptic generators 1621 are hydraulic, pneumatic, electric, and/or mechanical actuators. In some embodiments, one or more tactile generators 1621 are part of the surface of the housing 1606 and can be used to generate a tactile response (e.g., thermal changes at the surface, tightening or loosening of straps, increases or decreases in pressure wait). For example, one or more tactile generators 1625 may apply vibration stimulation, pressure stimulation, squeeze simulation, shear stimulation, temperature changes, or some combination thereof to the user. Additionally, in some embodiments, one or more tactile generators 1621 include audio generating devices (eg, speakers 1617 and other sound transducers) and lighting devices (eg, light emitting diodes (LEDs), screen displays, etc.) . One or more tactile generators 1621 may be used to generate different audible sounds and/or visible lights that are provided to the user as tactile responses. The above list of tactile generators is not exhaustive; any emotion device may be used to generate one or more tactile responses that are delivered to the user.

In some specific examples, one or more applications 1635 include social media applications, banking applications, health applications, messaging applications, web browsers, gaming applications, streaming applications, media applications, imaging applications programs, productivity apps, social apps, and more. In some embodiments, one or more applications 1635 include artificial reality applications. One or more applications 1635 are configured to provide data to the head wearable device 1611 to perform one or more operations. In some embodiments, one or more applications 1635 may be displayed via display 1630 of head wearable device 1611 (eg, via HMD 1614).

In some embodiments, instructions that cause the performance of one or more operations are controlled via artificial reality (AR) processing module 1645 . AR processing module 1645 may be implemented in one or more devices, such as one or more of server 1670 , electronic device 1674 , head wearable device 1611 , and/or wrist wearable device 1670 . In some embodiments, one or more devices perform the operations of AR processing module 1645 using one or more respective processors, alone or in combination with at least one other device described herein. In some embodiments, AR processing module 1645 is configured to process signals based at least on sensor data. In some embodiments, the AR processing module 1645 is configured to process signals based on received image data capturing at least a portion of the user's hands, mouth, facial expressions, surrounding environment, etc. For example, the housing 1606 can receive EMG data and/or IMU data from one or more sensors 1625 and provide the sensor data to the AR processing module 1645 for specific operations (eg, gesture recognition, facial recognition, etc.) . AR processing module 1645 causes a device communicatively coupled to housing 1606 to perform operations (or actions). In some embodiments, the AR processing module 1645 performs different operations based on the sensor data and/or performs one or more actions based on the sensor data.

In some examples, one or more imaging devices 1655 may include an ultra-wide camera, a wide camera, a telephoto camera, a depth-sensing camera, or other types of cameras. In some embodiments, one or more imaging devices 1655 are used to capture image data and/or audio data. Imaging device 1655 may be coupled to a portion of housing 1606. The captured image data can be processed and stored in memory, and then presented to the user for viewing. One or more imaging devices 1655 may include one or more modes for capturing image data or audio data. For example, these modes may include high dynamic range (HDR) image capture mode, low-light image capture mode, burst image capture mode, and other modes. In some embodiments, specific modes are automatically selected based on the environment (eg, lighting, movement of the device, etc.). For example, a wrist wearable device in HDR image capture mode and low-light image capture mode can automatically select the appropriate mode based on the environment (for example, dark lighting can cause low-light image capture mode to be used instead of HDR image capture mode) . In some embodiments, the user can select the mode. Image data and/or audio data captured by one or more imaging devices 1655 are stored in memory 1660 (memory may include volatile and non-volatile memory, so that the image data and/or audio data may be stored as appropriate depending on the situation. need to be stored temporarily or permanently).

Circuitry 1646 is configured to facilitate interaction between housing 1606 and HMD 1614 . In some embodiments, circuitry 1646 is configured to regulate power distribution between power supply 1607 and HMD 1614 . In some embodiments, circuitry 746 is configured to communicate audio and/or audio data between one or more components of HMD 1614 and/or housing 1606 .

One or more processors 1650 may be implemented as any type of computing device, such as an integrated system on a chip, a microcontroller, a fixed programmable gate array (FPGA), a microprocessor, and/or other application specific integrated circuits (ASICs). ). The processor may operate in conjunction with memory 1660. Memory 1660 may be or include random access memory (RAM), read only memory (ROM), dynamic random access memory (DRAM), static random access memory (SRAM), and magnetoresistive random access memory. memory (MRAM) and may include firmware, such as static data or fixed instructions, basic input/output system (BIOS), system functions, configuration data and other routines used during operation of the enclosure and processor 1650. Memory 1660 also provides storage for data and instructions associated with applications and data processed by processor 1650.

In some embodiments, the memory 1660 at least stores user data 1661 including sensor data 1662 and AR processing data 1664. Sensor data 1662 includes sensor data monitored by one or more sensors 1625 of housing 1606 and/or from one or more devices communicatively coupled with housing 1606 (such as HMD 1614, smartphone 1674b, control The sensor data received by the device 1674c, etc.). Sensor data 1662 may include sensor data collected over a predetermined time period that may be used by the AR processing module 1645 . AR processing data 1664 may include one or more predefined camera control gestures, user-defined camera control gestures, predefined non-camera control gestures, and/or user-defined non-camera control gestures. In some embodiments, AR processing profile 1664 further includes one or more predetermined thresholds for different gestures.

HMD 1614 includes a communication interface 1615, a display 1630, an AR processing module 1645, one or more processors, and memory. In some embodiments, HMD 1614 includes one or more sensors 1625 , one or more tactile generators 1621 , one or more imaging devices 1655 (eg, cameras), a microphone 1613 , a speaker 1617 , and/or a or Multiple applications 1635. HMD 1614 operates in conjunction with housing 1606 to perform one or more operations of head wearable device 1611 , such as capturing camera data, presenting a representation of the image data at a coupled display, operating one or more applications 1635 , and/or allowing Users participate in the AR environment.

Any data collection performed by the devices described herein and/or any devices configured to perform or cause to be performed the various embodiments described above with reference to any of the Figures (hereinafter referred to as "Devices") is performed using done with the consent of the person concerned and in a manner that complies with all applicable privacy laws. Give users the option to allow the device to collect data, as well as the option to limit or deny the device to collect data. Users can opt in or opt out of any data collection at any time. In addition, users are given the option to request removal of any collected data.

It will be understood that, although the terms "first," "second," etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the disclosure. As used in the description of specific examples and the accompanying claims, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term "and/or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms "comprise" and/or "comprising" when used in this specification specify the presence of stated features, integers, steps, operations, elements and/or components but do not exclude the presence or Add one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

As used herein, the term "if" may be construed to mean "when" or "at the time of" or "in response to a determination" or "based on a determination" or "in response to a detection," as the case may be. Given the context, the stated prerequisite is true. Similarly, depending on the context, the phrase "if [the stated precondition is true]" or "if [the stated precondition is true]" or "when [the stated precondition is true]" may be interpreted to mean It means that the precondition stated in "in judgment" or "in response to judgment" or "according to judgment" or "in detection" or "in response to detection" is true.

For purposes of explanation, the preceding description has been described with reference to specific specific examples. However, the above illustrative discussion is not intended to be exhaustive or to limit the patentable scope to the precise forms disclosed. Many modifications and variations are possible in light of the above teachings. The specific examples were chosen and described in order to best explain principles of operation and practical application to those skilled in the art.

100: Wearable glove device 102A: Clothing integrated capacitive sensor assembly 102B: Clothing integrated capacitive sensor assembly 102C: Clothing integrated capacitive sensor assembly 102D: Clothing integrated capacitive sensor assembly 102E: Clothing integrated capacitive sensor assembly 104: Exploded view 106A: Clothing integrated capacitive sensor contact area 106B: Clothing integrated capacitive sensor contact area 106C: Clothing integrated capacitive sensor contact area 106D: Clothing integrated capacitive sensor contact area 108: First knitted conductive electrode layer 110: Second knitted conductive electrode layer 112:First Glove 114:Second Glove 116A: Clothing integrated capacitive sensor 116B: Clothing integrated capacitive sensor 116C: Clothing integrated capacitive sensor 116D: Clothing integrated capacitive sensor 116E: Clothing integrated capacitive sensor 116F: Clothing integrated capacitive sensor 116G: Clothing integrated capacitive sensor 116H: Clothing integrated capacitive sensor 116I: Clothing integrated capacitive sensor 116J: Clothing integrated capacitive sensor 116K: Clothing integrated capacitive sensor 116L: Clothing integrated capacitive sensor 118:User 120:Surface 121:Plot 122:Fingertips 123:Curve 124:Virtual keyboard 125: Letter "H" 126:Plot 128: The first clothing integrated capacitive sensor 130: The second clothing integrated capacitive sensor 132:First pattern 134:Second pattern 136: Clothing integrated capacitive sensor assembly 200:Multidimensional knitting machine 202: First axis needle bed 204: Needle/fabric spool 206:Nonwoven insert components 208: Second axis needle bed 210: Needle 212: Fabric spool 214:Nonwoven insert components 216:N-axis needle bed 218: Needle 220: Fabric spool 222:Nonwoven insert components 224: Knitting Logic Module 226: Insert logic module 228:Move down 300: order 302A: Snapshot 302B: Snapshot 302C: Snapshot 304:Sequence 306A: Snapshot 306B: Snapshot 400:Multidimensional knitting machine 402:Insert component 405: Non-knitted structure 406A: First pane 406B: Second pane 406C: Third pane 406D: The fourth pane 408: Gloves 408A: Non-knitted structure 408B: Non-knitted structure 412: Second knitting pattern 414: The first knitting pattern 416: Second knitting pattern 500:Structure 501: Knitted structure 502: Non-knitted structure 506: First knitting part 508: Second knitting part 510A: Arrow/stretch state 510B: Arrow/stretch state 600:Sewing technology 602:Conductive yarn 604:surrounding yarn 605: Knitting needles 606:Fabric 608:Suture technology 610: Conductive yarn 612:surrounding yarn 614:Fabric 616: Small stitch spacing 618: Center needle step distance 620: Large stitch spacing 622: Knitting tissue 624:Conductive yarn 626:Conductive yarn 700: Knitted structure 702: First fabric component 704: Second fabric component 706A: Guide hole 706B: Guide hole 706C: Guide hole 706D: Guide hole 706E: Guide hole 706F: Guide hole 706G: Guide hole 706H: Guide hole 706I: Guide hole 706J: Guide hole 706K: Guide hole 706L: Guide hole 707: Stress Relief Hole 708: Overmolding machine 712A: Positioning pin 712B: Positioning pin 712C: Positioning pin 712D: Positioning pin 712E: Positioning pin 712F: Positioning pin 712G: Positioning pin 712H: Positioning pin 712I: Positioning pin 712J: Positioning pin 712K: Positioning pin 712L: Positioning pin 714: Overmolded structure 716: Tactile fingertip structure 717: Bubble Array 718A: Rope 718B: Rope 720: Overmolded structure 800: Gloves 801:User 802: Conductive deformable fabric part 803:Artificial Reality Head Mounted Devices 804: Plot 806:Curve 810: x-axis 900: Fabric structure 902: Conductive deformable fabrics 904:Curve 906: Dashed x-axis curve 908: Solid y-axis curve 1000:First view 1002: Knitted structure 1004: Three-dimensional part 1006: Second view 1008: Knitted structure 1010A: Three-dimensional part 1010B: Three-dimensional part 1010C: Three-dimensional part 1100:Method flow chart 1200:Method flow chart 1300:Method 1425A: Front image sensor 1425B: Rear image sensor 1450: Wrist wearable device 1454: Surface body 1456:Display 1458: Peripheral device button 1460:Coupling mechanism 1462:strap 1463: Tactile device 1464: Sensor 1465:Neuromuscular Sensor 1467: Maintain organization 1468:Peripheral buttons 1470: Release mechanism 1472:Peripheral buttons 1474:Peripheral buttons 1476:Peripheral buttons 14000:Computing system 14002:Electronic devices 14002A: Combination watch device 14002B: Capsule device body 14002C: Circle frame part 14004:Central processing unit 14010:Controller 14012: Tactile Controller 14014: Peripheral interface 14100: Sensor 14102:Coupled sensor 14104: Imaging sensor 14106:SpO2 sensor 14108:EMG sensor 14110:Capacitive sensor 14112:Heart rate sensor 14114:Inertial Measurement Unit (IMU) sensor 14170:Wearable devices 14172:Soft electronic connector 14174:Elastic band 14175:Wearable structures 14176:Neuromuscular Sensor 14179:Wearable devices 14180a:Electrode 14180b:Electrode 14180c:Electrode 14180d:Electrode 14180e:Electrode 14180f:Electrode 14180g:Electrode 14180h:Electrode 14185a: Sensor channel 14185b: Sensor channel 14185c: Sensor channel 14185d: Sensor channel 14185e: Sensor channel 14185f: Sensor channel 14190:With part 14202: Near field communication (NFC) components 14204:Global Positioning System (GPS) component 14206: Long Term Evolution (LTE) components 14208:Wi-Fi/Bluetooth communication components 14212:Display 14214:Speaker 14216:Microphone 14218:Camera 14220:Front camera 14222:Rear camera 14300:Power system 14302:Charger input terminal 14304:Power Management Integrated Circuit (PMIC) 14306:Battery 14400:Memory 14402:Operating system 14410:Information 14412:Profile data 14414: Sensor data 14416:Media archives 14430:Application 14432: Communication interface module 14434:Graphics module 14436:Camera application module 1500:AR system 1502:Frame 1504-1: Acoustic Sensor 1504-2: Acoustic Sensor 1504-3: Acoustic Sensor 1504-4: Acoustic Sensor 1504-5: Acoustic Sensor 1504-6: Acoustic Sensor 1504-7: Acoustic Sensor 1504-8: Acoustic Sensor 1506-1: Left display device/display device 1506-2: Right display device/display device 1550:VR system 1552:Head Mounted Display (HMD) 1554:Frame 1556:Pre-subject 1558-1: Output audio transducer 1558-2: Output audio transducer 1560-1:Camera 1560-2:Camera 15662:Camera 1600:Artificial Reality System 1606:Modular shell 1607:Power supply 1611:Head mounted display 1613:Microphone 1614:HMD 1615: Communication interface 1617: Speaker 1620:Interface 1621:Tactile Generator 1625: Sensor 1630:Display 1635:Application 1645:AR processing module 1646:Circuit system 1650:processor 1655: Imaging device 1660:Memory 1661:User information 1662: Sensor data 1664:AR processing data 1670:Server 1672:Internet 1674:Electronic devices 1674a:Computer 1674b:Smartphone 1674c:Controller 1688: Wrist wearable device 16015:User 16020: Wrist wearable device 1700:System 1702-A: Clothing 1702-B: Clothing 1702-N: Clothing 1704-A:Support Structure 1704-B:Support Structure 1704-N:Support Structure 1706-A: Bladder 1706-B: Bladder 1706-N: Bladder 1708:Pipeline 1709:Bus 1710: Pressure changing device 1712:Manifold 1714:Controller 1720-A:Device 1720-B:Device 1720-N:Device 1722-A: Tactile assembly 1722-B: Tactile assembly 1722-N: Tactile assembly

For a better understanding of the various specific examples described, reference should be made to the following detailed description in conjunction with the following drawings, wherein like reference numerals refer to corresponding parts throughout.

[Figure 1A] to [Figure 1E] illustrate knitted wearable glove devices according to some specific examples. The knitted wearable glove devices include one or more garment-integrated capacitive sensors (for example, the capacitive sensors can be Configured to detect force-based and contact-based input from the user's fingers, and can do so in various quadrants for more granular detection of such input).

[Figure 2] Illustration of a multi-dimensional knitting machine configured to produce multi-dimensional knitted garments in an automated manner according to some specific examples (e.g., requiring no manual knitting or other user intervention after the initial knitting procedure, including allowing electronic components to be automatically Knitting is an integrated component of multi-dimensional knitted clothing).

[Fig. 3A] The sequence of knitting a wearable structure (for example, a glove) along a vertical axis is illustrated according to some specific examples.

[Fig. 3B] The sequence of knitting a knitted wearable structure (for example, another glove) along the horizontal axis is illustrated according to some specific examples.

[Fig. 4] Illustrating a non-knitted structure according to some specific examples, the non-knitted structure is inserted into a multi-dimensional knitting machine while knitting the knitted structure (for example, also in an automatic manner, so that no user intervention is required to allow initialization The knitting sequence is followed by the integration of non-knitted structures).

[Figure 5A] and [Figure 5B] illustrate a knitted structure having a non-knitted structure according to some specific examples, wherein the non-knitted structure has a first knitted portion surrounding it and a second knitted portion surrounding the first knitted portion.

[FIG. 6A] to [FIG. 6B] illustrate a first type of weave pattern (eg, a flat stitch weave pattern) for allowing accommodation of conductive traces according to some specific examples.

[FIGS. 6C] to [FIG. 6D] illustrate a second type of weave pattern for allowing accommodation of conductive traces according to some specific examples (e.g., a flat stitch weave pattern different from the weave pattern depicted and described with reference to FIGS. 6A-6B) .

[Fig. 6E] Another example of a weave pattern that adjusts the stitch spacing to adjust the tensile properties of the resulting fabric is illustrated according to some specific examples.

[FIG. 6F] illustrates an example of a fabric including a larger pitch knit weave 622 (eg, a larger pitch knit jersey) that allows for additional stretch characteristics to be accommodated, according to some specific examples.

[FIG. 6G] According to some specific examples, the conductive yarn may be stitched in a vertical direction, as opposed to the horizontal direction for stitching the conductive yarn described with reference to the examples of FIGS. 6A to 6F.

[Figure 6H] According to some specific examples, the conductive yarn can be knitted in another way other than plain knitting.

[FIG. 7A] to [FIG. 7G] illustrate a sequence for producing a portion of an actuator configured to be placed at a fingertip, according to some specific examples.

[FIG. 8A]-[FIG. 8B] illustrates a fabric structure including one or more portions made of an electrically conductive deformable fabric and the favorable strain characteristics adapted by the fabric structure according to some specific examples.

[FIG. 9A] to [FIG. 9C] illustrate a fabric structure according to some specific examples, the fabric structure includes one or more portions made of a conductive deformable fabric, and the fabric structure is configured to have bidirectional stretch, the bidirectional stretch Stretching has favorable strain characteristics as shown by the plots in each of Figures 9A-9C.

[FIG. 10A] Illustrate two views of a knitted fabric including a three-dimensional knitted fabric that can be configured to accommodate one or more non-knitted structures, according to some specific examples.

[Fig. 10B] Specific examples are shown according to some specific examples in which multiple three-dimensional portions are placed on a single knitted structure.

[Fig. 11] A flowchart illustrating a method for detecting force received at clothing according to some specific examples.

[Fig. 12] A flow chart illustrating a method for manufacturing knitted fabrics including non-knitted structures according to some specific examples.

[Fig. 13] A flow chart illustrating a method for knitting a dual-density fabric including an overmolded structure according to some specific examples.

[FIG. 14A] to [FIG. 14E] illustrate an example wrist wearable device according to some specific examples.

[FIG. 15A]-[FIG. 15B] illustrates an example AR system according to some specific examples, which AR system can be achieved by using knitted structures (e.g., wearable gloves or other wearable structures formed according to the knitting techniques described herein). control.

[Figure 16A] and [Figure 16B] are block diagrams illustrating an example artificial reality system based on some specific examples.

[FIG. 17] illustrates additional components that may be used with the artificial reality system of FIGS. 16A and 16B (e.g., additional components that allow the use of knitted structures described herein to provide tactile feedback, according to some specific examples). ) diagram.

In accordance with common practice, various features illustrated in the drawings may not be drawn to scale. Therefore, the dimensions of the various features may be arbitrarily expanded or reduced for clarity. Additionally, some drawings may not depict all components of a given system, method, or device. Finally, throughout the specification and drawings, the same reference numbers may be used to refer to the same features.

This specification will refer to U.S. Provisional Application No. 63/314,199, which includes conductive yarns (and some knitted fabrics formed using conductive yarns or other yarns), forming electrical connections with fabric electrodes, and laser cutting certain fabrics (and (other manufacturing processes) and related descriptions. These aspects may be combined with, substituted for, or otherwise combined with other aspects described herein.

100: Wearable glove device

102A: Clothing integrated capacitive sensor assembly

102B: Clothing integrated capacitive sensor assembly

102C: Clothing integrated capacitive sensor assembly

102D: Clothing integrated capacitive sensor assembly

102E: Clothing integrated capacitive sensor assembly

104: Exploded view

106A: Clothing integrated capacitive sensor contact area

106B: Clothing integrated capacitive sensor contact area

106C: Clothing integrated capacitive sensor contact area

106D: Clothing integrated capacitive sensor contact area

108: First knitted conductive electrode layer

110: Second knitted conductive electrode layer

118:User

Claims (17)

A wearable device containing: Conductive deformable fabric, the conductive deformable fabric includes: a conductive trace having an inextensible fixed length along the first axis; The conductive traces are sewn into the fabric structure to create a conductive deformable material where: The fabric structure includes a weave pattern that promotes oscillatory expansion and folding of the conductive traces to allow the conductive traces to expand and contract, respectively, along the first axis without exceeding the fixed length of the conductive traces. ,and The conductive deformable material is located within the wearable device such that when the wearable device is worn, the tissue pattern is positioned over the user's joints to allow the tissue pattern to expand or contract with movement of the joints. The wearable device of claim 1, wherein the tissue pattern further promotes expansion and contraction of the conductive trace along a second axis perpendicular to the first axis without exceeding the fixed length of the conductive trace. The wearable device of claim 1, wherein the conductive trace provides a signal for determining the amount of strain at the fabric structure. The wearable device of claim 3, wherein the strain amount on the fabric structure is used to determine joint motion for interacting with the artificial reality environment. The wearable device of claim 1, wherein the weave pattern of the fabric structure allows the fabric structure to be folded via alternating folds, wherein the conductive traces are folded together with the fabric structure. The wearable device of claim 1, wherein the fabric structure includes an elastic band that allows the conductive deformable fabric to return to a preset state. The wearable device of claim 1, wherein the conductive trace is linear along the first axis along the inextensible fixed length. The wearable device of claim 1, wherein the weave pattern of the fabric structure is a plain weave pattern. The wearable device of claim 1, wherein the conductive traces are embroidered onto the fabric structure. The wearable device of claim 1, wherein a portion of the conductive trace is configured to attach to a neuromuscular signal sensor. The wearable device of claim 1, wherein the conductive trace is an insulated copper magnetic wire. The wearable device of claim 1, wherein the wearable device is machine washable. The wearable device of claim 1, wherein the conductive deformable fabric is configured to shrink to a size that is 300% less than the fixed length of the conductive trace. The wearable device of claim 1, wherein the first portion of the conductive trace is configured to contact the second portion of the conductive trace without electrically shorting. The wearable device of claim 1, wherein the conductive deformable fabric is configured to expand and fold in the oscillatory manner for 8,000 to 20,000 cycles without performance degradation. The wearable device of claim 1, wherein the resistivity of the conductive trace increases along the fixed length of the conductive trace according to the width of the conductive trace. The wearable device of claim 1, wherein the unfolding and folding in the oscillating manner follows a folding technology based on origami.