CN118011634A - Extended reality glasses control method, extended reality glasses, electronic equipment and medium - Google Patents
Extended reality glasses control method, extended reality glasses, electronic equipment and medium Download PDFInfo
- Publication number
- CN118011634A CN118011634A CN202311815132.5A CN202311815132A CN118011634A CN 118011634 A CN118011634 A CN 118011634A CN 202311815132 A CN202311815132 A CN 202311815132A CN 118011634 A CN118011634 A CN 118011634A
- Authority
- CN
- China
- Prior art keywords
- nose pad
- augmented reality
- reality glasses
- characteristic information
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0176—Head mounted characterised by mechanical features
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C5/00—Constructions of non-optical parts
- G02C5/12—Nose pads; Nose-engaging surfaces of bridges or rims
- G02C5/122—Nose pads; Nose-engaging surfaces of bridges or rims with adjustable means
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/213—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B2027/0192—Supplementary details
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Artificial Intelligence (AREA)
- General Engineering & Computer Science (AREA)
- Evolutionary Computation (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Software Systems (AREA)
- Optics & Photonics (AREA)
- Medical Informatics (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Health & Medical Sciences (AREA)
- Ophthalmology & Optometry (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides an augmented reality glasses control method, an augmented reality glasses, electronic equipment and a medium, wherein the method comprises the following steps: based on a sensing component positioned at a nose pad position in the augmented reality glasses, acquiring wearing characteristic information of a user, wherein the wearing characteristic information is used for describing nose bridge characteristic information of the user under the condition that the user wears the augmented reality glasses currently; inputting the wearing characteristic information into an adjustment mode matching model to determine a target adjustment mode corresponding to the wearing characteristic information; and adjusting the current nose pad form of the augmented reality glasses based on the target adjusting mode to obtain a target nose pad form. The wearing feature information of the user is acquired to determine the wearing requirement of the user, and then the nose pad shape is adjusted, so that the adjusted nose pad shape, namely the target nose pad shape, can be matched with the wearing requirement of the user, and the use scenes of different users are met.
Description
Technical Field
The invention relates to the field of augmented reality, in particular to an augmented reality glasses control method, an augmented reality glasses, electronic equipment and a medium.
Background
XR (Extended Reality) includes visual interaction technologies such as AR (Augmented Reality ), VR (Virtual Reality), MR (Mixed Reality), and the like; the augmented reality glasses are XR realized carriers; the appearance of current augmented reality glasses is fixed generally, and the head structure of different users has the difference, if nose height, width are different, and the impression of different structure user when wearing the augmented reality glasses of the same structure is different, and if the user's nasal bridge that the nose is high receives is too big, and the user that the nose is low then can not support the augmented reality glasses well, leads to the nose to hold in the palm to adjust and can not adjust to the demand adaptability of different users to adopt manual regulation's mode among the prior art, also can lead to the nose to hold in the palm the precision of adjusting lower.
Disclosure of Invention
The invention mainly aims to provide an augmented reality glasses control method, an augmented reality glasses, electronic equipment and a medium, and aims to solve the technical problems that the augmented reality glasses cannot be adjusted according to the requirements of different users and the nose pad adjusting precision is low in the prior art.
In order to achieve the above object, the present invention provides an augmented reality glasses control method applied to an augmented reality glasses including a nose pad; the augmented reality glasses control method comprises the following steps:
Based on a sensing component positioned at a nose pad position in the augmented reality glasses, acquiring wearing characteristic information of a user, wherein the wearing characteristic information is used for describing nose bridge characteristic information of the user under the condition that the user wears the augmented reality glasses currently;
inputting the wearing characteristic information into an adjustment mode matching model to determine a target adjustment mode corresponding to the wearing characteristic information;
And adjusting the current nose pad form of the augmented reality glasses based on the target adjusting mode to obtain a target nose pad form.
Optionally, the sensing assembly includes a plurality of pressure sensors and a plurality of optical sensors, the pressure sensors and the optical sensors being distributed at different detection positions of the nose pad; the step of acquiring the wearing characteristic information of the user based on the sensing component positioned at the nose pad position in the augmented reality glasses comprises the following steps:
acquiring detection pressure values of the nose pads on the human face, which are acquired by the pressure sensors;
acquiring distance information from the nose pad to the face, which is acquired by each optical sensor;
and determining wearing characteristic information of the user according to the detected pressure value and the distance information.
Optionally, the target adjustment mode includes a target adjustment parameter, where the target adjustment parameter is used to indicate an adjustment degree corresponding to the height, the width and the angle of the nose pad, and the step of adjusting the current nose pad form of the augmented reality glasses based on the target adjustment mode to obtain the target nose pad form includes:
And adjusting the parameters corresponding to the current nose pad form based on the target adjusting parameters to obtain the target nose pad form.
Optionally, before the step of acquiring wearing feature information of the user, the method further includes:
acquiring facial feature information of the user:
determining an initial nose pad state of the nose pad according to the feature information of the nose bridge area in the facial feature information and the facial contour features in the facial feature information;
And adjusting the current nose pad form of the augmented reality glasses to the initial nose pad form.
Optionally, the augmented reality glasses further comprise a plurality of pressure sensors, wherein the pressure sensors are distributed at different detection positions of the nose pads; during the adjustment of the morphology of the nose pad, the method further comprises:
acquiring detection pressure values acquired by the pressure sensors;
for each detection position, acquiring a safety pressure threshold corresponding to the detection position;
judging whether the detected pressure value is greater than or equal to the safety pressure threshold value;
and if the detected pressure value is greater than or equal to the safety pressure threshold value, stopping adjusting the form of the nose pad.
Optionally, after the step of adjusting the current nose pad form of the augmented reality glasses based on the target adjustment mode to obtain the target nose pad form, the method further includes:
Receiving a nose pad adjusting instruction sent by a user;
And adjusting the form of the nose pad based on the nose pad adjusting instruction.
Optionally, the method further comprises:
Acquiring different types of reference wearing characteristic information and a reference adjusting mode corresponding to each piece of reference wearing characteristic information;
inputting the reference wearing characteristic information into a model to be trained to determine a training adjustment mode matched with the reference wearing characteristic information;
Based on the reference adjustment mode and the training adjustment mode, performing machine learning training on the model to be trained to obtain an adjustment mode matching model
To achieve the above object, the present invention also provides an augmented reality glasses including a nose pad and a processor, the processor comprising:
the first acquisition module is used for acquiring wearing characteristic information of a user based on a sensing assembly positioned at a nose pad position in the augmented reality glasses, wherein the wearing characteristic information is used for describing nose bridge characteristic information of the user under the condition that the user wears the augmented reality glasses currently;
the first determining module is used for inputting the wearing characteristic information into an adjusting mode matching model to determine a target adjusting mode corresponding to the wearing characteristic information;
And the first adjusting module is used for adjusting the current nose pad form of the augmented reality glasses based on the target adjusting mode to obtain a target nose pad form.
To achieve the above object, the present invention also provides an electronic device including a memory, a processor, and a computer program stored on the memory and executable on the processor, which when executed by the processor, implements the steps of the augmented reality glasses control method as described above.
To achieve the above object, the present invention also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the augmented reality glasses control method as described above.
According to the control method of the augmented reality glasses, the electronic equipment and the medium, the wearing characteristic information of the user is obtained based on the sensing component positioned at the nose pad position in the augmented reality glasses, and the wearing characteristic information is used for describing nose bridge characteristic information of the user under the condition that the user wears the augmented reality glasses currently; inputting the wearing characteristic information into an adjustment mode matching model to determine a target adjustment mode corresponding to the wearing characteristic information; and adjusting the current nose pad form of the augmented reality glasses based on the target adjusting mode to obtain a target nose pad form. The wearing feature information of the user is acquired to determine the wearing requirement of the user, and then the nose pad shape is adjusted, so that the adjusted nose pad shape, namely the target nose pad shape, can be matched with the wearing requirement of the user, the accuracy of nose pad adjustment is improved, different users can be individually adapted, the comfort of nose pad adjustment is improved, and the user experience is improved.
Drawings
FIG. 1 is a flowchart of a first embodiment of an augmented reality glasses control method according to the present invention;
FIG. 2 is a schematic diagram of the structure of the augmented reality glasses of the present invention;
Fig. 3 is a schematic block diagram of an electronic device according to the present invention.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
The invention provides an augmented reality glasses control method, referring to fig. 1, fig. 1 is a flow chart of a first embodiment of the augmented reality glasses control method of the invention, the augmented reality glasses control method is applied to augmented reality glasses, and the augmented reality glasses comprise nose pads; the method comprises the steps of:
Step S10, based on a sensing component positioned at a nose pad position in the augmented reality glasses, acquiring wearing characteristic information of a user, wherein the wearing characteristic information is used for describing nose bridge characteristic information of the user under the condition that the user wears the augmented reality glasses currently;
it can be appreciated that when a user wears the augmented reality glasses, the states between the user and the augmented reality glasses are different based on the matching degree of the augmented reality glasses and the wearing requirement of the user; the present embodiment focuses on the matching relationship between the nose pads and the user's nose in the augmented reality glasses.
For users with the same nose shape and size, the requirements of the users on the nose pad form of the augmented reality glasses are similar, so that the determined nose can reflect the wearing requirements of the users, and the nose parameters of the users can be used as wearing characteristic information; that is, the wearing feature information may reflect the state of the nose of the user when wearing the augmented reality glasses, and may also be a parameter of the nose itself of the user. Therefore, the sensing component is arranged at the nose pad position to collect wearing characteristic information in the embodiment.
Step S20, inputting the wearing characteristic information into an adjustment mode matching model to determine a target nose pad form corresponding to the wearing characteristic information;
The nose pad shape is used for indicating the structural characteristics of the nose pad; the nose pad configuration includes, but is not limited to, setting the nose pad height and angle.
The target nose pad is matched with the wearing characteristic information; it will be appreciated that after the wearing feature information is determined, the wearing needs of the user are determined, and the requirements for the nose pad morphology are also determined, so that the nose pad morphology that is currently required to be set, namely the target nose pad morphology, can be determined through the wearing feature information.
In practical application, the wearing feature information is diversified, so in order to adapt to more users, in this embodiment, a machine model mode, that is, an adjustment mode, is adopted to match the model to determine a target nose pad form corresponding to the wearing feature information; the specific type and structure of the adjustment mode matching model can be set based on actual application requirements.
And step S30, adjusting the current nose pad form of the augmented reality glasses based on the target adjusting mode to obtain a target nose pad form.
After the target nose pad morphology is determined, the nose pad morphology can be adjusted to the target nose pad morphology.
It should be noted that, in practical application, the nose pad form may not be matched with the nose of the user through one-time adjustment; therefore, after the nose pad shape is adjusted to the target nose pad shape, the method returns to the step S10 to circulate again until the determined target nose pad shape is consistent with the current shape of the nose pad, and the adjustment is determined to be completed, and the target nose pad shape at that time is taken as the final determined use shape of the nose pad; after the use form of the nose pad is determined, the form of the nose pad is not actively regulated by wearing the characteristic information, so that the influence on the use of a user is avoided.
According to the nose pad adjusting method and device, the wearing characteristic information of the user is obtained to determine the wearing requirement of the user, and then the nose pad shape is adjusted, so that the adjusted nose pad shape, namely the target nose pad shape, can be matched with the wearing requirement of the user, different users can be individually adapted, the nose pad adjusting comfort level is improved, and the user experience is improved.
Further, in a second embodiment of the augmented reality glasses control method according to the present invention, the sensing assembly further includes a plurality of pressure sensors and a plurality of optical sensors, and the pressure sensors and the optical sensors are distributed at different detection positions of the nose pad; the step S10 includes the steps of:
step S11, acquiring detection pressure values of the nose pads on the human face, which are acquired by the pressure sensors;
Step S12, obtaining the distance information from the nose pad to the face, which is acquired by each optical sensor;
and step S13, determining wearing characteristic information of the user according to the detected pressure value and the distance information.
It can be understood that when a user wears the augmented reality glasses, the nose and the nose pad are contacted based on a plurality of positions, and the pressure and the distance born by the different positions are also different, so that in order to improve the accuracy of wearing feature information acquisition, a plurality of pressure sensors and a plurality of optical sensors are arranged for different detection positions; the specific detection position can be set based on actual application requirements, for example, positions corresponding to the upper end of the nose bridge, the lower end of the nose bridge, the left nasal wing, the right nasal wing and the cheeks at two sides in the nose pad are used as detection positions.
The detected pressure value is the pressure value detected by the pressure sensor; each pressure sensor outputs a sensed pressure value associated with a corresponding sensed location.
The distance information is the distance from the detection position detected by the optical sensor to the face, and each optical sensor outputs a piece of distance information related to the corresponding detection position.
The matching condition is used for indicating the suitability degree of the nose pad and the nose of the user at the detection position; it can be understood that the corresponding detected pressure value and the distance information are different under the condition that the nose pad is suitable and unsuitable to the nose of the user; if the width of the nose pad relative to the nose of the user is too narrow, the detected pressure value corresponding to the position of the nose wing is too large, and the distance information indicates that the distance is too short, otherwise, if the width of the nose pad relative to the nose of the user is too wide, the detected pressure value corresponding to the position of the nose wing is too small or not, and the distance information indicates that the distance is too long; therefore, the matching condition of the nose pad and the nose of the user can be reflected by detecting the pressure value and the distance information.
It will be appreciated that in the case of a morphological determination of the nose pad, the matching of the different detection positions is not necessarily the same, for example, when the nose pad is relatively high with respect to the nose of the user, but the width is appropriate, the detected pressure value corresponding to the nose bridge position is abnormal with the distance information, but the detected pressure value corresponding to the nose wing position is matched with the distance information.
The current form of the nose pad is the real-time form of the nose pad; it can be understood that the matching condition is detected under the current form of the nose pad, the proper condition of different positions of the nose pad can be known based on the matching condition of different detection positions, and the current form of the nose pad is known, so that the current form can be adjusted based on the current form through the matching condition, the adjusted wearing characteristic information is matched with the nose of a user at each position, and the accuracy of nose pad adjustment is improved.
Further, in a third embodiment of the present invention of the control method for an augmented reality glasses according to the first embodiment of the present invention, the target adjustment mode includes a target adjustment parameter, the target adjustment parameter is used to indicate respective adjustment degrees of the nose pad height, width and angle, and the step of adjusting the current nose pad shape of the augmented reality glasses based on the target adjustment mode to obtain the target nose pad shape includes:
And adjusting the parameters corresponding to the current nose pad form based on the target adjusting parameters to obtain the target nose pad form.
On the basis of the current nose pad shape, if the degree of the height, the width and the angle to be adjusted is determined, the target nose pad shape can be determined,
When the nose pad form is specifically adjusted, the nose pad form can be adjusted based on the actual structure setting of the nose pad, for example, a driving device in the height direction is arranged for the nose pad main body, and the height of the nose pad is adjusted by controlling the driving device; if the nose holds in the palm the main part and constitutes through two independent fins, two fins correspond the left side and the right side that contact user's nose respectively, and two fins are close to the one end of bridge of the nose and are connected, and the other end sets up drive arrangement respectively, controls the height of the one end that the fin kept away from the bridge of the nose through controlling this drive arrangement to make the contained angle between two fins change, realize the control to nose and hold in the palm angle and width.
Further, in the fourth embodiment of the present invention of the control method for an augmented reality glasses according to the first embodiment of the present invention, before the step S10, the method further includes the steps of:
step S40, acquiring facial feature information of the user:
Step S50, determining an initial nose pad state of the nose pad according to the feature information of the nose bridge area in the facial feature information and the facial contour feature in the facial feature information;
And step S60, adjusting the current nose pad form of the augmented reality glasses to be the initial nose pad form.
Facial feature information is used to indicate the facial structure of the user; facial feature information can be obtained by means of cameras, structured light and the like; the camera, the structured light module may be disposed on the augmented reality glasses, and may also be disposed on other settings associated with the augmented reality glasses.
The facial feature information includes feature information of a nose bridge region and facial contour features in the facial feature information.
It can be appreciated that the facial feature information reflects the wearing needs of the user to some extent, so that the required nose pad form, i.e., the initial nose pad form, can be preliminarily determined through the facial feature information; before the user wears the augmented reality glasses, the nose pad form is adjusted to be the initial nose pad form, so that the problem that the nose pad form is too mismatched when the user just wears the augmented reality glasses can be avoided;
Further, the identity of the user can be obtained, whether the identity has a corresponding historical nose pad form or not is judged, and if the identity has the corresponding historical nose pad form, the historical nose pad form is used as a target nose pad form of the user.
The identity mark is used for indicating the uniqueness of the user; uniqueness may refer to relative uniqueness between users using augmented reality glasses, and may also refer to absolute uniqueness of users in a crowd; the identity may be a user name, a user preset password, etc. if it is relatively unique, and fingerprint data, iris data, etc. if it is absolutely unique.
It will be appreciated that most users of the augmented reality glasses are fixed, and the same users need to be generally fixed, so when the user has worn the augmented reality glasses and has determined the target nose pad form, and then the user wears the augmented reality glasses again, the nose pad form can be directly adjusted to the target nose pad form determined before, i.e. the history nose pad form; thereby improving the efficiency of the shape adjustment of the nose pad.
Further, in a fifth embodiment of the present invention of the control method for an augmented reality glasses according to the first embodiment of the present invention, the augmented reality glasses further include a plurality of pressure sensors, and the pressure sensors are distributed at different detection positions of the nose pad; in the process of adjusting the form of the nose pad, the method further comprises the steps of:
step S70, obtaining detection pressure values acquired by the pressure sensors;
Step S80, for each detection position, acquiring a safety pressure threshold corresponding to the detection position;
step S90, judging whether the detected pressure value is greater than or equal to the safety pressure threshold value;
And step S110, if the detected pressure value is greater than or equal to the safety pressure threshold value, stopping adjusting the form of the nose pad.
Generally, the form of the nose pad is constructed through a mechanical structure, and the form adjustment of the nose pad is realized through the adjustment of the mechanical structure; therefore, when the form of the nose pad is regulated, the safety in the regulation process needs to be ensured, and discomfort or injury to a user caused by regulation is avoided; setting a safety pressure threshold in the embodiment; when the detected pressure value is larger than the safety pressure threshold value, the nose pad is considered to be in too tight contact with the user at the detected position, and in order to avoid damage to the user caused by further tightening of the nose pad, the nose pad is stopped to be adjusted.
It can be understood that the safety pressure thresholds corresponding to different detection positions are different, and specific values of the safety pressure thresholds can be set based on actual applications, which are not described herein.
Further, in a sixth embodiment of the present invention of the control method for an augmented reality glasses according to the first embodiment of the present invention, the method further includes the steps of:
step S120, receiving a nose pad adjusting instruction sent by a user;
and step S130, adjusting the form of the nose pad based on the nose pad adjusting instruction.
Different users experience different comfort levels; even if the nose pad is adjusted to a form that is theoretically the best match to the user, the user may be dissatisfied with the form; therefore, in this embodiment, the user may adjust the form of the nose pad by sending a specific nose pad adjustment instruction, so that the nose pad form better meets the needs of the user. The sending mode of the nose pad adjusting instruction can be set based on actual needs, including but not limited to physical buttons, virtual buttons and voice input on related equipment.
Further, in a seventh embodiment of the present invention's augmented reality glasses control method according to the first embodiment of the present invention, the method further includes the steps of:
step S140, different types of reference wearing feature information and the reference adjustment modes corresponding to the reference wearing feature information are obtained;
Step S150, inputting the reference wearing characteristic information into a model to be trained to determine a training adjustment mode matched with the reference wearing characteristic information;
and step S160, performing machine learning training on the model to be trained based on the reference adjustment mode and the training adjustment mode to obtain the adjustment mode matching model.
Taking different types of reference wearing characteristic information and corresponding reference adjustment modes as training samples to train the model to be trained;
specifically, the model to be trained outputs a training adjustment mode corresponding to the reference wearing feature information, and the training adjustment mode is compared with the reference adjustment mode so as to train the model to be trained according to the comparison result; when the model to be trained meets the training completion condition, the training of the initial form adjustment model is completed, and the form adjustment model after the training is completed is obtained; the loss function, the training completion condition, etc. in the specific training process can be set based on actual needs.
From the description of the above embodiments, it will be clear to a person skilled in the art that the method according to the above embodiments may be implemented by means of software plus the necessary general hardware platform, but of course also by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present application.
The application also provides an augmented reality glasses for implementing the above-mentioned augmented reality glasses control, the augmented reality glasses including a nose pad and a processor, the processor comprising:
the first acquisition module is used for acquiring wearing characteristic information of a user based on a sensing assembly positioned at a nose pad position in the augmented reality glasses, wherein the wearing characteristic information is used for describing nose bridge characteristic information of the user under the condition that the user wears the augmented reality glasses currently;
the first determining module is used for inputting the wearing characteristic information into an adjusting mode matching model to determine a target adjusting mode corresponding to the wearing characteristic information;
And the first adjusting module is used for adjusting the current nose pad form of the augmented reality glasses based on the target adjusting mode to obtain a target nose pad form.
This equipment augmented reality glasses is through obtaining wearing characteristic information to the user, comes to confirm the needs of wearing of user, and then comes to adjust the form that the nose held in the palm to make the nose that adjusts hold in the palm the form, target nose holds in the palm the form promptly can with the user wear needs assorted, improve the precision that the nose held in the palm the regulation, and can adapt to different users individually, improved the comfort level that the nose held in the palm the regulation, thereby improved user experience.
It should be noted that, the first obtaining module in this embodiment may be used to perform step S10 in the embodiment of the present application, the first determining module in this embodiment may be used to perform step S20 in the embodiment of the present application, and the first adjusting module in this embodiment may be used to perform step S30 in the embodiment of the present application.
Referring to fig. 2, in terms of product structure, the augmented reality glasses may further include a pressure sensor C30, a driving module C40, a display module C50, an audio module C60, a camera C70, an audio acquisition module C80, and an optical sensor C90;
The input end of the processor C20 is respectively connected with the pressure sensor C30, the optical sensor C90, the camera C70 and the audio acquisition module C80, the output end of the processor C20 is respectively connected with the driving module C40, the display module C50 and the audio module C60, and the processor C20 can also be in communication connection with intelligent terminals such as a mobile phone, a flat panel and wearable equipment;
the pressure sensor C30 is used for collecting detection pressure values of different detection positions of the nose pad C10;
The optical sensor C90 is used for collecting distance information of different detection positions of the nose pad C10;
A camera C70 for collecting facial feature information of a user;
The driving module C40 is used for adjusting the form of the nose pad C10;
The display module C50 is used for performing display operation; in the process of adjusting the form of the nose pad C10, the adjusting condition of the form of the nose pad C10 can be displayed;
an audio module C60 for playing audio data;
and the audio acquisition module C80 is used for acquiring voice instructions of a user.
Further, the augmented reality glasses further comprise a plurality of pressure sensors and a plurality of optical sensors, wherein the pressure sensors and the optical sensors are distributed at different detection positions of the nose pad; the first acquisition module includes:
The first acquisition unit is used for acquiring the detected pressure value of the nose pad on the face acquired by each pressure sensor;
The second acquisition unit is used for acquiring the distance information from the nose pad to the face, which is acquired by each optical sensor;
And the first determining unit is used for determining the wearing characteristic information of the user according to the detected pressure value and the distance information.
Further, the target adjustment mode includes a target adjustment parameter, the target adjustment parameter is used for indicating the adjustment degrees corresponding to the height, the width and the angle of the nose pad, and the first adjustment module includes:
And the first adjusting unit is used for adjusting the parameters corresponding to the current nose pad form based on the target adjusting parameters to obtain the target nose pad form.
Further, the processor further comprises:
A second acquisition module, configured to acquire facial feature information of the user:
The second determining module is used for determining an initial nose pad state of the nose pad according to the feature information of the nose bridge area in the facial feature information and the facial contour feature in the facial feature information;
And the second adjusting module is used for adjusting the current nose pad form of the augmented reality glasses to the initial nose pad form.
Further, the augmented reality glasses further comprise a plurality of pressure sensors, wherein the pressure sensors are distributed at different detection positions of the nose pads; the processor further includes:
The third acquisition module is used for acquiring the detection pressure value acquired by each pressure sensor;
A fourth obtaining module, configured to obtain, for each detection position, a safety pressure threshold corresponding to the detection position;
the first judging module is used for judging whether the detected pressure value is larger than or equal to the safety pressure threshold value or not;
And the first stopping module is used for stopping adjusting the form of the nose pad if the detected pressure value is greater than or equal to the safety pressure threshold value.
Further, the processor further comprises:
The first receiving module is used for receiving a nose pad adjusting instruction sent by a user;
And the third adjusting module is used for adjusting the form of the nose pad based on the nose pad adjusting instruction.
Further, the processor further comprises:
the fifth acquisition module is used for acquiring different types of reference wearing characteristic information and the reference adjustment modes corresponding to the reference wearing characteristic information respectively;
The first input module is used for inputting the reference wearing characteristic information into a model to be trained to determine a training adjustment mode matched with the reference wearing characteristic information;
and the first training module is used for performing machine learning training on the model to be trained based on the reference adjusting mode and the training adjusting mode to obtain the adjusting mode matching model.
Referring to fig. 3, the augmented reality glasses control may include a communication module 10, a memory 20, a processor 30, and the like in terms of hardware configuration. In the augmented reality glasses control, the processor 30 is connected to the memory 20 and the communication module 10, and a computer program is stored in the memory 20, and the computer program is executed by the processor 30 at the same time, and the steps of the method embodiments are implemented when the computer program is executed.
The communication module 10 is connectable to an external communication device via a network. The communication module 10 may receive a request sent by an external communication device, and may also send a request, an instruction, and information to the external communication device, where the external communication device may be other augmented reality glasses control, a server, or an internet of things device, such as a television, and so on.
The memory 20 is used for storing software programs and various data. The memory 20 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function (such as acquiring wearing feature information of a user), and the like; the storage data area may include a database, may store data or information created according to the use of the system, and the like. In addition, the memory 20 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
The processor 30, which is a control center of the augmented reality glasses control, connects various parts of the entire augmented reality glasses control using various interfaces and lines, performs various functions and processes data of the augmented reality glasses control by running or executing software programs and/or modules stored in the memory 20 and calling data stored in the memory 20, thereby performing overall monitoring of the augmented reality glasses control. Processor 30 may include one or more processing units; alternatively, the processor 30 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 30.
Although not shown in fig. 3, the above-mentioned augmented reality glasses control may further include a circuit control module for connecting with a power source to ensure normal operation of other components. It will be appreciated by those skilled in the art that the augmented reality glasses control structure shown in fig. 3 is not limiting of the augmented reality glasses control and may include more or fewer components than shown, or certain components in combination, or a different arrangement of components.
The present invention also proposes a computer-readable storage medium on which a computer program is stored. The computer readable storage medium may be the Memory 20 in the control of the augmented reality glasses of fig. 3, or may be at least one of ROM (Read-Only Memory)/RAM (Random Access Memory ), magnetic disk, optical disk, etc., and the computer readable storage medium includes several instructions for causing a terminal device (which may be a television, an automobile, a mobile phone, a computer, a server, a terminal, or a network device, etc.) having a processor to perform the method according to the embodiments of the present invention.
In the present invention, the terms "first", "second", "third", "fourth", "fifth" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance, and the specific meaning of the above terms in the present invention will be understood by those of ordinary skill in the art depending on the specific circumstances.
In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, the different embodiments or examples described in this specification and the features of the different embodiments or examples may be combined and combined by those skilled in the art without contradiction.
Although embodiments of the present invention have been shown and described above, the scope of the present invention is not limited thereto, and it should be understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications and substitutions of the above embodiments may be made by those skilled in the art within the scope of the present invention, and are intended to be included in the scope of the present invention. Therefore, the protection scope of the invention is subject to the protection scope of the claims.
Claims (10)
1. The method for controlling the augmented reality glasses is characterized in that the method for controlling the augmented reality glasses is applied to the augmented reality glasses, and the augmented reality glasses comprise nose pads; the augmented reality glasses control method comprises the following steps:
Based on a sensing component positioned at a nose pad position in the augmented reality glasses, acquiring wearing characteristic information of a user, wherein the wearing characteristic information is used for describing nose bridge characteristic information of the user under the condition that the user wears the augmented reality glasses currently;
inputting the wearing characteristic information into an adjustment mode matching model to determine a target adjustment mode corresponding to the wearing characteristic information;
And adjusting the current nose pad form of the augmented reality glasses based on the target adjusting mode to obtain a target nose pad form.
2. The augmented reality glasses control method of claim 1, wherein the sensing assembly comprises a plurality of pressure sensors and a plurality of optical sensors, the pressure sensors and the optical sensors being distributed at different detection positions of the nose pad; the step of acquiring the wearing characteristic information of the user based on the sensing component positioned at the nose pad position in the augmented reality glasses comprises the following steps:
acquiring detection pressure values of the nose pads on the human face, which are acquired by the pressure sensors;
acquiring distance information from the nose pad to the face, which is acquired by each optical sensor;
and determining wearing characteristic information of the user according to the detected pressure value and the distance information.
3. The method of claim 1, wherein the target adjustment mode includes a target adjustment parameter, the target adjustment parameter is used to indicate an adjustment degree corresponding to a height, a width and an angle of the nose pad, and the step of adjusting a current nose pad shape of the augmented reality glasses based on the target adjustment mode to obtain a target nose pad shape includes:
And adjusting the parameters corresponding to the current nose pad form based on the target adjusting parameters to obtain the target nose pad form.
4. The augmented reality glasses control method according to claim 1, wherein before the step of acquiring wearing feature information of the user, the method further comprises:
acquiring facial feature information of the user:
determining an initial nose pad state of the nose pad according to the feature information of the nose bridge area in the facial feature information and the facial contour features in the facial feature information;
And adjusting the current nose pad form of the augmented reality glasses to the initial nose pad form.
5. The augmented reality glasses control method of claim 1, wherein the augmented reality glasses further comprise a plurality of pressure sensors distributed at different detection positions of the nose pads; during the adjustment of the morphology of the nose pad, the method further comprises:
acquiring detection pressure values acquired by the pressure sensors;
for each detection position, acquiring a safety pressure threshold corresponding to the detection position;
judging whether the detected pressure value is greater than or equal to the safety pressure threshold value;
and if the detected pressure value is greater than or equal to the safety pressure threshold value, stopping adjusting the form of the nose pad.
6. The method for controlling the augmented reality glasses according to claim 1, wherein after the step of adjusting the current nose pad shape of the augmented reality glasses based on the target adjustment mode to obtain the target nose pad shape, the method further comprises:
Receiving a nose pad adjusting instruction sent by a user;
And adjusting the form of the nose pad based on the nose pad adjusting instruction.
7. The augmented reality glasses control method of claim 1, wherein the method further comprises:
Acquiring different types of reference wearing characteristic information and a reference adjusting mode corresponding to each piece of reference wearing characteristic information;
inputting the reference wearing characteristic information into a model to be trained to determine a training adjustment mode matched with the reference wearing characteristic information;
and performing machine learning training on the model to be trained based on the reference adjustment mode and the training adjustment mode to obtain the adjustment mode matching model.
8. An augmented reality glasses, wherein the augmented reality glasses include a nose pad and a processor, the processor comprising:
the first acquisition module is used for acquiring wearing characteristic information of a user based on a sensing assembly positioned at a nose pad position in the augmented reality glasses, wherein the wearing characteristic information is used for describing nose bridge characteristic information of the user under the condition that the user wears the augmented reality glasses currently;
the first determining module is used for inputting the wearing characteristic information into an adjusting mode matching model to determine a target adjusting mode corresponding to the wearing characteristic information;
And the first adjusting module is used for adjusting the current nose pad form of the augmented reality glasses based on the target adjusting mode to obtain a target nose pad form.
9. An augmented reality glasses control comprising a memory, a processor and a computer program stored on the memory and executable on the processor, which when executed by the processor implements the steps of the augmented reality glasses control method according to any one of claims 1 to 7.
10. A computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, which when executed by a processor, implements the steps of the augmented reality glasses control method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311815132.5A CN118011634A (en) | 2023-12-26 | 2023-12-26 | Extended reality glasses control method, extended reality glasses, electronic equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311815132.5A CN118011634A (en) | 2023-12-26 | 2023-12-26 | Extended reality glasses control method, extended reality glasses, electronic equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN118011634A true CN118011634A (en) | 2024-05-10 |
Family
ID=90952657
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311815132.5A Pending CN118011634A (en) | 2023-12-26 | 2023-12-26 | Extended reality glasses control method, extended reality glasses, electronic equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN118011634A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118707731A (en) * | 2024-07-24 | 2024-09-27 | 歌尔股份有限公司 | Smart glasses |
| CN119548383A (en) * | 2025-01-20 | 2025-03-04 | 宁波浙鼎教育科技有限公司 | Artificial intelligence-based teenager pseudomyopia relieving method |
-
2023
- 2023-12-26 CN CN202311815132.5A patent/CN118011634A/en active Pending
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118707731A (en) * | 2024-07-24 | 2024-09-27 | 歌尔股份有限公司 | Smart glasses |
| CN119548383A (en) * | 2025-01-20 | 2025-03-04 | 宁波浙鼎教育科技有限公司 | Artificial intelligence-based teenager pseudomyopia relieving method |
| CN119548383B (en) * | 2025-01-20 | 2025-05-27 | 宁波浙鼎教育科技有限公司 | An artificial intelligence-based device for alleviating pseudomyopia in adolescents |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN118011634A (en) | Extended reality glasses control method, extended reality glasses, electronic equipment and medium | |
| CN113639446B (en) | Method and device for controlling air conditioner, air conditioner and storage medium | |
| US11561392B2 (en) | Method for generating and displaying a virtual object by an optical system | |
| US8135173B2 (en) | Eye-tracking method and eye-tracking system for implementing the same | |
| US11033204B2 (en) | Method for determining an ophthalmological parameter | |
| TW201437682A (en) | Method for adjusting head mounted display adaptively and head-mounted display | |
| CN113137723A (en) | Method and device for controlling air conditioner and air conditioner | |
| CN105847538B (en) | Mobile phone and method for controlling VR (virtual reality) glasses operation based on eyeball tracking | |
| AU2014276655A1 (en) | Method for determining at least one value of a parameter for customising a visual compensation device | |
| JP6981277B2 (en) | Detection device and detection program | |
| US20170372679A1 (en) | Mobile Terminal for Automatically Adjusting a Text Size and a Method Thereof | |
| CN105431765A (en) | Focal length adjustment | |
| CN112839162B (en) | Method, device, terminal and storage medium for adjusting eye display position | |
| CN114816065B (en) | Screen backlight adjusting method, virtual reality device and readable storage medium | |
| CN118279966A (en) | Sight tracking method and device, electronic equipment and storage medium | |
| CN109856802B (en) | Interpupillary distance adjustment method, device and virtual display device | |
| CN111190524A (en) | Control method and system for automatically adjusting font size of screen and air conditioner | |
| CN112130326B (en) | Method and device for improving eye protection performance of VR glasses | |
| CN114857126A (en) | Cylinder control device, cylinder control method, and electronic apparatus | |
| KR101610496B1 (en) | Method and apparatus for gaze tracking | |
| CN118807180A (en) | An adaptive motion control system for fitness equipment | |
| CN103927012A (en) | Mobile terminal achieving user posture detection through operating system and method | |
| US11978281B2 (en) | Facial expression alterations | |
| CN109552221B (en) | Driving control system and method | |
| CN118182352A (en) | Vehicle-mounted cosmetic mirror adjusting method, vehicle-mounted cosmetic mirror, device, medium and vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |