CN114355627A

CN114355627A - Method and device for adjusting length of glasses leg, electronic equipment and storage medium

Info

Publication number: CN114355627A
Application number: CN202210010063.XA
Authority: CN
Inventors: 许芳; 夏勇峰
Original assignee: Beijing Beehive Century Technology Co ltd
Current assignee: Beijing Beehive Century Technology Co ltd
Priority date: 2022-01-05
Filing date: 2022-01-05
Publication date: 2022-04-15
Anticipated expiration: 2042-01-05
Also published as: CN114355627B

Abstract

The application relates to the field of glasses, in particular to a method and a device for adjusting the length of glasses legs, electronic equipment and a storage medium, wherein the method comprises the following steps: acquiring a first position of a contact point of a glasses ear hanging part and an ear part, and acquiring a second position of a contact point of a glasses nose frame part and a nose part corresponding to the glasses ear hanging part; determining a distance between the first location and the second location; reading current user information, and acquiring preset volume at an ear hole of a user; determining a corresponding target distance range from the pre-stored corresponding relation among the user information, the volume and the distance range according to the current user information and the preset volume at the ear hole of the user; and sending an adjusting instruction to the telescopic part of the glasses leg according to the distance between the first position and the second position, wherein the adjusting instruction is used for controlling the telescopic part of the glasses leg to stretch until the adjusted distance is within the target distance range. This application can be convenient for accurately adjust the position of audio preferred with the mirror leg.

Description

Method and device for adjusting length of glasses leg, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of glasses, and in particular, to a method and an apparatus for adjusting a length of a temple, an electronic device, and a storage medium.

Background

Along with the rapid development of intelligent technologies, the types of intelligent devices are more and more. The wearer can wear smart glasses such as AR (Augmented Reality) glasses and 3D (three-dimensional) glasses. Under the scenes of playing music such as a movie theater, the wearer can wear the intelligent glasses with the music function. For intelligent glasses with music function, the sound outlet hole is too close to or too far away from the ear, which affects the experience of the wearer. Therefore, it is important to properly adjust the distance between the sound output hole of the glasses and the ears.

In the related art, after a wearer wears glasses, the wearer adjusts the glasses to a comfortable position according to the perception of the wearer, but the position of the adjusted glasses is not necessarily the best position of sound effect, the wearer needs to repeatedly adjust the positions of the glasses, and the whole process is time-consuming and labor-consuming.

In the process of implementing the present application, the inventor thinks that the position of the sound outlet hole of the glasses may not be accurately adjusted to the distance with better sound effect only by the perception of the wearer, so how to more accurately adjust the glasses to the position with better sound effect becomes a key problem.

Disclosure of Invention

In order to adjust the glasses legs to the position with better sound effect accurately, the application provides a method and a device for adjusting the lengths of the glasses legs, electronic equipment and a storage medium.

In a first aspect, the method for adjusting the length of the glasses leg provided by the application adopts the following technical scheme:

a temple length adjustment method comprising:

acquiring a first position of a contact point of a glasses ear hanging part and an ear part, and acquiring a second position of a contact point of a glasses nose frame part and a nose part corresponding to the glasses ear hanging part;

determining a distance between the first location and the second location;

reading current user information, and acquiring preset volume at an ear hole of a user, wherein the preset volume is the target volume at the ear hole of the user under the condition of playing audio;

determining a corresponding target distance range from the pre-stored corresponding relation among the user information, the volume and the distance range according to the current user information and the preset volume at the ear hole of the user;

and sending an adjusting instruction to the telescopic part of the glasses leg according to the distance between the first position and the second position, wherein the adjusting instruction is used for controlling the telescopic part of the glasses leg to stretch until the adjusted distance is within the target distance range.

By adopting the above scheme, confirm the distance between first position and the second position, then acquire current user information, and confirm the preset volume of user's ear hole department, can be according to user information, the corresponding relation between volume and the distance range, thereby obtain the target distance range that corresponds based on current user information and settlement volume, when the actual distance of first position and second position is in the target distance range, can have better audio, current user's auditory effect has been guaranteed, this scheme will control the telescopic part of mirror leg to carry out flexible adjustment instruction and send to the telescopic part of mirror leg, thereby can make the distance after the adjustment be in the target distance range, the step that the mirror leg manually adjusts the flexibility has been saved from this, and then accurately will go out the sound hole and adjust to the position of audio preferred, guarantee wearer's auditory effect.

In another possible implementation manner, the obtaining the preset volume at the ear hole of the user includes:

acquiring the volume of the environmental sound where the glasses are located and/or the size of the space where the glasses are located;

determining a correction coefficient based on the volume of the ambient sound where the glasses are located and/or the size of the space where the glasses are located;

acquiring a set volume selected by a user;

and correcting the set volume based on the correction coefficient to obtain the preset volume at the ear hole of the current user.

By adopting the technical scheme, because the environmental factors can lead to the effect of listening to the audio currently, the volume set by the user is revised according to the volume of the environmental sound where the glasses are located and/or the space size where the glasses are located, so that the target volume at the ear hole of the current user is determined, the difference between the volume heard by the user and the volume set by the user is reduced, the revised volume is close to the volume with better audio effect, and the hearing effect of a wearer is improved.

In another possible implementation manner, the obtaining the volume of the ambient sound where the glasses are located includes:

acquiring the environmental sound of the glasses, and extracting background sound from the environmental sound;

and inputting the background sound into a pre-trained model, and outputting the volume of the environmental sound.

Through adopting above-mentioned technical scheme, can be through the extraction to the background sound in the environmental sound that glasses were located, confirm the environmental sound volume to with the noisy noise separation of the audio frequency of glasses broadcast and external environment, and then can be based on the environmental sound volume, confirm accurate revision coefficient.

In another possible implementation manner, the acquiring the second position of the contact point of the nose portion and the nose portion of the glasses corresponding to the glasses hanging ear portion includes:

acquiring a three-dimensional face image of a user, and extracting feature points of the three-dimensional face image;

determining a first contact point in the face, which is in contact with a spectacle frame part, from the feature points of the three-dimensional face image;

judging whether the first contact point is in a set range of the midpoint of the two eye characteristic points;

and if the first contact point is in the set range of the midpoint of the two eye characteristic points, acquiring a second position of the contact point of the nose part and the nose part of the glasses corresponding to the glasses ear hanging part.

By adopting the technical scheme, the first contact point can be determined, whether the first contact point is in the set range of the middle point of the two eyes or not is judged, and the second position is obtained only when the first contact point is in the set range of the middle point of the characteristic points of the two eyes, so that the second position is not obtained when the glasses are not worn, and the electric energy loss is reduced.

In another possible implementation manner, the acquiring a three-dimensional face image of a user further includes:

acquiring reflection spectrum information of a target object wearing intelligent glasses;

comparing the reflection spectrum information with target reflection spectrum information, and judging whether the reflection spectrum information corresponds to a real human face;

and if the reflection spectrum information corresponds to a real face, executing the step of acquiring the three-dimensional face image of the user.

By adopting the technical scheme, whether the current user is a real face is judged by comparing the spectral information of the target object wearing the intelligent glasses with the target spectral information, so that when the target object wearing the glasses is the real face, the three-dimensional face image of the user is obtained, and the electric energy loss of the target object wearing the glasses, which is a false face, is reduced.

In another possible implementation manner, the sending an adjustment instruction to the telescopic portion of the temple includes:

acquiring a wearing mode determined by a current user, wherein the wearing mode comprises any one of a music mode, a movie mode and a common mode;

determining a distance range corresponding to the wearing mode determined by the current user, wherein the distance range is a subinterval of the target distance range;

and determining an adjusting instruction corresponding to the distance range, and sending the adjusting instruction to the telescopic part of the glasses leg, wherein the adjusting instruction is used for controlling the telescopic part of the glasses leg to stretch until the adjusted distance is within the target distance range.

By adopting the technical scheme, the distance ranges corresponding to different wearing modes are matched according to different wearing modes selected by a user, so that the user selects different wearing modes in different scenes based on the distance range corresponding to the current wearing mode, determines an adjusting instruction based on the distance range, and sends the adjusting instruction to the telescopic part of the glasses, so that the telescopic part of the glasses legs stretches and contracts, and the comfort level of the wearer is improved.

In another possible implementation manner, the obtaining of the wearing mode determined by the current user includes:

displaying a plurality of wearing modes to be selected on a display interface of the intelligent glasses, and determining the wearing mode corresponding to the preset direction pointed by the pupil of the current user; determining the stay time of the current user pupil in the preset direction;

judging whether the stay time length is greater than a stay time length threshold value or not;

and when the stay time is longer than the stay time threshold, determining a mode corresponding to the preset direction and determining a wearing mode for the current user.

By adopting the technical scheme, whether the stay time is longer than the stay time threshold value or not can be judged based on the fact that the current user pupil stays for different preset directions, so that the user pupil direction and the wearing mode can be accurately corresponded, the wearing mode of the current user is determined when the stay time is longer than the stay time threshold value, and the comfort level of a wearer can be improved.

In a second aspect, the present application provides a device for a method for adjusting a length of a temple, which adopts the following technical solution:

a method and a device for adjusting the length of a glasses leg comprise the following steps:

the first acquisition module is used for acquiring a first position of a contact point of a glasses ear hanging part and an ear part and acquiring a second position of a contact point of a glasses nose frame part and a nose part corresponding to the glasses ear hanging part;

a first determining module for determining a distance between the first location and the second location;

the second acquisition module is used for reading the current user information and acquiring the preset volume at the ear hole of the user;

the second determining module is used for determining a corresponding target distance range from the pre-stored corresponding relation among the user information, the volume and the distance range according to the current user information and the target volume at the ear hole of the user;

and the sending module is used for sending an adjusting instruction to the telescopic part of the glasses leg according to the distance between the first position and the second position, wherein the adjusting instruction is used for controlling the telescopic part of the glasses leg to stretch until the adjusted distance is within the target distance range.

By adopting the technical scheme, the first determining module determines the distance between the first position and the second position, then reads the current user information, the second acquiring module acquires the preset volume at the ear hole of the user, the second determining module can obtain the target distance range corresponding to the current user information and the set volume according to the corresponding relation among the user information, the volume and the distance range, when the distance between the first position and the second position is within the target distance range, the sound effect under the preset volume can be achieved, the auditory effect of the current user is ensured, the scheme sends the adjusting instruction for controlling the telescopic part of the glasses leg to stretch out and draw back to the telescopic part of the glasses leg, so that the adjusted distance is within the target distance range, the step of manually adjusting the telescopic part of the glasses leg by a wearer is omitted, and the sound hole is accurately adjusted to the position with the better sound effect, ensuring the hearing effect of the wearer.

In another possible implementation manner, when acquiring the volume preset at the ear hole of the user, the second acquiring module is specifically configured to:

determining a correction coefficient based on the volume of the environment sound where the glasses are located and/or the size of the space where the glasses are located;

acquiring a set volume selected by a user;

and correcting the set volume based on the correction coefficient to obtain the preset volume at the ear hole of the user.

In another possible implementation manner, when acquiring the volume of the ambient sound where the glasses are located, the second acquiring module is specifically configured to:

In another possible implementation manner, the first obtaining module, when obtaining the second position of the contact point of the nose portion and the nose portion of the glasses corresponding to the glasses hanging ear portion, is specifically configured to:

In another possible implementation manner, the apparatus further includes: a third obtaining module, a judging module and an executing module, wherein,

the third acquisition module is used for acquiring the reflection spectrum information of a target object wearing the intelligent glasses;

and the judging module is used for comparing the reflection spectrum information with the target reflection spectrum information and judging whether the reflection spectrum information corresponds to a real human face.

And the execution module is used for executing the step of acquiring the three-dimensional face image of the user when the reflection spectrum information corresponds to the real face.

In another possible implementation manner, when sending the adjustment instruction to the telescopic portion of the temple, the sending module is specifically configured to:

In another possible implementation manner, when obtaining the wearing mode determined by the current user, the sending module is specifically configured to:

In a third aspect, the present application provides an electronic device, which adopts the following technical solutions:

an electronic device, comprising:

at least one processor;

a memory;

at least one application, wherein the at least one application is stored in the memory and configured to be executed by the at least one processor, the at least one application configured to: a temple-length adjustment method according to any one of the possible implementations of the first aspect is performed.

In a fourth aspect, the present application provides a computer-readable storage medium, which adopts the following technical solutions:

a computer-readable storage medium, comprising: there is stored a computer program that can be loaded by a processor and that executes a method for temple length adjustment as shown in any of the possible implementations of the first aspect.

In summary, the present application includes at least one of the following beneficial technical effects:

1. determining the distance between a first position and a second position, then acquiring current user information, determining preset volume at an ear hole of a user, and obtaining a target distance range corresponding to the current user information and the set volume according to the corresponding relation between the user information, the volume and the distance range;

2. according to different wearing modes selected by the user, the distance ranges corresponding to the different wearing modes are matched, so that when the user selects different wearing modes in different scenes, the distance ranges corresponding to the current wearing modes are determined based on the distance ranges, the adjusting instructions are sent to the telescopic parts of the glasses, the telescopic parts of the glasses legs stretch, and the comfort level of the wearer is improved.

Drawings

Fig. 1 is a schematic flowchart of a method for adjusting a length of a temple according to an embodiment of the present application.

Fig. 2 is a schematic structural view of a temple length adjusting apparatus according to an embodiment of the present application.

Fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The embodiments of the present application will be described in further detail with reference to the accompanying drawings 1-3.

The present embodiment is only for explaining the present application, and it is not limited to the present application, and those skilled in the art can make modifications of the present embodiment without inventive contribution as needed after reading the present specification, but all of them are protected by patent law within the scope of the claims of the present application.

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

In addition, the term "and/or" herein is only one kind of association relationship describing an associated object, and means that there may be three kinds of relationships, for example, a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship, unless otherwise specified.

With the rapid development of intelligent technology, the types of intelligent glasses are gradually increased, and the application is gradually wide. When the intelligent glasses with the audio playing function are worn by a wearer, the sound outlet holes are formed in the intelligent glasses, so that the hearing effect of the wearer is required to be guaranteed, and the sound outlet holes of the intelligent glasses are required not to be too close to or too far away from ear holes of the wearer.

In the related art, the temple is adjusted to a proper position by the wearer according to the sensory recognition after the wearer wears the glasses, but since it is difficult for the wearer to adjust the glasses to a proper position at a time, it takes much time and effort to repeatedly adjust.

In order to solve the above technical problem, an embodiment of the present application provides a method for adjusting lengths of glasses legs, which can read current user information, determine a volume at an ear hole of a current user, determine, based on a corresponding relationship between the user information, the volume, and a distance range, a target distance range corresponding to the current user information and the volume at the ear hole of the current user, and control, based on an adjustment instruction, a telescopic portion of the glasses legs to stretch so that an adjusted distance is within the target distance range, thereby enabling a user to have better hearing experience.

In order to better implement the temple length adjustment method, the following description is made by way of specific examples in conjunction with the accompanying drawings.

The embodiment of the application provides a method for adjusting the length of glasses legs, which is executed by electronic equipment, wherein the electronic equipment can be a smart phone, a tablet personal computer or smart glasses.

Further, an embodiment of the present application provides a method for adjusting a length of a temple, as shown in fig. 1, which gives an example to implement a method for adjusting a length of a temple, specifically as follows:

step S101, a first position of a contact point of a glasses ear hanging part and an ear part is obtained, and a second position of a contact point of a glasses nose frame part and a nose part corresponding to the glasses ear hanging part is obtained.

To this application embodiment, glasses include picture frame and lens, and wherein, the picture frame includes mirror leg and glasses nose frame portion, and the mirror leg includes glasses hangers portion and can adjust the pars contractilis of mirror leg length.

A temple sensor for acquiring a first position is mounted on a spectacle frame ear part in advance, and a nose pad sensor for acquiring a second position is mounted on a spectacle nose frame part. The temple sensor and the nose pad sensor may be position sensors, and the position sensors include a contact position sensor and a proximity position sensor, which are not limited in the embodiments of the present application. It is worth mentioning that the position sensor is a multipoint sensor in order to be able to accurately acquire the first position and the second position.

Specifically, when the sensor is a contact type position sensor, when a contact of the contact type position sensor is squeezed by the glasses legs and the ears of the wearer to generate pressure, the contact type position sensor collects the positions of contact points of the glasses legs and the ears of the wearer, and sends the positions of the contact points serving as first positions to the electronic equipment.

Step S102, a distance between the first position and the second position is determined.

For the embodiment of the present application, the first coordinates of the first position are acquired by the temple sensors as (X1, Y1, Z1), the second coordinates of the second position are acquired by the nose pad sensors as (X2, Y2, Z2), the distance between the first position and the second position is determined as L1, and the distance L1 is calculated by obtaining a formula of the distance from the first coordinates, the second coordinates, and the two-point coordinates. The formula for obtaining the distance by two-point coordinates can be as follows:

。

step S103, reading the current user information, and acquiring the preset volume at the ear hole of the user.

The preset volume is the target volume of the ear hole of the user under the condition of playing audio.

For the embodiment of the application, the current user information includes a user identifier, and the user identifier includes but is not limited to a user name, a user ID, a user identification number, and a user fingerprint, as long as the information uniquely represents the user identity. The preset volume is the target volume at the ear hole of the user under the playing audio, and the auditory effect of the user is better under the target volume.

And step S104, determining a corresponding target distance range from the pre-stored corresponding relation among the user information, the volume and the distance range according to the current user information and the preset volume at the ear hole of the user.

For the embodiment of the present application, the corresponding relationship among the user information, the volume and the distance range is stored in advance, the corresponding relationship may be a text or a table, and the embodiment is not limited.

And determining a target distance range corresponding to the user information, the preset volume and the distance range according to the corresponding relation among the user information, the volume and the distance range. The target distance range is a standard distance range of the first location and the second location.

For the glasses capable of playing audio, the glasses legs close to the ear holes are provided with sound holes, the sound holes are used for playing audio, when the preset volume at the ear holes of the user is the target volume of the ear holes of the user under the audio playing, the sound effect with better effect is shown at present, and at the moment, the distance range from the corresponding sound holes to the ear holes is the preset range of the effect.

It can be understood that after audio is played, the actual volume at the ear hole of the user is the preset volume, the distance between the first position and the second position is within the target distance range by adjusting the length of the glasses legs, and meanwhile, the distance range from the sound outlet hole to the ear hole is the sound effect preset range. It is understood that the specific relationship between the three is data obtained from a plurality of samples through a plurality of experiments.

Specifically, there is a correspondence between user information, volume, and target distance. For example, if the current user information is "three, when the volume corresponding to the three user information is volume 1, the volume 1 corresponds to the target distance LB1-LB 2; when the volume corresponding to the user Zhang III is volume 2, the target distance corresponding to the volume 2 is LB3-LB 4; if the current user information is "liquad", when the volume corresponding to the user liquad is 3, the target distance corresponding to the volume 3 may be LB1-LB2, LB3-LB4, or LB5-LB 6; when the volume corresponding to the user lie four is volume 4, the target distance corresponding to the volume 4 may be LB1-LB2, LB3-LB4, and LB6-LB 7.

When the adjusted distance is LB1-LB2, the distance between the sound outlet hole and the ear hole is LA1-LA2, which is the distance range with better sound effect.

And step S105, sending an adjusting instruction to the telescopic part of the temple according to the distance between the first position and the second position.

And the adjusting instruction is used for controlling the telescopic part of the glasses leg to stretch until the adjusted distance is within the target distance range.

For the present application, before sending the adjustment command to the extendable portion of the temple, it is determined whether the distance L1 between the first position and the second position is within the target distance range LB1-LB 2. When the distance L1 between the first position and the second position is larger than LB2, the telescopic parts of the temples are controlled to stretch and contract, and the distance is shortened to be L1-LB 2-L1-LB 1; when the distance L1 between the first position and the second position is less than LB1, the temple extension is controlled to extend by LB1-L1 to LB 2-L1. The telescopic parts of the glasses legs can be automatically telescopic by matching with a telescopic structure through electronic parts such as a motor and the like so as to ensure that the telescopic distance L1 falls between LB1-LB 2. Further, after the adjustment of the telescopic parts of the glasses legs is completed, the distance between the sound outlet holes of the glasses and the ear holes of the user is the distance with better sound effect, and the user can have better hearing experience.

In a possible implementation manner of the embodiment of the present application, the obtaining of the second position of the contact point between the nose portion and the nose portion of the glasses corresponding to the ear hanging portion of the glasses in step S101 may specifically include: step S1011 (not shown), step S1012 (not shown), step S1013 (not shown), and step S1014 (not shown), wherein,

step S1011, a three-dimensional face image of the user is acquired, and feature points of the three-dimensional face image are extracted.

For the embodiment of the application, a plurality of cameras are arranged on the nose frame part of the glasses in advance, and the three-dimensional face image is obtained according to the user image shot by the cameras. Wherein, obtain three-dimensional face image according to the user's image that a plurality of cameras were shot, include: the method comprises the steps of carrying out histogram equalization on a user image containing a human face, changing the gray value of the image point by point, carrying out median filtering on the image with the changed gray value to remove noise in the image, finally carrying out normalization on the filtered image, and carrying out normalization on the image of the same person shot under the imaging conditions of different directions, distances and the like to obtain a three-dimensional human face image.

Specifically, the extracting feature points of the three-dimensional face image includes: after the three-dimensional face image shot by the camera is acquired, the three-dimensional face image is preliminarily screened, the image which does not contain the face image is screened, and then the image which contains the face is subjected to feature point extraction.

The feature point detection is carried out on the human face, and the nose root, the nose bone, the nostrils, the auricle, the earlobe and the like of the human face are positioned on the basis of extracting the features of the human face.

In an implementation mode, the characteristic points of the three-dimensional face image are extracted, and the method comprises the following steps: the method comprises the steps of firstly dividing a three-dimensional face image into small regions through HOG (Histogram of Oriented gradients), then acquiring the gradient or edge direction Histogram (the Histogram is in balanced association with the Histogram of the previous section) of each pixel point in the small regions, and combining the direction histograms to form feature points.

In another implementation, the extracting the feature points of the three-dimensional face image includes: performing convolution, activation, pooling and full-connection Network on the three-dimensional face image by using a Convolutional Neural Network (CNN), and finally outputting the feature points of the three-dimensional face image.

In another implementation, the extracting the feature points of the three-dimensional face image includes: 5 feature points of the nasal root, the nasal bone, the nostril, the auricle and the earlobe in the human face are positioned through a Cascade Cascade regression (CNN) method, and the positions of the feature points are predicted in a human face frame. Firstly, training a network capable of predicting the relative positions of the feature points in the face frame, and then predicting the coordinates of the feature points in the face frame.

In another implementation, the extracting the feature points of the three-dimensional face image includes: the method for detecting the facial feature points of the human face through the Dlib face feature point detection, the libfacedetect face feature point detection and the Seetaface face feature point detection can be used, and the method is not limited to the above feature point detection mode in the embodiment of the application.

In step S1012, a first contact point between the face and the nosepiece portion of the spectacles is determined from the feature points of the three-dimensional face image.

It is an object of embodiments of the present application to determine a type of feature points of a three-dimensional face image, the type including glasses or nose, so as to determine a first contact point according to the type. Specifically, the method may be to perform regional detection on a plurality of feature points of the three-dimensional face image, and determine the type corresponding to each region, where the specific determination manner may be to determine the type corresponding to each feature point by identifying skin texture features of each feature point, and certainly, other manners may exist, and this embodiment is not limited.

In step S1013, it is determined whether the first contact point is within a set range from a midpoint between the two eye feature points.

For the embodiment of the application, after the feature points corresponding to the glasses are determined, the midpoint coordinate between the two feature points can be determined according to the pixel points, the horizontal floating value is selected, and the setting range is determined according to the horizontal floating value; for example, the coordinates of the first eye are (Xa, Y), the coordinates of the second eye are (Xb, Y), and the horizontal floating value is b, where Xa is greater than Xb, a range of ((Xa-Xb)/2-b, Y) - ((Xa-Xb)/2 + b, Y) is set.

In step S1014, if the first contact point is within the set range of the two eye points, a second position of the contact point between the nose portion and the nose portion of the glasses corresponding to the ear hanging portion of the glasses is acquired.

For the embodiment of the application, if the first contact point is in the setting range of the middle point of the two eyes, it is determined that the current glasses are worn on the human face, and the glasses are worn on the nose frame portion, the second position of the contact point of the nose frame portion and the nose portion of the glasses is obtained, so that the second position is not obtained when the nose frame portion of the glasses is not located on the nose portion, and the electric energy loss caused by the fact that the second position is obtained when the wearer does not wear the glasses is reduced.

In a possible implementation manner of the embodiment of the present application, the acquiring a three-dimensional face image of a user in step S1011 further includes:

and acquiring the reflection spectrum information of the target object wearing the intelligent glasses.

For the embodiment of the present application, the target object includes a human face and a prosthetic human face, a color CCD (charge coupled device) camera may be mounted on the glasses in advance, the color CCD camera may acquire a color video with spatial information, and then the spectral video after sampling is acquired synchronously by the high-spectrum imaging device, and the spectral video is subjected to target detection and target tracking to extract spectral information of a frame image. And comparing the reflection spectrum information with the target spectrum information, and judging whether the reflection spectrum information corresponds to a real human face. And if the reflection spectrum information corresponds to a real face, executing the step of acquiring a three-dimensional face image of the user.

For the embodiment of the application, the spectral information of the frame image is compared with the target spectral information in the database, the wavelength of the reflection spectral information is determined, the wavelength of the reflection spectral information is compared with the wavelength corresponding to the skin of the human face, then the spectral living body detection is carried out on the spectral information of the human face, whether the current spectral information is the spectral information of the natural skin or not is judged, if the current spectral information is the spectral information of the natural skin, the current spectral information is determined to be the real human face, the three-dimensional human face image of the user is acquired, and therefore when the glasses are worn on the false human face, the electric energy loss caused by the fact that the lengths of the glasses legs are repeatedly adjusted by the glasses is reduced.

And if the reflection spectrum information corresponds to a real face, executing the step of acquiring a three-dimensional face image of the user.

In a possible implementation manner of the embodiment of the present application, the determining the target volume at the ear hole of the current user in step S103 may specifically include: step S1031 (not shown), step S1032 (not shown), step S1033 (not shown), and step S1034 (not shown), wherein,

and step S1031, acquiring the volume of the environmental sound where the glasses are located and/or the size of the space where the glasses are located.

For the embodiment of the application, the volume of the environmental sound where the glasses are located is obtained, the current environmental sound where the glasses are located can be obtained through a sound collection sensor arranged in the glasses, the environmental sound comprises sound tones, timbres, volume and the like, the sound volume is extracted, and the volume of the environmental sound can be expressed in decibels (dB).

In an implementation, obtaining the volume of the ambient sound where the glasses are located comprises: the method comprises the steps of obtaining the volume of environmental sound collected by external equipment, wherein the external equipment comprises a mobile phone provided with a decibel meter, the mobile phone is connected with glasses through a near field transmission protocol, and the near field transmission protocol can comprise a Bluetooth protocol, an NFC protocol and the like.

In another implementation, obtaining the size of the space in which the glasses are located includes: the size of the space where the glasses are located at present is collected through a laser range finder or an infrared range finder arranged in the glasses, specifically, the infrared range finding or the laser range finding is carried out through measuring the light returning time, and based on the light returning time, the light speed and the atmospheric refraction coefficient, the azimuth distance is calculated, and then the space size is calculated through a plurality of distances.

In step S1032, a correction coefficient is determined based on the volume of the ambient sound where the glasses are located and/or the size of the space where the glasses are located.

For the embodiment of the application, the correction coefficient may be determined based on the volume of the environment where the glasses are located, may also be determined based on the size of the space where the glasses are located, and may also be determined based on both the volume of the environment where the glasses are located and the size of the space where the glasses are located. Specifically, when the volume of the environment where the glasses are located is large, i.e. the surrounding environment is loud, and/or when the space where the glasses are located is large, i.e. the surrounding environment is spacious, the corresponding correction coefficient is large. For example, when the volume of the environment where the glasses are located is below 60 decibels, that is, the environment where the glasses are located is quite, the current environment has little influence on the sound effect, and the correction coefficient is 1; when the volume of the environment is 60-100 decibels, namely the environment where the glasses are located is noisy, the current environment has an influence on the sound effect, and the correction coefficient is 1.2; when the environmental sound effect is 100-150 db, i.e. the environment where the glasses are located is noisy, the current environment has a large influence on the sound effect, and the correction factor is 1.5.

In step S1033, the set volume selected by the user is acquired.

For the embodiment of the application, the set volume of the played audio selected by the user is obtained, and the set volume value selected by the user can be determined by obtaining the volume selected by the user through pressing keys or selecting the volume selected by the user through sliding. It is noted that the set volume selected by the user is not equivalent to the volume actually heard by the user.

Step S1034, the set volume is corrected based on the correction coefficient, and the preset volume at the ear hole of the current user is obtained.

For the embodiment of the application, the set volume is trimmed based on the volume of the environment where the glasses are located and the correction coefficient determined by the size of the space where the glasses are located. When the volume of the environment where the glasses are located is small, namely the surrounding environment is quite, and/or when the space where the glasses are located is small, namely the space where the glasses are located is a relatively closed space, the volume of the ear hole of the user is relatively close to the set volume selected by the user, and the corresponding correction coefficient is a coefficient close to 1. The set volume is corrected based on the correction coefficient, so that the volume at the ear hole of the user is close to the set volume selected by the user, the possibility that the difference between the volume at the ear hole of the user and the set volume is too large due to noisy environment is reduced, and the auditory effect of the user is improved.

In a possible implementation manner of the embodiment of the application, the obtaining of the volume of the environmental sound where the glasses are located in step S1031 may specifically include: step S10311 (not shown in the figure) and step S10312 (not shown in the figure), wherein,

step S10311, obtaining the environmental sound of the glasses, and extracting the background sound from the environmental sound.

For the embodiment of the application, the environmental sound includes audio sound and background sound played by the glasses, and the background sound includes, but is not limited to, crowd sound, traffic sound, equipment operating sound, and the like. Background sounds are extracted from the environmental sounds, and the peak frequencies of the environmental sounds can be obtained by performing nonlinear variation on the audio signals of the environmental sounds. And comparing the peak frequency of the environmental sound with the threshold frequency, taking the environmental sound lower than the threshold frequency as background sound, and extracting the background sound, thereby distinguishing the audio played by the glasses from the background sound of the external environment.

And step S10312, inputting the background sound into the pre-trained model, and outputting the volume of the environmental sound.

For the embodiment of the application, a model corresponding to the sound and the volume can be trained in advance, the model can be a convolutional neural network, and the neural network model is trained and learned. A large number of sample values are input into a neural network model, and the sample values are trained, wherein the sample values comprise matching relations between a plurality of groups of sounds and volumes corresponding to the sounds. And inputting the background sound into the trained convolutional neural network to obtain the volume corresponding to the background sound.

In a possible implementation manner of the embodiment of the present application, the sending of the adjustment instruction to the telescopic portion of the temple in step S105 may specifically include: step S1051 (not shown), step S1052 (not shown), and step S1051 (not shown), wherein,

step S1051, acquiring the wearing mode determined by the current user.

The wearing mode includes any one of a music mode, a movie mode and a normal mode.

For the embodiment of the application, the user can freely select the mode according to different requirements of different scenes on comfort and auditory effect.

In an implementation manner, a plurality of keys are pre-installed on the glasses, the keys include a music mode key, a movie mode key and a common mode key, and the obtaining of the wearing mode determined by the current user includes: and when the user triggers the target key, acquiring the corresponding wearing mode determined by the current user.

In another implementation, a key is mounted in the glasses in advance, the number of times of key pressing represents a corresponding wearing mode, and acquiring the wearing mode determined by the current user includes: reading the number of times of pressing by a user, and determining a wearing mode according to the number of times, wherein for example, when the user presses a key once, the corresponding mode is a music mode; when a user presses a key twice, the corresponding mode is a movie mode; when a user presses a key for three times, the corresponding mode is a common mode; when the user presses the four keys, the corresponding mode returns to the music mode.

In step S1052, a distance range corresponding to the wearing mode determined by the current user is determined.

Wherein, the distance range is a sub-interval of the target distance range.

For the embodiment of the present application, the sub-interval of the target distance range is a certain interval within the whole target distance range. When the user does not select the wearing mode, only the distance is required to be within the target distance range, after the user selects the wearing mode, the user experience feeling and the hearing effect corresponding to different wearing modes are different, and meanwhile, the corresponding mode ranges are different but are all within the target distance range.

Specifically, in order to ensure that the user obtains a better auditory effect, the output hole is closer to the ear hole of the user, and the target distance range corresponding to the music mode is smaller than that corresponding to the common mode. For example, the target distance range is 13-15cm (centimeters), the mode range corresponding to the normal mode is 13.2-14.8cm, and the mode range corresponding to the music mode is 13-14 cm.

And step S1053, determining an adjusting instruction corresponding to the mode range according to the distance between the first position and the second position, and adjusting the temple based on the adjusting instruction.

The adjusting instruction is used for controlling the telescopic part of the glasses leg to stretch until the adjusted distance is within the distance range.

For the embodiment of the application, the matching relation between the wearing mode and the mode range corresponding to the wearing mode is stored in advance, after the wearing mode determined by the user is obtained, the mode range corresponding to the wearing mode selected by the user is determined from the matching relation, and the glasses legs are adjusted based on the mode range corresponding to the wearing mode selected by the user, so that the comfort degree of the user can be improved.

In a possible implementation manner of the embodiment of the present application, the obtaining of the wearing mode determined by the current user in step S1051 may specifically include: step S10511 (not shown), step S10512 (not shown), and step S10513 (not shown), wherein,

step S10511, displaying a plurality of wearing modes to be selected on the display interface of the intelligent glasses, determining the wearing mode corresponding to the preset direction pointed by the current user pupil, and determining the stay time of the current user pupil in the preset direction.

For the embodiment of the application, the preset directions of the pupils of the current user are different, the corresponding wearing modes are also different, and the preset directions of the pupils of the current user correspond to the directions of the areas where the gaze of the current user stays.

Specifically, the pupil of the current user is located, the acquired face video information can be roughly detected through the adaboost algorithm, the eye area is detected, the edge of the eye area is detected through the canny algorithm, the edge of the pupil is obtained, and the center of the pupil is obtained through the Hough transformation method for detecting the circle center.

Step S10512, it is determined whether the stay time is longer than the stay time threshold.

For the embodiment of the application, the eye movement is tracked, a beam of light (near infrared light) and a camera are aligned to the eyes of the current user based on a non-invasive technology of a VOG (Video eye graphics, eye Video analysis), so that the stay time of the user in the preset direction is obtained through analysis, and whether the stay time is greater than the stay time threshold is judged.

Step S10513, when the stay time is longer than the stay time threshold, determining the mode corresponding to the preset direction, and determining the wearing mode for the current user.

For the embodiment of the application, a preset time length may be preset, and if the time length that the current user pupil stays in the preset direction is longer than the preset time length, the mode selected by the current user is determined. For example, if the dwell time threshold is five minutes and the dwell time of the pupil of the current user on the screen of the movie theater exceeds five minutes, the mode of the current user is determined to be the movie mode.

The following embodiments describe a temple length adjusting apparatus from the viewpoint of apparatus structure, and are applicable to the above method embodiments, and are described in detail in the following embodiments:

the embodiment of the present application provides a temple length adjusting apparatus, as shown in fig. 2, the temple length adjusting apparatus 20 may specifically include:

a first obtaining module 201, configured to obtain a first position of a contact point between an ear portion and a glasses ear portion and obtain a second position of a contact point between a nose portion and a glasses frame portion corresponding to the ear portion;

a first determining module 202 for determining a distance between the first location and the second location;

the second obtaining module 203 is configured to read current user information and obtain a preset volume at an ear hole of the user;

a second determining module 204, configured to determine a target distance range from a relationship among pre-stored user information, volume, and a set distance range according to the current user information and a preset volume at an ear hole of the user;

and the sending module 205 is configured to send an adjustment instruction to the telescopic part of the temple, where the adjustment instruction is used to control the telescopic part of the temple to stretch until the adjusted distance is within the target distance range.

For the embodiment of the application, the first determining module determines the distance between the first position and the second position, then reads the current user information, the second obtaining module obtains the preset volume at the ear hole of the user, the second determining module can obtain the target distance range corresponding to the current user information and the set volume according to the corresponding relation among the user information, the volume and the distance range, when the actual distance between the first position and the second position is within the target distance range, the sound effect under the preset volume can be achieved, the auditory effect of the current user is ensured, the scheme sends the adjusting instruction for controlling the telescopic part of the glasses leg to stretch out and draw back to the telescopic part of the glasses leg, so that the adjusted distance can be within the target distance range, the step of manually adjusting the telescopic of a wearer is omitted, and the sound hole is accurately adjusted to the position with the better sound effect, ensuring the hearing effect of the wearer.

In another possible implementation manner of the embodiment of the application, when determining the target volume at the current ear hole of the user, the second obtaining module 203 is specifically configured to:

determining a correction coefficient based on the volume of the environment where the glasses are located and/or the size of the space where the glasses are located;

acquiring a set volume selected by a user;

and adjusting the set volume based on the correction coefficient to obtain the preset volume at the ear hole of the user.

In another possible implementation manner of the embodiment of the application, when acquiring the volume of the environmental sound where the glasses are located, the second acquiring module 203 is specifically configured to:

inputting the background sound into the pre-trained model, and outputting the volume of the environmental sound

In another possible implementation manner of the embodiment of the present application, when the first obtaining module 201 obtains the second position of the contact point between the nose portion and the nose portion of the glasses corresponding to the ear portions of the glasses hanger, the first obtaining module is specifically configured to:

and if the first contact point is within the set range of the midpoint of the two eye characteristic points, acquiring a second position of the contact point of the nose part and the nose part of the glasses corresponding to the eye hanging part.

In another possible implementation manner of the embodiment of the present application, the apparatus further includes: a third obtaining module, a judging module and an executing module, wherein,

In another possible implementation manner, when sending the adjustment instruction to the telescopic portion of the temple, the sending module 205 is specifically configured to:

acquiring a mode determined by a current user, wherein the mode comprises any one of a music mode, a movie mode and a common mode;

determining a distance range corresponding to the wearing mode determined by the current user, wherein the distance range is a subinterval of a target distance range;

and determining an adjusting instruction corresponding to the distance range, and sending the adjusting instruction to the telescopic part of the glasses leg, wherein the adjusting instruction is used for controlling the telescopic part of the glasses leg to stretch until the adjusted distance is in the distance range.

In another possible implementation manner, when obtaining the wearing mode determined by the current user, the sending module 205 is specifically configured to:

displaying a plurality of wearing modes to be selected on a display interface of the intelligent glasses, determining a wearing mode corresponding to a preset direction pointed by the current user pupil, and determining the stay time of the current user pupil in the preset direction;

In an embodiment of the present application, there is also provided an electronic device, as shown in fig. 3, where the electronic device 30 shown in fig. 3 includes: a processor 301 and a memory 303. Wherein processor 301 is coupled to memory 303, such as via bus 302. Optionally, the electronic device 30 may also include a transceiver 304. It should be noted that the transceiver 304 is not limited to one in practical applications, and the structure of the electronic device 30 is not limited to the embodiment of the present application.

The Processor 301 may be a CPU (Central Processing Unit), a general-purpose Processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array) or other Programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Which may implement or perform the various illustrative logical blocks, modules, and circuits described in connection with the disclosure. The processor 301 may also be a combination of computing functions, e.g., comprising one or more microprocessors, a combination of a DSP and a microprocessor, or the like.

Bus 302 may include a path that transfers information between the above components. The bus 302 may be a PCI (Peripheral Component Interconnect) bus, an EISA (Extended Industry Standard Architecture) bus, or the like. The bus 302 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown in FIG. 3, but this does not mean only one bus or one type of bus.

The Memory 303 may be a ROM (Read Only Memory) or other type of static storage device that can store static information and instructions, a RAM (Random Access Memory) or other type of dynamic storage device that can store information and instructions, an EEPROM (Electrically Erasable Programmable Read Only Memory), a CD-ROM (Compact Disc Read Only Memory) or other optical Disc storage, optical Disc storage (including Compact Disc, laser Disc, optical Disc, digital versatile Disc, blu-ray Disc, etc.), a magnetic Disc storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited to these.

The memory 303 is used for storing application program codes for executing the scheme of the application, and the processor 301 controls the execution. The processor 301 is configured to execute application program code stored in the memory 303 to implement the aspects illustrated in the foregoing method embodiments.

Among them, electronic devices include but are not limited to: a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a car terminal (e.g., car navigation terminal), etc., and a fixed terminal such as a digital TV, a desktop computer, etc., may also be a server, etc. The electronic device shown in fig. 3 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present application.

The embodiment of the application provides a computer-readable storage medium, on which a computer program is stored, which, when running on a computer, enables the computer to execute the corresponding content in the method embodiment executed by the aforementioned terminal device. In contrast to the related art, the distance between the first location and the second location is determined, and then current user information is acquired, and the preset volume at the ear hole of the user is determined, according to the corresponding relation among the user information, the volume and the distance range, thereby obtaining a target distance range corresponding to the set volume based on the current user information, when the actual distance between the first position and the second position is within the target distance range, can have better sound effect under the preset volume, ensures the auditory effect of the current user, sends an adjusting instruction for controlling the telescopic part of the glasses leg to stretch to the telescopic part of the glasses leg, thereby enabling the adjusted distance to be within the target distance range, thereby eliminating the step of manually adjusting the extension and contraction of the temples by the wearer, and then accurately adjust the sound outlet hole to the position with better sound effect, thereby ensuring the hearing effect of the wearer.

It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least a portion of the steps in the flow chart of the figure may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

The foregoing is only a partial embodiment of the present application, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present application, and these modifications and decorations should also be regarded as the protection scope of the present application.

Claims

1. A temple length adjustment method, comprising:

determining a distance between the first location and the second location;

2. The method for adjusting the lengths of the temples according to claim 1, wherein the obtaining the preset volume at the ear holes of the user comprises:

acquiring a set volume selected by a user;

3. The temple length adjustment method according to claim 2, wherein obtaining the volume of ambient sound at which the eyeglasses are located comprises:

4. The temple length adjustment method according to claim 1, wherein said acquiring a second position of a contact point of a nose portion and a nose portion of an eyeglass corresponding to the eyeglass hanging ear portion comprises:

5. The temple length adjustment method according to claim 4, wherein the acquiring a three-dimensional face image of a user further comprises:

6. The temple length adjustment method according to claim 1, wherein said sending an adjustment command to the extendable portion of the temple comprises:

and determining an adjusting instruction corresponding to the target distance range, and sending the adjusting instruction to the telescopic part of the glasses leg, wherein the adjusting instruction is used for controlling the telescopic part of the glasses leg to stretch until the adjusted distance is within the target distance range.

7. The temple length adjustment method of claim 6, wherein said obtaining a wearing mode determined by a current user comprises:

and when the stay time is longer than the stay time threshold, determining the wearing mode corresponding to the preset direction, and determining the wearing mode for the current user.

8. A temple-length adjusting device, comprising:

the second acquisition module is used for reading the current user information and reading the preset volume at the ear hole of the user;

and the sending module is used for sending an adjusting instruction to the telescopic part of the glasses leg, and the adjusting instruction is used for controlling the telescopic part of the glasses leg to stretch until the adjusted distance is within the target distance range.

9. An electronic device, comprising:

at least one processor;

a memory;

at least one application, wherein the at least one application is stored in the memory and configured to be executed by the at least one processor, the at least one application configured to: a temple length adjustment method according to any of claims 1-7 is performed.

10. A computer-readable storage medium on which a computer program is stored, the program, when executed by a processor, implementing a temple length adjustment method according to any one of claims 1 to 7.