CN110895369A - Intelligent glasses and control method thereof - Google Patents
Intelligent glasses and control method thereof Download PDFInfo
- Publication number
- CN110895369A CN110895369A CN201811070370.7A CN201811070370A CN110895369A CN 110895369 A CN110895369 A CN 110895369A CN 201811070370 A CN201811070370 A CN 201811070370A CN 110895369 A CN110895369 A CN 110895369A
- Authority
- CN
- China
- Prior art keywords
- image
- user
- camera module
- glasses
- display screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 239000011521 glass Substances 0.000 title claims abstract description 85
- 238000000034 method Methods 0.000 title claims abstract description 34
- 230000004438 eyesight Effects 0.000 claims abstract description 61
- 210000001508 eye Anatomy 0.000 claims abstract description 35
- 238000012545 processing Methods 0.000 claims description 37
- 238000012360 testing method Methods 0.000 claims description 33
- 230000000007 visual effect Effects 0.000 claims description 16
- 239000004984 smart glass Substances 0.000 claims description 14
- 239000013589 supplement Substances 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 5
- 230000008569 process Effects 0.000 claims description 4
- 230000000694 effects Effects 0.000 description 4
- 210000005252 bulbus oculi Anatomy 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000004379 myopia Effects 0.000 description 2
- 208000001491 myopia Diseases 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- HBBGRARXTFLTSG-UHFFFAOYSA-N Lithium ion Chemical compound [Li+] HBBGRARXTFLTSG-UHFFFAOYSA-N 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000008094 contradictory effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 229910001416 lithium ion Inorganic materials 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 229920000642 polymer Polymers 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
Abstract
The invention discloses intelligent glasses and a control method thereof, wherein the intelligent glasses comprise a glasses frame, a first camera module, a second camera module, a circuit board and a display screen; the spectacle frame comprises a spectacle frame and two spectacle legs which are respectively connected to two sides of the spectacle frame, wherein the outer side of the spectacle frame is the side far away from the eyes of a user, and the inner side of the spectacle frame is the side close to the eyes of the user; the first camera module is embedded in the inner side of the glasses frame; the second camera module is embedded at the outer side of the glasses frame; the display screen is fixedly arranged on the glasses frame, and one side of the display screen, which is used for displaying images, faces the eyes of the user; the circuit board is arranged in the glasses legs. The intelligent glasses can automatically and adaptively zoom the display image on the display screen according to the vision state of the current user so as to be suitable for the current user to watch, and no lens or focusing device is required to be added, so that the self weight of the intelligent glasses is reduced, and the intelligent glasses have wide applicability.
Description
Technical Field
The invention relates to the technical field of intelligent wearing, in particular to intelligent glasses and a control method thereof.
Background
In recent years, with the demand for immersive human-computer interaction is higher and higher, intelligent head-mounted display devices are rapidly developed. The user can be put in the world of virtual information and reality scene superposition through wearing intelligent head-mounted display equipment. However, since the vision states of users are different, many myopes cannot see the picture clearly because the eye degree is too high when using the intelligent head-mounted display device.
To address this problem, there are several existing solutions: most of intelligent head-mounted display equipment reserve a certain space for people wearing glasses, so that people can wear the glasses before wearing the intelligent head-mounted display equipment, but the two glasses are heavy when wearing the intelligent head-mounted display equipment, and a user can feel fatigue quickly; in another method, a frame is fixed in the intelligent head-mounted display device, and a user can configure lenses with proper degrees by himself, but the method is inconvenient to use, increases the user cost, increases the self weight of the device, and is not high in user experience; there is also a method of adjusting the focal length of the lens in advance in accordance with user input power information by adding a focusing device such as a zoom lens, but this method also increases the weight of the apparatus itself and is cumbersome to operate.
Disclosure of Invention
The invention mainly aims to provide intelligent glasses and a control method thereof, the intelligent glasses have light dead weight and are convenient and fast to use, and the problem that the display effect of the intelligent glasses cannot be automatically adjusted according to the vision state of a user in the prior art is solved.
The invention provides intelligent glasses, which comprise a glasses frame, a first camera module, a second camera module, a circuit board and a display screen, wherein the glasses frame is provided with a first lens and a second lens;
the glasses frame comprises a glasses frame and two glasses legs respectively connected to two sides of the glasses frame, the outer side of the glasses frame is the side far away from the eyes of a user, and the inner side of the glasses frame is the side close to the eyes of the user;
the first camera module is embedded in the inner side of the glasses frame and used for shooting images appointed by a user;
the second camera module is embedded at the outer side of the glasses frame and used for shooting an environment image;
the display screen is fixedly arranged on the glasses frame, and one side of the display screen, which is used for displaying images, is arranged facing the eyes of the user;
the circuit board is arranged in the glasses legs and used for processing the user-specified image and the environment image according to different preset algorithms respectively.
Further, the first camera module is arranged at the upper edge of the inner side of the glasses frame, and the distance from the first camera module to one of the glasses legs is one fourth of the width of the glasses frame.
Further, the second camera module comprises a first sub-camera module and a second sub-camera module, and the first sub-camera module and the second sub-camera module are arranged on the upper edge of the middle part of the outer side of the glasses frame side by side.
Further, the circuit board is used for processing the image designated by the user according to a first preset algorithm to obtain first data information; processing the environment image according to a second preset algorithm to obtain a first image; and processing the first image according to the first data information to obtain a second image, and displaying the second image on the display screen.
Further, set up at least one light filling lamp in the middle of first sub camera module with the sub camera module of second, the light filling lamp inlays to be located the outside of spectacle-frame.
The invention also provides a control method of the intelligent glasses based on any one of the above, which comprises the following steps:
acquiring a user designated image through a first camera module, processing the user designated image according to a first preset algorithm, and acquiring the current user vision state;
acquiring an environment image through a second camera module, and processing the environment image according to a second preset algorithm to acquire a first image;
and zooming the first image according to the current user vision state and a preset rule to obtain a second image, and displaying the second image on the display screen.
Further, the step of obtaining a user-specified image through the first camera module, processing the user-specified image according to a first preset algorithm, and obtaining the current user vision state includes:
displaying a test image through a display screen, wherein the test image comprises a plurality of vision test icons with different sizes;
opening the first camera module;
the step of obtaining the user designated image through the first camera module, processing the user designated image according to a first preset algorithm, and obtaining the current user vision state comprises the following steps:
acquiring a user-specified image through the first camera module, wherein the user-specified image is a user image when a user watches the minimum visual test icon which can be clearly seen;
according to the image appointed by the user, acquiring a position on the display screen corresponding to the sight of the user, determining a minimum visual test icon which can be seen clearly, and obtaining the current visual state of the user corresponding to the minimum visual test icon which can be seen clearly;
and stopping displaying the test image and closing the first camera module.
Further, the step of obtaining an environment image through a second camera module, processing the environment image according to a second preset algorithm, and obtaining a first image includes:
acquiring a first environment image through a first sub-camera module included by the second camera module, and acquiring a second environment image through a second sub-camera module included by the second camera module;
and merging the first environment image and the second environment image according to a second preset algorithm to obtain a first image.
Further, the step of zooming the first image according to the current user vision state and a preset rule to obtain a second image and displaying the second image on the display screen includes:
acquiring a current image zooming multiple corresponding to the current user vision state according to a preset corresponding relation between the user vision state and the image zooming multiple;
zooming the first image according to the current image zooming multiple to obtain a second image;
and presenting the second image on the display screen, wherein the center position of the second image is positioned in the center of the display screen.
The invention also proposes a computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of the preceding claims.
The invention has the beneficial effects that:
according to the intelligent glasses and the control method thereof, the first camera module is embedded in the inner side of the glasses frame and used for acquiring the user-specified image including the eye image of the user and acquiring the current vision state of the user according to the preset algorithm; a second camera module is embedded at the outer side of the glasses frame and used for shooting an environment image; zooming the environment image or the processed environment image according to the current vision state of the user; the display screen is used for displaying the zoomed image so as to match the vision state of the current user. The intelligent glasses can automatically and adaptively zoom the display image on the display screen according to the vision state of the current user so as to be suitable for the current user to watch, and no lens or focusing device is required to be added, so that the self weight of the intelligent glasses is reduced, and the intelligent glasses have wide applicability.
Drawings
Fig. 1 is a schematic structural diagram of smart glasses according to an embodiment of the present invention;
FIG. 2 is a schematic view of the inside of the frame of the smart eyewear according to one embodiment of the present invention;
fig. 3 is a flowchart illustrating a control method of the smart glasses according to an embodiment of the present invention;
FIG. 4 is a schematic flow chart of step S1 in FIG. 3;
FIG. 5 is a schematic flow chart of step S2 in FIG. 3;
fig. 6 is a flowchart of step S3 in fig. 3.
Description of reference numerals:
1: a first camera module; 2: a second camera module; 201: a first sub-camera module; 202: a second sub-camera module; 3: a display screen; 4: a spectacle frame; 5: a temple; 6: and a light supplement lamp.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In addition, the descriptions related to "first", "second", etc. in the present invention are only for descriptive purposes and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In addition, technical solutions between various embodiments may be combined with each other, but must be realized by a person skilled in the art, and when the technical solutions are contradictory or cannot be realized, such a combination should not be considered to exist, and is not within the protection scope of the present invention.
Referring to fig. 1 and 2, an embodiment of the present invention provides a pair of smart glasses, including a glasses frame, a first camera module 1, a second camera module 2, a circuit board, and a display screen 3,
the spectacle frame comprises a spectacle frame 4 and two spectacle legs 5 which are respectively connected to two sides of the spectacle frame 4, wherein the outer side of the spectacle frame 4 is the side far away from the eyes of a user, and the inner side of the spectacle frame 4 is the side close to the eyes of the user;
the first camera module 1 is embedded in the inner side of the glasses frame 4 and used for shooting images appointed by a user;
the second camera module 2 is embedded at the outer side of the glasses frame 4 and is used for shooting an environment image;
the display screen 3 is fixedly arranged on the glasses frame 4, and one side of the display screen 3, which is used for displaying images, faces to the eyes of a user;
the circuit board is arranged in the glasses leg 5 and used for processing the user-specified image and the environment image according to different preset algorithms respectively.
In the embodiment, a first camera module 1 is embedded in the inner side of the glasses frame 4 and used for acquiring a user-specified image including an eye image of a user and acquiring the current vision state of the user according to a preset algorithm; specifically speaking, show predetermined test image on display screen 3, test image includes a plurality of not equidimension eyesight test icons, for example a plurality of not equidimension E characters, a plurality of not equidimension arbitrary pictures, and the user is watched the minimum eyesight test icon that can see clearly, shoots user's appointed image this moment through first camera module 1.
A second camera module 2 is embedded outside the spectacle frame 4 and used for shooting an environmental image;
the circuit board is arranged in the glasses leg 5 and used for processing the image designated by the user and the environment image according to different preset algorithms respectively. And acquiring the vision state of the current user by analyzing the image specified by the user, and zooming the environment image according to the vision state of the current user.
The display screen 3 is used to display the scaled image to match the current user's visual state.
The intelligent glasses of this embodiment can also further set up structures such as battery and USB interface. The battery can select a lithium ion polymer battery, has high capacity, small volume and good safety performance, and is used for providing a power supply for the intelligent glasses. The USB interface may be used to charge a battery. In addition, the USB interface can also be used for external terminal equipment and used for mutual information transmission between the intelligent glasses and the terminal equipment.
In addition, the intelligent glasses of this embodiment can also expand other functional module as required, for example bluetooth, WIFI, communication module etc. all can be built-in the mirror leg. The prior art of these functional modules is mature, and it is only necessary to directly perform adaptive adjustment and assemble the functional modules in the smart glasses of the present invention, which is not described in detail herein.
Further, the first camera module 1 is disposed at an upper edge of the inner side of the glasses frame 4, and a distance from the first camera module 1 to one of the glasses legs 5 is a quarter of a width of the glasses frame 4.
In this embodiment, the first camera module 1 is installed at the inner upper edge of the glasses frame 4 for capturing a user-specified image including an image of the eyes of the user. Because the first camera module 1 is closer to the longitudinal distance of the face of the user, the view angle of the camera is limited, and the range of the image shot by the first camera module 1 is smaller. Therefore, the first camera module 1 is installed at the quarter width position and is as close to the eyes of the user as possible in the transverse direction, and the image acquisition of the eyes of the user is facilitated. In the embodiment of the application, the symmetry of two eyes is considered, and the eye image of a single eye is acquired. The first camera module 1 uses an optical lens assembly composed of a plurality of lenses. Because the face of the user is close to the first camera module 1, and the image specified by the user and shot by the first camera module 1 is used for analyzing the relative position information of the eyeball in the glasses, the requirement on the pixels of the first camera module 1 is not high, and 500 ten thousand pixels in the embodiment can meet the requirement. In addition, the parameter requirement for the optical lens group of the first camera module 1 is the focusing distance, the focusing distance of the present embodiment is approximately equal to the linear distance between the first camera module 1 and the face after the user wears the intelligent glasses of the present embodiment, and the optical lens group of the first camera module 1 with a proper focal length can be selected to realize the focusing distance.
Further, the second camera module 2 includes a first sub-camera module 201 and a second sub-camera module 202, and the first sub-camera module 201 and the second sub-camera module 202 are arranged side by side at the upper edge of the middle part of the outer side of the glasses frame 4.
In this embodiment, adopt two camera modules, the left eye and the right eye of simulation people's eye gather the image in different visual fields, carry out the image merging to the image that first sub-camera module 201 acquireed and the image that second sub-camera module 202 acquireed again, obtain the picture that has the 3D degree of depth effect, improve the user and watch experience. In this embodiment, the first sub-camera module 201 adopts a telephoto lens, the second sub-camera module 202 adopts a wide-angle lens, and both the telephoto lens and the wide-angle lens adopt lens groups having a plurality of aspheric lenses, which can reduce imaging distortion and aberration and improve imaging quality. The telephoto lens and the wide-angle lens of the embodiment use the same pixels, the focal length of the telephoto lens is twice that of the wide-angle lens, the field angle of the wide-angle lens is greater than 100 degrees, and through the combination of the telephoto lens and the wide-angle lens, a picture with a 3D depth effect can be synthesized through a merged image algorithm. The pixels of the telephoto lens and the wide-angle lens in the embodiment are higher than 1200 ten thousand pixels, and the high-pixel lens enables the collected picture details to be richer. Further, in this embodiment, a stepping motor may be further installed on the telephoto lens and the wide-angle lens, and the stepping motor adjusts the position of the lens through simple mechanical movement, so as to adjust the focal length of the lens.
The environment image collected by the second camera module 2 is displayed on the display screen 3 after a series of processing, and the user can see the surrounding environment by watching the image on the display screen 3. Virtual information can be further superposed on the pictures in the real environment to realize superposition of the virtual information and the real scene; for some users with inconvenient actions, the surrounding environment can be displayed for the users through the environment image acquired by the second camera module 2, so that the living convenience of the users is improved.
Further, the circuit board is used for processing the image designated by the user according to a first preset algorithm to obtain first data information; processing the environment image according to a second preset algorithm to obtain a first image; and processing the first image according to the first data information to obtain a second image, and displaying the second image on the display screen 3.
In this embodiment, the image designated by the user is processed according to a first preset algorithm, specifically, the image designated by the user is subjected to image analysis to obtain the relative position of the eyeball in the eye, and the eye tracking analysis is performed to obtain the position on the display screen 3 corresponding to the user's eye, determine the smallest vision test icon that the user can see, and obtain the current user vision state corresponding to the smallest vision test icon that the user can see.
And processing the environment image according to a second preset algorithm, specifically, processing the environment image acquired by the second camera module 2 according to a specified requirement, such as brightness adjustment, image clipping, image merging, frame rate change, and the like.
And processing the first image according to the first data information, specifically, acquiring an image scaling factor corresponding to the current user vision state according to a preset corresponding relation between the user vision state and the image scaling factor, and scaling the processed environment image according to the scaling factor. The preset corresponding relation between the vision state of the user and the image scaling factor can be obtained in advance through multi-user sample collection.
Further, at least one light supplement lamp 6 is arranged between the first sub-camera module 201 and the second sub-camera module 202, and the light supplement lamp 6 is embedded in the outer side of the glasses frame 4.
In this embodiment, the light filling lamp 6 is arranged in the middle of the first sub-camera module 201 and the second sub-camera module 202, and is used for filling light for the environment when the ambient brightness is lower, so that the shooting scene brightness of the first sub-camera module 201 and the second sub-camera module 202 is improved, and the user watching experience is improved.
The intelligent glasses in the embodiment of the invention can automatically and adaptively zoom the display image on the display screen 3 according to the vision state of the current user so as to be suitable for the current user to watch, and no lens or focusing device is required to be added, so that the self weight of the intelligent glasses is reduced, and the intelligent glasses have wide applicability.
Referring to fig. 3, an embodiment of the present invention further provides a control method for smart glasses based on any one of the foregoing methods, including:
s1, acquiring a user designated image through the first camera module 1, processing the user designated image according to a first preset algorithm, and acquiring the current user vision state;
s2, acquiring an environment image through the second camera module 2, and processing the environment image according to a second preset algorithm to acquire a first image;
s3, zooming the first image according to the current user vision state and a preset rule to obtain a second image, and displaying the second image on the display screen 3.
In this embodiment, when the user uses the smart glasses, the user-specific image is first acquired through the first camera module 1, and the user-specific image is analyzed according to a first preset algorithm to acquire the current user vision state. The second camera module 2 is used for shooting an environment image and processing the environment image according to a second preset algorithm. Zooming the processed environment image according to the current user vision state; the scaled image is displayed via the display screen 3 to match the current user's visual state. The control method of the intelligent glasses can automatically perform adaptive zooming on the display image on the display screen 3 according to the vision state of the current user so as to be suitable for the current user to watch, lenses or a focusing device is not required to be added, the self weight of the intelligent glasses is reduced, and the control method has wide applicability.
Further, referring to fig. 4, before the step S1 of acquiring the user-specified image through the first camera module 1, and processing the user-specified image according to the first preset algorithm to acquire the current user vision status, the method includes:
s101, displaying a test image through a display screen 3, wherein the test image comprises a plurality of vision test icons with different sizes;
and S102, starting the first camera module 1.
The step S1 of acquiring the user-specific image through the first camera module, processing the user-specific image according to a first preset algorithm, and acquiring the current user' S eyesight state includes:
s103, acquiring a user-specified image through the first camera module 1, wherein the user-specified image is a user image when a user watches the minimum visual test icon which can be clearly seen;
s104, acquiring a position on the display screen 3 corresponding to the sight of the user according to the image appointed by the user, determining a minimum visual test icon which can be seen clearly, and obtaining the current visual state of the user corresponding to the minimum visual test icon which can be seen clearly;
and S105, stopping displaying the test image, and closing the first camera module 1.
In this embodiment, in step S101, a preset test image is displayed on the display screen 3, where the test image includes a plurality of vision test icons with different sizes, such as a plurality of E words with different sizes and a plurality of arbitrary pictures with different sizes.
In step S103, whether the user is in the gazing state is determined according to the time that the user stays in the sight, for example, if the time that the user stays in the sight exceeds 2S or other preset time, it is determined that the user is in the gazing state, the first camera module 1 shoots the current user-specified image, and the obtained user-specified image includes a human eye image because the position of the first camera module 1 is set in front of the human eye.
In step S104, the eye image in the image specified by the user is analyzed to obtain the relative position of the eyeball in the eye, the position on the display screen 3 corresponding to the current user 'S sight line is analyzed by the sight line tracking technology, the smallest sight test icon that the user can see clearly is determined, and the current user' S sight state corresponding to the icon can be obtained. The sight tracking technology may be implemented by the prior art, and is not described herein.
The method for acquiring the vision state of the current user is applicable to users with different vision states, is simple and convenient to operate, does not need to increase a hardware device, saves cost and reduces self weight of intelligent glasses.
Further, referring to fig. 5, the step S2 of acquiring the environment image through the second camera module 2, processing the environment image according to a second preset algorithm, and acquiring the first image includes:
s201, acquiring a first environment image through a first sub-camera module 201 included in the second camera module 2, and acquiring a second environment image through a second sub-camera module 202 included in the second camera module 2;
s202, merging the first environment image and the second environment image according to a second preset algorithm to obtain a first image.
In this embodiment, in step S201, the first sub-camera module 201 and the second sub-camera module 202 respectively obtain pictures to simulate the left eye and the right eye of the human eye.
In step S202, the first environment image and the second environment image are subjected to image merging according to a preset algorithm, so as to obtain a first image with a 3D depth effect. The preset algorithm for image merging in this embodiment may adopt a double-shot image merging algorithm in the prior art, which is not described herein again.
Further, referring to fig. 6, the step S3 of zooming the first image according to the preset rule according to the current user vision status to obtain a second image and presenting the second image on the display screen 3 includes:
s301, acquiring a current image zooming multiple corresponding to the current user vision state according to a preset corresponding relation between the user vision state and the image zooming multiple;
s302, zooming the first image according to the current image zooming multiple to obtain a second image;
and S303, displaying the second image on the display screen 3, wherein the center of the second image is located at the center of the display screen 3.
In this embodiment, in step S301, a corresponding relationship between the vision state of the user and the image zoom factor is preset in the first processing module, and the preset corresponding relationship may be obtained in advance through multi-user sample collection. Each vision test icon on the display screen 3 represents different vision states, and if the vision test icon viewed by the sight of the current user represents the myopia 800 degrees, the corresponding relationship between the vision state of the preset user and the image zoom factor is searched, and the current image zoom factor corresponding to the myopia 800 degrees is searched.
In step S302, the first image obtained in step S2 is scaled according to the current image scaling factor in step S301, so as to obtain a second image.
In step S303, the second image obtained in step S302 is displayed on the display screen 3, and the center of the second image is located at the center of the display screen 3.
The zoomed second image obtained by the embodiment is matched with the vision state of the current user.
In other embodiments of the present invention, when the smart glasses include the fill-in light 6, the acquiring an environment image through the second camera module, processing the environment image according to a second preset algorithm, and before the step S2 of acquiring the first image, the method further includes:
and detecting the brightness of the current shooting scene of the second camera module 2, and if the brightness is lower than a preset value, starting the light supplement lamp 6.
In this embodiment, when still including light filling lamp 6 in the structure of intelligent glasses, when second camera module 2 was shot, if ambient brightness crosses lowly, the luminance that leads to the shooting scene is low, and light filling lamp 6 can be opened and is used for improving ambient brightness to improve second camera module 2's imaging quality.
According to the control method of the intelligent glasses, the user-specified image containing the eye image of the user is obtained through the first camera module 1, and the current vision state of the user is obtained according to a first preset algorithm; shooting an environment image through the second camera module 2, and processing according to a second preset algorithm to obtain a first image; zooming the first image according to the current user vision state; the display screen 3 is used to display the scaled image to match the current user's visual state. The control method of the intelligent glasses can automatically obtain the vision state of the current user, adaptively zoom the display image on the display screen 3 according to the vision state of the current user so as to be suitable for the current user to watch, no lens or focusing device needs to be added, the self weight of the intelligent glasses is reduced, and the wide applicability is realized.
The invention also provides a computer-readable storage medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements a method for controlling smart glasses, specifically:
acquiring a user designated image through a first camera module, processing the user designated image according to a first preset algorithm, and acquiring the current user vision state;
acquiring an environment image through a second camera module, and processing the environment image according to a second preset algorithm to acquire a first image;
and zooming the first image according to the current user vision state and a preset rule to obtain a second image, and displaying the second image on the display screen.
It will be understood by those skilled in the art that all or part of the processes of the methods of the above embodiments may be implemented by hardware associated with instructions of a computer program, which may be stored on a non-volatile computer-readable storage medium, and when executed, may include processes of the above embodiments of the methods. Any reference to memory, storage, databases, or other media provided herein or used in embodiments of the present invention may include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double-rate SDRAM (SSRSDRAM), Enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. An intelligent glasses is characterized by comprising a glasses frame, a first camera module, a second camera module, a circuit board and a display screen;
the glasses frame comprises a glasses frame and two glasses legs respectively connected to two sides of the glasses frame, the outer side of the glasses frame is the side far away from the eyes of a user, and the inner side of the glasses frame is the side close to the eyes of the user;
the first camera module is embedded in the inner side of the glasses frame and used for shooting images appointed by a user;
the second camera module is embedded at the outer side of the glasses frame and used for shooting an environment image;
the display screen is fixedly arranged on the glasses frame, and one side of the display screen, which is used for displaying images, is arranged facing the eyes of the user;
the circuit board is arranged in the glasses legs and used for processing the user-specified image and the environment image according to different preset algorithms respectively.
2. The smart eyewear of claim 1, wherein the first camera module is disposed at an upper edge of an interior side of the eyewear frame, and the first camera module is a distance of one quarter of a width of the eyewear frame from one of the temples.
3. The smart eyewear of claim 1, wherein the second camera module comprises a first sub-camera module and a second sub-camera module, the first sub-camera module and the second sub-camera module being disposed side-by-side at an upper edge of an outer middle portion of the eyewear frame.
4. The smart glasses according to claim 1, wherein the circuit board is configured to process the user-specified image according to a first preset algorithm to obtain first data information; processing the environment image according to a second preset algorithm to obtain a first image; and processing the first image according to the first data information to obtain a second image, and displaying the second image on the display screen.
5. The pair of smart glasses according to claim 3, wherein at least one light supplement lamp is disposed between the first sub-camera module and the second sub-camera module, and the light supplement lamp is embedded outside the glasses frame.
6. The control method of the smart glasses according to any one of claims 1 to 5, comprising:
acquiring a user designated image through a first camera module, processing the user designated image according to a first preset algorithm, and acquiring the current user vision state;
acquiring an environment image through a second camera module, and processing the environment image according to a second preset algorithm to acquire a first image;
and zooming the first image according to the current user vision state and a preset rule to obtain a second image, and displaying the second image on the display screen.
7. The method for controlling smart glasses according to claim 6, wherein the step of obtaining the user-specified image through the first camera module, processing the user-specified image according to a first preset algorithm, and obtaining the current vision status of the user comprises:
displaying a test image through a display screen, wherein the test image comprises a plurality of vision test icons with different sizes;
opening the first camera module;
the step of obtaining the user designated image through the first camera module, processing the user designated image according to a first preset algorithm, and obtaining the current user vision state comprises the following steps:
acquiring a user-specified image through the first camera module, wherein the user-specified image is a user image when a user watches the minimum visual test icon which can be clearly seen;
according to the image appointed by the user, acquiring a position on the display screen corresponding to the sight of the user, determining a minimum visual test icon which can be seen clearly, and obtaining the current visual state of the user corresponding to the minimum visual test icon which can be seen clearly;
and stopping displaying the test image and closing the first camera module.
8. The method for controlling smart glasses according to claim 6, wherein the step of obtaining the first image by obtaining the environment image through the second camera module and processing the environment image according to a second preset algorithm comprises:
acquiring a first environment image through a first sub-camera module included by the second camera module, and acquiring a second environment image through a second sub-camera module included by the second camera module;
and merging the first environment image and the second environment image according to a second preset algorithm to obtain a first image.
9. The method for controlling smart glasses according to claim 6, wherein the step of zooming the first image according to the current user's eyesight state and a preset rule to obtain a second image and displaying the second image on the display screen comprises:
acquiring a current image zooming multiple corresponding to the current user vision state according to a preset corresponding relation between the user vision state and the image zooming multiple;
zooming the first image according to the current image zooming multiple to obtain a second image;
and presenting the second image on the display screen, wherein the center position of the second image is positioned in the center of the display screen.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 6 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811070370.7A CN110895369A (en) | 2018-09-13 | 2018-09-13 | Intelligent glasses and control method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811070370.7A CN110895369A (en) | 2018-09-13 | 2018-09-13 | Intelligent glasses and control method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110895369A true CN110895369A (en) | 2020-03-20 |
Family
ID=69785578
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811070370.7A Withdrawn CN110895369A (en) | 2018-09-13 | 2018-09-13 | Intelligent glasses and control method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110895369A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111416947A (en) * | 2020-03-25 | 2020-07-14 | 深圳奇迹智慧网络有限公司 | Augmented reality device imaging method and device, computer device and storage medium |
| CN113985608A (en) * | 2021-10-29 | 2022-01-28 | 金陵科技学院 | Active adjusting method for imaging position of AR glasses |
| CN115590462A (en) * | 2022-12-01 | 2023-01-13 | 广州视景医疗软件有限公司（Cn） | Vision detection method and device based on camera |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110197151A1 (en) * | 2010-02-05 | 2011-08-11 | Microsoft Corporation | Graphics remoting using augmentation data |
| CN105955477A (en) * | 2016-04-29 | 2016-09-21 | 乐视控股（北京）有限公司 | Method and apparatus for adjusting display image of VR device and corresponding VR device |
| CN106309089A (en) * | 2016-08-29 | 2017-01-11 | 深圳市爱思拓信息存储技术有限公司 | VR (Virtual Reality) eyesight correction method and device |
| CN106843474A (en) * | 2017-01-03 | 2017-06-13 | 惠州Tcl移动通信有限公司 | A kind of mobile terminal display processing method and system |
| CN206833075U (en) * | 2017-04-01 | 2018-01-02 | 北京暴风魔镜科技有限公司 | Head-mounted display apparatus and electronic equipment |
| CN108478184A (en) * | 2018-04-26 | 2018-09-04 | 京东方科技集团股份有限公司 | Eyesight measurement method and device, VR equipment based on VR |
-
2018
- 2018-09-13 CN CN201811070370.7A patent/CN110895369A/en not_active Withdrawn
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110197151A1 (en) * | 2010-02-05 | 2011-08-11 | Microsoft Corporation | Graphics remoting using augmentation data |
| CN105955477A (en) * | 2016-04-29 | 2016-09-21 | 乐视控股（北京）有限公司 | Method and apparatus for adjusting display image of VR device and corresponding VR device |
| CN106309089A (en) * | 2016-08-29 | 2017-01-11 | 深圳市爱思拓信息存储技术有限公司 | VR (Virtual Reality) eyesight correction method and device |
| CN106843474A (en) * | 2017-01-03 | 2017-06-13 | 惠州Tcl移动通信有限公司 | A kind of mobile terminal display processing method and system |
| CN206833075U (en) * | 2017-04-01 | 2018-01-02 | 北京暴风魔镜科技有限公司 | Head-mounted display apparatus and electronic equipment |
| CN108478184A (en) * | 2018-04-26 | 2018-09-04 | 京东方科技集团股份有限公司 | Eyesight measurement method and device, VR equipment based on VR |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111416947A (en) * | 2020-03-25 | 2020-07-14 | 深圳奇迹智慧网络有限公司 | Augmented reality device imaging method and device, computer device and storage medium |
| CN111416947B (en) * | 2020-03-25 | 2022-05-17 | 深圳奇迹智慧网络有限公司 | Augmented reality device imaging method and device, computer device and storage medium |
| CN113985608A (en) * | 2021-10-29 | 2022-01-28 | 金陵科技学院 | Active adjusting method for imaging position of AR glasses |
| CN115590462A (en) * | 2022-12-01 | 2023-01-13 | 广州视景医疗软件有限公司（Cn） | Vision detection method and device based on camera |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11694353B2 (en) | Single depth tracked accommodation-vergence solutions | |
| US20210325684A1 (en) | Eyewear devices with focus tunable lenses | |
| US10319154B1 (en) | Methods, systems, and computer readable media for dynamic vision correction for in-focus viewing of real and virtual objects | |
| US11606548B2 (en) | Head mounted display device and method for providing visual aid using same | |
| Chakravarthula et al. | Focusar: Auto-focus augmented reality eyeglasses for both real world and virtual imagery | |
| US9916690B2 (en) | Correction of displayed images for users with vision abnormalities | |
| CN204331144U (en) | Zoom helmet | |
| US9618748B2 (en) | Apparatus and method for a dynamic “region of interest” in a display system | |
| CN106773064B (en) | Display control method and device of image picture and head-mounted display equipment | |
| US10712563B2 (en) | Methods for near-to-eye displays exploiting optical focus and depth information extraction | |
| CN106484116B (en) | The treating method and apparatus of media file | |
| CN104598180B (en) | Display control method, device and near-eye display device | |
| US11150476B2 (en) | Method for providing a display unit for an electronic information device | |
| CN105068249A (en) | Holographic intelligent glasses | |
| CN110895369A (en) | Intelligent glasses and control method thereof | |
| CN104407437A (en) | Zoom head-worn equipment | |
| JPWO2013175923A1 (en) | Simulation device | |
| US10372207B2 (en) | Adaptive VR/AR viewing based on a users eye condition profile | |
| CN105319719A (en) | Eye wire distance adjusting method and head-mounted virtual reality display device | |
| CN109283997A (en) | Display methods, device and system | |
| CN104167196A (en) | Backlight brightness adjusting method and device and electronic device | |
| CN106020480A (en) | Virtual reality device and image processing method of virtual reality images | |
| CN105227828B (en) | Filming apparatus and method | |
| CN109597210A (en) | Display device | |
| CN110840721B (en) | Near-eye display-based eyesight prevention, control and training method and near-eye display equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20200320 |
|
| WW01 | Invention patent application withdrawn after publication |