CN113985611B - Zoom display method and system for head-mounted display - Google Patents
Zoom display method and system for head-mounted display Download PDFInfo
- Publication number
- CN113985611B CN113985611B CN202111287441.0A CN202111287441A CN113985611B CN 113985611 B CN113985611 B CN 113985611B CN 202111287441 A CN202111287441 A CN 202111287441A CN 113985611 B CN113985611 B CN 113985611B
- Authority
- CN
- China
- Prior art keywords
- head
- mounted display
- user terminal
- stepping motor
- picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
Abstract
The invention provides a zoom display method of a head-mounted display, which comprises the following steps: step S1, a user terminal is connected with Bluetooth of a head-mounted display, and a stepping motor is arranged in the head-mounted display; step S2, after connection, the user terminal adjusts the angle of the concave mirror of the head-mounted display through Bluetooth according to preset time, so that focal length change is realized; s3, the user terminal converts original picture pixels according to a picture distortion coefficient matrix of the head-mounted display according to a rotation step of a preset stepping motor, adjusts the size of a picture, and maintains the proportion of the picture, so that the focal length of the head-mounted display is adjusted; the invention can relieve eye fatigue and automatically adjust the focal length.
Description
Technical Field
The invention relates to the technical field of head-mounted displays, in particular to a zoom display method and a zoom display system for the head-mounted display.
Background
A head mounted display (Head Mounted Display, HMD), also known as a head mounted display (Helmet Mounted Display, HMD), is a near-to-eye display device that includes at least one miniature image source and corresponding optical systems. The special man-machine interaction characteristic of the HMD enables the HMD to be widely applied to a plurality of fields of scientific research, education, medical treatment, social interaction, industry, military and the like by combining Virtual Reality (VR) technology and augmented Reality (Augmented Reality, AR) technology.
In the prior art, the head-mounted display is worn for a long time, the focal length of the content is fixed, and glasses fatigue is easy to generate, so that myopia is caused; manual adjustment of the focal length affects the size of the display.
Disclosure of Invention
In order to overcome the problems, an object of the present invention is to provide a zoom display method of a head-mounted display capable of alleviating eye fatigue and automatically adjusting a focal length.
The invention is realized by adopting the following scheme: a method of zoom display for a head mounted display, the method comprising the steps of:
step S1, a user terminal is connected with Bluetooth of a head-mounted display, and a stepping motor is arranged in the head-mounted display;
step S2, after connection, the user terminal adjusts the angle of the concave mirror of the head-mounted display through Bluetooth according to preset time, so that focal length change is realized;
and step S3, the user terminal converts the original picture pixels according to a picture distortion coefficient matrix of the head-mounted display according to a rotation step of a preset stepping motor, adjusts the size of a picture and keeps the proportion of the picture, thereby realizing the focal length adjustment of the head-mounted display.
Further, the step S2 is further specifically: the user terminal sends a Bluetooth instruction through the timer, and the stepping motor receives the Bluetooth instruction; the stepping motor rotates according to the step number set by the user terminal.
Further, the step S3 further specifically includes the following steps: step S31, presetting a generated picture distortion coefficient matrix by a user terminal, and receiving pixel points reflected by the user terminal by placing a simulated human eye position by a camera of the user terminal; step S32, exhausting the rotation angles of the stepping motor, and recording matrixes A and B corresponding to the angles; step S33, when the head-mounted display plays, the user terminal obtains the current rotation angle of the stepping motor to obtain a transformation matrix A, B.
Further, the step S31 is further specifically: when a person wearing the head-mounted display wears the block glasses, the four-side pixel points of the glasses frame can be recorded.
Further, when the front camera of the user terminal is an infrared night vision camera, the infrared night vision camera acquires the current eyeball image in real time; extracting the iris and pupil areas from the acquired images, judging whether the acquired images are too dark, if yes, actively transmitting infrared light for auxiliary acquisition, and if no, not transmitting infrared light for auxiliary acquisition; the iris region is transformed into a standard circular shape with a diameter of 12mm by stretching, scaling and the like.
The invention also provides a zoom display system of the head-mounted display, which comprises a connecting module, an adjusting module and a transforming module, wherein the connecting module, namely a user terminal, is connected with Bluetooth of the head-mounted display, and a stepping motor is arranged in the head-mounted display; the adjusting module is used for adjusting the angle of the concave mirror of the head-mounted display through Bluetooth according to preset time after connection, so that focal length change is realized; the conversion module, namely the user terminal, converts the original picture pixels according to a picture distortion coefficient matrix of the head-mounted display according to a rotation step of a preset stepping motor, adjusts the size of the picture and keeps the proportion of the picture, thereby realizing the focal length adjustment of the head-mounted display.
Further, the adjusting module is further specifically: the user terminal sends a Bluetooth instruction through the timer, and the stepping motor receives the Bluetooth instruction; the stepping motor rotates according to the step number set by the user terminal.
Further, the transformation module further specifically includes: the system comprises a presetting unit, a recording unit and an acquisition unit, wherein the presetting unit is used for presetting a generated picture distortion coefficient matrix for a user terminal, and receiving pixel points reflected by the user terminal by simulating the position of a human eye through a camera of the user terminal; the recording unit is used for recording the corresponding matrixes A and B of each angle, namely the rotation angle of the exhaustive stepper motor; the obtaining unit obtains the current rotation angle of the stepping motor by the user terminal when the head-mounted display plays, and obtains a transformation matrix A, B.
Further, the preset unit is further specifically: when a person wearing the head-mounted display wears the block glasses, the four-side pixel points of the glasses frame can be recorded.
Further, when the front camera of the user terminal is an infrared night vision camera, the infrared night vision camera acquires the current eyeball image in real time; extracting the iris and pupil areas from the acquired images, judging whether the acquired images are too dark, if yes, actively transmitting infrared light for auxiliary acquisition, and if no, not transmitting infrared light for auxiliary acquisition; the iris region is transformed into a standard circular shape with a diameter of 12mm by stretching, scaling and the like.
The invention has the beneficial effects that: the invention can relieve eye fatigue, automatically adjust focal length and avoid the glasses to fix a focal length for a long time; the size proportion of the picture can be kept when the focal length is automatically adjusted, and the picture cannot be reduced to cause poor vision when the focal length is adjusted; only one motor is needed, so that the weight is light, and the structure is simple; by identifying the glasses frame, the accuracy of distortion prevention is improved, and the wearing position of a wearer can be allowed to be not fixed; the damage to the glasses caused by the excessive brightness can be reduced.
Drawings
FIG. 1 is a schematic flow chart of the method of the present invention.
Fig. 2 is a system schematic block diagram of the present invention.
Fig. 3 is a transformation diagram of a transformation matrix.
Fig. 4 is a schematic view of the usage state of the present invention.
Detailed Description
The invention is further described below with reference to the accompanying drawings.
Referring to fig. 1, the zoom display method of the head-mounted display of the present invention includes the following steps:
step S1, a user terminal is connected with Bluetooth of a head-mounted display, and a stepping motor is arranged in the head-mounted display;
step S2, after connection, the user terminal adjusts the angle of the concave mirror of the head-mounted display through Bluetooth according to preset time, so that focal length change is realized;
and step S3, the user terminal converts the original picture pixels according to a picture distortion coefficient matrix of the head-mounted display according to a rotation step of a preset stepping motor, adjusts the size of a picture and keeps the proportion of the picture, thereby realizing the focal length adjustment of the head-mounted display.
The invention is further illustrated by the following examples:
the method comprises the following steps:
referring to fig. 4, 1. The mobile phone controls the stepping motor to automatically adjust the focal length according to the preset time, and the preset time ranges from 5 minutes to 20 minutes.
1.1 the cell phone sends out Bluetooth command regularly through the timer
1.2 step motor receiving instruction
1.3 the stepper motor rotates according to a preset number of steps.
2. The mobile phone automatically adjusts the size of the picture according to the rotation step number of the preset stepping motor, and the proportion of the picture is maintained; the number of steps is confirmed according to the visual range of the D concave mirror, the left angle in the graph on the concave mirror is overlarge, and visual contents cannot be completely displayed, and the right is the same. The size of the picture content to be seen is also relevant, and if the picture is smaller, the included angle between the left and right movement can be larger.
Referring to fig. 3, an included angle range x between B and D is preset according to the actual apparatus, and then the total step number of the stepper motor moving x is calculated.
And 2.1, simultaneously, transforming the original picture pixels according to a preset picture distortion coefficient matrix.
2.1.1. Generating a preset coefficient matrix, and placing pixel points simulating the positions of eyes of people to receive the reflection of the mobile phone through the camera. The camera (the front camera of the mobile phone) shoots personnel position square frame glasses, and four sides pixel points of the glasses frame are recorded.
2.1.2. And rendering a black background and a white rectangular frame in a mobile phone screen.
Referring to FIG. 3, the 2.1.3 camera calculates the angles between the sides x1, y1 to x3, y3 and the sides x3, y3 to x4, y4 of the frame after receiving the frame reflected by the A plane mirror and the B concave mirror. The X3, Y3 position is calculated (where x3=x1, because x4=x2 is on the same abscissa). Then, the pixel points of each row are scaled equally to a length of X2-X1 centered at the midpoint. The coefficients (wx+bx, wy+by) of each pixel transformed to the final pixel are recorded, and the coefficients of all the pixels form a matrix A and B (the matrix A and B can be used for solving what proportion of the picture output of the mobile phone, and the camera can receive the picture without rectangular distortion). In order to change the appearance of E displayed in the mirror from trapezoidal to square. An adjustment is required for the position of each pixel.
The image of the actual display is changed from G to S.
For example, at an angle of 90 degrees, E becomes F, the point (X1, Y1), (X2, Y2) coordinates may be unchanged, x1=x1, y1=y1, X2, Y2. (X3, Y3) requires a rightward movement, i.e. x3=ax3+b, y3=cy3+d. All pixels are subjected to a coefficient calculation to obtain the final pixel position.
Then, each time the stepping motor rotates by one step, the shape change is different, a group of coefficients are needed, and the pixel points corresponding to the square are calculated.
2.1.2. And (5) automatically exhausting the rotation angles of the stepping motor, and recording matrixes A and B corresponding to each angle. And recording the pixel points of the mirror frame.
2.2, when playing, the mobile phone obtains the current rotation angle of the stepping motor to obtain transformation matrixes A and B. And calculating the pixel points which should be played by the mobile phone. The camera shoots the picture frame pixels, and the corresponding transformation matrix is matched through the picture frame pixels (if the mobile phone is directly watched without the reflection mirror surface, the actual image of the mobile phone is the effect of G-to-S transformation.
3. Eyeball information acquisition through infrared night vision camera
3.1 real-time acquisition eyeball current image of infrared night vision camera
3.2 extracting the region of iris and pupil from the acquired image, if the acquired image is too dark, actively emitting infrared light to assist acquisition
3.3 conversion of the Iris region into a standard circle of 12mm diameter (between 11.4mm and 12mm according to the statistical population's iris)
4. Calculation of pupil size
4.1 identifying the transformed Iris image, identifying the pupil area
4.2 calculating the current pupil diameter from the iris diameter of 12mm
5. Obtaining the screen brightness according to the pupil size multiplied by the corresponding coefficient
5.1 pupil size the screen brightness value is calculated according to the ratio of the iris diameters, with a default of 1.2mm brightness of 100% and if performed of 9.6mm brightness of 0%. Let the brightness be L and the pupil diameter be D (1.2 mm to 9.6mm is the pupil range of a typical person).
In a word, the user terminal of the invention controls the stepping motor to automatically adjust the focal length (the focal length is changed and the picture size is changed because of the angle adjustment of the concave mirror) according to the preset time, thereby relieving the fatigue of the glasses, automatically adjusting the focal length and avoiding the glasses to fix a focal length for a long time.
The invention also provides a zoom display system of the head-mounted display, which comprises a connecting module, an adjusting module and a transforming module, wherein the connecting module, namely a user terminal, is connected with Bluetooth of the head-mounted display, and a stepping motor is arranged in the head-mounted display; the adjusting module is used for adjusting the angle of the concave mirror of the head-mounted display through Bluetooth according to preset time after connection, so that focal length change is realized; the conversion module, namely the user terminal, converts the original picture pixels according to a picture distortion coefficient matrix of the head-mounted display according to a rotation step of a preset stepping motor, adjusts the size of the picture and keeps the proportion of the picture, thereby realizing the focal length adjustment of the head-mounted display.
The adjusting module is further specifically: the user terminal sends a Bluetooth instruction through the timer, and the stepping motor receives the Bluetooth instruction; the stepping motor rotates according to the step number set by the user terminal.
The transformation module further specifically includes: the system comprises a presetting unit, a recording unit and an acquisition unit, wherein the presetting unit is used for presetting a generated picture distortion coefficient matrix for a user terminal, and receiving pixel points reflected by the user terminal by simulating the position of a human eye through a camera of the user terminal; the recording unit is used for recording the corresponding matrixes A and B of each angle, namely the rotation angle of the exhaustive stepper motor; the obtaining unit obtains the current rotation angle of the stepping motor by the user terminal when the head-mounted display plays, and obtains a transformation matrix A, B.
The preset unit is further specifically: when a person wearing the head-mounted display wears the block glasses, the four-side pixel points of the glasses frame can be recorded.
When the front camera of the user terminal is an infrared night vision camera, the infrared night vision camera acquires the current eyeball image in real time; extracting the iris and pupil areas from the acquired images, judging whether the acquired images are too dark, if yes, actively transmitting infrared light for auxiliary acquisition, and if no, not transmitting infrared light for auxiliary acquisition; the iris region is transformed into a standard circular shape with a diameter of 12mm by stretching, scaling and the like.
The foregoing description is only of the preferred embodiments of the invention, and all changes and modifications that come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein.
Claims (6)
1. A method of zoom display for a head mounted display, the method comprising the steps of:
step S1, a user terminal is connected with Bluetooth of a head-mounted display, and a stepping motor is arranged in the head-mounted display;
step S2, after connection, the user terminal adjusts the angle of the concave mirror of the head-mounted display through Bluetooth according to preset time, so that focal length change is realized;
s3, the user terminal converts original picture pixels according to a picture distortion coefficient matrix of the head-mounted display according to a rotation step of a preset stepping motor, adjusts the size of a picture, and maintains the proportion of the picture, so that the focal length of the head-mounted display is adjusted;
the step S3 further specifically includes the following steps: step S31, presetting a generated picture distortion coefficient matrix by a user terminal, and receiving pixel points reflected by the user terminal by placing a simulated human eye position by a camera of the user terminal; step S32, exhausting the rotation angles of the stepping motor, and recording matrixes A and B corresponding to the angles; step S33, when the head-mounted display is played, the user terminal obtains the current rotation angle of the stepping motor to obtain a transformation matrix A, B;
the step S31 is further specifically: when a person wearing the head-mounted display wears the block glasses, the four-side pixel points of the glasses frame can be recorded.
2. A method of zoom display of a head mounted display as claimed in claim 1, wherein: the step S2 is further specifically: the user terminal sends a Bluetooth instruction through the timer, and the stepping motor receives the Bluetooth instruction; the stepping motor rotates according to the step number set by the user terminal.
3. A method of zoom display of a head mounted display as claimed in claim 1, wherein: when the front camera of the user terminal is an infrared night vision camera, the infrared night vision camera acquires the current eyeball image in real time; extracting the iris and pupil areas from the acquired images, judging whether the acquired images are too dark, if yes, actively transmitting infrared light for auxiliary acquisition, and if no, not transmitting infrared light for auxiliary acquisition; the iris region was transformed into a standard circle with a diameter of 12mm by stretching and scaling.
4. A head mounted display zoom display system, characterized by: the Bluetooth headset comprises a connection module, an adjustment module and a conversion module, wherein the connection module, namely a user terminal, is connected with Bluetooth of a headset display, and a stepping motor is arranged in the headset display; the adjusting module is used for adjusting the angle of the concave mirror of the head-mounted display through Bluetooth according to preset time after connection, so that focal length change is realized; the conversion module, namely the user terminal converts the original picture pixels according to a picture distortion coefficient matrix of the head-mounted display according to a rotation step of a preset stepping motor, adjusts the size of a picture and keeps the proportion of the picture, thereby realizing the focal length adjustment of the head-mounted display;
the transformation module further specifically includes: the system comprises a presetting unit, a recording unit and an acquisition unit, wherein the presetting unit is used for presetting a generated picture distortion coefficient matrix for a user terminal, and receiving pixel points reflected by the user terminal by simulating the position of a human eye through a camera of the user terminal; the recording unit is used for recording the corresponding matrixes A and B of each angle, namely the rotation angle of the exhaustive stepper motor; the obtaining unit obtains the current rotation angle of the stepping motor by the user terminal when the head-mounted display plays, and obtains a transformation matrix A, B;
the preset unit is further specifically: when a person wearing the head-mounted display wears the block glasses, the four-side pixel points of the glasses frame can be recorded.
5. A head mounted display zoom display system according to claim 4, wherein: the adjusting module is further specifically: the user terminal sends a Bluetooth instruction through the timer, and the stepping motor receives the Bluetooth instruction; the stepping motor rotates according to the step number set by the user terminal.
6. A head mounted display zoom display system according to claim 4, wherein: when the front camera of the user terminal is an infrared night vision camera, the infrared night vision camera acquires the current eyeball image in real time; extracting the iris and pupil areas from the acquired images, judging whether the acquired images are too dark, if yes, actively transmitting infrared light for auxiliary acquisition, and if no, not transmitting infrared light for auxiliary acquisition; the iris region was transformed into a standard circle with a diameter of 12mm by stretching and scaling.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111287441.0A CN113985611B (en) | 2021-11-02 | 2021-11-02 | Zoom display method and system for head-mounted display |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111287441.0A CN113985611B (en) | 2021-11-02 | 2021-11-02 | Zoom display method and system for head-mounted display |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113985611A CN113985611A (en) | 2022-01-28 |
| CN113985611B true CN113985611B (en) | 2023-10-20 |
Family
ID=79745701
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111287441.0A Active CN113985611B (en) | 2021-11-02 | 2021-11-02 | Zoom display method and system for head-mounted display |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113985611B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH10307202A (en) * | 1997-05-09 | 1998-11-17 | Fujitsu General Ltd | Reflection mirror for projector and optical distortion adjusting system |
| JP2000312319A (en) * | 1999-04-28 | 2000-11-07 | Matsushita Electric Ind Co Ltd | Head mounted display |
| CN106383404A (en) * | 2016-08-31 | 2017-02-08 | 北京奇艺世纪科技有限公司 | Automatic focusing method and head-wearing visual device |
| CN106970468A (en) * | 2017-05-19 | 2017-07-21 | 安徽建筑大学 | A kind of autofocusing VR helmets |
| CN107368104A (en) * | 2017-07-19 | 2017-11-21 | 济南中维世纪科技有限公司 | Any independent positioning method based on cell phone application and domestic intelligent monopod video camera |
| CN109633907A (en) * | 2019-01-09 | 2019-04-16 | 福建天晴数码有限公司 | The method of simple eye AR glasses automatic brightness adjustment, storage medium |
| CN110874135A (en) * | 2018-09-03 | 2020-03-10 | 广东虚拟现实科技有限公司 | Optical distortion correction method and device, terminal equipment and storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6391423B2 (en) * | 2014-10-24 | 2018-09-19 | 株式会社ソニー・インタラクティブエンタテインメント | Image generating apparatus, image extracting apparatus, image generating method, and image extracting method |
-
2021
- 2021-11-02 CN CN202111287441.0A patent/CN113985611B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH10307202A (en) * | 1997-05-09 | 1998-11-17 | Fujitsu General Ltd | Reflection mirror for projector and optical distortion adjusting system |
| JP2000312319A (en) * | 1999-04-28 | 2000-11-07 | Matsushita Electric Ind Co Ltd | Head mounted display |
| CN106383404A (en) * | 2016-08-31 | 2017-02-08 | 北京奇艺世纪科技有限公司 | Automatic focusing method and head-wearing visual device |
| CN106970468A (en) * | 2017-05-19 | 2017-07-21 | 安徽建筑大学 | A kind of autofocusing VR helmets |
| CN107368104A (en) * | 2017-07-19 | 2017-11-21 | 济南中维世纪科技有限公司 | Any independent positioning method based on cell phone application and domestic intelligent monopod video camera |
| CN110874135A (en) * | 2018-09-03 | 2020-03-10 | 广东虚拟现实科技有限公司 | Optical distortion correction method and device, terminal equipment and storage medium |
| CN109633907A (en) * | 2019-01-09 | 2019-04-16 | 福建天晴数码有限公司 | The method of simple eye AR glasses automatic brightness adjustment, storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113985611A (en) | 2022-01-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10495885B2 (en) | Apparatus and method for a bioptic real time video system | |
| US11551602B2 (en) | Non-uniform resolution, large field-of-view headworn display | |
| US20170208312A1 (en) | Apparatus and method for a dynamic "region of interest" in a display system | |
| CA2875261C (en) | Apparatus and method for a bioptic real time video system | |
| CA2454524A1 (en) | Method and device for image display | |
| WO2008065569A1 (en) | Electronic imaging device and method of electronically rendering a wavefront | |
| JPWO2008096719A1 (en) | Head mounted display with open peripheral vision | |
| CN111880654A (en) | Image display method and device, wearable device and storage medium | |
| North et al. | Compact and high-brightness helmet-mounted head-up display system by retinal laser projection | |
| EP2972564A1 (en) | System, apparatus, and method for enhancing stereoscopic images | |
| JP2018513656A (en) | Eyeglass structure for image enhancement | |
| CN113985611B (en) | Zoom display method and system for head-mounted display | |
| WO2019217262A1 (en) | Dynamic foveated rendering | |
| CN110840721B (en) | Near-eye display-based eyesight prevention, control and training method and near-eye display equipment | |
| US10771774B1 (en) | Display apparatus and method of producing images having spatially-variable angular resolutions | |
| CN204883059U (en) | Wear display device | |
| WO2022240707A1 (en) | Adaptive backlight activation for low-persistence liquid crystal displays | |
| CN109963145B (en) | Visual display system and method and head-mounted display device | |
| JP2020522022A (en) | Eyepiece for personal display and personal display including such eyepiece | |
| JP3907523B2 (en) | Glasses-type image display device | |
| CN111435195B (en) | Near-eye display structure | |
| JP2024093070A (en) | HMD brightness adjustment device and program thereof | |
| CN112153251A (en) | Image processing device and method | |
| CN115426489A (en) | Method and device for reducing blue light in virtual reality helmet | |
| CN115867238A (en) | Visual aid |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |