CN108957742A - A kind of augmented reality helmet and method for realizing the virtual transparent dynamic regulation of picture - Google Patents
A kind of augmented reality helmet and method for realizing the virtual transparent dynamic regulation of picture Download PDFInfo
- Publication number
- CN108957742A CN108957742A CN201710356974.7A CN201710356974A CN108957742A CN 108957742 A CN108957742 A CN 108957742A CN 201710356974 A CN201710356974 A CN 201710356974A CN 108957742 A CN108957742 A CN 108957742A
- Authority
- CN
- China
- Prior art keywords
- module
- image
- eyepiece
- picture
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
Abstract
The invention discloses a kind of augmented reality helmets and method for realizing the virtual transparent dynamic regulation of picture, the augmented reality helmet includes the helmet cap and vision module being fixedly connected, and the vision module includes: image collection module, interpupillary distance adjustment module, display module, processing module and eyepiece；Described image obtains module and is used to obtain external image data, and the display module is for control instruction based on the received to virtual image and external image processing and Overlapping display；The processing module is used to obtain the hardware parameter of internal various components and sends corresponding control instruction to the corresponding component, and dynamic regulation penetrates the image that the eyepiece is shown.The present invention is by obtaining the hardware parameter of internal various components and sending corresponding control instruction to the corresponding component, dynamic regulation penetrates the image that the eyepiece is shown, realize the automatic adjustment of right and left eyes picture position, reach the virtual transparent automatic adjustment of picture, user is made to obtain better usage experience.
Description
Technical field
The present invention relates to field more particularly to a kind of realize picture virtually the augmented reality helmet of transparent dynamic regulation and side
Method.
Background technique
Augmented reality (Augmented Reality, abbreviation AR) technology is a kind of position for calculating camera image in real time
Set and angle and add respective image technology, the target of this technology is that virtual world is covered in real generation on the display module
Boundary is simultaneously interacted.
Currently, the imaging position of the virtual transparent effect of the augmented reality helmet and picture size ratio be it is fixed, this is caused
The scenery for being distal to setting position may appear to less than normal, and the scenery for being bordering on setting position may appear to bigger than normal, and user using
On can feel that remote scenery is remote, and close scenery is partially close.This impression for making user in use and thering is entire space to be stretched, together
When also bring the possibility of maloperation in actual use to user.
Further, since the interpupillary distance of hardware size limitation and different user is different, screen to the optical device between human eye
It is likely to be at the state of center deviation, this deviation state will lead to right and left eyes picture and can not be overlapped, to solve this problem, user
Additional calibration process may be required when using different hardware is overlapped picture.
In realizing process of the present invention, at least there are the following problems in the prior art for inventor's discovery:
1, user makes to be stretched with the impression in entire space in the process, can feel that remote scenery is remote, and close scenery
It is partially close；
2, user may require additional calibration process when using different hardware is overlapped picture, and adjustment process is complicated
It is cumbersome.
Summary of the invention
In order to overcome the shortcomings of Related product in the prior art, the present invention proposes a kind of realization picture virtually transparent dynamic tune
The augmented reality helmet and method of section, solve the current augmented reality helmet it is cumbersome and because space stretch cause maloperation
Problem.
The present invention provides a kind of augmented reality helmets for realizing the virtual transparent dynamic regulation of picture, including what is be fixedly connected
Helmet cap and vision module, the vision module include: image collection module, interpupillary distance adjustment module, display module, processing module
And eyepiece；Described image acquisition module, interpupillary distance adjustment module, display module, processing module and eyepiece are arranged at described
On helmet cap, wherein described image obtains the front that the helmet cap is arranged in module, and the display module and eyepiece are arranged described
The reverse side of helmet cap, and the display module is arranged in the front of the eyepiece, described image obtain module, interpupillary distance adjustment module and
Display module is electrically connected with the processing module respectively；Described image obtains module and is used to obtain external image data, institute
Display module is stated for control instruction based on the received to virtual image and external image processing and Overlapping display；The eyepiece packet
Two are included, the eyepiece is for the external image watching the display module and showing, the interpupillary distance adjustment module is for adjusting institute
State the spacing between two eyepieces；The processing module is for obtaining the hardware parameter of internal various components and to described corresponding
Component sends corresponding control instruction, and dynamic regulation penetrates the image that the eyepiece is shown.
As a further improvement of the present invention, the processing module includes: resolution unit, is obtained for parsing described image
The external image data that module obtains determine the depth parameter of target object；Sensor unit, for obtaining internal various components
Hardware parameter；Computing unit, for determining the zoom factor of image and additional according to the depth parameter and hardware parameter
Deviation angle；Unit is adjusted, for angularly corresponding component to be sent according to the zoom factor of described image and additional offset
Control instruction is to execute corresponding adjusting operation.
As a further improvement of the present invention, the hardware parameter that the sensor unit obtains includes: two goggle structures
The spacing of central point, the distance of human eye to the eyepiece, the aperture of the eyepiece, the focal length of the eyepiece and display dress
The radius set.
As a further improvement of the present invention, the processing module further include: virtual image unit, for generating virtual graph
Picture is simultaneously output to the display device.
As a further improvement of the present invention, the adjusting unit is specifically used for following at least one adjusting operation: adjusting
The visual field side of spacing, the display image and the adjusting adjusting virtual image unit that adjust display module between the eyepiece
To.
As a further improvement of the present invention, the helmet further include: power module and switch control module, the figure
It is electrical with the power module that picture obtains module, interpupillary distance adjustment module, display module, processing module and switch control module
Connection, the switch control module are arranged in the outside of the shell and are electrically connected with the display module；The power supply mould
Block, which is used to obtain module, interpupillary distance adjustment module, display module, processing module and switch control module for described image, provides energy
Amount, the switch control module is for adjusting the display module brightness and the opening and closing of power supply.
The embodiment of the invention provides a kind of realization picture applied to the augmented reality helmet described in any of the above-described is virtual
The method of transparent dynamic regulation, comprising: external image data is obtained, by virtual image and external image Overlapping display；It obtains
The hardware parameter of internal various components simultaneously sends control instruction to corresponding component to execute corresponding adjusting operation.
As a further improvement of the present invention, it the hardware parameter of various components and is sent out to corresponding component inside the acquisition
Control instruction is sent to execute the corresponding depth ginseng for adjusting the external image data that operation includes: parsing acquisition and determining target object
Number；Obtain the hardware parameter of internal various components；According to the depth parameter and hardware parameter determine the zoom factor of image with
And additional deviation angle；According to the zoom factor of described image and additional offset, angularly corresponding component sends control instruction
To execute corresponding adjusting operation.
As a further improvement of the present invention, the method also includes: generate virtual image simultaneously export.
As a further improvement of the present invention, which is characterized in that described according to the hardware parameter and described image
Zoom factor sends control instruction to display module to execute in corresponding adjusting operation, and the adjusting operation includes at least as follows
It is a kind of: to adjust the spacing between the eyepiece, adjust the display image of display module and adjust the adjusting virtual image list
The visual field direction of member.
Compared with prior art, the present invention has the following advantages:
Virtually the augmented reality helmet of transparent dynamic regulation and method pass through acquisition to realization picture described in the embodiment of the present invention
The hardware parameter of internal various components simultaneously sends corresponding control instruction to the corresponding component, and dynamic regulation penetrates the mesh
The image that mirror is shown realizes the automatic adjustment of right and left eyes picture position, can show external environment with being overlapped for virtual content
Show, realizes the virtual transparent automatic adjustment of picture, user is made to obtain better usage experience.
Detailed description of the invention
It to describe the technical solutions in the embodiments of the present invention more clearly, below will be to needed in the embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for ability
For the those of ordinary skill of domain, without creative efforts, it can also be obtained according to these attached drawings other attached
Figure.
Fig. 1 is the positive structure schematic of the augmented reality helmet of the present invention；
Fig. 2 is the reverse structure schematic of the augmented reality helmet of the present invention；
Fig. 3 is the structural schematic diagram of vision module of the present invention；
Fig. 4 is the virtual transparent schematic illustration of picture of the present invention；
Fig. 5 is the schematic illustration that the present invention calculates human eye field angle；
Fig. 6 is the schematic diagram of binocular camera field angle of the present invention；
Fig. 7 is the schematic diagram for the zoom factor α that the present invention calculates image；
Fig. 8 is display screen of the present invention and the asymmetric schematic diagram of eyepiece optics structure centre；
Fig. 9 is that the present invention calculates deviation angle schematic diagram；
Figure 10 is that image collection module field angle of the present invention adjusts schematic diagram；
Figure 11 is the flow diagram of the virtual method of transparent dynamic regulation of realization picture of the present invention；
Figure 12 is of the present invention applied to the virtual electronic equipment of the method for transparent dynamic regulation of the realization picture
Hardware schematic.
Specific embodiment
In order to enable those skilled in the art to better understand the solution of the present invention, below in conjunction in the embodiment of the present invention
Attached drawing, technical scheme in the embodiment of the invention is clearly and completely described.Obviously, described embodiment is only
A part of the embodiment of the present invention gives presently preferred embodiments of the present invention instead of all the embodiments in attached drawing.The present invention can
To realize in many different forms, however it is not limited to embodiment described herein, on the contrary, provide the mesh of these embodiments
Be to make the disclosure of the present invention more thorough and comprehensive.Based on the embodiments of the present invention, the common skill in this field
Art personnel every other embodiment obtained without creative efforts belongs to the model that the present invention protects
It encloses.
Unless otherwise defined, all technical and scientific terms used herein and belong to technical field of the invention
The normally understood meaning of technical staff is identical.Term as used herein in the specification of the present invention is intended merely to description tool
The purpose of the embodiment of body, it is not intended that in the limitation present invention.In description and claims of this specification and above-mentioned attached drawing
Term " first ", " second " etc. be to be not use to describe a particular order for distinguishing different objects.In addition, term " packet
Include " and " having " and their any deformations, it is intended that it covers and non-exclusive includes.Such as contain series of steps or list
The process, method, system, product or equipment of member are not limited to listed step or unit, but optionally further comprising do not have
The step of listing or unit, or optionally further comprising other steps intrinsic for these process, methods, product or equipment or
Unit.
Referenced herein " embodiment " is it is meant that a particular feature, structure, or characteristic described can wrap in conjunction with the embodiments
Containing at least one embodiment of the present invention.Each position in the description occur the phrase might not each mean it is identical
Embodiment, nor the independent or alternative embodiment with other embodiments mutual exclusion.Those skilled in the art explicitly and
Implicitly understand, embodiment described herein can be combined with other embodiments.
The technology of the general augmented reality helmet is there are two types of, respectively optical perspective technology and video perspective technology, institute
The optical perspective technology stated is directly to obtain external image and projected image by lens, and video perspective technology is then logical
The virtual image Overlapping display that camera obtains external image and will acquire is crossed, the embodiment of the present invention uses the video perspective
Technology realizes that picture is virtually transparent.
Refering to fig. 1 and shown in Fig. 2, the augmented reality helmet for realizing the virtual transparent dynamic regulation of picture includes fixed connects
The helmet cap 2 and vision module 1 connect.
As shown in fig.3, the vision module 1 includes image collection module 11, interpupillary distance adjustment module 12, display module
13, processing module 14 and eyepiece 15；
Described image obtains module 11, interpupillary distance adjustment module 12, display module 13, processing module 14 and eyepiece 15 and is all provided with
It sets on the helmet cap 2, wherein described image obtains the front that the helmet cap 2 is arranged in module 11,13 He of display module
The reverse side of the helmet cap 2 is arranged in eyepiece 15, and the front of the eyepiece 15 is arranged in the display module 13, and described image obtains
Modulus block 11, interpupillary distance adjustment module 12 and display module 13 are electrically connected with the processing module 14 respectively.
Described image obtains module 11 and is used to obtain external image data, and in embodiments of the present invention, described image obtains
Taking device is binocular camera.
The display module 13 is used for virtual image and external image Overlapping display, and the display module 13 is display
Screen, including but not limited to liquid crystal display, LED (light emitting diode) display screen etc.；
The eyepiece 15 includes two, and the eyepiece 15 watches what the display module 13 was shown from external for user
Image, the interpupillary distance adjustment module 12 is used to adjust the spacing between described two eyepieces 15, to adapt to making for different interpupillary distances
User.
The processing module 14 is for obtaining the hardware parameter of internal various components and to the display module 13 and pupil
Corresponding control instruction is sent away from adjustment module 12, dynamic regulation penetrates the image of the eyepiece 15 display；The processing module
14 include resolution unit 141, sensor unit 142, computing unit 143, adjusting unit 144 and virtual image unit 145.
The resolution unit 141 is used to parse the external image data that described image acquisition module 11 obtains and determines target pair
The depth parameter of elephant, the depth parameter of the target object are target object with a distance from the binocular camera, optionally,
The depth parameter can also calculate the existing skills such as object distance by infrared depth camera, laser ranging or by pick-up lens focusing
Art obtains.
The sensor unit 142 is used to obtain the hardware parameter of internal various components, and the sensor unit 142 obtains
Hardware parameter include: human eye to the distance of the eyepiece 15, the aperture of the eyepiece 15, the focal length of the eyepiece 15 and institute
State the radius of display device；
The computing unit 143 is used to determine the zoom factor and volume of image according to the depth parameter and hardware parameter
Outer deviation angle.
The adjusting unit 144 is used for according to the angular corresponding component of the zoom factor of described image and additional offset
Control instruction is sent to execute corresponding adjusting operation, the adjusting unit 144 is specifically used for adjusting between the eyepiece 15
Spacing adjusts visual field direction and the adjusting visual field side for adjusting virtual image unit 145 that described image obtains module 11
To.
The virtual image unit 145 is for generating virtual image and being output to the display device.
The principle that the augmented reality helmet described in the embodiment of the present invention realizes the virtual transparent dynamic regulation of picture is explained below,
It is specific:
As shown in fig.4, when seeing object, such as to realize picture in the case where human eye and camera field angle are all fixed
It is virtual transparent, then human eye field angle θ1With the field angle θ of camera3It should be overlapped, in the case, regardless of whether it is existing to wear enhancing
The real helmet, it is seen that article size be all consistent.But due between human eye and camera there are range difference, and the two visual field
Angle size is also inconsistent, if the size of picture is fixed in display screen, when seeing near objects, the image of display screen is put
Greatly, it appears that the effect that image will be seen compared with naked eye is bigger than normal；Otherwise when seeing distant objects, it appears that image will be less than normal,
Therefore, θ3Less than or equal to θ1It is virtually transparent all to cannot achieve picture, and certainly exists a close range in the entire ken, takes the photograph
As the visual field of head can not cover human eye visual field.Since there are the distances of distinct vision for human eye, if the distance of distinct vision be 250mm, be greater than this away from
From human eye can very easily blur-free imaging, and shorter than this distance, although human eye can increase diopter in a certain range,
It is more easily tired, it keeps also damaging eyesight for a long time, therefore the ken within the distance of distinct vision is not involved in and realizes that picture is virtually saturating
It is bright, i.e., only need the field angle θ of camera3In human eye distance of distinct vision 250mm and human eye field angle θ1It is overlapped, just has on hardware
It realizes the virtual transparent condition of picture, therefore realizes the virtual transparent field angle θ for necessarily requiring camera of picture3It should be greater than human eye view
Rink corner θ1。
As shown in fig.5, human eye maximum field of view angle when using the perspective helmet is enhancedIt is by human eye and eyepiece 15
Spacing l, the clear aperature r of eyepiece 15, eyepiece 15 focal length f and screen radius size s are determined；Optionally, due to enhancing
The helmet is had an X-rayed in design, above-mentioned human eye and the spacing l of eyepiece 15, the clear aperature r of eyepiece 15,15 focal length f of eyepiece and
With determination, each hardware parameter can also be stored in the enhancing perspective helmet screen radius size s when leaving the factory
Portion, the sensor unit 142 can directly acquire.The θ2It is the field angle of eyepiece 15, it is known that tan θ1=r/l, tan θ2=
(s-r)/f, it is available according to ray tracing formula: tan θ1=tan θ2+ r/f, and the determination of hardware parameter has also determined that people
The field angle θ of eye1, the above parameter constant, then the maximum field of view angle of human eye is also constant, valueAre as follows:
In human eye maximum field of view angle θ1It in the case where determination, to realize that the picture of scene at different sighting distances is virtually transparent, need
Adjust the field angle θ of camera in real time according to image-forming range3, it is allowed to and human eye field angle θ1Matching.
As shown in fig.6, the field angle of the binocular camera remove with camera lens itself design field angle mutually outside the Pass, also at
As the target surface size correlation of sensor, for identical camera lens, target surface is smaller, then resulting field angle is smaller, and vice versa.Institute
The target surface for stating imaging sensor has determined when leaving the factory, that is to say, that the field angle θ of camera module3It is fixed value.
As shown in fig.7, the depth parameter of target object is b, then if make us eye is a to the binocular distance of camera
Human eye size of field of view d and the size of field of view e of binocular camera are respectively as follows:
D=(a+b) tan θ1(2)
E=btan θ3(3)
Enable the ratio of the size of field of view e and human eye size of field of view d of the binocular camera for the zoom factor α of image, knot
Box-like (1), (2) and formula (3), the computing unit 143 are obtained by calculation
Since the hardware parameter of various components is when leaving the factory it has been determined that in order to reach camera described in virtual transparent effect
Field angle θ3It is necessarily greater than human eye field angle θ1, therefore only need the depth parameter b for obtaining target object in real time that can calculate
The zoom factor α of image when reaching virtual transparent effect, as it was noted above, the augmented reality helmet is at distance of distinct vision 250mm, θ3
WithIntersection, the zoom factor of picture is 1 at this time, and the image frame that camera obtains all is projected on display screen, photopic vision
Within distance, the augmented reality helmet abandons blur-free imaging to keep consistent with naked eye, and is distal at the distance of distinct vision, and camera obtains
Image frame be greater than human eye maximum field of view angleThe content that can be seen, therefore the zoom factor greater than 1 is substituted into, make
Part picture " spilling " screen is not shown, to obtain virtual transparent effect, adjusting unit 144 described in the embodiment of the present invention is logical
After the zoom factor α for adjusting 13 image of display module in real time, then the display module 13 can be in full scope of sight by institute
It states the external environment content that image collection module 11 is got and realizes the virtual transparence display of picture.
Similarly, the virtual image that the virtual image unit 145 generates is in order to realize virtual transparent effect, it is also desirable to phase
The virtual field angle answered is adjusted, due to the display effect and described image acquisition device acquired image of the virtual image
Display effect it is different, in embodiments of the present invention, the virtual field angle of the virtual image unit 145 and the human eye visual field
Virtual transparent effect can be realized in angle size when identical, when the computing unit 143 has determined human eye maximum field of view angle
Afterwards, the adjustment unit sends control instruction and adjusts the virtual field angle to the virtual image unit 145 is corresponding in real time, reaches
It is in the same size to the dummy object seen with human eye by eyepiece 15.
As shown in fig.8, in some cases, the optical texture center asymmetry of display screen and eyepiece 15 will lead to optical center
It deviates, box indicates that display screen, circle indicate eyepiece 15 in figure, and left side cross is the structure centre point of display screen, and right side ten
Word is the structure centre point of eyepiece 15, and da is the width of display screen, and de is that the spacing of two 15 structure centre points of eyepiece (is defaulted
Interpupillary distance), as shown in fig.9, will be generated when the width da of display screen is greater than the spacing de of two 15 structure centre points of eyepiece
The offset of optical centre, offset Δ d=(da-de)/2, and the picture of display screen default display is still original with screen center
Point thus introduces additional offset visual angle, prevent the picture that binocular light transmission eyepiece 15 is seen is from being overlapped.
Sensor unit 142 described in the embodiment of the present invention obtains the width da and described two eyepieces 15 of the display screen
The spacing de of structure centre point, the offset Δ d is calculated according to the da and de in the computing unit 143, in this hair
In bright embodiment, described two eyepieces 15 are thin lens, according to optical principle and formula (1), then caused by the offset
Deviation angle θ can be obtained:
θ=θ '=arctan (Δ d/f) (5)
The additional visual field deflection angle theta of the offset Δ d bring, because additional visual field deflection angle is both to real camera
The real picture taken also produces same effect to the dummy object picture that virtual camera takes, and makes two kinds of pictures
Cannot all be overlapped, thus two kinds of cameras will opposite direction deflection, the embodiment of the present invention by change image collection module 11 and
The visual field direction of virtual image unit 145 is offset, and rotational angle and the deflection angle are equal in magnitude, contrary, refering to
Shown in Figure 10, schematic diagram is adjusted for 11 field angle of image collection module of the present invention.Unit is adjusted described in the embodiment of the present invention
144 according to the deviation angle θ, send corresponding control instruction to the interpupillary distance adjustment module 12, image collection module 11 and
Virtual image unit 145 adjusts separately the visual field direction of interpupillary distance, image collection module 11 and virtual image unit 145, to support
The influence for the additional visual field deflection angle that disappears.
The augmented reality helmet further includes power module 16 and switch control module 17, and described image obtains module
11, interpupillary distance adjustment module 12, display module 13, processing module 14 and switch control module 17 are electric with the power module 16
Property connection, the switch control module 17 be arranged in the outside of the shell and with the display module 13 be electrically connected；It is described
Power module 16 is used to obtain module 11, interpupillary distance adjustment module 12, display module 13, processing module 14 for described image and open
It closes control module 17 and energy is provided, the switch control module 17 is for adjusting 13 brightness of display module and power module
16 opening and closing.
In embodiments of the present invention, the augmented reality helmet is by obtaining the hardware parameter of internal various components and to institute
It states corresponding component and sends corresponding control instruction, dynamic regulation penetrates the image of the eyepiece 15 display, realizes right and left eyes
The display that is overlapped of external environment and virtual content can be realized that picture is virtual transparent automatic by the automatic adjustment of picture position
It adjusts, user is made to obtain better usage experience.
Embodiment two
Refering to fig. 1 shown in 1, for the flow diagram of the virtual method of transparent dynamic regulation of realization picture of the present invention,
Include:
S101: external image data is obtained, by virtual image and external image Overlapping display.
S102: obtaining the hardware parameter of internal various components and it is corresponding to execute to send control instruction to corresponding component
Adjust operation.
Optionally, the external image data that parsing of the embodiment of the present invention obtains determine the depth parameter of target object；It obtains
The hardware parameter of internal various components；The zoom factor of image and additional is determined according to the depth parameter and hardware parameter
Deviation angle；According to the zoom factor of described image and additional offset, angularly corresponding component sends control instruction to execute pair
The adjusting operation answered.
Optionally, the embodiment of the present invention also generates virtual image and exports.
Optionally, the embodiment of the present invention it is described according to the hardware parameter and the zoom factor of described image to display mould
Block sends control instruction to execute in corresponding adjusting operation, and the adjusting operation includes at least following a kind of: adjusting the mesh
The visual field direction of spacing, the display image and the adjusting adjusting virtual image unit that adjust display module between mirror.
The augmented reality helmet described in above-described embodiment, which can be performed, realizes that picture is virtually saturating provided by the embodiment of the present invention
The method of bright dynamic regulation, it is corresponding that the method for realizing the virtual transparent dynamic regulation of picture has the above-mentioned augmented reality helmet
Functional module and beneficial effect, referring specifically to the embodiment of the above-mentioned augmented reality helmet, the embodiment of the present invention is no longer superfluous herein
It states.
Embodiment three
Figure 12 be it is provided in an embodiment of the present invention realization picture virtually the method for transparent dynamic regulation hardware configuration signal
Figure, as shown, the electronic equipment includes one or more processors 310 and memory 320.It is with a processor 310
Example.The electronic equipment can also include: input unit 330 and output device 340.
Processor 310, memory 320, input unit 330 and output device 340 can pass through bus or other modes
It connects, in Fig. 5 for being connected by bus.
Memory 320 is used as a kind of non-transient computer readable storage medium, can be used for storing non-transient software program, non-
Transient computer executable program and module.The non-transient software journey that processor 310 is stored in memory 320 by operation
Sequence, instruction and module, thereby executing the various function application and data processing of electronic equipment, i.e. the realization above method is implemented
The method of the virtual transparent dynamic regulation of realization picture of example.
Memory 320 may include storing program area and storage data area, wherein storing program area can store operation system
Application program required for system, at least one function；It storage data area can storing data etc..In addition, memory 320 may include
High-speed random access memory, can also include non-transient memory, a for example, at least disk memory, flush memory device,
Or other non-transient solid-state memories.In some embodiments, it includes long-range relative to processor 310 that memory 320 is optional
The memory of setting, these remote memories can pass through network connection to processing unit.The example of above-mentioned network includes but not
It is limited to internet, intranet, local area network, mobile radio communication and combinations thereof.
Input unit 330 can receive the number or character information of input, and generate signal input.Output device 340 can
Equipment is shown including display screen etc..
One or more of modules are stored in the memory 320, when by one or more of processors
310 when executing, the method for executing described in any of the above-described embodiment the virtual transparent dynamic regulation of realization picture.
Method provided by the embodiment of the present invention can be performed in the said goods, has the corresponding functional module of execution method and has
Beneficial effect.The not technical detail of detailed description in the present embodiment, reference can be made to realization picture provided in an embodiment of the present invention is virtual
The method of transparent dynamic regulation.
The embodiment of the invention provides a kind of non-transient (non-volatile) computer storage medium, the computer storage is situated between
Matter is stored with computer executable instructions, which can be performed realization picture described in any of the above-described embodiment
The method of virtual transparent dynamic regulation.
The embodiment of the invention provides a kind of computer program product, the computer program product is non-temporary including being stored in
Computer program on state computer readable storage medium, the computer program include program instruction, when described program instructs
When being computer-executed, the computer is made to execute described in any of the above-described embodiment realization picture virtually transparent dynamic regulation
Method.
It will be appreciated by those skilled in the art that implementing the method for the above embodiments is that can pass through
Program is completed to instruct relevant hardware, which is stored in a storage medium, including some instructions are used so that one
A equipment (can be single-chip microcontroller, chip etc.) or processor (processor) execute each embodiment the method for the application
All or part of the steps.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only
Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. are various can store journey
The medium of sequence code.
In above-described embodiment provided by the present invention, it should be understood that disclosed device and method can pass through it
Its mode is realized.For example, the apparatus embodiments described above are merely exemplary, for example, the division of the module, only
Only a kind of logical function partition, there may be another division manner in actual implementation, for example, multiple module or components can be tied
Another system is closed or is desirably integrated into, or some features can be ignored or not executed.
The module as illustrated by the separation member may or may not be physically separated, aobvious as module
The component shown may or may not be physical module, it can and it is in one place, or may be distributed over multiple
In network unit.Some or all of the modules therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
The above is only the embodiment of the present invention, are not intended to limit the scope of the patents of the invention, although with reference to the foregoing embodiments
Invention is explained in detail, still can be to aforementioned each specific reality for coming for those skilled in the art
It applies technical solution documented by mode to modify, or equivalence replacement is carried out to part of technical characteristic.It is all to utilize this
The equivalent structure that description of the invention and accompanying drawing content are done directly or indirectly is used in other related technical areas, similarly
Within the invention patent protection scope.
Claims (10)
1. a kind of augmented reality helmet for realizing the virtual transparent dynamic regulation of picture, including the helmet cap and vision mould being fixedly connected
Block, which is characterized in that the vision module include: image collection module, interpupillary distance adjustment module, display module, processing module with
And eyepiece；
Described image obtains module, interpupillary distance adjustment module, display module, processing module and eyepiece and is arranged at the helmet cap
On, wherein described image obtains the front that the helmet cap is arranged in module, and the display module and eyepiece are arranged in the helmet cap
Reverse side, and the display module is arranged in the front of the eyepiece, and described image obtains module, interpupillary distance adjustment module and display
Module is electrically connected with the processing module respectively；
Described image obtains module and is used to obtain external image data, and the display module is for control instruction based on the received
To virtual image and external image processing and Overlapping display；
The eyepiece includes two, and the eyepiece is adjusted for the external image watching the display module and showing, the interpupillary distance
Module is used to adjust the spacing between described two eyepieces；
The processing module is used to obtain the hardware parameter of internal various components and sends corresponding control to the corresponding component
System instruction, dynamic regulation penetrate the image that the eyepiece is shown.
2. the augmented reality helmet according to claim 1 for realizing the virtual transparent dynamic regulation of picture, which is characterized in that institute
Stating processing module includes:
Resolution unit obtains the depth ginseng that the external image data that module obtains determine target object for parsing described image
Number；
Sensor unit, for obtaining the hardware parameter of internal various components；
Computing unit, for determined according to the depth parameter and hardware parameter image zoom factor and additional offset
Angle；
Unit is adjusted, for angularly corresponding component transmission control to refer to according to the zoom factor of described image and additional offset
It enables to execute corresponding adjusting operation.
3. the augmented reality helmet according to claim 2 for realizing the virtual transparent dynamic regulation of picture, which is characterized in that institute
State sensor unit acquisition hardware parameter include: the spacing of two goggle structure central points, the distance of human eye to the eyepiece,
The radius in the aperture of the eyepiece, the focal length of the eyepiece and the display device.
4. the augmented reality helmet according to claim 2 for realizing the virtual transparent dynamic regulation of picture, which is characterized in that institute
State processing module further include:
Virtual image unit, for generating virtual image and being output to the display device.
5. the augmented reality helmet according to claim 3 for realizing the virtual transparent dynamic regulation of picture, which is characterized in that institute
It states and adjusts unit specifically for following at least one adjusting operation:
The spacing between the eyepiece is adjusted, the display image of display module is adjusted and adjusts the adjusting virtual image unit
Visual field direction.
6. the augmented reality helmet according to claim 1 for realizing the virtual transparent dynamic regulation of picture, which is characterized in that institute
State the helmet further include: power module and switch control module, described image obtain module, interpupillary distance adjustment module, display module,
Processing module and switch control module are electrically connected with the power module, and the switch control module setting is described outer
The outside of shell is simultaneously electrically connected with the display module；The power module is used to obtain module for described image, interpupillary distance is adjusted
Module, display module, processing module and switch control module provide energy, and the switch control module is described aobvious for adjusting
Show module brightness and the opening and closing of power supply.
7. a kind of virtual transparent dynamic tune of realization picture applied to any one of the claims 1-6 augmented reality helmet
The method of section characterized by comprising
Image data outside obtaining, by virtual image and external image Overlapping display；
It obtains the hardware parameter of internal various components and sends control instruction to corresponding component to execute corresponding adjusting operation.
8. the method according to claim 7 for realizing the virtual transparent dynamic regulation of picture, which is characterized in that in the acquisition
The hardware parameter of portion's various components simultaneously sends control instruction to corresponding component to execute corresponding adjusting operation and include:
The external image data that parsing obtains determine the depth parameter of target object；
Obtain the hardware parameter of internal various components；
According to the depth parameter and hardware parameter determine image zoom factor and additional deviation angle；
According to the zoom factor of described image and additional offset, angularly corresponding component sends control instruction to execute correspondence
Adjusting operation.
9. the method according to claim 8 for realizing the virtual transparent dynamic regulation of picture, which is characterized in that the method is also
It include: to generate virtual image and export.
10. the method according to claim 9 for realizing the virtual transparent dynamic regulation of picture, which is characterized in that at described
Control instruction is sent to execute corresponding adjusting operation to display module according to the hardware parameter and the zoom factor of described image
In, the adjusting operation includes at least following a kind of:
The spacing between the eyepiece is adjusted, the display image of display module is adjusted and adjusts the adjusting virtual image unit
Visual field direction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710356974.7A CN108957742B (en) | 2017-05-19 | 2017-05-19 | Augmented reality helmet and method for realizing virtual transparent dynamic adjustment of picture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710356974.7A CN108957742B (en) | 2017-05-19 | 2017-05-19 | Augmented reality helmet and method for realizing virtual transparent dynamic adjustment of picture |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108957742A true CN108957742A (en) | 2018-12-07 |
| CN108957742B CN108957742B (en) | 2021-09-03 |
Family
ID=64462085
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710356974.7A Active CN108957742B (en) | 2017-05-19 | 2017-05-19 | Augmented reality helmet and method for realizing virtual transparent dynamic adjustment of picture |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108957742B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111308707A (en) * | 2020-01-19 | 2020-06-19 | 惠州Tcl移动通信有限公司 | Picture display adjusting method and device, storage medium and augmented reality display equipment |
| CN111654688A (en) * | 2020-05-29 | 2020-09-11 | 亮风台（上海）信息科技有限公司 | Method and equipment for acquiring target control parameters |
| CN112991147A (en) * | 2019-12-18 | 2021-06-18 | 北京字节跳动网络技术有限公司 | Image processing method, image processing device, electronic equipment and computer readable storage medium |
| CN114442814A (en) * | 2022-03-31 | 2022-05-06 | 灯影科技有限公司 | Cloud desktop display method, device, equipment and storage medium |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102158721A (en) * | 2011-04-06 | 2011-08-17 | 青岛海信电器股份有限公司 | Method and device for adjusting three-dimensional image and television |
| US20120113209A1 (en) * | 2006-02-15 | 2012-05-10 | Kenneth Ira Ritchey | Non-Interference Field-of-view Support Apparatus for a Panoramic Facial Sensor |
| CN103337079A (en) * | 2013-07-09 | 2013-10-02 | 广州新节奏智能科技有限公司 | Virtual augmented reality teaching method and device |
| CN103353663A (en) * | 2013-06-28 | 2013-10-16 | 北京智谷睿拓技术服务有限公司 | Imaging adjustment apparatus and method |
| CN103499886A (en) * | 2013-09-30 | 2014-01-08 | 北京智谷睿拓技术服务有限公司 | Imaging device and method |
| CN104076513A (en) * | 2013-03-26 | 2014-10-01 | 精工爱普生株式会社 | Head-mounted display device, control method of head-mounted display device, and display system |
| US20150070596A1 (en) * | 2013-09-06 | 2015-03-12 | Omnivision Technologies, Inc. | Eyewear display system providing vision enhancement |
| CN104483753A (en) * | 2014-12-04 | 2015-04-01 | 上海交通大学 | Auto-registration transmission type head-wearing display equipment |
| WO2015043275A1 (en) * | 2013-09-30 | 2015-04-02 | Beijing Zhigu Rui Tuo Tech Co., Ltd | Imaging for local scaling |
| CN104520904A (en) * | 2012-08-10 | 2015-04-15 | 赫力环球有限公司 | Method and apparatus for layout for augmented reality view |
| CN105068249A (en) * | 2015-08-03 | 2015-11-18 | 众景视界（北京）科技有限公司 | Holographic intelligent glasses |
| CN105717644A (en) * | 2016-04-26 | 2016-06-29 | 上海与德通讯技术有限公司 | Image adjusting method and device and applicable intelligent glasses |
| CN106204431A (en) * | 2016-08-24 | 2016-12-07 | 中国科学院深圳先进技术研究院 | The display packing of intelligent glasses and device |
| CN106254847A (en) * | 2016-06-12 | 2016-12-21 | 深圳超多维光电子有限公司 | A kind of methods, devices and systems of the display limit determining stereo display screen |
| CN106291933A (en) * | 2016-09-06 | 2017-01-04 | 深圳酷酷科技有限公司 | Intelligent glasses wears control method and device |
| CN106556928A (en) * | 2015-09-28 | 2017-04-05 | 深圳市易瞳科技有限公司 | A kind of head video perspective display device |
| CN106575045A (en) * | 2014-08-18 | 2017-04-19 | 索尼公司 | Image display device and display apparatus |
-
2017
- 2017-05-19 CN CN201710356974.7A patent/CN108957742B/en active Active
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120113209A1 (en) * | 2006-02-15 | 2012-05-10 | Kenneth Ira Ritchey | Non-Interference Field-of-view Support Apparatus for a Panoramic Facial Sensor |
| CN102158721A (en) * | 2011-04-06 | 2011-08-17 | 青岛海信电器股份有限公司 | Method and device for adjusting three-dimensional image and television |
| CN104520904A (en) * | 2012-08-10 | 2015-04-15 | 赫力环球有限公司 | Method and apparatus for layout for augmented reality view |
| CN104076513A (en) * | 2013-03-26 | 2014-10-01 | 精工爱普生株式会社 | Head-mounted display device, control method of head-mounted display device, and display system |
| CN103353663A (en) * | 2013-06-28 | 2013-10-16 | 北京智谷睿拓技术服务有限公司 | Imaging adjustment apparatus and method |
| CN103337079A (en) * | 2013-07-09 | 2013-10-02 | 广州新节奏智能科技有限公司 | Virtual augmented reality teaching method and device |
| US20150070596A1 (en) * | 2013-09-06 | 2015-03-12 | Omnivision Technologies, Inc. | Eyewear display system providing vision enhancement |
| WO2015043275A1 (en) * | 2013-09-30 | 2015-04-02 | Beijing Zhigu Rui Tuo Tech Co., Ltd | Imaging for local scaling |
| CN103499886A (en) * | 2013-09-30 | 2014-01-08 | 北京智谷睿拓技术服务有限公司 | Imaging device and method |
| CN106575045A (en) * | 2014-08-18 | 2017-04-19 | 索尼公司 | Image display device and display apparatus |
| CN104483753A (en) * | 2014-12-04 | 2015-04-01 | 上海交通大学 | Auto-registration transmission type head-wearing display equipment |
| CN105068249A (en) * | 2015-08-03 | 2015-11-18 | 众景视界（北京）科技有限公司 | Holographic intelligent glasses |
| CN106556928A (en) * | 2015-09-28 | 2017-04-05 | 深圳市易瞳科技有限公司 | A kind of head video perspective display device |
| CN105717644A (en) * | 2016-04-26 | 2016-06-29 | 上海与德通讯技术有限公司 | Image adjusting method and device and applicable intelligent glasses |
| CN106254847A (en) * | 2016-06-12 | 2016-12-21 | 深圳超多维光电子有限公司 | A kind of methods, devices and systems of the display limit determining stereo display screen |
| CN106204431A (en) * | 2016-08-24 | 2016-12-07 | 中国科学院深圳先进技术研究院 | The display packing of intelligent glasses and device |
| CN106291933A (en) * | 2016-09-06 | 2017-01-04 | 深圳酷酷科技有限公司 | Intelligent glasses wears control method and device |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112991147A (en) * | 2019-12-18 | 2021-06-18 | 北京字节跳动网络技术有限公司 | Image processing method, image processing device, electronic equipment and computer readable storage medium |
| US11651529B2 (en) | 2019-12-18 | 2023-05-16 | Beijing Bytedance Network Technology Co., Ltd. | Image processing method, apparatus, electronic device and computer readable storage medium |
| CN112991147B (en) * | 2019-12-18 | 2023-10-27 | 抖音视界有限公司 | Image processing method, device, electronic equipment and computer readable storage medium |
| CN111308707A (en) * | 2020-01-19 | 2020-06-19 | 惠州Tcl移动通信有限公司 | Picture display adjusting method and device, storage medium and augmented reality display equipment |
| CN111654688A (en) * | 2020-05-29 | 2020-09-11 | 亮风台（上海）信息科技有限公司 | Method and equipment for acquiring target control parameters |
| CN111654688B (en) * | 2020-05-29 | 2022-03-29 | 亮风台（上海）信息科技有限公司 | Method and equipment for acquiring target control parameters |
| CN114442814A (en) * | 2022-03-31 | 2022-05-06 | 灯影科技有限公司 | Cloud desktop display method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108957742B (en) | 2021-09-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104954777B (en) | A kind of method and apparatus showing video data | |
| EP3330771B1 (en) | Display apparatus and method of displaying using focus and context displays | |
| US9961335B2 (en) | Pickup of objects in three-dimensional display | |
| US10048750B2 (en) | Content projection system and content projection method | |
| CN109901710B (en) | Media file processing method and device, storage medium and terminal | |
| CN108957742A (en) | A kind of augmented reality helmet and method for realizing the virtual transparent dynamic regulation of picture | |
| CN104598180B (en) | Display control method, device and near-eye display device | |
| US11126014B2 (en) | Eyewear, eyewear systems and associated methods for enhancing vision | |
| CN106802486A (en) | A kind of method for focusing and head-mounted display | |
| CN105068249A (en) | Holographic intelligent glasses | |
| EP2812748A2 (en) | Image generation systems and image generation methods | |
| US20090059364A1 (en) | Systems and methods for electronic and virtual ocular devices | |
| WO2015035823A1 (en) | Image collection with increased accuracy | |
| CN109803133B (en) | Image processing method and device and display device | |
| CN113419350B (en) | Virtual reality display device, picture presentation method, device and storage medium | |
| US20140085422A1 (en) | Image processing method and device | |
| CN107529052A (en) | One kind auxiliary filming apparatus and stereoscopic shooting method | |
| CN105954883B (en) | A kind of display device and display equipment | |
| CN104216126A (en) | Zooming 3D (third-dimensional) display technique | |
| CN110244837A (en) | Augmented reality and the experience glasses and its imaging method being superimposed with virtual image | |
| JP2012022278A (en) | Video virtual feeling glasses | |
| WO2015007878A1 (en) | A method for determining a visual effect of an ophthalmic lens | |
| CN110325897A (en) | The near-eye display of adjustable range adjustment with extension | |
| CN109151446A (en) | Control method and electronic equipment | |
| CN109151440B (en) | Image positioning device and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |