CN106444333A - Image processing method and device - Google Patents

Image processing method and device Download PDF

Info

Publication number
CN106444333A
CN106444333A CN201611002196.3A CN201611002196A CN106444333A CN 106444333 A CN106444333 A CN 106444333A CN 201611002196 A CN201611002196 A CN 201611002196A CN 106444333 A CN106444333 A CN 106444333A
Authority
CN
China
Prior art keywords
digital hologram
image
hologram
optical information
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN201611002196.3A
Other languages
Chinese (zh)
Inventor
赵超亚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Netease Hangzhou Network Co Ltd
Original Assignee
Netease Hangzhou Network Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netease Hangzhou Network Co Ltd filed Critical Netease Hangzhou Network Co Ltd
Priority to CN201611002196.3A priority Critical patent/CN106444333A/en
Publication of CN106444333A publication Critical patent/CN106444333A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04Processes or apparatus for producing holograms
    • G03H1/0443Digital holography, i.e. recording holograms with digital recording means
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04Processes or apparatus for producing holograms
    • G03H1/08Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0866Digital holographic imaging, i.e. synthesizing holobjects from holograms
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04Processes or apparatus for producing holograms
    • G03H1/08Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0891Processes or apparatus adapted to convert digital holographic data into a hologram
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04Processes or apparatus for producing holograms
    • G03H1/10Processes or apparatus for producing holograms using modulated reference beam

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Holo Graphy (AREA)

Abstract

The invention relates to an image processing method and device. The image processing method comprises the following steps: acquiring three-dimensional information of a virtual object; generating a digital hologram according to the three-dimensional information; generating a left image and a right image which respectively correspond to a left viewpoint and a right viewpoint according to the digital hologram and the first reference light information related to the digital hologram. According to the image processing method and device disclosed by the invention, the problems in the prior art such as extremely high cost of generating the left image and the right image, complicated operation, low transmission efficiency, low operation speed and the like can be solved, so that the cost is reduced, and the selectivity and degrees of freedom of data sources are improved.

Description

Image processing method and device
Technical field
The application is related to a kind of image processing method and device.Preferably, the application be related to a kind of for virtual reality Image procossing treating method and apparatus.
Background technology
Virtual reality technology is the technology of a kind of tool feeling of immersion, interactivity and imagination, one of its interactive mode realized It is exactly three-dimensional stereo display technique.3 D stereo shows position, level and the depth that can comprehensively show image, makes observation Person more intuitively understands the real distribution situation of image, thus more comprehensively understanding image or stereoprojection.
At present, apply in virtual reality is binocular solid technology:The right and left eyes of people are respectively from diverse location and angle Watch during same object in retina of both eyes knot as the small horizontal image position occurring is poor, i.e. horizontal disparity.3D stereo display Ultimate principle seeks to reappear manually parallax, and left-eye image and the eye image will with horizontal disparity are defeated respectively Give the left eye of observer and right eye so that observer can perceive three-dimensional depth, form third dimension.Under this basis Develop 3D stereo display technique miscellaneous, current relative maturity is stereo display based on glasses.
Realize the method flow of one of the prior art of virtual reality as shown in figure 11, it is projected to by virtual video camera On screen, and by virtual video camera view frustums, the human eye ken is modeled.Then the three-dimensional body in view frustums is passed through Perspective projection change is projected on viewport, finally Viewport element is rendered into indicator screen.Obtaining space any point on a left side Under conditions of respective coordinates in right image and two camera parameters matrixes, you can carry out the reconstruction of spatial point, that is, realize being based on The virtual reality of human eye vision principle shows.
The mainstream technology of current virtual reality Stereo display during above-mentioned prior art.Its core is to obtain in three-dimensional scenic Any point meets the left images of human eye demand, and left images are inputted left eye and right eye respectively, thus producing stereoscopic vision Effect.
However, from its technological layer, still there is gap with the 3D effect of observation of nature environment in binocular solid technology. Reason of searching to the bottom is that the main information of needs is only showed by we by the form of left images, and not by scene Full detail be presented in face of human eye.So, there are technology barriers because scene information lacks in traditional method, can only be tight Third dimension is produced it is impossible to present true and comfortable 3-D effect under the conditions of severe.
Secondly, from algorithm and cost, traditional method generally carries out data using plural polyphaser array and adopts Collection, optimizes gatherer process using polyphaser array, and the camera quantity that the method needs is big, high cost, and a large amount of camera Staking-out work complicated.
Finally, from real-time, traditional method necessarily adopts the letter of two or more passages of left images Breath, therefore contains much information, and the memory space of needs is big, and efficiency of transmission is low, thus leading to arithmetic speed slow, system real time difference Problem.Therefore, find a kind of memory space greatly and be easy to data mode raising efficiency of transmission and the arithmetic speed transmitted, strengthen The practicality of system is particularly important.
Content of the invention
For problems of the prior art, the application proposes a kind of image processing method for realizing virtual reality To solve problems of the prior art.
According to the one side of the application, provide a kind of image processing method, including:Obtain the three-dimensional information of object;Root Generate digital hologram according to described three-dimensional information;And according to described digital hologram and related to described digital hologram First generates left image and the right image corresponding respectively to left view point and right viewpoint with reference to optical information.
According to further aspect of the application, provide a kind of image processing apparatus, including:Three-dimensional information acquisition module, uses In the three-dimensional information obtaining object;Hologram generation module, for generating digital hologram according to described three-dimensional information;And it is left Right image generation module, for according to described digital hologram and the related to described digital hologram first reference optical information Generate the left image corresponding respectively to left view point and right viewpoint and right image.
According to further aspect of the application, provide a kind of image processing method, including:Obtain the multigroup three-dimensional letter of object Breath;Digital hologram is generated respectively according to each group in described multigroup three-dimensional information, thus generating digital hologram graphic sequence;With And using the digital hologram being generated graphic sequence and first reference optical information corresponding with digital hologram each described as number It is transmitted according to stream.
According to further aspect of the application, provide a kind of image processing apparatus, including:Three-dimensional information acquisition module, uses In the multigroup three-dimensional information obtaining object;Hologram generation module, for according to each component in described multigroup three-dimensional information Not Sheng Cheng digital hologram, thus generating digital hologram graphic sequence;And sending module, for by the digital hologram being generated Sequence and corresponding with digital hologram each described first is transmitted as data flow with reference to optical information.
According to further aspect of the application, provide a kind of image processing method, including:Obtain data flow, described data Stream include digital hologram graphic sequence and with corresponding first reference of each digital hologram in described digital hologram graphic sequence Optical information;And for each digital hologram in described digital hologram graphic sequence, in conjunction with corresponding described first reference light Information, generates the left image corresponding respectively to left view point and right viewpoint and right image.
According to further aspect of the application, provide a kind of image processing apparatus, including:Acquisition module, for obtaining number According to stream, described data flow include digital hologram sequence and with described digital hologram graphic sequence in each digital hologram pair First answering is with reference to optical information;And image generation module, for complete for each numeral in described digital hologram graphic sequence Breath figure, in conjunction with corresponding described first with reference to optical information, generates the left image corresponding respectively to left view point and right viewpoint and right figure Picture.
By image processing method and the device of the application, can solve the problem that and present in prior art, generate left image and the right side The high cost of image, the problems such as work is complicated, efficiency of transmission is low and arithmetic speed is slow.Thus carrying while reduces cost The high alternative of data source and degree of freedom.
Brief description
Accompanying drawing described herein is used for providing further understanding of the present application, constitutes the part of the application, this Shen Schematic description and description please is used for explaining the application, does not constitute the improper restriction to the application.In the accompanying drawings:
Fig. 1 is the flow chart illustrating the image processing method according to the embodiment of the present application 1;
Fig. 2 is the schematic diagram illustrating the image processing apparatus according to the embodiment of the present application 2;
Fig. 3 is the flow chart illustrating the image processing method according to the embodiment of the present application 3;
Fig. 4 is the schematic diagram illustrating the image processing apparatus according to the embodiment of the present application 4;
Fig. 5 is the flow chart illustrating the image processing method according to the embodiment of the present application 5;
Fig. 6 is the schematic diagram illustrating the image processing apparatus according to the embodiment of the present application 6;
Fig. 7 is the flow chart of the method illustrating the formation stereoscopic vision according to the embodiment of the present application 7;
Fig. 8 (a) to Fig. 8 (d) is the design sketch that the method according to embodiment 7 is described;
Fig. 9 (a) to Fig. 9 (d) is the design sketch that explanation carries out robust detection;
Figure 10 is the schematic diagram according to the application according to hologram reconstruction left image and right image;
Figure 11 is the flow chart according to prior art for the method for simulating reality.
Figure 12 is the schematic flow sheet that the step in Fig. 7 is further illustrated.
Specific embodiment
In order that those skilled in the art more fully understand application scheme, below in conjunction with the embodiment of the present application Accompanying drawing, is clearly and completely described to the technical scheme in the embodiment of the present application it is clear that described embodiment is only The embodiment of the application part, rather than whole embodiments.Based on the embodiment in the application, ordinary skill people The every other embodiment that member is obtained under the premise of not making creative work, all should belong to the model of the application protection Enclose.
It should be noted that term " first " in the description and claims of this application and above-mentioned accompanying drawing, " Two " it is etc. for distinguishing similar object, without for describing specific order or precedence.It should be appreciated that such use Data can exchange in the appropriate case so that embodiments herein described herein can with except here diagram or Order beyond those of description is implemented.Additionally, term " comprising " and " having " and their any deformation are it is intended that cover Cover non-exclusive comprising, for example, contain process, method, system, product or the equipment of series of steps or module or unit not It is necessarily limited to those steps or module or the unit clearly listed, but may include clearly not listing or for these mistakes Journey, method, product or the intrinsic other steps of equipment or module or unit.
Embodiment 1
The flow chart that accompanying drawing 1 shows the image processing method according to embodiment 1, as shown in Figure 1, the method includes:
S102:Obtain the three-dimensional information of virtual objects;
S104:Digital hologram is generated according to described three-dimensional information;And
S106:Generated with reference to optical information according to described digital hologram and related to described digital hologram first and divide Dui Yingyu not the left image of left view point and right viewpoint and right image.
Because embodiment 1 generates corresponding to the left image of left view point and right viewpoint and right image according to digital hologram, because This is in practical operation it is only necessary to reproduce, according to digital hologram, the left images that generation system needs, you can as information source Input virtual reality system, thus reducing camera quantity and camera calibration work, reduces algorithm and cost price.And due to number Word hologram, to record the information of three-dimensional object, therefore can be effectively prevented the disappearance of scene information.
Alternatively, the method also includes respectively this left image and right image being shown.By by this left image and the right side Image is shown, thus left images input user's left eye and right eye respectively, produces stereoscopic visual effect.It should be noted that , the step that left image and right image are shown not is necessary to the application.As content provider, can not The display of left image and right image must be considered, and be only only sent to long-range user.
Alternatively, step S102 obtaining the three-dimensional information of virtual objects includes:Obtain the default note of described virtual objects Record distance;And calculate wavefront function at described preset recording distance for the described virtual objects, wherein, described wavefront function bag Include amplitude information and phase information.Corresponding, included according to step S104 that described three-dimensional information generates digital hologram: Calculated with reference to optical information according to described wavefront function and second and generate described digital hologram.According to the method, using wavefront Function and reference optical information calculate and generate digital hologram, thus the generating process of whole digital hologram is all by calculating Simulated implementation, therefore save the hardware cost generating digital hologram.And due to do not need to introduce actual light source with And imaging device, therefore also make the method be easier to realize.Additionally, in addition to the above method, any virtual right for obtaining The three-dimensional information of elephant, so that the mode generating digital hologram is suitable for the application, can obtain the support of the technical program.
Alternatively, described first reference light information includes reproducing reference with described left view point and the corresponding left view point of right viewpoint Optical information and right viewpoint reproduce with reference to optical information, and wherein, described left view point reproduces reference light information and includes:Simulation from left view point The light that corresponding left reproduction reference light source sends is irradiated to incident angle during described digital hologram, and described right viewpoint reproduces Reference light information includes:The light that simulation sends from right reproduction reference light source corresponding with right viewpoint is irradiated to described digital hologram Incident angle during figure.And described according to described digital hologram and first reference light related to described digital hologram Information generates the left image corresponding respectively to left view point and right viewpoint and right image, including:Reference is reproduced based on described left view point Optical information and right viewpoint reproduce and generate described left image and right image with reference to optical information and described digital hologram.According to the party Method is it is only necessary to be reproduced with reference to optical information with described left view point and the corresponding left view point of right viewpoint based on described generation with reference to optical information Reproduce with reference to optical information with right viewpoint, then based on described left view point reproduce with reference to optical information and right viewpoint reproduce with reference to optical information with And described digital hologram can generate described left image and right image.Due in practical operation, described left view point reference light Information and described right view reference optical information all can produce (for example according to from described left view point and the right side with reference to optical information according to described The light that viewpoint sends is irradiated to angle of incidence during described digital hologram, is generated and described left view with reference to optical information based on described Point and the corresponding left view point of right viewpoint reproduce and reproduce with reference to optical information with reference to optical information and right viewpoint), therefore can be just with Described left image and right image can be generated with reference to optical information and described hologram, therefore decrease the described left image of generation and the right side Data volume needed for image.For the application, in addition to the method, others are used for producing left image and right figure The method of picture is also applied for the technical scheme of the application.
Alternatively, described preset recording distance at least two.And the described virtual objects of described calculating are described default Wavefront function at recording distance, including:Calculate wavefront at each described preset recording distance for the described virtual objects respectively Function, and described wavefront function is overlapped.And described according to described wavefront function and second with reference to optical information calculate Generate described digital hologram, including:Life is calculated with reference to optical information according to the described wavefront function after superposition and described second Become described digital hologram.
Because the wavefront function of three-dimensional object has different preset recording, and apart from d, (different preset recording is apart from d The different layers of correspondence), therefore by three-dimensional object, the wavefront function under different preset recording distance is overlapped, then with ginseng Examine optical information to combine, the process forming hologram just becomes the process of hierarchical information record.And during the reconstruction of hologram, can only correspond to Reproduction under d, can the clearly corresponding reproduction image of reproducing, thus will not produce corresponding interference.
Embodiment 2
Accompanying drawing 2 shows the schematic diagram of the image processing apparatus 200 according to the embodiment of the present application 2.As shown in Fig. 2 this figure As processing meanss 200 include:Three-dimensional information acquisition module 201, for obtaining the three-dimensional information of virtual objects;Hologram generates mould Block 202, for generating digital hologram according to described three-dimensional information;And left images generation module 203, for according to described Digital hologram and related to described digital hologram first corresponds respectively to left view point with reference to optical information generation and the right side regards The left image of point and right image.
With reference to described in embodiment 1, this image processing apparatus can reduce camera quantity and camera calibration work, reduce and calculate Method and cost price, and it is effectively prevented the disappearance of scene information.
Alternatively, described three-dimensional information acquisition module is configured to:Obtain the two dimensional image of described virtual objects, and according to institute State the three-dimensional information that two dimensional image obtains described virtual objects.
Alternatively, also include display module, respectively described left image and right image are shown.Thus by left images Input user's left eye and right eye respectively, produces stereoscopic visual effect.
Alternatively, described three-dimensional information acquisition module includes:Preset recording distance acquiring unit, described virtual for obtaining The preset recording distance of object;And wavefront function calculating unit, for calculate described virtual objects described preset recording away from Wherein, described wavefront function includes amplitude information and phase information to wavefront function from place.And described hologram generation module Including:Hologram computing unit, generates described numeral entirely for calculating with reference to optical information according to described wavefront function and second Breath figure.Because image processing apparatus utilize wavefront function and with reference to optical information calculating generation digital hologram, thus entirely counting The generating process of word hologram is all realized by calculating simulation, therefore saves the hardware cost generating digital hologram. And due to not needing to introduce light source and imaging device, therefore also make the method be easier to realize.
Alternatively, described first reference light information includes reproducing reference with described left view point and the corresponding left view point of right viewpoint Optical information and right viewpoint reproduce with reference to optical information, and wherein, described left view point reproduces reference light information and includes:Simulation from left view point The light that corresponding left reproduction reference light source sends is irradiated to incident angle during described digital hologram, and described right viewpoint reproduces Reference light information includes:The light that simulation sends from right reproduction reference light source corresponding with right viewpoint is irradiated to described digital hologram Incident angle during figure.And described left images generation module includes:Left images signal generating unit, for based on described left view Point reproduces to reproduce with reference to optical information and right viewpoint and generates described left image and right figure with reference to optical information and described digital hologram Picture.Based on this image processing apparatus it is only necessary to be generated corresponding with described left view point and right viewpoint based on described reference optical information Left view point reproduces and reproduces with reference to optical information with reference to optical information and right viewpoint, then is reproduced with reference to optical information and the right side based on described left view point Viewpoint reproduces and can generate described left image and right image with reference to optical information and described digital hologram.Due in practical operation In, described left view point all can produce (for example with reference to optical information according to described with reference to optical information and described right view reference optical information Angle of incidence when light according to sending from described left view point and right viewpoint is irradiated to described digital hologram, based on described reference Optical information is generated to be reproduced with described left view point and the corresponding left view point of right viewpoint and reproduces reference light letter with reference to optical information and right viewpoint Breath), therefore can generate described left image and right image just with reference to optical information and described hologram, therefore reduce Data volume needed for generation described left image and right image.
Alternatively, described preset recording distance at least two.And described wavefront function calculating unit includes:Wavefront letter Number superposition element, calculates wavefront function at each described preset recording distance for the described virtual objects respectively, and to described ripple Front function is overlapped, and described hologram computing unit includes:Digital hologram producing element, after according to superposition Described wavefront function and described second calculates with reference to optical information and generates described digital hologram.Because the ripple of three-dimensional object Front function has different preset recording apart from d (different preset recording is apart from the different layer of d correspondence), therefore by three-dimensional Wavefront function under different preset recording distance for the object is overlapped, then is combined with reference to optical information, forms the mistake of hologram Journey just becomes the process of hierarchical information record.And during the reconstruction of hologram, can only be under corresponding reproduction apart from d, can be clearly The corresponding reproduction image of reproducing, thus will not produce corresponding interference.
Embodiment 3
The flow chart that accompanying drawing 3 shows the image processing method according to embodiment 3, as shown in Figure 3, the method includes:
S302:Obtain multigroup three-dimensional information of virtual objects;
S304:Digital hologram is generated respectively according to each group in described multigroup three-dimensional information, thus it is complete to generate numeral Breath graphic sequence;And
S306:By the digital hologram being generated graphic sequence and first reference light corresponding with digital hologram each described Information is transmitted as data flow.
With the development of network technology, provide virtual reality service will become one by way of remote service and become Gesture, is provided in particular in the video of virtual reality, because virtual reality needs to provide the video of left image and the video of right image, The data volume transmitted therefore certainly will be led to excessive.
According to embodiment 3, form multiple left images on the basis of embodiment 1 such that it is able to form regarding of left images Frequency flows, and considerably reduces the quantity needing transmission, is conducive to provide more quality services.
Embodiment 4
Accompanying drawing 4 shows the schematic diagram of the image processing apparatus 400 according to the embodiment of the present application 4.As shown in figure 4, this figure Picture processing meanss 400, including:Three-dimensional information acquisition module 401, for obtaining multigroup three-dimensional information of virtual objects;Hologram Generation module 402, for generating digital hologram respectively according to each group in described multigroup three-dimensional information, thus generate numeral Holographic graphic sequence;And sending module 403, for by the digital hologram being generated graphic sequence and with digital hologram each described Scheme corresponding first to be transmitted as data flow with reference to optical information.
With reference to described in embodiment 3, form multiple left images on the basis of embodiment 2 such that it is able to form left images Video flowing, considerably reduce need transmission quantity, be conducive to provide more quality services.
Embodiment 5
The flow chart that accompanying drawing 5 shows the image processing method according to embodiments herein 5.As shown in figure 5, described figure As processing method includes:
S502:Obtain data flow, described data flow include digital hologram sequence and with described digital hologram graphic sequence In each digital hologram corresponding first with reference to optical information;And
S504:For each digital hologram in described digital hologram graphic sequence, in conjunction with corresponding described first reference Optical information, generates the left image corresponding respectively to left view point and right viewpoint and right image.
Wherein, embodiment 5 is the image processing method of receiving side corresponding with embodiment 3.
Embodiment 6
The flow chart that accompanying drawing 6 shows the image processing apparatus 600 according to embodiments herein 6, as shown in fig. 6, institute State image processing apparatus to include:
Acquisition module 601, for obtaining data flow, described data flow include digital hologram sequence and with described numeral Each digital hologram in holographic graphic sequence corresponding first is with reference to optical information;And
Image generation module 602, for for each digital hologram in described digital hologram graphic sequence, in conjunction with correspondence Described first with reference to optical information, generate the left image corresponding respectively to left view point and right viewpoint and right image.
Embodiment 7
Fig. 7 shows according to the embodiment of the present application 7 for forming the method flow diagram of stereoscopic vision.
As shown in fig. 7, methods described includes:
S702, obtains three-dimensional object A.It is used for during virtual reality, being shown to the three-dimensional object of user.Wherein, Virtual objects in the present embodiment refer to the three-dimensional object (rather than object of necessary being) producing by calculating simulation, The 3 D stereo object of the human body that for example produced by calculating simulation, object etc..
S704, holographic recording.Carry out holographic recording for described three-dimensional object A and produce digital hologram.For example By Fresnel Diffraction Integral computational methods, (this function includes object light to obtain the wavefront complex amplitude function of three-dimensional object A Amplitude and phase information).Alternatively, the different diffraction distance of the different aspects of described three-dimensional object A (herein, is spread out Penetrate distance with the preset recording described in preceding embodiment apart from corresponding, be statement under different application scene for the same distance) Under wavefront complex amplitude information be overlapped, by superposition wavefront complex amplitude function record in same digital hologram, from And three-dimensional body is carried out being layered with digital holographic recording, complete three-dimensional information and obtain.
S706, reproduces and generates left images.The i.e. viewpoint demand according to virtual reality system, according to from described left view point and The light that right viewpoint sends is irradiated to angle of incidence during described digital hologram, based on the reference light generating described digital hologram Information, generates left images corresponding with all viewpoints, as in information source input virtual reality system.
For ease of understanding, in conjunction with accompanying drawing 12 brief explanation with regard to step S702 to step S706.As described above, three-dimensional empty Intending object A is a three-dimensional object passing through simulation calculating generation, and step S1202 in accompanying drawing 12 corresponds to above-mentioned steps Step S1204 in S702, Figure 12 and S1206 correspond to above-mentioned step 704, and step S1208 in Figure 12 corresponds to Above-mentioned steps S706.As shown in figure 12, in step S1202, calculate the three-dimensional void producing with regard to car by computer C simulation Intend object A, including the data such as coordinate (x, y, z) of each point of three-dimensional object A.In order to by three-dimensional object A Present to user to form the scene of virtual reality, need to generate the left image of display three-dimensional object A and right image to divide It is not shown to left eye and the right eye of user.In order to obtain above-mentioned left image and right image, in step S1204, computer C is directed to three Dimension virtual objects A calculates its wavefront complex amplitude function at diffraction distance by Fresnel Diffraction Integral computational methods, i.e. mould Intend being derived from wavefront complex amplitude function at diffraction distance for the object light of three-dimensional object A, wherein this wavefront complex amplitude function bag Amplitude containing this object light and phase information.Optionally, because three-dimensional object A is three-dimensional, therefore for its different layer Face, can calculate wavefront complex amplitude function respectively and be overlapped according to the diffraction distance of different aspects.Then in step S1206, computer C, according to the wavefront complex amplitude function of the three-dimensional object A being obtained, calculate and obtain digital hologram.And And in step S1208, computer C calculates according to this digital hologram and obtains left image and the right image carrying out virtual reality.Its In, the generation with regard to digital hologram and left image and right image and calculating, carry out in detail further in connection with accompanying drawing 8-10 Explanation.Although it should be noted that for the purpose of simplifying the description, said process is all completed by identical computer C, basis Specific practical situation, can be respectively completed each above-mentioned step by different computing devices.Continue with and introduce accompanying drawing 7 In step.
S708, updates left and right input data using newly-generated left images.
S710, carries out the split screen display available of left and right picture using the left and right input data after updating.
S712, is filtered so that left eye picture can only be seen by left eye to the picture of right and left eyes respectively using display device To and described right eye picture can only be seen by right eye.
S714, user forms the vision of solid after seeing described right and left eyes picture.
Alternatively, embodiment 7 also includes hologram is carried out with the flow process of robust detection, specifically, in holographic recording (step Rapid S704) after, in step S716, robust sexual assault is carried out to the digital hologram generating, for example, hologram is carried out cutting, Compression and applying noise etc. are processed.And in step S718, the hologram after carrying out robust sexual assault is reproduced, to enter Row robustness judges.Thus after robust detection, in step S706, reproducing the left images generating.
With reference to the design sketch in Fig. 8, to illustrate three-dimensional object A is carried out holographic recording and ultimately generates a left side Image and the process of right image.
First, obtain three-dimensional object A in step S702, such as shown in Fig. 8 (a).Wherein Fig. 8 (a) shows with regard to three The image of dimension virtual objects A (i.e. teddy bear).And wherein, image size is 360 × 300, observed range (herein, observation Distance is table under different application scene for the same distance with foregoing diffraction distance and preset recording apart from corresponding State) it is z.
Then, carry out holographic recording in step S704, that is, pass through fresnel diffraction integration method, calculate three-dimensional pair As A is in the wavefront function O of observed range z (i.e. teddy bear image is to the distance of holographic plan)Z, including amplitude and phase place letter Breath.That is, teddy bear image is entered with the fresnel diffraction integration computing that row distance is z, and according to predetermined reference optical information, simulates It is calculated hologram with reference to interference of light, thus completing the record of three-dimensional information.Wherein, Fig. 8 (b) show setting from When the object light of virtual objects A reflection is 30 ° with the angle of reference light, calculate the off-axis hologram generating.
Then reproduce in step S706 and generate left images, the light being sent from described left view point and right viewpoint according to simulation Be irradiated to angle of incidence during described digital hologram, based on generate described digital hologram reference optical information, calculate generate and The corresponding left images of all viewpoints.Wherein Fig. 8 (c) is that analog references light is with respect to hologram according to hologram Fig. 8 (b) Angle of incidence is the left image corresponding with left view point reproducing when 15 °, reproduces apart from z=500mm (i.e. from left view point to hologram Distance, identical with above-mentioned observed range size), size is 360 × 300.Fig. 8 (d) is according to hologram Fig. 8 (b), analog references Light with respect to the angle of incidence of hologram be reproducing when 45 ° with right viewpoint correspondence image, reproduce and (regard from the right side apart from z=500mm Point is to the distance of hologram, identical with above-mentioned observed range size), size is 360 × 300.
And then in step S708, using left images Fig. 8 (c) generating and Fig. 8 (d), update left and right input data, and Step S710 carries out the split screen display available of left and right picture using the left and right input data after updating.And finally formed in step S714 vertical Body vision.
With reference to the design sketch in Fig. 9, the robust detection that hologram is carried out is described.
Wherein Fig. 9 (a) is that holographic Fig. 9 (b) is carried out with the hologram after circular shearing attack.Fig. 9 (b) be using cutting after Hologram reconstruction image, it is analog references light is the image reproducing when 30 ° with respect to the angle of incidence of hologram, therein Reproduce apart from z=500mm;And Fig. 9 (c) is according to hologram Fig. 9 (a), analog references light with respect to the angle of incidence of hologram is The left image corresponding with left view point reproducing when 15 °, reproduces apart from z=500mm.Fig. 9 (d) is according to hologram Fig. 9 (a), mould Intend reference light with respect to the angle of incidence of hologram be reproducing when 45 ° with right viewpoint correspondence image, reproduce apart from z=500mm.
According to Fig. 9 as can be seen that the present processes have extraordinary robustness.
Generate hologram and the specific algorithm and the principle that reproduce left images
The specific algorithm for generating hologram and reproduction left images of explanation the application and principle below, and with The method for generating hologram and reproduction left images of lower record is relevant be applied to above any one embodiment The operation generating hologram and reproducing left images.
Algorithm and principle
Specifically, algorithm and principle one are to calculate the wavefront complex amplitude letter of three-dimensional object by Fresnel Diffraction Integral Number, generates hologram using the method for wavefront information superposition, specific as follows:
Step 1) calculate complex amplitude before the Object light wave of the object light of three-dimensional object reflection
It is possible, firstly, to calculating diffraction distance by following (formula 1) is complex amplitude function before the Object light wave of d:
Wherein, d is diffraction distance, (x0,y0) on starting material popin face with coordinate x0And y0Corresponding, O (x0,y0) be Starting material popin surface information function, U (x, y) is complex amplitude function before diffraction distance is for the Object light wave of d, and λ is the ripple of object light Long, j is imaginary unit, and k is wave number, x0、y0For original object plane coordinate, x, y are the wavefront function through diffraction apart from d diffraction Plane coordinates.
Then, (formula 1) is integrated processing, the item unrelated with integration variable is mentioned before the sign of integration, obtains (formula 2):
As can be seen that (formula 2) is right from above-mentioned (formula 2)It has been a Fourier to become Change, then, transformation results are multiplied by a quadratic phase factor, that is, againWith regard to permissible Obtain through complex amplitude before Object light wave after d diffraction for the diffraction.In order to calculate above formula using fast fourier transform FFT, can Fourier transform is represented with F, object plane sampling width is L0, hits is N × N, and sampling interval is Δ x0=Δ y0=L0/ N, Then, above-mentioned (formula 2) is rewritten as (formula 3), that is,:
In (formula 3), Δ x=Δ y is corresponding Space domain sampling spacing after discrete Fourier transform (DFT), now, according to Fu Vertical leaf transformation and the relation of discrete Fourier transform (DFT), can obtain (formula 4):Wherein, in (formula 4), L is Through diffraction apart from d diffraction pattern sample range.(formula 4) is entered line translation and obtains (formula 5):
On the other hand, according to nyquist sampling theorem, meet (formula 6) when only having:Retouched During the condition stated, discrete calculation result could approximately meet the diffractional field of nyquist sampling theorem.Now, object plane and diffraction The sampling width of field plane is equal, and from (formula 5), now object plane and diffractional field width are equal, that is,
Therefore, result above shows, if keeping the sampling interval of object plane and observation area constant, discrete Fourier becomes Change diffraction pattern on plane of vision for the result of calculation and sample range L and be not only wavelength X and the function of sampling number N, and can be with Diffraction increases apart from the increase of d.When diffraction is apart from very little, if sampling number N keeps constant, result of calculation can only correspond to The diffraction image in neighbouring optical axis very little region on plane of vision.
Step 2) holographic production is carried out to three-dimensional object A according to principle of holography, that is, simulate by reference to interference of light thing Light wavefront complex amplitude U (x, y), obtains objective holographic figure IH(x, y), IH(x, y) contains the three-dimensional information (amplification of virtual objects And phase information).In the embodiment of the present application, objective holographic figure can be calculated by following (formula 7),Wherein, R (x, y) table Show reference light, U (x, y) represents complex amplitude function (that is, above-mentioned wavefront information), R before the Object light wave of diffraction*(x, y) represents Reference light is conjugated, and U* (x, y) represents complex amplitude function conjugation before Object light wave.
Step 3) according to the viewpoint demand of virtual reality system, generate and left view point and the corresponding left image of right viewpoint and the right side Image.Simulate different reference angles of light (i.e. the angle of the normal of incident reference light and hologram), hologram is entered Row reproduces.When reference light is R (x, y), Fresnel hologram is IHWhen (x, y), the optical field distribution of reproduction is:
Formula 8) in, F is function Fourier transform symbol, and d is diffraction distance, and λ is wavelength, and j is imaginary unit, and k is wave number, (x, y) is the hologram plane coordinates through diffraction apart from the wavefront function generation of d diffraction, and (x ', y ') is to shine through reference light Penetrate the reproduction image plane coordinates of hologram generation, (Δ x ', Δ y ') corresponds to Space domain sampling spacing.Below, shown in refer to the attached drawing 10 To step 3) make and illustrating.
First, the visual field scope of human eye is 30 degree to 100 degree, during the reconstruction of hologram, is selected according to human eye visual field scope Meet the left view point of system requirements and right viewpoint, and reproduce with left view point and the corresponding left view point of right viewpoint according to reference to light settings Reference light and right viewpoint reproduce reference light.For example, reproduce reference light incident angle when setting reproduction as α, then reproduce reference light Expression formula is changed into R (x, y) exp (jkxsin α).According to formula (8), secondary reproduction reference light expression formula is substituted in formula (8):
By formula (9) as can be seen that incident angle has affected only the phase information of reconstruction results.Therefore, two are selected Different incident angle α, that is, select the reproduction reference light of two out of phase information, thus in the viewpoint of corresponding left and right, then Now generate the left images that system needs.
Above-mentioned the embodiment of the present application sequence number is for illustration only, does not represent the quality of embodiment.
In above-described embodiment of the application, the description to each embodiment all emphasizes particularly on different fields, and does not have in certain embodiment The part describing in detail, may refer to the associated description of other embodiment.
It should be understood that disclosed technology contents in several embodiments provided herein, can pass through other Mode is realized.Wherein, device embodiment described above is only the schematically division of for example described unit or module, It is only a kind of division of logic function, actual can have other dividing mode when realizing, for example multiple units or module or group Part can in conjunction with or be desirably integrated into another system, or some features can be ignored, or does not execute.Another, shown Or the coupling each other that discusses or direct-coupling or communication connection can be by some interfaces, module or unit indirect Coupling or communication connection, can be electrical or other forms.
The described unit illustrating as separating component or module can be or may not be physically separate, as The part that unit or module show can be or may not be physical location or module, you can with positioned at a place, or Person can also be distributed in multiple NEs or module.Some or all of list therein can be selected according to the actual needs Unit or module are realizing the purpose of this embodiment scheme.
In addition, each functional unit in each embodiment of the application or module can be integrated in a processing unit or mould In block or unit or module is individually physically present it is also possible to two or more units or module are integrated in In one unit or module.Above-mentioned integrated unit or module both can be to be realized in the form of hardware, it would however also be possible to employ software The form of functional unit or module is realized.
If described integrated unit is realized and as independent production marketing or use using in the form of SFU software functional unit When, can be stored in a computer read/write memory medium.Based on such understanding, the technical scheme of the application is substantially The part in other words prior art being contributed or all or part of this technical scheme can be in the form of software products Embody, this computer software product is stored in a storage medium, including some instructions with so that a computer Equipment (can be personal computer, server or network equipment etc.) execution each embodiment methods described of the application whole or Part steps.And aforesaid storage medium includes:USB flash disk, read only memory (ROM, Read-Only Memory), random access memory are deposited Reservoir (RAM, Random Access Memory), portable hard drive, magnetic disc or CD etc. are various can be with store program codes Medium.
The above is only the preferred implementation of the application it is noted that ordinary skill people for the art For member, on the premise of without departing from the application principle, some improvements and modifications can also be made, these improvements and modifications also should It is considered as the protection domain of the application.

Claims (14)

1. a kind of image processing method is it is characterised in that include:
Obtain the three-dimensional information of virtual objects;
Digital hologram is generated according to described three-dimensional information;And
Generated with reference to optical information according to described digital hologram and related to described digital hologram first and correspond respectively to The left image of left view point and right viewpoint and right image.
2. method according to claim 1 is it is characterised in that also include respectively described left image and right image being shown Show.
3. method according to claim 1 is it is characterised in that the three-dimensional information of described acquisition virtual objects, including:
Obtain the preset recording distance of described virtual objects;And
Calculate wavefront function at described preset recording distance for the described virtual objects, wherein, described wavefront function includes amplitude Information and phase information, and
Described according to described three-dimensional information generate digital hologram, including:
Calculated with reference to optical information according to described wavefront function and second and generate described digital hologram.
4. method according to claim 3 it is characterised in that described first reference light information include with described left view point and The right corresponding left view point reproduction reference optical information of viewpoint and right viewpoint reproduce with reference to optical information, and wherein, described left view point reproduces joins Examine optical information to include:The light that simulation sends from left reproduction reference light source corresponding with left view point is irradiated to described digital hologram When incident angle, described right viewpoint reproduces reference light information and includes:Simulation is from right reproduction reference light source corresponding with right viewpoint The light sending is irradiated to incident angle during described digital hologram, and
Described right respectively with reference to optical information generation according to described digital hologram and related to described digital hologram first Should in the left image of left view point and right viewpoint and right image, including:Reproduced with reference to optical information and right viewpoint based on described left view point Reproduce and generate described left image and right image with reference to optical information and described digital hologram.
5. method according to claim 3 is it is characterised in that described preset recording distance at least two, and
Described calculating wavefront function at described preset recording distance for the described virtual objects, including:
Calculate wavefront function at each described preset recording distance for the described virtual objects respectively, and to described wavefront function It is overlapped;And
Described calculating with reference to optical information according to described wavefront function and second generates described digital hologram, including:
Calculated with reference to optical information according to the described wavefront function after superposition and described second and generate described digital hologram.
6. a kind of image processing apparatus are it is characterised in that include:
Three-dimensional information acquisition module, for obtaining the three-dimensional information of virtual objects;
Hologram generation module, for generating digital hologram according to described three-dimensional information;And
Left images generation module, for according to described digital hologram and first reference related to described digital hologram Optical information generates the left image corresponding respectively to left view point and right viewpoint and right image.
7. image processing apparatus according to claim 6 are it is characterised in that also include:
Display module, for showing to described left image and right image respectively.
8. image processing apparatus according to claim 6 it is characterised in that
Described three-dimensional information acquisition module includes:
Preset recording distance acquiring unit, for obtaining the preset recording distance of described virtual objects;And
Wavefront function calculating unit, for calculating wavefront function at described preset recording distance for the described virtual objects, wherein, Described wavefront function includes amplitude information and phase information, and
Described hologram generation module includes:
Hologram computing unit, generates described digital hologram for calculating with reference to optical information according to described wavefront function and second Figure.
9. image processing apparatus according to claim 8 it is characterised in that described first reference light information include with described Left view point and the corresponding left view point of right viewpoint reproduce and reproduce with reference to optical information, wherein, described left view with reference to optical information and right viewpoint Point reproduces reference light information and includes:The light that simulation sends from left reproduction reference light source corresponding with left view point is irradiated to described number Incident angle during word hologram, described right viewpoint reproduces reference light information and includes:Simulation is from right reproduction corresponding with right viewpoint The light that reference light source sends is irradiated to incident angle during described digital hologram, and described left images generation module bag Include:
Left images signal generating unit, for based on described left view point reproduce with reference to optical information and right viewpoint reproduce with reference to optical information with And described digital hologram generates described left image and right image.
10. image processing apparatus according to claim 8 are it is characterised in that described preset recording distance at least two, And
Described wavefront function calculating unit includes:
Wavefront function superposition element, calculates wavefront function at each described preset recording distance for the described virtual objects respectively, And described wavefront function is overlapped, and
Described hologram computing unit includes:
Digital hologram producing element, for calculating with reference to optical information according to the described wavefront function after superposition and described second Generate described digital hologram.
A kind of 11. image processing methods are it is characterised in that include:
Obtain multigroup three-dimensional information of virtual objects;
Digital hologram is generated respectively according to each group in described multigroup three-dimensional information, thus generating digital hologram graphic sequence; And
Using the digital hologram being generated graphic sequence and corresponding with digital hologram each described first with reference to optical information as Data flow is transmitted.
A kind of 12. image processing apparatus are it is characterised in that include:
Three-dimensional information acquisition module, for obtaining multigroup three-dimensional information of virtual objects;
Hologram generation module, for digital hologram is generated respectively according to each group in described multigroup three-dimensional information, thus Generate digital hologram graphic sequence;And
Sending module, for joining the digital hologram being generated graphic sequence and corresponding with digital hologram each described first Examine optical information to be transmitted as data flow.
A kind of 13. image processing methods are it is characterised in that include:
Obtain data flow, described data flow include digital hologram sequence and with described digital hologram graphic sequence in every number Word hologram corresponding first is with reference to optical information;And
For each digital hologram in described digital hologram graphic sequence, in conjunction with corresponding described first with reference to optical information, raw Become to correspond respectively to left image and the right image of left view point and right viewpoint.
A kind of 14. image processing apparatus are it is characterised in that include:
Acquisition module, for obtaining data flow, described data flow include digital hologram sequence and with described digital hologram Each digital hologram in sequence corresponding first is with reference to optical information;And
Image generation module, for for each digital hologram in described digital hologram graphic sequence, in conjunction with corresponding described First, with reference to optical information, generates the left image corresponding respectively to left view point and right viewpoint and right image.
CN201611002196.3A 2016-11-11 2016-11-11 Image processing method and device Withdrawn CN106444333A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611002196.3A CN106444333A (en) 2016-11-11 2016-11-11 Image processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611002196.3A CN106444333A (en) 2016-11-11 2016-11-11 Image processing method and device

Publications (1)

Publication Number Publication Date
CN106444333A true CN106444333A (en) 2017-02-22

Family

ID=58207057

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611002196.3A Withdrawn CN106444333A (en) 2016-11-11 2016-11-11 Image processing method and device

Country Status (1)

Country Link
CN (1) CN106444333A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108508727A (en) * 2017-05-18 2018-09-07 苏州纯青智能科技有限公司 A kind of digital implementation of three-dimensional hologram

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101014911A (en) * 2004-09-08 2007-08-08 视瑞尔技术公司 Method and device for encoding and reconstructing computer-generated video holograms
CN101088052A (en) * 2004-12-23 2007-12-12 视瑞尔技术公司 Method and device for computing computer-generated video holograms
CN104661012A (en) * 2014-11-28 2015-05-27 深圳市亿思达科技集团有限公司 Individual holographic three-dimensional display method and equipment

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101014911A (en) * 2004-09-08 2007-08-08 视瑞尔技术公司 Method and device for encoding and reconstructing computer-generated video holograms
CN101088052A (en) * 2004-12-23 2007-12-12 视瑞尔技术公司 Method and device for computing computer-generated video holograms
CN104661012A (en) * 2014-11-28 2015-05-27 深圳市亿思达科技集团有限公司 Individual holographic three-dimensional display method and equipment

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
葛宝臻; 罗文国; 吕且妮; 赵慧影; 张以谟: "数字再现三维物体菲涅耳计算全息的研究", 《光电子·激光》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108508727A (en) * 2017-05-18 2018-09-07 苏州纯青智能科技有限公司 A kind of digital implementation of three-dimensional hologram

Similar Documents

Publication Publication Date Title
US9684994B2 (en) Modifying perspective of stereoscopic images based on changes in user viewpoint
US7907167B2 (en) Three dimensional horizontal perspective workstation
KR100837365B1 (en) Method for generating and reconstructing computer generated hologram using look-up table and apparatus thereof
US20050275913A1 (en) Binaural horizontal perspective hands-on simulator
US20060126925A1 (en) Horizontal perspective representation
US20050219694A1 (en) Horizontal perspective display
US20110216160A1 (en) System and method for creating pseudo holographic displays on viewer position aware devices
JP2006325165A (en) Device, program and method for generating telop
CN108520510B (en) No-reference stereo image quality evaluation method based on overall and local analysis
WO2003036993A1 (en) Projection of three-dimensional images
CN104021587A (en) Large-scale scene true three-dimension display rapid generation method based on computer generated hologram technology
CN107071392A (en) Image processing method and device
CN108881886A (en) A method of it is realized based on camera Matrix Technology and carries out the lossless interactive application of big data in display end
KR20100111176A (en) Method for generating computer generated hologram using look-up table and spatial redundancy, and apparatus thereof
KR20120118621A (en) Hologram recording device and hologram display
CN106444333A (en) Image processing method and device
CN103871094A (en) Swept-volume-based three-dimensional display system data source generating method
EP4030752A1 (en) Image generation system and method
CN106296827A (en) Image processing method and device
CA2252063C (en) System and method for generating stereoscopic image data
Lacey Geometric modeling with image plane integral (IPI) holography
Thatte Cinematic virtual reality with head-motion parallax
JP2012008213A (en) Calculation and reproduction method of computer-synthesized hologram using lookup table, and apparatus thereof

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication

Application publication date: 20170222

WW01 Invention patent application withdrawn after publication