CN108234986B - For treating the 3D rendering management method and management system and device of myopia or amblyopia - Google Patents

For treating the 3D rendering management method and management system and device of myopia or amblyopia Download PDF

Info

Publication number
CN108234986B
CN108234986B CN201810054258.8A CN201810054258A CN108234986B CN 108234986 B CN108234986 B CN 108234986B CN 201810054258 A CN201810054258 A CN 201810054258A CN 108234986 B CN108234986 B CN 108234986B
Authority
CN
China
Prior art keywords
image
rendering
parameter
amblyopia
eyes
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810054258.8A
Other languages
Chinese (zh)
Other versions
CN108234986A (en
Inventor
姚惜珺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201810054258.8A priority Critical patent/CN108234986B/en
Publication of CN108234986A publication Critical patent/CN108234986A/en
Application granted granted Critical
Publication of CN108234986B publication Critical patent/CN108234986B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/04Indexing scheme for image data processing or generation, in general involving 3D image data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/41Medical

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The present invention provides it is a kind of for treat myopia or amblyopia 3D rendering management method, first by 2D image be converted into can dynamic change 3D rendering;Then 3D rendering includes left view difference image and right anaglyph, respectively corresponds the left eye and right eye of human body, and wherein left eye can only see left view difference image, and right eye can only see right anaglyph;In terminal plays, the parameter of left view difference image and right anaglyph can individually be adjusted the 3D rendering according to the needs of users, and the parameter regulation of one of image does not influence the parameter of another image.Terminal processing method of the invention makes the system for the treatment of myopia or amblyopia no longer need to remake special video;It is designed to that the parameter of all or part of picture of left and right screen is individually adjusted; have no effect on the parameter of another picture; space, more efficient treatment amblyopia eye can be more fully selected to doctor, while the eyes of another health being protected sufficiently to be taken exercise and protected.

Description

For treating the 3D rendering management method and management system and device of myopia or amblyopia
Technical field
The invention belongs to digital processings and medical field, are related to a kind of for treating the 3D rendering manager of myopia or amblyopia Method and management system and device.
Background technique
VR (Virtual Reality, virtual reality) technology can show virtual scene by equipment before user, Including vision, the sense of hearing, interaction etc. etc..Wherein vision is to currently form the most important factor of virtual sense organ, existing VR equipment Using human body binocular stereo vision, the different images for seeing two eyes of user, to just generate three-dimensional sense by parallax 3D scene.This characteristic can be used for the various fields including medical application.
Currently, the content Forming Mechanism of VR equipment is complicated, lazy weight is presented in the content for causing VR equipment that can show, can not The problems such as customization.
The existing method for forming VR equipment vision content is as follows:
By manually modeling or edit 3D scene, then 3D image recording is carried out, it is specific virtual existing to be provided for VR equipment Real content.First pass through artificial 3D modeling, recycle computer graphics calculate to be formed fixed parallax double screen content it is direct It is supplied to VR equipment.The method, the cost of labor for constructing scene is very high, and the scale of content quantity is caused not expanded effectively Exhibition.On the other hand, since the virtual scene of formation is recorded in advance, the virtual scene can not being customized change and more Newly.
By introducing 2D multimedia resource (image and video), 2D resource and artificial constructed 3D scene are combined, It recycles and calculates to achieve the purpose that 2D media can be shown under fixed 3D virtual scene.2D resource is fixed on specific 3D Under virtual scene, reaches 2D resource and be present in the pseudo- 3D visual effect in 3D virtual scene, formed by computer disparity computation Family can be used to adjust different visual angle viewing 2D resource contents for double screen content.This method can be effectively more by existing a large amount of 2D Media resource forms virtual scene content, but position of the 2D resource under 3D scene be fixation can not dynamic regulation, cannot Change 2D resource content dynamically in 3D scene.As a result, content show be also can not being customized change, thus very greatly Degree loses the characteristic that can configure, can be interacted of VR content.
Although and there is 2D resource to be converted into 3D resource in the prior art now, be the absence of 3D rendering required for treating Mapping function, such as translation, overturning, the scaling of image etc., therefore can not be well using existing in the treatment of myopia or amblyopia The 2D resource of some other fields.
Amblyopia is the common eye diseases in children of clinical ophthalmology, is infant period, due to various reasons such as consciousness, movement, biography It leads and the reasons such as visual center fails to receive suitable view stimulation, so that visual development is affected and the visual performance decline that occurs State is mainly shown as low vision and binocular vision obstacle.
Treating the common treatment method of amblyopia is covering method, is divided into complete and part overlaid.Purpose is to cover strong eye, It forces amblyopia eye fixation and carries out fine work.However covering method frequently can lead to the healthy eyes of amblyopia opposite side due to for a long time Covering amblyopia occurs and influences the stereopsis and fusion function of eyes.
Conventional images processing method is the processing carried out for single image, does not have and is directed to eyes feature for same image Processing is the different degrees of function of showing content, it is thus impossible to be applied under the different VR application scenarios of eyes physiological parameter.
On the other hand, traditional images processing method does not have the characteristics of continuously adjusting image processing effect of parametrization, because This does not adapt to the different fine-tuning capabilities under the conditions of eye, to cannot be efficiently applied to use eye medical field.
Summary of the invention
The object of the present invention is to provide being 3D entity in 3D scene by 2D resource conversion, and by computer graphics 3D conversion is allowed to can dynamically change (including displacement, rotation, scaling) in position in 3D scene, and using dichoptic viewing Three-dimensional imaging mode is made, at the same eyes depending on image parameter individually adjust, with reach be directed to patient individual instances Effectively treatment amblyopia, protects the purpose of eyes.
To achieve the above object, the present invention takes following technical proposals to realize:
For treating the management method of the 3D rendering of myopia or amblyopia, comprising: converting 2D image to can dynamically become first The 3D rendering of change;Then 3D rendering includes left view difference image and right anaglyph, respectively corresponds the left eye and right eye of human body, wherein Left eye can only see left view difference image, and right eye can only see right anaglyph;
The 3D rendering in terminal plays, according to the needs of users may be used by the parameter of left view difference image and right anaglyph To be individually adjusted, the parameter regulation of one of image does not influence the parameter of another image;
Wherein 2D image be converted into can dynamic change 3D rendering method are as follows: to 2D image carry out image contract, will take out It takes result to be placed in 3D coordinate system by texture mapping operation, motion process is then carried out in 3D coordinate system and rendering is realized and moved State variation, first progress 3D coordinate conversion, which calculates to be formed by projection calculating again, carries out 2D image projection;By calculating parallax in real time, The multimedia content of 2D image is incorporated into 3D scene by way of movable plane, makes it can be in 3D virtual scene according to pre- Determine the dynamic change that mode carries out 3D rendering.
Further, the dynamic change of 3D rendering is one of translation, rotation, overturning or scaling of image or a variety of.
Further, the 2D image be converted into can dynamic change 3D rendering method the following steps are included:
Step a carries out image contract to 2D image;
Step b chooses required 3D virtual scene;
Step c constructs 2D the resource plane in 3D virtual scene, and constructs the first of place coordinate system for its 2D the resource plane Beginning position, angle and size;
Step d constructs the intrinsic coordinates system of 2D the resource plane, by parsing the feature of 2D resource image, carries out coordinate and reflects Calculating is penetrated, converts 2D resource image to the textures of 2D the resource plane;
2D multimedia content is incorporated 3D scene by calculating parallax in real time by step e by way of movable plane, It is allowed to that configurable 3D figure conversion can be carried out.
Further, in step e, 2D resource entity is converted in 3D scene by configurable variation pattern, is counted Calculation process is as follows:
Obtain plane initial coordinate matrix and current coordinate conversion conversion coordinates matrix;
Configured plane motion track is obtained, and calculates the transition matrix of current generation, and is allowed to smooth;
The coordinate that the resource plane is carried out under 3D scene calculates, to obtain the coordinate of the resource plane under next frame, and again Calculate the reflecting effect of light;
Current eyes are calculated in virtual scene by the motion sensor data of VR equipment and the configuration data of equipment Position and visual angle;
It is calculated under next frame including 2D content by the resource plane position of next frame and the virtual location of eyes The projection relation of all objects under 3D scene forms the double screen with parallax effect.
Further, the parameter of the left view difference image and right anaglyph be left view difference image and right anaglyph all or The size of part picture, brightness, gray scale, saturation degree, one of contrast or a variety of.
Further, the parameter of the left view difference image and right anaglyph part picture immobilizes, and when adjusting only changes The parameter of setting section.
Further, the method for independent adjustment parameter is that configurable content shelter is carried out according to right and left eyes parameter setting Reason, comprising the following steps:
The screen of VR equipment eyes is obtained, and is translated into image
Content is subjected to left and right split screen, and configurable content masking is carried out according to right and left eyes parameter and is handled.
For right and left eyes parameter configuration, color, light and shade, the independent process of contrast can be carried out to right and left eyes image.
For right and left eyes parameter configuration, the independent process of image size can be carried out to right and left eyes image.
Export right and left eyes image.
Further, the step of configurable content masking processing being carried out according to right and left eyes parameter are as follows:
Step 1, the content that copies picture is two parts of right and left eyes;
Step 2, right and left eyes parameter is mapped to masking percentage P1, the P2 of the two parts of contents in left and right, wherein eyes cover The sum of content P1+P2 < 100%;
Step 3, picture pixels summation X is obtained, the unit-sized of mosaic is calculated according to configuration, m*n pixel square is one A fundamental unit;
Step 4, Y fundamental unit is selected at random as mosaic square, makes the total pixel Y*m*n=X* (P1+ of mosaic P2);
Step 5, the image that masking square will be chosen to be randomly assigned to left and right eyes in proportion according to P1:P2 value.
The present invention also provides a kind of for treating the 3D rendering management system of myopia or amblyopia, including image extraction module, Computing module, 3D processing module, parameter adjustment module and VR equipment;Wherein image extraction module carries out image pumping to 2D image It takes, computing module first carries out the conversion of 3D coordinate and calculates, by calculating parallax in real time, using 3D processing module by more matchmakers of 2D image Hold in vivo and incorporate 3D scene by way of movable plane, make its can in the 3D virtual scene of VR equipment according to predetermined way into The dynamic change of row 3D rendering;Parameter adjustment module is by carrying out configurable content shelter according to right and left eyes parameter setting Reason realizes the independent adjusting of the parameter of left view difference image and right anaglyph.
The present invention also provides a kind of device for treating amblyopia, described device includes wearable device, is equipped in the equipment The above-mentioned 3D rendering management system for being used to treat myopia or amblyopia.
Compared with prior art, the invention has the following advantages that
2D multimedia content is incorporated 3D scene by the present invention by way of movable plane, to realize that quick VR content produces It is raw;
By using the real-time method for calculating parallax, 2D multimedia content is incorporated 3D by way of movable plane Scape is allowed to that configurable 3D graphics conversion can be carried out, i.e., multimedia content can carry out in virtual scene according to predetermined way Translation, rotation, overturning, scaling etc. change;
The calculation method for carrying out 2D projection again by first carrying out the conversion calculating of 3D coordinate, under the support of equipment computing capability The dynamic optical oomputing that can carry out virtual scene can make the movement of 2D multimedia content more true under virtual scene.
3D rendering of the invention parameter adjusting method of the invention is designed to left and right screen according to the own characteristic of amblyopia patient Size, brightness, gray scale, color saturation and contrast of all or part of picture of curtain etc. are individually adjusted, and are had no effect on another The parameter of a picture can more fully select space to doctor, the case where for individual patients, more efficient treatment amblyopia Eye, while the eyes of another health being protected sufficiently to be taken exercise and protected.
Specifically, the present invention can independently carry out the processing of content for binocular vision, using a variety of crippled modes in conjunction with next Form the medical procedure of customizable;Various reduction processes, which are realized, all can carry out continuously linear adjustment by eyes parameter, can press Medical progress is finely adjusted adaptation.
By watching 3D rendering of the invention, can take exercise children with amblyopia it is fixed as, position, identify, following, searching etc. it is related Aspect technical ability.Under the support of body-sensing interaction technique, making children with amblyopia association inspection operation by training, (movement, eye, brain are assisted Adjust), visual skill is grasped, eye impressions are established, forms visual memory, cerebral cortex optic element is promoted and influence is processed Journey, to promote the raising of their vision operational capability.
Specific embodiment
The present invention will be described in detail combined with specific embodiments below.
In one embodiment of the invention, common 2D resource is converted into 3D resource, the specific steps are as follows:
Image contract is carried out to 2D resource (especially video) in VR software systems;
VR software systems, which import, chooses 3D virtual scene;2D the resource plane is constructed in 3D virtual scene, and (size is suitable In plane), and be its building where coordinate system initial position, angle and size;
The intrinsic coordinates system for constructing 2D the resource plane carries out coordinate mapping calculation by the feature of parsing 2D resource image, Convert 2D resource image to the textures of 2D the resource plane;
2D resource entity can be converted in 3D scene by configurable variation pattern, and calculating process is as follows:
Obtain plane initial coordinate matrix and current conversion coordinates matrix;
Plane initial coordinate be the time started be 0 when coordinate;
Calculate the transition matrix in each stage;
Transition matrix is from time point 0 (at the beginning of definition) to displacement, the rotation in current point in time this period The summation of equal operations, the coordinate of initial coordinate * transition matrix=current.
With regard in one embodiment of the invention if video has 100 frames, that if each frame carry out a location updating if, 99 location updatings are just had, also just there are 99 transition matrixes.
Configured plane motion track is obtained, and calculates the transition matrix of current generation, and is allowed to smooth;
For example, being at the uniform velocity moved to bottom right from upper left " such it is intended to become 99 transition matrixes (each to indicate to move to right Little by little, a little is moved down).
Obtaining configured plane motion track is exactly to pass through software configuration, can predefined movement effects, such as From left to right, while at random above and below, while the rotation etc. accelerated, motion profile herein refers to the effect that user intentionally gets Fruit.
The coordinate that the resource plane is carried out under 3D scene calculates, and (is related to putting down to obtain the coordinate of the resource plane under next frame Move, rotate and scale), and recalculate the reflecting effect of light;
This step be exactly by " changing coordinates " * " next stage transition matrix ", the result is that next frame it should coordinate, so The calculating of light is carried out further according to new coordinate afterwards.By the relative position of current plane and light source and angle processing such as point light source or Reflecting effect under source of parallel light.
Current eyes are calculated by the motion sensor data of VR equipment and the configuration data (interpupillary distance etc.) of distinct device Position and visual angle in virtual scene;
The exercise data that the motion sensor of VR equipment obtains, the main angle for indicating user's rotary head, the angle etc. of new line Deng.It is input with user perspective, considers interpupillary distance, coordinate and direction of the right and left eyes in 3D scene is calculated, by by 3D The projection that scape carries out right and left eyes calculates to form final image.
It is calculated under next frame including 2D content by the resource plane position of next frame and the virtual location of eyes The projection relation of all objects under 3D scene forms the double screen with parallax effect.
The present invention specifically provides a kind of device for treating amblyopia, and described device includes wearable device, 3D in the equipment Picture system includes display screen, convex lens eyeglass and output left view difference image on a display screen and right anaglyph;It is wherein left Anaglyph and right anaglyph are divided equally on a display screen, and left view difference image and right anaglyph are distributed at axial symmetry;The left side The parameter of anaglyph and right anaglyph is individually adjusted according to the needs of users.
Wherein the headset equipment is worn on user's head, is respectively equipped with lens or lens in corresponding human body eyes position Group.
Display can be the general display that headset equipment corresponding position is arranged in for playing 3D rendering, It can be common smart mobile phone screen, or retinal projection's formula display.
By taking common smart mobile phone common at present as an example, one accommodating chamber is set in headset equipment corresponding position, it will Mobile phone is put into, and mobile phone display screen is directed at the lens or lens group position of headset equipment.Preset 3D rendering can be stored in mobile phone In, click play.
The left view difference image and right anaglyph are made respectively according to human body binocular parallax principle, and the two has micro- The image of small difference, left view difference image and right anaglyph are distributed at axial symmetry, and a wherein width picture is respectively seen in human body eyes, Then fusion obtains the image that a width has stereoscopic effect.By the way that same picture is divided into left view difference image and right anaglyph, Allow to simulate remote target with close-target, makes our eyes that can obtain seeing remote in near-ambient encirclement and see close coordination It takes exercise.
3D rendering in the present invention is bisected into left view difference image and right anaglyph among picture.It is with smart phone Example, smart phone screen is laterally disposed, it then is bisected into left screen and right screen from centre, plays left view difference image and right view respectively Difference image.
The left and right eyepiece of convex lens glasses is convex lens, and left and right eyepiece center respectively corresponds two screens in left and right.
Left and right screen can adjust related software parameters, the software by the various control modes such as touch screen, key or knob Information and the size to all or part of picture of left and right screen, brightness, gray scale, color are obtained according to the sensor of system support Saturation degree and contrast etc. make corresponding adjustment, and the image between left and right screen after the adjustment can be right by 3D rendering system Amblyopia patient carries out treatment training.
Left view difference image of the invention and right anaglyph can individually be adjusted parameter.One embodiment of the invention In, 3D rendering is played such as the software on mobile phone by terminal device, which can adequately select simultaneously to client The individually parameters of selection left view difference image and right anaglyph.Or it is controlled to adjust with bluetooth approach connection remote control device etc. Parameters.
For example, the parameter of right anaglyph is able to maintain when the parameter of left view difference image is adjusted to maximum value from minimum value The parameter of original image does not change.Or when the area parameters of left view difference image are from the maximum value of raw frames 100%, press When being adjusted to 70% minimum big value in proportion, the original size that the area parameters of right anaglyph are able to maintain original image is not sent out Changing.
In one embodiment of the invention, processing method of the invention is to be carried out in configurable according to right and left eyes parameter setting Hold masking processing, comprising the following steps:
The content that copies picture is two parts of right and left eyes;
Right and left eyes parameter is mapped to masking percentage P1, P2 (the sum of content of eyes masking P1+ of the two parts of contents in left and right P2 < 100%);
Picture pixels summation X is obtained, (m*n pixel square is a basis according to the unit-sized of configuration calculating mosaic Unit);
Y fundamental unit is selected as mosaic square at random, makes the total pixel Y*m*n=X* (P1+P2) of mosaic;
The image that masking square will be chosen to be randomly assigned to left and right eyes in proportion according to P1:P2 value;
For square content, the mode in step 3 can be used to carry out Weakening treatment.
Specifically, being directed to right and left eyes parameter configuration, independent process can be carried out to right and left eyes image.Wherein each seed ginseng of image Number regulating step can be carried out freely in any order, and the adjusting of each parameter is independent of each other each other, and be not necessarily to restriction sequence.This hair It is bright that several specific embodiments are as follows, how can be adjusted for different parameters illustration.
The independent adjusting of 1 color of embodiment
Specific step is as follows:
1. obtaining eye parameters
2. (existing above there are many expression method of pixel color, calculating below for each pixel numerical value of acquisition image It is illustrated at method with RGB statement)
3. the numerical value of pair each pixel calculates, specific as follows:
According to right and left eyes configuration parameter, the colouring intensity of image is adjusted, forms the received image color intensity of right and left eyes Difference.Its detailed process be by image carry out pixel scale calculating so that image showed according to different parameters it is different Color effect, the method is as follows:
Input the information strength parameter percentage P ([0,1] range) that parameter is the left and right two
It is characterized in that there is image original color to present when P is 1, when P is 0, image is rendered as gray level image, P When changing for median, the effect variation of image changes linearly relationship
This method carries out the color Weakening treatment of image using the mapping mode of pixel scale, empty with the RGB color of image Between be described for model, (other models such as HSV etc., expression method is different, but its mathematical computations essence is similar).
Its rgb value is obtained for each pixel of image, and is replaced with the mapping value of response, meets features above For the pixel processing method of specific image ashing there are many calculation, typical mapping method example is following (but not containing only):
(R,G,B)->(R*P+(R+G+B)/3*(1-P),G*P+(R+G+B)/3*(1-P),B*P+(R+G+B)/3*(1- P))。
According to right and left eyes configuration parameter, the light and shade intensity of image is adjusted, forms the received image light and shade intensity of right and left eyes Difference.Its detailed process be by image carry out pixel scale calculating so that image showed according to different parameters it is different Brightness effects, the method is as follows:
Input the information strength parameter percentage P ([0,1] range) that parameter is the left and right two
It is characterized in that there is image original color to present when P is 1, when P is 0, image is rendered as pure black image, P When changing for median, the effect variation of image changes linearly relationship
This method carries out the color Weakening treatment of image using the mapping mode of pixel scale, empty with the RGB color of image Between be described for model, (other models such as HSV etc., expression method is different, but its mathematical computations essence is similar);
Its rgb value is obtained for each pixel of image, and is replaced with the mapping value of response, meets features above For the pixel processing method that specific image darkens there are many calculation, typical mapping method example is following (but not containing only):
(R,G,B)->(R*P,G*P,B*P)。
The independent adjusting of 2 contrast of embodiment
Specific step is as follows:
1. obtaining eye parameters
2. obtaining each pixel numerical value of image
3. the numerical value of pair each pixel calculates, specific as follows:
According to right and left eyes configuration parameter, the contrast intensity of image is adjusted, makes the received image light and shade intensity shape of right and left eyes At difference.Its detailed process is by carrying out pixel scale calculating to image, so that image shows difference according to different parameters Brightness effects, the method is as follows:
Input the information strength parameter percentage P ([0,1] range) that parameter is the left and right two
It is characterized in that redistributing the colour gamut of image using P value, the color contrast of the bigger image of P value is more obvious, P value Difference is corresponding between the color gamut and pixel of smaller image reduces.When P is 1, there is image original color to present, and work as P When being 0, image is rendered as gray image, and when P is that median changes, the effect variation of image changes linearly relationship
This method carries out the comparison Weakening treatment of image using the mapping mode of pixel scale, empty with the RGB color of image Between be described for model, (other models such as HSV etc., expression method is different, but its mathematical computations essence is similar)
Its rgb value is obtained for each pixel of image, and is replaced with the mapping value of response, meets features above For the pixel processing method of specific image comparison reduction there are many calculation, typical mapping method example is following (but not containing only):
(R,G,B)->((R+Max*(1-P))/2,(G+Max*(1-P))/2,(B+Max*(1-P))/2)
Wherein Max value is the maximum value upper limit of RGB, can be considered 1 after normalization.
The independent adjusting of 3 image size of embodiment
Specific step is as follows:
1. obtaining eye parameters
2. obtaining each pixel numerical value of image
3. the numerical value of pair each pixel calculates, specific as follows:
According to right and left eyes configuration parameter, the size of image is adjusted, the received image size of right and left eyes is made to form difference.
Input the information strength parameter percentage P ([0,1] range) that parameter is the left and right two
It is characterized in that the bigger image area of P value is bigger, the smaller image area of P value is smaller.When P is 1, image has original Size present, when P be 0 when, image area 0, P be median change when, image effect variation changes linearly relationship.
This method is calculated using the scaling that interpolation method carries out image, and process is as follows:
The size (long and wide) of picture after scaling is recalculated by ratio;
Calculate respective coordinates of each pixel in the picture of source in Target Photo;
It is carried out according to pixel coordinate, the interpolation calculation (such as neighbor interpolation, two-wire interpolation etc.) of Target Photo pixel color;
Export target image.
Although the invention has been described by way of example and in terms of the preferred embodiments, but it is not for limiting the present invention, any this field Technical staff without departing from the spirit and scope of the present invention, may be by the masking device and technology contents pair of the disclosure above Technical solution of the present invention makes possible variation and modification, therefore, anything that does not depart from the technical scheme of the invention, according to this The technical spirit of invention any simple modifications, equivalents, and modifications made to the above embodiment, belong to the technology of the present invention The protection scope of scheme.

Claims (10)

1. the management method for the 3D rendering for treating myopia or amblyopia, which is characterized in that first convert 2D image to movably The 3D rendering of state variation;Then 3D rendering includes left view difference image and right anaglyph, respectively corresponds the left eye and right eye of human body, Wherein left eye can only see left view difference image, and right eye can only see right anaglyph;
For the 3D rendering in terminal plays, the parameter of left view difference image and right anaglyph according to the needs of users can be single It is solely adjusted, the parameter regulation of one of image does not influence the parameter of another image;
Wherein 2D image be converted into can dynamic change 3D rendering method are as follows: to 2D image carry out image contract, by extract tie Fruit is placed in 3D coordinate system by texture mapping operation, and motion process is then carried out in 3D coordinate system and rendering realizes that dynamic becomes Change, first progress 3D coordinate conversion, which calculates to be formed by projection calculating again, carries out 2D image projection;By calculating parallax in real time, by 2D The multimedia content of image incorporates 3D scene by way of movable plane, makes it can be in 3D virtual scene according to predetermined party The dynamic change of formula progress 3D rendering.
2. according to claim 1 for treating the management method of the 3D rendering of myopia or amblyopia, which is characterized in that 3D figure The dynamic change of picture is one of translation, rotation, overturning or scaling of image or a variety of.
3. according to claim 1 for treating the management method of the 3D rendering of myopia or amblyopia, which is characterized in that described 2D image be converted into can dynamic change 3D rendering method the following steps are included: step a, image contract is carried out to 2D image;
Step b chooses required 3D virtual scene;
Step c constructs 2D the resource plane in 3D virtual scene, and the initial bit of place coordinate system is constructed for its 2D the resource plane It sets, angle and size;
Step d constructs the intrinsic coordinates system of 2D the resource plane, by parsing the feature of 2D resource image, carries out coordinate mapping meter It calculates, converts 2D resource image to the textures of 2D the resource plane;
2D multimedia content is incorporated by way of movable plane 3D scene, is allowed to by step e by calculating parallax in real time It can carry out configurable 3D figure conversion.
4. according to claim 3 for treating the management method of the 3D rendering of myopia or amblyopia, which is characterized in that step In e, 2D resource entity is converted in 3D scene by configurable variation pattern, and calculating process is as follows:
Obtain plane initial coordinate matrix and current coordinate conversion conversion coordinates matrix;
Configured plane motion track is obtained, and calculates the transition matrix of current generation, and is allowed to smooth;Under 3D scene The coordinate for carrying out the resource plane calculates, and to obtain the coordinate of the resource plane under next frame, and recalculates the reflecting effect of light;
Position of the current eyes in virtual scene is calculated by the motion sensor data of VR equipment and the configuration data of equipment It sets and visual angle;
The field 3D under next frame including 2D content is calculated by the resource plane position of next frame and the virtual location of eyes The projection relation of all objects under scape forms the double screen with parallax effect.
5. according to claim 1 for treating the management method of the 3D rendering of myopia or amblyopia, which is characterized in that described The parameter of left view difference image and right anaglyph is the size, bright of left view difference image and right anaglyph all or part picture Degree, gray scale, saturation degree, one of contrast or a variety of.
6. according to claim 1 for treating the management method of the 3D rendering of myopia or amblyopia, which is characterized in that described The parameter of left view difference image and right anaglyph part picture immobilizes, and when adjusting only changes the parameter of setting section.
7. according to claim 1 for treating the management method of the 3D rendering of myopia or amblyopia, which is characterized in that individually The method of adjustment parameter is to carry out configurable content masking according to right and left eyes parameter setting to handle, comprising the following steps:
The screen of VR equipment eyes is obtained, and is translated into image;
Content is subjected to left and right split screen, and configurable content masking is carried out according to right and left eyes parameter and is handled;
For right and left eyes parameter configuration, color, light and shade, the independent process of contrast can be carried out for right and left eyes to right and left eyes image Parameter configuration can carry out the independent process of image size to right and left eyes image;
Export right and left eyes image.
8. according to claim 7 for treating the management method of the 3D rendering of myopia or amblyopia, which is characterized in that according to Right and left eyes parameter carries out the step of configurable content masking processing are as follows:
Step 1, the content that copies picture is two parts of right and left eyes;
Step 2, right and left eyes parameter is mapped to masking percentage P1, the P2 of the two parts of contents in left and right, wherein the content of eyes masking The sum of P1+P2 < 100%;
Step 3, picture pixels summation X is obtained, the unit-sized of mosaic is calculated according to configuration, m*n pixel square is a base Plinth unit;
Step 4, Y fundamental unit is selected at random as mosaic square, makes the total pixel Y*m*n=X* (P1+ of mosaic P2);
Step 5, the image that masking square will be chosen to be randomly assigned to left and right eyes in proportion according to P1:P2 value.
9. a kind of for treating the 3D rendering management system of myopia or amblyopia, which is characterized in that the 3D rendering management system packet Include image extraction module, computing module, 3D processing module, parameter adjustment module and VR equipment;Wherein image extraction module is to 2D Image carries out image contract, and computing module first carries out the conversion of 3D coordinate and calculates, and by calculating parallax in real time, utilizes 3D processing module The multimedia content of 2D image is incorporated into 3D scene by way of movable plane, it can be in the 3D virtual field of VR equipment The dynamic change of 3D rendering is carried out in scape according to predetermined way;Parameter adjustment module by according to right and left eyes parameter setting progress can The content masking of configuration is handled, and realizes the independent adjusting of the parameter of left view difference image and right anaglyph.
10. a kind of device for treating amblyopia, described device include wearable device, it is equipped in the equipment such as claim 9 institute That states is used to treat the 3D rendering management system of myopia or amblyopia.
CN201810054258.8A 2018-01-19 2018-01-19 For treating the 3D rendering management method and management system and device of myopia or amblyopia Active CN108234986B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810054258.8A CN108234986B (en) 2018-01-19 2018-01-19 For treating the 3D rendering management method and management system and device of myopia or amblyopia

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810054258.8A CN108234986B (en) 2018-01-19 2018-01-19 For treating the 3D rendering management method and management system and device of myopia or amblyopia

Publications (2)

Publication Number Publication Date
CN108234986A CN108234986A (en) 2018-06-29
CN108234986B true CN108234986B (en) 2019-03-15

Family

ID=62668067

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810054258.8A Active CN108234986B (en) 2018-01-19 2018-01-19 For treating the 3D rendering management method and management system and device of myopia or amblyopia

Country Status (1)

Country Link
CN (1) CN108234986B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111202663B (en) * 2019-12-31 2022-12-27 浙江工业大学 Vision training learning system based on VR technique

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103384340A (en) * 2013-06-28 2013-11-06 中南大学 Method for obtaining 3D imaging image from single 2D image
WO2014070814A2 (en) * 2012-11-01 2014-05-08 X6D Limited Glasses for amblyopia treatment
CN104618710A (en) * 2015-01-08 2015-05-13 左旺孟 Dysopia correction system based on enhanced light field display

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI468849B (en) * 2011-04-28 2015-01-11 Inst Information Industry Building texture extracting apparatus and method thereof

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014070814A2 (en) * 2012-11-01 2014-05-08 X6D Limited Glasses for amblyopia treatment
CN103384340A (en) * 2013-06-28 2013-11-06 中南大学 Method for obtaining 3D imaging image from single 2D image
CN104618710A (en) * 2015-01-08 2015-05-13 左旺孟 Dysopia correction system based on enhanced light field display

Also Published As

Publication number Publication date
CN108234986A (en) 2018-06-29

Similar Documents

Publication Publication Date Title
CN108271011B (en) For treating the parameter processing method and system and device of the 3D rendering system of amblyopia
US20200174262A1 (en) Head-mountable apparatus and methods
CN106484116B (en) The treating method and apparatus of media file
JP6870080B2 (en) Image generator, image display system, and image generation method
CN110121885A (en) For having recessed video link using the wireless HMD video flowing transmission of VR, the low latency of watching tracking attentively
CN104618710B (en) Dysopia correction system based on enhanced light field display
US20060232665A1 (en) Materials and methods for simulating focal shifts in viewers using large depth of focus displays
CN107277495A (en) A kind of intelligent glasses system and its perspective method based on video perspective
CN105629469B (en) Head-mounted display apparatus based on liquid crystal lens array
CN106491323B (en) For treating the video system and device of amblyopia
US11962746B2 (en) Wide-angle stereoscopic vision with cameras having different parameters
CN104581119B (en) A kind of display methods of 3D rendering and a kind of helmet
CN107272200A (en) A kind of focal distance control apparatus, method and VR glasses
US11570426B2 (en) Computer-readable non-transitory storage medium, web server, and calibration method for interpupillary distance
CN110021445A (en) A kind of medical system based on VR model
CN107669455A (en) A kind of vision training method, device and equipment
US20200051207A1 (en) Image generating apparatus, image displaying system, and image generating method
WO2007059477A2 (en) Virtual patient simulator
CN105894567A (en) Scaling pixel depth values of user-controlled virtual object in three-dimensional scene
WO2018176927A1 (en) Binocular rendering method and system for virtual active parallax computation compensation
CN109521871B (en) Training method, device, equipment and storage medium for fusion function
CN108064447A (en) Method for displaying image, intelligent glasses and storage medium
CN108234986B (en) For treating the 3D rendering management method and management system and device of myopia or amblyopia
US11107276B2 (en) Scaling voxels in a virtual space
CN102798981A (en) Biomimetic 3D (three dimensional) stereoimaging system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant