CN109445103A - Show the update method and device, storage medium, electronic device of picture - Google Patents

Show the update method and device, storage medium, electronic device of picture Download PDF

Info

Publication number
CN109445103A
CN109445103A CN201811506335.5A CN201811506335A CN109445103A CN 109445103 A CN109445103 A CN 109445103A CN 201811506335 A CN201811506335 A CN 201811506335A CN 109445103 A CN109445103 A CN 109445103A
Authority
CN
China
Prior art keywords
displacement
glasses
coordinate system
virtual camera
display screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811506335.5A
Other languages
Chinese (zh)
Other versions
CN109445103B (en
Inventor
常明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Virtual Point Technology Co Ltd
Original Assignee
Leyard Optoelectronic Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Leyard Optoelectronic Co Ltd filed Critical Leyard Optoelectronic Co Ltd
Priority to CN201811506335.5A priority Critical patent/CN109445103B/en
Publication of CN109445103A publication Critical patent/CN109445103A/en
Application granted granted Critical
Publication of CN109445103B publication Critical patent/CN109445103B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0138Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B2027/0178Eyeglass type

Abstract

The embodiment of the invention provides a kind of update methods and device, storage medium, electronic device for showing picture, which comprises obtains first displacement of the 3D glasses in real coordinate system, wherein 3D glasses are worn on the eyes of experiencer;According to the first displacement of 3D glasses, second displacement amount of the virtual camera in simulation software virtual coordinate system is determined, wherein virtual coordinate system and real coordinate system in simulation software have corresponding relationship;The display picture on display screen is updated according to the second displacement amount of determining virtual camera.It solves and matches the display picture after personage's displacement by changing the focal length of virtual camera in the prior art, the problem of leading to not meet the variation of human eye actual visual, achievees the effect that image that human eye is watched and actual persons situation of movement is identical really feeds back.

Description

Show the update method and device, storage medium, electronic device of picture
Technical field
The present invention relates to Virtual Simulation field, in particular to a kind of update method for showing picture and device, Storage medium, electronic device.
Background technique
In Virtual Simulation application at present, CAVE system, such as Fig. 1 are mostly used greatly, and experiencer 104 is in be shown by three pieces Shield in the space surrounded, also there are more display screens certainly, positioned at the surface of experiencer, underfooting and rear were not done herein It is illustrate more.Three pieces of display screens show video pictures (front display screen 101, left side display screen 102, right side display screen 103), and people is logical Cross the viewing stereoscopic picture plane of 3D glasses 105 for wearing adjustment notch point.The space above that display screen surrounds is mounted with that multi-section is infrared dynamic Camera 106 is caught, it is fixed to carry out space to mark point special in space in real time for these this spaces of camera alternate covering Position tracking, these mark points are mounted on the 3D glasses of experiencer's wearing, in this way, people arbitrarily moves in space, it is dynamic to catch system It will track to obtain glasses, that is, the space displacement information of human eye, this information be exported in real time aobvious to three pieces of display screens Show system, 3D display image software can change video pictures, phase according to location information in real time according to these spatial positional informations Meet the mobile bring view transformation of people with answering.Here it is the typical cases of dummy emulation system.
Usually, moving and catching the glasses space displacement information of system capture is x, tri- axial coordinate value of y, z, virtual emulation system System 3D software can obtain these three changes in coordinates values, then match certain coefficient, change the camera lens of virtual camera in 3D software Focal length, the image size variation that Lai Shixian screen broadcasts, after following people mobile, visual field view also follows the feeling of variation.But this Kind changes according to coordinate value, is not meet the vision generated in the practical movement of people to become to change the way of virtual camera focal length Change, feeling on the spot in person can not be truly realized, belong to the method for compromise.
For the display picture after personage is displaced is matched by changing the focal length of virtual camera in the prior art, cause The problem of not meeting the variation of human eye actual visual, there has been no reasonable solutions.
Summary of the invention
The embodiment of the invention provides a kind of update methods and device, storage medium, electronic device for showing picture, so that It is few to solve to match the display picture after personage's displacement by changing the focal length of virtual camera in the related technology, cause not meeting The problem of human eye actual visual changes.
According to one embodiment of present invention, a kind of update method of image display picture is provided, comprising: obtain three-dimensional First displacement of the glasses in real coordinate system, wherein the 3D glasses are worn on the eyes of experiencer;According to described First displacement of 3D glasses determines second displacement amount of the virtual camera in simulation software virtual coordinate system, In, virtual coordinate system and the real coordinate system in the simulation software have corresponding relationship;According to determining described virtual The second displacement amount of video camera updates the display picture on display screen.
Preferably, obtaining first displacement of the 3D glasses in real coordinate system includes: the setting real coordinate system In X-axis the plane being oriented parallel to where the display screen, the direction of Y-axis perpendicular to the plane where the display screen, Plane where the reality coordinate system is ground, and the display screen is arranged perpendicular to ground, and the positive direction of the Y-axis is directed toward institute State the plane where display screen;The 3D glasses are obtained in the displacement of the Y direction, by the 3D glasses in Y-axis The displacement in direction is determined as first displacement.
Preferably, the 3D glasses are obtained in the displacement of the Y direction, by the 3D glasses in Y direction Displacement to be determined as first displacement include: to obtain the first starting coordinate value that the 3D glasses are once displaced and the One terminating coordinates value, and extract the Y axis coordinate value Y in the first starting coordinate value1And in the first terminating coordinates value Y axis coordinate value Y2;Utilize the coordinate value Y2Subtract the coordinate value Y1, the 3D glasses are obtained in the displacement of Y direction Measure △1, by the displacement △1It is determined as first displacement;Work as △1When > 0,3D glasses are towards close to the display screen Direction be subjected to displacement, work as △1When < 0,3D glasses are subjected to displacement towards the direction far from the display screen;Wherein, described one Secondary displacement determines in the following way: the 3D glasses move static process from this is begun to move into, and are determined as primary Displacement;Or the 3D glasses from begin to move into this move it is static during, be divided into according to preset rules multiple The displacement stage, will wherein each displacement stage be determined as once being displaced.
Preferably, according to first displacement of the 3D glasses, determine that virtual camera is virtual in simulation software Second displacement amount in coordinate system, comprising: according to 3D glasses Y direction displacement △1, virtual camera is calculated imitative The displacement △ of Y direction in true software virtual coordinate system2, the displacement △2Calculation formula are as follows: △2=K △1, In, K is positive number;By the displacement △ of virtual camera Y direction in simulation software virtual coordinate system2It is determined as described Second displacement amount.
Preferably, the display picture packet on display screen is updated according to the second displacement amount of the determining virtual camera It includes: target object is adjusted in the display picture of the display screen according to the second displacement amount of the determining virtual camera On size.
Preferably, target object is adjusted in the display according to the second displacement amount of the determining virtual camera Size on the display picture of screen includes: according to the displacement △2, adjust the angular field of view of the virtual camera;Wherein, As the displacement △2When > 0, the angular field of view of the virtual camera is reduced, as the displacement △2When < 0, amplify institute State the angular field of view of virtual camera;According to the angular field of view of the virtual camera, the target object is adjusted described aobvious Show the size on picture;Wherein, when the angular field of view of the virtual camera reduces, amplify the target object described aobvious Show the size on picture, when the amplification of the angular field of view of the virtual camera, reduces the target object in the display picture Size on face.
According to another embodiment of the invention, a kind of updating device for showing picture is additionally provided, comprising: obtain mould Block, for obtaining first displacement of the 3D glasses in real coordinate system, wherein the 3D glasses are worn on experiencer's On eyes;Determining module determines virtual camera in simulation software for first displacement according to the 3D glasses Second displacement amount in virtual coordinate system, wherein the virtual coordinate system in the simulation software has with the real coordinate system Corresponding relationship;Update module, for updating the display on display screen according to the second displacement amount of the determining virtual camera Picture.
Preferably, the acquisition module includes: setup unit, for setting the direction of the X-axis in the real coordinate system The plane being parallel to where the display screen, the direction of Y-axis is perpendicular to the plane where the display screen, the reality coordinate system The plane at place is ground, and the display screen is arranged perpendicular to ground, and the positive direction of the Y-axis is directed toward where the display screen Plane;Acquiring unit, for obtaining the 3D glasses in the displacement of the Y direction, by the 3D glasses in Y-axis side To displacement be determined as first displacement.
Other side according to an embodiment of the present invention additionally provides a kind of storage medium, which is characterized in that the storage Computer program is stored in medium, wherein the computer program is arranged to execute any of the above-described method reality when operation Apply the step in example.
According to another embodiment of the invention, a kind of electronic device, including memory and processor are additionally provided, it is special Sign is, computer program is stored in the memory, and the processor is arranged to run the computer program to hold Step in row any of the above-described embodiment of the method.
Through the embodiment of the present invention, by collected human eye coordinates value, output is corresponding into virtual 3D software environment It in coordinate system, is worn on video camera, reaches image that human eye is watched and actual persons situation of movement is identical true anti- The effect of feedback.It solves and matches the display picture after personage's displacement by changing the focal length of virtual camera in the prior art, Lead to the problem of not meeting the variation of human eye actual visual.
Detailed description of the invention
The drawings described herein are used to provide a further understanding of the present invention, constitutes part of this application, this hair Bright illustrative embodiments and their description are used to explain the present invention, and are not constituted improper limitations of the present invention.In the accompanying drawings:
Fig. 1 is that schematic diagram is experienced in 3D emulation in the related technology;
Fig. 2 is the hardware configuration frame for the mobile terminal that a kind of image of the embodiment of the present invention shows the update method of picture Figure;
Fig. 3 is the flow chart of the update method of middle image display picture according to embodiments of the present invention;
Fig. 4 is the demonstration graph for the update method that image according to an embodiment of the present invention shows picture;
Fig. 5 is another demonstration graph for the update method that image according to an embodiment of the present invention shows picture;
Fig. 6 is another demonstration graph for the update method that image according to an embodiment of the present invention shows picture;
Fig. 7 is the structural block diagram for the updating device that image according to an embodiment of the present invention shows picture;
Fig. 8 is the structural block diagram for the more new system that image according to an embodiment of the present invention shows picture.
Specific embodiment
Hereinafter, the present invention will be described in detail with reference to the accompanying drawings and in combination with Examples.It should be noted that not conflicting In the case of, the features in the embodiments and the embodiments of the present application can be combined with each other.
It should be noted that description and claims of this specification and term " first " in above-mentioned attached drawing, " Two " etc. be to be used to distinguish similar objects, without being used to describe a particular order or precedence order.
Embodiment 1
Embodiment of the method provided by the embodiment of the present application one can be in mobile terminal, terminal or similar fortune It calculates and is executed in device.For running on mobile terminals, Fig. 2 is that a kind of image of the embodiment of the present invention shows the update of picture The hardware block diagram of the mobile terminal of method.As shown in Fig. 2, mobile terminal 100 may include it is one or more (in Fig. 2 only Showing one) (processor 1002 can include but is not limited to Micro-processor MCV or programmable logic device FPGA to processor 1002 Deng processing unit) and memory 1004 for storing data, optionally, above-mentioned mobile terminal can also include for communicating The transmission device 1006 and input-output equipment 1008 of function.It will appreciated by the skilled person that knot shown in Fig. 2 Structure is only to illustrate, and does not cause to limit to the structure of above-mentioned mobile terminal.For example, mobile terminal 100 may also include than in Fig. 2 Shown more perhaps less component or with the configuration different from shown in Fig. 2.
Memory 1004 can be used for storing computer program, for example, the software program and module of application software, such as this hair The corresponding computer program of the acquisition methods of data information in bright embodiment, processor 1002 are stored in memory by operation Computer program in 1004 realizes above-mentioned method thereby executing various function application and data processing.Memory 1004 may include high speed random access memory, may also include nonvolatile memory, and such as one or more magnetic storage device dodges It deposits or other non-volatile solid state memories.In some instances, memory 1004 can further comprise relative to processor 102 remotely located memories, these remote memories can pass through network connection to mobile terminal 100.The reality of above-mentioned network Example includes but is not limited to internet, intranet, local area network, mobile radio communication and combinations thereof.
Transmitting device 1006 is used to that data to be received or sent via a network.Above-mentioned network specific example may include The wireless network that the communication providers of mobile terminal 100 provide.In an example, transmitting device 1006 includes that a network is suitable Orchestration (Network Interface Controller, referred to as NIC), can be connected by base station with other network equipments from And it can be communicated with internet.In an example, transmitting device 1006 can be radio frequency (Radio Frequency, abbreviation For RF) module, it is used to wirelessly be communicated with internet.
The embodiment of the invention provides the update methods that a kind of image shows picture.Fig. 3 be according to embodiments of the present invention in Image shows the flow chart of the update method of picture, as shown in figure 3, this method comprises:
Step S301 obtains first displacement of the 3D glasses in real coordinate system, wherein 3D glasses are worn on body On the eyes for the person of testing;
Step S303 determines virtual camera in simulation software virtual coordinate system according to the first displacement of 3D glasses In second displacement amount, wherein virtual coordinate system in simulation software and real coordinate system have corresponding relationship;
Step S305 updates the display picture on display screen according to the second displacement amount of determining virtual camera.
Existing change lens focus method, can cause deformation, the depth of field of three-dimensional things also changes therewith, this to image Situation is not in reality, and the visual angle change situation that people generate when mobile is not enough to simulate reality.By the above method, obtain First displacement of the 3D glasses in real coordinate system, wherein 3D glasses are worn on the eyes of experiencer;According to three-dimensional First displacement of glasses determines second displacement amount of the virtual camera in simulation software virtual coordinate system, wherein imitative Virtual coordinate system and real coordinate system in true software have corresponding relationship;According to the second displacement amount of determining virtual camera Update the display picture on display screen.It solves and matches personage's displacement by changing the focal length of virtual camera in the prior art Display picture afterwards leads to the problem of not meeting the variation of human eye actual visual, reaches image and actual persons shifting that human eye is watched The emotionally identical effect really fed back of condition.
A preferred embodiment according to the present invention, above-mentioned steps S301 can be realized by following steps: setting is existing The plane of X-axis in real coordinate system being oriented parallel to where display screen, the direction of Y-axis perpendicular to the plane where display screen, Plane where real coordinate system is ground, and display screen is arranged perpendicular to ground, flat where the positive direction direction display screen of Y-axis Face;3D glasses are obtained in the displacement of Y direction, 3D glasses are determined as the first displacement in the displacement of Y direction.
Preferably, obtaining 3D glasses can be realized in the first displacement of Y direction by following steps: be obtained three-dimensional The the first starting coordinate value and the first terminating coordinates value that glasses are once displaced, and extract the Y-axis in the first starting coordinate value Coordinate value Y1And the Y axis coordinate value Y in the first terminating coordinates value2;Utilize the coordinate value Y2Subtract the coordinate value Y1, the 3D glasses are obtained in the displacement △ of Y direction1, by the displacement △1It is determined as first displacement;When △1When > 0,3D glasses are subjected to displacement towards the direction close to the display screen, work as △1When < 0,3D glasses are towards far from described The direction of display screen is subjected to displacement;Wherein, primary displacement determines in the following way: 3D glasses are from beginning to move into this shifting The process that sound is stopped, is determined as once being displaced;Or 3D glasses from begin to move into this move it is static during, according to Preset rules are divided into multiple displacement stages, will wherein each displacement stage be determined as once being displaced.
It should be noted that each displacement stage can be set to very after primary displacement is divided into multiple displacement stages Small time interval, show in this way the time interval of frame updating also can very little, improve fluency that picture is shown and smooth Degree.
A preferred embodiment according to the present invention, above-mentioned steps S303 can be realized by following steps: according to three Glasses are tieed up in the displacement △ of Y direction1, calculate the displacement of virtual camera Y direction in simulation software virtual coordinate system Measure △2, the displacement △2Calculation formula are as follows: △2=K △1, wherein K is positive number;By the virtual camera imitative The displacement △ of Y direction in true software virtual coordinate system2It is determined as the second displacement amount.
It should be noted that displacement as mentioned in the embodiments of the present invention is with direction, that is to say, that displacement can be just It can bear, after coordinate value is superimposed displacement, coordinate value may increase, it is also possible to reduce, the direction of displacement and the direction of coordinate system It is consistent corresponding.For example, the 3D glasses worn are in the position of y-axis when experiencer is subjected to displacement in real coordinate system Shifting amount △1It is 0.2m, then according to preset △2=K △1Rule corresponds in the coordinate system of simulation software, works as K=0.1 When, displacement △ of the virtual camera in simulation software coordinate system2It is 0.02m, the displacement that above-mentioned correspondence is obtained is superimposed On coordinate value before to virtual camera displacement, the coordinate value after virtual camera is displaced in simulation software can be obtained.
It should be noted that system of catching of moving is arranged in realistic space, including multiple move catches camera, includes on 3D glasses Multiple mark points are caught camera and are captured the coordinate value of mark point by dynamic, and above-mentioned mark point may be constructed a three-dimensional image, Dynamic camera of catching determines the coordinate value of 3D glasses, inputs in computer system according to the coordinate value of mark point.
A preferred embodiment according to the present invention, above-mentioned steps S305 can be realized by following steps: according to true Size of the second displacement amount adjustment target object of fixed virtual camera on the display picture of display screen.
Preferably, target object is adjusted in the display picture of display screen according to the second displacement amount of determining virtual camera On size can be realized by following steps: according to the displacement △2, adjust the angular field of view of the virtual camera; Wherein, as the displacement △2When > 0, the angular field of view of the virtual camera is reduced, as the displacement △2When < 0, put The angular field of view of the big virtual camera;According to the angular field of view of the virtual camera, the target object is adjusted in institute State the size on display picture;Wherein, when the angular field of view of the virtual camera reduces, amplify the target object in institute The size on display picture is stated, when the amplification of the angular field of view of the virtual camera, reduces the target object described aobvious Show the size on picture.
Specifically, according to the displacement △2, adjust the angular field of view of the virtual camera;Wherein, when the displacement Measure △2It, can be according to the displacement △ of virtual camera when > 02The corresponding angular field of view for reducing the virtual camera of size, As the displacement △2It, can be according to the displacement △ of virtual camera when < 02Size corresponding amplify the virtual camera Angular field of view.According to the angular field of view of the virtual camera, size of the target object on the display picture is adjusted; Wherein, when the angular field of view of the virtual camera reduces, the target object can be amplified in institute according to preset ratio is corresponding The size on display picture is stated, when the amplification of the angular field of view of the virtual camera, institute can be reduced according to preset ratio is corresponding State size of the target object on the display picture.
The technical solution of embodiment for a better understanding of the present invention, is further detailed with reference to the accompanying drawing.
Fig. 4 is the demonstration graph for the update method that image according to an embodiment of the present invention shows picture.As shown in figure 4, experience Person watches in display screen front, and visual angle is that the virtual camera of 3D graphics software is exported according to certain angle, watches at this time The target sizes arrived are 202.201 be dummy emulation system display screen, and 202 be the content shown on screen, and 203 be experiencer's pendant The 3D eye positions worn, 204 be the visual angle of 3D simulation software virtual camera output.
Fig. 5 is another demonstration graph for the update method that image according to an embodiment of the present invention shows picture.As shown in figure 5, When experiencer's screen-oriented moves backward, i.e., 307 are moved to by position 304, move the system of catching at this time and capture this shift value, it will After it is adapted to certain coefficient, virtual camera visual angle is set to increase to 305 by 306, camera lens visual angle becomes larger, and displaying target mutually strains It is small, 303 are compared, is contracted to 302, is realized when the purpose that experiencer is to move backward, and visual field target becomes smaller.Wherein, 301 indicate empty Quasi- analogue system display screen, 302 indicate that the content shown on screens becomes smaller (after experiencer position is mobile), on 303 display screens The content (before experiencer position is mobile) of display, 304 indicate experiencer's eye positions (before mobile), and 305 indicate 3D simulation software The visual angle of virtual camera output becomes larger (after experiencer position is mobile), and 306 indicate the output of 3D simulation software virtual camera Visual angle (before experiencer position is mobile), 307 indicate experiencer's eye positions (after mobile).
Fig. 6 is another demonstration graph for the update method that image according to an embodiment of the present invention shows picture.As shown in fig. 6, When it is dynamic catch system detection and be moved to 407 by position 404 to target after, measure coordinate displacement value, give this value real-time delivery to 3D figure In the virtual camera of row software, and in software in strict accordance with the coordinate displacement value measured, mobile virtual video camera, in the process The focal length of virtual camera is not changed.And the video output picture variation that mobile camera generates, meeting real-time delivery is to display Screen, in this way, the image change that experiencer sees, is the real displacement amount according to oneself in virtual emulation space, what is obtained changes Become, has achieved the purpose that actual visual is experienced.Wherein, it 401 indicates dummy emulation system display screen, is shown on 402 expression screens Content become smaller (experiencer position mobile after), the content (before experiencer position is mobile) shown on 403 expression screens, 404 bodies Signifier's eye positions (before mobile) is tested, 405 indicate unchanged view angle (the experiencer position of 3D simulation software virtual camera output After movement), 406 indicate the visual angle (before experiencer position is mobile) of 3D simulation software virtual camera output, and 407 indicate experiencer Eye positions (after mobile).
Embodiment 2
A kind of updating device of image display picture is additionally provided in the present embodiment, it is real for executing any of the above-described method The step in example is applied, details are not described herein again for the content having been noted above.Fig. 7 is that image according to an embodiment of the present invention shows picture Updating device structural block diagram, as shown in fig. 7, the device include: obtain module 70, for obtain 3D glasses reality sit The first displacement in mark system, wherein the 3D glasses are worn on the eyes of experiencer;Determining module 72 is used for basis First displacement of the 3D glasses, determines second displacement of the virtual camera in simulation software virtual coordinate system Amount, wherein virtual coordinate system and the real coordinate system in the simulation software have corresponding relationship;Update module 74 is used According to the display picture on the second displacement amount of determining virtual camera update display screen.
By above-mentioned apparatus, obtains module 70 and obtain first displacement of the 3D glasses in real coordinate system, wherein three Eyeglasses-wearing is tieed up on the eyes of experiencer;Determining module 72 determines virtual camera according to the first displacement of 3D glasses Second displacement amount in simulation software virtual coordinate system, wherein virtual coordinate system and real coordinate system in simulation software have There is corresponding relationship;Update module 74 updates the display picture on display screen according to the second displacement amount of determining virtual camera. It solves and matches the display picture after personage's displacement by changing the focal length of virtual camera in the prior art, cause not meeting The problem of human eye actual visual changes reaches image and the identical true feedback of actual persons situation of movement that human eye is watched Effect.
A preferred embodiment according to the present invention, it is preferable that obtaining module 70 includes: setup unit, for setting The plane of X-axis in real coordinate system being oriented parallel to where display screen, the direction of Y-axis is perpendicular to flat where display screen Face, the plane where real coordinate system are ground, and display screen is arranged perpendicular to ground, and the positive direction of Y-axis is directed toward where display screen Plane;Acquiring unit, for obtaining 3D glasses in the displacement of Y direction, by 3D glasses Y direction displacement It is determined as the first displacement.
A kind of more new system of image display picture is additionally provided in the present embodiment, it is real for executing any of the above-described method The step in example is applied, details are not described herein again for the content having been noted above.Fig. 8 is that image according to an embodiment of the present invention shows picture More new system structural block diagram, as shown in figure 8, above system include: it is dynamic catch system software, for capturing experiencer's wearing The coordinate value of 3D glasses;3D graphic image software, for updating the coordinate value of virtual camera in analogue system, and to accrued Calculate the output picture of video image;Computer display card, for showing the video image of output.
Through the embodiment of the present invention, by collected human eye coordinates value, output is corresponding into virtual 3D software environment It in coordinate system, is worn on video camera, reaches image that human eye is watched and actual persons situation of movement is identical true anti- The effect of feedback.It solves and matches the display picture after personage's displacement by changing the focal length of virtual camera in the prior art, Lead to the problem of not meeting the variation of human eye actual visual.
Embodiment 3
The embodiments of the present invention also provide a kind of storage medium, computer program is stored in the storage medium, wherein The computer program is arranged to execute the step in any of the above-described embodiment of the method when operation.
Optionally, in the present embodiment, above-mentioned storage medium can be set to store by executing based on following steps Calculation machine program:
S1 obtains first displacement of the 3D glasses in real coordinate system, wherein 3D glasses are worn on experiencer's On eyes;
S2 determines of virtual camera in simulation software virtual coordinate system according to the first displacement of 3D glasses Two displacements, wherein virtual coordinate system and real coordinate system in simulation software have corresponding relationship;
S3 updates the display picture on display screen according to the second displacement amount of determining virtual camera.
Optionally, storage medium is also configured to store the computer program for executing following steps:
The plane of the X-axis in real coordinate system being oriented parallel to where display screen is set, the direction of Y-axis is perpendicular to display Plane where shielding, the plane where the reality coordinate system is ground, and the display screen is arranged perpendicular to ground, the Y-axis Positive direction be directed toward the plane where the display screen;3D glasses are obtained in the displacement of Y direction, by the 3D glasses It is determined as first displacement in the displacement of Y direction.
Optionally, storage medium is also configured to store the computer program for executing following steps: obtaining three-dimensional eye The the first starting coordinate value and the first terminating coordinates value that mirror is once displaced, and extract the Y axis coordinate value in the first starting coordinate value Y1And the first Y axis coordinate value Y in terminating coordinates value2;Utilize coordinate value Y2Subtract coordinate value Y1, 3D glasses are obtained in Y The displacement △ of axis direction1, by displacement △1It is determined as the first displacement;Work as △1When > 0,3D glasses are towards close to display screen Direction be subjected to displacement, work as △1When < 0,3D glasses are subjected to displacement towards the direction far from display screen;Wherein, primary displacement is pressed Determine according to following manner: 3D glasses move static process from this is begun to move into, and are determined as once being displaced;Or three-dimensional eye Mirror is divided into multiple displacement stages according to preset rules from during beginning to move into this and move static, will be wherein every A displacement stage is determined as once being displaced.
Optionally, storage medium is also configured to store the computer program for executing following steps: according to three-dimensional eye Displacement △ of the mirror in Y direction1, calculate the displacement △ of virtual camera Y direction in simulation software virtual coordinate system2, The displacement △2Calculation formula are as follows: △2=K △1, wherein K is positive number;By the virtual camera in simulation software The displacement △ of Y direction in virtual coordinate system2It is determined as the second displacement amount.
Optionally, storage medium is also configured to store the computer program for executing following steps: according to institute's rheme Shifting amount △2, adjust the angular field of view of the virtual camera;Wherein, as the displacement △2When > 0, diminution is described virtually to be taken the photograph The angular field of view of camera, as the displacement △2When < 0, amplify the angular field of view of the virtual camera;According to described virtual The angular field of view of video camera adjusts size of the target object on the display picture;Wherein, when the virtual camera Angular field of view reduce when, amplify the target object it is described display picture on size, when the view of the virtual camera When angular region is amplified, size of the target object on the display picture is reduced.
Optionally, in the present embodiment, above-mentioned storage medium can include but is not limited to: USB flash disk, read-only memory (Read- Only Memory, referred to as ROM), it is random access memory (Random Access Memory, referred to as RAM), mobile hard The various media that can store computer program such as disk, magnetic or disk.
The embodiments of the present invention also provide a kind of electronic device, including memory and processor, stored in the memory There is computer program, which is arranged to run computer program to execute the step in any of the above-described embodiment of the method Suddenly.
Optionally, above-mentioned electronic device can also include transmission device and input-output equipment, wherein the transmission device It is connected with above-mentioned processor, which connects with above-mentioned processor.
Optionally, in the present embodiment, above-mentioned processor can be set to execute following steps by computer program:
S1 obtains first displacement of the 3D glasses in real coordinate system, wherein 3D glasses are worn on experiencer's On eyes;
S2 determines of virtual camera in simulation software virtual coordinate system according to the first displacement of 3D glasses Two displacements, wherein virtual coordinate system and real coordinate system in simulation software have corresponding relationship;
S3 updates the display picture on display screen according to the second displacement amount of determining virtual camera.
Optionally, processor is also configured to store the computer program for executing following steps:
The plane of the X-axis in real coordinate system being oriented parallel to where display screen is set, the direction of Y-axis is perpendicular to display Plane where shielding, the plane where the reality coordinate system is ground, and the display screen is arranged perpendicular to ground, the Y-axis Positive direction be directed toward the plane where the display screen;3D glasses are obtained in the displacement of Y direction, by the 3D glasses It is determined as first displacement in the displacement of Y direction.
Optionally, processor is also configured to store the computer program for executing following steps:
The the first starting coordinate value and the first terminating coordinates value that 3D glasses are once displaced are obtained, and extracts the first starting and sits Y axis coordinate value Y in scale value1And the first Y axis coordinate value Y in terminating coordinates value2;Utilize coordinate value Y2Subtract coordinate value Y1, 3D glasses are obtained in the displacement △ of Y direction1, by displacement △1It is determined as the first displacement;Work as △1When > 0, three Dimension glasses are subjected to displacement towards the direction close to display screen, work as △1When < 0, towards the direction far from display screen position occurs for 3D glasses It moves;Wherein, primary displacement determines in the following way: 3D glasses move static process from this is begun to move into, and determine To be once displaced;Or 3D glasses from begin to move into this move it is static during, be divided into according to preset rules more A displacement stage, will wherein each displacement stage be determined as once being displaced.
Optionally, processor is also configured to store the computer program for executing following steps:
According to 3D glasses Y direction displacement △1, virtual camera is calculated in simulation software virtual coordinate system The displacement △ of Y direction2, the displacement △2Calculation formula are as follows: △2=K △1, wherein K is positive number;By the void The displacement △ of quasi- video camera Y direction in simulation software virtual coordinate system2It is determined as the second displacement amount.
Optionally, processor is also configured to store the computer program for executing following steps:
According to the displacement △2, adjust the angular field of view of the virtual camera;Wherein, as the displacement △2> 0 When, the angular field of view of the virtual camera is reduced, as the displacement △2When < 0, amplify the visual angle of the virtual camera Range;According to the angular field of view of the virtual camera, size of the target object on the display picture is adjusted;Its In, when the angular field of view of the virtual camera reduces, amplify size of the target object on the display picture, when When the angular field of view amplification of the virtual camera, size of the target object on the display picture is reduced.
Specific example in the present embodiment can refer to example described in above-described embodiment and optional embodiment, this Details are not described herein for embodiment.
Obviously, those skilled in the art should be understood that each module of the above invention or each step can be with general Computing device realize that they can be concentrated on a single computing device, or be distributed in multiple computing devices and formed Network on, optionally, they can be realized with the program code that computing device can perform, it is thus possible to which they are stored It is performed by computing device in the storage device, and in some cases, it can be to be different from shown in sequence execution herein Out or description the step of, perhaps they are fabricated to each integrated circuit modules or by them multiple modules or Step is fabricated to single integrated circuit module to realize.In this way, the present invention is not limited to any specific hardware and softwares to combine.
The foregoing is only a preferred embodiment of the present invention, is not intended to restrict the invention, for the skill of this field For art personnel, the invention may be variously modified and varied.It is all within principle of the invention, it is made it is any modification, etc. With replacement, improvement etc., should all be included in the protection scope of the present invention.

Claims (10)

1. a kind of update method for showing picture characterized by comprising
Obtain first displacement of the 3D glasses in real coordinate system, wherein the 3D glasses are worn on the eye of experiencer On eyeball;
According to first displacement of the 3D glasses, of virtual camera in simulation software virtual coordinate system is determined Two displacements, wherein virtual coordinate system and the real coordinate system in the simulation software have corresponding relationship;
The display picture on display screen is updated according to the second displacement amount of the determining virtual camera.
2. the method according to claim 1, wherein obtaining first displacement of the 3D glasses in real coordinate system Amount includes:
Set the plane of the X-axis in the real coordinate system being oriented parallel to where the display screen, the direction of Y-axis perpendicular to Plane where the display screen, the plane where the reality coordinate system is ground, and the display screen is arranged perpendicular to ground, The positive direction of the Y-axis is directed toward the plane where the display screen;
The 3D glasses are obtained in the displacement of the Y direction, the displacement by the 3D glasses in Y direction determines For first displacement.
3. according to the method described in claim 2, it is characterized in that, obtaining the 3D glasses in the displacement of the Y direction The 3D glasses are determined as first displacement in the displacement of Y direction by amount, comprising:
The the first starting coordinate value and the first terminating coordinates value that the 3D glasses are once displaced are obtained, and extracts the first Y axis coordinate value Y in beginning coordinate value1And the Y axis coordinate value Y in the first terminating coordinates value2
Utilize the coordinate value Y2Subtract the coordinate value Y1, the 3D glasses are obtained in the displacement △ of Y direction1, by institute State displacement △1It is determined as first displacement;Work as △1When > 0,3D glasses occur towards the direction close to the display screen Displacement, works as △1When < 0,3D glasses are subjected to displacement towards the direction far from the display screen;Wherein, it is described it is primary displacement according to Following manner determines:
The 3D glasses move static process from this is begun to move into, and are determined as once being displaced;Or
The 3D glasses from begin to move into this move it is static during, be divided into multiple displacements according to preset rules Stage, will wherein each displacement stage be determined as once being displaced.
4. according to the method described in claim 3, it is characterized in that, according to first displacement of the 3D glasses, really Determine second displacement amount of the virtual camera in simulation software virtual coordinate system, comprising:
According to 3D glasses Y direction displacement △1, calculate virtual camera Y-axis side in simulation software virtual coordinate system To displacement △2, the displacement △2Calculation formula are as follows: △2=K △1, wherein K is positive number;
By the displacement △ of virtual camera Y direction in simulation software virtual coordinate system2It is determined as the second displacement Amount.
5. according to the method described in claim 4, it is characterized in that, according to the second displacement amount of the determining virtual camera Update display screen on display picture include:
Target object is adjusted in the display picture of the display screen according to the second displacement amount of the determining virtual camera Size on face.
6. according to the method described in claim 5, it is characterized in that, according to the second of the determining virtual camera Shifting amount adjusts size of the target object on the display picture of the display screen
According to the displacement △2, adjust the angular field of view of the virtual camera;Wherein, as the displacement △2When > 0, The angular field of view for reducing the virtual camera, as the displacement △2When < 0, amplify the visual angle model of the virtual camera It encloses;
According to the angular field of view of the virtual camera, size of the target object on the display picture is adjusted;Wherein, When the angular field of view of the virtual camera reduces, amplifies size of the target object on the display picture, work as institute When stating the angular field of view amplification of virtual camera, size of the target object on the display picture is reduced.
7. a kind of updating device for showing picture characterized by comprising
Module is obtained, for obtaining first displacement of the 3D glasses in real coordinate system, wherein the 3D glasses are worn In on the eyes of experiencer;
Determining module determines virtual camera in simulation software void for first displacement according to the 3D glasses Second displacement amount in quasi-coordinate system, wherein virtual coordinate system in the simulation software and the real coordinate system have pair It should be related to;
Update module, for updating the display picture on display screen according to the second displacement amount of the determining virtual camera.
8. device according to claim 7, which is characterized in that the acquisition module includes:
Setup unit, for setting the plane of the X-axis in the real coordinate system being oriented parallel to where the display screen, Y Perpendicular to the plane where the display screen, the plane where the reality coordinate system is ground, the display screen in the direction of axis It is arranged perpendicular to ground, the positive direction of the Y-axis is directed toward the plane where the display screen;
Acquiring unit, for obtaining the 3D glasses in the displacement of the Y direction, by the 3D glasses in Y-axis side To displacement be determined as first displacement.
9. a kind of storage medium, which is characterized in that be stored with computer program in the storage medium, wherein the computer Program is arranged to execute method described in any one of claim 1 to 6 when operation.
10. a kind of electronic device, including memory and processor, which is characterized in that be stored with computer journey in the memory Sequence, the processor are arranged to run the computer program to execute side described in any one of claim 1 to 6 Method.
CN201811506335.5A 2018-12-10 2018-12-10 Display picture updating method and device, storage medium and electronic device Active CN109445103B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811506335.5A CN109445103B (en) 2018-12-10 2018-12-10 Display picture updating method and device, storage medium and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811506335.5A CN109445103B (en) 2018-12-10 2018-12-10 Display picture updating method and device, storage medium and electronic device

Publications (2)

Publication Number Publication Date
CN109445103A true CN109445103A (en) 2019-03-08
CN109445103B CN109445103B (en) 2022-03-01

Family

ID=65556443

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811506335.5A Active CN109445103B (en) 2018-12-10 2018-12-10 Display picture updating method and device, storage medium and electronic device

Country Status (1)

Country Link
CN (1) CN109445103B (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110430421A (en) * 2019-06-24 2019-11-08 南方电网调峰调频发电有限公司 A kind of optical tracking positioning system for five face LED-CAVE
CN111273878A (en) * 2020-01-08 2020-06-12 广州市三川田文化科技股份有限公司 Video playing method and device based on CAVE space and storage medium
CN111369619A (en) * 2020-02-28 2020-07-03 神华铁路装备有限责任公司 VR visual angle correction method, device, system and storage medium
CN111420402A (en) * 2020-03-18 2020-07-17 腾讯科技(深圳)有限公司 Virtual environment picture display method, device, terminal and storage medium
CN111462204A (en) * 2020-02-13 2020-07-28 腾讯科技(深圳)有限公司 Virtual model generation method, virtual model generation device, storage medium, and electronic device
CN112162640A (en) * 2020-10-13 2021-01-01 深圳晶泰科技有限公司 Crystal display method and system
CN113206991A (en) * 2021-04-23 2021-08-03 深圳市瑞立视多媒体科技有限公司 Holographic display method, system, computer program product and storage medium
CN114593688A (en) * 2022-03-03 2022-06-07 惠州Tcl移动通信有限公司 Three-dimensional measurement method and device based on AR glasses, AR glasses and storage medium
CN114755839A (en) * 2021-04-23 2022-07-15 深圳市瑞立视多媒体科技有限公司 Holographic sand table display system

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05204548A (en) * 1992-01-30 1993-08-13 Wacom Co Ltd Method and device for moving display position
CN104281391A (en) * 2013-07-03 2015-01-14 辉达公司 Method for zooming into and out of an image shown on a display
CN106157236A (en) * 2015-04-20 2016-11-23 王安 Reality display hologram
CN106293417A (en) * 2015-06-08 2017-01-04 中兴通讯股份有限公司 Screen-picture display packing and device
CN106412424A (en) * 2016-09-20 2017-02-15 乐视控股(北京)有限公司 View adjusting method and device for panoramic video
CN107077216A (en) * 2016-12-19 2017-08-18 深圳市阳日电子有限公司 Method and mobile terminal that a kind of picture is shown
US20170270711A1 (en) * 2016-03-16 2017-09-21 Michael John Schoenberg Virtual object pathing
CN107479697A (en) * 2017-07-27 2017-12-15 北京云创启航智能科技有限公司 Vision guide repositions mobile method and device under virtual reality
CN108292146A (en) * 2016-02-08 2018-07-17 谷歌有限责任公司 Laser designator interaction in virtual reality and scaling

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05204548A (en) * 1992-01-30 1993-08-13 Wacom Co Ltd Method and device for moving display position
CN104281391A (en) * 2013-07-03 2015-01-14 辉达公司 Method for zooming into and out of an image shown on a display
CN106157236A (en) * 2015-04-20 2016-11-23 王安 Reality display hologram
CN106293417A (en) * 2015-06-08 2017-01-04 中兴通讯股份有限公司 Screen-picture display packing and device
CN108292146A (en) * 2016-02-08 2018-07-17 谷歌有限责任公司 Laser designator interaction in virtual reality and scaling
US20170270711A1 (en) * 2016-03-16 2017-09-21 Michael John Schoenberg Virtual object pathing
CN106412424A (en) * 2016-09-20 2017-02-15 乐视控股(北京)有限公司 View adjusting method and device for panoramic video
CN107077216A (en) * 2016-12-19 2017-08-18 深圳市阳日电子有限公司 Method and mobile terminal that a kind of picture is shown
CN107479697A (en) * 2017-07-27 2017-12-15 北京云创启航智能科技有限公司 Vision guide repositions mobile method and device under virtual reality

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110430421A (en) * 2019-06-24 2019-11-08 南方电网调峰调频发电有限公司 A kind of optical tracking positioning system for five face LED-CAVE
CN111273878A (en) * 2020-01-08 2020-06-12 广州市三川田文化科技股份有限公司 Video playing method and device based on CAVE space and storage medium
CN111462204A (en) * 2020-02-13 2020-07-28 腾讯科技(深圳)有限公司 Virtual model generation method, virtual model generation device, storage medium, and electronic device
CN111462204B (en) * 2020-02-13 2023-03-03 腾讯科技(深圳)有限公司 Virtual model generation method, virtual model generation device, storage medium, and electronic device
CN111369619A (en) * 2020-02-28 2020-07-03 神华铁路装备有限责任公司 VR visual angle correction method, device, system and storage medium
CN111369619B (en) * 2020-02-28 2023-04-07 神华铁路装备有限责任公司 VR visual angle correction method, device, system and storage medium
CN111420402A (en) * 2020-03-18 2020-07-17 腾讯科技(深圳)有限公司 Virtual environment picture display method, device, terminal and storage medium
US11759709B2 (en) 2020-03-18 2023-09-19 Tencent Technology (Shenzhen) Company Limited Display method and apparatus for virtual environment picture, and device and storage medium
CN112162640B (en) * 2020-10-13 2022-10-25 深圳晶泰科技有限公司 Crystal display method and system
CN112162640A (en) * 2020-10-13 2021-01-01 深圳晶泰科技有限公司 Crystal display method and system
CN114755839A (en) * 2021-04-23 2022-07-15 深圳市瑞立视多媒体科技有限公司 Holographic sand table display system
CN113206991A (en) * 2021-04-23 2021-08-03 深圳市瑞立视多媒体科技有限公司 Holographic display method, system, computer program product and storage medium
CN114593688A (en) * 2022-03-03 2022-06-07 惠州Tcl移动通信有限公司 Three-dimensional measurement method and device based on AR glasses, AR glasses and storage medium
CN114593688B (en) * 2022-03-03 2023-10-03 惠州Tcl移动通信有限公司 Three-dimensional measurement method and device based on AR (augmented reality) glasses, AR glasses and storage medium

Also Published As

Publication number Publication date
CN109445103B (en) 2022-03-01

Similar Documents

Publication Publication Date Title
CN109445103A (en) Show the update method and device, storage medium, electronic device of picture
CN106131530B (en) A kind of bore hole 3D virtual reality display system and its methods of exhibiting
CN104661012B (en) Personal holographic 3 D displaying method and equipment
JP4766877B2 (en) Method for generating an image using a computer, computer-readable memory, and image generation system
KR101763636B1 (en) Method for collaboration using head mounted display
CN109598796A (en) Real scene is subjected to the method and apparatus that 3D merges display with dummy object
CN109997175B (en) Determining the size of a virtual object
US11579687B2 (en) Method and system for determining a current gaze direction
CN109752951B (en) Control system processing method and device, storage medium and electronic device
CN110610546B (en) Video picture display method, device, terminal and storage medium
US10885651B2 (en) Information processing method, wearable electronic device, and processing apparatus and system
CN107580207A (en) The generation method and generating means of light field 3D display cell picture
CN109640070A (en) A kind of stereo display method, device, equipment and storage medium
CN107993292A (en) Augmented reality scene restored method, device and computer-readable recording medium
CN107894842A (en) Augmented reality scene restored method, terminal and computer-readable recording medium
CN110855972A (en) Image processing method, electronic device, and storage medium
CN111111173A (en) Information display method, device and storage medium for virtual reality game
KR20210052570A (en) Determination of separable distortion mismatch
US20200228792A1 (en) Test method and system for wearable device
JP2023065502A (en) Mixed reality display device and mixed reality display method
US11328436B2 (en) Using camera effect in the generation of custom synthetic data for use in training an artificial intelligence model to produce an image depth map
CN113870213A (en) Image display method, image display device, storage medium, and electronic apparatus
US11107276B2 (en) Scaling voxels in a virtual space
WO2020262261A1 (en) Information processing device, information processing method, and program
CN110244837A (en) Augmented reality and the experience glasses and its imaging method being superimposed with virtual image

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20200803

Address after: No.206, floor 2, No.11, Fengzhi East Road, Baiwang Innovation Technology Park, Xibeiwang Town, Haidian District, Beijing 100094

Applicant after: Beijing Virtual Dynamic Technology Co.,Ltd.

Address before: 100091, No. 9 Hongqi West Street, Beijing, Haidian District

Applicant before: LEYARD OPTOELECTRONIC Co.,Ltd.

GR01 Patent grant
GR01 Patent grant