CN109445103B - Display picture updating method and device, storage medium and electronic device - Google Patents
Display picture updating method and device, storage medium and electronic device Download PDFInfo
- Publication number
- CN109445103B CN109445103B CN201811506335.5A CN201811506335A CN109445103B CN 109445103 B CN109445103 B CN 109445103B CN 201811506335 A CN201811506335 A CN 201811506335A CN 109445103 B CN109445103 B CN 109445103B
- Authority
- CN
- China
- Prior art keywords
- displacement
- display screen
- virtual camera
- dimensional glasses
- coordinate system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 238000006073 displacement reaction Methods 0.000 claims abstract description 205
- 239000011521 glass Substances 0.000 claims abstract description 112
- 230000000007 visual effect Effects 0.000 claims abstract description 54
- 238000004590 computer program Methods 0.000 claims description 26
- 230000008569 process Effects 0.000 claims description 12
- 238000004364 calculation method Methods 0.000 claims description 5
- 230000008859 change Effects 0.000 abstract description 17
- 230000033001 locomotion Effects 0.000 abstract description 14
- 230000000694 effects Effects 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 8
- 230000005540 biological transmission Effects 0.000 description 6
- 230000003247 decreasing effect Effects 0.000 description 4
- 238000004088 simulation Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000016776 visual perception Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Abstract
The embodiment of the invention provides a method and a device for updating a display picture, a storage medium and an electronic device, wherein the method comprises the following steps: acquiring a first displacement of the three-dimensional glasses in a real coordinate system, wherein the three-dimensional glasses are worn on the eyes of an experiencer; determining a second displacement of the virtual camera in a virtual coordinate system of simulation software according to the first displacement of the three-dimensional glasses, wherein the virtual coordinate system in the simulation software has a corresponding relation with a real coordinate system; and updating the display picture on the display screen according to the determined second displacement of the virtual camera. The problem that in the prior art, the display picture after human body displacement is matched by changing the focal length of the virtual camera, so that the real visual change of human eyes is not met is solved, and the effect of real feedback that the image watched by the human eyes is identical to the actual human body movement condition is achieved.
Description
Technical Field
The invention relates to the technical field of virtual simulation, in particular to a method and a device for updating a display picture, a storage medium and an electronic device.
Background
In the application of the current virtual simulation technology, a CAVE system is mostly adopted, as shown in fig. 1, an experiencer 104 is in a space enclosed by three display screens, and certainly, more display screens are arranged right above, under the feet and behind the experiencer, which are not described in more detail herein. The three display screens display video pictures (a front display screen 101, a left display screen 102 and a right display screen 103), and a person watches the stereoscopic pictures by wearing 3D glasses 105 provided with mark points. A plurality of infrared moving-capture cameras 106 are installed above a space surrounded by the display screens, the cameras cover the space in a crossed mode, special mark points in the space can be located and tracked in real time, the mark points are installed on 3D glasses worn by an experiencer, therefore, the moving-capture system can track the glasses, namely space displacement information of human eyes, the information is output to display systems of three display screens in real time, and the 3D display image software can change video pictures according to the space position information in real time according to the space position information, and accordingly visual angle change caused by human movement is met. This is a typical application of virtual simulation systems.
Generally speaking, the glasses space displacement information captured by the moving capture system is x, y and z three-axis coordinate values, the three coordinate change values can be obtained by the virtual simulation system 3D software, then a certain coefficient is matched, the lens focal length of a virtual camera in the 3D software is changed, the size change of an image played on a screen is realized, and the visual field view also follows the change feeling after the moving following person moves. However, the method of changing the focal length of the virtual camera according to the coordinate value change is not in line with the visual change generated in the actual movement of people, cannot really achieve the feeling of being personally on the scene, and belongs to a compromise method.
Aiming at the problem that the real visual change of human eyes is not met due to the fact that the display picture after human body displacement is matched by changing the focal length of a virtual camera in the prior art, a reasonable solution is not provided.
Disclosure of Invention
The embodiment of the invention provides a method and a device for updating a display picture, a storage medium and an electronic device, which are used for at least solving the problem that the real visual change of human eyes is not met due to the fact that the display picture after human body displacement is matched by changing the focal length of a virtual camera in the related technology.
According to an embodiment of the present invention, there is provided an updating method of an image display screen, including: acquiring a first displacement amount of three-dimensional glasses in a real coordinate system, wherein the three-dimensional glasses are worn on the eyes of an experiencer; determining a second displacement of the virtual camera in a virtual coordinate system of simulation software according to the first displacement of the three-dimensional glasses, wherein the virtual coordinate system in the simulation software has a corresponding relation with the real coordinate system; and updating the display picture on the display screen according to the determined second displacement of the virtual camera.
Preferably, the acquiring a first displacement amount of the three-dimensional glasses in the real coordinate system comprises: setting the direction of an X axis in the real coordinate system to be parallel to the plane of the display screen, setting the direction of a Y axis to be vertical to the plane of the display screen, setting the plane of the real coordinate system to be the ground, setting the display screen to be vertical to the ground, and pointing the positive direction of the Y axis to the plane of the display screen; and acquiring the displacement of the three-dimensional glasses in the Y-axis direction, and determining the displacement of the three-dimensional glasses in the Y-axis direction as the first displacement.
Preferably, the obtaining a displacement amount of the three-dimensional glasses in the Y-axis direction, and the determining the displacement amount of the three-dimensional glasses in the Y-axis direction as the first displacement amount comprises: acquiring a first initial coordinate value and a first termination coordinate value of the primary displacement of the three-dimensional glasses, and extracting a Y-axis coordinate value Y in the first initial coordinate value1And a Y-axis coordinate value Y in the first termination coordinate values2(ii) a Using said coordinate value Y2Subtracting the coordinate value Y1Obtaining the displacement delta of the three-dimensional glasses in the Y-axis direction1The displacement amount Delta1Determining the first displacement amount; when delta is1When the angle is larger than 0, the three-dimensional glasses are displaced towards the direction close to the display screen, and when the angle is delta1When the distance is less than 0, the three-dimensional glasses displace towards the direction far away from the display screen; wherein the primary displacement is determined in the following manner: determining the three-dimensional glasses to be a displacement from the beginning of moving to the current moving and standing process; or the three-dimensional glasses are divided into a plurality of displacement stages according to a preset rule in the process from the beginning of moving to the current moving and stopping, and each displacement stage is determined as one displacement.
Preferably, determining a second displacement amount of the virtual camera in the virtual coordinate system of the simulation software according to the first displacement amount of the three-dimensional glasses comprises: amount of displacement Δ in the Y-axis direction according to three-dimensional glasses1Calculating the displacement delta of the virtual camera in the Y-axis direction in the virtual coordinate system of the simulation software2The amount of displacement Δ2The calculation formula of (2) is as follows: delta2＝K·△1Wherein K is a positive number; shifting quantity delta of the virtual camera in the Y-axis direction in the virtual coordinate system of the simulation software2The second amount of displacement is determined.
Preferably, updating the display on the display screen according to the determined second displacement amount of the virtual camera comprises: and adjusting the size of a target object on a display screen of the display screen according to the determined second displacement amount of the virtual camera.
Preferably, adjusting the size of the target object on the display screen of the display screen according to the determined second displacement amount of the virtual camera includes: according to the displacement delta2Adjusting the visual angle range of the virtual camera; wherein, when the displacement amount Δ2When the angle is larger than 0, the visual angle range of the virtual camera is reduced, and when the displacement amount delta is larger2When the visual angle range is less than 0, enlarging the visual angle range of the virtual camera; adjusting the size of the target object on the display picture according to the visual angle range of the virtual camera; wherein the size of the target object on the display screen is enlarged when the view angle range of the virtual camera is reduced, and the size of the target object on the display screen is reduced when the view angle range of the virtual camera is enlarged.
According to another embodiment of the present invention, there is also provided an update apparatus of a display screen, including: the system comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring a first displacement amount of three-dimensional glasses in a real coordinate system, and the three-dimensional glasses are worn on the eyes of an experiencer; the determining module is used for determining a second displacement of the virtual camera in a virtual coordinate system of simulation software according to the first displacement of the three-dimensional glasses, wherein the virtual coordinate system in the simulation software has a corresponding relation with the real coordinate system; and the updating module is used for updating the display picture on the display screen according to the determined second displacement of the virtual camera.
Preferably, the obtaining module includes: the setting unit is used for setting the direction of an X axis in the real coordinate system to be parallel to the plane where the display screen is located, the direction of a Y axis is perpendicular to the plane where the display screen is located, the plane where the real coordinate system is located is the ground, the display screen is perpendicular to the ground, and the positive direction of the Y axis points to the plane where the display screen is located; and the acquisition unit is used for acquiring the displacement of the three-dimensional glasses in the Y-axis direction and determining the displacement of the three-dimensional glasses in the Y-axis direction as the first displacement.
According to another aspect of the embodiments of the present invention, there is also provided a storage medium, characterized in that the storage medium stores a computer program, wherein the computer program is configured to execute the steps in any of the above method embodiments when running.
According to another embodiment of the present invention, there is also provided an electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor is configured to execute the computer program to perform the steps of any of the above method embodiments.
According to the embodiment of the invention, the acquired human eye coordinate values are output to the corresponding coordinate system in the virtual 3D software environment and worn on the camera, so that the effect of real feedback that the image watched by human eyes is identical to the actual human movement condition is achieved. The problem that in the prior art, the display picture after human body displacement is matched by changing the focal length of the virtual camera, so that the real visual change of human eyes is not met is solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
FIG. 1 is a schematic diagram of a 3D simulation experience in the related art;
fig. 2 is a block diagram of a hardware configuration of a mobile terminal of an image display screen updating method according to an embodiment of the present invention;
FIG. 3 is a flow chart of a method for updating an image display according to an embodiment of the present invention;
fig. 4 is an explanatory diagram of an update method of an image display screen according to an embodiment of the invention;
FIG. 5 is another illustration of an update method of an image display according to an embodiment of the invention;
FIG. 6 is another illustration of an update method of an image display according to an embodiment of the invention;
fig. 7 is a block diagram of a configuration of an apparatus for updating an image display screen according to an embodiment of the present invention;
fig. 8 is a block diagram of a configuration of an update system of an image display screen according to an embodiment of the present invention.
Detailed Description
The invention will be described in detail hereinafter with reference to the accompanying drawings in conjunction with embodiments. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.
Example 1
The method provided by the first embodiment of the present application may be executed in a mobile terminal, a computer terminal, or a similar computing device. Taking the mobile terminal as an example, fig. 2 is a block diagram of a hardware structure of the mobile terminal of an updating method of an image display screen according to an embodiment of the present invention. As shown in fig. 2, the mobile terminal may include one or more (only one shown in fig. 2) processors 1002 (the processor 1002 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 1004 for storing data, and optionally, a transmission device 1006 for communication functions and an input-output device 1008. It will be understood by those skilled in the art that the structure shown in fig. 2 is only an illustration, and does not limit the structure of the mobile terminal. For example, the mobile terminal may also include more or fewer components than shown in FIG. 2, or have a different configuration than shown in FIG. 2.
The memory 1004 can be used for storing computer programs, for example, software programs and modules of application software, such as computer programs corresponding to the data information acquiring method in the embodiment of the present invention, and the processor 1002 executes various functional applications and data processing by running the computer programs stored in the memory 1004, that is, implementing the above-described method. The memory 1004 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 1004 may further include memory located remotely from the processor 102, which may be connected to the mobile terminal through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 1006 is used for receiving or sending data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device 1006 includes a Network adapter (NIC), which can be connected to other Network devices through a base station so as to communicate with the internet. In one example, the transmission device 1006 can be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
The embodiment of the invention provides an updating method of an image display picture. Fig. 3 is a flowchart of an updating method of an image display screen according to an embodiment of the present invention, as shown in fig. 3, the method includes:
step S301, acquiring a first displacement of three-dimensional glasses in a real coordinate system, wherein the three-dimensional glasses are worn on eyes of an experiencer;
step S303, determining a second displacement of the virtual camera in a virtual coordinate system of simulation software according to the first displacement of the three-dimensional glasses, wherein the virtual coordinate system in the simulation software has a corresponding relation with a real coordinate system;
and step S305, updating the display picture on the display screen according to the determined second displacement amount of the virtual camera.
The existing method for changing the focal length of the lens can deform an image, the depth of field of a three-dimensional object is changed, and the situation is not realistic, and the situation of visual angle change generated when people move is not enough to simulate reality. By the method, the first displacement of the three-dimensional glasses in a real coordinate system is obtained, wherein the three-dimensional glasses are worn on the eyes of an experiencer; determining a second displacement of the virtual camera in a virtual coordinate system of simulation software according to the first displacement of the three-dimensional glasses, wherein the virtual coordinate system in the simulation software has a corresponding relation with a real coordinate system; and updating the display picture on the display screen according to the determined second displacement of the virtual camera. The problem that in the prior art, the display picture after human body displacement is matched by changing the focal length of the virtual camera, so that the real visual change of human eyes is not met is solved, and the effect of real feedback that the image watched by the human eyes is identical to the actual human body movement condition is achieved.
According to a preferred embodiment of the present invention, the step S301 may be implemented by: setting the direction of an X axis in a real coordinate system to be parallel to the plane of the display screen, setting the direction of a Y axis to be vertical to the plane of the display screen, setting the plane of the real coordinate system to be the ground, setting the display screen to be vertical to the ground, and pointing the positive direction of the Y axis to the plane of the display screen; and acquiring the displacement of the three-dimensional glasses in the Y-axis direction, and determining the displacement of the three-dimensional glasses in the Y-axis direction as a first displacement.
Preferably, the obtaining of the first displacement amount of the three-dimensional glasses in the Y-axis direction can be achieved by the following steps: acquiring a first initial coordinate value and a first termination coordinate value of one-time displacement of the three-dimensional glasses, and extracting a Y-axis coordinate value Y in the first initial coordinate value1And a Y-axis coordinate value Y in the first termination coordinate values2(ii) a Using said coordinate value Y2Subtracting the coordinate value Y1Obtaining the displacement delta of the three-dimensional glasses in the Y-axis direction1The displacement amount Delta1Determining the first displacement amount; when delta is1When the angle is larger than 0, the three-dimensional glasses are displaced towards the direction close to the display screen, and when the angle is delta1When the distance is less than 0, the three-dimensional glasses displace towards the direction far away from the display screen; wherein the primary displacement is determined in the following manner: determining the three-dimensional glasses as one-time displacement from the beginning of moving to the current moving and standing process; or the three-dimensional glasses are divided into a plurality of positions according to a preset rule in the process from the beginning of moving to the current moving and stoppingAnd a shifting stage, wherein each shifting stage is determined as one shifting.
It should be noted that, after one-time displacement is divided into a plurality of displacement stages, each displacement stage can be set to a very small time interval, so that the time interval for updating the display image is also very small, and the smoothness and smoothness of the image display are improved.
According to a preferred embodiment of the present invention, the step S303 can be implemented by: amount of displacement Δ in the Y-axis direction according to three-dimensional glasses1Calculating the displacement delta of the virtual camera in the Y-axis direction in the virtual coordinate system of the simulation software2The amount of displacement Δ2The calculation formula of (2) is as follows: delta2＝K·△1Wherein K is a positive number; shifting quantity delta of the virtual camera in the Y-axis direction in the virtual coordinate system of the simulation software2The second amount of displacement is determined.
It should be noted that the displacement mentioned in the embodiments of the present invention is in a belt direction, that is, the displacement may be positive or negative, and after the coordinate values are superimposed on the displacement, the coordinate values may be increased or decreased, and the direction of the displacement corresponds to the direction of the coordinate system. For example, when the experiencer shifts in the real coordinate system, the shift Δ of the worn three-dimensional glasses in the y-axis1Is 0.2m, then Δ is according to the preset2＝K·△1The rule corresponds to the coordinate system of the simulation software, and when K is 0.1, the displacement delta of the virtual camera in the coordinate system of the simulation software is2And if the displacement is 0.02m, the coordinate value of the virtual camera after displacement in the simulation software can be obtained by superposing the correspondingly obtained displacement on the coordinate value of the virtual camera before displacement.
The moving capture system is arranged in the real space, and comprises a plurality of moving capture cameras, the three-dimensional glasses comprise a plurality of mark points, the coordinate values of the mark points are captured by the moving capture cameras, the mark points can form a three-dimensional image, and the moving capture cameras determine the coordinate values of the three-dimensional glasses according to the coordinate values of the mark points and input the coordinate values into the computer system.
According to a preferred embodiment of the present invention, the step S305 may be implemented by: and adjusting the size of the target object on the display screen of the display screen according to the determined second displacement amount of the virtual camera.
Preferably, the size of the target object on the display screen of the display screen is adjusted according to the determined second displacement amount of the virtual camera by the following steps: according to the displacement delta2Adjusting the visual angle range of the virtual camera; wherein, when the displacement amount Δ2When the angle is larger than 0, the visual angle range of the virtual camera is reduced, and when the displacement amount delta is larger2When the visual angle range is less than 0, enlarging the visual angle range of the virtual camera; adjusting the size of the target object on the display picture according to the visual angle range of the virtual camera; wherein the size of the target object on the display screen is enlarged when the view angle range of the virtual camera is reduced, and the size of the target object on the display screen is reduced when the view angle range of the virtual camera is enlarged.
In particular, according to said displacement Δ2Adjusting the visual angle range of the virtual camera; wherein, when the displacement amount Δ2If > 0, the amount of displacement Δ of the virtual camera can be adjusted2Is correspondingly reduced, when the displacement amount delta is smaller than the visual angle range of the virtual camera2If < 0, the amount of displacement Δ of the virtual camera can be adjusted2Corresponding to enlarging the view angle range of the virtual camera. Adjusting the size of the target object on the display picture according to the visual angle range of the virtual camera; when the view angle range of the virtual camera is reduced, the size of the target object on the display screen can be correspondingly enlarged according to a preset scale, and when the view angle range of the virtual camera is enlarged, the size of the target object on the display screen can be correspondingly reduced according to a preset scale.
For better understanding of the technical solutions of the embodiments of the present invention, the following description is further provided with reference to the accompanying drawings.
Fig. 4 is an illustration of an update method of an image display screen according to an embodiment of the present invention. As shown in fig. 4, the experiencer looks at the front of the display screen, and the visual angle of the experiencer is output by the virtual camera of the 3D graphics software according to a certain angle, and the size of the object viewed at this time is 202. 201 is a virtual simulation system display screen, 202 is content displayed on the screen, 203 is the position of 3D glasses worn by the experiencer, and 204 is the angle of view output by the virtual camera of the 3D simulation software.
Fig. 5 is another illustration of an update method of an image display screen according to an embodiment of the present invention. As shown in fig. 5, when the experiencer moves backward facing the screen, i.e. moves from position 304 to position 307, the motion capture system captures the displacement value, and after the displacement value is adapted to a certain coefficient, the visual angle of the virtual camera is increased from 306 to 305, the visual angle of the lens is increased, the display target is correspondingly decreased, and compared with 303, the display target is decreased to 302, so that the purpose that the visual target is decreased when the experiencer moves backward is achieved. Wherein 301 represents a virtual simulation system display screen, 302 represents that the content displayed on the screen becomes small (after the position of the experiencer moves), 303 represents the content displayed on the screen (before the position of the experiencer moves), 304 represents the position of the glasses of the experiencer (before the movement), 305 represents that the visual angle output by the virtual camera of the 3D simulation software becomes large (after the position of the experiencer moves), 306 represents the visual angle output by the virtual camera of the 3D simulation software (before the position of the experiencer moves), and 307 represents the position of the glasses of the experiencer (after the movement).
Fig. 6 is another illustration of an update method of an image display screen according to an embodiment of the present invention. As shown in fig. 6, when the motion capture system detects that the target moves from the position 404 to 407, the coordinate displacement value is measured, the value is transmitted to the virtual camera of the 3D graphics software in real time, and the virtual camera is moved in the software strictly according to the measured coordinate displacement value, without changing the focal length of the virtual camera. The change of the video output picture generated by the mobile camera can be transmitted to the display screen in real time, so that the image change seen by an experiencer is changed according to the real displacement of the experiencer in the virtual simulation space, and the purpose of real visual perception is achieved. Wherein 401 represents a virtual simulation system display screen, 402 represents that the content displayed on the screen becomes smaller (after the position of the experiencer moves), 403 represents the content displayed on the screen (before the position of the experiencer moves), 404 represents the position of the glasses of the experiencer (before the movement), 405 represents that the visual angle output by the virtual camera of the 3D simulation software is unchanged (after the position of the experiencer moves), 406 represents the visual angle output by the virtual camera of the 3D simulation software (before the position of the experiencer moves), and 407 represents the position of the glasses of the experiencer (after the movement).
Example 2
In this embodiment, an apparatus for updating an image display screen is further provided, which is configured to perform the steps in any of the above method embodiments, and the content that has been described is not repeated here. Fig. 7 is a block diagram of a structure of an apparatus for updating an image display screen according to an embodiment of the present invention, as shown in fig. 7, the apparatus including: an obtaining module 70, configured to obtain a first displacement amount of three-dimensional glasses in a real coordinate system, where the three-dimensional glasses are worn on eyes of an experiencer; a determining module 72, configured to determine a second displacement of the virtual camera in a virtual coordinate system of simulation software according to the first displacement of the three-dimensional glasses, where the virtual coordinate system in the simulation software has a corresponding relationship with the real coordinate system; and an updating module 74, configured to update a display screen on the display screen according to the determined second displacement amount of the virtual camera.
By the above device, the obtaining module 70 obtains a first displacement of the three-dimensional glasses in the real coordinate system, wherein the three-dimensional glasses are worn on the eyes of the experiencer; the determining module 72 determines a second displacement of the virtual camera in a virtual coordinate system of the simulation software according to the first displacement of the three-dimensional glasses, wherein the virtual coordinate system in the simulation software has a corresponding relationship with the real coordinate system; the update module 74 updates the display on the display screen based on the determined second amount of displacement of the virtual camera. The problem that in the prior art, the display picture after human body displacement is matched by changing the focal length of the virtual camera, so that the real visual change of human eyes is not met is solved, and the effect of real feedback that the image watched by the human eyes is identical to the actual human body movement condition is achieved.
According to a preferred embodiment of the present invention, preferably, the obtaining module 70 includes: the setting unit is used for setting the direction of an X axis in a real coordinate system to be parallel to the plane where the display screen is located, the direction of a Y axis is perpendicular to the plane where the display screen is located, the plane where the real coordinate system is located is the ground, the display screen is arranged perpendicular to the ground, and the positive direction of the Y axis points to the plane where the display screen is located; and the acquisition unit is used for acquiring the displacement of the three-dimensional glasses in the Y-axis direction and determining the displacement of the three-dimensional glasses in the Y-axis direction as a first displacement.
In this embodiment, a system for updating an image display screen is further provided, which is used to perform the steps in any of the above method embodiments, and the already described contents are not repeated here. Fig. 8 is a block diagram of a configuration of an image display screen update system according to an embodiment of the present invention, as shown in fig. 8, the system including: the motion capture system software is used for capturing coordinate values of the 3D glasses worn by the experiencer; the 3D graphic image software is used for updating the coordinate values of the virtual camera in the simulation system and correspondingly calculating the output picture of the video image; and the computer display card is used for displaying the output video image.
According to the embodiment of the invention, the acquired human eye coordinate values are output to the corresponding coordinate system in the virtual 3D software environment and worn on the camera, so that the effect of real feedback that the image watched by human eyes is identical to the actual human movement condition is achieved. The problem that in the prior art, the display picture after human body displacement is matched by changing the focal length of the virtual camera, so that the real visual change of human eyes is not met is solved.
Example 3
Embodiments of the present invention also provide a storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the above method embodiments when executed.
Alternatively, in the present embodiment, the storage medium may be configured to store a computer program for executing the steps of:
s1, acquiring a first displacement of the three-dimensional glasses in a real coordinate system, wherein the three-dimensional glasses are worn on the eyes of the experiencer;
s2, determining a second displacement of the virtual camera in a virtual coordinate system of the simulation software according to the first displacement of the three-dimensional glasses, wherein the virtual coordinate system in the simulation software has a corresponding relation with a real coordinate system;
and S3, updating the display picture on the display screen according to the determined second displacement amount of the virtual camera.
Optionally, the storage medium is further arranged to store a computer program for performing the steps of:
setting the direction of an X axis in a real coordinate system to be parallel to the plane of a display screen, setting the direction of a Y axis to be vertical to the plane of the display screen, wherein the plane of the real coordinate system is the ground, the display screen is arranged to be vertical to the ground, and the positive direction of the Y axis points to the plane of the display screen; and acquiring the displacement of the three-dimensional glasses in the Y-axis direction, and determining the displacement of the three-dimensional glasses in the Y-axis direction as the first displacement.
Optionally, the storage medium is further arranged to store a computer program for performing the steps of: acquiring a first initial coordinate value and a first termination coordinate value of the primary displacement of the three-dimensional glasses, and extracting a Y-axis coordinate value Y in the first initial coordinate value1And a Y-axis coordinate value Y in the first termination coordinate values2(ii) a Using the coordinate value Y2Minus the coordinate value Y1Obtaining the displacement delta of the three-dimensional glasses in the Y-axis direction1The amount of displacement is delta1Determining as a first displacement amount; when delta is1When the angle is larger than 0, the three-dimensional glasses are shifted towards the direction close to the display screen, and when the angle is larger than1When the distance is less than 0, the three-dimensional glasses are displaced towards the direction far away from the display screen; wherein the primary displacement is determined in the following manner: determining the three-dimensional glasses as one-time displacement from the beginning of moving to the current moving and standing process; or the three-dimensional glasses are divided into a plurality of displacement stages according to a preset rule in the process from the beginning of moving to the current moving and stopping, and each displacement stage is determined as one displacement.
Optionally, the storage medium is further arranged to store a computer program for performing the steps of: amount of displacement Δ in the Y-axis direction according to three-dimensional glasses1Calculating the virtual coordinate system of the virtual camera in the simulation softwareDisplacement Δ in the middle Y-axis direction2The amount of displacement Δ2The calculation formula of (2) is as follows: delta2＝K·△1Wherein K is a positive number; shifting quantity delta of the virtual camera in the Y-axis direction in the virtual coordinate system of the simulation software2The second amount of displacement is determined.
Optionally, the storage medium is further arranged to store a computer program for performing the steps of: according to the displacement delta2Adjusting the visual angle range of the virtual camera; wherein, when the displacement amount Δ2When the angle is larger than 0, the visual angle range of the virtual camera is reduced, and when the displacement amount delta is larger2When the visual angle range is less than 0, enlarging the visual angle range of the virtual camera; adjusting the size of the target object on the display picture according to the visual angle range of the virtual camera; wherein the size of the target object on the display screen is enlarged when the view angle range of the virtual camera is reduced, and the size of the target object on the display screen is reduced when the view angle range of the virtual camera is enlarged.
Optionally, in this embodiment, the storage medium may include, but is not limited to: various media capable of storing computer programs, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.
Embodiments of the present invention also provide an electronic device comprising a memory having a computer program stored therein and a processor arranged to run the computer program to perform the steps of any of the above method embodiments.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, acquiring a first displacement of the three-dimensional glasses in a real coordinate system, wherein the three-dimensional glasses are worn on the eyes of the experiencer;
s2, determining a second displacement of the virtual camera in a virtual coordinate system of the simulation software according to the first displacement of the three-dimensional glasses, wherein the virtual coordinate system in the simulation software has a corresponding relation with a real coordinate system;
and S3, updating the display picture on the display screen according to the determined second displacement amount of the virtual camera.
Optionally, the processor is further arranged to store a computer program for performing the steps of:
setting the direction of an X axis in a real coordinate system to be parallel to the plane of a display screen, setting the direction of a Y axis to be vertical to the plane of the display screen, wherein the plane of the real coordinate system is the ground, the display screen is arranged to be vertical to the ground, and the positive direction of the Y axis points to the plane of the display screen; and acquiring the displacement of the three-dimensional glasses in the Y-axis direction, and determining the displacement of the three-dimensional glasses in the Y-axis direction as the first displacement.
Optionally, the processor is further arranged to store a computer program for performing the steps of:
acquiring a first initial coordinate value and a first termination coordinate value of the primary displacement of the three-dimensional glasses, and extracting a Y-axis coordinate value Y in the first initial coordinate value1And a Y-axis coordinate value Y in the first termination coordinate values2(ii) a Using the coordinate value Y2Minus the coordinate value Y1Obtaining the displacement delta of the three-dimensional glasses in the Y-axis direction1The amount of displacement is delta1Determining as a first displacement amount; when delta is1When the angle is larger than 0, the three-dimensional glasses are shifted towards the direction close to the display screen, and when the angle is larger than1When the distance is less than 0, the three-dimensional glasses are displaced towards the direction far away from the display screen; wherein the primary displacement is determined in the following manner: determining the three-dimensional glasses as one-time displacement from the beginning of moving to the current moving and standing process; or the three-dimensional glasses are divided into a plurality of displacement stages according to a preset rule in the process from the beginning of moving to the current moving and stopping, and each displacement stage is determined as one displacement.
Optionally, the processor is further arranged to store a computer program for performing the steps of:
amount of displacement Δ in the Y-axis direction according to three-dimensional glasses1Calculating the displacement delta of the virtual camera in the Y-axis direction in the virtual coordinate system of the simulation software2The amount of displacement Δ2The calculation formula of (2) is as follows: delta2＝K·△1Wherein K is a positive number; shifting quantity delta of the virtual camera in the Y-axis direction in the virtual coordinate system of the simulation software2The second amount of displacement is determined.
Optionally, the processor is further arranged to store a computer program for performing the steps of:
according to the displacement delta2Adjusting the visual angle range of the virtual camera; wherein, when the displacement amount Δ2When the angle is larger than 0, the visual angle range of the virtual camera is reduced, and when the displacement amount delta is larger2When the visual angle range is less than 0, enlarging the visual angle range of the virtual camera; adjusting the size of the target object on the display picture according to the visual angle range of the virtual camera; wherein the size of the target object on the display screen is enlarged when the view angle range of the virtual camera is reduced, and the size of the target object on the display screen is reduced when the view angle range of the virtual camera is enlarged.
For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and optional implementation manners, and details of this embodiment are not described herein again.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the principle of the present invention should be included in the protection scope of the present invention.
Claims (8)
1. A method for updating a display, comprising:
acquiring a first displacement amount of three-dimensional glasses in a real coordinate system, wherein the three-dimensional glasses are worn on the eyes of an experiencer;
wherein the acquiring a first displacement amount of the three-dimensional glasses in a real coordinate system comprises: the three-dimensional glasses are divided into a plurality of displacement stages according to a preset rule in the process from the beginning of moving to the current moving and standing, and each displacement stage is determined to be displacement; or, the three-dimensional glasses are determined to be a displacement in the process from the beginning of moving to the current moving and standing; acquiring the first displacement according to the primary displacement;
determining a second displacement of the virtual camera in a virtual coordinate system of simulation software according to the first displacement of the three-dimensional glasses, wherein the virtual coordinate system in the simulation software has a corresponding relation with the real coordinate system;
adjusting the size of the target object on the display screen of the display screen according to the determined second displacement amount of the virtual camera, comprising: according to the second displacement Delta2Adjusting the visual angle range of the virtual camera; when the three-dimensional glasses are displaced towards the direction close to the display screen, the second displacement delta2When the visual angle range of the virtual camera is larger than 0, the visual angle range of the virtual camera is narrowed, when the three-dimensional glasses are displaced towards the direction far away from the display screen, the second displacement delta2When the visual angle range is less than 0, enlarging the visual angle range of the virtual camera; depending on the range of viewing angles of the virtual camera,adjusting the size of the target object on the display screen; wherein the size of the target object on the display screen is enlarged when the view angle range of the virtual camera is reduced, and the size of the target object on the display screen is reduced when the view angle range of the virtual camera is enlarged.
2. The method of claim 1, wherein obtaining a first amount of displacement of the three-dimensional eyewear in a real coordinate system comprises:
setting the direction of an X axis in the real coordinate system to be parallel to the plane of the display screen, setting the direction of a Y axis to be vertical to the plane of the display screen, setting the plane of the real coordinate system to be the ground, setting the display screen to be vertical to the ground, and pointing the positive direction of the Y axis to the plane of the display screen;
and acquiring the displacement of the three-dimensional glasses in the Y-axis direction, and determining the displacement of the three-dimensional glasses in the Y-axis direction as the first displacement.
3. The method according to claim 2, wherein obtaining the displacement of the three-dimensional glasses in the Y-axis direction, and determining the displacement of the three-dimensional glasses in the Y-axis direction as the first displacement comprises:
acquiring a first initial coordinate value and a first termination coordinate value of the primary displacement of the three-dimensional glasses, and extracting a Y-axis coordinate value Y in the first initial coordinate value1And a Y-axis coordinate value Y in the first termination coordinate values2；
Using said coordinate value Y2Subtracting the coordinate value Y1Obtaining the displacement delta of the three-dimensional glasses in the Y-axis direction1The displacement amount Delta1Determining the first displacement amount; when delta is1When the angle is larger than 0, the three-dimensional glasses are displaced towards the direction close to the display screen, and when the angle is delta1When the distance is less than 0, the three-dimensional glasses are displaced towards the direction far away from the display screen.
4. The method of claim 3, wherein determining a second amount of displacement of the virtual camera in the virtual coordinate system of the simulation software based on the first amount of displacement of the three-dimensional eyewear comprises:
amount of displacement Δ in the Y-axis direction according to three-dimensional glasses1Calculating the displacement delta of the virtual camera in the Y-axis direction in the virtual coordinate system of the simulation software2The amount of displacement Δ2The calculation formula of (2) is as follows: delta2=K·△1Wherein K is a positive number;
shifting quantity delta of the virtual camera in the Y-axis direction in the virtual coordinate system of the simulation software2The second amount of displacement is determined.
5. An apparatus for updating a display screen, comprising:
the system comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring a first displacement amount of three-dimensional glasses in a real coordinate system, and the three-dimensional glasses are worn on the eyes of an experiencer;
the determining module is used for determining a second displacement of the virtual camera in a virtual coordinate system of simulation software according to the first displacement of the three-dimensional glasses, wherein the virtual coordinate system in the simulation software has a corresponding relation with the real coordinate system;
an updating module, configured to adjust a size of a target object on a display screen of a display screen according to the determined second displacement amount of the virtual camera, including: according to the second displacement Delta2Adjusting the visual angle range of the virtual camera; when the three-dimensional glasses are displaced towards the direction close to the display screen, the second displacement delta2When the visual angle range of the virtual camera is larger than 0, the visual angle range of the virtual camera is narrowed, when the three-dimensional glasses are displaced towards the direction far away from the display screen, the second displacement delta2When the visual angle range is less than 0, enlarging the visual angle range of the virtual camera; adjusting the size of the target object on the display picture according to the visual angle range of the virtual camera; wherein, when the visual angle range of the virtual camera is reduced, the target object is enlarged on the display pictureA size of the target object on the display screen is reduced when the view angle range of the virtual camera is enlarged;
wherein the obtaining module is further configured to perform the following operations: the acquiring a first displacement amount of the three-dimensional glasses in a real coordinate system comprises: the three-dimensional glasses are divided into a plurality of displacement stages according to a preset rule in the process from the beginning of moving to the current moving and standing, and each displacement stage is determined to be displacement; or, the three-dimensional glasses are determined to be a displacement in the process from the beginning of moving to the current moving and standing; and acquiring the first displacement according to the one-time displacement.
6. The apparatus of claim 5, wherein the obtaining module comprises:
the setting unit is used for setting the direction of an X axis in the real coordinate system to be parallel to the plane where the display screen is located, the direction of a Y axis is perpendicular to the plane where the display screen is located, the plane where the real coordinate system is located is the ground, the display screen is perpendicular to the ground, and the positive direction of the Y axis points to the plane where the display screen is located;
and the acquisition unit is used for acquiring the displacement of the three-dimensional glasses in the Y-axis direction and determining the displacement of the three-dimensional glasses in the Y-axis direction as the first displacement.
7. A storage medium, in which a computer program is stored, wherein the computer program is arranged to perform the method of any of claims 1 to 4 when executed.
8. An electronic device comprising a memory and a processor, wherein the memory has stored therein a computer program, and wherein the processor is arranged to execute the computer program to perform the method of any of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811506335.5A CN109445103B (en) | 2018-12-10 | 2018-12-10 | Display picture updating method and device, storage medium and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811506335.5A CN109445103B (en) | 2018-12-10 | 2018-12-10 | Display picture updating method and device, storage medium and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109445103A CN109445103A (en) | 2019-03-08 |
| CN109445103B true CN109445103B (en) | 2022-03-01 |
Family
ID=65556443
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811506335.5A Active CN109445103B (en) | 2018-12-10 | 2018-12-10 | Display picture updating method and device, storage medium and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109445103B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110430421A (en) * | 2019-06-24 | 2019-11-08 | 南方电网调峰调频发电有限公司 | A kind of optical tracking positioning system for five face LED-CAVE |
| CN111273878B (en) * | 2020-01-08 | 2020-11-10 | 广州市三川田文化科技股份有限公司 | Video playing method and device based on CAVE space and storage medium |
| CN111462204B (en) * | 2020-02-13 | 2023-03-03 | 腾讯科技（深圳）有限公司 | Virtual model generation method, virtual model generation device, storage medium, and electronic device |
| CN111369619B (en) * | 2020-02-28 | 2023-04-07 | 神华铁路装备有限责任公司 | VR visual angle correction method, device, system and storage medium |
| CN111420402B (en) * | 2020-03-18 | 2021-05-14 | 腾讯科技（深圳）有限公司 | Virtual environment picture display method, device, terminal and storage medium |
| CN112162640B (en) * | 2020-10-13 | 2022-10-25 | 深圳晶泰科技有限公司 | Crystal display method and system |
| CN114755839A (en) * | 2021-04-23 | 2022-07-15 | 深圳市瑞立视多媒体科技有限公司 | Holographic sand table display system |
| CN113206991A (en) * | 2021-04-23 | 2021-08-03 | 深圳市瑞立视多媒体科技有限公司 | Holographic display method, system, computer program product and storage medium |
| CN114593688B (en) * | 2022-03-03 | 2023-10-03 | 惠州Tcl移动通信有限公司 | Three-dimensional measurement method and device based on AR (augmented reality) glasses, AR glasses and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104281391A (en) * | 2013-07-03 | 2015-01-14 | 辉达公司 | Method for zooming into and out of an image shown on a display |
| CN107077216A (en) * | 2016-12-19 | 2017-08-18 | 深圳市阳日电子有限公司 | Method and mobile terminal that a kind of picture is shown |
| CN108292146A (en) * | 2016-02-08 | 2018-07-17 | 谷歌有限责任公司 | Laser designator interaction in virtual reality and scaling |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH05204548A (en) * | 1992-01-30 | 1993-08-13 | Wacom Co Ltd | Method and device for moving display position |
| CN106157236A (en) * | 2015-04-20 | 2016-11-23 | 王安 | Reality display hologram |
| CN106293417A (en) * | 2015-06-08 | 2017-01-04 | 中兴通讯股份有限公司 | Screen-picture display packing and device |
| US9824500B2 (en) * | 2016-03-16 | 2017-11-21 | Microsoft Technology Licensing, Llc | Virtual object pathing |
| CN106412424A (en) * | 2016-09-20 | 2017-02-15 | 乐视控股（北京）有限公司 | View adjusting method and device for panoramic video |
| CN107479697A (en) * | 2017-07-27 | 2017-12-15 | 北京云创启航智能科技有限公司 | Vision guide repositions mobile method and device under virtual reality |
-
2018
- 2018-12-10 CN CN201811506335.5A patent/CN109445103B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104281391A (en) * | 2013-07-03 | 2015-01-14 | 辉达公司 | Method for zooming into and out of an image shown on a display |
| CN108292146A (en) * | 2016-02-08 | 2018-07-17 | 谷歌有限责任公司 | Laser designator interaction in virtual reality and scaling |
| CN107077216A (en) * | 2016-12-19 | 2017-08-18 | 深圳市阳日电子有限公司 | Method and mobile terminal that a kind of picture is shown |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109445103A (en) | 2019-03-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109445103B (en) | Display picture updating method and device, storage medium and electronic device | |
| CN109345556B (en) | Neural network foreground separation for mixed reality | |
| CN109246463B (en) | Method and device for displaying bullet screen | |
| EP3166079A1 (en) | Augmented reality method and system based on wearable device | |
| CN108292489A (en) | Information processing unit and image generating method | |
| CN109743892B (en) | Virtual reality content display method and device | |
| CN109840946B (en) | Virtual object display method and device | |
| US20170195664A1 (en) | Three-dimensional viewing angle selecting method and apparatus | |
| CN104536579A (en) | Interactive three-dimensional scenery and digital image high-speed fusing processing system and method | |
| CN109752951B (en) | Control system processing method and device, storage medium and electronic device | |
| KR102637901B1 (en) | A method of providing a dolly zoom effect by an electronic device and the electronic device utilized in the method | |
| CN109510975B (en) | Video image extraction method, device and system | |
| CN111111173A (en) | Information display method, device and storage medium for virtual reality game | |
| US11620792B2 (en) | Fast hand meshing for dynamic occlusion | |
| CN105611267B (en) | Merging of real world and virtual world images based on depth and chrominance information | |
| CN110855972A (en) | Image processing method, electronic device, and storage medium | |
| CN109360277B (en) | Virtual simulation display control method and device, storage medium and electronic device | |
| WO2017062730A1 (en) | Presentation of a virtual reality scene from a series of images | |
| CN112015264A (en) | Virtual reality display method, virtual reality display device and virtual reality equipment | |
| CN113870213A (en) | Image display method, image display device, storage medium, and electronic apparatus | |
| CN109842791B (en) | Image processing method and device | |
| CN110892706B (en) | Method for displaying content derived from light field data on a 2D display device | |
| CN109801351B (en) | Dynamic image generation method and processing device | |
| CN108734791B (en) | Panoramic video processing method and device | |
| CN116168076A (en) | Image processing method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200803 Address after: No.206, floor 2, No.11, Fengzhi East Road, Baiwang Innovation Technology Park, Xibeiwang Town, Haidian District, Beijing 100094 Applicant after: Beijing Virtual Dynamic Technology Co.,Ltd. Address before: 100091, No. 9 Hongqi West Street, Beijing, Haidian District Applicant before: LEYARD OPTOELECTRONIC Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |