WO2019015249A1

WO2019015249A1 - Virtual-reality-based image display method and apparatus, and virtual reality helmet device

Info

Publication number: WO2019015249A1
Application number: PCT/CN2017/117556
Authority: WO
Inventors: 夏钦展
Original assignee: 歌尔科技有限公司
Priority date: 2017-07-18
Filing date: 2017-12-20
Publication date: 2019-01-24
Also published as: CN107277485B; CN107277485A

Abstract

Disclosed are a virtual-reality-based image display method and apparatus, and a virtual reality helmet device. The method comprises: when two cameras photograph the same object, respectively recording horizontal angles of field of view and vertical angles of field of view of two images and saving same in metadata of the corresponding images, so that based on the horizontal angles of field of view and the vertical angles of field of view of the two images, horizontal widths and vertical widths of the two images displayed on a virtual display screen can be calculated; and when the two images displayed on the virtual display screen are projected into human eyes, the human eyes acquiring the two images and then producing a stereoscopic impression in the brain. Since an actual horizontal angle of field of view and an actual vertical angle of field of view during imaging for a left eye and a right eye are considered when an image is displayed on a virtual display screen, the image displayed on the virtual display screen has a scale consistent with that of an object in a real scene, so that the visual perception of a user for a virtual scene is consistent with the visual perception for the real scene, and the sense of realism and immersion for the user can be improved.

Description

Virtual reality based image display method and device, virtual reality helmet device

cross reference

The present application is hereby incorporated by reference in its entirety in its entirety in its entirety in the the the the the the the the the the the the the

Technical field

The present invention relates to the field of human-computer interaction technologies, and in particular, to a virtual reality-based image display method and apparatus, and a virtual reality helmet device.

Background technique

Virtual reality technology is a technology that combines computer graphics systems and various control interface devices to generate immersive virtual scenes in an interactive, three-dimensional environment on a computer.

For the user, visual perception of the virtual scene is the basis for providing true immersion. In order to realize the stereoscopic display of the virtual scene, the virtual scene can be converted into a virtual stereo scene in combination with a computer graphics system, so that the virtual stereo scene is presented in the real scene.

However, in the prior art, the virtual scene is linearly converted into a virtual stereo scene by using a fixed conversion parameter, which may result in the virtual stereo scene not being well adapted to the real scene, that is, the user is virtual. The visual perception of the scene is inconsistent with the visual perception in the real scene, so that the better stereoscopic display effect can not be achieved, and the user's true immersion is reduced.

Summary of the invention

In order to solve the above problems, the present invention provides an image display method and apparatus based on virtual reality, and an electronic device, which can achieve consistency between visual perception of a virtual scene and visual perception in a real scene, and improve the adaptation of the virtual stereo scene and the real scene. Matching.

The invention provides an image display method based on virtual reality, comprising:

Obtaining a horizontal field of view and a vertical field of view of the left eye image and a horizontal field of view and a vertical field of view of the right eye image, wherein the left eye image and the right eye image are respectively the same for the first camera and the second camera An image taken by each object;

Calculating a horizontal width and a vertical width of the two images on the virtual display screen according to the horizontal field of view and the vertical field of view of the two images;

The two images are displayed on the virtual display screen according to the horizontal width and the vertical direction width of the two images on the virtual display screen.

Optionally, before acquiring the horizontal field of view and the vertical field of view of the two images, respectively:

When photographing the left eye image and the right eye image, respectively recording a horizontal field of view angle and a vertical field of view angle when the first camera and the second camera respectively capture images for the same object;

The horizontal field of view and the vertical field of view when the image is captured are saved to the metadata of the corresponding image to obtain the horizontal field of view and the vertical field of view of the image from the metadata of the image.

Optionally, calculating a horizontal width and a vertical width of the two images on the virtual display screen according to the horizontal field of view and the vertical field of view of the two images, respectively:

Calculating the horizontal width of the image on the virtual display screen according to the horizontal field of view angle of the image and the distance between the virtual imaging device corresponding to the preset virtual display screen distance;

The vertical width of the image on the virtual display screen is calculated according to the vertical field of view of the image and the distance between the virtual display device and the corresponding virtual imaging device.

Optionally, the method includes:

Calculate the horizontal width of the image on the virtual display screen according to the calculation formula B=2A*tgα The vertical direction width, where A is the distance between the virtual display device corresponding to the preset virtual display screen distance, and when α is the horizontal field of view angle of the image, then B is the horizontal width of the image on the virtual display screen. Or when α is the vertical field of view of the image, then B is the vertical width of the image on the virtual display.

Optionally, two optical imaging devices are disposed corresponding to the left and right eyes, including two lenses corresponding to the left and right eyes, a first lens and a second lens, and the two lenses are symmetrically mounted on the virtual reality device, and the hardware parameters of the two lenses are the same. And the lay length between the two lenses is 6.5 cm.

The invention also provides an image display device based on virtual reality, comprising:

And an acquiring module, configured to respectively acquire a horizontal field of view and a vertical field of view of the left eye image and a horizontal field of view and a vertical field of view of the right eye image, wherein the left eye image and the right eye image are respectively the first camera and An image captured by the second camera for the same object;

a calculation module, configured to calculate a horizontal width and a vertical width of the two images on the virtual display screen according to the horizontal field of view and the vertical field of view of the two images;

And a display module, configured to display the two images on the virtual display screen according to the horizontal direction width and the vertical direction width of the two images on the virtual display screen.

Optionally, the device further includes:

a recording module, configured to record a horizontal field of view and a vertical field of view when the first camera and the second camera respectively capture images for the same object when the left eye image and the right eye image are captured ;

a saving module for saving a horizontal field of view and a vertical field of view when capturing an image into metadata of a corresponding image, so as to obtain a horizontal field of view and a vertical field of view when the image is captured from the metadata of the image .

Optionally, the computing module is specifically configured to:

Calculate the horizontal width and vertical width of the image on the virtual display screen according to the calculation formula B=2A*tgα, where A is the distance between the virtual imaging device corresponding to the preset virtual display screen distance, when α is the image When the horizontal field of view is angle, then B is the horizontal width of the image on the virtual display screen, or when α is the vertical field of view of the image, then B is the vertical width of the image on the virtual display screen.

The invention provides a virtual reality helmet device, comprising: a processor and a memory;

The memory is for storing one or more computer instructions, wherein the one or more computer instructions are executed by the processor to implement the following steps:

The present invention provides a non-volatile computer storage medium having stored thereon computer program instructions that, when executed by a processor, implement the aforementioned virtual reality-based image display method.

In the embodiment of the present invention, two optical imaging devices are arranged on the virtual reality device corresponding to the left and right eyes. When two cameras are shooting for the same object, two different images are generated for the left and right eyes, and the horizontal fields of the two images are respectively recorded. The angular and vertical field of view angles are saved to the metadata of the corresponding image, so that the horizontal width and vertical of the two images displayed on the virtual display screen can be calculated based on the horizontal field of view and the vertical field of view of the two images. Direction width when displayed in virtual The two images on the display are projected into the human eye, and the human eye acquires the two images to create a stereoscopic effect in the brain. Since the horizontal field angle and the vertical field angle when actually imaging the left and right eyes are taken into account when displaying the image on the virtual display screen, the display image on the virtual display screen is consistent with the object ratio in the real scene, so that The user's visual perception of the virtual scene is consistent with the visual perception in the real scene, which can improve the user's true immersion.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, a brief description of the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

1 is a schematic flow chart of an image display method based on virtual reality according to an embodiment of the present invention;

2 is a schematic diagram of a virtual scene arrangement according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of a lens arrangement according to an embodiment of the present invention; FIG.

4 is a schematic structural diagram of an image display device based on virtual reality according to an embodiment of the present invention;

FIG. 5 shows a schematic diagram of the internal configuration of the virtual reality helmet device 100 in some embodiments.

Detailed ways

The technical solutions of the present application will be clearly and completely described in the following with reference to the specific embodiments of the present application and the corresponding drawings. It is apparent that the described embodiments are only a part of the embodiments of the present application, and not all of them. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.

FIG. 1 is a schematic flowchart of a virtual reality-based image display method according to an embodiment of the present invention. As shown in FIG. 1 , the method includes:

101. Obtain a horizontal field of view and a vertical field of view of the left eye image and a horizontal field of view and a vertical field of view of the image of the right eye, respectively.

Wherein, the left eye image and the right eye image are images respectively taken by the first camera and the second camera for the same object;

When the first camera and the second camera respectively capture images for the same object, two different images may be generated for the left and right eyes, for example, one image is an image taken by the first camera for the right eye (referred to as a right eye image), and One image is an image taken by a second camera for the left eye (referred to as a left eye image).

In order to enable the display image on the virtual display screen to be consistent with the ratio of the objects in the real scene, so that the visual perception of the virtual scene is consistent with the visual perception in the real scene, in the embodiment of the present invention, when the first camera When the second camera generates an image corresponding to the left and right eyes (the left eye image and the right eye image) for the same object, the horizontal angle of view and the vertical angle of view of the two images are respectively recorded, that is, the first camera captures an image of the same object. The horizontal field of view and the vertical field of view, and the horizontal field of view and the vertical field of view when the second camera captures an image of the same object. Thereafter, in order to save memory resources of the virtual reality device, two images can be The horizontal field of view and the vertical field of view are respectively saved into the metadata of the corresponding image, so that the virtual reality device obtains the horizontal field of view and the vertical field of view of the image from the metadata of the image before the virtual display; The horizontal field of view and the vertical field of view saved in the metadata can be a string of strings.

102. Calculate a horizontal width and a vertical width of the two images on the virtual display screen according to the horizontal field of view and the vertical field of view of the two images;

2 is a schematic diagram of a virtual scene arrangement according to an embodiment of the present invention. As shown in FIG. 2, two virtual cameras are arranged in a virtual scene, and a virtual camera on the left corresponds to the left eye, and a virtual camera on the right corresponds to the right eye. A virtual display is placed at a distance in front of the virtual camera (the distance is variable), wherein one virtual display is used to display a virtual image for the right eye and the other virtual display is used to display a virtual image for the left eye. image.

When the step 102 is specifically implemented, for example, according to the horizontal angle of view of the right eye image acquired in the above step 101, and the distance between the virtual imaging devices corresponding to the virtual display screen distance preset according to FIG. 3, the right can be calculated. The horizontal direction width of the eye image on the virtual display screen; the vertical field of view angle of the right eye image acquired in the above step 101, and the distance between the virtual imaging devices corresponding to the virtual display screen distance preset according to FIG. , the vertical width of the right eye image on the virtual display can be calculated. In the same way, the horizontal width and the vertical width of the left eye image on the virtual display screen can be obtained.

In an optional implementation manner of the present invention, the horizontal width and the vertical width of the image on the virtual display screen may be calculated according to the calculation formula B=2A*tgα; wherein A is a virtual imaging corresponding to the virtual display screen distance. The distance between the device (or virtual camera), when α is the horizontal field of view of the image, then B is the horizontal width of the image on the virtual display, or when α is the vertical field of view of the image, then B The width of the image in the vertical direction on the virtual display.

When the distance A between the virtual imaging device (or virtual camera) corresponding to the virtual display screen distance is i1, the horizontal width or vertical width B1 of the corresponding image on the virtual display screen; the virtual virtual display distance corresponding to the virtual When the distance A between the imaging devices (or virtual cameras) is i2, the corresponding image has a horizontal width or a vertical width B2 on the virtual display screen.

103. Display the two images on the virtual display screen according to the horizontal width and the vertical width of the two images on the virtual display screen.

When two images displayed on the virtual display are projected into the human eye, the human eye acquires the two images to create a stereoscopic effect in the brain.

It should be noted that, in the embodiment of the present invention, in order to reduce the visual error of the left and right eyes and improve the real immersion of the user on the virtual scene, FIG. 3 is a schematic diagram of a lens arrangement according to an embodiment of the present invention, as shown in FIG. The first lens (lens 1) and the second lens (lens 2) are respectively disposed corresponding to the left and right eyes, such as lens 1 for the left eye, lens 2 for the right eye, and two lenses symmetrically mounted on the virtual reality device (such as virtual reality On the headgear, the hardware parameters of the two lenses are the same, and the lay length between the two lenses is 6.5 cm.

It can be seen that, in the embodiment of the present invention, when the virtual display screen is away from the virtual imaging device (or virtual When the camera is relatively close, the horizontal width or vertical width of the corresponding image on the virtual display screen is also proportionally smaller; when the virtual display screen is far away from the virtual imaging device (or virtual camera), the corresponding image The horizontal width or vertical width of the image on the virtual display is also proportionally larger. That is to say, regardless of the distance between the virtual display screen and the virtual imaging device (or virtual camera), the user's visual perception in the virtual scene is that the object size ratio does not change, that is, the user's visual perception and reality in the virtual scene. The visual perception in the scene is consistent. Therefore, the image display of the embodiment of the invention can achieve a better display effect, and the real immersion of the user is greatly improved.

In the prior art, the distance between the virtual display screen and the virtual imaging device (or virtual camera) is far or near, and the image is on the virtual display screen, regardless of the horizontal field of view and the vertical field of view when the image is taken. The size above does not change, so when the virtual display screen is closer to the virtual imaging device (or virtual camera), the user's visual perception of the virtual scene is that the object feels great; when the virtual display screen is away from the virtual imaging device ( When the virtual camera is relatively far away, the user's visual perception in the virtual scene is that the object feels very small. Therefore, the prior art image display cannot achieve a better display effect, and the user's true immersion is greatly reduced.

4 is a schematic structural diagram of an image display device based on virtual reality according to an embodiment of the present invention. As shown in FIG. 4, the method includes:

Optionally, the device further includes:

a recording module, configured to record, when the left eye image and the right eye image are captured, a horizontal angle of view and a horizontal angle of view when the first camera and the second camera respectively capture images for the same object Vertical field of view;

Optionally, the computing module is specifically configured to:

The device in the embodiment of the present invention can perform the method shown in FIG. 1 , and the implementation principle and technical effects thereof are not described again.

In the embodiment of the present invention, the foregoing apparatus includes a processor and a memory, where the memory is used to store one or more computer instructions, wherein the one or more computer instructions are executed by the processor to implement the following steps. :

Optionally, the processor is further configured to perform all or part of the steps in the foregoing embodiments.

The embodiment of the present invention further provides a non-volatile computer storage medium on which computer program instructions are stored, and when the computer program instructions are executed by the processor, the virtual reality-based image display method provided by the foregoing embodiments is implemented.

It should be noted that the method of the embodiment of the present invention is not limited to the image display method based on virtual reality, and the video display based on virtual reality can also be realized, because the video is a continuous image collection of time frames, when two cameras are aimed at the human eye. When the right-eye image and the left-eye image of each time frame are taken in the field of view of the eye, the horizontal and vertical angles of view of the right-eye image and the left-eye image of each time frame can be recorded and saved to the corresponding In the metadata of the right eye image and the left eye image of the time frame, the right eye image of each time frame can be calculated based on the horizontal field of view and the vertical field of view of the right eye image and the left eye image of each time frame. And the left eye image displays the horizontal width and the vertical width on the virtual display screen, and when the right eye image and the left eye image of each time frame displayed on the virtual display are projected into the human eye, the human eye acquires the video. Create a three-dimensional sense in the brain. And the user's visual perception in the virtual video scene is consistent with the visual perception in the real video scene. Therefore, the video image display of the embodiment of the present invention can achieve a better display effect, and the real immersion of the user is greatly improved. Those skilled in the art should understand that embodiments of the present invention can be provided as a method, a system, or a computer program. product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

The electronic device provided by some embodiments of the present invention may be an external head mounted display device or an integrated head mounted display device, wherein the external head mounted display device needs to be used in conjunction with an external processing system (eg, a computer processing system).

The display unit 101 may include a display panel disposed on a side surface of the virtual reality helmet device 100 facing the user's face, which may be a whole panel or respectively corresponding to the user's left eye and The left and right panels of the right eye. The display panel may be an electroluminescence (EL) element, a liquid crystal display or a microdisplay having a similar structure, or a laser-scanned display in which the retina may be directly displayed or similar.

The virtual image optical unit 102 photographs the image displayed by the display unit 101 in an enlarged manner, and allows the user to observe the displayed image in the enlarged virtual image. As the display image outputted to the display unit 101, it may be an image of a virtual scene supplied from a content reproduction device (a Blu-ray disc or a DVD player) or a streaming server, or an image of a real scene photographed using the external camera 110. In some embodiments, virtual image optical unit 102 can include a lens unit, such as a spherical lens, an aspheric lens, a Fresnel lens, and the like.

The input operation unit 103 includes at least one operation member for performing an input operation, such as a button, a button, a switch, or other similarly functioned component, receives a user instruction through the operation member, and outputs an instruction to the control unit 107.

The status information acquisition unit 104 is configured to acquire status information of the user wearing the virtual reality helmet device 100. The status information acquisition unit 104 may include various types of sensors for detecting status information by itself, and may acquire status information from an external device such as a smartphone, a wristwatch, and other multi-function terminals worn by the user through the communication unit 105. The status information acquisition unit 104 can acquire location information and/or posture information of the user's head. The status information acquisition unit 104 may include one or more of a gyro sensor, an acceleration sensor, a global positioning system (GPS) sensor, a geomagnetic sensor, a Doppler effect sensor, an infrared sensor, and a radio frequency field intensity sensor. Further, the state information acquisition unit 104 acquires state information of the user wearing the virtual reality helmet device 100, for example, acquires, for example, an operation state of the user (whether the user wears the virtual reality helmet device 100), an action state of the user (such as still, walking, running) And the state of movement such as the state of the hand or fingertip, the open or closed state of the eye, the direction of the line of sight, the size of the pupil, the mental state (whether the user is immersed in observing the displayed image, and the like), or even the physiological state.

The communication unit 105 performs communication processing, modulation and demodulation processing with an external device, and encoding and decoding processing of the communication signal. In addition, the control unit 107 can transmit transmission data from the communication unit 105 to an external device. Communication can be wired or wireless, such as mobile HD links (MHL) or Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI), Wireless Fidelity (Wi-Fi), Bluetooth communication or Bluetooth low energy communication, and the mesh network of the IEEE 802.11s standard. Additionally, communication unit 105 can be a cellular wireless transceiver that operates in accordance with Wideband Code Division Multiple Access (W-CDMA), Long Term Evolution (LTE), and the like.

In some embodiments, the virtual reality helmet device 100 can also include a storage unit, which is a mass storage device configured to have a solid state drive (SSD) or the like. In some embodiments, storage unit 106 can store applications or various types of data. For example, content viewed by a user using the virtual reality helmet device 100 may be stored in the storage unit 106.

In some embodiments, the virtual reality helmet device 100 may further include a control unit, and the control unit 107 may include a computer processing unit (CPU) or other device having similar functions. In some embodiments, control unit 107 may be used to execute an application stored by storage unit 106, or control unit 107 may also be used to perform the methods, functions, and operations disclosed in some embodiments of the present application.

The image processing unit 108 is for performing signal processing such as image quality correction related to the image signal output from the control unit 107, and converting its resolution into a resolution according to the screen of the display unit 101. Then, the display driving unit 109 sequentially selects each line of pixels of the display unit 101, and sequentially scans each line of pixels of the display unit 101 line by line, thereby providing a pixel signal based on the signal-processed image signal.

In some embodiments, the virtual reality helmet device 100 can also include an external camera. The external camera 110 may be disposed on a front surface of the main body of the virtual reality helmet device 100, and the external camera 110 may be one or more. The external camera 110 can acquire three-dimensional information and can also be used as a distance sensor. Additionally, a position sensitive detector (PSD) or other type of distance sensor that detects reflected signals from the object can be used with the external camera 110. The external camera 110 and the distance sensor can be used to detect the body position, posture, and shape of the user wearing the virtual reality helmet device 100. In addition, under certain conditions, the user can directly view or preview the real scene through the external camera 110.

In some embodiments, the virtual reality helmet device 100 may further include a sound processing unit, and the sound processing unit 111 may perform sound quality correction or sound of the sound signal output from the control unit 107. Sound amplification, and signal processing of input sound signals. Then, the sound input/output unit 112 outputs the sound to the outside and the sound from the microphone after the sound processing.

It should be noted that the structure or component shown by the dotted line in FIG. 5 may be independent of the virtual reality helmet device 100, for example, may be disposed in an external processing system (such as a computer system) for use with the virtual reality helmet device 100; or The structure or components shown in dashed boxes may be disposed inside or on the surface of the virtual reality helmet device 100.

The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include non-persistent memory, random access memory (RAM), and/or non-volatile memory in a computer readable medium, such as read only memory (ROM) or flash memory (flash) RAM). Memory is an example of a computer readable medium.

Computer readable media includes both permanent and non-persistent, removable and non-removable media. Information storage can be implemented by any method or technology. The information can be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory. (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disk read only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape storage or other magnetic storage devices or any other non-transportable media can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary storage of computer readable media, such as modulated data signals and carrier waves.

It is also to be understood that the terms "comprises" or "comprising" or "comprising" or any other variations are intended to encompass a non-exclusive inclusion, such that a process, method, article, Other elements not explicitly listed, or elements that are inherent to such a process, method, commodity, or equipment. An element defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device including the element.

Those skilled in the art will appreciate that embodiments of the present application can be provided as a method, system, or computer program product. Thus, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment in combination of software and hardware. Moreover, the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

The above description is only an embodiment of the present application and is not intended to limit the application. Various changes and modifications can be made to the present application by those skilled in the art. Any modifications, equivalents, improvements, etc. made within the spirit and scope of the present application are intended to be included within the scope of the appended claims.

Claims

An image display method based on virtual reality, comprising:

Obtaining a horizontal field of view and a vertical field of view of the left eye image and a horizontal field of view and a vertical field of view of the right eye image, wherein the left eye image and the right eye image are respectively the same for the first camera and the second camera An image taken by each object;

Calculating a horizontal width and a vertical width of the two images on the virtual display screen according to the horizontal field of view and the vertical field of view of the two images;

The two images are displayed on the virtual display screen according to the horizontal width and the vertical direction width of the two images on the virtual display screen.
The method according to claim 1, wherein before acquiring the horizontal field of view and the vertical field of view of the two images, respectively, comprising:

When photographing the left eye image and the right eye image, respectively recording a horizontal field of view angle and a vertical field of view angle when the first camera and the second camera respectively capture images for the same object;

The horizontal field of view and the vertical field of view when the image is captured are saved to the metadata of the corresponding image to obtain the horizontal field of view and the vertical field of view of the image from the metadata of the image.
The method according to claim 1, wherein the horizontal width and the vertical width of the two images on the virtual display screen are respectively calculated according to the horizontal angle of view and the vertical field of view of the two images, including :

Calculating the horizontal width of the image on the virtual display screen according to the horizontal field of view angle of the image and the distance between the virtual imaging device corresponding to the preset virtual display screen distance;

The vertical width of the image on the virtual display screen is calculated according to the vertical field of view of the image and the distance between the virtual display device and the corresponding virtual imaging device.
The method of claim 3 wherein:

Calculate the horizontal width and vertical width of the image on the virtual display screen according to the calculation formula B=2A*tgα, where A is the distance between the virtual imaging device corresponding to the preset virtual display screen distance, when α is the image When the horizontal field of view is angle, then B is the horizontal direction of the image on the virtual display Width, or when α is the vertical field of view of the image, then B is the vertical width of the image on the virtual display.
The method according to claim 1, wherein the two optical imaging devices are disposed corresponding to the left and right eyes, including two lenses corresponding to the left and right eyes, the first lens and the second lens, and the two lenses are symmetrically mounted on the virtual reality device Above, the hardware parameters of the two lenses are the same, and the lay length between the two lenses is 6.5 cm.
An image display device based on virtual reality, comprising:

And an acquiring module, configured to respectively acquire a horizontal field of view and a vertical field of view of the left eye image and a horizontal field of view and a vertical field of view of the right eye image, wherein the left eye image and the right eye image are respectively the first camera and An image captured by the second camera for the same object;

a calculation module, configured to calculate a horizontal width and a vertical width of the two images on the virtual display screen according to the horizontal field of view and the vertical field of view of the two images;

And a display module, configured to display the two images on the virtual display screen according to the horizontal direction width and the vertical direction width of the two images on the virtual display screen.
The device according to claim 6, further comprising:

a recording module, configured to record a horizontal field of view and a vertical field of view when the first camera and the second camera respectively capture images for the same object when the left eye image and the right eye image are captured ;

a saving module for saving a horizontal field of view and a vertical field of view when capturing an image into metadata of a corresponding image, so as to obtain a horizontal field of view and a vertical field of view when the image is captured from the metadata of the image .
The device according to claim 6, wherein the calculation module is specifically configured to:

Calculating the horizontal width of the image on the virtual display screen according to the horizontal field of view angle of the image and the distance between the virtual imaging device corresponding to the preset virtual display screen distance;

The vertical width of the image on the virtual display screen is calculated according to the vertical field of view of the image and the distance between the virtual display device and the corresponding virtual imaging device.
The device according to claim 8, wherein the calculation module is specifically configured to:

Calculate the horizontal width and vertical width of the image on the virtual display screen according to the calculation formula B=2A*tgα, where A is the distance between the virtual imaging device corresponding to the preset virtual display screen distance, when α is the image When the horizontal field of view is angle, then B is the horizontal width of the image on the virtual display screen, or when α is the vertical field of view of the image, then B is the vertical width of the image on the virtual display screen.
The apparatus according to claim 6, wherein the two optical imaging devices are disposed corresponding to the left and right eyes, including two lenses corresponding to the left and right eyes, the first lens and the second lens, and the two lenses are symmetrically mounted on the virtual reality device Above, the hardware parameters of the two lenses are the same, and the lay length between the two lenses is 6.5 cm.
A virtual reality helmet device, comprising: a processor and a memory;

The memory is for storing one or more computer instructions, wherein the one or more computer instructions are executed by the processor to implement the following steps:

Obtaining a horizontal field of view and a vertical field of view of the left eye image and a horizontal field of view and a vertical field of view of the right eye image, wherein the left eye image and the right eye image are respectively the same for the first camera and the second camera An image taken by each object;

Calculating a horizontal width and a vertical width of the two images on the virtual display screen according to the horizontal field of view and the vertical field of view of the two images;

The two images are displayed on the virtual display screen according to the horizontal width and the vertical direction width of the two images on the virtual display screen.
A non-volatile computer storage medium having stored thereon computer program instructions, the computer program instructions being executed by a processor to implement virtual reality based implementation according to any one of claims 1 to 5. Image display method.