CN107610044A - Image processing method, computer-readable recording medium and virtual reality helmet - Google Patents

Abstract

The invention discloses a kind of image processing method, computer-readable recording medium and virtual reality helmet, this method to include：Obtain image to be displayed corresponding to first angle of visual field, virtual reality helmet optical component second angle of visual field and second angle of visual field corresponding to, the second field range size on the screen of the virtual reality helmet；Using first angle of visual field, second angle of visual field and the second field range size, it is calculated corresponding to first angle of visual field, the first field range size on the screen of the virtual reality helmet；Using the first field range size, the size of the image to be displayed is calculated；According to the size of the image to be displayed, optic aberrance revising processing is carried out to the image to be displayed.According to one embodiment of present invention, the experience of user is improved.

Description

Image processing method, computer-readable storage medium, and virtual reality head-mounted device

technical field

The present invention relates to the technical field of virtual reality, and more specifically, to an image processing method, a computer-readable storage medium, and a virtual reality head-mounted device.

Background technique

Virtual reality devices are equipped with optical lenses. The optical lens has a specific FOV (Field of View, field of view), combined with the structural design of the virtual reality device, determines the user's field of view on the screen of the virtual reality device through the optical lens. Fig. 1 shows a schematic diagram of a field of view on a screen of a virtual reality device viewed by a user through an optical lens.

In order to improve the authenticity of user experience, when developing VR (Virtual Reality, virtual reality) applications, the VR scene will be designed according to the FOV of the optical lens, so that the display area of the screen of the VR device matches the field of view of the optical lens, and the adjustment Combined with distortion and chromatic aberration correction when displaying the area, it ensures the consistency between the VR scene and the optical lens.

When the FOV of the image input to the VR device is inconsistent with the optical lens of the VR device, it will seriously affect the user experience. For example, when a VR device is connected to an external camera, the image of the camera needs to be input to the VR device for display, but different cameras have different FOVs, and cannot be guaranteed to be consistent with the FOV of the optical lens of the VR device. At this time, if the content of the camera If it is displayed within the field of view of the lens, the content observed through the lens will not match the FOV of the lens, which will affect the experience.

Therefore, it is necessary to provide a new technical solution to improve the above-mentioned technical problems in the prior art.

Contents of the invention

An object of the present invention is to provide a new technical solution for an image processing method.

According to a first aspect of the present invention, an image processing method is provided, comprising:

Obtaining the first viewing angle corresponding to the image to be displayed, the second viewing angle of the optical components of the virtual reality head-mounted device, and the second viewing angle corresponding to the second viewing angle on the screen of the virtual reality head-mounted device. Second, the size of the field of view;

Using the first field of view, the second field of view and the size of the second field of view, calculate and obtain the first field of view corresponding to the first field of view on the screen of the virtual reality head-mounted device - the size of the field of view;

calculating the size of the image to be displayed by using the size of the first field of view;

Perform optical distortion correction processing on the image to be displayed according to the size of the image to be displayed.

Optionally, the first viewing angle corresponding to the image to be displayed is the viewing angle of an optical component of an external device of the virtual reality headset.

Optionally, obtaining the first viewing angle corresponding to the image to be displayed includes: when the virtual reality head-mounted device establishes a connection with the external device, the virtual reality head-mounted device obtains device parameters of the external device , wherein the device parameters include the viewing angle of the optical components of the external device.

Optionally, using the first field of view, the second field of view, and the size of the second field of view, calculate and obtain a value corresponding to the first field of view in the virtual reality head-mounted device. The size of the first field of view on the screen, including:

The size of the first field of view is calculated based on the following formula,

r=R*[tan(FOV ₁ /2)/tan(FOV ₂ /2)], where r is the area radius corresponding to the first field of view, and R is the area radius corresponding to the second field of view Size, FOV ₁ is the first viewing angle, FOV ₂ is the second viewing angle.

Optionally, using the size of the first field of view to calculate the size of the image to be displayed includes:

The size of the image to be displayed is calculated based on the following formula,

r=K ₀ +K ₁ *h+K ₂ *h ² +K ₃ *h ³ +...+K _n *h ⁿ , where h is the side length of the square area corresponding to the image to be displayed, r is the The size of the area radius corresponding to the first field of view, K ₀ , K ₁ , K ₂ , K ₃ , ... K _n are coefficients corresponding to the optical components of the virtual reality head-mounted device.

Optionally, performing optical distortion correction processing on the image to be displayed according to the size of the image to be displayed includes:

Determining a plurality of feature points from the image to be displayed, and determining the distance from each feature point to the center point of the image to be displayed according to the size of the image to be displayed;

Performing optical distortion correction processing on the image to be displayed based on the following calculation formula,

l'=K ₀ +K ₁ *l+K ₂ *l ² +K ₃ *l ³ +...+K _n *l ⁿ , wherein, l is the distance from the feature point to the center point of the image to be displayed, K ₀ , K ₁ , K ₂ , K ₃ , ... K _n are the coefficients corresponding to the optical components of the virtual reality head-mounted device, and l' is the conversion of the feature points to the image to be displayed after optical distortion correction processing The distance from the center point.

Optionally, the method also includes:

The image to be displayed after optical distortion correction is displayed on the screen of the virtual reality head-mounted device.

Optionally, after the image to be displayed after optical distortion correction is displayed on the screen of the virtual reality head-mounted device, when the first viewing angle is smaller than the second viewing angle, the user The region of the image to be displayed after the optical distortion correction processed by the optical components of the virtual reality head-mounted device is the area corresponding to the first viewing angle on the screen of the virtual reality head-mounted device The size of the first field of view;

In the case where the first viewing angle is greater than the second viewing angle, the area of the image to be displayed after the optical distortion correction process viewed by the user through the optical components of the virtual reality head-mounted device is the set The size of the second field of view on the screen of the virtual reality head-mounted device corresponding to the second field of view;

In the case where the first viewing angle is equal to the second viewing angle, the area of the image to be displayed after the optical distortion correction process viewed by the user through the optical components of the virtual reality head-mounted device is the set The size of the second field of view range on the screen of the virtual reality head-mounted device corresponding to the second field of view angle.

According to a second aspect of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium stores a computer program, and the computer program is executed by one or more processors to implement any of the above-mentioned image processing method.

According to a third aspect of the present invention, a virtual reality head-mounted device is provided, including: a memory, a processor, and a computer program stored in the memory and operable on the processor, and the processor executes the When the above computer program is used, the image processing method as described in any one of the above is realized.

The image processing method, computer-readable storage medium, and virtual reality head-mounted device provided by the present invention use the first viewing angle corresponding to the image to be displayed, the second viewing angle and the second viewing angle of the optical components of the virtual reality head-mounted device The size of the second field of view on the screen of the virtual reality head-mounted device corresponding to the field of view is obtained, and the size of the first field of view on the screen of the virtual reality head-mounted device corresponding to the first field of view is obtained, and then, using The size of the first field of view is calculated to obtain the size of the image to be displayed. Finally, according to the size of the image to be displayed, optical distortion correction is performed on the image to be displayed, so that the scene transmitted by the image to be displayed matches the second field of view, which improves the experience. authenticity.

Other features of the present invention and advantages thereof will become apparent from the following detailed description of exemplary embodiments of the present invention with reference to the accompanying drawings.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention.

Fig. 1 shows a schematic diagram of a field of view on a screen of a virtual reality device viewed by a user through an optical lens.

Fig. 2 shows a processing flowchart of an image processing method according to an embodiment of the present invention.

Fig. 3 shows a schematic diagram of an optical distortion correction process according to an embodiment of the present invention.

Fig. 4 shows a schematic diagram of display areas respectively corresponding to a first viewing angle and a second viewing angle according to an embodiment of the present invention.

FIG. 5 shows another schematic diagram of display areas respectively corresponding to the first viewing angle and the second viewing angle according to an embodiment of the present invention.

FIG. 6 shows another schematic diagram of display areas respectively corresponding to the first viewing angle and the second viewing angle according to an embodiment of the present invention.

Fig. 7 shows a schematic structural diagram of a virtual reality headset according to an embodiment of the present invention.

detailed description

Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangements of components and steps, numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless specifically stated otherwise.

The following description of at least one exemplary embodiment is merely illustrative in nature and in no way taken as limiting the invention, its application or uses.

Techniques, methods and devices known to those of ordinary skill in the relevant art may not be discussed in detail, but where appropriate, such techniques, methods and devices should be considered part of the description.

In all examples shown and discussed herein, any specific values should be construed as exemplary only, and not as limitations. Therefore, other instances of the exemplary embodiment may have different values.

It should be noted that like numbers and letters denote similar items in the following figures, therefore, once an item is defined in one figure, it does not require further discussion in subsequent figures.

An embodiment of the present invention provides an image processing method. Fig. 2 shows a processing flowchart of an image processing method according to an embodiment of the present invention. Referring to Fig. 2, the method at least includes steps S201 to S204.

Step S201, acquiring the first field of view corresponding to the image to be displayed, the second field of view of the optical components of the virtual reality head-mounted device, and the second field of view corresponding to the second field of view on the screen of the virtual reality head-mounted device. field of view size;

Step S202, using the first field of view, the second field of view and the size of the second field of view to calculate the size of the first field of view on the screen of the virtual reality head-mounted device corresponding to the first field of view;

Step S203, using the size of the first field of view to calculate the size of the image to be displayed;

Step S204, performing optical distortion correction processing on the image to be displayed according to the size of the image to be displayed.

In an embodiment of the present invention, the image to be displayed is input to the virtual reality head-mounted device by an external device of the virtual reality head-mounted device, and the first field of view corresponding to the image to be displayed is the optical angle of the external device of the virtual reality head-mounted device. The field of view of the part. The external device of the virtual reality head-mounted device can be any one of a camera and a video camera. When the virtual reality head-mounted device establishes a connection with its external device, the virtual reality head-mounted device can acquire device parameters of the external device, wherein the device parameters at least include the field of view angle of the optical components of the external device. Taking the camera as an example, before the camera sends the captured video to the VR headset, the camera needs to establish a connection with the VR headset. After the camera and the VR headset are connected, the VR headset can Obtain the relevant parameters of the camera, for example, the field of view of the lens in the camera.

The image viewed by the user through the optical components of the virtual reality headset will appear distorted, for example, pincushion distortion. In order to make the image viewed by the user through the optical components of the virtual reality head-mounted device consistent with the original image, optical distortion correction processing is performed on the original image before the original image is displayed. The original image involved here is the image to be displayed.

In one embodiment of the present invention, the above-mentioned step S102 is specifically, using the first viewing angle, the second viewing angle and the size of the second viewing range, and calculating the corresponding value of the first viewing angle based on the following calculation formula (1): , the size of the first field of view on the screen of the virtual reality head-mounted device,

r=R*[tan(FOV ₁ /2)/tan(FOV ₂ /2)]—calculation formula (1),

Among them, r is the radius of the area corresponding to the first field of view, R is the radius of the area corresponding to the second field of view, FOV ₁ is the first field of view, and FOV ₂ is the second field of view.

After the radius of the area corresponding to the first field of view is calculated, in one embodiment of the present invention, the size of the image to be displayed is calculated based on the following calculation formula (2):

r=K ₀ +K ₁ *h+K ₂ *h ² +K ₃ *h ³ +...+K _n *h ⁿ —calculation formula (2),

h is the side length of the square area corresponding to the image to be displayed, r is the radius of the area corresponding to the first field of view, and K ₀ , K ₁ , K ₂ , K ₃ ... K _n are the areas corresponding to the optical components of the virtual reality headset. coefficient.

It should be noted that, before the image to be displayed undergoes optical distortion correction processing, the image to be displayed is a square image, and its corresponding side length is h. After the image to be displayed undergoes optical distortion correction processing, the image to be displayed becomes a barrel shape with a radius of r, where the radius r is the radius of the area corresponding to the first field of view calculated based on the above calculation formula (1) . In addition, K ₀ , _{K 1} , K ₂ , K ₃ . Change accordingly, wherein, K ₀ , K ₁ , K ₂ , K ₃ . . . K _n can be obtained through fitting experiments.

After calculating the size of the image to be displayed, according to the size of the image to be displayed, perform optical distortion correction processing on the image to be displayed, specifically, first, determine a plurality of feature points from the image to be displayed, and then, according to the size of the image to be displayed , determine the distance from each feature point to the center point of the image to be displayed, and then perform optical distortion correction processing on the image to be displayed based on the following calculation formula (3),

l'=K ₀ +K ₁ *l+K ₂ *l ² +K ₃ *l ³ +...+K _n *l ⁿ —calculation formula (3),

Among them, l is the distance from the feature point to the center point of the image to be displayed, K ₀ , K ₁ , K ₂ , K ₃ , ... K _n are the coefficients corresponding to the optical components of the virtual reality head-mounted device, and l' is the feature point The distance from the center point of the image to be displayed after optical distortion correction processing. In the embodiment of the present invention, the multiple feature points determined from the image to be displayed are preferably uniformly distributed in the feature points of the image to be displayed, and each of the determined feature points is corrected for optical distortion according to the above calculation formula (3) deal with.

Fig. 3 shows a schematic diagram of an optical distortion correction process according to an embodiment of the present invention. Referring to FIG. 3, the left half of FIG. 3 shows two images to be displayed (image a and image b) before the optical distortion correction processing, and the right half of FIG. 3 shows the two images after the two optical distortion correction processing. barrel images (image c and image d). Image c is the image obtained after image a is processed by optical distortion correction. Image b is the image obtained from image d after optical distortion correction processing. Determine its center point and a feature point from the image a, determine the distance from the feature point to the center point of the image a according to the size of the image a, and then perform optical distortion correction processing on the feature point based on the above calculation formula (3) , to obtain the distance from the feature point to the center point after optical distortion correction processing. Determine its center point and a feature point from the image b, determine the distance from the feature point to the center point of the image according to the size of the image b, and then perform optical distortion correction processing on the feature point based on the above calculation formula (3), The distance from the feature point to the center point after optical distortion correction processing is obtained. It should be noted that the above example only shows that a feature point is determined from the image to be displayed, but does not impose any limitation on the present invention. The number of feature points determined from the image to be displayed may be several, dozens, hundreds, or even more. The larger the number of feature points determined from the image to be displayed, the more accurate the image after optical distortion correction processing is obtained.

After optical distortion correction processing is performed on the image to be displayed, the image to be displayed after optical distortion correction processing is displayed on the screen of the virtual reality head-mounted device. The display area of the image to be displayed after optical distortion correction processing on the screen of the virtual reality head-mounted device is the size of the first field of view range on the screen of the virtual reality head-mounted device corresponding to the first field of view angle. The size of the first field of view corresponding to the image to be displayed and the second field of view of the optical components of the virtual reality head-mounted device will appear in the following three situations: the first field of view is smaller than the second field of view; the first field of view The angle is greater than the second viewing angle; the first viewing angle is equal to the second viewing angle.

When the first viewing angle corresponding to the image to be displayed is smaller than the second viewing angle of the optical components of the virtual reality head-mounted device, referring to FIG. The size of the first field of view on the screen of the wearable device, and the display area b is the size of the second field of view on the screen of the virtual reality head-mounted device corresponding to the second field of view. The display area of the image to be displayed after optical distortion correction processing on the screen of the virtual reality head-mounted device is the size of the field of view on the screen of the virtual reality head-mounted device corresponding to the first viewing angle. The region of the image to be displayed after the optical distortion correction processed by the user through the optical components of the virtual reality head-mounted device is the size of the first field of view on the screen of the virtual reality head-mounted device corresponding to the first field of view.

When the first viewing angle corresponding to the image to be displayed is larger than the second viewing angle of the optical components of the virtual reality head-mounted device, referring to FIG. The size of the first field of view on the screen of the wearable device, and the display area b is the size of the second field of view on the screen of the virtual reality head-mounted device corresponding to the second field of view. The display area of the image to be displayed after optical distortion correction processing on the screen of the virtual reality head-mounted device is the size of the field of view on the screen of the virtual reality head-mounted device corresponding to the first viewing angle. The region of the image to be displayed after the optical distortion correction processed by the user through the optical components of the virtual reality head-mounted device is the size of the second field of view on the screen of the virtual reality head-mounted device corresponding to the second field of view.

In the case where the first viewing angle corresponding to the image to be displayed is equal to the second viewing angle of the optical components of the virtual reality head-mounted device, see FIG. The size of the first field of view on the above is equal to the size of the second field of view on the screen of the virtual reality head-mounted device corresponding to the second field of view. The display area of the image to be displayed after optical distortion correction processing on the screen of the virtual reality head-mounted device is the size of the field of view on the screen of the virtual reality head-mounted device corresponding to the first viewing angle. The region of the image to be displayed after the optical distortion correction processed by the user through the optical components of the virtual reality head-mounted device is the size of the second field of view on the screen of the virtual reality head-mounted device corresponding to the second field of view.

Based on the same inventive concept, the present invention provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and the computer program can be executed by one or more processors to implement the image processing method provided by any one of the above embodiments.

Based on the same inventive concept, the present invention provides a virtual reality head-mounted device. Fig. 7 shows a schematic structural diagram of a virtual reality headset according to an embodiment of the present invention. Referring to FIG. 7, a virtual reality headset 700 includes a display unit 701, a virtual image optical unit 702, an input operation unit 703, a state information acquisition unit 704, a communication unit 705, a memory 706, a processor 707, an image processing unit 708, a display driver unit 709, a sound processing unit 710, and a sound input/output unit 711.

The memory 706 is a mass storage device configured with a solid-state drive or the like. The memory 706 may store application programs or various types of data. For example, the processor 707 executes the computer program of the image processing method provided by the present invention, or the content viewed by the user using the virtual reality headset 700 can be stored in the memory 706, and so on.

Processor 707 may include a computer processing unit (CPU) or other device with similar functionality. In some embodiments, the processor 707 is configured to execute the image processing method provided by the present invention, that is, perform the following steps: acquire the first field of view corresponding to the image to be displayed, and obtain the second field of view of the optical components of the virtual reality head-mounted device angle and the second field of view corresponding to the size of the second field of view on the screen of the virtual reality head-mounted device; using the first field of view, the second field of view and the size of the second field of view, the first field of view is calculated The size of the first field of view on the screen of the virtual reality head-mounted device corresponding to the field angle; using the size of the first field of view, calculate the size of the image to be displayed; perform optical distortion correction on the image to be displayed according to the size of the image to be displayed deal with.

The display unit 701 may include a display panel. The display panel is set on the side surface of the virtual reality head-mounted device 700 facing the user's face, and may be a whole panel, or a left panel and a right panel respectively corresponding to the user's left and right eyes. The display panel may be an electroluminescence (EL) element, a liquid crystal display or a microdisplay with a similar structure, or a retinal direct display or a similar laser scanning display.

The virtual image optical unit 702 captures the image displayed by the display unit 701 in an enlarged manner, and allows the user to observe the displayed image as an enlarged virtual image. As a display image output to the display unit 701 , an image of a virtual scene provided from a content reproduction device (Blu-ray Disc or DVD player) or a streaming server, or an image of a real scene captured using the external camera 110 may be used. In some embodiments, the virtual image optical unit 702 may include a lens unit, such as a spherical lens, an aspheric lens, a Fresnel lens, and the like.

It should be noted that the external camera 110 may be set on the front surface of the main body of the virtual reality headset 700 , and there may be one or more external cameras 110 . The external camera 110 can acquire three-dimensional information, and can also be used as a distance sensor. Additionally, a position sensitive detector (PSD) or other type of distance sensor that detects reflected signals from objects may be used with the external camera 110 . The external camera 110 and the distance sensor can be used to detect the body position, posture and shape of the user wearing the virtual reality headset 700 . In addition, under certain conditions, the user can directly watch or preview the real scene through the external camera 110 .

The input operation unit 703 includes at least one operation component for performing an input operation, such as keys, buttons, switches or other components with similar functions, receives user instructions through the operation components, and outputs instructions to the processor 707 .

The status information acquiring unit 704 is configured to acquire status information of the user wearing the virtual reality headset 700 . The status information acquisition unit 704 may include various types of sensors for detecting status information by itself, and may acquire status information from external devices (such as smart phones, watches and other multi-function terminals worn by users) through the communication unit 705 . The state information obtaining unit 704 may obtain position information and/or posture information of the user's head. The state information acquisition unit 704 may include one or more of a gyroscope sensor, an acceleration sensor, a Global Positioning System (Global Positioning System, GPS) sensor, a geomagnetic sensor, a Doppler effect sensor, an infrared sensor, and a radio frequency field intensity sensor. In addition, the state information obtaining unit 704 obtains the state information of the user wearing the virtual reality head-mounted device 700, for example, obtains the user's operation state (whether the user is wearing the virtual reality head-mounted device 700), the user's action state (such as standing still, walking, running, etc.). motion and the like, hand or fingertip posture, eye open or closed, gaze direction, pupil size), mental state (whether the user is immersed in looking at the displayed image, and the like), and even physiological state.

The communication unit 705 performs communication processing with an external device, modulation and demodulation processing, and encoding and decoding processing of communication signals. In addition, the processor 707 can send transmission data from the communication unit 705 to an external device. The communication method can be wired or wireless, such as Mobile High-Definition Link (MHL for short) or Universal Serial Bus (USB for short), High Definition Multimedia Interface (HDMI for short), wireless Fidelity (Wi-Fi), Bluetooth communication or Bluetooth low energy communication, and IEEE802.11s standard mesh network, etc. In addition, the communication unit 705 may be a cellular radio transceiver operating in accordance with Wideband Code Division Multiple Access (W-CDMA), Long Term Evolution (LTE), and similar standards.

The image processing unit 708 is for performing signal processing such as image quality correction related to the image signal output from the processor 707 and converting its resolution to that according to the screen of the display unit 701 . Then, the display driving unit 709 sequentially selects each row of pixels of the display unit 701 and sequentially scans each row of pixels of the display unit 701 row by row, thereby providing a pixel signal based on the signal-processed image signal.

The sound processing unit 710 can perform sound quality correction or sound amplification of the sound signal output from the processor 707, signal processing of the input sound signal, and the like. Then, the sound input/output unit 711 outputs sound to the outside and inputs sound from a microphone after sound processing.

It should be noted that the structure or components shown in the dashed box in FIG. 7 may be independent of the virtual reality head-mounted device 700, for example, it may be set in an external processing system (such as a computer system) to cooperate with the virtual reality head-mounted device 700. or, the structures or components shown by the dotted line box can be set inside or on the surface of the virtual reality head-mounted device 700 .

The present invention can be a system, method and/or computer program product. A computer program product may include a computer readable storage medium having computer readable program instructions thereon for causing a processor to implement various aspects of the present invention.

A computer readable storage medium may be a tangible device that can retain and store instructions for use by an instruction execution device. A computer readable storage medium may be, for example, but is not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or flash memory), static random access memory (SRAM), compact disc read only memory (CD-ROM), digital versatile disc (DVD), memory stick, floppy disk, mechanically encoded device, such as a printer with instructions stored thereon A hole card or a raised structure in a groove, and any suitable combination of the above. As used herein, computer-readable storage media are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., pulses of light through fiber optic cables), or transmitted electrical signals.

Computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or downloaded to an external computer or external storage device over a network, such as the Internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers. A network adapter card or a network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing/processing device .

Computer program instructions for carrying out operations of the present invention may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or Source or object code written in any combination, including object-oriented programming languages—such as Smalltalk, C++, etc., and conventional procedural programming languages—such as “C” or similar programming languages. Computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement. In cases involving a remote computer, the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as via the Internet using an Internet service provider). connect). In some embodiments, an electronic circuit, such as a programmable logic circuit, field programmable gate array (FPGA), or programmable logic array (PLA), can be customized by utilizing state information of computer-readable program instructions, which can Various aspects of the invention are implemented by executing computer readable program instructions.

Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It should be understood that each block of the flowcharts and/or block diagrams, and combinations of blocks in the flowcharts and/or block diagrams, can be implemented by computer-readable program instructions.

These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine such that when executed by the processor of the computer or other programmable data processing apparatus , producing an apparatus for realizing the functions/actions specified in one or more blocks in the flowchart and/or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause computers, programmable data processing devices and/or other devices to work in a specific way, so that the computer-readable medium storing instructions includes An article of manufacture comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks in flowcharts and/or block diagrams.

It is also possible to load computer-readable program instructions into a computer, other programmable data processing device, or other equipment, so that a series of operational steps are performed on the computer, other programmable data processing device, or other equipment to produce a computer-implemented process , so that instructions executed on computers, other programmable data processing devices, or other devices implement the functions/actions specified in one or more blocks in the flowcharts and/or block diagrams.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, a program segment, or a portion of an instruction that contains one or more executable instruction. In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified function or action , or may be implemented by a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that implementation by means of hardware, implementation by means of software, and implementation by a combination of software and hardware are all equivalent.

Having described various embodiments of the present invention, the foregoing description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and alterations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principle of each embodiment, practical application or technical improvement in the market, or to enable other ordinary skilled in the art to understand each embodiment disclosed herein. The scope of the invention is defined by the appended claims.

Claims (10)

1. An image processing method, characterized in that, comprising: Obtaining the first viewing angle corresponding to the image to be displayed, the second viewing angle of the optical components of the virtual reality head-mounted device, and the second viewing angle corresponding to the second viewing angle on the screen of the virtual reality head-mounted device. Second, the size of the field of view; Using the first field of view, the second field of view and the size of the second field of view, calculate and obtain the first field of view corresponding to the first field of view on the screen of the virtual reality head-mounted device - the size of the field of view; calculating the size of the image to be displayed by using the size of the first field of view; Perform optical distortion correction processing on the image to be displayed according to the size of the image to be displayed. 2. The method according to claim 1, wherein the first viewing angle corresponding to the image to be displayed is the viewing angle of an optical component of an external device of the virtual reality headset. 3. The method according to claim 2, wherein obtaining the first viewing angle corresponding to the image to be displayed comprises: When the virtual reality head-mounted device establishes a connection with the external device, the virtual reality head-mounted device acquires device parameters of the external device, wherein the device parameters include a field of view of an optical component of the external device horn. 4. The method according to claim 1, characterized in that, using the first field of view, the second field of view and the size of the second field of view to calculate the corresponding angle of the first field of view The size of the first field of view on the screen of the virtual reality head-mounted device includes: The size of the first field of view is calculated based on the following formula, r=R*[tan(FOV ₁ /2)/tan(FOV ₂ /2)], where r is the area radius corresponding to the first field of view, and R is the area radius corresponding to the second field of view Size, FOV ₁ is the first viewing angle, FOV ₂ is the second viewing angle. 5. The method according to claim 1, wherein the size of the image to be displayed is calculated using the size of the first field of view, comprising: The size of the image to be displayed is calculated based on the following formula, r=K ₀ +K ₁ *h+K ₂ *h ² +K ₃ *h ³ +...+K _n *h ⁿ , where h is the side length of the square area corresponding to the image to be displayed, r is the The size of the area radius corresponding to the first field of view, K ₀ , K ₁ , K ₂ , K ₃ , ... K _n are coefficients corresponding to the optical components of the virtual reality head-mounted device. 6. The method according to any one of claims 1-5, wherein performing optical distortion correction processing on the image to be displayed according to the size of the image to be displayed includes: Determining a plurality of feature points from the image to be displayed, and determining the distance from each feature point to the center point of the image to be displayed according to the size of the image to be displayed; Performing optical distortion correction processing on the image to be displayed based on the following calculation formula, l'=K ₀ +K ₁ *l+K ₂ *l ² +K ₃ *l ³ +...+K _n *l ⁿ , wherein, l is the distance from the feature point to the center point of the image to be displayed, K ₀ , K ₁ , K ₂ , K ₃ , ... K _n are the coefficients corresponding to the optical components of the virtual reality head-mounted device, and l' is the conversion of the feature points to the image to be displayed after optical distortion correction processing The distance from the center point. 7. The method according to claim 1, further comprising: The image to be displayed after optical distortion correction is displayed on the screen of the virtual reality head-mounted device. 8. The method according to claim 7, characterized in that, after the image to be displayed after the optical distortion correction is displayed on the screen of the virtual reality head-mounted device, when the first viewing angle is smaller than the specified In the case of the second field of view, the area of the image to be displayed after the optical distortion correction processed by the user through the optical components of the virtual reality head-mounted device is the area corresponding to the first field of view, at The size of the first field of view on the screen of the virtual reality head-mounted device; In the case where the first viewing angle is greater than the second viewing angle, the area of the image to be displayed after the optical distortion correction process viewed by the user through the optical components of the virtual reality head-mounted device is the set The size of the second field of view on the screen of the virtual reality head-mounted device corresponding to the second field of view; In the case where the first viewing angle is equal to the second viewing angle, the area of the image to be displayed after the optical distortion correction process viewed by the user through the optical components of the virtual reality head-mounted device is the set The size of the second field of view range on the screen of the virtual reality head-mounted device corresponding to the second field of view angle. 9. A computer-readable storage medium, the computer-readable storage medium storing a computer program, characterized in that, the computer program is executed by one or more processors to implement any one of claims 1-8 The image processing method described above. 10. A virtual reality head-mounted device, comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, characterized in that, when the processor executes the computer program, it realizes The image processing method according to any one of claims 1-8.