CN111489670A - Image display method of head-mounted display device and head-mounted display device - Google Patents

Image display method of head-mounted display device and head-mounted display device Download PDF

Info

Publication number
CN111489670A
CN111489670A CN201910074098.8A CN201910074098A CN111489670A CN 111489670 A CN111489670 A CN 111489670A CN 201910074098 A CN201910074098 A CN 201910074098A CN 111489670 A CN111489670 A CN 111489670A
Authority
CN
China
Prior art keywords
display
parameter
sub
definition
sharpness
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910074098.8A
Other languages
Chinese (zh)
Inventor
林子杰
黄昭世
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Acer Inc
Original Assignee
Acer Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Acer Inc filed Critical Acer Inc
Priority to CN201910074098.8A priority Critical patent/CN111489670A/en
Publication of CN111489670A publication Critical patent/CN111489670A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted

Abstract

An image display method of a head-mounted display device and the head-mounted display device are provided, the head-mounted display device comprises a first display and a first lens, and the image display method of the head-mounted display device comprises the following steps. A plurality of display parameters respectively corresponding to a plurality of sub-display areas of the first display are acquired. The display area of the first display is divided into sub-display areas, and the sub-display areas comprise a first sub-display area and a second sub-display area. And then, controlling the first display to display in the first sub-display area according to the first display parameter, and controlling the first display to display in the second sub-display area according to the second display parameter. The display area of the first display is divided into a plurality of sub-display areas from inside to outside by taking a reference point as a center.

Description

Image display method of head-mounted display device and head-mounted display device
Technical Field
The present invention relates to an image display method and a display device, and more particularly, to an image display method and a head-mounted display device of a head-mounted display device.
Background
With the progress of display technology and the desire for high technology, virtual reality (HMD) technology has grown, wherein HMD is a display device for implementing the technology. In recent years, as the resolution of the microdisplay is higher and the microdisplay is smaller, the head-mounted display device is also developed into a portable (portable) display device. Generally, a head-mounted Display (headphone) usually uses Near Eye Display (NED) optical system to generate images, so that a user can clearly view a Display screen at a short distance through refraction of a lens.
In order to make the head-mounted display device light, thin, small, and to manufacture the head-mounted display device with a larger field angle, the design of the optical system of the head-mounted display device (such as the type of lens, the size of the lens, or the position of the lens) and the configuration of the display screen are important for researchers to consider, which may directly affect the visual and sensory experience. However, based on the physical characteristics of the lens, the central region of the monocular image viewed by the user through the lens is generally clearer than the peripheral region. Specifically, when the human eye views the central region of the display screen through the central portion of the lens near the optical center, the user can view the image quality with excellent definition. In contrast, when the human eyes view the peripheral area of the display screen through the peripheral portion of the lens away from the optical center, the user will view a blurred image quality. In addition, when the eyes of the user are clearly turned, a phenomenon may occur in which the image seen by one eye is clearer and the image seen by the other eye is blurred. These inconsistent definitions can cause discomfort or poor visual experience when using the head mounted display device.
Disclosure of Invention
Based on the above problems, the present invention provides an image display method of a head-mounted display device and the head-mounted display device, which can provide a better stereoscopic experience.
An embodiment of the present invention provides an image display method of a head-mounted display device, where the head-mounted display device includes a first display and a first lens, and the image display method of the head-mounted display device includes the following steps. A plurality of display parameters respectively corresponding to a plurality of sub-display areas of the first display are acquired. The display area of the first display is divided into the sub-display areas, and the sub-display areas comprise a first sub-display area and a second sub-display area. The display parameters include a first display parameter corresponding to the first sub-display region and a second display parameter corresponding to the second sub-display region. And then, controlling the first display to display in the first sub-display area according to the first display parameter, and controlling the first display to display in the second sub-display area according to the second display parameter. The display area of the first display is divided into the sub-display areas from inside to outside by taking a reference point as a center.
In an embodiment of the present invention, the head-mounted display device further includes a second display, a second lens and an eye tracking device, and the processing circuit is further configured to execute instructions to perform the following steps. And tracking the fixation position of the left eye and the fixation position of the right eye by using an eyeball tracking device. The gaze location of the left eye is determined to be in a left eye concentration region of the sub-display regions of the first display, and the gaze location of the right eye is determined to be in a right eye concentration region of the plurality of sub-display regions of the second display. And acquiring a left definition parameter corresponding to the left eye concentration area and a right definition parameter corresponding to the right eye concentration area. And comparing the left definition parameter corresponding to the left eye concentration region with the right definition parameter corresponding to the right eye concentration region to adjust the third display parameter of the left eye concentration region or the fourth display parameter of the right eye concentration region. And controlling the first display to display in the left eye concentration area according to the third display parameter, and controlling the second display to display in the right eye concentration area according to the fourth display parameter.
From another perspective, embodiments of the present invention provide a head-mounted display device, which includes a first display, a first lens, a storage device, and a processing circuit. The storage device stores a plurality of instructions, and the processing circuit is connected with the first display and the storage device and used for executing the instructions to execute the following steps. A plurality of display parameters respectively corresponding to a plurality of sub-display areas of the first display are acquired. The display area of the first display is divided into the sub-display areas, and the sub-display areas comprise a first sub-display area and a second sub-display area. The display parameters include a first display parameter corresponding to the first sub-display region and a second display parameter corresponding to the second sub-display region. And then, controlling the first display to display in the first sub-display area according to the first display parameter, and controlling the first display to display in the second sub-display area according to the second display parameter. The display area of the first display is divided into the sub-display areas from inside to outside by taking a reference point as a center.
Based on the above, the head-mounted display device and the image display method thereof according to the embodiments of the invention display in the corresponding sub-display areas according to different display parameters. Thus, when a user views a display through a lens of the head-mounted display device, visual perception based on disparity in definition caused by physical characteristics of the lens can be effectively improved. In addition, the eyeball tracking device is used for detecting the fixation position, and the display parameters displayed by the display can be dynamically adjusted along with the fixation position of the user, so that the definition of images felt by the left eye and the right eye respectively achieves the effect of relative balance.
In order to make the aforementioned and other features and advantages of the invention more comprehensible, embodiments accompanied with figures are described in detail below.
Drawings
FIG. 1 is a block diagram of a head mounted display device according to an embodiment of the invention.
FIG. 2 is a diagram of a head mounted display device according to an embodiment of the invention.
FIG. 3 is a flowchart of a method of displaying an image according to an embodiment of the present invention.
FIG. 4 is a schematic diagram of a plurality of sub-display areas and optical centers according to an embodiment of the present invention.
FIG. 5 is a block diagram of a head mounted display device according to an embodiment of the invention.
FIG. 6 is a flowchart illustrating a method of displaying an image according to an embodiment of the present invention.
Fig. 7A is a schematic diagram illustrating a situation in which the eyes of the user are looking forward.
FIG. 7B is a diagram illustrating a gaze location and a sub-display area based on the example of FIG. 7A.
FIG. 8A is a schematic diagram illustrating a situation in which the user's eyes are shifted to the left.
Fig. 8B is a schematic diagram illustrating a gaze location and a sub-display area based on the example of fig. 8A.
Fig. 9 is a flow chart of adjusting a third display parameter for a left eye concentration region or a fourth display parameter for a right eye concentration region according to an embodiment of the present invention.
Wherein, 100, 200: head-mounted display device
110. 170: lens and lens assembly
120. 160: display device
130: processing circuit
140: lens adjusting mechanism
150: storage device
180: eyeball tracking device
210: wearing piece
221: shell body
220: main body
P1: reference point
C1, C2: optical center
Z1-Z8: sub display area
E1: left eye
E2: right eye
F1, F2, F3, F4: gaze location
S401 to S402, S601 to S607, S6061 to S6064: step (ii) of
Detailed Description
Some embodiments of the invention will now be described in detail with reference to the drawings, wherein like reference numerals are used to refer to like or similar elements throughout the several views. These examples are only a part of the present invention and do not disclose all possible embodiments of the present invention. Rather, these embodiments are merely exemplary of the methods and head mounted display devices in the scope of the present invention.
FIG. 1 is a block diagram of a head mounted display device according to an embodiment of the invention. FIG. 2 is a diagram of a head mounted display device according to an embodiment of the invention. Referring to fig. 1 and fig. 2, the head-mounted display device 100 is suitable for being worn on the head of a user and displaying a picture for the user to watch, and includes a wearing part 210 and a main body 220. In the present embodiment, the main body 220 is formed by a housing 221 covering various components. The aforementioned components may include a lens 110 (also referred to as a first lens 110), a display 120 (also referred to as a first display 120), a processing circuit 130, a lens adjustment mechanism 140, and a storage device 150.
The first Display 120 may be a liquid Crystal Display (L liquid Crystal Display, L CD), a light Emitting Diode (L lighting Diode, L ED) Display, or other types of displays, which are not limited in the invention.
The storage device 150 may be any type of fixed or removable Random Access Memory (RAM), Read-Only Memory (ROM), Flash Memory (Flash Memory), or the like or any combination thereof, and is used to record a plurality of instructions executable by the processing circuit 130, and the instructions may be loaded into the processing circuit 130.
The Processing circuit 130 may be a Central Processing Unit (CPU), or other Programmable general purpose or special purpose Microprocessor (Microprocessor), Digital Signal Processor (DSP), Programmable controller, Application Specific Integrated Circuit (ASIC), Programmable logic Device (Programmable L analog Device, P L D), or other similar devices or combinations thereof, the Processing circuit 130 is connected to the first display 120, the lens adjusting mechanism 140, and the storage Device 150, and can access and execute the instructions recorded in the storage Device 150 to implement the image display method of the embodiment of the present invention, in addition, the Processing circuit 130 can drive the first display 120 to make the first display 120 display the image for the user to watch.
Lens 110 may be formed of one or more lenses, as the present invention is not limited in this respect. The user's line of sight views the first display 120 through the lens 110. Through the refraction of the lens 110, the user can clearly view the first display 120 at a short distance. Lens 110 may be a Fresnel lens or other type of lens, as the present invention is not limited in this respect. The lens 110 is connected to a lens adjustment mechanism 140, and the lens adjustment mechanism 140 can be used to adjust the focus position of the lens 110. The lens adjustment mechanism 230 may include a stepper motor or other manual control element to push the lens 110 away from or toward the first display 120. However, the arrangement of the lens adjusting mechanism 140 is not essential, and the configuration or non-configuration may be selected according to the actual application.
When the user wears the head-mounted display device 100 on the head, the user's eye can just look directly at the lens 110, and the user's line of sight can penetrate the lens 110 to view the first display 120 located on the other side of the lens 110. It should be understood that the head-mounted display device 100 depicted in fig. 2 is only an exemplary embodiment, which is not limiting, but is merely illustrative. The head-mounted display device including the components shown in fig. 1 may be implemented in other configurations different from the example shown in fig. 2 according to design requirements.
FIG. 3 is a flowchart of a method of displaying an image according to an embodiment of the present invention. Referring to fig. 3, the method of the present embodiment is applied to the head-mounted display device 100 in the above embodiment, and the detailed steps of the present embodiment are described below with reference to various elements in the head-mounted display device 100.
In step S401, the processing circuit 130 acquires a plurality of display parameters respectively corresponding to a plurality of sub-display regions of the first display 120. Here, the display area of the first display 120 can be divided into a plurality of sub-display areas, and the number of the sub-display areas is not limited in the present invention. In order to improve the phenomenon of inconsistent resolution caused by the physical characteristics of the lens 110, the display area of the first display 120 is divided into a plurality of sub-display areas from inside to outside with a reference point as a center. In one embodiment, the optical axis of the first lens element 110 substantially passes through the reference point. In other words, in the case that the relative position of the first lens 110 and the first display 120 is determined, the optical axis of the first lens 110 passes through a reference point on the display plane of the first display 120, and the sub-display areas are divided by taking the reference point as the center.
In an embodiment, the plurality of sub-display regions of the first display 120 may include a first sub-display region and a second sub-display region, and the display parameters acquired by the processing circuit 130 may include a first display parameter corresponding to the first sub-display region and a second display parameter corresponding to the second sub-display region. In one embodiment, the distance between the first sub-display area and the reference point is greater than the distance between the second sub-display area and the reference point, and the first display parameter is higher than the second display parameter. That is, the first sub-display region is located outside the second sub-display region, and the first display parameter of the first sub-display region is configured to be higher than the second display parameter of the second sub-display region.
Then, in step S402, the processing circuit 130 controls the first display 120 to display in the first sub-display region according to the first display parameter, and controls the first display 120 to display in the second sub-display region according to the second display parameter. Compared to the conventional head-mounted display device that displays the entire screen with the same display parameters, the first display 120 of the embodiment respectively displays the corresponding screen portions according to a plurality of different display parameters.
For example, FIG. 4 is a schematic diagram of a plurality of sub-display areas and an optical center according to an embodiment of the invention. Referring to fig. 4, the display area of the first display 120 is divided into a plurality of sub-display areas Z1-Z4 from inside to outside with the reference point P1 as the center. The optical axis of the lens 110 passes through its optical center C1 and a reference point P1 in the display area. In the example of FIG. 4, the display area of the first display 120 is divided into a plurality of sub-display areas Z1-Z4 by concentric circle cutting lines with the reference point P1 as the center. In this example, the sub-display area Z1 is a circular area; the sub-display areas Z2, Z3 are circular ring-shaped areas; the sub display region Z4 is a region other than the sub display regions Z1 to Z3.
However, the sub-display areas Z1-Z4 of FIG. 4 are exemplary only and not intended to limit the present invention. The number and the division of the sub-display regions can be designed according to the practical application under the condition of conforming to the principle of dividing the sub-display regions from inside to outside by taking the reference point as the center. For example, in other embodiments, the sub-display areas may be divided by a rectangular cut line with a center at the reference point and an enlarged scale, in which case, the sub-display areas are all square areas except the sub-display area at the center.
The display parameters corresponding to each sub-display region may be determined through a series of prior tests and analyses and stored in the storage device 150. Specifically, a developer may capture an image displayed on the first display 120 through the first lens 110 by using an image capturing device, and analyze the captured image by using a Modulation Transfer Function (MTF), for example, to obtain a sharpness parameter of each sub-display area. In this test method, the MTF value of each sub-display area can be used to represent the sharpness parameter of each sub-display area. Then, the display parameters of each sub-display area can be formulated and stored according to the definition parameters of each sub-display area.
Further, the processing circuit 130 may read the display parameters stored in advance and corresponding to each sub-display region from the storage device 150. The display parameters of the sub-display regions may include picture contrast, picture sharpness, display resolution, or a combination thereof. In other words, the display parameters corresponding to each sub-display region may be pre-recorded in the storage device 150. Taking the sub-display areas Z1-Z4 of fig. 4 as an example, assuming that the display parameters are the contrast of the screen, table 1 is an example in which the display parameters of each sub-display area are recorded. Table 1 may be generated and stored in the storage device 150 according to a prior test, and is referred to as a "static display parameter setting table" herein.
TABLE 1
Figure BDA0001958193860000061
In detail, in order to improve the phenomenon of peripheral blurring of an image caused based on physical characteristics of a lens, the display parameters of the sub-display regions farther from the reference point are set higher. Taking table 1 and fig. 4 as an example, the distance between the sub-display region Z4 (referred to as the first sub-display region) and the reference point P1 is greater than the distance between the sub-display region Z2 (referred to as the second sub-display region) and the reference point P1, and the first display parameter set to 'contrast D' is higher than the second display parameter set to 'contrast a'. In more detail, the 'contrast D' of the sub-display region Z4 is configured to be higher than the 'contrast C' of the sub-display region Z3; the 'contrast C' of the sub-display region Z3 is configured to be higher than the 'contrast B' of the sub-display region Z2; the 'contrast B' of the sub-display region Z2 is configured to be higher than the 'contrast a' of the sub-display region Z1. It should be noted that if the display area is divided in a finer manner to obtain a finer adjustment manner, the processing circuit 130 may obtain the display parameters corresponding to each sub-display area by interpolation.
Based on the above, by controlling the first display 120 of the head mounted display device 100 to display in the corresponding sub-display region according to different display parameters, the phenomenon of inconsistent definition in a single-eye picture viewed by the user can be improved. It should be noted that the embodiments shown in fig. 1 and fig. 3 are described by taking a monocular display system as an example, but those skilled in the art can derive the embodiments to be applied to display systems corresponding to two eyes respectively. That is, in one embodiment, the two displays corresponding to the left eye and the right eye of the head-mounted display device can be controlled according to the same image display method. In another embodiment, the head mounted display device may be additionally configured with an eye tracking device to detect the line of sight of the user. The following examples will be presented to illustrate how to dynamically adjust the display parameters of the display according to the change of the binocular vision.
FIG. 5 is a block diagram of a head mounted display device according to an embodiment of the invention. Referring to fig. 5, the head-mounted display device 200 includes a lens 110 (also referred to as a first lens 110), a display 120 (also referred to as a first display 120), a processing circuit 130, a lens adjusting mechanism 140, and a storage device 150, and the connection relationship and functions thereof are similar to those of the embodiment of fig. 1 and are not repeated herein. It should be noted that the head-mounted display device 200 further includes a lens 170 (also referred to as a second lens 170), a display 160 (also referred to as a second display 160), and an eye tracking device 180.
In the present embodiment, the head-mounted display device 200 includes two sets of display systems symmetrically disposed and respectively corresponding to the left eye and the right eye. Here, the first display 120 and the first lens 110 constitute a display system for the left eye, and the second display 160 and the second lens 170 constitute a display system for the right eye. Hardware implementation of the second lens 170 and the second display 160 can refer to the description of the first lens 110 and the first display 120 in the previous embodiments. When the user wears the head-mounted display device 200, the left eye of the user will receive the left eye picture displayed by the first display 120 through the first lens 110, and the right eye of the user will receive the right eye picture displayed by the second display 160 through the second lens 170.
The eye tracking device 180 is a device capable of tracking and measuring the position and movement of the eye, and is suitable for detecting the characteristics of the eye of the user. In one embodiment, the eye tracking device 180 may use image analysis to detect and determine the gaze point. In addition, the gaze tracking technique can also calculate the position offset of the same pupil feature point from two eye images captured from the front and the back to be used as the movement information of the eyeball. Alternatively, the eye tracking device 180 may track the eye gaze point based on the relationship between the pupil and the orbit, the shape, and the eye gaze direction. However, the eye tracking device 180 may also detect the viewing angle of the user based on other eye tracking technologies, so that the processing circuit 130 can obtain the gaze location of the user on the first display 120 and the gaze location on the second display 160 respectively.
FIG. 6 is a flowchart illustrating a method of displaying an image according to an embodiment of the present invention. Referring to fig. 6, the method of the present embodiment is applied to the head-mounted display device 200 in the embodiment of fig. 5, and the following describes detailed steps of the present embodiment in cooperation with various elements in the head-mounted display device 200.
In step S601, the processing circuit 130 acquires a plurality of display parameters respectively corresponding to a plurality of sub-display regions of the first display 120. In step S602, the processing circuit 130 controls the first display 120 to display in the first sub-display region according to the first display parameter, and controls the first display 120 to display in the second sub-display region according to the second display parameter. The steps S601 and S602 are similar to the steps S401 and S402 in the foregoing embodiment, and therefore are not described herein again. It should be noted that the processing circuit 130 can also control the second display 160 to display according to operations similar to steps S601 and S602. In other words, the display area of the second display 160 is also divided into a plurality of sub-display areas, and the processing circuit 130 controls the second display 160 to display according to the display parameters corresponding to the sub-display areas.
Next, in step S603, the processing circuit 130 tracks the gaze position of the left eye and the gaze position of the right eye by using the eye tracking device 180. In step S604, the processing circuit 130 determines that the gaze position of the left eye is located in the left eye concentration region among the plurality of sub-display regions of the first display 120, and determines that the gaze position of the right eye is located in the right eye concentration region among the plurality of sub-display regions of the second display 160. Specifically, the processing circuit 130 may analyze a two-dimensional projection coordinate of the user's sight line on the display plane of the first display 120, which may be used as the gaze location of the left eye, by using the eye tracking device 180. The processing circuit 130 may also analyze the two-dimensional projection coordinates of the user's gaze onto the display plane of the second display 160, which may be used as the gaze location of the right eye, by using the eye tracking device 180. Then, the processing circuit 130 can know in which sub-display region the gaze positions of the left eye and the right eye are located. Here, the sub-display region including the gaze position of the left eye is referred to as a left eye concentration region, and the sub-display region including the gaze position of the right eye is referred to as a right eye concentration region.
In step S605, the processing circuit 130 obtains a left sharpness parameter corresponding to the left-eye concentration region and a right sharpness parameter corresponding to the right-eye concentration region. In step S606, the processing circuit 130 compares the left sharpness parameter corresponding to the left eye concentration region with the right sharpness parameter corresponding to the right eye concentration region to adjust the third display parameter of the left eye concentration region or the fourth display parameter of the right eye concentration region.
In one embodiment, the plurality of resolution parameters of each sub-display region of the first display 120 are recorded in the storage device 150 of the head-mounted display device 200, and the plurality of resolution parameters of each sub-display region of the second display 170 are recorded in the storage device 150. The plurality of definition parameters of the sub-display regions of the first display 120 include a left definition parameter, and the plurality of definition parameters of the sub-display regions of the second display 160 include a right definition parameter. In other words, the sharpness parameter corresponding to the left-eye concentration region is referred to as a left sharpness parameter, and the sharpness parameter corresponding to the right-eye concentration region is referred to as a right sharpness parameter.
Further, the sharpness parameter corresponding to each sub-display region may be generated through a series of preliminary tests and analyses and stored in the storage device 150. As described above, by capturing images by the image capturing device and analyzing the images through the Modulation Transfer Function (MTF), the sharpness parameters of each sub-display region of the first display 120 and the second display 160 can be generated. In this test method, the MTF value of each sub-display area can be used to represent the sharpness parameter of each sub-display area. In addition, in the test process, research personnel can control the same sub-display area to display according to a plurality of preset display parameters and acquire definition parameters corresponding to different display parameters. For example, assuming that the display parameter is the frame contrast, the single sub-display region is controlled to display according to the plurality of different frame contrasts, and the definition parameters corresponding to the single sub-display region and the plurality of different frame contrasts can be generated and recorded through test analysis. Taking the sub-display areas Z1-Z4 of fig. 4 as an example, assuming that the display parameter is the contrast of the display, table 2 shows an example of the predetermined display parameter and the sharpness parameter recorded in each sub-display area. That is, table 2 may be generated and stored in the storage device 150 according to a prior test, and is referred to as a "sharpness parameter reference table" herein.
TABLE 2
Figure BDA0001958193860000091
Figure BDA0001958193860000101
Through the implementation of steps S601 and S602, the processing circuit 130 can determine the initial display parameters of each sub-display region according to the "static display parameter setting table". Then, the processing circuit 130 may obtain the left sharpness parameter corresponding to the left eye concentration region and the right sharpness parameter corresponding to the right eye concentration region according to the initial display parameter and the "sharpness parameter reference table", and dynamically adjust the display parameter of the left eye concentration region (also referred to as a third display parameter) or the display parameter of the left eye concentration region (also referred to as a fourth display parameter) by comparing the left sharpness parameter and the right sharpness parameter, so as to improve the phenomenon that the sharpness difference experienced by both eyes is too large.
For example, fig. 7A is a schematic diagram illustrating a user looking forward with both eyes. FIG. 7B is a diagram illustrating a gaze location and a sub-display area based on the example of FIG. 7A. Referring to fig. 7A and 7B, the right eye E2 views the second display 160 through the second lens 170, and the left eye E1 views the first display 120 through the first lens 110. Based on that the right eye E2 and the left eye E1 both view forward (viewing angle is 0 °), the processing circuit 130 can detect the gaze position F1 of the left eye E1 and the gaze position F2 of the right eye E2. The processing circuit 130 may determine that the gaze position F1 of the left eye E1 is located in the left eye concentration region among the sub display regions Z1 to Z4, and determine that the gaze position F2 of the right eye E2 is located in the right eye concentration region among the sub display regions Z5 to Z5. As shown in fig. 7B, the left-eye concentration area is sub-display area Z2, and the right-eye concentration area is sub-display area Z6.
Next, the processing circuit 130 may obtain the initial display parameters of the left-eye concentration area (i.e., the sub-display area Z2) and obtain the initial display parameters of the right-eye concentration area (i.e., the sub-display area Z6) according to the "static display parameter setting table". Then, the processing circuit 130 may obtain the left sharpness parameter of the left-eye concentration region and obtain the right sharpness parameter of the right-eye concentration region according to the "sharpness parameter reference table". Taking tables 1 and 2 as examples, the processing circuit 130 may look up table 1 to obtain the initial display parameter of the left-eye concentration region as 'contrast B', and obtain the left-resolution parameter as 'resolution parameter B2' according to 'contrast B' to look up table 2. Similarly, the processing circuit 130 may obtain the right sharpness parameter according to a similar table look-up manner. Then, the processing circuit 130 compares the left sharpness parameter with the right sharpness parameter to determine whether to adjust the third display parameter of the left eye concentration region or the fourth display parameter of the right eye concentration region.
In this example, it is assumed that the first display 120 and the second display 160 divide the sub-display regions in the same division manner, and the parameters recorded in the "static display parameter setting table" and the "sharpness parameter reference table" of the first display 120 and the second display 160 are the same. Based on that the right eye E2 and the left eye E1 are both looking forward (viewing angle is 0 °), the offset between the line of sight of the left eye E1 and the optical center C1 is substantially the same as the offset between the line of sight of the right eye E2 and the optical center C2, and the processing circuit 130 can obtain the left sharpness parameter as the right sharpness parameter. In this case, the processing circuit 130 may not adjust the third display parameter of the left eye concentration region and the fourth display parameter of the right eye concentration region.
On the other hand, fig. 8A is a schematic diagram illustrating a situation in which the eyes of the user are shifted to the left. Fig. 8B is a schematic diagram illustrating a gaze location and a sub-display area based on the example of fig. 8A. Referring to fig. 8A and 8B, based on the fact that the lines of sight of the right eye E2 and the left eye E1 are shifted to the left (the viewing angle is-23 °), the processing circuit 130 can detect the gaze position F3 of the left eye E1 and the gaze position F4 of the right eye E2. The processing circuit 130 may determine that the gaze position F3 of the left eye E1 is located in the left eye concentration region among the sub display regions Z1 to Z4, and determine that the gaze position F4 of the right eye E2 is located in the right eye concentration region among the sub display regions Z5 to Z5. As shown in fig. 8B, the left-eye concentration area is sub-display area Z1, and the right-eye concentration area is sub-display area Z8.
Next, the processing circuit 130 may obtain the initial display parameters of the left-eye concentration area (i.e., the sub-display area Z1) and obtain the initial display parameters of the right-eye concentration area (i.e., the sub-display area Z8) according to the "static display parameter setting table". Then, the processing circuit 130 may obtain the left sharpness parameter of the left-eye concentration region and obtain the right sharpness parameter of the right-eye concentration region according to the "sharpness parameter reference table". Taking tables 1 and 2 as examples, the processing circuit 130 may look up table 1 to obtain the initial display parameter of the left-eye concentration region as 'contrast a', and obtain the left-resolution parameter as 'resolution parameter a 1' according to 'contrast a' to look up table 2. Similarly, the processing circuit 130 may obtain the right sharpness parameter according to a similar table look-up manner. Then, the processing circuit 130 compares the left sharpness parameter with the right sharpness parameter to determine whether to adjust the third display parameter of the left eye concentration region or the fourth display parameter of the right eye concentration region.
In this example, it is assumed that the first display 120 and the second display 160 divide the sub-display regions in the same division manner, and the parameters recorded in the "static display parameter setting table" and the "sharpness parameter reference table" of the first display 120 and the second display 160 are the same. Based on the fact that the line of sight of the right eye E2 and the left eye E1 is shifted to the left (viewing angle is-23 °), the amount of shift between the line of sight of the left eye E1 and the optical center C1 is significantly smaller than the amount of shift between the line of sight of the right eye E2 and the optical center C2, and the processing circuit 130 can determine that the left sharpness parameter is different from the right sharpness parameter. In this case, the processing circuit 130 may adjust the third display parameter of the left eye concentration region or the fourth display parameter of the right eye concentration region according to the difference between the left and right resolution parameters to balance the resolution perceived by the left eye and the resolution perceived by the right eye.
Returning to the flow of fig. 6, after adjusting the third display parameter of the left-eye concentration region or the fourth display parameter of the left-eye concentration region, in step S607, the processing circuit 130 controls the first display 120 to display in the left-eye concentration region according to the third display parameter, and controls the second display 160 to display in the right-eye concentration region according to the fourth display parameter.
An example of how to adjust the third display parameter of the left-eye concentration region or the fourth display parameter of the right-eye concentration region will be described below. FIG. 9 is a flowchart of adjusting a third display parameter for a left eye concentration region or a fourth display parameter for a right eye concentration region according to an embodiment of the present invention
It should be noted that even though the definition of the peripheral region of the display viewed by the eyes is improved by the "static display parameter setting table" pulling up the display parameters at the periphery of the display region, the definition of the peripheral region of the display viewed by the eyes is still limited by the physical characteristics of the lenses and cannot be increased to be the same as the definition of the central region of the display viewed by the eyes. Therefore, in order to achieve the purpose of balancing the definition of the two eyes, in the present embodiment, the display parameters of the left eye concentration region or the right eye concentration region corresponding to the higher definition parameters are adjusted down.
Referring to fig. 9, in step S6061, the processing circuit 130 determines whether the left sharpness parameter and the right sharpness parameter are both greater than the adjustment threshold. If neither the left sharpness parameter nor the right sharpness parameter is greater than the adjustment threshold (no in step S6061), in step S6062, the processing circuit 130 does not adjust the third display parameter of the left eye concentration region and the fourth display parameter of the right eye concentration region. That is, when both the left-eye-perceived left sharpness and the right-eye-perceived right sharpness are low, neither the third display parameter of the left-eye concentration region nor the fourth display parameter of the right-eye concentration region is reduced.
If at least one of the left sharpness parameter and the right sharpness parameter is greater than the adjustment threshold (yes in step S6061), in step S6063, the processing circuit 130 determines whether an absolute difference between the left sharpness parameter and the right sharpness parameter is greater than a difference threshold. If the absolute difference between the left sharpness parameter and the right sharpness parameter is not greater than the difference threshold (no in step S6063), in step S6062, the processing circuit 130 does not adjust the third display parameter of the left-eye concentration region and the fourth display parameter of the right-eye concentration region. That is, when the resolution perceived by the left eye and the resolution perceived by the right eye are not much different, the processing circuit 130 does not adjust the third display parameter of the left eye concentration region and the fourth display parameter of the right eye concentration region.
If the absolute difference between the left sharpness parameter and the right sharpness parameter is greater than the difference threshold (yes in step S6063), in step S6064, the processing circuit 130 adjusts one of the third display parameter of the left eye concentration region and the fourth display parameter of the right eye concentration region. That is, when the difference between the sharpness perceived by the left eye and the sharpness perceived by the right eye is significant, the processing circuit 130 adjusts the third display parameter of the left eye concentration region or the fourth display parameter of the right eye concentration region. Here, the third display parameter and the fourth display parameter, which are adjusted, are determined based on the higher of the left definition parameter and the right definition parameter. Further, if the left sharpness parameter is greater than the right sharpness parameter, the processing circuit 130 adjusts a third display parameter corresponding to the left eye concentration region. If the right sharpness parameter is greater than the left sharpness parameter, the processing circuit 130 adjusts a fourth display parameter corresponding to the right eye concentration region.
In an embodiment, the processing circuit 130 may adjust the third display parameter corresponding to the left eye concentration region or the fourth display parameter corresponding to the right eye concentration region by looking up a table or subtracting a predetermined value. Alternatively, in one embodiment, the processing circuit 130 may query the "sharpness parameter reference table" based on the lower of the left sharpness parameter and the right sharpness parameter to lower the display parameter of the left concentration area or the right concentration area. In detail, when the third display parameter of the left eye concentration area is adjusted, the processing circuit 130 may search a target definition parameter from the plurality of definition parameters of the left eye concentration area according to the right definition parameter, and adjust the third display parameter according to a preset display parameter corresponding to the target definition parameter. Specifically, when the third display parameter of the left eye concentration area is adjusted, the processing circuit 130 may query the "definition parameter reference table" according to the right definition parameter, so as to search out the target definition parameter closest to the right definition parameter and greater than the adjustment threshold value from the plurality of definition parameters of the left eye concentration area. Then, the processing circuit 130 adjusts the third display parameter of the left eye concentration region from the initial display parameter to the preset display parameter corresponding to the target definition parameter according to the preset display parameter corresponding to the target definition parameter in the definition parameter reference table. Therefore, the definition perceived by the left eye and the definition perceived by the right eye can be reduced under the condition that the definition perceived by the left eye is not adjusted to be too low.
Similarly, when determining to adjust the fourth display parameter of the right eye concentration area, the processing circuit 130 may search the "sharpness parameter reference table" and determine an adjustment target of the fourth display parameter according to a similar method. That is, when adjusting the fourth display parameter of the right-eye concentration area, the processing circuit 130 may search for another target definition parameter from the plurality of definition parameters of the right-eye concentration area according to the left definition parameter, and adjust down the fourth display parameter according to a preset display parameter corresponding to the another target definition parameter.
It will be understood that, although the terms first, second, third, fourth, etc. may be used herein to describe various elements (and parameters), these elements (and parameters) should not be limited by these terms. These terms are only used to distinguish one element (or parameter) from another element (or parameter).
In summary, in the embodiments of the invention, by setting the display parameters for the plurality of sub-display regions and performing the display according to the display parameters, the head-mounted display device can perform a preliminary monocular visibility balance adjustment to improve the phenomenon of inconsistent visibility on the monocular image caused by the physical characteristics of the lens. In addition, wear display device accessible and listen the user about the fixation position of eye come the dynamic adjustment left side to be absorbed in regional or the right side is absorbed in regional display parameter of concentrating in to the definition that the left eye felt and the definition that the right eye felt are balanced, in order to promote user's visual experience.
Although the present invention has been described with reference to the above embodiments, the present invention is not limited to the above embodiments, and those skilled in the art can make various changes and modifications without departing from the spirit and scope of the invention.

Claims (20)

1. An image display method of a head-mounted display device, the head-mounted display device comprising a first display and a first lens, the method comprising:
acquiring a plurality of display parameters respectively corresponding to a plurality of sub-display areas of the first display, wherein the display area of the first display is divided into the plurality of sub-display areas, the plurality of sub-display areas comprise a first sub-display area and a second sub-display area, and the plurality of display parameters comprise a first display parameter corresponding to the first sub-display area and a second display parameter corresponding to the second sub-display area; and controlling the first display to display in the first sub-display area according to the first display parameter, and controlling the first display to display in the second sub-display area according to the second display parameter, wherein the display area of the first display is divided into the sub-display areas from inside to outside by taking a reference point as a center.
2. The image display method of a head-mounted display device according to claim 1, wherein an optical axis of the first lens passes through the reference point.
3. The method for displaying images on a head-mounted display device according to claim 1, wherein a distance between the first sub-display region and the reference point is greater than a distance between the second sub-display region and the reference point, and the first display parameter is higher than the second display parameter.
4. The method of claim 1, wherein the plurality of display parameters comprise a frame contrast, a frame sharpness, a display resolution, or a combination thereof.
5. The method of claim 1, wherein the head-mounted display device further comprises a second display and a second lens, and the method further comprises:
tracking a gaze location of a left eye and a gaze location of a right eye;
determining that the gaze location of the left eye is located in a left eye concentration region of the plurality of sub-display regions of the first display and determining that the gaze location of the right eye is located in a right eye concentration region of the plurality of sub-display regions of the second display;
acquiring a left definition parameter corresponding to the left eye concentration area and a right definition parameter corresponding to the right eye concentration area;
comparing the left sharpness parameter corresponding to the left eye concentration region with the right sharpness parameter corresponding to the right eye concentration region to adjust a third display parameter of the left eye concentration region or a fourth display parameter of the right eye concentration region; and
and controlling the first display to display in the left eye concentration area according to the third display parameter, and controlling the second display to display in the right eye concentration area according to the fourth display parameter.
6. The method as claimed in claim 5, wherein a plurality of resolution parameters of the sub-display regions of the first display are recorded in a storage device of the head-mounted display device, a plurality of resolution parameters of the sub-display regions of the second display are recorded in the storage device, the resolution parameters of the sub-display regions of the first display comprise a left resolution parameter, and the resolution parameters of the sub-display regions of the second display comprise a right resolution parameter.
7. The method as claimed in claim 5, wherein the step of comparing the left sharpness parameter corresponding to the left eye concentration region with the right sharpness parameter corresponding to the right eye concentration region to adjust the third display parameter corresponding to the left eye concentration region or the fourth display parameter corresponding to the right eye concentration region comprises:
judging whether an absolute difference value between the left definition parameter and the right definition parameter is larger than a difference critical value or not; and
adjusting one of the third display parameter and the fourth display parameter if the absolute difference between the left sharpness parameter and the right sharpness parameter is greater than the difference threshold, wherein the third display parameter and the fourth display parameter are adjusted based on a higher one of the left sharpness parameter and the right sharpness parameter.
8. The method as claimed in claim 7, wherein the step of adjusting one of the third display parameter and the fourth display parameter comprises:
if the left definition parameter is greater than the right definition parameter, adjusting the third display parameter corresponding to the left eye concentration area; and
if the right sharpness parameter is greater than the left sharpness parameter, adjusting the fourth display parameter corresponding to the right eye concentration area.
9. The method as claimed in claim 7, wherein if the absolute difference between the left-resolution parameter and the right-resolution parameter is greater than the difference threshold, the step of adjusting one of the third display parameter and the fourth display parameter comprises:
when the third display parameter of the left eye concentration area is adjusted, searching a target definition parameter from the definition parameters of the left eye concentration area according to the right definition parameter, and reducing the third display parameter according to a preset display parameter corresponding to the target definition parameter; and
when the fourth display parameter of the right-eye concentration area is adjusted, another target definition parameter is searched from the definition parameters of the right-eye concentration area according to the left definition parameter, and the fourth display parameter is adjusted according to a preset display parameter corresponding to the other target definition parameter.
10. The method as claimed in claim 5, further comprising, before the step of determining whether the absolute difference between the left-resolution parameter and the right-resolution parameter is greater than the difference threshold, the step of:
judging whether the left definition parameter and the right definition parameter are both larger than an adjustment threshold value; and
and if the left definition parameter and the right definition parameter are not greater than the adjustment threshold value, not adjusting the third display parameter and the fourth display parameter.
11. A head-mounted display device, comprising:
a first display;
a first lens;
a storage device storing a plurality of instructions;
a processing circuit coupled to the first display and the storage device for executing the plurality of instructions to: acquiring a plurality of display parameters respectively corresponding to a plurality of sub-display areas of the first display, wherein the display area of the first display is divided into the plurality of sub-display areas, the plurality of sub-display areas comprise a first sub-display area and a second sub-display area, and the plurality of display parameters comprise a first display parameter corresponding to the first sub-display area and a second display parameter corresponding to the second sub-display area; and
controlling the first display to display in the first sub-display area according to the first display parameter, and controlling the first display to display in the second sub-display area according to the second display parameter,
the display area of the first display is divided into the plurality of sub-display areas from inside to outside by taking a reference point as a center.
12. The head-mounted display device of claim 11, wherein an optical axis of the first lens passes through the reference point.
13. The head-mounted display device of claim 11, wherein a distance between the first sub-display area and the reference point is greater than a distance between the second sub-display area and the reference point, and the first display parameter is higher than the second display parameter.
14. The head-mounted display apparatus of claim 11, wherein the display parameter comprises a picture contrast, a picture sharpness, a display resolution, or a combination thereof.
15. The head-mounted display device of claim 11, wherein the head-mounted display device further comprises a second display, a second lens, and an eye tracking device, and the processing circuit is further configured to execute the instructions to:
tracking a gaze location of a left eye and a gaze location of a right eye with the eye tracking device;
determining that the gaze location of the left eye is located in a left eye concentration region of the plurality of sub-display regions of the first display and determining that the gaze location of the right eye is located in a right eye concentration region of the plurality of sub-display regions of the second display;
acquiring a left definition parameter corresponding to the left eye concentration area and a right definition parameter corresponding to the right eye concentration area;
comparing the left sharpness parameter corresponding to the left eye concentration region with the right sharpness parameter corresponding to the right eye concentration region to adjust a third display parameter of the left eye concentration region or a fourth display parameter of the right eye concentration region; and
and controlling the first display to display in the left eye concentration area according to the third display parameter, and controlling the second display to display in the right eye concentration area according to the fourth display parameter.
16. The head-mounted display apparatus according to claim 15, wherein a plurality of resolution parameters of the sub-display areas of the first display are recorded in a storage device of the head-mounted display apparatus, a plurality of resolution parameters of the sub-display areas of the second display are recorded in the storage device, the plurality of resolution parameters of the sub-display areas of the first display comprise a left resolution parameter, and the plurality of resolution parameters of the sub-display areas of the second display comprise a right resolution parameter.
17. The head-mounted display apparatus of claim 15, wherein the processing circuit determines whether an absolute difference between the left definition parameter and the right definition parameter is greater than a difference threshold, wherein if the absolute difference between the left definition parameter and the right definition parameter is greater than the difference threshold, the processing circuit adjusts one of the third display parameter and the fourth display parameter, wherein the adjusted one of the third display parameter and the fourth display parameter is determined based on a higher one of the left definition parameter and the right definition parameter.
18. The head-mounted display device of claim 17, wherein if the left sharpness parameter is greater than the right sharpness parameter, the processing circuit adjusts the third display parameter corresponding to the left eye focus area; and if the right sharpness parameter is greater than the left sharpness parameter, the processing circuit adjusts the fourth display parameter corresponding to the right eye concentration area.
19. The head-mounted display apparatus according to claim 17, wherein when the processing circuit adjusts the third display parameter of the left-eye concentration area, the processing circuit searches for a target sharpness parameter from the sharpness parameters of the left-eye concentration area according to the right sharpness parameter, and decreases the third display parameter according to a preset display parameter corresponding to the target sharpness parameter; and when the processing circuit adjusts the fourth display parameter of the right-eye concentration area, the processing circuit searches another target definition parameter from the plurality of definition parameters of the right-eye concentration area according to the left definition parameter, and reduces the fourth display parameter according to a preset display parameter corresponding to the another target definition parameter.
20. The head-mounted display device according to claim 15, wherein the processing circuit determines whether the left sharpness parameter and the right sharpness parameter are both greater than an adjustment threshold; and if the left definition parameter and the right definition parameter are not greater than the adjustment threshold value, the processing circuit does not adjust the third display parameter and the fourth display parameter.
CN201910074098.8A 2019-01-25 2019-01-25 Image display method of head-mounted display device and head-mounted display device Pending CN111489670A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910074098.8A CN111489670A (en) 2019-01-25 2019-01-25 Image display method of head-mounted display device and head-mounted display device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910074098.8A CN111489670A (en) 2019-01-25 2019-01-25 Image display method of head-mounted display device and head-mounted display device

Publications (1)

Publication Number Publication Date
CN111489670A true CN111489670A (en) 2020-08-04

Family

ID=71810689

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910074098.8A Pending CN111489670A (en) 2019-01-25 2019-01-25 Image display method of head-mounted display device and head-mounted display device

Country Status (1)

Country Link
CN (1) CN111489670A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140225920A1 (en) * 2013-02-13 2014-08-14 Seiko Epson Corporation Image display device and display control method for image display device
JP2016061809A (en) * 2014-09-12 2016-04-25 ブラザー工業株式会社 Display device, head-mounted display, display controller, display program, and display method
CN105892061A (en) * 2016-06-24 2016-08-24 北京国承万通信息科技有限公司 Display device and display method
US20180005563A1 (en) * 2016-06-30 2018-01-04 Samsung Display Co., Ltd. Head mounted display device and method of driving the same
TW201814356A (en) * 2016-10-03 2018-04-16 宏碁股份有限公司 Head-mounted display apparatus and lens position adjusting method thereof
CN108415170A (en) * 2018-05-29 2018-08-17 深圳宇博先进科技有限公司 Head-wearing display device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140225920A1 (en) * 2013-02-13 2014-08-14 Seiko Epson Corporation Image display device and display control method for image display device
JP2016061809A (en) * 2014-09-12 2016-04-25 ブラザー工業株式会社 Display device, head-mounted display, display controller, display program, and display method
CN105892061A (en) * 2016-06-24 2016-08-24 北京国承万通信息科技有限公司 Display device and display method
US20180005563A1 (en) * 2016-06-30 2018-01-04 Samsung Display Co., Ltd. Head mounted display device and method of driving the same
TW201814356A (en) * 2016-10-03 2018-04-16 宏碁股份有限公司 Head-mounted display apparatus and lens position adjusting method thereof
CN108415170A (en) * 2018-05-29 2018-08-17 深圳宇博先进科技有限公司 Head-wearing display device

Similar Documents

Publication Publication Date Title
EP3740847B1 (en) Display systems and methods for determining registration between a display and a user's eyes
US20240022704A1 (en) Combining video-based and optic-based augmented reality in a near eye display
KR102428196B1 (en) Replicating effects of optical lenses
US9720238B2 (en) Method and apparatus for a dynamic “region of interest” in a display system
JP2019091051A (en) Display device, and display method using focus display and context display
JP2023504373A (en) Predictive eye-tracking system and method for foveal rendering of electronic displays
US10401953B2 (en) Systems and methods for eye vergence control in real and augmented reality environments
JP6507241B2 (en) Head-mounted display device and vision assistance method using the same
EP3827426A1 (en) Display systems and methods for determining registration between a display and eyes of a user
US8692870B2 (en) Adaptive adjustment of depth cues in a stereo telepresence system
JP6026836B2 (en) Image display device, control method, program, and storage medium
JP2018004950A (en) Video display system, video display method, and video display program
EP3548955B1 (en) Display apparatus and method of displaying using image renderers and optical combiners
KR101613091B1 (en) Device and method for tracking gaze
WO2018100239A1 (en) Imaging system and method of producing images for display apparatus
TW201814356A (en) Head-mounted display apparatus and lens position adjusting method thereof
JPH09322197A (en) Stereoscopic vision display device
CN111580273B (en) Video transmission type head-mounted display and control method thereof
TWI683134B (en) Image display method of head-mounted display apparatus and head-mounted display apparatus
JP2019118004A (en) Information processing apparatus, information processing method, and recording medium
CN111489670A (en) Image display method of head-mounted display device and head-mounted display device
US20230244307A1 (en) Visual assistance
US20230393655A1 (en) Electronic apparatus
US11740478B2 (en) Display device, control method thereof, and recording medium
US11327313B2 (en) Method and system for rendering an image with a pupil enhanced accommodation of the eye

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20200804

WD01 Invention patent application deemed withdrawn after publication