CN114494659A - Image display method and device, AR head-mounted equipment and storage medium - Google Patents
Image display method and device, AR head-mounted equipment and storage medium Download PDFInfo
- Publication number
- CN114494659A CN114494659A CN202210108601.9A CN202210108601A CN114494659A CN 114494659 A CN114494659 A CN 114494659A CN 202210108601 A CN202210108601 A CN 202210108601A CN 114494659 A CN114494659 A CN 114494659A
- Authority
- CN
- China
- Prior art keywords
- shadow
- line segment
- reference object
- image
- straight line
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
- G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Processing Or Creating Images (AREA)
Abstract
The application discloses an image display method, which comprises the following steps: acquiring an environment image, and determining a reference object body and a reference object shadow in the environment image; determining a light source height angle and a shadow offset direction angle according to the position relation of the reference object body and the reference object shadow in the environment image; and carrying out scene light irradiation on the virtual object according to the light source height angle and the shadow offset direction angle to obtain a target image, and displaying the target image. The method and the device can improve the imaging quality of the displayed virtual object and reduce the difference between the virtual object and the real environment. The application also discloses an image display device, a storage medium and an AR head-mounted device, which have the beneficial effects.
Description
Technical Field
The present application relates to the field of image processing technologies, and in particular, to an image display method and apparatus, an AR headset, and a storage medium.
Background
The user mainly carries out human-computer interaction with the electronic equipment through the visual information, and the good human-computer interaction can greatly improve the use experience of the user. Electronic devices such as AR (Augmented Reality) headsets, VR (Virtual Reality) headsets, smartphones and the like generally display information such as text, images and the like on a display device so as to provide a user with required information. To improve the display effect, the electronic device may create and display a virtual object. The combined effect of the virtual object and the real environment is particularly important when displaying the virtual object.
Therefore, how to improve the imaging quality of displaying the virtual object and reduce the difference between the virtual object and the real environment is a technical problem that needs to be solved by those skilled in the art at present.
Disclosure of Invention
The application aims to provide an image display method, an image display device, an AR head-mounted device and a storage medium, which can improve the imaging quality of a displayed virtual object and reduce the difference between the virtual object and a real environment.
In order to solve the above technical problem, the present application provides an image display method, including:
acquiring an environment image, and determining a reference object body and a reference object shadow in the environment image;
determining a light source height angle and a shadow offset direction angle according to the position relation of the reference object body and the reference object shadow in the environment image;
and carrying out scene light irradiation on the virtual object according to the light source height angle and the shadow offset direction angle to obtain a target image, and displaying the target image.
Optionally, determining a reference object ontology and a reference object shadow in the environment image includes:
and performing image recognition on the environment image, setting a vertical object in the environment image as a reference object body according to an image recognition result, and setting the shadow of the vertical object as the shadow of the reference object.
Optionally, determining a reference object ontology and a reference object shadow in the environment image includes:
transmitting the environment image to a human-computer interaction interface, and receiving the labeling information of a user on the environment image; wherein the standard information comprises the outline of the reference object body and the outline of the reference object shadow;
and determining the reference object body and the reference object shadow in the environment image according to the annotation information.
Optionally, determining a light source height angle and a shadow offset direction angle according to a position relationship between the reference object body and the reference object shadow in the environment image, includes:
respectively calculating a first straight line segment corresponding to the reference object body and a second straight line segment corresponding to the reference object shadow by using a straight line detection algorithm;
determining the position relation of the first straight line segment and the second straight line segment according to the position relation of the reference object body and the reference object shadow in the environment image;
and determining the height angle of the light source and the offset direction angle of the shadow according to the position relation of the first straight line segment and the second straight line segment.
Optionally, determining the light source elevation angle and the shadow offset direction angle according to the position relationship between the first straight line segment and the second straight line segment includes:
establishing a space coordinate system according to the position relation of the first straight line segment and the second straight line segment; the origin of the space coordinate system is the intersection point of the first straight line segment and the second straight line segment, the first straight line segment is overlapped with the Y axis of the space coordinate system, and the plane where the first straight line segment and the second straight line segment are located is overlapped with the XY axis plane of the space coordinate system;
setting an included angle between the target straight line segment and the Y axis as the height angle of the light source; the target straight-line segment is a connecting line of a first target endpoint of the first straight-line segment and a second target endpoint of the second straight-line segment, and the first target endpoint and the second target endpoint are not the intersection point of the first straight-line segment and the second straight-line segment;
and calculating the shadow offset direction angle according to the projection length of the second straight line segment on the X axis and the length of the second straight line segment.
Optionally, after the target image is displayed, the method further includes:
judging whether a light source in the environment image is a natural light source or not;
if so, after delaying for a preset time, determining a new light source height angle and a new shadow offset direction angle, so as to perform scene light irradiation on the virtual object according to the new light source height angle and the new shadow offset direction angle to obtain a new target image and display the new target image.
Optionally, before performing scene light irradiation on the virtual object according to the light source altitude angle and the shadow offset direction angle to obtain a target image, the method further includes:
and determining the light intensity of the environment according to the environment image, and adjusting the illumination intensity of the scene light according to the light intensity of the environment.
The present application also provides an image display apparatus, the apparatus including:
the reference object determining module is used for acquiring an environment image and determining a reference object body and a reference object shadow in the environment image;
the angle calculation module is used for determining a light source height angle and a shadow offset direction angle according to the position relation of the reference object body and the reference object shadow in the environment image;
and the display module is used for carrying out scene light irradiation on the virtual object according to the light source height angle and the shadow offset direction angle to obtain a target image and displaying the target image.
The present application also provides a storage medium having stored thereon a computer program that, when executed, performs the steps performed by the above-described image display method.
The application also provides an AR head-mounted device, which comprises a memory and a processor, wherein the memory is stored with a computer program, and the processor realizes the steps executed by the image display method when calling the computer program in the memory.
The application provides an image display method, which comprises the following steps: acquiring an environment image, and determining a reference object body and a reference object shadow in the environment image; determining a light source height angle and a shadow offset direction angle according to the position relation of the reference object body and the reference object shadow in the environment image; and carrying out scene light irradiation on the virtual object according to the light source height angle and the shadow offset direction angle to obtain a target image, and displaying the target image.
The method and the device can determine the light source height angle and the shadow offset direction angle when the environment image is shot according to the position relation of the reference object body and the reference object shadow in the environment image. Corresponding scene light can be determined according to the light source height angle and the shadow offset direction angle, and the virtual object is subjected to scene light irradiation to obtain an image to be displayed. According to the scheme, the scene light irradiating the virtual object is the same as the direction and the incident angle of the light source in the real world, so that the imaging quality of the displayed virtual object can be improved, and the difference between the virtual object and the real environment is reduced. This application still provides an image display device, a storage medium and an AR head mounted device simultaneously, has above-mentioned beneficial effect, no longer gives unnecessary details here.
Drawings
In order to more clearly illustrate the embodiments of the present application, the drawings needed for the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained by those skilled in the art without inventive effort.
Fig. 1 is a flowchart of an image display method according to an embodiment of the present disclosure;
fig. 2 is a comparison chart before and after a line detection provided in an embodiment of the present application;
FIG. 3 is a schematic diagram illustrating a method for determining a light source elevation angle and a shadow offset direction angle according to an embodiment of the present disclosure;
fig. 4 is a schematic imaging diagram of an AR scene according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of an image display device according to an embodiment of the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.
Referring to fig. 1, fig. 1 is a flowchart of an image display method according to an embodiment of the present disclosure.
The specific steps may include:
s101: acquiring an environment image, and determining a reference object body and a reference object shadow in the environment image;
wherein, this embodiment can be applied to electronic equipment such as AR head-mounted device, VR head-mounted device, smart mobile phone, can improve above-mentioned electronic equipment's virtual model's the demonstration degree of reality through this scheme of use for virtual model's display effect is more lifelike.
In this step, an environment image may be captured, and a reference object body and a reference object shadow may be determined from the environment image, and in order to improve an image display effect, the reference object in this embodiment may be a slender upright object, such as a flagpole, a telegraph pole, a trunk, and the like.
S102: determining a light source height angle and a shadow offset direction angle according to the position relation of the reference object body and the reference object shadow in the environment image;
after the reference body and the reference shadow in the environment image are determined, in this embodiment, the light source height angle and the shadow offset direction angle may be derived from the positional relationship between the reference body and the reference shadow in the environment image, because the reference shadow is generated by irradiating the reference body with light. Light source height angle means: the included angle between the incident light of the light source and the vertical direction in the environment image; the shadow offset direction angle indicates: and the included angle between the shadow of the reference object and the horizontal direction in the environment image.
S103: and carrying out scene light irradiation on the virtual object according to the light source height angle and the shadow offset direction angle to obtain a target image, and displaying the target image.
The orientation of the light source in the real scene can be determined according to the height angle of the light source and the shadow offset direction angle, and then the virtual light source is added in the virtual scene where the virtual object is located based on the orientation of the light source in the real scene, so that the scene light of the virtual scene is the same as the light in the real scene. The embodiment can perform scene light irradiation rendering on the virtual object according to the light source height angle and the shadow offset direction angle to obtain the target image, and then display the target image in the display screen.
In the present embodiment, an environment image is acquired, a reference object body and a reference object shadow in the environment image are determined, and a light source height angle and a shadow offset direction angle when the environment image is captured can be determined according to a positional relationship between the reference object body and the reference object shadow in the environment image. Corresponding scene light can be determined according to the light source height angle and the shadow offset direction angle, and the virtual object is subjected to scene light irradiation to obtain an image to be displayed. According to the scheme, the scene light irradiating the virtual object is the same as the direction and the incident angle of the light source in the real world, so that the imaging quality of the displayed virtual object can be improved, and the difference between the virtual object and the real environment is reduced.
As a further introduction to the embodiment corresponding to fig. 1, the above embodiment can determine the reference object body and the reference object shadow in at least two ways:
mode 1: and performing image recognition on the environment image, setting a vertical object in the environment image as a reference object body according to an image recognition result, and setting the shadow of the vertical object as the shadow of the reference object. Specifically, the vertical object in the environment image can be identified by using a target detection model such as fast R-CNN, YOLO, and the like.
Mode 2: transmitting the environment image to a human-computer interaction interface, and receiving the labeling information of a user on the environment image; wherein the standard information comprises the outline of the reference object body and the outline of the reference object shadow; and determining the reference object body and the reference object shadow in the environment image according to the labeling information. In the method 2, the user can mark the outline of the reference object body and the outline of the reference object shadow in the environment image, and the amount of calculation of the machine can be reduced.
As a possible implementation, the embodiment of fig. 1 may determine the light source height angle and the shadow offset direction angle by: respectively calculating a first straight line segment corresponding to the reference object body and a second straight line segment corresponding to the reference object shadow by using a straight line detection algorithm; determining the position relation of the first straight line segment and the second straight line segment according to the position relation of the reference object body and the reference object shadow in the environment image; and determining the height angle of the light source and the offset direction angle of the shadow according to the position relation of the first straight line segment and the second straight line segment.
Specifically, the above process may establish a spatial coordinate system according to a positional relationship between the first straight line segment and the second straight line segment; the origin of the space coordinate system is the intersection point of the first straight line segment and the second straight line segment, the first straight line segment is overlapped with the Y axis of the space coordinate system, and the plane where the first straight line segment and the second straight line segment are located is overlapped with the XY axis plane of the space coordinate system (namely, the plane XOY where the X axis and the Y axis are located in the space coordinate system); setting an included angle between the target straight line segment and the Y axis as the height angle of the light source; the target straight-line segment is a connecting line of a first target endpoint of the first straight-line segment and a second target endpoint of the second straight-line segment, and the first target endpoint and the second target endpoint are not the intersection point of the first straight-line segment and the second straight-line segment; and calculating the shadow offset direction angle according to the projection length of the second straight line segment on the X axis and the length of the second straight line segment.
Referring to fig. 2, fig. 2 is a comparison diagram before and after line detection according to an embodiment of the present disclosure, in this embodiment, a vertical object of a display scene is set as a reference body, a is the reference body, and a' is a reference shadow, and a line detection result of the reference body and a line detection result of the reference shadow can be obtained through line detection. The method comprises the steps of detecting a vertical object and a shadow in a scene by using a Hough transformation linear detection algorithm, and determining the height h of a reference object body and the length l of the shadow of the reference object according to the length of a measured and detected line segment.
Referring to fig. 3, fig. 3 is a schematic diagram illustrating a method for determining a light source elevation angle and a shadow offset direction angle according to an embodiment of the present disclosure, as shown in fig. 3, the embodiment establishes a spatial coordinate system, measures a length d of a shadow of a reference object mapped on an X coordinate axis, and calculates a corresponding light source elevation angle α and an offset direction angle β in an XZ coordinate system. The calculation formula is as follows:
as a possible implementation, after the target image is displayed, it may be further determined whether the light source in the environment image is a natural light source; if so, after delaying for a preset time, determining a new light source height angle and a new shadow offset direction angle, so as to perform scene light irradiation on the virtual object according to the new light source height angle and the new shadow offset direction angle to obtain a new target image and display the new target image. Since the position of the natural light source changes with time, the present embodiment may take an environmental picture and re-determine the light source elevation angle and the shadow offset direction angle in the above manner.
As a feasible implementation manner, before the target image is obtained by performing scene light irradiation on the virtual object according to the light source elevation angle and the shadow offset direction angle, the ambient light intensity may be determined according to the ambient image, and the illumination intensity of the scene light may be adjusted according to the ambient light intensity, so as to improve the imaging reality degree of the target image. The illumination intensity of the scene light is positively correlated with the intensity of the ambient light.
Because the illumination consistency is crucial to the reality of the fusion of the virtual scene and the real scene, and the light source direction is the basis of the illumination information, the image display scheme based on the scene light direction detection can be used in the AR head-mounted device, so that a user can obtain more real user experience when using the AR head-mounted device. Specifically, an ambient light direction detection method can be added to the AR scene, so that the virtual and reality fusion effect is improved. The line segments of the reference object and the shadows of the reference object are detected by using a Hough linear detection algorithm, the incident angle of the ambient light is obtained through calculation of a corresponding algorithm by combining the detection result, and the incident angle is applied to AR scene rendering and fusion. The shadow caused by the light is combined in the 3D modeling of the virtual object, so that the virtual object and the object in the actual scene have the consistent light and shade state, the reality of augmented reality is improved, and the user experience is improved.
Referring to fig. 4, fig. 4 is a schematic imaging diagram of an AR scene provided in an embodiment of the present application, where a cube in fig. 4 is a virtual object, and a shadow portion is a shadow of the virtual object. By setting the consistent illumination altitude angle alpha and azimuth angle beta in the AR scene, the real shadow and light and shade states are generated by combining the projection direction of light in the 3D modeling of the virtual object, and are rendered in the real scene, so that the more real user experience is realized. When the scheme is applied to the AR head-mounted equipment, the illumination setting in the scene of the AR head-mounted equipment can be matched with the real illumination condition, the 3D modeling and rendering effect in the real scene are better and real, and the product experience of a user is improved.
Referring to fig. 5, fig. 5 is a schematic structural diagram of an image display device according to an embodiment of the present disclosure, where the image display device may include:
a reference object determining module 501, configured to obtain an environment image, and determine a reference object body and a reference object shadow in the environment image;
an angle calculation module 502, configured to determine a light source elevation angle and a shadow offset direction angle according to a position relationship between the reference body and the reference shadow in the environment image;
and the display module 503 is configured to perform scene light irradiation on the virtual object according to the light source elevation angle and the shadow offset direction angle to obtain a target image, and display the target image.
In the present embodiment, an environment image is acquired, a reference object body and a reference object shadow in the environment image are determined, and a light source height angle and a shadow offset direction angle when the environment image is captured can be determined according to a positional relationship between the reference object body and the reference object shadow in the environment image. Corresponding scene light can be determined according to the light source height angle and the shadow offset direction angle, and the virtual object is subjected to scene light irradiation to obtain an image to be displayed. According to the scheme, the scene light irradiating the virtual object is the same as the direction and the incident angle of the light source in the real world, so that the imaging quality of the displayed virtual object can be improved, and the difference between the virtual object and the real environment is reduced.
Further, the reference determining module 501 is configured to perform image recognition on the environment image, set a vertical object in the environment image as a reference body according to an image recognition result, and set a shadow of the vertical object as the reference shadow.
Further, the reference object determining module 501 is configured to transmit the environment image to a human-computer interaction interface, and receive labeling information of the environment image from a user; wherein the standard information comprises the outline of the reference object body and the outline of the reference object shadow; and the system is also used for determining the reference object body and the reference object shadow in the environment image according to the labeling information.
Further, the angle calculating module 502 is configured to calculate a first straight line segment corresponding to the reference object body and a second straight line segment corresponding to the reference object shadow by using a straight line detection algorithm; the first straight line segment and the second straight line segment are further used for determining the position relation of the first straight line segment and the second straight line segment according to the position relation of the reference object body and the reference object shadow in the environment image; and the shadow offset direction angle is also used for determining the light source height angle and the shadow offset direction angle according to the position relation of the first straight line segment and the second straight line segment.
Further, the process of determining the light source height angle and the shadow offset direction angle by the angle calculation module 502 according to the position relationship between the first straight line segment and the second straight line segment includes: establishing a space coordinate system according to the position relation of the first straight line segment and the second straight line segment; the origin of the space coordinate system is the intersection point of the first straight line segment and the second straight line segment, the first straight line segment is overlapped with the Y axis of the space coordinate system, and the plane where the first straight line segment and the second straight line segment are located is overlapped with the XY axis plane of the space coordinate system; setting an included angle between the target straight line segment and the Y axis as the height angle of the light source; the target straight-line segment is a connecting line of a first target endpoint of the first straight-line segment and a second target endpoint of the second straight-line segment, and the first target endpoint and the second target endpoint are not the intersection point of the first straight-line segment and the second straight-line segment; and calculating the shadow offset direction angle according to the projection length of the second straight line segment on the X axis and the length of the second straight line segment.
Further, the method also comprises the following steps:
the updating module is used for judging whether a light source in the environment image is a natural light source or not after the target image is displayed; if so, after delaying for a preset time, determining a new light source height angle and a new shadow offset direction angle, so as to perform scene light irradiation on the virtual object according to the new light source height angle and the new shadow offset direction angle to obtain a new target image and display the new target image.
Further, the method also comprises the following steps:
and the light intensity adjusting module is used for determining the ambient light intensity according to the ambient image before carrying out scene light irradiation on the virtual object according to the light source altitude angle and the shadow offset direction angle to obtain a target image, and adjusting the illumination intensity of the scene light according to the ambient light intensity.
Since the embodiments of the apparatus portion and the method portion correspond to each other, please refer to the description of the embodiments of the method portion for the embodiments of the apparatus portion, which is not repeated here.
The present application also provides a storage medium having a computer program stored thereon, which when executed, may implement the steps provided by the above-described embodiments. The storage medium may include: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The present application further provides an AR headset, which may include a memory and a processor, where the memory stores a computer program, and when the processor calls the computer program in the memory, the steps provided in the foregoing embodiments may be implemented. Of course, the AR headset may also include various network interfaces, power supplies, and the like.
The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and such improvements and modifications also fall within the scope of the claims of the present application.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. An image display method, comprising:
acquiring an environment image, and determining a reference object body and a reference object shadow in the environment image;
determining a light source height angle and a shadow offset direction angle according to the position relation of the reference object body and the reference object shadow in the environment image;
and carrying out scene light irradiation on the virtual object according to the light source height angle and the shadow offset direction angle to obtain a target image, and displaying the target image.
2. The image display method according to claim 1, wherein determining a reference object ontology and a reference object shadow in the environment image comprises:
and performing image recognition on the environment image, setting a vertical object in the environment image as a reference object body according to an image recognition result, and setting the shadow of the vertical object as the shadow of the reference object.
3. The image display method according to claim 1, wherein determining a reference object ontology and a reference object shadow in the environment image comprises:
transmitting the environment image to a human-computer interaction interface, and receiving the labeling information of a user on the environment image; wherein the standard information comprises the outline of the reference object body and the outline of the reference object shadow;
and determining the reference object body and the reference object shadow in the environment image according to the labeling information.
4. The image display method according to claim 1, wherein determining a light source elevation angle and a shadow shift direction angle from a positional relationship of the reference body and the reference shadow in the environment image includes:
respectively calculating a first straight line segment corresponding to the reference object body and a second straight line segment corresponding to the reference object shadow by using a straight line detection algorithm;
determining the position relation of the first straight line segment and the second straight line segment according to the position relation of the reference object body and the reference object shadow in the environment image;
and determining the height angle of the light source and the offset direction angle of the shadow according to the position relation of the first straight line segment and the second straight line segment.
5. The image display method according to claim 4, wherein determining the light source elevation angle and the shadow shift direction angle from the positional relationship of the first straight line segment and the second straight line segment includes:
establishing a space coordinate system according to the position relation of the first straight line segment and the second straight line segment; the origin of the space coordinate system is the intersection point of the first straight line segment and the second straight line segment, the first straight line segment is overlapped with the Y axis of the space coordinate system, and the plane where the first straight line segment and the second straight line segment are located is overlapped with the XY axis plane of the space coordinate system;
setting an included angle between the target straight line segment and the Y axis as the height angle of the light source; the target straight-line segment is a connecting line of a first target endpoint of the first straight-line segment and a second target endpoint of the second straight-line segment, and the first target endpoint and the second target endpoint are not the intersection point of the first straight-line segment and the second straight-line segment;
and calculating the shadow offset direction angle according to the projection length of the second straight line segment on the X axis and the length of the second straight line segment.
6. The image display method according to claim 1, further comprising, after displaying the target image:
judging whether a light source in the environment image is a natural light source or not;
if so, after delaying for a preset time, determining a new light source height angle and a new shadow offset direction angle, so as to perform scene light irradiation on the virtual object according to the new light source height angle and the new shadow offset direction angle to obtain a new target image and display the new target image.
7. The image display method according to any one of claims 1 to 6, wherein before the obtaining of the target image by illuminating the virtual object with the scene light according to the light source elevation angle and the shadow shift direction angle, the method further comprises:
and determining the light intensity of the environment according to the environment image, and adjusting the illumination intensity of the scene light according to the light intensity of the environment.
8. An image display apparatus, comprising:
the reference object determining module is used for acquiring an environment image and determining a reference object body and a reference object shadow in the environment image;
the angle calculation module is used for determining a light source height angle and a shadow offset direction angle according to the position relation of the reference object body and the reference object shadow in the environment image;
and the display module is used for carrying out scene light irradiation on the virtual object according to the light source height angle and the shadow offset direction angle to obtain a target image and displaying the target image.
9. An AR headset comprising a memory in which a computer program is stored and a processor which, when called into the memory, implements the steps of the image display method according to any one of claims 1 to 7.
10. A storage medium having stored thereon computer-executable instructions which, when loaded and executed by a processor, carry out the steps of the image display method according to any one of claims 1 to 7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210108601.9A CN114494659A (en) | 2022-01-28 | 2022-01-28 | Image display method and device, AR head-mounted equipment and storage medium |
| PCT/CN2022/084579 WO2023142264A1 (en) | 2022-01-28 | 2022-03-31 | Image display method and apparatus, and ar head-mounted device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210108601.9A CN114494659A (en) | 2022-01-28 | 2022-01-28 | Image display method and device, AR head-mounted equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114494659A true CN114494659A (en) | 2022-05-13 |
Family
ID=81476160
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210108601.9A Pending CN114494659A (en) | 2022-01-28 | 2022-01-28 | Image display method and device, AR head-mounted equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114494659A (en) |
| WO (1) | WO2023142264A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116974417A (en) * | 2023-07-25 | 2023-10-31 | 江苏泽景汽车电子股份有限公司 | Display control method and device, electronic equipment and storage medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108062752B (en) * | 2017-12-13 | 2023-07-25 | 杭州易现先进科技有限公司 | Method, medium, device and computing equipment for judging azimuth of main light source |
| CN108154549A (en) * | 2017-12-25 | 2018-06-12 | 太平洋未来有限公司 | A kind of three dimensional image processing method |
| CN108525298B (en) * | 2018-03-26 | 2020-08-04 | Oppo广东移动通信有限公司 | Image processing method, image processing device, storage medium and electronic equipment |
| JP2019212062A (en) * | 2018-06-05 | 2019-12-12 | 株式会社セガゲームス | Information processing device and program |
| CN109255841A (en) * | 2018-08-28 | 2019-01-22 | 百度在线网络技术（北京）有限公司 | AR image presentation method, device, terminal and storage medium |
-
2022
- 2022-01-28 CN CN202210108601.9A patent/CN114494659A/en active Pending
- 2022-03-31 WO PCT/CN2022/084579 patent/WO2023142264A1/en unknown
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116974417A (en) * | 2023-07-25 | 2023-10-31 | 江苏泽景汽车电子股份有限公司 | Display control method and device, electronic equipment and storage medium |
| CN116974417B (en) * | 2023-07-25 | 2024-03-29 | 江苏泽景汽车电子股份有限公司 | Display control method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023142264A1 (en) | 2023-08-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108304075B (en) | Method and device for performing man-machine interaction on augmented reality device | |
| CN111311756B (en) | Augmented reality AR display method and related device | |
| US9576397B2 (en) | Reducing latency in an augmented-reality display | |
| CN104346612B (en) | Information processing unit and display methods | |
| CN108765270B (en) | Virtual three-dimensional space tag binding method and device | |
| CN111294665A (en) | Video generation method and device, electronic equipment and readable storage medium | |
| CN112037314A (en) | Image display method, image display device, display equipment and computer readable storage medium | |
| JP2005135355A (en) | Data authoring processing apparatus | |
| WO2019228144A1 (en) | Image processing method and device | |
| CN108430032B (en) | Method and equipment for realizing position sharing of VR/AR equipment | |
| CN111382618B (en) | Illumination detection method, device, equipment and storage medium for face image | |
| CN104680532A (en) | Object labeling method and device | |
| EP3813019A1 (en) | Method and system for estimating the geometry of a scene | |
| CN108597034B (en) | Method and apparatus for generating information | |
| CN111340865B (en) | Method and apparatus for generating image | |
| US20220139016A1 (en) | Sticker generating method and apparatus, and medium and electronic device | |
| CN114494659A (en) | Image display method and device, AR head-mounted equipment and storage medium | |
| CN107203961B (en) | Expression migration method and electronic equipment | |
| CN112991208B (en) | Image processing method and device, computer readable medium and electronic equipment | |
| US20220245900A1 (en) | Systems and methods of augmented reality guided image capture | |
| CN109040612B (en) | Image processing method, device and equipment of target object and storage medium | |
| CN112860060B (en) | Image recognition method, device and storage medium | |
| CN113552942A (en) | Method and equipment for displaying virtual object based on illumination intensity | |
| EP2706508B1 (en) | Reducing latency in an augmented-reality display | |
| JP5865092B2 (en) | Image processing apparatus, image processing method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |