CN111416947B - Augmented reality device imaging method and device, computer device and storage medium - Google Patents
Augmented reality device imaging method and device, computer device and storage medium Download PDFInfo
- Publication number
- CN111416947B CN111416947B CN202010216097.5A CN202010216097A CN111416947B CN 111416947 B CN111416947 B CN 111416947B CN 202010216097 A CN202010216097 A CN 202010216097A CN 111416947 B CN111416947 B CN 111416947B
- Authority
- CN
- China
- Prior art keywords
- light
- light supplement
- augmented reality
- light intensity
- brightness
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/71—Circuitry for evaluating the brightness variation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B20/00—Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
- Y02B20/40—Control techniques providing energy savings, e.g. smart controller or presence detection
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The application relates to an augmented reality device imaging method and device, a computer device and a storage medium. The method is applied to augmented reality equipment; the augmented reality equipment is provided with a light supplement lamp; the method comprises the following steps: detecting the light intensity of the real environment; when the light intensity reaches a preset light supplement condition, controlling the light supplement lamp to perform ambient light supplement processing on the real environment; and under the supplemented light intensity, carrying out image acquisition processing by using the camera of the augmented reality equipment, and obtaining an augmented reality image according to the acquired image. The method can improve the imaging quality of the augmented reality equipment.
Description
Technical Field
The present application relates to the field of augmented reality technologies, and in particular, to an imaging method and apparatus for augmented reality devices, a computer device, and a storage medium.
Background
With the development of scientific technology, an Augmented Reality (AR) technology has appeared, which is a technology for increasing the perception of a user to the real world through information provided by a computer system, and superimposes virtual objects, scenes or system prompt information generated by the computer to real scenes, thereby realizing 'Augmented' to Reality. With the continuous development of augmented reality technology, augmented reality devices are beginning to be widely used in a plurality of fields.
In the conventional technology, when a user uses the augmented reality equipment in an environment with insufficient light, the imaging quality of the augmented reality equipment is poor, and the environment cannot be clearly observed.
Disclosure of Invention
In view of the above, it is necessary to provide an augmented reality device imaging method, apparatus, computer device and storage medium capable of improving the imaging quality of an augmented reality device.
An augmented reality device imaging method is applied to an augmented reality device; the augmented reality equipment is provided with a light supplement lamp; the method comprises the following steps:
detecting the light intensity of the real environment;
when the light intensity reaches the preset light supplement condition, the light supplement condition is executed
Controlling the light supplement lamp to perform ambient light supplement processing on the real environment;
and under the supplemented light intensity, carrying out image acquisition processing by using the camera of the augmented reality equipment, and obtaining an augmented reality image according to the acquired image.
In one embodiment, the detecting the light intensity of the real environment includes:
detecting the light intensity of the real environment through a light sensor; the light sensor is arranged on the augmented reality equipment.
In one embodiment, the detecting the light intensity of the real environment includes:
shooting the real environment through a camera to obtain an environment image; the camera is arranged on the augmented reality equipment;
extracting a first brightness value of each pixel in the environment image, and carrying out averaging processing on the first brightness values to obtain the light intensity of the real environment; or extracting a second brightness value of each pixel in the central area of the environment image, and determining the light intensity of the real environment according to the second brightness value.
In one embodiment, a fill-in light driver is disposed in the augmented reality device;
when light intensity reaches the preset light supplement condition, then control the light supplement lamp is right real environment carries out ambient light supplement processing and includes:
and when the light intensity is lower than a preset low-brightness threshold value, controlling the light supplement lamp driver to turn on the light supplement lamp, and performing ambient light supplement processing on the real environment.
In one embodiment, the controlling the light supplement lamp driver to turn on the light supplement lamp includes:
controlling the light supplement lamp driver to turn on the light supplement lamp;
detecting the intensity range of the light intensity;
determining the brightness of the corresponding light supplement lamp according to the intensity range;
and adjusting the light supplement lamp according to the brightness of the light supplement lamp so as to supplement the ambient light to the real environment.
In one embodiment, the method further comprises:
when the light intensity is higher than a preset high-brightness threshold value, controlling a light supplement lamp driver to turn off the light supplement lamp;
the preset high brightness threshold is a preset brightness threshold higher than the preset low brightness threshold.
In one embodiment, the method further comprises:
acquiring a light supplement mode selection instruction, and determining a light supplement mode selected by the light supplement mode selection instruction;
when the light supplement mode is the automatic light supplement mode, executing the light intensity and the subsequent steps of detecting the real environment;
and when the light supplement mode is a manual light supplement mode and a light supplement operation instruction input by a user is detected, controlling the light supplement lamp according to the light supplement operation instruction.
An imaging device of an augmented reality equipment, wherein the device is arranged in the augmented reality equipment; the augmented reality equipment is provided with a light supplement lamp; the device comprises:
the light intensity detection module is used for detecting the light intensity of the real environment;
the light supplement module is used for controlling the light supplement lamp to perform ambient light supplement processing on the real environment when the light intensity reaches a preset light supplement condition;
and the augmented reality module is used for acquiring and processing images by using the camera of the augmented reality equipment under the supplemented light intensity, and acquiring augmented reality images according to the acquired images.
A computer device comprising a memory and a processor, the memory having stored therein a computer program that, when executed by the processor, causes the processor to perform the steps of the augmented reality device imaging method according to embodiments of the present application.
A computer readable storage medium having a computer program stored thereon, which, when executed by a processor, causes the processor to perform the steps of the augmented reality device imaging method according to embodiments of the present application.
According to the augmented reality device imaging method and device, the computer device and the storage medium, the light supplement lamp is installed on the augmented reality device, the augmented reality device detects the light intensity of the real environment, when the light intensity reaches the preset light supplement condition, the light supplement lamp is controlled to perform ambient light supplement processing on the real environment, the augmented reality image is obtained under the light intensity after supplement, the influence of the light intensity of the real environment on the imaging quality of the augmented reality device is reduced, and the imaging quality of the augmented reality device is improved.
Drawings
FIG. 1 is a diagram of an environment in which an augmented reality device imaging method is applied in an embodiment;
FIG. 2 is a schematic flow chart of an imaging method of an augmented reality device in one embodiment;
FIG. 3 is a diagram illustrating the overall architecture of an imaging method of an augmented reality device in one embodiment;
FIG. 4 is a diagram illustrating the overall architecture of an imaging method of an augmented reality device in one embodiment;
FIG. 5 is a diagram illustrating the overall architecture of an imaging method of the augmented reality device in one embodiment;
FIG. 6 is a block diagram of an imaging apparatus of an augmented reality device according to an embodiment;
FIG. 7 is a block diagram of an imaging apparatus of an augmented reality device according to an embodiment;
FIG. 8 is a diagram illustrating an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The augmented reality device imaging method provided by the application can be applied to the application environment shown in fig. 1. Where a user 102 uses an augmented reality device 104 to observe a real environment 106. The light filling lamp on the augmented reality device 104 can supplement the real environment 106 with ambient light, so that the imaging quality of the augmented reality device 104 on the real environment 106 is improved, and the user 102 can clearly observe the real environment 106 through the augmented reality device 104.
It should be noted that Augmented Reality (AR) technology is a technology that increases the perception of the user to the real world through information provided by a computer system, and superimposes virtual objects, scenes, or system prompt information generated by the computer system on real scenes, thereby realizing "Augmented Reality". Augmented reality devices (AR devices) are devices that apply augmented reality technology. In one embodiment, the augmented reality device may be a wearable augmented reality device. Such as AR glasses.
In one embodiment, as shown in fig. 2, an imaging method of an augmented reality device is provided, which is described by taking the method as an example of the augmented reality device in fig. 1, where the augmented reality device is installed with a fill light, and the method includes the following steps:
s202, detecting the light intensity of the real environment.
The real environment is observed by the user using the augmented reality device. And the light intensity is used for representing the intensity of the light in the real environment.
Specifically, the augmented reality device may detect the light intensity of the real environment through a sensor (e.g., a light sensor) capable of detecting the light intensity, an image capturing device (e.g., a camera), or the like. The sensor or the image shooting equipment is arranged on the augmented reality equipment and is consistent with the direction of a camera used for observing the environment on the augmented reality equipment.
And S204, when the light intensity reaches the preset light supplement condition, controlling the light supplement lamp to perform ambient light supplement processing on the real environment.
The preset light supplement condition is used for triggering and controlling the light supplement lamp to perform ambient light supplement processing on the real environment. It can be understood that when light intensity reaches this preset light filling condition, can control the light filling lamp and carry out ambient light to real environment and supply the processing.
In one embodiment, the preset fill-in condition may be a preset light intensity threshold.
Specifically, when the light intensity of the real environment reaches a preset light intensity threshold (preset light supplement condition), the augmented reality device controls the light supplement lamp to perform ambient light supplement processing on the real environment.
In one embodiment, the augmented reality device may control the light supplement lamp to be turned on or off, and may also adjust the brightness of the light supplement lamp.
In one embodiment, the controller in the augmented reality device receives the detected light intensity of the real environment, and controls the light supplement lamp driver to control the light supplement lamp to perform the ambient light supplement processing on the real environment. The controller and the light supplement lamp driver are both arranged in the augmented reality device. In one embodiment, the controller may be a microprocessor in an augmented reality device.
And S206, under the supplemented light intensity, carrying out image acquisition processing by using a camera of the augmented reality equipment, and obtaining an augmented reality image according to the acquired image.
The augmented reality image is an image of an augmented reality scene seen by a user through the augmented reality device.
Specifically, under the light intensity after carrying out ambient light supplementary processing to the reality environment, use augmented reality equipment's camera to carry out image acquisition to this reality environment and handle to according to the image of gathering, obtain augmented reality image.
In the augmented reality device imaging method, the light supplement lamp is installed on the augmented reality device, the augmented reality device detects the light intensity of the real environment, when the light intensity reaches the preset light supplement condition, the light supplement lamp is controlled to perform ambient light supplement processing on the real environment, the augmented reality image is obtained under the light intensity after supplement, the influence of the light intensity of the real environment on the imaging quality of the augmented reality device is reduced, and the imaging quality of the augmented reality device is improved.
In an embodiment, the step of detecting the light intensity of the real environment specifically includes the following steps: the light intensity of the real environment is detected through the light sensor. The light sensor is arranged on the augmented reality device.
The light sensor is a sensor for detecting the intensity of light in the real environment.
Specifically, the light sensor is oriented in line with a camera on the augmented reality device for viewing the environment. The light sensor transmits the detected light intensity of the real environment to the controller.
In this embodiment, augmented reality equipment passes through the light intensity that light sensor detected real environment, can automated inspection real environment's light intensity, and then can be according to light intensity automatic control light filling lamp to improve augmented reality equipment's image quality.
In an embodiment, the step of detecting the light intensity of the real environment specifically includes the following steps: shooting a real environment through a camera to obtain an environment image; the camera is arranged on the augmented reality equipment; extracting a first brightness value of each pixel in the environment image, and carrying out averaging processing on the first brightness values to obtain the light intensity of the real environment; or extracting a second brightness value of each pixel in the central area of the environment image, and determining the light intensity of the real environment according to the second brightness value.
The camera is arranged on the augmented reality device and used for detecting the light intensity of the real environment. The direction of the camera used for observing the environment on the camera and the augmented reality equipment is consistent. The first luminance value is a luminance value of each pixel in the environment image. The second luminance value is a luminance value of each pixel in the central region of the environment image. The central area is an area of a predetermined size in the center of the environment image.
In one embodiment, the augmented reality device captures a real environment through a camera to obtain an environment image, the controller receives the environment image captured by the camera, extracts brightness values of pixels in the environment image, averages all the brightness values, and takes the average value as light intensity of the real environment.
In one embodiment, the augmented reality device captures a real environment through a camera to obtain an environment image, the controller receives the environment image captured by the camera, extracts brightness values of pixels in a central area of the environment image, averages the brightness values, and takes the average value as light intensity of the real environment.
In one embodiment, the camera can directly detect the light intensity, and the controller receives the light intensity detected by the camera, so that the camera is not required to shoot images and then the light intensity is obtained according to the images. It can be understood that the camera in this embodiment has a function of directly detecting the intensity of light.
In this embodiment, augmented reality equipment passes through the light intensity that the camera detected real environment, can automated inspection real environment's light intensity, and then can be according to light intensity automatic control light filling lamp to improve augmented reality equipment's image quality.
In one embodiment, a fill light driver is disposed in the augmented reality device. When light intensity reaches the preset light supplement condition, the light supplement lamp is controlled to perform the step of ambient light supplement processing on the real environment, and the method specifically comprises the following steps: when the light intensity is lower than the preset low-brightness threshold value, the light supplement lamp driver is controlled to turn on the light supplement lamp, and ambient light supplement processing is carried out on the real environment.
The light supplement lamp driver is used for driving the light supplement lamp. And the preset low-brightness threshold is a preset brightness threshold for turning on the light supplement lamp when the light intensity is lower than the threshold.
Specifically, the controller among the augmented reality equipment carries out the analysis to light intensity, and when light intensity was less than and predetermines the low light threshold value, the light filling lamp was opened to control light filling lamp driver, carries out ambient light to the real environment and supplyes the processing.
In one embodiment, the controller in the augmented reality device may control the light supplement lamp driver to adjust the brightness of the light supplement lamp according to the intensity of the light.
In this embodiment, when light intensity is less than when predetermineeing the low light threshold value, the light filling lamp is opened to augmented reality equipment control light filling lamp driver, carries out ambient light to real environment and supplyes the processing, can carry out the light filling through the light filling lamp under the relatively low condition of light intensity of real environment to improve augmented reality equipment's imaging quality.
In one embodiment, the step of controlling the light supplement lamp driver to turn on the light supplement lamp and performing ambient light supplement processing on the real environment specifically includes the following steps: controlling a light supplement lamp driver to turn on a light supplement lamp; detecting the intensity range of the light intensity; determining the brightness of the corresponding light supplement lamp according to the intensity range; and adjusting the light supplement lamp according to the brightness of the light supplement lamp so as to supplement ambient light to the real environment.
Specifically, the light intensity lower than the low-brightness threshold may be divided into a plurality of intensity ranges in advance, and each intensity range corresponds to the brightness of the corresponding fill-in light. It can be understood that the greater the light intensity in the intensity range, the less the brightness of the fill-in lamp corresponding to the intensity range is, i.e. the less light needs to be filled. The smaller the light intensity in the intensity range is, the larger the brightness of the fill-in lamp corresponding to the intensity range is, that is, the more light needs to be filled.
In one embodiment, the controller controls the light supplement lamp driver to turn on the light supplement lamp, detects an intensity range where the light intensity is located, determines the corresponding light supplement lamp brightness according to the intensity range, and controls the light supplement lamp driver to adjust the light supplement lamp according to the light supplement lamp brightness so as to perform ambient light supplement processing on the real environment.
In this embodiment, confirm the light filling lamp luminance that corresponds according to the intensity range of light intensity to according to light filling lamp adjustting of lighteness light filling lamp, can be according to the size of light intensity, the power of intelligent regulation light filling lamp luminance, thereby improve augmented reality equipment's imaging quality.
In one embodiment, the method further comprises the steps of: and when the light intensity is higher than the preset high brightness threshold value, controlling the light supplement lamp driver to close the light supplement lamp.
The preset high brightness threshold is a preset brightness threshold higher than the preset low brightness threshold.
It can be understood that when light intensity is higher than the preset high-brightness threshold value, the light intensity of the real environment is sufficient, the light supplement lamp is not needed to perform light supplement processing, and therefore the controller controls the light supplement lamp driver to close the light supplement lamp.
In this embodiment, through when light intensity is higher than predetermineeing the hi-lite threshold value, control light filling lamp driver closes the light filling lamp, when can be in the environment light is sufficient, intelligently close the light filling lamp, avoid the energy extravagant, and avoid reducing augmented reality equipment's imaging quality because of light is too strong.
In one embodiment, the method further comprises the steps of: acquiring a light supplement mode selection instruction, and determining a light supplement mode selected by the light supplement mode selection instruction; when the light supplement mode is the automatic light supplement mode, executing the light intensity of the real environment and the subsequent steps; and when the light supplement mode is the manual light supplement mode and a light supplement operation instruction input by a user is detected, controlling the light supplement lamp according to the light supplement operation instruction.
The light supplement mode selection instruction is an instruction which is input by a user and is used for selecting the light supplement mode. The light supplement operation instruction is an instruction which is input by a user and is used for controlling the light supplement lamp.
Specifically, the controller of the augmented reality device obtains a light supplement mode selection instruction input by a user, and determines a light supplement mode selected by the light supplement mode selection instruction. When the light supplement mode is the automatic light supplement mode, the light intensity of the real environment and subsequent steps are executed, namely, the light intensity of the real environment is automatically detected by the augmented reality equipment, and the light supplement processing is automatically carried out when the light intensity reaches the preset light supplement condition. And when the light supplement mode is the manual light supplement mode, if a user inputs a light supplement operation instruction, controlling the light supplement lamp according to the light supplement operation instruction.
In an embodiment, the supplementary lighting mode selection instruction and the supplementary lighting operation instruction may be input by a user through a human-computer interaction interface of the augmented reality device, or generated by the user through voice control, or generated in other manners, without limitation.
In one embodiment, the light supplement operation command may control the light supplement lamp to be turned on or off, or may control the brightness of the light supplement lamp to be adjusted. When the light supplement operation instruction is to turn off the light supplement lamp, the controller controls the light supplement lamp driver to turn off the light supplement lamp. When the light supplement operation instruction is to turn on the light supplement lamp, the controller controls the light supplement lamp driver to turn on the light supplement lamp. When the light supplement lamp is in an on state, if the light supplement operation instruction input by the user is to adjust the brightness of the light supplement lamp, the brightness of the light supplement lamp is adjusted according to the light supplement operation instruction. In one embodiment, the fill-in operation instruction for adjusting the brightness of the fill-in lamp may specify that the brightness of the fill-in lamp is adjusted to a certain brightness value, or may specify how much the brightness of the fill-in lamp is increased or decreased.
In one embodiment, in the manual light supplement mode, the augmented reality device still automatically detects the light intensity of the real environment, analyzes the light supplement lamp brightness corresponding to the light intensity, and does not adjust the light supplement lamp brightness according to the light supplement operation instruction when the value of the light supplement lamp brightness specified by the light supplement operation instruction input by the user, which exceeds the light supplement lamp brightness corresponding to the current light intensity, reaches a preset threshold value, and triggers a warning of too high brightness, so as to avoid the influence of the too high brightness on the imaging quality or the damage to the eyes of the user.
In this embodiment, through light filling lamp mode selection instruction, can switch under these two kinds of modes of automatic light filling mode and manual light filling mode, can make the user select the light filling mode according to the demand of oneself. The manual light filling mode makes light intensity ratio special if needs under some special circumstances, and the user can adjust the light filling lamp at reasonable within range by oneself.
Fig. 3 is a diagram illustrating an overall architecture of an imaging method of an augmented reality device according to an embodiment. The controller receives the light intensity of the real environment detected by the light sensor, and determines the control form (turning on, turning off or adjusting the brightness) of the light supplement lamp according to the light intensity. Or, the controller receives a manual control (a light supplement operation instruction) of a user, and determines a control mode of the light supplement lamp according to the light supplement operation instruction. The controller controls the light supplement lamp driver to drive the light supplement lamp according to the control form of the light supplement lamp.
Fig. 4 is a diagram showing an overall architecture of an imaging method of an augmented reality device according to another embodiment. The controller receives an environment image of the real environment shot by the camera, averages the brightness values of all pixels in the environment image to obtain the light intensity of the real environment, and determines the control form (turning on, turning off or adjusting the brightness) of the light supplement lamp according to the light intensity. Or, the controller receives a manual control (a light supplement operation instruction) of a user, and determines a control mode of the light supplement lamp according to the light supplement operation instruction. The controller controls the light supplement lamp driver to drive the light supplement lamp according to the control form of the light supplement lamp.
Fig. 5 is a diagram illustrating an overall architecture of an imaging method of an augmented reality device in another embodiment. The controller sets up in the host computer, and light sensor, light filling lamp driver, light filling lamp and augmented reality display etc. set up in augmented reality equipment, and the host computer communicates with augmented reality equipment. Augmented reality equipment transmits the light intensity that light sensor detected to the host computer, and the controller in the host computer is according to light intensity, confirms the control form to the light filling lamp, and the host computer transmits the control form to augmented reality equipment and control light filling lamp driver drive light filling lamp. The controller in the host may also control the augmented reality display. The controller is arranged outside the augmented reality equipment, so that the size and the weight of the augmented reality equipment can be reduced, and heat generation is reduced.
It should be understood that, although the steps in the flowchart of fig. 2 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a portion of the steps in fig. 2 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed in turn or alternately with other steps or at least a portion of the other steps or stages.
In one embodiment, as shown in fig. 6, an augmented reality device imaging apparatus 600 is provided, which is disposed in an augmented reality device. This augmented reality equipment has installed the light filling lamp. The device includes: light intensity detection module 602, light filling module 604 and augmented reality module 606, wherein:
the light intensity detecting module 602 is configured to detect light intensity of a real environment.
The light supplement module 604 is configured to control the light supplement lamp to perform ambient light supplement processing on the real environment when the light intensity reaches a preset light supplement condition.
And the augmented reality module 606 is configured to perform image acquisition processing on the image by using a camera of the augmented reality device under the supplemented light intensity, and obtain an augmented reality image according to the acquired image.
In one embodiment, the light intensity detecting module 602 is further configured to detect the light intensity of the real environment through a light sensor; the light sensor is arranged on the augmented reality device.
In one embodiment, the light intensity detection module 602 is further configured to capture a real environment through a camera to obtain an environment image; the camera is arranged on the augmented reality equipment; and extracting a first brightness value of each pixel in the environment image, and averaging the first brightness values to obtain the light intensity of the real environment.
In one embodiment, the light intensity detecting module 602 is further configured to shoot a real environment through a camera to obtain an environment image; the camera is arranged on the augmented reality equipment; and extracting a second brightness value of each pixel in the central area of the environment image, and determining the light intensity of the real environment according to the second brightness value.
In one embodiment, a fill light driver is disposed in the augmented reality device. The light supplement module 604 is further configured to control the light supplement lamp driver to turn on the light supplement lamp when the light intensity is lower than the preset low-brightness threshold, so as to perform ambient light supplement processing on the real environment.
In one embodiment, the fill-in light module 604 is further configured to control the fill-in light driver to turn on the fill-in light; detecting the intensity range of the light intensity; determining the brightness of the corresponding light supplement lamp according to the intensity range; and adjusting the light supplement lamp according to the brightness of the light supplement lamp so as to supplement ambient light to the real environment.
In one embodiment, augmented reality device imaging apparatus 600 further comprises:
and a light supplement lamp closing module 608 for controlling the light supplement lamp driver to close the light supplement lamp when the light intensity is higher than the preset high brightness threshold value. The preset high brightness threshold is a preset brightness threshold higher than the preset low brightness threshold.
In one embodiment, as shown in fig. 7, the augmented reality device imaging apparatus 600 further includes:
a light supplement mode switching module 610, configured to acquire a light supplement mode selection instruction and determine a light supplement mode selected by the light supplement mode selection instruction; when the light supplement mode is the automatic light supplement mode, executing the light intensity of the real environment and the subsequent steps; and when the light supplement mode is the manual light supplement mode and a light supplement operation instruction input by a user is detected, controlling the light supplement lamp according to the light supplement operation instruction.
Among the above-mentioned augmented reality equipment imaging device, through installation light filling lamp on augmented reality equipment, augmented reality equipment detects real environment's light intensity, when light intensity reaches and predetermines the light filling condition, then control light filling lamp and carry out ambient light to real environment and supply the processing, obtain augmented reality image under the light intensity after supplying, the light intensity that has reduced real environment is to augmented reality equipment imaging quality's influence, has improved augmented reality equipment's imaging quality.
For specific limitations of the imaging device of the augmented reality apparatus, reference may be made to the above limitations of the imaging method of the augmented reality apparatus, and details are not repeated here. The modules in the imaging device of the augmented reality equipment can be wholly or partially realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, which may be an augmented reality device, the internal structure of which may be as shown in fig. 8. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, an operator network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement an augmented reality device imaging method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the architecture shown in fig. 8 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is further provided, which includes a memory and a processor, the memory stores a computer program, and the processor implements the steps of the above method embodiments when executing the computer program.
In an embodiment, a computer-readable storage medium is provided, on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method embodiments.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical storage, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. An imaging method of an augmented reality device is characterized in that the method is applied to the augmented reality device; the augmented reality equipment is provided with a light supplement lamp; the method comprises the following steps:
acquiring a supplementary lighting mode selection instruction input by a user through a human-computer interaction interface of the augmented reality device or generated by voice control, and determining a supplementary lighting mode selected by the supplementary lighting mode selection instruction;
when the light filling mode is automatic light filling mode, then detect real environment's light intensity, include: detecting the light intensity of the real environment through image shooting equipment; the image shooting equipment is arranged on the augmented reality equipment and is consistent with a camera used for observing the environment on the augmented reality equipment in direction;
when the light intensity reaches the preset light supplement condition, the light supplement condition is executed
Controlling the light supplement lamp to perform ambient light supplement processing on the real environment;
when the light supplement mode is the manual light supplement mode, the augmented reality equipment still automatically detects the light intensity of the real environment through the image shooting equipment, and analyzes the light supplement lamp brightness corresponding to the light intensity; if a light supplement operation instruction input by a user through the human-computer interaction interface or generated by voice control is detected, and the value of the light supplement lamp brightness specified by the light supplement operation instruction, which exceeds the light supplement lamp brightness corresponding to the current light intensity, is lower than a preset threshold value, controlling the light supplement lamp according to the light supplement operation instruction to perform ambient light supplement processing;
if the light supplement lamp brightness specified by the light supplement operation instruction exceeds the light supplement lamp brightness corresponding to the current light intensity and reaches a preset threshold value, the light supplement lamp brightness is not adjusted according to the light supplement operation instruction, and a warning of overhigh brightness is triggered;
under the control light intensity that the light filling lamp carries out after the ambient light supplyes the processing, use augmented reality equipment's camera carries out image acquisition and handles to according to the image of gathering, obtain augmented reality image.
2. The method of claim 1, wherein detecting the light intensity of the real-world environment further comprises:
detecting the light intensity of the real environment through a light sensor; the light sensor is arranged on the augmented reality equipment.
3. The method of claim 1, wherein the detecting the light intensity of the real environment by the image capturing device comprises:
shooting the real environment through a camera to obtain an environment image; the camera is arranged on the augmented reality equipment;
extracting a first brightness value of each pixel in the environment image, and carrying out averaging processing on the first brightness values to obtain the light intensity of the real environment; or extracting a second brightness value of each pixel in the central area of the environment image, and determining the light intensity of the real environment according to the second brightness value.
4. The method of claim 3, wherein the central region is a region of a preset size in the center of the ambient image.
5. The method of claim 1, wherein a fill light driver is disposed in the augmented reality device;
when light intensity reaches the preset light supplement condition, then control the light supplement lamp is right real environment carries out ambient light supplement processing and includes:
and when the light intensity is lower than a preset low-brightness threshold value, controlling the light supplement lamp driver to turn on the light supplement lamp, and performing ambient light supplement processing on the real environment.
6. The method of claim 5, wherein the controlling the fill light driver to turn on the fill light, and performing ambient light compensation on the real environment comprises:
controlling the light supplement lamp driver to turn on the light supplement lamp;
detecting the intensity range of the light intensity;
determining the brightness of the corresponding light supplement lamp according to the intensity range;
and adjusting the light supplement lamp according to the brightness of the light supplement lamp so as to supplement the ambient light to the real environment.
7. The method of claim 5, further comprising:
when the light intensity is higher than a preset high-brightness threshold value, controlling a light supplement lamp driver to turn off the light supplement lamp;
the preset high brightness threshold is a preset brightness threshold higher than the preset low brightness threshold.
8. An imaging device of an augmented reality device is characterized in that the device is arranged in the augmented reality device; the augmented reality equipment is provided with a light supplement lamp; the device comprises:
the supplementary lighting mode switching module is used for acquiring a supplementary lighting mode selection instruction which is input by a user through a human-computer interaction interface of the augmented reality device or generated by voice control, and determining a supplementary lighting mode selected by the supplementary lighting mode selection instruction; when the light supplement mode is a manual light supplement mode and a light supplement operation instruction input by a user through the human-computer interaction interface or generated by voice control is detected, controlling the light supplement lamp according to the light supplement operation instruction;
light intensity detection module is used for when the light filling mode is automatic light filling mode, then detects real environment's light intensity, includes: detecting the light intensity of the real environment through image shooting equipment; the image shooting equipment is arranged on the augmented reality equipment and is consistent with a camera used for observing the environment on the augmented reality equipment in direction;
the light supplement module is used for controlling the light supplement lamp to perform ambient light supplement processing on the real environment when the light intensity reaches a preset light supplement condition;
the light intensity detection module is further used for automatically detecting the light intensity of the real environment through the image shooting equipment by the augmented reality equipment when the light supplement mode is the manual light supplement mode, and analyzing the light intensity of the light supplement lamp corresponding to the light intensity; if a light supplement operation instruction input by a user through the human-computer interaction interface or generated by voice control is detected, and the value of the light supplement lamp brightness specified by the light supplement operation instruction, which exceeds the light supplement lamp brightness corresponding to the current light intensity, is lower than a preset threshold value, controlling the light supplement lamp according to the light supplement operation instruction to perform ambient light supplement processing;
the light intensity detection module is further configured to not inform the light supplement module of adjusting the brightness of the light supplement lamp according to the light supplement operation instruction and trigger a warning of too high brightness if the light supplement lamp specified by the light supplement operation instruction emphasizes that the value of the brightness of the light supplement lamp corresponding to the current light intensity is lower than the preset threshold;
and the augmented reality module is used for controlling the light supplement lamp to carry out image acquisition and processing under the light intensity after the ambient light supplement processing, and obtaining an augmented reality image according to the acquired image.
9. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor, when executing the computer program, implements the steps of the method of any of claims 1 to 7.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010216097.5A CN111416947B (en) | 2020-03-25 | 2020-03-25 | Augmented reality device imaging method and device, computer device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010216097.5A CN111416947B (en) | 2020-03-25 | 2020-03-25 | Augmented reality device imaging method and device, computer device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111416947A CN111416947A (en) | 2020-07-14 |
| CN111416947B true CN111416947B (en) | 2022-05-17 |
Family
ID=71494670
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010216097.5A Active CN111416947B (en) | 2020-03-25 | 2020-03-25 | Augmented reality device imaging method and device, computer device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111416947B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104113688A (en) * | 2014-06-26 | 2014-10-22 | 联想(北京)有限公司 | Image processing method and electronic equipment |
| CN106791468A (en) * | 2016-12-28 | 2017-05-31 | 深圳天珑无线科技有限公司 | A kind of mobile terminal and its shooting light compensation method |
| CN108040213A (en) * | 2017-12-05 | 2018-05-15 | 北京小米移动软件有限公司 | The method and apparatus of shooting image |
| CN208351737U (en) * | 2017-10-18 | 2019-01-08 | 罗颖 | Point based on augmented reality reads tutoring system |
| CN109815778A (en) * | 2017-11-20 | 2019-05-28 | 上海真曦通信技术有限公司 | A kind of identification electronic system based on eye feature |
| CN209299384U (en) * | 2018-12-19 | 2019-08-23 | 华北创芯（北京）科技有限公司 | A kind of individual combat wearable device |
| CN110290330A (en) * | 2019-06-26 | 2019-09-27 | Oppo广东移动通信有限公司 | Control method, electronic device and storage medium |
| CN110895369A (en) * | 2018-09-13 | 2020-03-20 | 奇酷互联网络科技（深圳）有限公司 | Intelligent glasses and control method thereof |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9398229B2 (en) * | 2012-06-18 | 2016-07-19 | Microsoft Technology Licensing, Llc | Selective illumination of a region within a field of view |
-
2020
- 2020-03-25 CN CN202010216097.5A patent/CN111416947B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104113688A (en) * | 2014-06-26 | 2014-10-22 | 联想(北京)有限公司 | Image processing method and electronic equipment |
| CN106791468A (en) * | 2016-12-28 | 2017-05-31 | 深圳天珑无线科技有限公司 | A kind of mobile terminal and its shooting light compensation method |
| CN208351737U (en) * | 2017-10-18 | 2019-01-08 | 罗颖 | Point based on augmented reality reads tutoring system |
| CN109815778A (en) * | 2017-11-20 | 2019-05-28 | 上海真曦通信技术有限公司 | A kind of identification electronic system based on eye feature |
| CN108040213A (en) * | 2017-12-05 | 2018-05-15 | 北京小米移动软件有限公司 | The method and apparatus of shooting image |
| CN110895369A (en) * | 2018-09-13 | 2020-03-20 | 奇酷互联网络科技（深圳）有限公司 | Intelligent glasses and control method thereof |
| CN209299384U (en) * | 2018-12-19 | 2019-08-23 | 华北创芯（北京）科技有限公司 | A kind of individual combat wearable device |
| CN110290330A (en) * | 2019-06-26 | 2019-09-27 | Oppo广东移动通信有限公司 | Control method, electronic device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111416947A (en) | 2020-07-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3142351B1 (en) | Shooting method and device | |
| CN105744176B (en) | A kind of screen light compensation method, device and mobile terminal | |
| US9961273B2 (en) | Mobile terminal and shooting method thereof | |
| CN106210334B (en) | Intelligent flash lamp control method and system and mobile terminal | |
| CN104065862A (en) | Information processing method and electronic device | |
| CN106060417A (en) | Flashlight control method and terminal | |
| CN106941588B (en) | Data processing method and electronic equipment | |
| CN111246114B (en) | Photographing processing method and device, terminal equipment and storage medium | |
| CN114596620B (en) | Light supplement control method, device and equipment for face recognition equipment and storage medium | |
| CN111880640B (en) | Screen control method and device, electronic equipment and storage medium | |
| CN106204743B (en) | Control method and device for augmented reality function and mobile terminal | |
| CN113596344A (en) | Shooting processing method and device, electronic equipment and readable storage medium | |
| CN110570370B (en) | Image information processing method and device, storage medium and electronic equipment | |
| CN111416947B (en) | Augmented reality device imaging method and device, computer device and storage medium | |
| CN111856752B (en) | Augmented reality display equipment adjusting method and device and computer equipment | |
| CN110473156B (en) | Image information processing method and device, storage medium and electronic equipment | |
| CN106161970A (en) | A kind of image pickup method, device and mobile terminal | |
| CN113630535B (en) | Face camera light supplementing method, equipment, storage medium and device based on television | |
| KR20190020633A (en) | Apparatus and method for controlling brightness of display based on eye tracking | |
| CN113472998B (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN114286004A (en) | Focusing method, shooting device, electronic equipment and medium | |
| CN113891139B (en) | Operation interface theme switching method, terminal and computer readable storage medium | |
| CN114638951B (en) | House model display method and device, electronic equipment and readable storage medium | |
| CN113938597B (en) | Face recognition method, device, computer equipment and storage medium | |
| CN107454333B (en) | The classification method of sampling, device, system, storage medium and computer equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |