CN112004077B - Calibration method and device for off-screen camera, storage medium and electronic equipment - Google Patents

Calibration method and device for off-screen camera, storage medium and electronic equipment Download PDF

Info

Publication number
CN112004077B
CN112004077B CN202010826144.8A CN202010826144A CN112004077B CN 112004077 B CN112004077 B CN 112004077B CN 202010826144 A CN202010826144 A CN 202010826144A CN 112004077 B CN112004077 B CN 112004077B
Authority
CN
China
Prior art keywords
data
calibration
calibration data
camera
under
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010826144.8A
Other languages
Chinese (zh)
Other versions
CN112004077A (en
Inventor
张学勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oppo Chongqing Intelligent Technology Co Ltd
Original Assignee
Oppo Chongqing Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo Chongqing Intelligent Technology Co Ltd filed Critical Oppo Chongqing Intelligent Technology Co Ltd
Priority to CN202010826144.8A priority Critical patent/CN112004077B/en
Publication of CN112004077A publication Critical patent/CN112004077A/en
Application granted granted Critical
Publication of CN112004077B publication Critical patent/CN112004077B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00Diagnosis, testing or measuring for television systems or their details
    • H04N17/002Diagnosis, testing or measuring for television systems or their details for television cameras

Abstract

The disclosure provides a calibration method of an off-screen camera, a calibration device of the off-screen camera, a computer readable storage medium and an electronic device, and relates to the technical field of computers. The calibration method of the under-screen camera comprises the following steps: acquiring first calibration data of an off-screen camera to be calibrated, wherein the first calibration data is obtained by singly calibrating the off-screen camera when the off-screen camera is not installed on the terminal equipment; when the under-screen camera is installed on the terminal equipment, acquiring image data shot by the under-screen camera under a calibration light source; determining second calibration data from the image data; and integrating the first calibration data and the second calibration data to generate target calibration data so as to calibrate the under-screen camera installed on the terminal equipment. This openly can carry out effective calibration to camera under the screen, has solved the screen and has caused the problem of influence to camera formation of image under the screen, has improved the shooting effect of camera under the screen.

Description

Calibration method and device for off-screen camera, storage medium and electronic equipment
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to a calibration method for an off-screen camera, a calibration apparatus for an off-screen camera, a computer-readable storage medium, and an electronic device.
Background
With the wider application of the camera in the terminal equipment, the imaging effect and quality requirements of the terminal equipment on the camera are higher and higher. In practical application, due to manufacturing tolerance or other unavoidable factors, imaging effects of different cameras have certain difference, and consistency of imaging effects of all the cameras is difficult to guarantee only by means of fixed imaging parameters. How to improve the consistency and the performance of all aspects of the camera module is particularly important.
In the prior art, a camera module is usually calibrated and burning calibration data is performed during production of the camera module. However, with the diversification development of terminal devices, in a terminal device configured with a camera under a screen, since the screen is covered above the camera and the screen has a certain influence on the camera, if the calibration data originally burned is used, the expected calibration effect cannot be achieved. Therefore, how to effectively calibrate the under-screen camera is a problem to be solved urgently in the prior art.
Disclosure of Invention
The disclosure provides a calibration method of an off-screen camera, a calibration device of the off-screen camera, a computer readable storage medium and an electronic device, thereby improving the problem that the off-screen camera cannot be effectively calibrated in the prior art at least to a certain extent.
Additional features and advantages of the disclosure will be set forth in the detailed description which follows, or in part will be obvious from the description, or may be learned by practice of the disclosure.
According to a first aspect of the present disclosure, there is provided a calibration method for an off-screen camera, including: acquiring first calibration data of an under-screen camera to be calibrated, wherein the first calibration data is obtained by singly calibrating the under-screen camera when the under-screen camera is not installed on a terminal device; when the under-screen camera is installed on the terminal equipment, acquiring image data shot by the under-screen camera under a calibration light source; determining second calibration data from the image data; and integrating the first calibration data and the second calibration data to generate target calibration data so as to calibrate the under-screen camera installed on the terminal equipment.
According to a second aspect of the present disclosure, there is provided a calibration device for an underscreen camera, including: the calibration method comprises the steps that a first calibration data acquisition module is used for acquiring first calibration data of an off-screen camera to be calibrated, wherein the first calibration data is obtained by singly calibrating the off-screen camera when the off-screen camera is not installed on a terminal device; the image data acquisition module is used for acquiring image data shot by the under-screen camera under a calibration light source when the under-screen camera is installed on the terminal equipment; a second calibration data determination module to determine second calibration data from the image data; and the target calibration data generation module is used for integrating the first calibration data and the second calibration data to generate target calibration data so as to calibrate the under-screen camera installed on the terminal equipment.
According to a third aspect of the present disclosure, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the calibration method of the above-described under-screen camera.
According to a fourth aspect of the present disclosure, there is provided an electronic device comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute the calibration method of the off-screen camera via execution of the executable instructions.
The technical scheme of the disclosure has the following beneficial effects:
according to the calibration method of the off-screen camera, the calibration device of the off-screen camera, the computer readable storage medium and the electronic equipment, first calibration data of the off-screen camera to be calibrated are obtained, wherein the first calibration data are data obtained by singly calibrating the off-screen camera when the off-screen camera is not installed on the terminal equipment; when the under-screen camera is installed on the terminal equipment, acquiring image data shot by the under-screen camera under a calibration light source; determining second calibration data from the image data; and integrating the first calibration data and the second calibration data to generate target calibration data so as to calibrate the under-screen camera installed on the terminal equipment. On one hand, because a screen above the under-screen camera can affect optical imaging to a certain extent, and the mode of burning calibration data only at the camera module end in the prior art is adopted, and the application scene of the under-screen camera cannot be met, the exemplary embodiment provides a new camera calibration method, which can avoid the problem that the screen above the camera affects the optical imaging and can effectively calibrate the under-screen camera; on the other hand, the second calibration data is determined based on the image data shot by the calibration light source, the target calibration data is generated according to the first calibration data and the second calibration data to calibrate the camera under the screen, the influence factors of optical imaging are fully considered in the calibration process, the calibration process is simple, the camera under the screen can be accurately and effectively calibrated, and the effect consistency of the camera under the screen can be improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure. It is to be understood that the drawings in the following description are merely exemplary of the disclosure, and that other drawings may be derived from those drawings by one of ordinary skill in the art without the exercise of inventive faculty.
FIG. 1 shows a schematic diagram of a system architecture of the present exemplary embodiment;
fig. 2 shows a schematic diagram of an electronic device of the present exemplary embodiment;
fig. 3 shows a flowchart of a calibration method of an off-screen camera of the present exemplary embodiment;
FIG. 4 illustrates a sub-flow diagram of a method of calibration of an off-screen camera in accordance with the present exemplary embodiment;
fig. 5 shows a flowchart of another calibration method of an off-screen camera of the present exemplary embodiment;
fig. 6 shows a block diagram of a calibration apparatus for an underscreen camera according to the present exemplary embodiment.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the disclosure. One skilled in the relevant art will recognize, however, that the subject matter of the present disclosure can be practiced without one or more of the specific details, or with other methods, components, devices, steps, and the like. In other instances, well-known technical solutions have not been shown or described in detail to avoid obscuring aspects of the present disclosure.
Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
Fig. 1 shows a schematic diagram of a system architecture of an exemplary embodiment of the present disclosure. As shown in fig. 1, the system architecture 100 may include: calibration terminal 110, and terminal device 120 mounted with an off-screen camera. The calibration terminal 110 may be any device capable of calibrating the off-screen camera, for example, a server or a computer, and a virtual platform may be set in the calibration terminal 110, and the virtual platform may be used to calibrate the off-screen camera. The terminal device 120 may include, but is not limited to, a smart phone with an off-screen camera, a tablet computer, a personal computer, a digital camera, and the like. It should be understood that the number of calibration terminals 110, and the number of terminal devices 120 mounted with an off-screen camera in fig. 1 are merely illustrative. There may be any number of calibration terminals 110, and terminal devices 120, as desired for the implementation.
The calibration method for the off-screen camera provided by the embodiment of the disclosure may be executed by the calibration terminal 110, for example, the calibration terminal 110 may obtain the first calibration data and the image data captured under the specific calibration light source from the terminal device 120, and generate the target calibration data for calibrating the off-screen camera of the terminal device 120 after processing the first calibration data and the image data.
Exemplary embodiments of the present disclosure also provide an electronic device capable of implementing the above method.
As will be appreciated by one skilled in the art, aspects of the present disclosure may be embodied as a system, method or program product. Accordingly, various aspects of the present disclosure may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
An electronic device 200 according to such an exemplary embodiment of the present disclosure is described below with reference to fig. 2. The electronic device 200 shown in fig. 2 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in FIG. 2, electronic device 200 is embodied in the form of a general purpose computing device. The components of the electronic device 200 may include, but are not limited to: the at least one processing unit 210, the at least one memory unit 220, a bus 230 connecting different system components (including the memory unit 220 and the processing unit 210), and a display unit 240.
Where the storage unit stores program code, the program code may be executed by the processing unit 210 to cause the processing unit 210 to perform the steps according to various exemplary embodiments of the present disclosure described in the above section "exemplary methods" of this specification. For example, processing unit 210 may perform the steps shown in fig. 3, 4, or 5, and so on.
The storage unit 220 may include readable media in the form of volatile memory units, such as a random access memory unit (RAM)221 and/or a cache memory unit 222, and may further include a read only memory unit (ROM) 223.
The storage unit 220 may also include a program/utility 224 having a set (at least one) of program modules 225, such program modules 225 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
Bus 230 may be one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.
The electronic device 200 may also communicate with one or more external devices 270 (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a user to interact with the electronic device 200, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device 200 to communicate with one or more other computing devices. Such communication may occur via an input/output (I/O) interface 250. Also, the electronic device 200 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the Internet) via the network adapter 260. As shown, the network adapter 260 communicates with the other modules of the electronic device 200 over the bus 230. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device 200, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the exemplary embodiments of the present disclosure.
In the prior art, in the calibration process of a conventional camera, the camera is generally calibrated when being produced, calibration data is burned in advance and written into a memory, and the calibration data can be directly acquired from the memory to perform the calibration process on the camera during subsequent calibration. However, in a calibration scene of the camera under the screen, since the screen is covered above the camera, the screen may affect the optical imaging of the camera, for example, the color display is inaccurate or color cast occurs, and if the calibration data burnt in advance is still used, the camera cannot exhibit a good photographing effect. Based on this, the present exemplary embodiment proposes a calibration method of an off-screen camera.
The calibration method of the off-screen camera and the calibration apparatus of the off-screen camera according to the exemplary embodiments of the present disclosure will be described in detail below.
Fig. 3 shows a flow of a calibration method for an off-screen camera in the present exemplary embodiment, including the following steps S310 to S340:
step S310, acquiring first calibration data of the to-be-calibrated underscreen camera, wherein the first calibration data is obtained by singly calibrating the underscreen camera when the underscreen camera is not installed on the terminal equipment.
When the under-screen camera is not installed on the terminal device, the data obtained by individually calibrating the under-screen camera refers to the data obtained by individually calibrating the camera before the terminal device is not equipped with the camera, in other words, the original calibration data burned in the under-screen camera in the prior art in the production process. The exemplary embodiment may obtain the first calibration data from a preset path of the terminal device, for example, read the first calibration data from an EEPROM (Electrically Erasable and Programmable read only memory) at the camera module end; the first calibration data may also be obtained from other devices or databases storing the calibration data, for example, when the off-screen camera is calibrated individually, the obtained data is stored in a specific calibration database, and then the first calibration data may be obtained from the calibration database, which is not limited in this disclosure.
In an exemplary embodiment, the calibration data may be OTP (One Time programmable) data.
The OTP is a memory type of MCU (micro controller Unit), i.e. one-time programming, a fuse structure can be adopted, and the programming process is an irreversible destruction activity. The OTP data can be used to calibrate the camera to ensure camera effect consistency. The first calibration data is the first OTP data, and the camera may be calibrated before being installed in the terminal device. The OTP data may include various configuration parameters of the camera module, such as a lens uniformity parameter, an AWB (Automatic White balance) parameter, an AF (auto Focus) position parameter, and other parameters such as a lens model, a camera module model, and a production date.
And step S320, when the screen lower camera is installed on the terminal equipment, acquiring image data shot by the screen lower camera under the calibration light source.
The installation of the screen lower camera on the terminal equipment means that the configuration of the camera in the terminal equipment is completed, namely the screen is covered above the camera. The calibration light source refers to a light source that can be used for calibrating an off-screen camera, and the calibration light source may include multiple specifications or standards, for example, the calibration light source in the present exemplary embodiment may perform a calibration procedure using youthtech G4C. When image data shot by the camera under the screen is acquired, the color temperature and the illumination of the calibration light source can be set. The color temperature is a unit of measurement indicating that the light contains color components, and images shot at different color temperatures are also different, and generally, the lower the color temperature is, the warmer the color tone is; the higher the color temperature, the cooler the hue. The illuminance, i.e., illumination intensity, refers to the luminous flux of visible light received per unit area. In this exemplary embodiment, the image data may be collected under a calibration light source with a fixed illumination and different color temperatures, or the image data may be collected under calibration light sources with different illumination and different color temperatures, and the specific calibration light source may be set by a user as needed, which is not specifically limited in this disclosure.
In an exemplary embodiment, the acquiring image data captured by the off-screen camera under the calibration light source may include:
and acquiring image data shot by the camera under the screen under the calibration light source with preset color temperature and preset illumination.
The preset color temperature may be one color temperature or a plurality of color temperatures, for example, the preset color temperature may be 5100K (kelvin) one color temperature, or 5100K, 4000K, and 3100K color temperatures. The preset illuminance may be a standard illuminance of the set calibration light source, and may be set to 4000lux (lux), for example. In the present exemplary embodiment, the captured image data may be in a raw format, for example, raw 10.
In order to ensure that the calibrated under-screen camera can perform good effect consistency in multiple application scenarios, in an exemplary embodiment, the preset color temperature may include at least two different color temperatures.
For example, the exemplary embodiment may capture image data under calibration light sources with high color temperature, medium color temperature, and low color temperature under the same illumination, for example, capture image data under 5100K, 4000K, 3100K color temperature, and 4000lux illumination, respectively, and store the image data in a corresponding storage path according to a certain naming format, for example, store the image data captured with the color temperature of 5100K in "upnp 10_ D5100kSN _ Raw _, 2592 × 1940.unpack10_ rgb.vcmpos _ 0"; image data captured when the color temperature is 4000K is stored in "upnp 10_ T4000kSN _ Raw _.2592 × 1940.unpack10_ rggb. vcmpos _ 0"; the image data captured at the color temperature of 3100K is stored in "upnp ack10_ a3100kSN _ Raw _.2592 × 1940. unpackack10 _ rgb. vcmpos _ 0", and the like.
Step S330, determining second calibration data according to the image data.
The second calibration data is different from the first calibration data, and the second calibration data is calibration data generated after adjustment according to the calibration light source, and may be OTP data. In the exemplary embodiment, after obtaining the image data, the image data may be processed through specific software or application to generate data in a target format, and then the generated second calibration data may be written into a preset address through a preset interface, for example, the exemplary embodiment may convert the original image data obtained by shooting from the format raw10 into raw8 through OTP data generation software, transmit the raw image data to a high-pass interface, and store the generated second calibration data in a corresponding location.
Step S340, integrating the first calibration data and the second calibration data to generate target calibration data, so as to calibrate the off-screen camera installed in the terminal device.
And finally, target calibration data can be generated by integrating the first calibration data and the second calibration data, and the target calibration data combines the first calibration data which is originally burnt and aims at a single camera and the second calibration data of the lower screen camera which is adjusted according to the calibration light source, so that the target calibration data can effectively calibrate the lower screen camera from multiple sides, and the influence of the screen above the camera on optical imaging caused by the camera is avoided.
By the calibration method of the under-screen camera in the exemplary embodiment, the terminal equipment provided with the under-screen camera can be calibrated completely, and the effect consistency of the under-screen camera is improved. In practical application, the terminal device only needs to read the target calibration data from a specific position and apply the corresponding parameters to the image, so that an imaging effect with good consistency can be obtained.
In an exemplary embodiment, the acquiring first calibration data of the off-screen camera to be calibrated may include:
the method comprises the steps of obtaining first calibration data of an off-screen camera from a first preset path of terminal equipment.
The first calibration data is used for individually calibrating the off-screen camera, and the burned calibration data can be written into an EEPROM (Electrically Erasable and Programmable read only memory) at the module end of the off-screen camera. The EEPROM is a memory chip with no data loss after power failure, and can erase existing information on a computer or special terminal equipment for reprogramming. Further, the present exemplary embodiment may acquire the first calibration data of the off-screen camera from an EEPROM of the terminal device, specifically, may acquire the first calibration data of the off-screen camera from a first preset path in the EEPROM, for example, may acquire the first calibration data of the off-screen camera from "mnt/vector/persistence/camera/EEPROMs _ sensor.
In an exemplary embodiment, as shown in fig. 4, the integrating the first calibration data and the second calibration data in the step S340 to generate the target calibration data may include the following steps:
step S410, extracting image color balance data from the second calibration data;
step S420, combining the image color balance data and the first calibration data to generate target calibration data;
step S430, storing the target calibration data to a second preset path of the terminal device.
The color balance data may be white balance data of an image, and the white balance refers to an important index for describing the accuracy of white color generated by mixing three primary colors of red, green and blue in a display. In practical application, the color cast phenomenon occurring when shooting under a specific light source can be compensated by enhancing the corresponding complementary color, the white balance of the camera can be set to calibrate the color temperature deviation, and the desired picture effect can be achieved by adjusting the white balance during shooting. The white balance data can comprise R/G, B/G and other ratio data of the camera module, the terminal equipment calculates by reading the ratio data in the display image, and the calculation result is set in the image, so that the phenomenon of color cast can be avoided.
In the present exemplary embodiment, the image color balance data may be extracted from the generated second calibration data, combined with the first calibration data, to generate the target calibration data, and written into the second preset path, which refers to a storage address for storing the target calibration data and is a different storage location from the first preset path. For example, in the exemplary embodiment, after the calibration light source captures image data at a preset illumination and a preset color temperature, the image data is processed to generate second calibration data, AWB data may be extracted from the second calibration data, and the AWB data is merged with the first calibration data to generate target calibration data, which is named as "eeprom _ sensorame _ otp _ raw data. bin", and written into a second preset path, such as "mnt/vector/persistence/camera/".
In an exemplary embodiment, the calibration method of the off-screen camera may further include:
and modifying the reading path of the calibration data of the under-screen camera recorded on the terminal equipment from the first preset path to a second preset path.
In order to avoid reading the first calibration data of the first preset path when the terminal device performs the camera calibration, the exemplary embodiment may modify the reading logic of the calibration data, and modify the reading path of the calibration data from the first preset path to the second preset path, so that the terminal device may obtain the target calibration data from the second preset path to calibrate the camera under the screen.
Fig. 5 shows another calibration method for an off-screen camera in the present exemplary embodiment, which may specifically include the following steps:
step S510, acquiring first calibration data of the off-screen camera from a first preset path of the terminal equipment;
step S520, when the under-screen camera is installed on the terminal equipment, image data shot by the under-screen camera under a calibration light source with preset color temperature and preset illumination is obtained;
step S530, determining second calibration data according to the image data;
step S540, extracting image color balance data from the second calibration data;
step S550, combining the image color balance data and the first calibration data to generate target calibration data;
step S560, storing the target calibration data to a second preset path of the terminal device;
step S570, modifying the reading path of the calibration data of the off-screen camera recorded on the terminal device from the first preset path to a second preset path.
Based on the method, the terminal device can read the target calibration data from the second preset path and calibrate the under-screen camera installed on the terminal device according to the target calibration data.
To sum up, in the present exemplary embodiment, first calibration data of an off-screen camera to be calibrated is obtained, where the first calibration data is obtained by individually calibrating the off-screen camera when the off-screen camera is not installed in a terminal device; when the under-screen camera is installed on the terminal equipment, acquiring image data shot by the under-screen camera under a calibration light source; determining second calibration data from the image data; and integrating the first calibration data and the second calibration data to generate target calibration data so as to calibrate the under-screen camera installed on the terminal equipment. On one hand, because a screen above the under-screen camera can affect optical imaging to a certain extent, and the mode of burning calibration data only at the camera module end in the prior art is adopted, and the application scene of the under-screen camera cannot be met, the exemplary embodiment provides a new camera calibration method, which can avoid the problem that the screen above the camera affects the optical imaging and can effectively calibrate the under-screen camera; on the other hand, the second calibration data is determined based on the image data shot by the calibration light source, the target calibration data is generated according to the first calibration data and the second calibration data to calibrate the camera under the screen, the influence factors of optical imaging are fully considered in the calibration process, the calibration process is simple, the camera under the screen can be accurately and effectively calibrated, and the effect consistency of the camera under the screen can be improved.
Exemplary embodiments of the present disclosure also provide a calibration apparatus of an underscreen camera. As shown in fig. 6, the calibration apparatus 600 of the under-screen camera may include: the calibration method includes a first calibration data acquisition module 610, configured to acquire first calibration data of an off-screen camera to be calibrated, where the first calibration data is data obtained by individually calibrating the off-screen camera when the off-screen camera is not installed in a terminal device; the image data acquiring module 620 is configured to acquire image data captured by the off-screen camera under the calibration light source when the off-screen camera is installed in the terminal device; a second calibration data determination module 630 for determining second calibration data from the image data; and the target calibration data generation module 640 is configured to integrate the first calibration data and the second calibration data to generate target calibration data, so as to calibrate the off-screen camera installed in the terminal device.
In an exemplary embodiment, the first calibration data acquisition module includes: the first data acquisition unit is used for acquiring first calibration data of the under-screen camera from a first preset path of the terminal equipment.
In an exemplary embodiment, the target calibration data generation module includes: an image color balance data extracting unit for extracting image color balance data from the second calibration data; the data merging unit is used for merging the image color balance data and the first calibration data to generate target calibration data; and the data storage unit is used for storing the target calibration data to a second preset path of the terminal equipment.
In an exemplary embodiment, the calibration apparatus for an off-screen camera further includes: and the path modification module is used for modifying the reading path of the calibration data of the off-screen camera recorded on the terminal equipment from a first preset path to a second preset path.
In an exemplary embodiment, the image data acquisition module includes: and the image data shooting unit is used for acquiring image data shot by the camera under the screen under the calibration light source with preset color temperature and preset illumination.
In an exemplary embodiment, the preset color temperature includes at least two different color temperatures.
In an exemplary embodiment, the calibration data is one-time-programmable OTP data.
The specific details of each module in the above apparatus have been described in detail in the method section, and details that are not disclosed may refer to the method section, and thus are not described again.
As will be appreciated by one skilled in the art, aspects of the present disclosure may be embodied as a system, method or program product. Accordingly, various aspects of the disclosure may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
Exemplary embodiments of the present disclosure also provide a computer-readable storage medium having stored thereon a program product capable of implementing the above-described method of the present specification. In some possible embodiments, various aspects of the disclosure may also be implemented in the form of a program product including program code for causing a terminal device to perform the steps according to various exemplary embodiments of the disclosure described in the "exemplary methods" section above of this specification, when the program product is run on the terminal device, for example, any one or more of the steps in fig. 3, fig. 4 or fig. 5 may be performed.
Exemplary embodiments of the present disclosure also provide a program product for implementing the above method, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
A computer readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is to be limited only by the terms of the appended claims.

Claims (9)

1. A calibration method for an off-screen camera is characterized by comprising the following steps:
acquiring first calibration data of an under-screen camera to be calibrated, wherein the first calibration data is obtained by singly calibrating the under-screen camera when the under-screen camera is not installed on a terminal device;
when the under-screen camera is installed on the terminal equipment, acquiring image data shot by the under-screen camera under a calibration light source with preset color temperature and preset illumination; the preset color temperature comprises at least two different color temperatures;
determining second calibration data from the image data;
extracting image color balance data from the second calibration data, the image color balance data comprising image white balance data;
combining the image color balance data and the first calibration data to generate target calibration data;
and storing the target calibration data to a second preset path of the terminal equipment so as to calibrate the under-screen camera installed on the terminal equipment.
2. The method of claim 1, wherein the obtaining first calibration data for the off-screen camera to be calibrated comprises:
and acquiring first calibration data of the under-screen camera from a first preset path of the terminal equipment.
3. The method of claim 2, further comprising:
and modifying the reading path of the calibration data of the camera under the screen recorded on the terminal equipment from the first preset path to the second preset path.
4. The method of claim 1, wherein the preset illumination comprises 4000 lux.
5. The method of claim 1, wherein the preset color temperature comprises 5100K, 4000K, 3100K.
6. The method of any of claims 1-5, wherein the calibration data is one-time-programmable (OTP) data.
7. The utility model provides a calibrating device of camera under screen which characterized in that includes:
the calibration method comprises the steps that a first calibration data acquisition module is used for acquiring first calibration data of an off-screen camera to be calibrated, wherein the first calibration data is obtained by singly calibrating the off-screen camera when the off-screen camera is not installed on a terminal device;
the image data acquisition module is used for acquiring image data shot by the under-screen camera under a calibration light source with preset color temperature and preset illumination when the under-screen camera is installed on the terminal equipment; the preset color temperature comprises at least two different color temperatures;
a second calibration data determination module to determine second calibration data from the image data;
a target calibration data generation module for extracting image color balance data from the second calibration data, the image color balance data including image white balance data; combining the image color balance data and the first calibration data to generate the target calibration data; and storing the target calibration data to a second preset path of the terminal equipment so as to calibrate the under-screen camera installed on the terminal equipment.
8. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method of any one of claims 1 to 6.
9. An electronic device, comprising:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the method of any of claims 1 to 6 via execution of the executable instructions.
CN202010826144.8A 2020-08-17 2020-08-17 Calibration method and device for off-screen camera, storage medium and electronic equipment Active CN112004077B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010826144.8A CN112004077B (en) 2020-08-17 2020-08-17 Calibration method and device for off-screen camera, storage medium and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010826144.8A CN112004077B (en) 2020-08-17 2020-08-17 Calibration method and device for off-screen camera, storage medium and electronic equipment

Publications (2)

Publication Number Publication Date
CN112004077A CN112004077A (en) 2020-11-27
CN112004077B true CN112004077B (en) 2022-06-07

Family

ID=73474057

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010826144.8A Active CN112004077B (en) 2020-08-17 2020-08-17 Calibration method and device for off-screen camera, storage medium and electronic equipment

Country Status (1)

Country Link
CN (1) CN112004077B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112911261B (en) * 2021-01-28 2022-07-12 武汉华星光电半导体显示技术有限公司 Display device and white balance adjustment method for photosensitive element of display device
CN113778471A (en) * 2021-09-10 2021-12-10 昆山丘钛微电子科技股份有限公司 Camera module burning method and device and readable storage medium
CN115100054A (en) * 2022-06-16 2022-09-23 昆山国显光电有限公司 Display device and under-screen photographing processing method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107608553A (en) * 2017-09-18 2018-01-19 联想(北京)有限公司 A kind of touch area calibration method and electronic equipment
CN109979382A (en) * 2019-04-23 2019-07-05 清华大学 Imaging system color correcting method and system under screen based on screen transmitted spectrum
CN110213570A (en) * 2019-06-11 2019-09-06 Oppo广东移动通信有限公司 Adjustment method, camera module and the storage medium of camera module

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109685032A (en) * 2018-12-29 2019-04-26 联想(北京)有限公司 Image processing method, device, electronic equipment and storage medium
CN110460825A (en) * 2019-08-02 2019-11-15 武汉华星光电半导体显示技术有限公司 A kind of imaging compensating device, imaging compensating method and its application

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107608553A (en) * 2017-09-18 2018-01-19 联想(北京)有限公司 A kind of touch area calibration method and electronic equipment
CN109979382A (en) * 2019-04-23 2019-07-05 清华大学 Imaging system color correcting method and system under screen based on screen transmitted spectrum
CN110213570A (en) * 2019-06-11 2019-09-06 Oppo广东移动通信有限公司 Adjustment method, camera module and the storage medium of camera module

Also Published As

Publication number Publication date
CN112004077A (en) 2020-11-27

Similar Documents

Publication Publication Date Title
CN112004077B (en) Calibration method and device for off-screen camera, storage medium and electronic equipment
US10951833B2 (en) Method and device for switching between cameras, and terminal
US10630906B2 (en) Imaging control method, electronic device and computer readable storage medium
JP2021530911A (en) Night view photography methods, devices, electronic devices and storage media
US8817128B2 (en) Real-time adjustment of illumination color temperature for digital imaging applications
CN103227928B (en) White balance adjusting method and device
CN105282429A (en) Imaging device, and control method for imaging device
CN107704798B (en) Image blurring method and device, computer readable storage medium and computer device
US11611731B2 (en) Evaluation method for image projection system, image projection system, and image projection control apparatus
US20150062350A1 (en) Light parameter measurement method and device, screen adjustment method and electronic device
EP3836532A1 (en) Control method and apparatus, electronic device, and computer readable storage medium
US11153502B2 (en) Method and apparatus for adjusting exposure time of camera and device
CN109040729B (en) Image white balance correction method and device, storage medium and terminal
CN108881876A (en) The method, apparatus and electronic equipment of white balance processing are carried out to image
US9854218B2 (en) Electronic system and image processing method
CN109831629B (en) Terminal photographing mode adjusting method and device, terminal and storage medium
CN114385280A (en) Parameter determination method and electronic equipment
WO2023151210A1 (en) Image processing method, electronic device and computer-readable storage medium
CN105430290A (en) Water ripple pre-elimination method and photographing device
US20220141374A1 (en) Intelligent flash intensity control systems and methods
CN111602390A (en) Terminal white balance processing method, terminal and computer readable storage medium
CN115278190A (en) Calibration method, calibration equipment and calibration system for video data display colors
JP2011049642A (en) Imaging apparatus and control method thereof
CN114697629B (en) White balance processing method and device, storage medium and terminal equipment
CN114046882A (en) Method and equipment for acquiring color test information of optical equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant