CN111770252B - Pixel position determining method and device, electronic equipment and storage medium - Google Patents

Pixel position determining method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN111770252B
CN111770252B CN202010592405.4A CN202010592405A CN111770252B CN 111770252 B CN111770252 B CN 111770252B CN 202010592405 A CN202010592405 A CN 202010592405A CN 111770252 B CN111770252 B CN 111770252B
Authority
CN
China
Prior art keywords
pixel
quality
determining
image
updating
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010592405.4A
Other languages
Chinese (zh)
Other versions
CN111770252A (en
Inventor
张弓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202010592405.4A priority Critical patent/CN111770252B/en
Publication of CN111770252A publication Critical patent/CN111770252A/en
Application granted granted Critical
Publication of CN111770252B publication Critical patent/CN111770252B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/55Optical parts specially adapted for electronic image sensors; Mounting thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

The disclosure provides a pixel position determining method and device, electronic equipment and a storage medium, and relates to the technical field of electronic equipment. The method comprises the following steps: acquiring position coordinates of each pixel preset in a light transmission area of the camera under the screen; updating the positions of the pixels respectively, wherein the corresponding position offset of each pixel during position updating is not completely the same and is smaller than an offset threshold; after the position of each pixel is updated, acquiring an image through the camera under the screen, determining the quality of the acquired image, and returning to the step of updating the position of each pixel when the quality of the image does not meet the preset condition until the quality of the acquired image meets the preset condition; and taking the position coordinates of each pixel after the last position update as the final position coordinates of each pixel. The camera can improve the imaging quality of the camera.

Description

Pixel position determining method and device, electronic equipment and storage medium
Technical Field
The present disclosure relates to the field of electronic device technologies, and in particular, to a pixel position determining method, a pixel position determining apparatus, an electronic device, and a computer-readable storage medium.
Background
With the development of electronic devices, more and more electronic devices having full-screen are provided. The electronic equipment with the full screen has a higher screen occupation ratio, so that a better visual experience can be brought to a user.
To full screen electronic equipment, can set up the camera in the below of display screen, realize the full screen through camera under the screen promptly. However, the structure in the display screen will result in a low camera imaging quality.
Disclosure of Invention
An object of the present disclosure is to provide a pixel position determining method, a pixel position determining apparatus, an electronic device, and a computer-readable storage medium, which overcome the problem of low imaging quality of an off-screen camera due to limitations and disadvantages of the related art to some extent.
According to a first aspect of the present disclosure, there is provided a pixel position determination method, including:
acquiring position coordinates of each pixel preset in a light transmission area of the camera under the screen;
updating the positions of the pixels respectively, wherein the position offset corresponding to each pixel during position updating is not completely the same and is smaller than an offset threshold;
after the position of each pixel is updated, acquiring an image through the under-screen camera, determining the quality of the acquired image, and returning to the step of updating the position of each pixel respectively when the quality of the image does not meet a preset condition until the quality of the acquired image meets the preset condition;
and taking the position coordinates of each pixel after the last position update as the final position coordinates of each pixel.
According to a second aspect of the present disclosure, there is provided a pixel position determining apparatus comprising:
the pixel position coordinate acquisition module is used for acquiring the position coordinates of each pixel preset in the light transmission area of the camera under the screen;
the pixel position updating module is used for respectively updating the positions of the pixels, wherein the position offset corresponding to each pixel during position updating is not completely the same and is smaller than an offset threshold;
the image quality determining module is used for acquiring images through the under-screen camera after the positions of the pixels are updated, determining the quality of the acquired images, and returning to the pixel position updating module until the quality of the acquired images meets preset conditions when the quality of the images does not meet the preset conditions;
and the final position coordinate determination module is used for taking the position coordinate of each pixel after the last position update as the final position coordinate of each pixel.
According to a third aspect of the present disclosure, there is provided an electronic device comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform the above-described pixel location determination method via execution of the executable instructions.
According to a fourth aspect of the present disclosure, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the above-described pixel position determination method.
Exemplary embodiments of the present disclosure may have some or all of the following benefits:
in the pixel position determining method provided by an exemplary embodiment of the present disclosure, the positions of the pixels in the display screen are updated, so that diffraction generated by the pixels in the display screen can be reduced, the influence of the diffraction on the image quality can be further reduced, and the image quality of the off-screen camera can be improved. Moreover, when the position of the pixel is updated, the influence on the display effect of the display screen can be reduced because the position offset is small. Therefore, the imaging quality of the camera under the screen can be improved, the display effect of the display screen is not reduced, and the user experience can be improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure. It is to be understood that the drawings in the following description are merely exemplary of the disclosure, and that other drawings may be derived from those drawings by one of ordinary skill in the art without the exercise of inventive faculty.
FIG. 1 illustrates a schematic structural diagram of an electronic device suitable for use in implementing embodiments of the present disclosure;
FIG. 2 illustrates a side view of a display screen and a camera module in an electronic device having an off-screen camera;
FIG. 3 illustrates a front view of a display screen and a camera module in an electronic device having an off-screen camera;
FIG. 4 shows a flow chart of a pixel location determination method in an embodiment of the present disclosure;
FIG. 5 is a schematic diagram illustrating pixel location updating in an embodiment of the present disclosure;
FIG. 6 shows a schematic of a diffuse spot prior to pixel location update;
FIG. 7 shows a schematic diagram of a diffuse spot after updating a pixel location in an embodiment of the present disclosure;
FIG. 8 is a schematic diagram of a pixel location prior to a pixel location update;
FIG. 9 is a schematic diagram illustrating pixel locations after updating the pixel locations in an embodiment of the disclosure;
fig. 10 shows a schematic structural diagram of a pixel position determining apparatus in an embodiment of the present disclosure.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the disclosure. One skilled in the relevant art will recognize, however, that the subject matter of the present disclosure can be practiced without one or more of the specific details, or with other methods, components, devices, steps, and the like. In other instances, well-known technical solutions have not been shown or described in detail to avoid obscuring aspects of the present disclosure.
Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
Referring to fig. 1, fig. 1 shows a schematic structural diagram of an electronic device suitable for implementing an embodiment of the present disclosure. It should be noted that the electronic device 100 shown in fig. 1 is only an example, and should not bring any limitation to the functions and the scope of the application of the embodiments of the present disclosure.
As shown in fig. 1, the electronic device 100 may specifically include: the mobile terminal includes a processor 110, a wireless communication module 120, a mobile communication module 130, a charging management module 140, a power management module 141, a battery 142, a USB (Universal Serial Bus) interface 150, an antenna 1, an antenna 2, an internal memory 161, an external memory interface 162, a display screen 170, a sensor module 180, and the like.
It is to be understood that the illustrated structure of the embodiment of the present application does not specifically limit the electronic device 100. In other embodiments of the present application, electronic device 100 may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor, a modem processor, a graphics processor, an image signal processor, a controller, a video codec, a digital signal processor, a baseband processor, and/or a neural network processor, among others. The different processing units may be separate devices or may be integrated into one or more processors. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.
A memory may also be provided in processor 110 for storing instructions and data. The memory may store instructions for implementing six modular functions: detection instructions, connection instructions, information management instructions, analysis instructions, data transmission instructions, and notification instructions, and are controlled to be executed by the processor 110. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory, avoiding repeated accesses, reducing the latency of the processor 110, and thus increasing the efficiency of the system.
The display screen 170 is used to display images, video, and the like. The display screen 170 includes a display panel. The display panel can be a liquid crystal display, an organic light emitting diode, an active matrix organic light emitting diode or an active matrix organic light emitting diode, a flexible light emitting diode, etc.
The technical solutions of the embodiments of the present disclosure are explained in detail below.
At present, place the camera in the technique of realizing the full screen below the display screen, include: mechanical pop-up, screen opening, etc. Mechanical ejection refers to ejecting a camera by a mechanical method when the camera is used. Although the method ensures the imaging quality of the camera, the display effect of the screen is also ensured. But the reliability, cost and thickness of the product are adversely affected by the application of additional mechanical structures.
In the screen trompil scheme, in camera light passing area, if there is not the pixel structure in the display screen, although can guarantee the imaging quality of camera, because the screen can not show in camera light passing area, consequently the display effect can receive the influence.
In the screen-cut scheme, if a pixel structure is included in the display screen in the camera light-transmitting area, the structure can be seen in fig. 2 and 3, respectively, and in the side view of fig. 2, the under-screen camera 210 is located below the display screen 220. In the front view of fig. 3, the enlarged view of the head light-passing area 320 in the display screen 310 can be seen in the right-side dashed box, and it can be seen that the pixels 330 are uniformly distributed. At this moment, the screen display effect of camera light-passing area and the imaging effect of camera need be guaranteed simultaneously. The light transmittance of the pixel part in the display screen is low, and the thin film transistor and the circuit connecting wire thereof in the screen also form a complex structure, so that the imaging quality of the camera is reduced, including the reduction of the resolving power, the generation of the starburst phenomenon and the like. The starburst belongs to the special phenomenon of light diffraction, and is formed after light is diffracted and scattered in the transmission process.
In order to solve the above problems, the present disclosure provides a pixel position determining method, a pixel position determining apparatus, an electronic device, and a computer-readable storage medium, which improve the imaging quality of a camera by determining the position of each pixel in a display screen when designing the display screen before the electronic device leaves a factory.
Referring to fig. 4, fig. 4 shows a flowchart of a pixel location determination method of an embodiment of the present disclosure, which may include the following steps:
step S410, acquiring position coordinates of each pixel preset in the light transmission region of the off-screen camera.
Step S420, respectively updating the positions of the pixels, wherein the position offsets corresponding to the pixels during the position updating are not completely the same and are all smaller than the offset threshold.
And step S430, after the position of each pixel is updated, acquiring an image through the under-screen camera, and determining the quality of the acquired image.
Step S440, determining whether the quality of the acquired image meets a preset condition. If the preset condition is not met, returning to the step S420; when the preset condition is satisfied, step S450 is performed.
In step S450, the position coordinates of each pixel after the last position update are used as the final position coordinates of each pixel.
In the pixel position determining method of the embodiment of the disclosure, the positions of the pixels in the display screen are updated, so that diffraction generated by the pixels in the display screen can be reduced, the influence of the diffraction on the image quality is further reduced, and the image quality of the camera under the screen is improved. Moreover, when the position of the pixel is updated, the influence on the display effect of the display screen can be reduced because the position offset is small. Therefore, the imaging quality of the camera under the screen can be improved, the display effect of the display screen is not reduced, and the user experience can be improved.
The pixel position determining method according to the embodiment of the present disclosure is described in more detail below.
In step S410, position coordinates of each pixel set in advance in the light-transmitting area of the off-screen camera are acquired.
In the embodiment of the present disclosure, the off-screen camera refers to a camera disposed below a display screen of an electronic device, and the electronic device may be a full-screen electronic device. Since the position coordinates of each pixel do not refer to the position coordinates of each pixel in the display screen after the electronic device is produced. Therefore, the position coordinates of each pixel set in advance may be the position coordinates of each pixel in the display screen of the electronic device in the related art. That is, the position coordinates of each pixel in the display screen can be newly determined on the basis of the prior art.
The light-transmitting area of the under-screen camera is located on a display screen, and pixels in the display screen can be arranged periodically, and correspondingly, the pixels in the light-transmitting area can also be arranged periodically. In general, the anode of a screen pixel has a low transmittance or even no transmittance, so that the periodically arranged pixels act as an amplitude-type two-dimensional grating and diffract incident light. In order to eliminate the diffraction phenomenon and improve the imaging quality of the camera, the position of the pixel in the light-transmitting area can be updated. Therefore, the position coordinates of each pixel in the light-transmitting area can be acquired first. The present disclosure may use the lower left corner of the display screen as an origin, the horizontal direction as an X axis, and the vertical direction as a Y axis to establish a coordinate system, or may use the lower left corner of the light-transmitting area as an origin, the horizontal direction as an X axis, and the vertical direction as a Y axis to establish a coordinate system, and the like, which is not limited herein.
In step S420, the positions of the pixels are updated.
In the embodiment of the present disclosure, the pixels arranged periodically form a grating to generate a diffraction phenomenon, and in order to eliminate the diffraction phenomenon, the position of each pixel may be updated, that is, each pixel is moved to change its position. It should be noted that the execution subject of the present disclosure may be the electronic device itself, for example, a processor in the electronic device may control the movement of each pixel in the display screen. In addition, another electronic device (for example, a desktop computer, a portable computer, etc.) may be used to control the movement of each pixel in the display screen of the electronic device.
Because the display effects of different display screens are different, that is, the distances between the pixels in different display screens are different, when the position of each pixel is updated, the position offset corresponding to each pixel can be determined according to the position coordinates of each pixel. The position offset amount represents the magnitude of the pixel shift, and may include: a lateral position offset and a longitudinal position offset. Referring to fig. 5, fig. 5 shows a schematic diagram of pixel position update in the embodiment of the present disclosure, where black represents an original position of a pixel, gray represents a position of the pixel after the position is thinner, and Δ x and Δ y represent a lateral position offset and a longitudinal position offset, respectively.
It should be noted that, if the position offset corresponding to each pixel during the position update is completely the same, which is equivalent to that each pixel has performed an overall translation, the influence on the imaging effect of the camera before and after the translation is the same, and the purpose of improving the imaging effect of the camera cannot be achieved. Therefore, the amount of positional shift corresponding to each pixel at the time of position update is not exactly the same. That is, the amount of positional shift corresponding to each pixel at the time of position update may be completely different, or may be partially the same or partially different.
In the embodiment of the present disclosure, the position offset amount of each pixel may be determined according to the position coordinate of each pixel. The method specifically comprises the following steps:
first, the distance between the pixels can be determined from the position coordinates of the pixels. For example, for the periodically arranged pixels, the lateral distances and the longitudinal distances between any adjacent pixels are the same before the position update is performed. The transverse distance and the longitudinal distance may be the same or different. Accordingly, it may be determined that the pixel arrangement period of the display screen includes: a transverse alignment period and a longitudinal alignment period. The horizontal arrangement period is the horizontal distance between adjacent pixels, and the vertical arrangement period is the vertical distance between adjacent pixels.
Then, the positional shift amount of each pixel is determined based on the distance, i.e., the lateral arrangement period and the longitudinal arrangement period. It can be understood that if the pixel position offset is too large, the human eye can distinguish the pixel position offset, and the display effect of the display screen will be affected. In order to reduce the influence on the screen display effect, each pixel can correspond to a small position offset. For example, the position offset amount of each pixel may be smaller than an offset amount threshold, where the position offset amount of each pixel refers to an overall position offset amount obtained by superimposing the lateral position offset amount and the longitudinal position offset amount. The offset threshold may be one tenth, one fifteenth, etc. of the pixel arrangement period, and is not limited herein. Experiments show that when the offset threshold is one tenth of the pixel arrangement period, the camera has a good imaging effect, and the display effect of the display screen is not affected.
After the position offset of each pixel is determined, the position of each pixel is updated according to the position offset corresponding to the pixel.
And step S430, after the position of each pixel is updated, acquiring an image through the under-screen camera, and determining the quality of the acquired image.
In the embodiment of the disclosure, images can be collected by the camera under the screen, and the imaging effect of the camera after the updating of each pixel position is checked according to the quality of the images. The image here may be a complete image or an image in a light-transmitting region. It is assumed that the lens in the under-screen camera is an ideal optical lens without any aberration. When there is no display screen, the image of the point source at infinity in the camera is also an infinitesimal point. When there is a display screen, the diffraction of light by the display screen can increase the amount of diffuse light. The diffuse speckle refers to the light intensity distribution of diffraction images formed on different sections of the front and the back of an image surface after a point light source passes through an optical system.
Thus, the quality of the image can be characterized by the size of the diffuse spot, which can be the radius, diameter, etc. of the diffuse spot. Specifically, the size of the diffuse spot of the acquired image can be determined; based on the size, the quality of the image is determined. Depending on the quality of the image, the magnitude of the display screen diffraction effects can be determined. That is, the magnitude of the display screen diffraction effect can be quantitatively characterized by the size of the diffuse spot. Of course, the quality of the image may be characterized in other ways besides the diffuse spot, and is not limited herein.
Step S440, determining whether the quality of the acquired image meets a preset condition. If the preset condition is not met, returning to the step S420; when the preset condition is satisfied, step S450 is performed.
In the embodiment of the present disclosure, after the positions of the pixels are updated, the quality of the acquired image may still not meet the preset condition, and at this time, the step S420 may be returned to, and the positions of the pixels are updated for multiple times in a cyclic manner. When the quality of the acquired image satisfies the preset condition, the step S450 is directly performed.
In one implementation of the present disclosure, the position offset corresponding to each pixel may be determined based on an optimization algorithm. The optimization algorithm may include: particle swarm algorithm, genetic algorithm, etc., and are not limited herein. Accordingly, the optimization goal of the optimization algorithm may be to minimize the size of the diffuse spot. The basic core of the particle swarm optimization is that the movement of the whole swarm generates an evolution process from disorder to order in a problem solving space by sharing information by individuals in the swarm, so that the optimal solution of the problem is obtained. A genetic algorithm is a method of searching for an optimal solution by simulating a natural evolution process. The algorithm converts the solving process of the problem into the processes of crossover, variation and the like of chromosome genes in the similar biological evolution by a mathematical mode and by utilizing computer simulation operation. When a complex combined optimization problem is solved, a better optimization result can be obtained faster compared with some conventional optimization algorithms.
In the embodiment of the present disclosure, as described above, the smaller the size of the diffuse spot, the higher the quality of the image. Therefore, when the size of the diffuse spot of the acquired image is smaller than the size threshold, it can be determined that the quality of the image satisfies the preset condition. The size threshold may be a preset fixed value or a variable value dynamically set according to different images, and is not limited herein.
Or, when the position of each pixel is optimized, under the condition that the optimization is not performed, the quality of the image is determined to meet the preset condition. Specifically, the size of the diffuse spot of the last acquired image can be acquired, and when the difference value between the size of the diffuse spot of the last acquired image and the size of the diffuse spot of the currently acquired image is smaller than a preset threshold value, it is determined that the quality of the image meets a preset condition. The preset threshold may be 3 pixel units, 5 pixel units, etc., and is not limited herein.
For example, the size of the diffuse spot (e.g., the diameter of the diffuse spot) of the last acquired image is 150 pixel units, and the size of the diffuse spot of the current acquired image is 148 pixel units, which is smaller than the preset threshold (e.g., 3 pixel units). At this time, it may be determined that the quality of the currently acquired image satisfies the preset condition, and the loop process is ended.
Referring to fig. 6 and 7, a schematic diagram of a diffuse spot before and after a pixel location update is shown, respectively. In fig. 6, the intensity is still large at a position farther from the center position of the image, that is, the size of the diffuse spot is large, 270 pixel units. In fig. 7, the light intensity is mainly concentrated in the central region of the image, and the light intensity is smaller at a position farther from the central position of the image, that is, the size of the dispersed spot is smaller, and is 150 pixel units. It is found by comparison that the size of the diffuse spot is significantly reduced, and thus the influence of the display screen corresponding to fig. 7 on the imaging quality is smaller than the influence of the display screen corresponding to fig. 6 on the imaging quality.
In step S450, the position coordinates of each pixel after the last position update are used as the final position coordinates of each pixel.
It can be understood that, since the quality of the acquired image after the last position update can satisfy the preset condition, the position coordinates of each pixel after the last position update can be directly used as the final position coordinates of each pixel. Through the final pixel arrangement mode, the influence of the diffraction phenomenon on the imaging quality of the camera can be reduced.
In the embodiment of the present disclosure, since some restrictions are made on the position offset of each pixel, the display effect of the display screen may be less affected. Fig. 8 and 9 show a schematic diagram of a pixel position before and after a pixel position update, respectively, and it can be seen that, after the pixel position update, the display screen cannot obviously see the change of the pixel position, so that the influence on the display effect of the display screen can be ensured to be relatively small.
According to the pixel position determining method, the pixel position of the display screen is slightly updated, so that the influence of screen diffraction on image quality is reduced, and the imaging quality of the camera under the screen is improved. Meanwhile, the influence of the tiny position update of each pixel on the screen display effect is small. Therefore, the imaging quality of the camera under the screen and the display effect of the display screen can be considered simultaneously.
It should be noted that although the various steps of the methods of the present disclosure are depicted in the drawings in a particular order, this does not require or imply that these steps must be performed in this particular order, or that all of the depicted steps must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions, etc.
Further, in the present exemplary embodiment, there is also provided a pixel position determining apparatus 1000, as shown in fig. 10, including:
a pixel position coordinate obtaining module 1010, configured to obtain position coordinates of each pixel preset in a light-transmitting area of the under-screen camera;
a pixel location updating module 1020, configured to update the location of each pixel, where the location offsets corresponding to the pixels during location updating are not completely the same and are all smaller than an offset threshold;
the image quality determining module 1030 is configured to, after the position of each pixel is updated, acquire an image through the off-screen camera, determine the quality of the acquired image, and return to the pixel position updating module 1020 until the quality of the acquired image meets a preset condition when the quality of the acquired image does not meet the preset condition;
and a final position coordinate determining module 1040, configured to use the position coordinates of each pixel after the last position update as the final position coordinates of each pixel.
In an exemplary embodiment of the present disclosure, the image quality determination module determines the quality of the acquired image by:
determining the size of a diffuse spot of the acquired image;
based on the size, the quality of the image is determined.
In an exemplary embodiment of the present disclosure, the image quality determination module determines that the quality of the acquired image satisfies a preset condition by:
when the size of the diffuse spot of the acquired image is smaller than a size threshold, determining that the quality of the image meets a preset condition; or
Acquiring the size of the diffuse spot of the last acquired image;
and when the difference value between the size of the scattered point of the last acquired image and the size of the scattered point of the current acquired image is smaller than a preset threshold value, determining that the quality of the image meets a preset condition.
In an exemplary embodiment of the present disclosure, a pixel location update module includes:
a position offset determining unit, which is used for determining the position offset corresponding to each pixel according to the position coordinate of each pixel;
and the position updating unit is used for updating the position of each pixel according to the position offset corresponding to the pixel.
In an exemplary embodiment of the present disclosure, the pixels in the light-transmitting area are periodically arranged before the position of each pixel is updated.
In an exemplary embodiment of the present disclosure, the offset threshold is one tenth of a pixel arrangement period.
The details of each module or unit in the above device have been described in detail in the corresponding method, and therefore are not described herein again.
It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
In an exemplary embodiment of the disclosure, there is also provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of any one of the above.
It should be noted that the computer readable storage medium shown in the present disclosure can be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer-readable signal medium may include a propagated data signal with computer-readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, radio frequency, etc., or any suitable combination of the foregoing.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (8)

1. A pixel position determining method, comprising:
acquiring position coordinates of each pixel preset in a light transmission area of the camera under the screen; wherein each pixel in the light-transmitting area is periodically arranged; updating the position of each pixel respectively, comprising:
determining the distance between the pixels according to the position coordinates of the pixels;
determining the position offset of each pixel according to the distance between the pixels;
updating the position of each pixel according to the position offset corresponding to the pixel; the corresponding position offset of each pixel during position updating is not completely the same and is smaller than an offset threshold;
after the position of each pixel is updated, acquiring an image through the under-screen camera, determining the quality of the acquired image, and returning to the step of updating the position of each pixel respectively when the quality of the image does not meet a preset condition until the quality of the acquired image meets the preset condition;
and taking the position coordinates of each pixel after the last position update as the final position coordinates of each pixel.
2. The method of claim 1, wherein determining the quality of the acquired image comprises:
determining the size of a diffuse spot of the acquired image;
based on the size, a quality of the image is determined.
3. The method according to claim 2, wherein the method for judging that the quality of the acquired image meets the preset condition comprises:
when the size of the diffuse spot of the acquired image is smaller than a size threshold, determining that the quality of the image meets a preset condition.
4. The method according to claim 2, wherein the method for judging that the quality of the acquired image meets the preset condition comprises:
acquiring the size of the diffuse spot of the last acquired image;
and when the difference value between the size of the diffuse spot of the last acquired image and the size of the diffuse spot of the currently acquired image is smaller than a preset threshold value, determining that the quality of the image meets a preset condition.
5. The method of claim 1, wherein the offset threshold is one tenth of a period of a pixel arrangement.
6. A pixel position determining apparatus, comprising:
the pixel position coordinate acquisition module is used for acquiring the position coordinates of each pixel preset in the light transmission area of the camera under the screen; wherein each pixel in the light-transmitting area is periodically arranged;
a pixel location updating module, configured to update the location of each pixel, respectively, including: determining the distance between the pixels according to the position coordinates of the pixels; determining the position offset of each pixel according to the distance between the pixels; updating the position of each pixel according to the position offset corresponding to the pixel; the corresponding position offset of each pixel during position updating is not completely the same and is smaller than an offset threshold;
the image quality determining module is used for acquiring images through the under-screen camera after the positions of the pixels are updated, determining the quality of the acquired images, and returning to the pixel position updating module until the quality of the acquired images meets the preset conditions when the quality of the images does not meet the preset conditions;
and the final position coordinate determination module is used for taking the position coordinate of each pixel after the last position update as the final position coordinate of each pixel.
7. An electronic device, comprising:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the method of any of claims 1-5 via execution of the executable instructions.
8. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method of any one of claims 1 to 5.
CN202010592405.4A 2020-06-24 2020-06-24 Pixel position determining method and device, electronic equipment and storage medium Active CN111770252B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010592405.4A CN111770252B (en) 2020-06-24 2020-06-24 Pixel position determining method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010592405.4A CN111770252B (en) 2020-06-24 2020-06-24 Pixel position determining method and device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN111770252A CN111770252A (en) 2020-10-13
CN111770252B true CN111770252B (en) 2021-11-02

Family

ID=72721798

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010592405.4A Active CN111770252B (en) 2020-06-24 2020-06-24 Pixel position determining method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN111770252B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106921767A (en) * 2017-03-07 2017-07-04 捷开通讯(深圳)有限公司 A kind of mobile terminal of screen accounting high
CN108683757A (en) * 2018-04-24 2018-10-19 Oppo广东移动通信有限公司 Electronic equipment and electronic device
CN110047380A (en) * 2019-03-26 2019-07-23 武汉华星光电半导体显示技术有限公司 A kind of display panel and display device
CN110459175A (en) * 2019-08-09 2019-11-15 武汉华星光电半导体显示技术有限公司 Display panel and display device
US10812705B2 (en) * 2017-03-22 2020-10-20 Fujifilm Corporation Imaging apparatus, imaging method, and imaging program

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110895665B (en) * 2018-09-12 2023-03-31 上海耕岩智能科技有限公司 Coordinate transformation method for under-screen imaging, storage medium and electronic equipment
CN110491909B (en) * 2019-07-29 2021-12-24 武汉华星光电技术有限公司 Display panel
CN110661949A (en) * 2019-09-09 2020-01-07 维沃移动通信有限公司 Control method of display panel and electronic equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106921767A (en) * 2017-03-07 2017-07-04 捷开通讯(深圳)有限公司 A kind of mobile terminal of screen accounting high
US10812705B2 (en) * 2017-03-22 2020-10-20 Fujifilm Corporation Imaging apparatus, imaging method, and imaging program
CN108683757A (en) * 2018-04-24 2018-10-19 Oppo广东移动通信有限公司 Electronic equipment and electronic device
CN110047380A (en) * 2019-03-26 2019-07-23 武汉华星光电半导体显示技术有限公司 A kind of display panel and display device
CN110459175A (en) * 2019-08-09 2019-11-15 武汉华星光电半导体显示技术有限公司 Display panel and display device

Also Published As

Publication number Publication date
CN111770252A (en) 2020-10-13

Similar Documents

Publication Publication Date Title
CN110276346B (en) Target area recognition model training method, device and computer readable storage medium
CN112258512B (en) Point cloud segmentation method, device, equipment and storage medium
US20190347824A1 (en) Method and apparatus for positioning pupil, storage medium, electronic device
CN109493814B (en) Picture compensation method, picture compensation device, display device and computer readable storage medium
US11812152B2 (en) Method and apparatus for controlling video frame image in live classroom
JP2023519728A (en) 2D image 3D conversion method, apparatus, equipment, and computer program
CN112802170A (en) Illumination image generation method, apparatus, device, and medium
WO2024120223A1 (en) Image processing method and apparatus, and device, storage medium and computer program product
CN111951192A (en) Shot image processing method and shooting equipment
CN110852209B (en) Target detection method and device, medium and equipment
CN114419322B (en) Image instance segmentation method and device, electronic equipment and storage medium
CN114742934B (en) Image rendering method and device, readable medium and electronic equipment
CN116844129A (en) Road side target detection method, system and device for multi-mode feature alignment fusion
CN114764841A (en) Use of built-in functions for shadow denoising in ray tracing applications
CN111770252B (en) Pixel position determining method and device, electronic equipment and storage medium
CN115131471B (en) Image-based animation generation method, device, equipment and storage medium
EP3467637B1 (en) Method, apparatus and system for displaying image
CN113744379B (en) Image generation method and device and electronic equipment
CN115527163A (en) Target detection model optimization method and device, electronic equipment and readable storage medium
US20140071129A1 (en) Method and system for graphics rendering employing gradient domain metropolis light transport
CN109741250B (en) Image processing method and device, storage medium and electronic equipment
CN114140335A (en) Spatio-temporal self-guided shadow denoising in ray tracing applications
CN112989991B (en) Lane line detection method and device, electronic equipment and computer readable storage medium
CN115082662B (en) Target area positioning method and target area positioning device
CN111325117B (en) Training method and device for target object recognition model and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant