CN114416009A

CN114416009A - Image processing method, image processing device, storage medium and electronic equipment

Info

Publication number: CN114416009A
Application number: CN202011173507.9A
Authority: CN
Inventors: 李志林
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2020-10-28
Filing date: 2020-10-28
Publication date: 2022-04-29

Abstract

The application discloses an image processing method, an image processing device, a storage medium and an electronic device. The method comprises the following steps: acquiring a plurality of first pixels at the adjacent position of the first display area and the second display area; splitting the plurality of first pixels at the adjacent positions into a preset number of virtual pixels respectively; acquiring a plurality of second pixels at the adjacent position of the first display area and the second display area; and performing pixel rendering on the plurality of second pixels and the virtual pixels at the adjacent positions by using a preset pixel rendering algorithm. The problem that lines of main and auxiliary screens of the comprehensive screen electronic equipment with the camera under the screen are obvious can be solved.

Description

Image processing method, image processing device, storage medium and electronic equipment

Technical Field

The present application belongs to the technical field of electronic devices, and in particular, to an image processing method, an image processing apparatus, a storage medium, and an electronic device.

Background

With the development of communication technology, electronic devices such as smart phones are becoming more and more popular. In the using process of the electronic equipment, the electronic equipment can display the picture by using the display screen of the electronic equipment. For better display effect and user experience, the size of the display screen is larger and larger, but the electronic device with the larger size is difficult to hold, so that it is more and more important to improve the screen occupation ratio of the electronic device.

In the related art, dividing a display screen of an electronic device into a main screen area and a sub screen area, improving light transmittance of the sub screen area, and arranging elements such as a front camera and a proximity sensor below the sub screen area so that the elements such as the front camera and the proximity sensor can transmit optical signals through the sub screen area are the most effective method for realizing a full screen. However, in the above method, a display effect of the display screen is not good due to the existence of a distinct boundary at the boundary of the main screen and the auxiliary screen of the electronic device.

Disclosure of Invention

The embodiment of the application provides an image processing method, an image processing device, a storage medium and electronic equipment, which can solve the problem that main and auxiliary screen boundaries of the overall screen electronic equipment with an off-screen camera are obvious.

In a first aspect, an embodiment of the present application provides an image processing method applied to an electronic device, where the electronic device includes a first display area and a second display area, the second display area is adjacent to the first display area, the first display area includes a plurality of first pixels, the second display area includes a plurality of second pixels, and a distribution density of the first pixels is smaller than a distribution density of the second pixels, the image processing method includes:

acquiring a plurality of first pixels at the adjacent position of the first display area and the second display area;

splitting the plurality of first pixels at the adjacent positions into a preset number of virtual pixels respectively;

acquiring a plurality of second pixels at the adjacent position of the first display area and the second display area;

and performing pixel rendering on the plurality of second pixels and the virtual pixels at the adjacent positions by using a preset pixel rendering algorithm.

In a second aspect, an embodiment of the present application provides an image processing apparatus applied to an electronic device, where the electronic device includes a first display area and a second display area, the second display area is adjacent to the first display area, the first display area includes a plurality of first pixels, the second display area includes a plurality of second pixels, and a distribution density of the first pixels is smaller than a distribution density of the second pixels, the image processing apparatus includes:

the first acquisition module is used for acquiring a plurality of first pixels at the adjacent positions of the first display area and the second display area;

the splitting module is used for splitting the plurality of first pixels at the adjacent positions into a preset number of virtual pixels;

the second acquisition module is used for acquiring a plurality of second pixels at the adjacent positions of the first display area and the second display area;

and the rendering module is used for performing pixel rendering on the plurality of second pixels and the virtual pixels at the adjacent positions by using a preset pixel rendering algorithm.

In a third aspect, an embodiment of the present application provides a storage medium, on which a computer program is stored, which, when executed on a computer, causes the computer to execute a flow in an image processing method provided by an embodiment of the present application.

In a fourth aspect, an embodiment of the present application further provides an electronic device, including a memory, a processor, and a camera module, where the processor is configured to execute a procedure in the image processing method provided in the embodiment of the present application by calling a computer program stored in the memory, and the camera module is disposed in the electronic device and configured to acquire an external light signal passing through the first display area to perform imaging.

In the embodiment of the application, the electronic device may acquire a plurality of first pixels at a position where the first display area is adjacent to the second display area; and splitting the plurality of first pixels at the adjacent positions into a preset number of virtual pixels respectively. Then, the electronic device acquires a plurality of second pixels where the first display area is adjacent to the second display area. And then, the electronic equipment carries out pixel rendering on the plurality of second pixels and the virtual pixels at the adjacent positions by using a preset pixel rendering algorithm. In other words, in the embodiment of the application, the electronic device calls the pixels on the two sides of the first display area and the second display area, and in the display process, the problem that the display boundary is obvious due to the fact that algorithms on the two sides of the main screen and the auxiliary screen are not consistent can be solved. Therefore, the problem that lines of main screens and auxiliary screens of the full-screen electronic equipment with the camera under the screen are obvious can be solved.

Drawings

The technical solutions and advantages of the present application will become apparent from the following detailed description of specific embodiments of the present application when taken in conjunction with the accompanying drawings.

Fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Fig. 2 is a schematic structural diagram of a display device according to an embodiment of the present application.

Fig. 3 is a sectional view of the display device shown in fig. 2 taken along the direction P1-P1.

Fig. 4 is a partial schematic view of the display device shown in fig. 2.

Fig. 5 is another partial schematic view of the display device shown in fig. 2.

Fig. 6 is another schematic structural diagram of a display device according to an embodiment of the present application.

Fig. 7 is a sectional view of the display device shown in fig. 6 taken along the direction P2-P2.

Fig. 8 is a partial schematic view of the display device shown in fig. 7.

Fig. 9 is a schematic flowchart of an image processing method according to an embodiment of the present application.

Fig. 10 is a schematic layout diagram of sub-pixels processed by using the SPR algorithm according to the embodiment of the present application.

Fig. 11 is a diagram illustrating an arrangement structure of RGB clips in the related art.

Fig. 12 is a schematic diagram of an RGBG arrangement structure in the related art.

Fig. 13 is a schematic diagram of an RGB Delta arrangement structure in the related art.

Fig. 14 is a schematic diagram showing a comparison of the three pixel arrangement structures in fig. 11, 12 and 13.

Fig. 15 is another schematic flowchart of an image processing method according to an embodiment of the present application.

Fig. 16 is a schematic diagram illustrating a principle of a Sub Pixel Rendering (SPR) algorithm according to an embodiment of the present disclosure.

Fig. 17 is a schematic view of a scene processed by an SPR algorithm according to an embodiment of the present application.

FIG. 18 is a partial schematic diagram of an SPR algorithm according to embodiments of the present application.

Fig. 19 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application.

Fig. 20 is a schematic structural diagram of an electronic device provided in an embodiment of the present application.

Fig. 21 is another schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

Referring to the drawings, wherein like reference numbers refer to like elements, the principles of the present application are illustrated as being implemented in a suitable computing environment. The following description is based on illustrated embodiments of the application and should not be taken as limiting the application with respect to other embodiments that are not detailed herein.

It can be understood that the execution subject of the embodiment of the present application may be an electronic device such as a smart phone or a tablet computer having a camera module.

Referring to fig. 1, fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. It is understood that the electronic device 10 of the embodiment of the present application includes, but is not limited to, a mobile terminal such as a mobile phone, a tablet computer, or other portable electronic devices. In this document, the electronic device 10 is taken as a mobile phone as an example for explanation.

In the present embodiment, the electronic device 10 includes the display device 20, and the display device 20 can display a screen. The display device 20 may be an Organic Light-Emitting Diode (OLED) display device. The display surface of the display device 20 may have a larger display area and a narrower non-display area, or the display device 20 may have a narrower black border. Of course, the display surfaces of the display device 20 may be all display areas, and no non-display area is provided, that is, the display device 20 may be a full-screen. Display device 20 may be protected using a display device cover layer such as a transparent glass layer, light-transmissive plastic, sapphire, or other transparent dielectric layer.

The display device 20 may have a regular shape, such as a rectangle, a rounded rectangle, or a circle. Of course, in some other possible embodiments, the display device 20 may also have an irregular shape, which is not limited in the examples of the present application.

Referring to fig. 2, fig. 2 is a schematic structural diagram of a display device according to an embodiment of the present disclosure. The display device 20 may include a first display area 210 and a second display area 220, both the first display area 210 and the second display area 220 may display a screen, and the first display area 210 and the second display area 220 may display the same screen or different screens.

The first display area 210 and the second display area 220 may be contiguous. For example, the periphery of the first display area 210 is entirely surrounded by the second display area 220; for another example, a portion of the edge of the first display region 210 is surrounded by the second display region 220, i.e., the first display region 210 is located at an end surface position or an end surface connection position of the display device 20. It is understood that the end surface connection position of the display device 20 is a position where both end surfaces of the display device 20 are connected to each other, and may include a portion of both end surfaces connected to each other. One or more first display regions 210 may be provided. When there are a plurality of first display regions 210, the plurality of first display regions 210 may be located on the same end surface of the display device 20, may be located on a plurality of end surfaces of the display device 20, may be located at a plurality of end surface connection positions of the display device 20, or may be located at an end surface connection position of the display device 20 in part and an end surface position of the display device 20 in part in the plurality of first display regions 210.

It should be understood that reference to "a plurality" herein means two or more.

In the embodiment of the present application, the area of the display area of the first display area 210 may be smaller than the area of the display area of the second display area 220, the first display area 210 may be used as an auxiliary display area of the display device 20, or a functional display area, and the second display area 220 may be used as a main display area of the display device 20. For example, the light transmittance of the first display area 210 may be set to be greater than the light transmittance of the second display area 220, so that the light transmittance of the first display area 210 may be greatly improved in the non-display state of the first display area 210, and functional devices of the electronic device 10, such as the camera 30, the sensor, and the like, may be set at positions corresponding to the first display area 210 inside the electronic device 10, so as to improve the quality of the optical signal transmission of the camera 30, the sensor, and the like through the first display area 210.

It should be noted that, in some embodiments, the display area of the first display area 210 may be set to be equal to the display area of the second display area 220, and the display area of the first display area 210 may also be set to be larger than the display area of the second display area 220.

In the embodiment of the application, devices such as the camera 30 and the sensor may be disposed at the position of the first display area 210, for example, below the first display area 210, and the devices such as the camera 30 and the sensor may perform optical signal transmission, for example, image acquisition, through the first display area 210 in the non-display state of the first display area 210. Meanwhile, the first display area 210 may also display a picture according to requirements, so as to achieve the integrity of the display device 20 and the integrity of the display area. Not only the hidden design of the camera 30, the sensor and other devices is realized, but also the screen occupation ratio of the electronic equipment 10 can be improved.

It should be noted that the functional devices of the electronic device 10, such as the camera 30 and the sensor, are not limited to be disposed below the first display area 210, and may also be disposed away from the first display area 210, and a light guide is disposed between the functional devices, such as the camera 30 and the sensor, and the first display area 210, so as to implement transmission of the optical signal. The light guide column can transmit light signals emitted by functional devices such as the camera 30 and the sensor to the first display area 210 and transmit the light signals to the outside of the electronic device 10 through the first display area 210, and the light guide column can also transmit external light signals passing through the first display area 210 to the functional devices such as the camera 30 and the sensor. The light guide column can be of a cylindrical structure or a multi-section structure. When the light guide column is in a multi-section structure, the light guide column can be provided with at least one light guide surface to reflect light signals.

Referring to FIG. 3, FIG. 3 is a cross-sectional view of the display device shown in FIG. 2 taken along the direction P1-P1. The display device 20 may include an upper substrate 240, a display layer 250, a driving layer 260, and a lower substrate 270, which are sequentially stacked. The display device 20 can drive the display layer 250 through the driving layer 260 to display a screen. The upper substrate 240 and the lower substrate 270 may be made of a transparent material, such as transparent glass. The upper substrate 240 may be defined as a first substrate, and the lower substrate 270 may serve as a second substrate.

The display layer 250 may include a plurality of pixels. The display layer 250 includes a first display portion 251 located in the first display region 210 and a second display portion 252 located in the second display region 220, that is, the display layer 250 may include a plurality of first pixels 211 located in the first display region 210 and a plurality of second pixels 221 located in the second display region 220. The plurality of first pixels 211 and the plurality of second pixels 221 may be arranged in a matrix. The arrangement of the first pixels 221 of the first display region 210 may be one of a standard RGB arrangement, a Pentile arrangement, or a Delta arrangement, and the arrangement of the second pixels 221 of the second display region 220 may be one of a standard RGB arrangement, a Pentile arrangement, or a Delta arrangement. It should be noted that the first pixels 211 in the first display area 210 may also adopt other arrangement manners, and the second pixels 221 in the second display area 220 may also adopt other arrangement manners, and the arrangement manners of the first pixels 211 in the first display area 210 and the second pixels 221 in the second display area 220 may be the same, and the arrangement manners of the first pixels 211 in the first display area 210 and the second pixels 221 in the second display area 220 may also be different.

In order to improve the light transmittance of the first display region 210, in the embodiment of the present application, the size of each of the plurality of first pixels 211 is larger than the size of each of the plurality of second pixels 221, and the arrangement of the plurality of first pixels 211 is more sparse than the arrangement of the plurality of second pixels 221, that is, the distribution density of the first pixels 211 is smaller than the distribution density of the second pixels 221. In addition, the first pixels 211 of the first display region 210 may be made of a light-transmitting material, so as to further improve the light transmittance of the first display region 210.

The driving layer 260 may include a plurality of driving units, each of which may drive one pixel. The driving layer 260 includes a plurality of first driving units 216 for driving the first display region 210 and a plurality of second driving units 226 for driving the second display region 220. Each of the first driving units 216 may be electrically connected to one of the first pixels 211, and may drive one of the first pixels 211. Each of the second driving units 226 may be electrically connected to one of the second pixels 221, and may drive one of the second pixels 221. The driving layer 260 may include a first driving part 261 positioned in the first display region 210 and a second driving part 262 positioned in the second display region 220, the plurality of first driving units 216 may be disposed in the first driving part 261, and the plurality of second driving units 226 may be disposed in the second driving part 262.

The driving unit may adopt one of driving circuits such as 2T1C, 5T1C, 7T1C, and the like. For example, the first driving unit 216 may adopt one of 2T1C, 5T1C, and 7T1C, and the second driving unit 226 may adopt one of 2T1C, 5T1C, and 7T 1C. Where T denotes a thin film transistor and C denotes a capacitor. In order to improve the light transmittance of the first display region 210, the first driving unit 216 disposed in the first display region 210 may be a simpler driving circuit than the second driving unit 226 disposed in the second display region 220, for example, the first driving unit 216 may include fewer thin film transistors than the second driving unit 226. For example, the first driving unit 216 may adopt one of 2T1C and 5T1C, and the second driving unit 226 may adopt 7T 1C. The number of the opaque tfts in the first driving unit 216 is smaller, and the number of the opaque portions in the first display region 210 is smaller, so that the light transmittance of the first display region 210 can be improved.

In order to make the light transmittance of the first display region 210 greater than that of the second display region 220, the first driving unit 216 of the display device 20 that drives the first display region 210 may be disposed outside the first display region 210 in the embodiment of the present application. For example, the first driving unit 216 for driving the first display area 210 is disposed in a driving layer structure of the display device 20 for driving the second display area 220, the first driving unit 216 for driving the first display area 210 is disposed at a side or a periphery of the display device 20, the first driving unit 216 for driving the first display area 210 is disposed in a non-display area of the display device 20, for example, a double-layer driving layer structure is disposed in the display device 20, and the first driving unit 216 for driving the first display area 210 is disposed in a driving layer structure corresponding to the second display area 220 by using a via hole.

Referring to fig. 4, fig. 4 is a partial schematic view of the display device shown in fig. 2. The first pixels 211 of the first display region 210 and the second pixels 221 of the second display region 220 may be arranged in the same manner, or the first display region 210 and the second display region 220 may have the same pixel arrangement. It should be noted that the resolution of the first display area 210 is higher than that of the second display area 220. Specifically, the sizes of the first pixels 211 of the first display region 210 and the second pixels 221 of the second display region 220 may be set to be different, and the size of the first pixels 211 of the first display region 210 is larger than the size of the second pixels 221 of the second display region 220, so that the number of the first pixels 211 included in the first display region 210 having the same area is smaller than the number of the second pixels 221 included in the second display region 220 having the same area. That is, the distribution density of the first pixels of the first display region 210 is less than the distribution density of the second pixels of the second display region 220. It should be noted that fig. 4 only shows a part of the pixels of the display device 20, and the area formed by the arrangement of the first pixels 211 and the area formed by the arrangement of the second pixels 221 shown in fig. 4 are substantially the same in size.

The first display region 210 may have a plurality of first pixel sets 212, and each of the first pixel sets 212 may include a plurality of first pixels 211 connected in parallel. Therein, one first set of pixels 212 may comprise at least two first pixels 211, which may comprise at least two first pixels 211 of the same color, such as first pixels 211 of red. One first set of pixels 212 may also comprise at least two different colored first pixels 211, such as red first pixels 211 and green first pixels 212. The first pixels 211 in one first pixel set 212 may be connected together by a plurality of signal lines, which may be made of a light-transmitting material.

Referring to fig. 5, fig. 5 is another partial schematic view of the display device shown in fig. 2. Fig. 5 illustrates a plurality of first driving units 216 of the first display area 210 and a plurality of second driving units 226 of the second display area 220. Each first driving unit 216 may be electrically connected to one first pixel set 212, and one first driving unit 216 may drive one first pixel set 212, that is, one first driving unit 216 may drive all first pixels 211 in one first pixel set 212. Each of the second driving units 226 may be electrically connected to one of the second pixels 221, and one of the second driving units 226 may drive one of the second pixels 221. Compared with one driving unit driving one pixel, in the embodiment of the present application, a plurality of first pixels 211 are connected in parallel to form one first pixel set 212, and all the first pixels 211 in one first pixel set 212 are driven by one first driving unit 216, so that the number of the first driving units 216 can be reduced. The embodiment of the present application may dispose the first driving unit 216 in the first display area 210 such as the first driving part 261, and the embodiment of the present application may also dispose the first driving unit 216 in the second display area 220 such as the second driving part 262. Since the driving of the plurality of first pixels 211 in the first display region 210 can be achieved by using fewer first driving units 216, the light transmittance of the first display region 210 can be further improved. It should be noted that fig. 5 only shows a part of the first driving unit 216 and a part of the second driving unit 226 of the display device 20, and the area formed by the arrangement of the first driving unit 216 and the area formed by the arrangement of the second driving unit 226 shown in fig. 5 are substantially the same in size.

Referring to fig. 6, fig. 6 is another schematic structural diagram of a display device according to an embodiment of the present disclosure. The display device 20 may also include a third display area 230, which may also be referred to as a transition area. The third display region 230 may connect the first display region 210 and the second display region 220, and the third display region 230 may be disposed between the first display region 210 and the second display region 220. In this embodiment, the third display area 230 may separate the first display area 210 from the second display area 220, so that the first display area 210 is not directly connected to the second display area 220. In the embodiment of the present application, the third display area 230 may also connect a portion of the first display area 210 and a portion of the second display area 220, and the other portion of the first display area 210 and the second display area 220 may also be directly connected. The size of the third display region 230 may be much smaller than the size of the second display region 220, and the first display region 210 and the third display region 230 may together form an auxiliary display region of the display device 20, where the first display region 210 and the third display region 230 may be defined as an auxiliary display region, or a sub-screen region.

Referring to FIG. 7, FIG. 7 is a cross-sectional view of the display device shown in FIG. 6 taken along the direction P2-P2. The display layer 250 may further include a third display portion 253 located in the third display region 230. The third display portion 253 may have a plurality of third pixels 231 arranged therein, and the arrangement of the third pixels 231 may be one of a standard RGB arrangement, a Pentile arrangement, and a Delta arrangement, but the third pixels 231 may have another arrangement. The driving layer 260 may further include a third driving portion 263, and the third driving portion 263 may include a plurality of driving units, such as the third driving portion 263 includes a plurality of third driving units, one third driving unit may be electrically connected to one third pixel 231, and one third driving unit may drive one third pixel 231. The third driving unit may adopt one of 2T1C, 5T1C, 7T1C, for example, the third driving unit adopts 5T 1C. In the embodiment of the present application, the first display area 210 may adopt 2T1C, the second display area 220 may adopt 7T1C, and the third display area 230 may adopt 5T1C, so that the quality of the display image of the second display area 220 is higher than that of the display image of the third display area 230, and the quality of the display image of the third display area 230 is higher than that of the display image of the first display area 210, thereby enabling the transition between the first display area 210 and the second display area 220 to be presented.

Of course, the driving manner of the first display region 210, the second display region 220, and the third display region 230 is not limited thereto. For example, the first display area 210 and the third display area 230 both adopt 5T1C, and the second display area 220 adopts 7T 1C.

Referring to fig. 8, fig. 8 is a first partial schematic view of the display device shown in fig. 6. The arrangement of the third pixels 231 of the third display region 230 may be the same as the arrangement of the second pixels 221 of the second display region 220 or the first pixels 211 of the first display region 210, and the arrangement of the third pixels 231 of the third display region 230 may also be different from the arrangement of the second pixels 221 of the second display region 220 or the first pixels 211 of the first display region 210. It should be noted that the resolution of the third display area 230 is higher than the resolution of the first display area 210 and lower than the resolution of the second display area 220, so that the transition from the first display area 210 to the third display area 230 to the second display area 220 is natural. Specifically, the sizes of the first pixels 211 of the first display area 210, the second pixels 221 of the second display area 220, and the third pixels 231 of the third display area 230 may be set to be different, and the size of the third pixels 231 of the third display area 230 is smaller than the size of the first pixels 211 of the first display area 210 and larger than the size of the second pixels 221 of the second display area 220, so that the number of the third pixels 231 included in the third display area 230 of the same area is greater than the number of the first pixels 211 included in the first display area 210 of the same area and less than the number of the second pixels 221 included in the second display area 220 of the same area. Fig. 8 only shows a part of the pixels of the display device 20, and the size of the region formed by the arrangement of the first pixels 211, the region formed by the arrangement of the second pixels 221, and the region formed by the arrangement of the third pixels 231 shown in fig. 8 is substantially the same.

In the embodiment of the present application, all the first driving units 216 for driving the first display area 210 may be disposed in the third display area 230, such as disposing the first driving units 216 in the third driving portion 263, so that the driving layer structure of the first display area 210 does not have the first driving units 216, such as the first driving portion 261 of the first display area 210 does not have thin film transistors, thereby greatly improving the light transmittance of the first display area 210. Meanwhile, other problems caused by the arrangement of the first driving units 216 in the first display area 210, such as diffraction problem caused by the imaging of the first driving units 216 arranged periodically to the camera 30 and stray light problem caused by the imaging of the first driving units 216 to the camera 30 by reflection and refraction, can be avoided.

It should be noted that, since the third display area 230 is provided with a plurality of third driving units, and the plurality of third driving units occupy the space of the third driving portion 263, the first driving unit 216 provided in the third driving portion 263 of the embodiment of the present application also occupies the space of the third driving portion 263, and the wiring also occupies the space of the third driving portion 263. In order to ensure that the first driving unit 216 can be disposed at the third driving part 263, the wiring of the third driving part 263 can be made thinner to reduce the occupation of a single signal line to a space to accommodate the arrangement of more signal lines. Of course, in the embodiment of the present application, the first driving unit 216 may be disposed in the third driving portion 263 without changing the thickness of the wiring in the third driving portion 263, and the wiring may be satisfied, for example, the number of the third driving units in the third display area 230 is reduced.

It is understood that the execution subject of the embodiment of the present application may be an electronic device such as a smart phone or a tablet computer.

Referring to fig. 9, fig. 9 is a schematic flowchart of an image processing method according to an embodiment of the present disclosure. The image processing method can be applied to electronic equipment. The flow of the image processing method may include:

101. a plurality of first pixels at the position where the first display area is adjacent to the second display area are obtained.

In the related art, dividing a display screen of an electronic device into a main screen area and a sub screen area, improving light transmittance of the sub screen area, and arranging elements such as a front camera and a proximity sensor below the sub screen area so that the elements such as the front camera and the proximity sensor can transmit optical signals through the sub screen area are the most effective method for realizing a full screen.

In the current technical scheme of under-screen image pickup, the gap is increased by reducing pixels or changing the pixel arrangement, so that the transmitted light quantity is increased. Based on the design, the pixel structures and the pixel arrangement of the lower image pick-up area of the auxiliary screen and the main screen are different, so that two areas which are obvious can be seen when the whole screen is displayed, and the contrast is stronger in the transition area. An obvious boundary exists at the boundary of a main screen and an auxiliary screen of the electronic equipment, and due to the fact that pixel structures on two sides of the main screen and the auxiliary screen are completely different and the obvious boundary, a transition line phenomenon can occur during display.

In addition, when the display algorithm is called, the display algorithm of the auxiliary screen area is real RGB display, and different from the mode that the main screen area adopts the sub-pixel rendering algorithm, the factors can cause obvious transition areas on the left side and the right side, and when the image is displayed, the appearance of the transition areas is more obvious. In addition, there is a defect in the pixels on the boundary (i.e., the transition area), resulting in poor display effect of the display screen. Needs to be optimized by methods and means.

It should be noted that, in this embodiment of the present application, the electronic device includes a display device, the display device includes a first display area and a second display area, the second display area is adjacent to the first display area, the first display area includes a plurality of first pixels, the second display area includes a plurality of second pixels, and a distribution density of the first pixels is smaller than a distribution density of the second pixels, where the first display area serves as a sub-screen area, and the second display area serves as a main screen area. Such as the display device 20 of fig. 1-8.

Since the first display area is adjacent to the second display area, the adjacent position of the first display area and the second display area is the boundary of the first display area and the second display area, and can also be understood as a transition area between the first display area and the second display area, and the adjacent position of the first display area and the second display area includes both the first pixel and the second pixel. The overall distribution density of the first pixels and the second pixels at the adjacent positions is different from that of the first pixels positioned in the first display area and is also different from that of the second pixels positioned in the second display area. Generally, the overall distribution density of the first pixels and the second pixels at the adjacent positions is greater than that of the first pixels of the first display area and less than that of the second pixels of the second display area.

In this embodiment of the application, the electronic device may obtain a plurality of first pixels at a position where the first display area is adjacent to the second display area, that is, all first pixels at a boundary of the first display area and the second display area. When the plurality of first pixels at the adjacent position of the first display area and the second display area are acquired, the plurality of first pixels can be acquired through an application program installed on the electronic equipment, an operating system of the electronic equipment, or an application program embedded in the operating system of the electronic equipment.

102. And splitting the plurality of first pixels at the adjacent positions into a preset number of virtual pixels respectively.

For example, after acquiring a plurality of first pixels at the adjacent position of the first display area and the second display area,each first pixel at the adjacent position is split into a preset number of virtual pixels, which can be understood as that the first pixel at the adjacent position in the first display area is split into a preset number of virtual small pixels, that is, the large pixel is split into small pixels for processing. For example, the preset number may be 4, and it can be considered that each first pixel at the adjacent position can be split into 4 small pixels by simulation, and the first pixels are multiplied by 4 different distance factors K respectively_iTo characterize the simulated 4 small pixels. It can be understood that, in other possible implementations, the preset number may be adjusted accordingly according to specific requirements, and the specific size of the preset number is not limited in the embodiment of the present application.

103. And acquiring a plurality of second pixels at the adjacent part of the first display area and the second display area.

For example, after splitting the plurality of first pixels at the adjacent positions into the preset number of virtual pixels, the electronic device obtains a plurality of second pixels at the adjacent positions of the first display area and the second display area, that is, all the second pixels at the boundary between the first display area and the second display area, and may also be understood as all the second pixels located at the adjacent positions in the second display area. When the plurality of second pixels at the adjacent positions of the first display area and the second display area are acquired, the plurality of second pixels can be acquired through an application program installed on the electronic device, an operating system of the electronic device, or an application program embedded in the operating system of the electronic device.

104. And performing pixel rendering on the plurality of second pixels and the virtual pixels at the adjacent positions by using a preset pixel rendering algorithm.

For example, the second pixels and the virtual pixels at the adjacent positions are subjected to pixel rendering by using a preset pixel rendering algorithm. For example, the pre-defined pixel rendering algorithm may be an SPR algorithm, by which the same resolution display may be achieved with fewer sub-pixels. For example, 6 sub-pixels are needed for the original 2 pixels, and 4 sub-pixels are needed after the SPR algorithm is used, so that the physical sub-pixels of the display screen with the same resolution are only 2/3 after the SPR algorithm is used. The display effect of 6 sub-pixels is achieved by 4 sub-pixels, and based on the three-color principle, the color must be borrowed from the sub-pixels beside the display device. Referring to fig. 10, fig. 10 is a schematic diagram illustrating an arrangement of sub-pixels processed by using the SPR algorithm according to an embodiment of the present disclosure. It will be understood that each pixel is made up of 2 sub-pixels arranged periodically in "red + green" or "green + blue" or "blue + red" order.

For example, referring to fig. 11 to 14, fig. 11 is a schematic diagram of an RGB stripe arrangement structure in the related art. Fig. 12 is a schematic diagram of an RGBG arrangement structure in the related art. Fig. 13 is a schematic diagram of an RGB Delta arrangement structure in the related art. Fig. 14 is a schematic diagram showing a comparison of the three pixel arrangement structures in fig. 11, 12 and 13. Where H is the number of horizontal direction pixels and V is the number of vertical direction pixels. It can be seen that, in the RGB spine arrangement structure, each pixel is composed of 3 sub-pixels, and in the RGBG arrangement structure and the RGB Delta arrangement structure processed by the SPR algorithm, each pixel is composed of only 2 sub-pixels. For the RGB Delta arrangement, 1/3 subpixels are saved per pixel, and for the RGBG arrangement, 1/3 subpixels are saved per pixel, with each pixel containing a subpixel for either the RG or BG components. If the RGBG or RGB Delta arrangement is to achieve the same resolution as the RGB stripe arrangement, then the SPR algorithm is used to borrow color from the adjacent sub-pixels. As can be seen from the comparison in fig. 14, the number of sub-pixels can be reduced by the processing method of the SPR algorithm, and the difficulty of the manufacturing process can be reduced. The design complexity of the driving chip can be reduced, thereby reducing the cost. In practical applications, it is necessary to design an appropriate SPR driving algorithm according to a specific arrangement structure to reduce or eliminate the problems of resolution reduction and color aliasing caused by the reduction of sub-pixels.

For example, if the pixel arrangement structure of the image data is a Real RGB arrangement structure, the resolution of the display image of the display screen is equal to the resolution of the Real RGB arrangement structure, the sub-pixels of the display image of the display screen may correspond to the sub-pixels in the Real RGB arrangement structure one to one, and the display screen may normally display the image data. In the SPR arrangement, the image data is processed by sub-pixel through the SPR algorithm, and then the display screen can normally display the image data.

In the embodiment of the application, an SPR algorithm is used at the adjacent position between the first display area and the second display area, and a first pixel (which may be regarded as a large pixel) located at the adjacent position in the first display area and a second pixel (which may be regarded as a small pixel) located at the adjacent position in the second display area are subjected to approximate SPR algorithm processing. Therefore, the problem that lines of main screens and auxiliary screens of the full-screen electronic equipment with the camera under the screen are obvious can be solved.

It should be noted that, for both sides of the adjacent position of the first display area and the second display area, that is, the edge of the first display area and the edge of the second display area, the main and sub-screen images are still processed according to the normal SPR algorithm, that is, the first pixels at the edge of the first display area are independently processed according to the normal SPR algorithm without performing pixel simulation splitting on the main and sub-screen images, and the second pixels at the edge of the second display area are independently processed according to the normal SPR algorithm on the main and sub-screen images.

For example, in one embodiment, the adjacent portion may include an adjacent line, where the boundary between the first display area and the second display area is an adjacent line, which means that the transition area between the first display area and the second display area is narrower and is an adjacent line. The plurality of first pixels at the position where the first display area and the second display area are adjacent, which is acquired by the electronic device in step 101, are the plurality of first pixels on the adjacent line, and the plurality of second pixels at the position where the first display area and the second display area are adjacent, which is acquired by the electronic device in step 103, are the plurality of second pixels on the adjacent line.

For example, in an embodiment, the adjacent portion includes a third display area, where a boundary between the first display area and the second display area is the third display area, which indicates that a transition area between the first display area and the second display area is slightly wider and is an area with a certain width, the third display area includes a plurality of third pixels, a distribution density of the third pixels is greater than a distribution density of the first pixels in the first display area and less than a distribution density of the second pixels in the second display area, and the plurality of third pixels include the first pixels and the second pixels, that is, the pixels in the third display area include both the first pixels and the second pixels. The plurality of first pixels acquired by the electronic device in step 101 where the first display area and the second display area are adjacent are the plurality of first pixels in the third display area, and the plurality of second pixels acquired by the electronic device in step 103 where the first display area and the second display area are adjacent are the plurality of second pixels in the third display area.

Referring to fig. 15, fig. 15 is another schematic flow chart of an image processing method according to an embodiment of the present disclosure. The image processing method can be applied to electronic equipment. The flow of the image processing method may include:

201. a plurality of first pixels at the position where the first display area is adjacent to the second display area are obtained.

For example, when the adjacent position of the first display area and the second display area is an adjacent line, a plurality of first pixels at the adjacent line are acquired, or when the adjacent position of the first display area and the second display area is a third display area, a plurality of first pixels in the third display area are acquired. The specific implementation of step 201 can refer to the embodiment of step 101, and is not described herein again.

202. And multiplying the plurality of first pixels at the adjacent positions by different distance factors with preset numbers respectively to obtain virtual pixels with preset numbers respectively.

For example, the preset number is 4, that is, each first pixel in the adjacent line or the third area can be split into 4 analog pixels, and 4 different distance factors are respectively represented as K₁、K₂、K₃、K₄Then one of the first pixels is multiplied by K₁、K₂、K₃、K₄Then 4 analog pixels are obtained into which the first pixel is split.

For example, in an embodiment, the multiplying the plurality of first pixels at the adjacent positions by a preset number of different distance factors to obtain a preset number of virtual pixels respectively may include:

respectively acquiring sub-pixels of a plurality of first pixels at adjacent positions;

and multiplying the sub-pixels of the plurality of first pixels at the adjacent positions by different distance factors with preset numbers respectively to obtain sub-pixels of virtual pixels with preset numbers respectively.

For example, each pixel has sub-pixels, such as: the red sub-pixel R, the green sub-pixel G and the blue sub-pixel B, for the first pixels at the adjacent positions, generally 1 first pixel is composed of 2 sub-pixels, such as: according to the red sub-pixel R₁And green sub-pixel G₁Green sub-pixel G₁+ blue sub-pixel B₁Blue sub-pixel B₁+ red subpixel R₁Arranged periodically in equal sequence. The sub-pixels of each first pixel at the adjacent position are respectively multiplied by different distance factors with a preset number, for example, when the preset number is 4, for the first pixel at the adjacent position, it can be generally considered as 4-in-1, that is, approximately 4 sub-pixels are combined into 1 large sub-pixel, so that the 4 sub-pixels that should exist originally can be respectively characterized by the large sub-pixel plus a distance factor Ki, that is, a large sub-pixel is multiplied by 4 different distance factors, to approximately characterize a virtual sub-pixel.

For example, the red sub-pixel R in the first pixel₁And green sub-pixel G₁By 4 different distance factors, e.g. K₁R₁、K₂R₁、K₃R₁、K₄R₁，K₁G₁、K₂G₁、K₃G₁、K₄G₁This results in 4 sub-pixels of virtual pixels, where the sub-pixel of the first virtual pixel is K₁R₁And K₁G₁The sub-pixel of the second virtual pixel is K₂R₁And K₂G₁The sub-pixel of the third virtual pixel is K₃R₁And K₃G₁The sub-pixel of the fourth virtual pixel is K₄R₁And K₄G₁. Or, the green sub-pixel G in the first pixel₁And blue sub-pixel B₁Multiply by 4 different distances respectivelyFrom the factor, K can be obtained in the same way₁G₁、K₂G₁、K₃G₁、K₄G₁，K₁B₁、K₂B₁、K₃B₁、K₄B₁Wherein, the sub-pixel of the first virtual pixel is K₁G₁And K₁B₁The sub-pixel of the second virtual pixel is K₂G₁And K₂B₁The sub-pixel of the third virtual pixel is K₃G₁And K₃B₁The sub-pixel of the fourth virtual pixel is K₄G₁And K₄B₁Or, the blue sub-pixel B in the first pixel₁And a red sub-pixel R₁Multiplying by 4 different distance factors respectively to obtain K₁B₁、K₂B₁、K₃B₁、K₄B₁，K₁R₁、K₂R₁、K₃R₁、K₄R₁Wherein, the sub-pixel of the first virtual pixel is K₁B₁And K₁R₁The sub-pixel of the second virtual pixel is K₂B₁And K₂R₁The sub-pixel of the third virtual pixel is K₃B₁And K₃R₁The sub-pixel of the fourth virtual pixel is K₄B₁And K₄R₁。

In one embodiment, the distance factor K_iIs the product of the coefficient and the distance, wherein the distance is the distance between the current sub-pixel and the target sub-pixel, and the target sub-pixel is a virtual sub-pixel, e.g., the coefficient is k_iIs a coefficient of_iIs the distance between the current sub-pixel and the i-th virtual sub-pixel, i.e. K_i＝k_i×l_i。

Since 1 first pixel is generally composed of 2 sub-pixels for the first pixels at the adjacent positions, a large sub-pixel is virtualized into 4 small sub-pixels, that is, the information of the 4 virtual sub-pixels is retained on the large sub-pixel through the conversion, so that the information of the removed sub-pixel can be retained on the large sub-pixel through the distance conversion, and the large sub-pixel retains the information of other sub-pixels which have been removed in the process of displaying, and the condition of information loss can not occur.

203. And acquiring sub-pixels of a plurality of second pixels at the adjacent positions of the first display area and the second display area.

For example, when the adjacent position of the first display area and the second display area is an adjacent line, a plurality of second pixels at the adjacent line are acquired, or when the adjacent position of the first display area and the second display area is a third display area, a plurality of second pixels in the third display area are acquired. The specific implementation of step 203 can refer to the embodiment of step 101, and is not described herein again.

204. And performing pixel rendering on the sub-pixels of the plurality of second pixels and the sub-pixels of the virtual pixels at the adjacent positions by using a preset pixel rendering algorithm.

For example, wherein the sub-pixel of the second pixel is a red sub-pixel R₂Green sub-pixel G₂And blue sub-pixel B₂Since the first pixel and the second pixel are located at the adjacent positions, when the first pixel and the second pixel are called after the first pixel at the adjacent positions are split into the virtual pixels, the virtual sub-pixels and the sub-pixels of the second pixel corresponding to the adjacent positions are called and are subjected to SPR algorithm processing, namely, the information of the pixel at the central position is displayed by the surrounding pixels, each first pixel corresponds to the RGB sub-pixels after the pixels are borrowed, and the screen can normally display image data.

For example, referring to fig. 16, fig. 16 is a schematic diagram of a sub-pixel rendering algorithm, i.e., a schematic diagram of an SPR algorithm, according to an embodiment of the present disclosure. The 9 RGB pixels in the nine-square grid may be the second pixel in the adjacent position, or may be the analog pixel after the simulation of the first pixel in the adjacent position, the sub-pixels are not specifically displayed, the display information of the pixel No. 5 in the figure is obtained by distance conversion of the information to be displayed by the pixel No. 5 through the conversion of the pixels No. 1, No. 2, No. 3, No. 4, No. 6, No. 7, No. 8 and No. 9 through the information of other peripheral pixels, and the sub-pixels of the peripheral pixels are linked in the display process, so that the relatively smooth display effect can be realized. The formula is as follows

Where k represents the coefficient, l represents the distance, R represents the red sub-pixel or red component, G represents the green sub-pixel or green component, and B represents the blue sub-pixel or blue component. For example, |₁Represents the distance between pixel No. 5 and pixel No. 1, l₂Represents the distance between pixel No. 5 and pixel No. 2, l₃Represents the distance between pixel No. 5 and pixel No. 3, l₄Represents the distance between pixel No. 5 and pixel No. 4, l₆Represents the distance between pixel No. 5 and pixel No. 6, l₇Represents the distance between pixel No. 5 and pixel No. 7, l₈Represents the distance between pixel No. 5 and pixel No. 8, l₉Represents the distance between pixel No. 5 and pixel No. 9, R₁Red sub-pixel or red component representing pixel number 1, G₁Green sub-pixel or green component representing pixel No. 1, B₁Representing the blue sub-pixel or blue component of pixel No. 1, and so on.

And calling the sub-pixels of the second pixels at the adjacent positions and the sub-pixels of the analog pixels split by the first pixels at the adjacent positions through the formula, and performing the accumulation and calling of an SPR algorithm on the sub-pixels of the second pixels at the adjacent positions and the sub-pixels of the analog pixels split by the first pixels at the adjacent positions, wherein the process is a virtual calculation process. By the formula, the information of the pixel at the central position is displayed by the surrounding pixels. The information of all 9 pixel points is retained in the No. 5 pixel, and the image is generated by the effect of multi-pixel coaction, so that the image is slightly blurred macroscopically by adopting the processing mode, but the information is retained. Therefore, the image information can be retained and the display effect can be optimized by the above-mentioned processing.

Referring to fig. 17, fig. 17 is a schematic view of a scenario processed by an SPR algorithm according to an embodiment of the present disclosure. As can be seen from fig. 17, pixel usage can be reduced after the SPR algorithm processing, red and blue sub-pixels in each pixel are reduced, and the sub-pixel arrangement is arranged according to the RGBG arrangement structure.

Referring to FIG. 18, FIG. 18 is a partial schematic diagram of an SPR algorithm according to embodiments of the present application, and FIG. 8 is a partial diagram of only a portion of the SPR algorithm, in practice, having a plurality of rows and columns. The upper two rows are the arrangement structure before pixel borrowing, and the lower two rows are the arrangement structure after pixel borrowing, namely the arrangement structure of the lower two rows can be obtained after the upper two rows pass the pixel borrowing. After the pixels are borrowed, each pixel can comprise RGB sub-pixels, and the screen can normally display images. In practical applications, the arrangement structure of the first pixels in the first display area may be various, and for different arrangement structures, an appropriate SPR algorithm may be designed to reduce or eliminate the problems of resolution reduction and color aliasing caused by sub-pixel reduction.

In the embodiment of the application, in the scheme of shooting under the screen, due to the fact that devices and pixel structures in the main and auxiliary screen areas and the pixel arrangement design are not consistent, the main and auxiliary screens have obvious transition lines in the display process. The embodiment of the application aims at the transition area, sub-pixels of the main and auxiliary screen areas at the adjacent positions are extracted by utilizing an SPR algorithm, an RGB pixel method is formed by pixels at two sides of the transition area, and the adjacent positions are displayed by mutual borrowing among the sub-pixels, so that the overall consistency of screen display is kept, the transition area between the main and auxiliary screens is eliminated or weakened, the consistency of main and auxiliary screen display is realized, and the display effect is improved.

Referring to fig. 19, fig. 19 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present disclosure. The image processing apparatus may be applied to an electronic device including a display apparatus including a first display region and a second display region, the second display region being adjacent to the first display region, the first display region including a plurality of first pixels, the second display region including a plurality of second pixels, a distribution density of the first pixels being smaller than a distribution density of the second pixels. The image processing 300 may include: a first acquisition module 301, a splitting module 302, a second acquisition module 303, and a rendering module 304.

A first obtaining module 301, configured to obtain a plurality of first pixels at a position where the first display area is adjacent to the second display area;

a splitting module 302, configured to split the plurality of first pixels at the adjacent positions into a preset number of virtual pixels, respectively;

a second obtaining module 303, configured to obtain a plurality of second pixels where the first display area is adjacent to the second display area;

a rendering module 304, configured to perform pixel rendering on the plurality of second pixels and the virtual pixel at the adjacent position by using a preset pixel rendering algorithm.

In one embodiment, the splitting module 302 is configured to: and multiplying the plurality of first pixels at the adjacent positions by different distance factors with preset numbers respectively to obtain virtual pixels with preset numbers respectively.

In one embodiment, the splitting module 302 is configured to: respectively acquiring sub-pixels of a plurality of first pixels at the adjacent positions; and multiplying the sub-pixels of the plurality of first pixels at the adjacent positions by different distance factors with preset numbers respectively to obtain the sub-pixels of the virtual pixels with the preset numbers respectively.

In one embodiment, the second obtaining module 303 is configured to: and acquiring sub-pixels of a plurality of second pixels at the adjacent position of the first display area and the second display area.

In one embodiment, the rendering module 304 is configured to: and performing pixel rendering on the sub-pixels of the plurality of second pixels at the adjacent positions and the sub-pixels of the virtual pixels by using a preset pixel rendering algorithm.

In one embodiment, the predetermined number is 4.

In one embodiment, the distance factor is a product of a coefficient and a distance, and the distance is a distance between the current sub-pixel and the target sub-pixel.

In one embodiment, the abutment comprises a line of abutment.

In one embodiment, the adjacent area includes a third display area including a plurality of third pixels, the third pixels having a distribution density greater than a distribution density of the first pixels in the first display area and less than a distribution density of the second pixels in the second display area, the plurality of third pixels including the first pixels and the second pixels.

The present embodiment provides a computer-readable storage medium, on which a computer program is stored, which, when executed on a computer, causes the computer to execute the flow in the image processing method provided by this embodiment.

The embodiment of the present application further provides an electronic device, which includes a memory and a processor, where the processor is configured to execute the flow in the image processing method provided in this embodiment by calling the computer program stored in the memory.

For example, the electronic device may be a mobile terminal such as a tablet computer or a smart phone. Referring to fig. 20, fig. 20 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

The electronic device 400 may include a camera module 401, a memory 402, a processor 403, and the like. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 20 does not constitute a limitation of the electronic device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The camera module 401 is disposed in the electronic device and is configured to acquire an external light signal passing through the first display area to form an image.

The memory 402 may be used to store applications and data. The memory 402 stores applications containing executable code. The application programs may constitute various functional modules. The processor 403 executes various functional applications and data processing by running an application program stored in the memory 402.

The processor 403 is a control center of the electronic device, connects various parts of the whole electronic device by using various interfaces and lines, and performs various functions of the electronic device and processes data by running or executing an application program stored in the memory 402 and calling data stored in the memory 402, thereby performing overall monitoring of the electronic device.

In this embodiment, the processor 403 in the electronic device loads the executable code corresponding to the processes of one or more application programs into the memory 402 according to the following instructions, and the processor 403 runs the application programs stored in the memory 402, so as to execute:

Referring to fig. 21, the electronic device 400 may include a camera module 401, a memory 402, a processor 403, a battery 404, a microphone 405, a speaker 406, and other components.

The battery 404 may be used to supply power to various modules and components of the electronic device.

Microphone 405 may be used to pick up acoustic signals in the surrounding environment, such as to receive voice commands from a user, etc.

The speaker 406 may be used to play sound signals.

In one embodiment, when the processor 403 performs the splitting of the plurality of first pixels at the adjacent position into the preset number of virtual pixels, it may perform: and multiplying the plurality of first pixels at the adjacent positions by different distance factors with preset numbers respectively to obtain virtual pixels with preset numbers respectively. The preset number may be 4, and the distance factor may be a product of a coefficient and a distance, where the distance is a distance between the current sub-pixel and the target sub-pixel.

Wherein, in one embodiment, the abutment may comprise an abutment line.

In another embodiment, the adjoining portion includes a third display area including a plurality of third pixels, the distribution density of the third pixels is greater than the distribution density of the first pixels in the first display area and less than the distribution density of the second pixels in the second display area, and the plurality of third pixels includes the first pixels and the second pixels.

In an embodiment, when the processor 403 executes the step of multiplying the plurality of first pixels at the adjacent position by different distance factors of a preset number respectively to obtain a preset number of virtual pixels, the following steps may be executed: respectively acquiring sub-pixels of a plurality of first pixels at the adjacent positions; and multiplying the sub-pixels of the plurality of first pixels at the adjacent positions by different distance factors with preset numbers respectively to obtain the sub-pixels of the virtual pixels with the preset numbers respectively.

In one embodiment, when the processor 403 executes the acquiring of the plurality of second pixels where the first display area is adjacent to the second display area, it may execute: and acquiring sub-pixels of a plurality of second pixels at the adjacent position of the first display area and the second display area.

In one embodiment, when the processor 403 performs pixel rendering on the plurality of second pixels at the adjacent position and the virtual pixel by using a preset pixel rendering algorithm, it may perform: and performing pixel rendering on the sub-pixels of the plurality of second pixels at the adjacent positions and the sub-pixels of the virtual pixels by using a preset pixel rendering algorithm.

In the above embodiments, the descriptions of the embodiments have respective emphasis, and parts that are not described in detail in a certain embodiment may refer to the above detailed description of the image processing method, and are not described herein again.

The image processing apparatus provided in the embodiment of the present application and the image processing method in the above embodiment belong to the same concept, and any method provided in the embodiment of the image processing method may be run on the image processing apparatus, and a specific implementation process thereof is described in the embodiment of the image processing method in detail, and is not described herein again.

It should be noted that, for the image processing method described in the embodiment of the present application, it can be understood by those skilled in the art that all or part of the process of implementing the image processing method described in the embodiment of the present application can be completed by controlling the relevant hardware through a computer program, where the computer program can be stored in a computer-readable storage medium, such as a memory, and executed by at least one processor, and during the execution, the process of the embodiment of the image processing method can be included. The storage medium may be a magnetic disk, an optical disk, a Read Only Memory (ROM), a Random Access Memory (RAM), or the like.

In the image processing apparatus according to the embodiment of the present application, each functional module may be integrated into one processing chip, each module may exist alone physically, or two or more modules may be integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium, such as a read-only memory, a magnetic or optical disk, or the like.

The foregoing detailed description has provided an image processing method, an image processing apparatus, a storage medium, and an electronic device according to embodiments of the present application, and specific examples are applied herein to explain the principles and implementations of the present application, and the descriptions of the foregoing embodiments are only used to help understand the method and the core ideas of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. An image processing method applied to an electronic device, wherein the electronic device includes a display device, the display device includes a first display area and a second display area, the second display area is adjacent to the first display area, the first display area includes a plurality of first pixels, the second display area includes a plurality of second pixels, and a distribution density of the first pixels is smaller than a distribution density of the second pixels, and the image processing method includes:

2. The image processing method according to claim 1, wherein the splitting the plurality of first pixels at the adjacency into a preset number of virtual pixels respectively comprises:

and multiplying the plurality of first pixels at the adjacent positions by different distance factors with preset numbers respectively to obtain virtual pixels with preset numbers respectively.

3. The image processing method according to claim 2, wherein the multiplying the plurality of first pixels at the adjacent positions by a preset number of different distance factors respectively to obtain a preset number of virtual pixels respectively comprises:

respectively acquiring sub-pixels of a plurality of first pixels at the adjacent positions;

and multiplying the sub-pixels of the plurality of first pixels at the adjacent positions by different distance factors with preset numbers respectively to obtain the sub-pixels of the virtual pixels with the preset numbers respectively.

4. The method according to claim 3, wherein the obtaining the plurality of second pixels where the first display area is adjacent to the second display area comprises:

and acquiring sub-pixels of a plurality of second pixels at the adjacent position of the first display area and the second display area.

5. The method according to claim 4, wherein the pixel rendering the plurality of second pixels of the neighborhood and the virtual pixel using a preset pixel rendering algorithm comprises:

and performing pixel rendering on the sub-pixels of the plurality of second pixels at the adjacent positions and the sub-pixels of the virtual pixels by using a preset pixel rendering algorithm.

6. The image processing method according to claim 1, wherein the preset number is 4.

7. The method according to claim 2, wherein the distance factor is a product of a coefficient and a distance, and the distance is a distance between the current sub-pixel and the target sub-pixel.

8. The image processing method according to claim 1, wherein the abutment comprises an abutment line.

9. The method according to claim 1, wherein the neighborhood includes a third display region including a plurality of third pixels having a distribution density greater than that of the first pixels in the first display region and less than that of the second pixels in the second display region, the plurality of third pixels including the first pixels and the second pixels.

10. An image processing apparatus applied to an electronic device, wherein the electronic device includes a display apparatus, the display apparatus includes a first display region and a second display region, the second display region is adjacent to the first display region, the first display region includes a plurality of first pixels, the second display region includes a plurality of second pixels, and a distribution density of the first pixels is smaller than a distribution density of the second pixels, the image processing apparatus includes:

11. A computer-readable storage medium, on which a computer program is stored, which, when executed on a computer, causes the computer to carry out the method according to any one of claims 1 to 9.

12. An electronic device comprising a memory, a processor and a camera module, wherein the processor is configured to execute the method according to any one of claims 1 to 9 by calling a computer program stored in the memory, and the camera module is disposed in the electronic device and configured to acquire an ambient light signal transmitted through the first display area for imaging.