CN113654459A - Method and device for determining position of photosensitive sensor under screen and storage medium - Google Patents

Method and device for determining position of photosensitive sensor under screen and storage medium Download PDF

Info

Publication number
CN113654459A
CN113654459A CN202110834126.9A CN202110834126A CN113654459A CN 113654459 A CN113654459 A CN 113654459A CN 202110834126 A CN202110834126 A CN 202110834126A CN 113654459 A CN113654459 A CN 113654459A
Authority
CN
China
Prior art keywords
screen
pixel
photosensitive sensor
row
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110834126.9A
Other languages
Chinese (zh)
Other versions
CN113654459B (en
Inventor
彭聪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN202110834126.9A priority Critical patent/CN113654459B/en
Publication of CN113654459A publication Critical patent/CN113654459A/en
Application granted granted Critical
Publication of CN113654459B publication Critical patent/CN113654459B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/22Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
    • G09G3/30Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels
    • G09G3/32Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED]
    • G09G3/3208Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED]

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Theoretical Computer Science (AREA)
  • Position Input By Displaying (AREA)

Abstract

The disclosure relates to a method and a device for determining the position of an under-screen photosensitive sensor and a storage medium. The method for determining the position of the under-screen photosensitive sensor comprises the following steps: controlling the terminal screen to respectively perform pixel row display and pixel column display, and determining the pixel row position and the pixel column position of the terminal screen where the photosensitive sensor monitors that the photosensitive data is greater than a preset data threshold; and determining the position of the photosensitive sensor under the screen based on the pixel row position and the pixel column position. The accurate position of the photosensitive sensor under the terminal screen can be determined through the method and the device.

Description

Method and device for determining position of photosensitive sensor under screen and storage medium
Technical Field
The present disclosure relates to the field of intelligent terminal technologies, and in particular, to a method and an apparatus for determining a position of an off-screen photosensor, and a storage medium.
Background
Currently, terminals such as mobile phones are often provided with sensors. The terminal comprises a sensor arranged on a terminal main board. In the related art, a connection method of a Flexible Printed Circuit (FPC) is generally used to install the sensor on the main board.
In the related art, the sensor is arranged in an FPC mode, so that the problem that the optimization precision of the sensor under the screen is reduced or the optimization is invalid exists.
Disclosure of Invention
To overcome the problems in the related art, the present disclosure provides a method and an apparatus for determining a position of an off-screen photosensor, and a storage medium.
According to a first aspect of the embodiments of the present disclosure, there is provided a method for determining a position of an off-screen photosensor, which is applied to a terminal, the method including:
controlling the terminal screen to respectively perform pixel row display and pixel column display, and determining the pixel row position and the pixel column position of the terminal screen where the photosensitive sensor monitors that the photosensitive data is greater than a preset data threshold; and determining the position of the photosensitive sensor under the screen based on the pixel row position and the pixel column position.
In one embodiment, controlling the terminal screen to perform pixel row display and pixel column display respectively includes: controlling the terminal screen to be displayed line by line from a first pixel line to a second pixel line in a preset line unit, wherein the first pixel line is an edge pixel line at a first side end of the terminal, and the second pixel line is an edge pixel line at a second side end opposite to the first side end; the terminal screen is controlled to be displayed in a row-by-row mode from a first pixel row to a second pixel row in a unit of a preset row, the first pixel row is an edge pixel row located at a third side end of the terminal screen, and the second pixel row is an edge pixel row located at a fourth side end opposite to the third side end; the first, second, third, and fourth lateral ends are different.
In one embodiment, controlling the terminal screen to perform pixel row display and pixel column display respectively includes: controlling a first pixel line of the terminal screen to display line by line in a preset line unit until the photosensitive data monitored by the photosensitive sensor under the screen is greater than a preset data threshold value, and controlling a second pixel line of the terminal screen to display line by line in the preset line unit until the photosensitive data monitored by the photosensitive sensor under the screen is greater than the preset data threshold value; and controlling the terminal screen to display the terminal screen in a row-by-row manner by using a third pixel row as a preset row unit, wherein the third pixel row is an edge pixel row at a third side end of the terminal screen until the photosensitive data monitored by the photosensitive sensor under the screen is greater than a preset data threshold value, controlling the terminal screen to display in a row-by-row manner by using a fourth pixel row as a preset row unit, and the fourth pixel row is an edge pixel row at a fourth side end opposite to the third side end until the photosensitive data monitored by the photosensitive sensor under the screen is greater than the preset data threshold value.
In one embodiment, determining the position of the off-screen photosensor based on the pixel row position and the pixel column position includes: determining edge vertex coordinates of an intersection pixel region formed between the pixel row positions and the pixel column positions; determining the size of a coordinate area surrounded by the edge vertex coordinates in the screen; and determining the position of the photosensitive sensor under the screen based on the size of the coordinate area and the size of the photosensitive sensor under the screen.
In one embodiment, determining the position of the off-screen photosensor based on the coordinate region size and the size of the off-screen photosensor includes: if the size of the coordinate area is the same as that of the photosensitive sensor under the screen, determining the coordinate area as the position of the photosensitive sensor under the screen; if the size of the coordinate area is different from that of the photosensitive sensor under the screen, the inclination angle of the photosensitive sensor under the screen relative to the coordinate area is determined based on the size of the coordinate area and the size of the photosensitive sensor under the screen, and the position of the photosensitive sensor under the screen is determined based on the inclination angle.
In one embodiment, determining the position of the off-screen photosensor based on the tilt angle includes: controlling the terminal screen to display the terminal screen in an oblique line by first pixels in an oblique line unit of a preset oblique line, wherein the first pixels are in an edge pixel oblique line at a first oblique side end of the terminal until the light sensing data monitored by the light sensing sensor under the screen is larger than a preset data threshold; determining a pixel diagonal position of a terminal, wherein the monitored photosensitive data of an under-screen photosensitive sensor is greater than a preset data threshold value, and determining the length corresponding to an intersection pixel line segment formed between the pixel diagonal position and the coordinate area; and if the length corresponding to the intersection pixel line segment is matched with the side length of the photosensitive sensor under the screen, determining the endpoint coordinate of the intersection pixel line segment as the vertex coordinate of the photosensitive sensor under the screen, and determining the position of the photosensitive sensor under the screen based on the vertex coordinate of the photosensitive sensor under the screen.
According to a second aspect of the embodiments of the present disclosure, there is provided an off-screen photosensor position determining apparatus for a terminal, the apparatus including:
the control unit is used for controlling the terminal screen to respectively perform pixel row display and pixel column display; the determining unit is used for determining the pixel row position and the pixel column position of the terminal when the under-screen photosensitive sensor monitors that the photosensitive data is larger than a preset data threshold value; and the position of the photosensitive sensor under the screen is determined based on the pixel row position and the pixel column position.
In one embodiment, the control unit controls the terminal screen to perform pixel row display and pixel column display respectively as follows: controlling the terminal screen to be displayed line by line from a first pixel line to a second pixel line in a preset line unit, wherein the first pixel line is an edge pixel line at a first side end of the terminal, and the second pixel line is an edge pixel line at a second side end opposite to the first side end; the terminal screen is controlled to be displayed in a row-by-row mode from a first pixel row to a second pixel row in a unit of a preset row, the first pixel row is an edge pixel row located at a third side end of the terminal screen, and the second pixel row is an edge pixel row located at a fourth side end opposite to the third side end; the first, second, third, and fourth lateral ends are different.
In one embodiment, the control unit controls the terminal screen to perform pixel row display and pixel column display respectively as follows: controlling a first pixel row of the terminal screen to display line by line in a preset line unit until the photosensitive data monitored by the under-screen photosensitive sensor is greater than a preset data threshold, and controlling a second pixel row of the terminal screen to display line by line in a preset line unit until the photosensitive data monitored by the under-screen photosensitive sensor is greater than a preset data threshold; and controlling the terminal screen to be displayed in a row-by-row manner by a third pixel row in a unit of a preset row, wherein the third pixel row is an edge pixel row at a third side end of the terminal, until the photosensitive data monitored by the photosensitive sensor under the screen is greater than a preset data threshold value, controlling the terminal screen to be displayed in a row-by-row manner by a fourth pixel row in a unit of the preset row, and the fourth pixel row is an edge pixel row at a fourth side end opposite to the third side end until the photosensitive data monitored by the photosensitive sensor under the screen is greater than the preset data threshold value.
In one embodiment, the determining unit determines the position of the off-screen photosensor based on the pixel row position and the pixel column position by: determining edge vertex coordinates of an intersection pixel area formed between the pixel row positions and the pixel column positions; determining the size of a coordinate area surrounded by the edge vertex coordinates in the screen; and determining the position of the photosensitive sensor under the screen based on the size of the coordinate area and the size of the photosensitive sensor under the screen.
In one embodiment, the determining unit determines the position of the off-screen photosensitive sensor based on the size of the coordinate area and the size of the off-screen photosensitive sensor in the following manner: if the size of the coordinate area is the same as that of the photosensitive sensor under the screen, determining the coordinate area as the position of the photosensitive sensor under the screen; if the size of the coordinate area is different from that of the photosensitive sensor under the screen, the inclination angle of the photosensitive sensor under the screen relative to the coordinate area is determined based on the size of the coordinate area and the size of the photosensitive sensor under the screen, and the position of the photosensitive sensor under the screen is determined based on the inclination angle.
In one embodiment, the determining unit determines the position of the off-screen photosensor based on the tilt angle in the following manner: controlling the terminal screen to display the terminal screen in a diagonal manner by a first pixel diagonal manner in a unit of a preset diagonal manner at the inclination angle, wherein the first pixel diagonal manner is an edge pixel diagonal manner at a first diagonal side end of the terminal until the photosensitive data monitored by the photosensitive sensor under the screen is larger than a preset data threshold value; determining a pixel diagonal position of a photosensitive sensor under a screen of the terminal, wherein the photosensitive data monitored by the photosensitive sensor is greater than a preset data threshold value, and determining the length corresponding to an intersection pixel line segment formed between the pixel diagonal position and the coordinate area; and if the length corresponding to the intersection pixel line segment is matched with the side length of the photosensitive sensor under the screen, determining the endpoint coordinate of the intersection pixel line segment as the vertex coordinate of the photosensitive sensor under the screen, and determining the position of the photosensitive sensor under the screen based on the vertex coordinate of the photosensitive sensor under the screen.
According to a third aspect of the embodiments of the present disclosure, there is provided an off-screen photosensor position determining apparatus including:
a processor; a memory for storing processor-executable instructions;
wherein the processor is configured to: the method for determining the position of the off-screen photosensitive sensor described in the first aspect or any one of the embodiments of the first aspect is performed.
According to a fourth aspect of the embodiments of the present disclosure, there is provided a storage medium having instructions stored therein, where the instructions when executed by a processor of a terminal enable the terminal to execute the method for determining a position of an off-screen photosensor according to the first aspect or any one of the embodiments of the first aspect.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: the method comprises the steps of controlling a terminal screen to respectively display pixel rows and pixel columns, determining the pixel row position and the pixel column position of a photosensitive sensor under the screen of the terminal, wherein the monitored photosensitive data of the photosensitive sensor under the screen is larger than a preset data threshold value, and determining the accurate position of the photosensitive sensor under the screen based on the pixel row position and the pixel column position.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a schematic view of a mounting position of an under-screen photosensor in the related art.
Fig. 2 is a schematic view of another mounting position of an under-screen photosensor in the related art.
FIG. 3 is a flow chart illustrating a method for determining the position of an off-screen photosensor according to one exemplary embodiment.
FIG. 4 is a flow chart illustrating another method of determining the position of an off-screen photosensor according to one exemplary embodiment.
FIG. 5 is a flow chart illustrating yet another method of determining the position of an off-screen light sensitive sensor according to an exemplary embodiment.
Fig. 6 is a diagram illustrating a control terminal screen displayed line by line in units of preset lines by a first pixel line according to an exemplary embodiment.
Fig. 7 is a diagram illustrating a control terminal screen that performs column-by-column display in units of preset columns from a first pixel column according to an exemplary embodiment.
FIG. 8 is a flowchart illustrating a method for determining the position of an off-screen photosensor based on pixel row positions and pixel column positions in accordance with an exemplary embodiment.
FIG. 9 is a diagram illustrating a method for determining a coordinate area enclosed by edge vertex coordinates in a screen according to an exemplary embodiment.
FIG. 10 is a diagram illustrating another exemplary determination of a coordinate area enclosed by edge vertex coordinates in a screen according to one illustrative embodiment.
FIG. 11 is a schematic diagram illustrating yet another exemplary method for determining a coordinate area enclosed by edge vertex coordinates in a screen according to an example embodiment.
FIG. 12 is a method flow diagram illustrating another method flow diagram for determining the position of an off-screen photosensor based on pixel row positions and pixel column positions in accordance with an exemplary embodiment.
FIG. 13 is a schematic diagram illustrating a method of determining a tilt angle of an off-screen light sensor relative to a coordinate area in accordance with an exemplary embodiment.
FIG. 14 is a flowchart illustrating a method for determining the position of an off-screen photosensor based on tilt angle, according to one exemplary embodiment.
FIG. 15 is an illustration of a pose of an off-screen light sensor within a coordinate region, shown in accordance with an exemplary embodiment.
FIG. 16 is a schematic diagram illustrating a pose of another off-screen light sensor within a coordinate region in accordance with an exemplary embodiment.
Fig. 17 is a diagram illustrating a control terminal screen for diagonal line-by-diagonal line display in units of preset diagonal lines by first pixel diagonal lines according to an exemplary embodiment.
Fig. 18 is a diagram illustrating another control terminal screen according to an exemplary embodiment, which is displayed in a diagonal line-by-diagonal line unit by first pixel diagonal lines.
FIG. 19 is a block diagram illustrating an off-screen photosensor position determining apparatus according to one exemplary embodiment.
FIG. 20 is a block diagram illustrating an apparatus for off-screen photosensor position determination according to one exemplary embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
In the drawings, the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The described embodiments are only a subset of the embodiments of the present disclosure, and not all embodiments. The embodiments described below with reference to the accompanying drawings are illustrative and intended to be illustrative of the present disclosure, and should not be construed as limiting the present disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any creative effort, shall fall within the protection scope of the present disclosure. Embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.
The method for determining the under-screen photosensitive sensor can be applied to a scene of detecting the position of the under-screen photosensitive sensor of the terminal. The under-screen light sensor may include a light sensor and other sensors having a light sensing function.
With the continuous development of full-screen mobile phones, more and more sensors under the screen come into the visual field of people. The photosensitive sensor under the screen is used as an important component of the terminal, and provides light sensing capability for the environment for the terminal.
In the related art, it is generally required to store the precise position of the photosensitive sensor in the main board in the terminal, so as to be used as a parameter when the terminal performs a related algorithm or an optimized setting. In the related art, an off-screen photosensor is generally mounted on a terminal main board. Moreover, because the terminal main board is usually made of hard materials, the photosensitive sensor under the screen can be installed at a certain accurate position in the main board in a hard connection mode. In the related art, a certain position can be determined in the main board, the under-screen photosensitive sensor is installed at the accurate position in a hard connection mode, and further, the position is stored in the terminal so as to meet the requirements of the terminal for carrying out related algorithms or optimizing settings.
In the related art, the FPC has advantages of thin thickness, light weight, flexibility, and high flexibility. In order to make the circuit arrangement and/or device distribution inside the terminal more flexible, the terminal motherboard is usually replaced by a hard motherboard with an FPC motherboard. In the related art, the FPC main board is made of a soft material, so that the under-screen photosensitive sensor cannot be installed at a certain accurate position in the main board, and the position of the under-screen photosensitive sensor stored in the terminal and the actual position of the under-screen photosensitive sensor can deviate. For example, if the off-screen photosensor is required to be installed at the position shown in fig. 1, the actual position where the off-screen photosensor is installed may be the position shown in fig. 2 because the terminal main board is the FPC main board. According to the method, the position of the under-screen photosensitive sensor stored by the terminal is different from the actual position of the under-screen photosensitive sensor, so that the accuracy of the terminal in executing the related algorithm is influenced, and even the optimal setting of the terminal is invalid.
The embodiment of the disclosure provides a method for determining a position of an under-screen photosensitive sensor, which is used for controlling a terminal screen to respectively perform pixel row display and pixel column display, and determining a pixel row position and a pixel column position of the under-screen photosensitive sensor, which monitor that photosensitive data is greater than a preset data threshold value, in the process. The precise position of the photosensitive sensor under the screen can be determined through the pixel row position and the pixel column position.
Fig. 3 is a flowchart illustrating an off-screen photosensor position determining method according to an exemplary embodiment, which is used in a terminal as shown in fig. 3, and includes the following steps.
In step S11, the terminal screen is controlled to perform pixel row display and pixel column display, and the pixel row position and the pixel column position where the under-screen photosensitive sensor of the terminal monitors that the photosensitive data is greater than the preset data threshold are determined.
The terminal screen may be, for example, a screen having pixel row display, pixel column display, and oblique pixel display capabilities, such as an Organic Light-Emitting Diode (OLED) screen. The light sensing data monitored by the light sensing sensor under the screen may be, for example, a pixel color (RGB) value of the terminal screen, or may also be a pixel brightness value of the terminal screen.
In an example, the preset data threshold may be a minimum value of the light sensing data, and of course, may also be a light sensing data value monitored by the light sensing sensor in a case that the terminal screen does not perform pixel display.
In step S12, the position of the off-screen photosensor is determined based on the pixel row position and the pixel column position.
The method for determining the position of the photosensitive sensor under the screen can determine the accurate position of the photosensitive sensor under the screen. Furthermore, the accurate position of the photosensitive sensor under the screen is stored in the terminal, so that the accuracy of the terminal in executing related algorithms and/or optimizing settings can be improved.
In the embodiment of the disclosure, the position of the photosensitive sensor under the screen is determined by a position detection mode. Therefore, compared with a mode that the photosensitive sensor under the screen is directly installed at a certain position in the main board and the position is used as the position of the photosensitive sensor under the screen, the method has higher accuracy.
In addition, the position of the photosensitive sensor under the screen is determined by the position detection mode. Therefore, the terminal provided with the FPC mainboard can acquire the accurate position of the photosensitive sensor under the screen, and the terminal provided with the hard material mainboard can acquire the more accurate position of the photosensitive sensor under the screen.
In the embodiment of the disclosure, a terminal screen can be controlled to perform pixel row display and pixel column display in different ways. As shown in fig. 6 and 7, the terminal may include a first side end, a second side end, a third side end, and a fourth side end. The first side end is opposite to the second side end, and the third side end is opposite to the fourth side end. Further, for convenience of description, the embodiment of the present disclosure refers to an edge pixel row at a terminal first side end as a first pixel row, an edge pixel row at a terminal second side end as a second pixel row, an edge pixel column at a terminal third side end as a first pixel column, and an edge pixel column at a terminal fourth side end as a first pixel column.
In one example, the terminal screen is controlled to perform pixel row display and pixel column display respectively, and two adjacent side ends (for example, a first side end and a third side end) may be selected from four side ends of the terminal. Further, the selected side end may be used as a start end (a first side end) of line-by-line display of the pixel rows or a start end (a third side end) of column-by-column display of the pixel columns, so as to control the pixel rows of the terminal screen to be displayed line-by-line and the pixel columns of the terminal screen to be displayed column-by-column.
Fig. 4 is a flowchart illustrating another method for determining a position of an off-screen photosensor according to an exemplary embodiment, and as shown in fig. 4, step S22 of the method for determining a position of an off-screen photosensor according to the embodiment of the present disclosure is similar to the method for executing step S12 shown in fig. 1, and is not repeated here.
In step S21, the control terminal screen performs line-by-line display from the first pixel line to the second pixel line in a preset line unit, performs line-by-line display from the first pixel column to the second pixel column in a preset column unit, and determines a pixel line position and a pixel column position where the under-screen photosensor of the terminal monitors that the sensitization data is greater than a preset data threshold.
In the embodiment of the disclosure, in the process of controlling the terminal screen to perform line-by-line display from the first pixel line to the second pixel line in the preset line unit and to perform line-by-line display from the first pixel column to the second pixel column in the preset column unit, the previously displayed pixel line or pixel column may be controlled to be in the off state, so that only the pixel line of the preset line or only the pixel column of the preset column is displayed at each time point in the process of performing pixel display on the terminal screen. The method may determine each pixel row and pixel column that intersects the off-screen photosensor and thereby determine the position of the off-screen photosensor.
In another example, the terminal screen is controlled to perform pixel row display and pixel column display respectively, and four side ends of the terminal may be respectively used as a start end of pixel row line-by-line display or a start end of pixel column line-by-column display, so as to control the pixel row line-by-line display of the terminal screen and control the pixel column line-by-column display of the terminal screen.
Fig. 5 is a flowchart illustrating a further method for determining a position of an off-screen photosensor according to an exemplary embodiment, and as shown in fig. 5, step S32 of the method for determining a position of an off-screen photosensor according to the embodiment of the present disclosure is similar to the method for executing step S12 shown in fig. 1, and is not repeated here.
In step S31, the control terminal screen performs line-by-line display on the first pixel line in units of preset lines until the sensed light data monitored by the off-screen light sensor is greater than a preset data threshold, and performs line-by-line display on the control terminal screen in units of preset lines on the second pixel line until the sensed light data monitored by the off-screen light sensor is greater than the preset data threshold. And controlling the terminal screen to display the third pixel column row by row in a preset column unit until the photosensitive data monitored by the photosensitive sensor under the screen is larger than a preset data threshold value, and controlling the terminal screen to display the fourth pixel column row by row in a preset column unit until the photosensitive data monitored by the photosensitive sensor under the screen is larger than the preset data threshold value. And determining the pixel row position and the pixel column position of the photosensitive data detected by the under-screen photosensitive sensor of the terminal to be greater than the preset data threshold value.
For example, the preset row may be a single pixel row or a multi-pixel row. The preset column may be a single pixel column or a multi-pixel column. In the embodiment of the present disclosure, the position of the photosensitive sensor under the screen needs to be determined according to the pixel row position and the pixel column position. Therefore, the rows are preset by the single pixel rows, the columns are preset by the single pixel columns, the accuracy is highest, and the determined position of the photosensitive sensor under the screen is accurate.
In the embodiment of the present disclosure, since the pixels displayed on the terminal screen row by row or the pixels displayed on the terminal screen column by column are terminated when the light sensing data monitored by the light sensing sensor under the screen is greater than the preset data threshold, the display state of the previously displayed pixel row or pixel column has no influence on the process. In other words, the previously displayed pixel rows or pixel columns can be kept in the on state or adjusted to the off state. According to the method, when the photosensitive data monitored by the photosensitive sensor under the screen is larger than the preset data threshold value, the position of the pixel row and the position of the pixel column displayed by the terminal screen can be determined, and the position of the photosensitive sensor under the screen can be determined.
Fig. 6 is a diagram illustrating a control terminal screen displayed line by line in units of preset lines by a first pixel line according to an exemplary embodiment. Fig. 7 is a diagram illustrating a control terminal screen that performs column-by-column display in units of preset columns by a first pixel column according to an exemplary embodiment. As shown in fig. 6 and 7, in the process of controlling the terminal screen to perform line-by-line display or column-by-column display, if there is an intersection between the pixel line or the pixel column displayed on the terminal screen and the under-screen photosensor, the photosensitive data monitored by the under-screen photosensor will change significantly (for example, the monitored photosensitive data is greater than the preset data threshold). The terminal can record pixel rows or pixel columns displayed by the terminal when the photosensitive data monitored by the photosensitive sensor under the screen is larger than the preset data threshold value in the mode, and accordingly the position of the photosensitive sensor under the screen is determined.
Of course, the method for determining the position of the off-screen photosensor according to the embodiment of the present disclosure may also perform pixel row display and pixel column display in other manners, which is not specifically limited in the present disclosure.
The method for determining the position of the under-screen photosensitive sensor provided by the embodiment of the disclosure can determine the pixel row position and the pixel column position of the under-screen photosensitive sensor of the terminal, where the monitored photosensitive data of the under-screen photosensitive sensor is greater than the preset data threshold, under the condition that the screen of the terminal is controlled to perform pixel row display and pixel column display respectively. Further, the position of the photosensitive sensor under the screen can be determined according to the determined pixel row position and the determined pixel column position.
In one example, the location of the off-screen photosensor may be determined by the edge vertex coordinates of the intersection pixel area formed between the pixel row location and the pixel column location.
Fig. 8 is a flowchart illustrating a method for determining the position of an off-screen photosensor based on pixel row positions and pixel column positions, as shown in fig. 8, according to an exemplary embodiment, including the following steps.
In step S41, the edge vertex coordinates of the intersection pixel area formed between the pixel row position and the pixel column position are determined.
In step S42, the size of the coordinate area surrounded by the edge vertex coordinates in the screen is determined.
In step S43, the position of the off-screen photosensitive sensor is determined based on the coordinate area size and the size of the off-screen photosensitive sensor.
In the embodiment of the disclosure, the size of the under-screen photosensor can be stored in the terminal in a pre-stored manner, so as to be called when the position of the under-screen photosensor needs to be determined according to the size of the under-screen photosensor.
In an embodiment, the determining the coordinate area surrounded by the edge vertex coordinates in the screen may be controlling the terminal screen to perform line-by-line display by a first pixel row to a second pixel row in a preset line unit, and controlling the terminal screen to perform line-by-line display by a first pixel column to a second pixel column in a preset column unit. The preset rows may be any number of pixel rows, and the preset columns may also be any number of pixel columns. In this case, it may be determined that the pixel row or the pixel column displayed by the terminal is displayed when the sensed data monitored by the on-screen sensor is greater than the preset data threshold. Further, a pixel row area composed of a plurality of pixel row positions and a pixel column area composed of a plurality of pixel column positions may be determined in the manner shown in fig. 9, and an intersection pixel area between the pixel row area and the pixel column area may be determined as a coordinate area (an area where the under-screen photosensor is located) surrounded by edge vertices, that is, a black rectangular area shown in fig. 9.
In another embodiment, a coordinate area surrounded by the edge vertex coordinates in the screen is determined, and the preset row may be set as a single pixel row and the preset column may be set as a single pixel column. And further, the terminal screen is controlled to be displayed line by the first pixel line in a preset line unit until the photosensitive data monitored by the photosensitive sensor under the screen is larger than a preset data threshold value, and the terminal screen is controlled to be displayed line by the second pixel line in the preset line unit until the photosensitive data monitored by the photosensitive sensor under the screen is larger than the preset data threshold value. And the control terminal screen performs row-by-row display by the third pixel row in a preset row unit until the photosensitive data monitored by the photosensitive sensor under the screen is greater than a preset data threshold value, and performs row-by-row display by the fourth pixel row in the preset row unit until the photosensitive data monitored by the photosensitive sensor under the screen is greater than the preset data threshold value. In this case, it may be determined that the pixel row or the pixel column displayed by the terminal is when the sensed data monitored by the on-screen sensor is greater than the preset data threshold. Further, intersection pixels between pixel row positions and pixel column positions may be determined in the manner shown in fig. 10, and a coordinate area (an area where the on-screen photosensor is located) surrounded by edge vertices may be determined in the manner that the intersection pixels are determined as the edge vertices.
In another embodiment, the coordinate region defined by the edge vertex coordinates in the screen may be a preset row set as a multi-pixel row (e.g., a two-pixel row), and a preset column set as a multi-pixel column (e.g., a two-pixel column). And further, controlling the terminal screen to display line by the first pixel line in a preset line unit until the photosensitive data monitored by the photosensitive sensor under the screen is greater than a preset data threshold value, and controlling the terminal screen to display line by the second pixel line in the preset line unit until the photosensitive data monitored by the photosensitive sensor under the screen is greater than the preset data threshold value. And the control terminal screen performs line-by-line display by the third pixel line in a preset line unit until the photosensitive data monitored by the photosensitive sensor under the screen is greater than a preset data threshold value, and performs line-by-line display by the fourth pixel line in the preset line unit until the photosensitive data monitored by the photosensitive sensor under the screen is greater than the preset data threshold value. In this case, it may be determined that the pixel row or the pixel column displayed by the terminal is displayed when the sensed data monitored by the on-screen sensor is greater than the preset data threshold. Further, in the manner shown in fig. 11, the edge vertex of the intersection pixel region is determined, and thus the coordinate region (the region where the on-screen photosensor is located) surrounded by the edge vertex is determined.
In one example, in the case of determining a coordinate area surrounded by the edge vertex coordinates, the size of the coordinate area may be compared with the size of the off-screen photosensitive sensor, and the position of the off-screen photosensitive sensor may be determined according to the comparison result of the sizes of the coordinate area and the off-screen photosensitive sensor.
Fig. 12 is a flowchart illustrating a method of another method for determining a position of an off-screen photosensor according to a pixel row position and a pixel column position according to an exemplary embodiment, and as shown in fig. 12, steps S51 and S52 in the method for determining a position of an off-screen photosensor according to an exemplary embodiment of the present disclosure are similar to the method for executing steps S41 and S42 shown in fig. 8, and are not repeated here.
In step S53a, if the coordinate area size is the same as the size of the off-screen photosensitive sensor, the coordinate area is determined as the position of the off-screen photosensitive sensor.
In step S53b, if the coordinate area size is different from the size of the off-screen photosensor, the tilt angle of the off-screen photosensor with respect to the coordinate area is determined based on the coordinate area size and the size of the off-screen photosensor, and the position of the off-screen photosensor is determined based on the tilt angle.
In the embodiment of the disclosure, if it is determined that the size of the coordinate area is the same as the size of the photosensitive sensor under the screen, it is determined that the coordinate area coincides with the area where the photosensitive sensor under the screen is located, and then the coordinate area is directly determined as the position of the photosensitive sensor under the screen. If the size of the coordinate area is different from the size of the photosensitive sensor under the screen, the coordinate area is partially overlapped with the area where the photosensitive sensor under the screen is located, and the accurate position of the photosensitive sensor under the screen needs to be further determined by determining the inclination angle between the coordinate area and the area.
In the method for determining the position of the photosensitive sensor under the screen provided by the embodiment of the disclosure, the size of the coordinate area and the size of the photosensitive sensor under the screen are determined, which is equivalent to determining the side length of each side of the coordinate area and determining the side length of each side of the photosensitive sensor under the screen. In one example, in the case that the size of the coordinate area is different from the size of the off-screen photosensor, the inclination angle of the off-screen photosensor relative to the coordinate area can be determined by means of geometric operation. For example, as shown in fig. 13, in the case of determining the coordinate region size (one side is a, the other side is B) and the size of the photosensitive sensor under the screen (one side is a, the other side is B), it is possible to pass through
Figure RE-GDA0003290884890000111
And
Figure RE-GDA0003290884890000112
the values of x and y are determined, and the length of each line segment in the coordinate region is determined. Furthermore, the upper acute angle of the lower right triangle can be calculated through the side lengths A-x, B-y and a of the three sides of the lower right triangle. Since this angle is the same as the inclination angle of the sensor with respect to the coordinate region, this angle is the inclination angle of the sensor with respect to the coordinate region. In addition, the inclination angle of the under-screen photosensor relative to the coordinate area may also be determined in other ways, which is not specifically limited by the present disclosure.
In the embodiment of the disclosure, the position of the photosensitive sensor under the screen in the coordinate area can be determined in a pixel oblique line display mode under the condition that the inclination angle of the photosensitive sensor under the screen relative to the coordinate area is determined. Here, for convenience of description, any diagonal side end matching the inclination angle is referred to as a first diagonal side end, and the edge pixel diagonal line at the terminal first diagonal side end is referred to as a first pixel diagonal line.
Fig. 14 is a flowchart illustrating a method for determining the position of an off-screen photosensor based on a tilt angle according to an exemplary embodiment, as shown in fig. 14, including the following steps.
In step S61, the terminal screen is controlled to perform oblique line-by-oblique line display by the first pixel oblique line in a preset oblique line unit at an oblique angle until the sensed data monitored by the photosensitive sensor under the screen is greater than a preset data threshold.
In step S62, it is determined that the off-screen photosensor of the terminal monitors the diagonal position of the pixel where the sensitization data is greater than the preset data threshold, and determines the length corresponding to the intersection pixel line segment formed between the diagonal position of the pixel and the coordinate region.
In step S63, if the length corresponding to the intersection pixel line segment matches the side length of the off-screen photosensor, the endpoint coordinates of the intersection pixel line segment are determined as the vertex coordinates of the off-screen photosensor, and the position of the off-screen photosensor is determined based on the vertex coordinates of the off-screen photosensor.
In one example, the off-screen photosensor may have multiple poses within the coordinate region for the same tilt angle. For example, the off-screen photosensor may be in two poses within the coordinate region as shown in fig. 15 and 16. In this case, the terminal screen may be controlled to perform diagonal pixel display according to the determined tilt angle.
In one embodiment, if the off-screen photosensor is in the posture as shown in fig. 15 in the coordinate region, the terminal screen may be controlled to display in diagonal lines by the first pixels in units of preset diagonal lines in the manner as shown in fig. 17 and 18. In the process of performing pixel-by-pixel diagonal display on the terminal screen, controlling the under-screen photosensor to monitor the photosensitive data, and further determining that the pixels displayed on the terminal screen are diagonal (the pixels diagonal tangent to the under-screen photosensor in fig. 17 and 18) when the under-screen photosensor monitors that the photosensitive data is greater than a preset data threshold. In this case, an intersection pixel line segment (a bold line segment in fig. 17 and 18) formed between the diagonal line of the pixel and the coordinate region is determined, and the length corresponding to the line segment is compared with the side length of the photosensitive sensor under the screen. Further, when it is determined that the length corresponding to the intersection pixel line segment matches the side length of the on-screen photosensor, the coordinates of the end points of the intersection pixel line segment (the end points of the bold line segment in fig. 17) are determined as the coordinates of the vertex of the on-screen photosensor, so as to determine the accurate position of the on-screen photosensor.
According to the method for determining the position of the under-screen photosensitive sensor, the pixel row position and the pixel column position of the intersection part of the under-screen photosensitive sensor can be determined by controlling the terminal screen to respectively perform pixel row display and pixel column display, and the approximate area of the under-screen photosensitive sensor in the terminal screen is determined according to the pixel row position and the pixel column position. Further, whether the approximate area is the accurate position of the under-screen photosensitive sensor can be judged according to the size of the under-screen photosensitive sensor stored in advance and the size of the determined coordinate area. And if the sizes of the two are the same, determining the coordinate area as the accurate position of the under-screen photosensitive sensor, and if the sizes of the two are different, further determining the posture of the under-screen photosensitive sensor in the coordinate area so as to determine the accurate position of the under-screen photosensitive sensor. By the method, the terminal can know the accurate position of the photosensitive sensor under the screen, so that the terminal can complete the algorithm or the optimized setting related to the accurate position with higher accuracy.
Based on the same conception, the embodiment of the disclosure also provides a device for determining the position of the photosensitive sensor under the screen.
It is understood that, in order to implement the above functions, the off-screen photosensor position determining apparatus provided in the embodiments of the present disclosure includes a hardware structure and/or a software module corresponding to the above functions. The disclosed embodiments can be implemented in hardware or a combination of hardware and computer software, in combination with the exemplary elements and algorithm steps disclosed in the disclosed embodiments. Whether a function is performed as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.
FIG. 19 is a block diagram illustrating an off-screen photosensor position determining apparatus according to one exemplary embodiment. Referring to fig. 19, the apparatus 100 includes a control unit 101 and a determination unit 102.
And the control unit 101 is used for controlling the terminal screen to respectively perform pixel row display and pixel column display. The determining unit 102 is configured to determine a pixel row position and a pixel column position where an under-screen photosensitive sensor of the terminal monitors that photosensitive data is greater than a preset data threshold. And the position of the photosensitive sensor under the screen is determined based on the pixel row position and the pixel column position.
In one embodiment, the control unit 101 controls the terminal screen to perform pixel row display and pixel column display respectively as follows: and controlling the terminal screen to display line by line from a first pixel line to a second pixel line in a preset line unit, wherein the first pixel line is an edge pixel line at a first side end of the terminal, and the second pixel line is an edge pixel line at a second side end opposite to the first side end. And controlling the terminal screen to display row by taking a preset row as a unit from a first pixel row to a second pixel row, wherein the first pixel row is an edge pixel row at a third side end of the terminal screen, and the second pixel row is an edge pixel row at a fourth side end opposite to the third side end. The first side end, the second side end, the third side end and the fourth side end are different.
In one embodiment, the control unit 101 controls the terminal screen to perform pixel row display and pixel column display respectively as follows: the control terminal screen is displayed line by a first pixel line in a preset line unit, the first pixel line is located in an edge pixel line of a first side end of the terminal until photosensitive data monitored by the photosensitive sensor under the screen is larger than a preset data threshold value, the control terminal screen is displayed line by a second pixel line in the preset line unit, and the second pixel line is located in an edge pixel line of a second side end opposite to the first side end until the photosensitive data monitored by the photosensitive sensor under the screen is larger than the preset data threshold value. And controlling the terminal screen to display column by using a third pixel column as a preset column unit, wherein the third pixel column is an edge pixel column at a third side end of the terminal until the photosensitive data monitored by the photosensitive sensor under the screen is greater than a preset data threshold value, controlling the terminal screen to display column by using a fourth pixel column as a preset column unit, and the fourth pixel column is an edge pixel column at a fourth side end opposite to the third side end until the photosensitive data monitored by the photosensitive sensor under the screen is greater than a preset data threshold value.
In one embodiment, the determining unit 102 determines the position of the off-screen photosensor based on the pixel row position and the pixel column position by: edge vertex coordinates of an intersection pixel region formed between pixel row locations and pixel column locations are determined. And determining the size of a coordinate area surrounded by the edge vertex coordinates in the screen. And determining the position of the photosensitive sensor under the screen based on the size of the coordinate area and the size of the photosensitive sensor under the screen.
In one embodiment, the determining unit 102 determines the position of the off-screen photosensor based on the size of the coordinate area and the size of the off-screen photosensor as follows: and if the size of the coordinate area is the same as that of the photosensitive sensor under the screen, determining the coordinate area as the position of the photosensitive sensor under the screen. If the size of the coordinate area is different from that of the photosensitive sensor under the screen, determining the inclination angle of the photosensitive sensor under the screen relative to the coordinate area based on the size of the coordinate area and the size of the photosensitive sensor under the screen, and determining the position of the photosensitive sensor under the screen based on the inclination angle.
In one embodiment, the determining unit 102 determines the position of the off-screen photosensor based on the tilt angle in the following manner: and controlling the terminal screen to display the screen in an oblique manner by the oblique manner of a first pixel in a preset oblique manner unit according to the oblique angle, wherein the oblique manner of the first pixel is the oblique manner of the edge pixel at the first oblique side end of the terminal until the photosensitive data monitored by the photosensitive sensor under the screen is larger than a preset data threshold value. And determining the diagonal pixel position of the photosensitive data monitored by the under-screen photosensitive sensor of the terminal to be larger than a preset data threshold value, and determining the length corresponding to an intersection pixel line segment formed between the diagonal pixel position and the coordinate area. And if the length corresponding to the intersection pixel line segment is matched with the side length of the photosensitive sensor under the screen, determining the endpoint coordinate of the intersection pixel line segment as the vertex coordinate of the photosensitive sensor under the screen, and determining the position of the photosensitive sensor under the screen based on the vertex coordinate of the photosensitive sensor under the screen.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
FIG. 20 is a block diagram illustrating an apparatus 200 for off-screen photosensor position determination according to an exemplary embodiment. For example, the apparatus 200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 20, the apparatus 200 may include one or more of the following components: a processing component 202, a memory 204, a power component 206, a multimedia component 208, an audio component 210, an input/output (I/O) interface 212, a sensor component 214, and a communication component 216.
The processing component 202 generally controls overall operation of the device 200, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 202 can include one or more modules that facilitate interaction between the processing component 202 and other components. For example, the processing component 202 can include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.
The memory 204 is configured to store various types of data to support operations at the apparatus 200. Examples of such data include instructions for any application or method operating on the device 200, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 204 may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
Power components 206 provide power to the various components of device 200. Power components 206 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for device 200.
The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 200 is in an operating mode, such as a shooting mode or a video mode. Each of the front camera and the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 210 is configured to output and/or input audio signals. For example, audio component 210 includes a Microphone (MIC) configured to receive external audio signals when apparatus 200 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 204 or transmitted via the communication component 216. In some embodiments, audio component 210 also includes a speaker for outputting audio signals.
The I/O interface 212 provides an interface between the processing component 202 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor component 214 includes one or more sensors for providing various aspects of status assessment for the device 200. For example, the sensor component 214 may detect an open/closed state of the device 200, the relative positioning of components, such as a display and keypad of the device 200, the sensor component 214 may also detect a change in the position of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration/deceleration of the device 200, and a change in the temperature of the device 200. The sensor assembly 214 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 214 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 216 is configured to facilitate wired or wireless communication between the apparatus 200 and other devices. The apparatus 200 may access a wireless network based on a communication standard, such as WiFi, 4G or 5G, or a combination thereof. In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 200 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as memory 204, comprising instructions executable by processor 220 of apparatus 200 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
It is understood that "a plurality" in this disclosure means two or more, and other words are analogous. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. The singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It will be further understood that the terms "first," "second," and the like are used to describe various information and that such information is not limited by these terms. These terms are only used to distinguish one type of information from another and do not denote a particular order or importance. Indeed, the terms "first," "second," and the like are fully interchangeable. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure.
It will be further understood that, unless otherwise specified, "connected" includes direct connections between the two without the presence of other elements, as well as indirect connections between the two with the presence of other elements.
It is further to be understood that while operations are depicted in the drawings in a particular order, this is not to be understood as requiring that such operations be performed in the particular order shown or in serial order, or that all illustrated operations be performed, to achieve desirable results. In certain environments, multitasking and parallel processing may be advantageous.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is to be limited only by the scope of the appended claims.

Claims (14)

1. A method for determining the position of an under-screen photosensitive sensor is applied to a terminal and comprises the following steps:
controlling the terminal screen to respectively perform pixel row display and pixel column display, and determining the pixel row position and the pixel column position of the terminal screen where the photosensitive sensor monitors that the photosensitive data is greater than a preset data threshold;
and determining the position of the photosensitive sensor under the screen based on the pixel row position and the pixel column position.
2. The method for determining the position of the off-screen photosensor according to claim 1, wherein controlling the terminal screen to perform pixel row display and pixel column display respectively comprises:
controlling the terminal screen to be displayed line by line from a first pixel line to a second pixel line in a preset line unit, wherein the first pixel line is an edge pixel line at a first side end of the terminal, and the second pixel line is an edge pixel line at a second side end opposite to the first side end; and
controlling the terminal screen to perform row-by-row display from a first pixel row to a second pixel row by taking a preset row as a unit, wherein the first pixel row is an edge pixel row at a third side end of the terminal screen, and the second pixel row is an edge pixel row at a fourth side end opposite to the third side end;
the first, second, third, and fourth lateral ends are different.
3. The method for determining the position of the off-screen photosensor according to claim 1, wherein controlling the terminal screen to perform pixel row display and pixel column display respectively comprises:
controlling a first pixel row of the terminal screen to display line by line in a preset line unit until the photosensitive data monitored by the under-screen photosensitive sensor is greater than a preset data threshold, and controlling a second pixel row of the terminal screen to display line by line in a preset line unit until the photosensitive data monitored by the under-screen photosensitive sensor is greater than a preset data threshold; and
the method comprises the steps of controlling a third pixel column of the terminal screen to display row by taking a preset row as a unit, controlling a fourth pixel column of the terminal screen to display row by taking a preset row as a unit until the photosensitive data monitored by a photosensitive sensor under the screen is larger than a preset data threshold value, and controlling the fourth pixel column of the terminal screen to display row by taking a preset row as a unit until the photosensitive data monitored by the photosensitive sensor under the screen is larger than the preset data threshold value.
4. The method according to any one of claims 1 to 3, wherein determining the position of the off-screen photosensor based on the pixel row position and the pixel column position comprises:
determining edge vertex coordinates of an intersection pixel area formed between the pixel row positions and the pixel column positions;
determining the size of a coordinate area surrounded by the edge vertex coordinates in the screen;
and determining the position of the photosensitive sensor under the screen based on the size of the coordinate area and the size of the photosensitive sensor under the screen.
5. The method of claim 4, wherein determining the position of the off-screen photosensor based on the coordinate region size and the size of the off-screen photosensor comprises:
if the size of the coordinate area is the same as that of the photosensitive sensor under the screen, determining the coordinate area as the position of the photosensitive sensor under the screen;
if the size of the coordinate area is different from that of the photosensitive sensor under the screen, the inclination angle of the photosensitive sensor under the screen relative to the coordinate area is determined based on the size of the coordinate area and the size of the photosensitive sensor under the screen, and the position of the photosensitive sensor under the screen is determined based on the inclination angle.
6. The method of claim 5, wherein determining the position of the off-screen photosensor based on the tilt angle comprises:
controlling the terminal screen to display the terminal screen in a diagonal manner by a first pixel diagonal manner in a unit of a preset diagonal manner, wherein the first pixel diagonal manner is an edge pixel diagonal manner at a first diagonal side end of the terminal until the photosensitive data monitored by the photosensitive sensor under the screen is larger than a preset data threshold value;
determining a pixel diagonal position of a terminal, wherein the pixel diagonal position is monitored by an under-screen photosensitive sensor, and the photosensitive data of the under-screen photosensitive sensor is greater than a preset data threshold value, and determining the length corresponding to an intersection pixel line segment formed between the pixel diagonal position and the coordinate area;
and if the length corresponding to the intersection pixel line segment is matched with the side length of the photosensitive sensor under the screen, determining the endpoint coordinate of the intersection pixel line segment as the vertex coordinate of the photosensitive sensor under the screen, and determining the position of the photosensitive sensor under the screen based on the vertex coordinate of the photosensitive sensor under the screen.
7. The utility model provides a photosensitive sensor position determination device under screen which characterized in that is applied to the terminal, photosensitive sensor position determination device under screen includes:
the control unit is used for controlling the terminal screen to respectively perform pixel row display and pixel column display;
the determining unit is used for determining the pixel row position and the pixel column position of the terminal when the under-screen photosensitive sensor monitors that the photosensitive data is larger than a preset data threshold value; and the position of the photosensitive sensor under the screen is determined based on the pixel row position and the pixel column position.
8. The device of claim 7, wherein the control unit controls the terminal screen to perform pixel row display and pixel column display respectively by:
controlling the terminal screen to be displayed line by line from a first pixel line to a second pixel line in a preset line unit, wherein the first pixel line is an edge pixel line at a first side end of the terminal, and the second pixel line is an edge pixel line at a second side end opposite to the first side end; and
controlling the terminal screen to perform row-by-row display from a first pixel row to a second pixel row by taking a preset row as a unit, wherein the first pixel row is an edge pixel row at a third side end of the terminal screen, and the second pixel row is an edge pixel row at a fourth side end opposite to the third side end;
the first, second, third, and fourth lateral ends are different.
9. The device of claim 7, wherein the control unit controls the terminal screen to perform pixel row display and pixel column display respectively by:
controlling a first pixel row of the terminal screen to display line by line in a preset line unit until the photosensitive data monitored by the under-screen photosensitive sensor is greater than a preset data threshold, and controlling a second pixel row of the terminal screen to display line by line in a preset line unit until the photosensitive data monitored by the under-screen photosensitive sensor is greater than a preset data threshold; and
the method comprises the steps of controlling a third pixel column of the terminal screen to display row by taking a preset row as a unit, controlling a fourth pixel column of the terminal screen to display row by taking a preset row as a unit until the photosensitive data monitored by a photosensitive sensor under the screen is larger than a preset data threshold value, and controlling the fourth pixel column of the terminal screen to display row by taking a preset row as a unit until the photosensitive data monitored by the photosensitive sensor under the screen is larger than the preset data threshold value.
10. The off-screen photosensor position determining apparatus according to any one of claims 7 to 9, wherein the determining unit determines the position of the off-screen photosensor based on the pixel row position and the pixel column position in the following manner:
determining edge vertex coordinates of an intersection pixel area formed between the pixel row positions and the pixel column positions;
determining the size of a coordinate area surrounded by the edge vertex coordinates in the screen;
and determining the position of the photosensitive sensor under the screen based on the size of the coordinate area and the size of the photosensitive sensor under the screen.
11. The off-screen photosensor position determining apparatus according to claim 10, wherein the determining unit determines the position of the off-screen photosensor based on the coordinate area size and the size of the off-screen photosensor in the following manner:
if the size of the coordinate area is the same as that of the photosensitive sensor under the screen, determining the coordinate area as the position of the photosensitive sensor under the screen;
if the size of the coordinate area is different from that of the photosensitive sensor under the screen, the inclination angle of the photosensitive sensor under the screen relative to the coordinate area is determined based on the size of the coordinate area and the size of the photosensitive sensor under the screen, and the position of the photosensitive sensor under the screen is determined based on the inclination angle.
12. The off-screen photosensor position determining apparatus according to claim 11, wherein the determining unit determines the position of the off-screen photosensor based on the inclination angle in the following manner:
controlling the terminal screen to display the terminal screen in a diagonal manner by a first pixel diagonal manner in a unit of a preset diagonal manner, wherein the first pixel diagonal manner is an edge pixel diagonal manner at a first diagonal side end of the terminal until the photosensitive data monitored by the photosensitive sensor under the screen is larger than a preset data threshold value;
determining a pixel diagonal position of a terminal, wherein the pixel diagonal position is monitored by an under-screen photosensitive sensor, and the photosensitive data of the under-screen photosensitive sensor is greater than a preset data threshold value, and determining the length corresponding to an intersection pixel line segment formed between the pixel diagonal position and the coordinate area;
and if the length corresponding to the intersection pixel line segment is matched with the side length of the photosensitive sensor under the screen, determining the endpoint coordinate of the intersection pixel line segment as the vertex coordinate of the photosensitive sensor under the screen, and determining the position of the photosensitive sensor under the screen based on the vertex coordinate of the photosensitive sensor under the screen.
13. An under-screen photosensor position determining apparatus comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to: the method of determining the position of an underscreen photosensor according to any one of claims 1 to 6 is performed.
14. A storage medium having stored therein instructions that, when executed by a processor of a terminal, enable the terminal to perform the method of determining a position of an underscreen photosensor according to any one of claims 1-6.
CN202110834126.9A 2021-07-22 2021-07-22 Method, device and storage medium for determining position of under-screen photosensitive sensor Active CN113654459B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110834126.9A CN113654459B (en) 2021-07-22 2021-07-22 Method, device and storage medium for determining position of under-screen photosensitive sensor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110834126.9A CN113654459B (en) 2021-07-22 2021-07-22 Method, device and storage medium for determining position of under-screen photosensitive sensor

Publications (2)

Publication Number Publication Date
CN113654459A true CN113654459A (en) 2021-11-16
CN113654459B CN113654459B (en) 2024-05-24

Family

ID=78489755

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110834126.9A Active CN113654459B (en) 2021-07-22 2021-07-22 Method, device and storage medium for determining position of under-screen photosensitive sensor

Country Status (1)

Country Link
CN (1) CN113654459B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114279332A (en) * 2021-12-27 2022-04-05 深圳市汇顶科技股份有限公司 Method and device for positioning sensor under display screen and electronic equipment
CN114281290A (en) * 2021-12-27 2022-04-05 深圳市汇顶科技股份有限公司 Method and device for positioning sensor under display screen and electronic equipment

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101634920A (en) * 2008-07-17 2010-01-27 三星移动显示器株式会社 Display device and method for determining touch position thereon
US20110080357A1 (en) * 2009-10-06 2011-04-07 Samsung Mobile Display Co., Ltd. Liquid crystal display with built-in touch screen
CN102511024A (en) * 2009-08-25 2012-06-20 夏普株式会社 Location identification sensor, electronic device, and display device
CN102568431A (en) * 2010-12-23 2012-07-11 鸿富锦精密工业(深圳)有限公司 Display and automatic adjusting method of display screen
TW201724842A (en) * 2015-12-18 2017-07-01 廣東歐珀移動通信有限公司 Image sensor, pixel information output method of the image sensor, phase focusing method, imaging device, and terminal
CN108319914A (en) * 2018-01-31 2018-07-24 北京小米移动软件有限公司 Terminal and display control method, storage medium
CN108363485A (en) * 2018-01-25 2018-08-03 广州杰赛科技股份有限公司 Control method, device, system and the computer equipment of non-touch screen display terminal
CN108509849A (en) * 2017-02-24 2018-09-07 三星电子株式会社 Utilize the electronic equipment and method of the pixel identification sensor position of display
CN112242119A (en) * 2019-07-16 2021-01-19 北京小米移动软件有限公司 Terminal, display parameter control method and device, and storage medium

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101634920A (en) * 2008-07-17 2010-01-27 三星移动显示器株式会社 Display device and method for determining touch position thereon
CN102511024A (en) * 2009-08-25 2012-06-20 夏普株式会社 Location identification sensor, electronic device, and display device
US20110080357A1 (en) * 2009-10-06 2011-04-07 Samsung Mobile Display Co., Ltd. Liquid crystal display with built-in touch screen
CN102568431A (en) * 2010-12-23 2012-07-11 鸿富锦精密工业(深圳)有限公司 Display and automatic adjusting method of display screen
TW201724842A (en) * 2015-12-18 2017-07-01 廣東歐珀移動通信有限公司 Image sensor, pixel information output method of the image sensor, phase focusing method, imaging device, and terminal
CN108509849A (en) * 2017-02-24 2018-09-07 三星电子株式会社 Utilize the electronic equipment and method of the pixel identification sensor position of display
CN108363485A (en) * 2018-01-25 2018-08-03 广州杰赛科技股份有限公司 Control method, device, system and the computer equipment of non-touch screen display terminal
CN108319914A (en) * 2018-01-31 2018-07-24 北京小米移动软件有限公司 Terminal and display control method, storage medium
CN112242119A (en) * 2019-07-16 2021-01-19 北京小米移动软件有限公司 Terminal, display parameter control method and device, and storage medium

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114279332A (en) * 2021-12-27 2022-04-05 深圳市汇顶科技股份有限公司 Method and device for positioning sensor under display screen and electronic equipment
CN114281290A (en) * 2021-12-27 2022-04-05 深圳市汇顶科技股份有限公司 Method and device for positioning sensor under display screen and electronic equipment
CN114279332B (en) * 2021-12-27 2023-11-03 深圳市汇顶科技股份有限公司 Method and device for positioning sensor under display screen and electronic equipment
US11847993B2 (en) 2021-12-27 2023-12-19 Shenzhen GOODIX Technology Co., Ltd. Method and apparatus for locating sensor under display screen and electronic device
CN114281290B (en) * 2021-12-27 2024-04-12 深圳市汇顶科技股份有限公司 Method and device for positioning sensor under display screen and electronic equipment

Also Published As

Publication number Publication date
CN113654459B (en) 2024-05-24

Similar Documents

Publication Publication Date Title
CN106570442B (en) Fingerprint identification method and device
EP3726514B1 (en) Display control method for terminal screen, device and storage medium thereof
US10650502B2 (en) Image processing method and apparatus, and storage medium
US11698297B2 (en) Methods and devices for detecting ambient light based on different states of flexible screen, and storage medium
CN113654459B (en) Method, device and storage medium for determining position of under-screen photosensitive sensor
CN112201211B (en) Ambient light collection method and device, terminal and storage medium
CN111261081B (en) Screen display method and device
CN111611034A (en) Screen display adjusting method and device and storage medium
CN105678296B (en) Method and device for determining character inclination angle
CN107219989B (en) Icon processing method and device and terminal
EP3629318B1 (en) Method and apparatus for compensating operating parameter of display circuit
WO2021169846A1 (en) Display method and electronic device
CN112905135A (en) Screen brightness processing method, electronic device and storage medium
CN108847199B (en) Brightness determination method and device
EP3086311A1 (en) Method and device for adjusting display brightness
CN113257177B (en) Brightness control method and device and electronic equipment
CN113066452B (en) Display control method and device, electronic equipment and computer readable storage medium
EP3809401A1 (en) Display control method, device and electronic apparatus
CN115145662A (en) Screen display brightness adjusting method and device and storage medium
CN108538261B (en) Display control method and device and display equipment
CN110956938A (en) Screen brightness adjusting method and device, electronic equipment and readable storage medium
CN105718168A (en) Image display method and device
CN107329604B (en) Mobile terminal control method and device
CN114860138B (en) Image display method, device, electronic equipment and storage medium
CN112987906B (en) Method and device for reducing display power consumption

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant