CN115695775A - Method and system for testing definition of terminal camera, graphic card and terminal equipment - Google Patents

Abstract

The embodiment of the application discloses a method and a system for testing the definition of a terminal camera, a graphic card and terminal equipment. The testing method comprises the steps of aligning a camera to a testing area; obtaining a test picture; selecting a plurality of fields of view; respectively acquiring intersection point coordinates of each intersection point of each diagonal line and a plurality of view fields; selecting black blocks to be detected; selecting a target black block; an ROI region is formed. The test system comprises a camera alignment module, a test picture acquisition module, a view field selection module, an intersection point acquisition module, a black block selection module to be tested, a target black block screening module and an ROI area forming module. The graphic card comprises a plurality of test areas which respectively correspond to different focal segments, a plurality of black blocks are distributed in each test area, and the distribution density is increased along with the increase of the focal segments. The technical scheme that this application is disclosed can make the definition test of many focuses of many cameras section can test on a picture card, effectively reduces the test station of camera, can also offset the marginal distortion of camera.

Description

Method and system for testing definition of terminal camera, graphic card and terminal equipment

[ technical field ] A method for producing a semiconductor device

The application relates to the technical field of terminal camera performance testing, in particular to a method and a system for testing definition of a terminal camera, a graphic card and terminal equipment.

[ background of the invention ]

The resolution of the imaging system is always one of the most critical indexes of the camera, and the commonly used methods in the industry at present mainly include TV line detection, modulation Transfer Function (MTF) detection, and Spatial Frequency Response (SFR) detection. The SFR testing method greatly simplifies the testing process, so the SFR testing method is widely used in the field of automatic testing of the definition of the camera of the smart phone. The scheme commonly used in the industry at present is to take pictures of different test graphic cards by controlling different cameras of a mobile phone, derive the pictures, capture an ROI (Region of Interest) by an algorithm, and calculate an SFR test method to complete the test.

With the increasing number of mobile phone cameras, the number of different camera coverage focal sections is increased and has larger difference, and under the condition that the space of the test equipment is limited, the test of covering different focal sections with the new test chart card and the test station is needed, so that the length of a production line body is lengthened and the manufacturing cost is increased.

In addition, when a checkerboard card is used for testing, the white-black boundary line is required to be inclined according to a certain angle by SFR calculation, but the slope of the boundary line cannot meet the testing requirement due to the distortion of the edge field of the wide-angle camera, so that the calculation cannot be carried out. For the problem of distortion of the marginal field of view, the prior art is a method for offsetting distortion by increasing the integral rotation angle of the checkerboard, but the loss of a test value of a central area of an image can be caused, and the inaccurate test value causes error detection and over-killing of a production line.

In the prior art, a checkerboard with an inclination angle is used as a graphic card, a camera captures a black-white boundary ROI area under different fields of view after taking a picture, and then an SFR of the ROI area is calculated to finish a definition test.

When the number of mobile phone cameras is increased and the physical zoom ratios are inconsistent, checkerboard test cards with different grid sizes can be designed according to the visual field size and the magnification ratio of the cameras, wherein an SFR test card for a wide-angle camera is shown in fig. 1, and an SFR test card for a telephoto camera is shown in fig. 2.

When the mobile phone has a scene with multiple zoom multiples of multiple cameras, the cameras with different focal lengths need to use the graphic cards with different checkerboard sizes for testing, and the prior art needs to add new graphic cards and test stations, so that the requirement of a test site space is increased, and the test cost is increased.

When the SFR is used for calculating the image definition, only one black and white intersected bevel edge is needed, and the current technology generally inclines a black and white checkerboard at a certain angle and calculates by grabbing the black and white bevel edge corresponding to a view field.

When the edge of the camera is distorted, the captured oblique edge can be deformed, and the slope of the black and white oblique edge does not meet the test requirement so as to generate a scene with calculation failure. For slope distortion caused by edge distortion, the current technology is to cancel the edge distortion in advance by increasing the overall tilt angle of the checkerboard, as shown in fig. 3.

The edge definition under the edge distortion can be calculated by increasing the inclination angle of the checkerboard to counteract the edge distortion, but the increase of the inclination angle causes loss (shown in fig. 4) to the test value of the central area, and over-killing or misdetection exists.

[ summary of the invention ]

In view of this, embodiments of the present application provide a method and a system for testing the definition of a terminal camera, a graphic card and a terminal device, so as to solve the technical problem of the definition of the terminal camera in the prior art.

In a first aspect, an embodiment of the present application provides a method for testing definition of a terminal camera, where the method includes:

aligning the camera to a test area corresponding to a focal section of the camera in a plurality of test areas of the graphic card;

shooting the test area to obtain a test picture and the resolution of the test picture;

selecting a plurality of fields of view with different radii based on the resolution of the test picture by taking the picture center of the test picture as an origin;

respectively acquiring intersection point coordinates of intersection points of each diagonal line of the test picture and the peripheries of the plurality of view fields;

selecting a black block to be tested which meets a preset squareness degree from a plurality of black blocks distributed in the test area;

selecting a target black block with an inclination angle meeting a preset angle from the plurality of black blocks to be detected;

forming an ROI area based on the target black block.

Through the scheme that this embodiment provided, the definition test that makes many camera many focal sections can test on a picture card, effectively reduces the test station of camera, can also offset the edge distortion of camera.

In a preferred embodiment, the step of aligning the camera with a test area corresponding to a focal length of the camera among a plurality of test areas of the graphic card includes:

identifying a test area corresponding to the focal section of the camera in a plurality of test areas of the graphic card according to the focal section of the camera;

and adjusting the projection position of the central point of the camera on the graphic card to enable the central point of the camera to be aligned with the test area corresponding to the focal section of the camera.

Through the scheme that this embodiment provided, the test area that is applicable to each focus section in making the camera can the automatic identification picture card, and can the accurate test area that the focus section that aims at the camera corresponds, especially in the occasion of many focus sections, the angle of automatic adjustment camera when can realizing the camera zoom section is and aim at the exact test area, in the occasion of many cameras, can realize that many cameras of different focus sections aim at different test areas respectively and carry out the function of definition test simultaneously.

In a preferred embodiment, the step of acquiring intersection coordinates of respective intersections where respective diagonal lines of the test picture intersect with the peripheries of the plurality of fields of view includes:

obtaining each diagonal line of the test picture based on the resolution of the test picture;

obtaining diagonal coordinate values of the diagonals and field of view coordinate values of the peripheries of the plurality of fields of view based on the picture center and the resolution of the test picture;

and calculating the coordinate values of the diagonals and the coordinate values of the field of view to obtain each intersection point and intersection point coordinates of each diagonal line and the periphery of the plurality of fields of view.

Through the scheme provided by the embodiment, four intersection points intersected with the diagonal lines are respectively taken on each view field, rectangular areas similar to the test picture are formed in different view field ranges, and calculation of edge distortion of the camera is facilitated.

In a preferred embodiment, the step of selecting the black block to be tested that satisfies the preset squareness from the plurality of black blocks arranged in the test area includes:

sequentially traversing the picture center of the test picture and each intersection point;

selecting a search area by taking the picture center and each intersection point as a center;

calculating the squareness of each black block in each search area;

and selecting black blocks meeting the preset squareness in each search area as black blocks to be detected.

Through the scheme provided by the embodiment, the black blocks near each intersection point needing to measure and calculate the edge distortion are primarily screened, and the black blocks with good squareness and edges easy to calculate are selected as the black blocks to be measured, so that the calculation of the definition test is facilitated to be simplified, and the calculation resources are saved.

In a preferred embodiment, the step of selecting a target black block of the plurality of black blocks to be measured, wherein an inclination angle of the target black block meets a preset angle, includes:

extracting coordinate values of all edges of the black block to be detected;

calculating the slope of each edge to obtain the inclination angle of the black block to be detected;

matching and calculating the inclination angle of each black block to be detected with a preset angle respectively to obtain the matching degree of each black block to be detected;

and taking the black block to be detected with the highest matching degree as a target black block.

Through the scheme provided by the embodiment, the screened black blocks to be tested are further screened, the black blocks to be tested with the inclination angle closest to the preset angle are selected as the target black blocks, and the optimal calculation result is ensured when the bevel edge of the target black blocks is calculated in the full-view scene in the test process.

In a preferred embodiment, the step of forming the ROI region based on the target black block includes:

extracting coordinate values of all edges of the target black block;

obtaining coordinate values of the middle points of the edges;

an ROI area is formed based on each of the midpoints.

The scheme provided by the embodiment is helpful for offsetting the influence of the edge distortion of the camera.

In a preferred embodiment, the test method further comprises:

aligning the shooting center of the camera to the calibration cross in the test area;

capturing four reference points symmetrically arranged around the calibration cross with respect to the center of the calibration cross;

calculating the slope of a connecting line between the two reference points which are positioned on the same side of the calibration cross to obtain a deflection angle;

comparing the deflection angle with a preset rotation angle;

and when the deflection angle is larger than the preset rotation angle, adjusting the position of the camera.

Through the scheme that this embodiment provided, can detect out the angle of inclination of camera in the testing process in real time, in time adjust the camera, and can cover the angle of inclination detection of many camera multifocal sections, improve the degree of accuracy of camera definition test.

In a second aspect, an embodiment of the present application provides a system for testing definition of a terminal camera, where the system includes: the system comprises a camera alignment module, a test picture acquisition module, a view field selection module, an intersection point acquisition module, a black block to be tested selection module, a target black block screening module and an ROI area forming module which are in communication connection with each other;

the camera alignment module is used for aligning the camera to a test area corresponding to a focal section of the camera in a plurality of test areas of the graphic card;

the test picture acquisition module is used for shooting the test area to acquire a test picture and the resolution of the test picture;

the view field selection module is used for selecting a plurality of view fields with different radius sizes by taking the picture center of the test picture as an original point based on the resolution of the test picture;

the intersection point acquisition module is used for respectively acquiring intersection point coordinates of intersection points of each diagonal line of the test picture and the peripheries of the plurality of view fields;

the black block to be tested selecting module is used for selecting black blocks to be tested meeting the preset squareness from the plurality of black blocks distributed in the test area;

the target black block screening module is used for selecting a target black block of which the inclination angle meets a preset angle from the black blocks to be detected;

the ROI area forming module is used for forming an ROI area based on the target black block.

Through the scheme that this embodiment provided, utilize this seven modules to make the definition test of many camera multifocal sections can test on a picture card, effectively reduce the test station of camera, can also offset the edge distortion of camera.

In a third aspect, an embodiment of the present application provides a graphic card, which includes a plurality of test areas, where the plurality of test areas correspond to different focal segments respectively, a plurality of black blocks are arranged in each test area, and the arrangement density of the black blocks in each test area increases with the increase of the focal segments.

Through the scheme that this embodiment provided, realize that same picture card can cover the definition test of many camera multifocal sections, effectively reduce the test space requirement in definition test place, shorten and produce line body length, save cost and raise the efficiency.

In a preferred embodiment, the plurality of test areas comprise a first test area, a second test area and a third test area, wherein the first test area is used for testing 0.6-1.5 times of Jiao Duan cameras, the second test area is used for testing 3 times and above focal length cameras, and the third test area is used for testing 1.5-3 times of focal length cameras;

the first test area is in an X shape consisting of two oblique line areas, the two oblique line areas extend along the diagonal line of the graph card, the second test area is an upper triangular area and a lower triangular area which are divided by the two oblique line areas, and the third test area is a left triangular area and a right triangular area which are divided by the two oblique line areas;

the length of the right-angle side in the first test area, which is intersected with each side of the graphic card, is not more than 1/5 of the length of the corresponding side of the graphic card.

Through the scheme that this embodiment provided, the three test area homoenergetic to the camera design of three different focal length sections can reach good test effect.

In a preferred embodiment, in the first test area, each of the diagonal line regions has a plurality of rows of black blocks extending along the respective corresponding diagonal line;

the black blocks in the rows have rotation angles relative to the edges of the graphic card, wherein the rotation angle of the black block in the row closest to the diagonal is the same as a preset rotation angle, the rotation angles of the black blocks in the other rows are positive and negative angles added on the basis of the preset rotation angle, and the positive and negative angles of the black blocks on the same side of the diagonal are the same.

Through the scheme provided by the embodiment, the problem of edge distortion of the camera can be counteracted in advance.

In a fourth aspect, an embodiment of the present application provides a terminal device, including: a memory and a processor: the memory for storing a computer program; the processor is configured to execute the computer program stored in the memory to cause the terminal device to perform the method according to the first aspect.

In a fifth aspect, the present application provides a computer-readable storage medium, which includes a program or instructions, when the program or instructions are run on a computer, the method according to the first aspect is performed.

Compared with the prior art, the technical scheme at least has the following beneficial effects:

the method and the system for testing the definition of the terminal camera, the graphic card and the terminal equipment can realize definition testing of a multi-focal-length section of the terminal camera covered by one graphic card, are suitable for application scenes of batch testing of the multi-focal-length sections of the terminal camera, effectively reduce testing stations of the terminal camera, improve testing efficiency and eliminate the influence of edge distortion of a definition testing chamber of a wide-focal-length section of the terminal camera.

[ description of the drawings ]

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

FIG. 1 is a schematic diagram of a prior art graphic card for SFR testing of wide angle cameras;

FIG. 2 is a schematic diagram of a prior art graphic card for SFR testing of a tele camera;

FIG. 3 is a diagram illustrating a prior art edge distortion at the edge of a camera resulting in a distortion of the slope of the hypotenuse;

FIG. 4 is a graphical illustration of the effect of black blocks of a prior art graphic card on SFR test values at different tilt angles;

fig. 5 is a schematic structural diagram of a terminal device provided in embodiment 1 of the present application;

FIG. 6 is a schematic view of a graphic card provided in embodiment 2 of the present application;

FIG. 7 is an enlarged schematic view of a first test area of a graphic card provided in embodiment 2 of the present application;

FIG. 8 is an enlarged schematic view of a second test area of the graphic card provided in embodiment 2 of the present application;

FIG. 9 is an enlarged schematic view of a third test area in the graphic card provided in embodiment 2 of the present application;

FIG. 10 is a flow chart of a testing method provided in embodiment 3 of the present application;

FIG. 11 is a schematic view of concentric circles representing three fields of view drawn on a graphic card in the test method provided in example 3 of the present application;

FIG. 12 is a schematic diagram of drawing diagonals on a graphic card and determining intersections in the test method provided in embodiment 3 of the present application;

fig. 13 is an enlarged schematic view of each intersection point when a black block to be tested is selected from a graphic card in the test method provided in embodiment 3 of the present application;

fig. 14 is a flowchart of detecting a deflection angle of a camera in the test method provided in embodiment 3 of the present application;

fig. 15 is an enlarged schematic view of a deflection angle calculation of a camera performed on a graphic card in the test method provided in embodiment 3 of the present application;

fig. 16 is a block diagram of a test system provided in embodiment 4 of the present application.

Reference numerals:

1-an antenna;

2-an antenna;

100-a terminal device; 110-a processor; 120-external memory interface; 121-internal memory; 130-universal serial bus interface; 140-a charge management module; 141-power management module; 142-a battery; 150-a mobile communication module; 160-a wireless communication module; 170-an audio module; 170A-speaker; 170B-receiver; 170C-microphone; 170D-headset interface; 180-a sensor module; 180A-pressure sensor; 180B-a gyroscope sensor; 180C-air pressure sensor; 180D-magnetic sensor; 180E-acceleration sensor; 180F-distance sensor; 180G — low beam sensor; 180H-fingerprint sensor; 180J-temperature sensor; 180K-touch sensor; 180L-ambient light sensor; 180M-bone conduction sensor; 190-key press; 191-a motor; 192-an indicator; 193-camera; 194-a display screen; 195-a subscriber identity module card interface;

11-a camera alignment module; 12-a test picture acquisition module; 13-a field of view selection module; 14-an intersection point acquisition module; 15-black block selection module to be tested; 16-a target black block screening module; 17-ROI region formation module; 18-deflection angle detection module;

20-a graphic card; 21-a first test area; 22-a second test area; 23-a third test area; 24-black blocks; 25-diagonal region; 26-edge of the graphic card; 27-square edge; 28-diagonal; 29-calibration cross; 30-a reference point; 31-concentric circles; 32-picture center; 33-intersection point; 34-finding a region; 35-black blocks to be detected; 36-target black block; 37-midpoint; 38-ROI area.

[ detailed description ] embodiments

For better understanding of the technical solutions of the present application, the following detailed descriptions of the embodiments of the present application are provided with reference to the accompanying drawings.

It should be understood that the embodiments described are only a few embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

Embodiments of a terminal device and an implementation method of the terminal device are described below, where the terminal device may be a mobile phone (also called an intelligent electronic device), a tablet personal computer (tablet personal computer), a personal digital assistant (personal digital assistant), an electronic book reader (e-book reader), or a virtual reality interactive device (virtual reality interactive device), and the terminal device may be accessed into various types of communication systems, for example: long Term Evolution (LTE) systems, future fifth generation (5 th generation, 5G) systems, new radio access technology (NR), and future communication systems, such as 6G systems; but also Wireless Local Area Networks (WLANs) and the like.

For convenience of description, in the following embodiments, an intelligent terminal device is taken as an example for description.

Example 1

Fig. 5 is a schematic structural diagram of a terminal device disclosed in embodiment 1 of the present application, where the terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display 194, and a Subscriber Identity Module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It is to be understood that the illustrated structure of the embodiment of the present invention does not specifically limit the terminal device 100. In other embodiments of the present application, terminal device 100 may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processor (GPU), an Image Signal Processor (ISP), a controller, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), among others. The different processing units may be separate devices or may be integrated into one or more processors.

The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in processor 110 for storing instructions and data. In one embodiment, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.

In one embodiment, the processor 110 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.

The I2C interface is a bidirectional synchronous serial bus comprising a serial data line (SDA) and a Serial Clock Line (SCL). In one embodiment, processor 110 may include multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, a charger, a flash, a camera 193, etc. through different I2C bus interfaces, respectively. For example: the processor 110 may be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through an I2C bus interface to implement a touch function of the terminal device 100.

The I2S interface may be used for audio communication. In one embodiment, processor 110 may include multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 through an I2S bus to enable communication between the processor 110 and the audio module 170. In one embodiment, the audio module 170 may transmit the audio signal to the wireless communication module 160 through an I2S interface, so as to implement a function of answering a call through a bluetooth headset.

The PCM interface may also be used for audio communication, sampling, quantizing and encoding analog signals. In one embodiment, the audio module 170 and the wireless communication module 160 may be coupled by a PCM bus interface. In one embodiment, the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to implement a function of answering a call through a bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communications. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In one embodiment, a UART interface is generally used to connect the processor 110 with the wireless communication module 160. For example: the processor 110 communicates with a bluetooth module in the wireless communication module 160 through a UART interface to implement a bluetooth function. In an embodiment, the audio module 170 may transmit the audio signal to the wireless communication module 160 through a UART interface, so as to realize the function of playing music through a bluetooth headset.

MIPI interfaces may be used to connect processor 110 with peripheral devices such as display screen 194, camera 193, and the like. The MIPI interface includes a Camera Serial Interface (CSI), a display screen serial interface (DSI), and the like. In one embodiment, the processor 110 and the camera 193 communicate through a CSI interface to implement the shooting function of the terminal device 100. The processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the terminal device 100.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal and may also be configured as a data signal. In one embodiment, a GPIO interface may be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface may also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, and the like.

The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the terminal device 100, and may also be used to transmit data between the terminal device 100 and a peripheral device. And the earphone can also be used for connecting an earphone and playing audio through the earphone. The interface may also be used to connect other terminal devices, such as AR devices and the like.

It should be understood that the interface connection relationship between the modules according to the embodiment of the present invention is only an exemplary illustration, and does not limit the structure of the terminal device 100. In other embodiments of the present application, the terminal device 100 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.

The charging management module 140 is configured to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In one wired charging embodiment, the charging management module 140 may receive charging input from a wired charger via the USB interface 130. In one wireless charging embodiment, the charging management module 140 may receive a wireless charging input through a wireless charging coil of the terminal device 100. The charging management module 140 may also supply power to the terminal device through the power management module 141 while charging the battery 142.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140, and supplies power to the processor 110, the internal memory 121, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be used to monitor parameters such as battery capacity, battery cycle count, battery state of health (leakage, impedance), etc. In one embodiment, the power management module 141 may also be disposed in the processor 110. In another embodiment, the power management module 141 and the charging management module 140 may be disposed in the same device.

The wireless communication function of the terminal device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in terminal device 100 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution including 2G/3G/4G/5G wireless communication applied on the terminal device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 150 may receive the electromagnetic wave from the antenna 1, filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In one embodiment, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In one embodiment, at least some of the functional modules of the mobile communication module 150 may be disposed in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In one embodiment, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional modules, independent of the processor 110.

The wireless communication module 160 may provide a solution for wireless communication applied to the terminal device 100, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), global Navigation Satellite System (GNSS), frequency Modulation (FM), near Field Communication (NFC), infrared (IR), and the like. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering on electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal, and convert the signal into electromagnetic waves through the antenna 2 to radiate the electromagnetic waves.

In one embodiment, the antenna 1 of the terminal device 100 is coupled to the mobile communication module 150 and the antenna 2 is coupled to the wireless communication module 160, so that the terminal device 100 can communicate with a network and other devices through a wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general Packet Radio Service (GPRS), code Division Multiple Access (CDMA), wideband Code Division Multiple Access (WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long Term Evolution (LTE), LTE, BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. The GNSS may include a Global Positioning System (GPS), a global navigation satellite system (GLONASS), a beidou satellite navigation system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).

The terminal device 100 implements a display function by the GPU, the display screen 194, and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 194 is used for displaying images, videos, and the like, wherein the display screen 194 includes a display panel, the display screen may specifically include a folding screen, a special-shaped screen, and the display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (flex-emitting diode, FLED), a miniature, a Micro-o led, a quantum dot light-emitting diode (QLED), and the like. In one embodiment, the terminal device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

The terminal device 100 can implement a photographing function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, etc.

The ISP is used to process the data fed back by the camera 193. For example, when a photo is taken, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converting into an image visible to naked eyes. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In one embodiment, the ISP may be provided in camera 193.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In one embodiment, the terminal device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. For example, when the terminal device 100 selects a frequency point, the digital signal processor is used to perform fourier transform or the like on the frequency point energy.

Video codecs are used to compress or decompress digital video. The terminal device 100 may support one or more video codecs. In this way, the terminal device 100 can play or record video in a plurality of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.

The NPU is a neural-network (NN) computing processor that processes input information quickly by using a biological neural network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. The NPU can implement applications such as intelligent recognition of the terminal device 100, for example: image recognition, face recognition, speech recognition, text understanding, and the like.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to extend the storage capability of the terminal device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music, video, etc. are saved in an external memory card.

The internal memory 121 may be used to store computer-executable program code, which includes instructions. The internal memory 121 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The storage data area may store data (such as audio data, a phonebook, etc.) created during use of the terminal device 100, and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like. The processor 110 executes various functional applications of the terminal device 100 and data processing by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.

The terminal device 100 may implement an audio function through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into analog audio signals for output, and also used to convert analog audio inputs into digital audio signals. The audio module 170 may also be used to encode and decode audio signals. In one embodiment, the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also called a "horn", is used to convert the audio electrical signal into a sound signal. The terminal device 100 can listen to music through the speaker 170A, or listen to a handsfree call.

The receiver 170B, also called "earpiece", is used to convert the electrical audio signal into an acoustic signal. When the terminal device 100 answers a call or voice information, it is possible to answer a voice by bringing the receiver 170B close to the human ear.

The microphone 170C, also referred to as a "microphone," is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can input a voice signal to the microphone 170C by speaking near the microphone 170C through the mouth. The terminal device 100 may be provided with at least one microphone 170C. In other embodiments, the terminal device 100 may be provided with two microphones 170C, which may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the terminal device 100 may further include three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.

The earphone interface 170D is used to connect a wired earphone. The headset interface 170D may be the USB interface 130, or may be an Open Mobile Terminal Platform (OMTP) standard interface of 3.5mm, or a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 180A is used for sensing a pressure signal, and can convert the pressure signal into an electrical signal. In one embodiment, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A can be of a wide variety, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a sensor comprising at least two parallel plates having an electrically conductive material. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The terminal device 100 determines the strength of the pressure from the change in capacitance. When a touch operation is applied to the display screen 194, the terminal device 100 detects the intensity of the touch operation based on the pressure sensor 180A. The terminal device 100 may also calculate the touched position from the detection signal of the pressure sensor 180A. In one embodiment, the touch operations that are applied to the same touch position but have different touch operation intensities may correspond to different operation instructions. For example: and when the touch operation with the touch operation intensity smaller than the first pressure threshold value acts on the short message application icon, executing an instruction for viewing the short message. And when the touch operation with the touch operation intensity larger than or equal to the first pressure threshold value acts on the short message application icon, executing an instruction of newly building the short message.

The gyro sensor 180B may be used to determine the motion attitude of the terminal device 100. In one embodiment, the angular velocity of the terminal device 100 about three axes (i.e., x, y, and z axes) may be determined by the gyro sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. Illustratively, when the shutter is pressed, the gyro sensor 180B detects the shake angle of the terminal device 100, calculates the distance to be compensated for by the lens module according to the shake angle, and allows the lens to counteract the shake of the terminal device 100 through a reverse movement, thereby achieving anti-shake. The gyroscope sensor 180B may also be used for navigation, somatosensory gaming scenes.

The air pressure sensor 180C is used to measure air pressure. In one embodiment, the terminal device 100 calculates an altitude from the barometric pressure measured by the barometric pressure sensor 180C, and assists in positioning and navigation.

The magnetic sensor 180D includes a hall sensor. The terminal device 100 may detect the opening and closing of the flip holster using the magnetic sensor 180D. In one embodiment, when the terminal device 100 is a folder, the terminal device 100 may detect the opening and closing of the folder according to the magnetic sensor 180D. And then according to the detected opening and closing state of the leather sheath or the opening and closing state of the flip, the characteristics of automatic unlocking of the flip and the like are set.

The acceleration sensor 180E can detect the magnitude of acceleration of the terminal device 100 in various directions (generally, three axes). The magnitude and direction of gravity may be detected when the terminal device 100 is stationary. The method can also be used for recognizing the posture of the terminal equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.

A distance sensor 180F for measuring a distance. The terminal device 100 may measure the distance by infrared or laser. In one embodiment, the scene is photographed and the terminal device 100 may range using the distance sensor 180F to achieve fast focus.

The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The terminal device 100 emits infrared light to the outside through the light emitting diode. The terminal device 100 detects infrared reflected light from a nearby object using a photodiode. When sufficient reflected light is detected, it can be determined that there is an object near the terminal device 100. When insufficient reflected light is detected, the terminal device 100 can determine that there is no object near the terminal device 100. The terminal device 100 can utilize the proximity light sensor 180G to detect that the user holds the terminal device 100 close to the ear for talking, so as to automatically turn off the screen to achieve the purpose of saving power. The proximity light sensor 180G may also be used in a holster mode, a pocket mode automatically unlocks and locks the screen.

The ambient light sensor 180L is used to sense the ambient light level. The terminal device 100 may adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L may also be used to automatically adjust the white balance when taking a picture. The ambient light sensor 180L may also cooperate with the proximity light sensor 180G to detect whether the terminal device 100 is in a pocket, in order to prevent accidental touches.

The fingerprint sensor 180H is used to collect a fingerprint. The terminal device 100 can utilize the collected fingerprint characteristics to realize fingerprint unlocking, access to an application lock, fingerprint photographing, fingerprint incoming call answering and the like.

The temperature sensor 180J is used to detect temperature. In one embodiment, the terminal device 100 executes a temperature processing strategy using the temperature detected by the temperature sensor 180J. For example, when the temperature reported by the temperature sensor 180J exceeds the threshold, the terminal device 100 performs a reduction in performance of a processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection. In other embodiments, the terminal device 100 heats the battery 142 when the temperature is below another threshold to avoid the terminal device 100 being abnormally shut down due to low temperature. In other embodiments, when the temperature is lower than a further threshold, the terminal device 100 performs boosting on the output voltage of the battery 142 to avoid abnormal shutdown due to low temperature.

The touch sensor 180K is also called a "touch device". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is used to detect a touch operation applied thereto or nearby. The touch sensor can communicate the detected touch operation to the application processor to determine the touch event type. Visual output associated with the touch operation may be provided through the display screen 194. In other embodiments, the touch sensor 180K may be disposed on the surface of the terminal device 100, different from the position of the display screen 194.

In one embodiment, the touch screen composed of the touch sensor 180K and the display screen 194 may be located in a side area or a folding area of the terminal device 100, and is used for determining a position touched by a user and a gesture touched by the user when the user touches the touch screen with a hand; for example, when the user holds the terminal device, the user can click any position on the touch screen with a thumb, the touch sensor 180K can detect the click operation of the user and transmit the click operation to the processor, and the processor determines the click operation according to the click operation to wake up the screen.

The bone conduction sensor 180M can acquire a vibration signal. In one embodiment, the bone conduction sensor 180M may acquire a vibration signal of the vibrating bone mass of the human voice. The bone conduction sensor 180M may also contact the human pulse to receive the blood pressure pulsation signal. In one embodiment, the bone conduction sensor 180M may also be provided in a headset, integrated into a bone conduction headset. The audio module 170 may analyze a voice signal based on the vibration signal of the bone block vibrated by the sound part obtained by the bone conduction sensor 180M, so as to implement a voice function. The application processor can analyze heart rate information based on the blood pressure beating signal acquired by the bone conduction sensor 180M, so as to realize the heart rate detection function.

The keys 190 include a power-on key, a volume key, and the like. The keys 190 may be mechanical keys. Or may be touch keys. The terminal device 100 may receive a key input, and generate a key signal input related to user setting and function control of the terminal device 100.

The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration cues, as well as for touch vibration feedback. For example, touch operations applied to different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motor 191 may also respond to different vibration feedback effects for touch operations applied to different areas of the display screen 194. Different application scenes (such as time reminding, receiving information, alarm clock, game and the like) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.

Indicator 192 may be an indicator light that may be used to indicate a state of charge, a change in charge, or a message, missed call, notification, etc.

The SIM card interface 195 is used to connect a SIM card. The SIM card can be attached to and detached from the terminal device 100 by being inserted into the SIM card interface 195 or being pulled out of the SIM card interface 195. The terminal device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 may support a Nano SIM card, a Micro SIM card, a SIM card, etc. The same SIM card interface 195 can be inserted with multiple cards at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 may also be compatible with external memory cards. The terminal device 100 interacts with the network through the SIM card to implement functions such as communication and data communication. In one embodiment, the terminal device 100 employs esims, namely: an embedded SIM card. The eSIM card may be embedded in the terminal device 100 and cannot be separated from the terminal device 100.

When the terminal device adopts the special-shaped screen or the folding screen, the touch display screen of the terminal device may include a plurality of touch display areas, for example, the folding screen of the terminal device includes a folding area in a folded state, and the folding area may also implement touch response. However, in the prior art, the operation of the terminal device on a specific touch display area is limited to a relatively large extent, and no relevant operation is specifically performed on the specific touch display area, and based on this, an embodiment of the present application provides a gesture interaction method, where a touch response area exists in a side area or a folding area of the terminal device in the gesture interaction method, and the terminal device may obtain an input event of the touch response area, and in response to the input event, trigger the terminal device to execute an operation instruction corresponding to the input event, so as to implement a gesture operation on the side area or the folding area of the terminal device, and improve the operation experience of the terminal device.

In the terminal device disclosed in embodiment 1 of the present application, the memory is configured to store a computer program, and the processor is configured to execute the computer program stored in the memory, so that the terminal device executes the method described in embodiment 3 of the present application.

Example 2

The graphic card 20 provided by the embodiment 2 of the application aims at the problems that different focuses Duan Tuka are not normalized and the distortion exists at the wide-angle edge in the multi-shooting definition test, so that the definition of the cameras with different focal sections and different models can not be calculated, the test areas for the cameras with different focal sections are combined in one graphic card 20, the definition test of the multi-focal sections of the multi-camera can be covered, and the purpose of simultaneously testing the definition of the cameras with different focuses Duan Butong is realized.

As shown in fig. 6, the graphic card 20 includes a plurality of test areas 21, 22, and 23, the plurality of test areas 21, 22, and 23 respectively correspond to different focal segments, a plurality of black blocks 24 are arranged in each test area 21, 22, and 23, and the arrangement density of the black blocks 24 in each test area 21, 22, and 23 increases with the increase of the focal segment.

The arrangement density of the black blocks 24 in the graphic card 20 is actually divided according to the actual situation of the camera, and if the focus Duan Yue of the tested camera is far, the density of the black blocks 24 is larger, because under the condition of the focus Duan Yuan, if the black blocks 24 shot by the camera are sparse, a large number of black blocks 24 cannot be accurately received, and the imaging characteristic of the camera cannot be accurately judged. If the focal length of the tested camera is short, if the shot black blocks 24 are dense, the interval area for calculating the black blocks 24 is smaller when the camera is tested, so that the sampling length of the test picture shot by the camera does not meet the requirement, and the test is possibly inaccurate. In addition, the pixels of the black and white region boundary segment between the black block 24 and the non-black block 24 are required, and must match the imaging requirements of the cameras of different focal segments.

The graphic card 20 of this embodiment 2 realizes that the same graphic card 20 can cover the definition test of many camera multi-focus sections, effectively reduces the test space requirement of definition test place, shortens and produces line body length, saves cost and raises the efficiency.

In the chart 20 of this embodiment 2, the plurality of test areas includes a first test area 21, a second test area 22, and a third test area 23.

Specifically, the first test area 21 is used for testing the 0.6-1.5-time Jiao Duan camera, the first test area 21 is in an X shape composed of two oblique line areas 25, and the two oblique line areas 25 extend along the diagonal line 28 of the graphic card 20 to form an X-shaped checkerboard area. The second test area 22 is used for testing 3 times or more of the focal length of the camera, the second test area 22 is an upper triangular area and a lower triangular area which are divided by two oblique line areas 25, and the upper triangular area and the lower triangular area are triangular checkerboard areas formed by checkerboards. The third test area 23 is used for testing a camera at a focal length of 1.5-3 times, the third test area 23 is a left triangular area and a right triangular area which are divided by two oblique line areas 25, and the left triangular area and the right triangular area are triangular checkerboard areas formed by checkerboards. The length of the right-angle side 27 intersecting each side 26 of the graphic card 20 in the first test area 21 is not more than 1/5 of the length of the corresponding side 26 of the graphic card 20, and the width of the two oblique line areas 25 forming the X shape in the first test area 21 along the direction of the diagonal line 28 cannot be too large, otherwise the definition test effect of the second test area 22 and the third test area 23 is affected. As can be seen from fig. 6, among the three test areas, the first test area 21 has the smallest number of black blocks 24, the largest shape, and the sparsest arrangement density, the second test area 22 has the largest number of black blocks 24, the smallest shape, and the closest arrangement density, and the third test area 23 has the number of black blocks 24, the smallest shape, and the closest arrangement density in between the first test area 21 and the second test area 22. And in the first test area 21, only one black block 24 located at the center and eight black blocks 24 distributed along two diagonal lines 28 and symmetrical with respect to the center are arranged near the center of the graphic card 20, and the nine black blocks 24 are used for the alignment operation of the camera before the test and the detection work of whether the camera deflects during the test.

In the graphic card 20 of this embodiment 2, the three test areas 21, 22, and 23 designed for the cameras with three different focal lengths can all achieve a good test effect.

In the chart 20 of the present embodiment 2, in the first test area 21, each of the diagonal line areas 25 has a plurality of rows of black blocks 24 extending along a corresponding diagonal line 28, and the plurality of rows of black blocks 24 have rotation angles with respect to the respective edges 26 of the chart 20, wherein the rotation angle of the row of black blocks 24 closest to the diagonal line 28 is the same as a preset rotation angle, the rotation angles of the remaining rows of black blocks 24 are plus and minus angles based on the preset rotation angle, and the positive and negative angles of the black blocks 24 on the same side of the diagonal line 28 are the same.

In the graph card 20 of this embodiment 2, in the two diagonal line regions 25 of the first test region 21, the row of black blocks 24 forming the region closest to the central diagonal line 28 of the X shape rotates according to the rotation angle satisfying the preset rotation angle of the SFR test, and the two rows of black blocks 24 relatively outside rotate according to the rotation angle having a certain positive and negative angle with the rotation angle, so that the black block 24 most suitable for calculating the SFR can be selected when the resolution test is performed on the camera, and the problem of edge distortion of the camera can be offset in advance.

In addition, as shown in fig. 7, 8 and 9, the first test area 21, the second test area 22 and the third test area 23 all contain a calibration cross 29 and a reference point 30 for testing defects of a deflection angle of the camera, so that when the camera performs a definition test, whether the camera deflects due to external factors or self factors can be detected, and the angle of the camera can be adjusted to avoid influencing the accuracy of the definition test performed on the camera.

Example 3

The embodiment 3 provides a method for testing the definition of a terminal camera, which is used for testing the definition of the camera by using the graphic card 20 disclosed in the embodiment 2 and is used for solving the problem that the multi-camera multi-focus-section definition test graphic card is not normalized, solving the problem that the multi-camera multi-focus section needs various graphic cards and a plurality of test devices, reducing the SFR test stations of the camera and solving the problem that the edge distortion during the definition test of the multi-camera wide-focus section cannot be calculated.

As shown in fig. 10, the test method of the present embodiment 3 includes:

step100: aligning the camera to a test area corresponding to the focal section of the camera in a plurality of test areas of the graphic card;

step200: shooting the test area to obtain a test picture and the resolution of the test picture;

step300: selecting a plurality of fields with different radius sizes by taking the picture center of the test picture as an origin based on the resolution of the test picture;

step400: respectively acquiring intersection point coordinates of intersection points of each diagonal line of the test picture and the peripheries of the plurality of view fields;

step500: selecting a black block to be tested which meets a preset squareness degree from a plurality of black blocks distributed in a test area;

step600: selecting a target black block with an inclination angle meeting a preset angle from a plurality of black blocks to be detected;

step700: the ROI region is formed based on the target black block.

In Step100, for example, in a 0.6-to 1.5-fold camera test scenario, the camera is directed to the first test area 21 in the card 20 of embodiment 2, and the black block 24 having a rotation angle in the X-shaped first test area 21 in the card 20 of embodiment 2 is used to select the target black block 36 to form the ROI area 38 through steps 200 to 700.

Referring to fig. 11, taking a test scene of a camera of Jiao Duan of 0.6-1.5 times as an example, in Step300, according to the resolution of an obtained test picture, the test picture is calculated, and three concentric circles 31 represented by three viewing fields are drawn with the picture center 32 as an origin, the radii of the three viewing fields are 0.3, 0.5, and 0.8 respectively, and represent the long-focus, short-focus, and wide-angle viewing fields in the test picture, the three concentric circles 31 are used for testing the definition of viewing field areas of different radii, but are not actually drawn, and are used for dividing the ranges of test areas 21, 22, and 23 in the graphic card 20, and an appropriate black block 24 is searched in the ranges to form an ROI area for a definition test.

The testing method of the embodiment 3 enables the definition test of the multi-focus section of the multiple cameras to be performed on one graphic card 20, effectively reduces the testing stations of the cameras, and can offset the edge distortion of the cameras.

In the test method of this embodiment 3, step100 includes:

step101: identifying a test area corresponding to the focal section of the camera in a plurality of test areas of the graphic card according to the focal section of the camera;

step102: and adjusting the projection position of the central point of the camera on the graphic card to enable the central point of the camera to be aligned to the test area corresponding to the focal section of the camera.

When Step102 is executed, the center point of the camera is aligned with the geometric center of the triangle when the camera is aligned with the second test area 22 or the third test area 23.

The test method of embodiment 3 can enable the camera to automatically identify the test areas 21, 22, 23 applicable to each focal length in the graphic card 20, and accurately align the test areas 21, 22, 23 corresponding to the focal length of the camera, and especially in the case of a multi-focal length, can automatically adjust the angle of the camera to align the correct test areas 21, 22, 23 when the camera is in the zoom length, and in the case of a multi-camera, can implement the function of performing the definition test when the multi-camera in different focal lengths aligns different test areas 21, 22, 23 respectively.

In the test method of this embodiment 3, step400 includes:

step401: obtaining each diagonal line of the test picture based on the resolution of the test picture;

step402: obtaining diagonal coordinate values of each diagonal line and field of view coordinate values of the periphery of a plurality of fields of view based on the picture center and the resolution of the test picture;

step403: the diagonal coordinate values and the field coordinate values are calculated to obtain each intersection point 33 where each diagonal intersects the periphery of the plurality of fields and the coordinates of the intersection point.

Referring to fig. 12, step401 is executed, after the resolution of the test picture is calculated, two diagonal lines 28 of the test picture can be drawn; step402 is executed, the picture center 32 is taken as an origin, and the diagonal coordinate value of the diagonal line 28 and the field coordinate value of three concentric circles 31 representing the outermost peripheries of the three fields are calculated; and executing Step403, and calculating the coordinate values of the diagonal lines and the coordinate values of the field of view to obtain four intersection points 33 and intersection point coordinates of the four intersection points 33, where each diagonal line 28 intersects each concentric circle 31.

In the test method of this embodiment 3, four intersection points 33 intersecting the diagonal line 28 are respectively taken on each field of view, and rectangular regions similar to the test picture are formed in different field of view ranges, which is helpful for calculating edge distortion of the camera.

In the test method of this embodiment 3, step500 includes:

step501: sequentially traversing the picture center and each intersection point of the test picture;

step502: selecting a search area by taking the center of the picture and each intersection point as the center;

step503: calculating the squareness of each black block in each search area;

step504: and respectively selecting black blocks meeting the preset squareness in each search area as black blocks to be detected.

Referring to fig. 13, step501 is executed, and the black block 35 to be detected is searched for the center 32 of the picture and the twelve intersection points 33 in sequence; step502 is executed, and a rectangular area within a certain range is selected as a search area 34 at each intersection point 33 by taking the intersection point 33 as the center; step503 is executed, and the squareness degree of each black block 24 in the search area 34 is calculated; and Step504 is executed to find out the black blocks 24 meeting the preset squareness, namely the black blocks 24 with the best squareness, wherein the black blocks 24 with the best squareness are the black blocks 35 to be tested which are screened out at the center 32 of the traversal picture and the twelve intersection points 33. The range and size of the search area 34 can be determined according to the actual application scenario or the user requirement.

The testing method of this embodiment 3 primarily screens the black blocks 24 near each intersection 33 where edge distortion needs to be measured, and selects the black block 24 with good squareness and easy edge calculation as the black block 35 to be tested, which helps to simplify the calculation of the sharpness test and save the calculation resources.

In the test method of this embodiment 3, step600 includes:

step601: extracting coordinate values of all edges of the black block to be detected;

step602: calculating the slope of each edge to obtain the inclination angle of the black block to be detected;

step603: respectively carrying out matching calculation on the inclination angle of each black block to be detected and a preset angle to obtain the matching degree of each black block to be detected;

step604: and taking the black block to be detected with the highest matching degree as a target black block.

Through steps 601 to 604, a preset angle with the inclination angle closest to the requirement of the SFR test is found out from all the screened black blocks 35 to be tested, and the preset angle is used as the target black block 36 of the selected ROI area 38. Referring to fig. 13, taking the camera as a wide-angle focal segment, taking an example that the radius of a concentric circle 31 representing the outermost periphery of the field of view is 0.8, four black blocks 35 to be measured, which satisfy requirements, a, b, c, and d, are screened near an intersection point 33 of the field of view and a diagonal line 28, after the slopes of the edges of the four black blocks 35 to be measured are calculated respectively, finally, the slope of the black block 35 to be measured, which is No. c, satisfies the requirement of the slope angle calculated by the SFR, and is selected as a target black block 36.

In the testing method of this embodiment 3, the screened black blocks 35 to be tested are further screened, and the black blocks 35 to be tested whose inclination angle is closest to the preset angle are selected as the target black blocks 36, so that the optimal calculation result is ensured when the oblique sides of the target black blocks 36 are calculated in the full view scene in the testing process.

In the test method of this embodiment 3, step700 includes:

step701: extracting coordinate values of all edges of the target black block;

step702: obtaining coordinate values of the middle points of all edges;

step703: the ROI area is formed based on the respective midpoints.

In fig. 13, after the target black block 36 is selected, the center point 37 of each edge of the target black block 36 is calculated, and the ROI region 38 is formed.

The test method of embodiment 3 helps to offset the effect of camera edge distortion.

As shown in fig. 14, the test method in this embodiment 3 further includes:

step800: aligning the shooting center of the camera to the calibration cross in the test area;

step900: capturing four reference points symmetrically arranged around the calibration cross and around the center of the calibration cross;

step1000: calculating the slope of a connecting line between two reference points which are positioned on the same side of the calibration cross to obtain a deflection angle;

step1100: comparing the deflection angle with a preset rotation angle;

when the deflection angle is larger than the preset rotation angle, step1200 is executed: and adjusting the position of the camera.

Referring to fig. 15, when cameras of different focuses Duan Beilv are aligned to corresponding test areas 21, 22 and 23 for shooting, the deflection defect of camera installation can be calculated by taking a cross as a calibration cross 29 and 4 reference points 30 uniformly distributed around the cross. Among them, steps 800 to 1100 can be executed in synchronization with steps 100 to 700.

The testing method of the embodiment 3 can detect the deflection of the camera in the testing process in real time, adjust the camera in time, cover the deflection angle detection of multiple camera and multiple focal sections, and improve the accuracy of the definition test of the camera.

Example 4

As shown in fig. 16, a system for testing the sharpness of a terminal camera provided in embodiment 4 of the present application includes: the device comprises a camera alignment module 11, a test picture acquisition module 12, a view field selection module 13, an intersection point acquisition module 14, a black block to be detected selection module 15, a target black block screening module 16, an ROI area forming module 17 and a deflection angle detection module 18 which are in communication connection with each other. The camera alignment module 11 is configured to align the camera with a test area corresponding to a focal length of the camera in the multiple test areas of the graphic card; the test picture acquisition module 12 is used for shooting a test area to acquire a test picture and the resolution of the test picture; the view field selection module 13 is configured to select a plurality of view fields with different radii based on the resolution of the test picture, with the picture center of the test picture as an origin; the intersection point acquisition module 14 is configured to acquire intersection point coordinates of intersection points where each diagonal line of the test picture intersects with the peripheries of the plurality of view fields, respectively; the black block to be tested selecting module 15 is configured to select a black block to be tested that meets a preset squareness from the plurality of black blocks arranged in the test area; the target black block screening module 16 is configured to select a target black block, of which an inclination angle satisfies a preset angle, from the plurality of black blocks to be detected; the ROI area forming module 17 is used for forming an ROI area based on the target black block; the deflection angle detection module 18 is configured to align a shooting center of the camera with a calibration cross in the test area, capture four reference points symmetrically arranged around the calibration cross with respect to a center of the calibration cross, calculate a slope of a connection line between the two reference points located on the same side of the calibration cross, obtain a deflection angle, compare the deflection angle with a preset rotation angle, and adjust a position of the camera when the deflection angle is greater than the preset rotation angle.

The test system of this embodiment 4 utilizes this seven modules to make the definition test of many focuses of many cameras section can test on a picture card, effectively reduces the test station of camera, can also offset the marginal distortion of camera, utilizes deflection angle detection module 18 can detect out the deflection of camera in the testing process in real time, in time adjusts the camera, and can cover the deflection angle detection of many focuses of many cameras section, improves the degree of accuracy of camera definition test.

Example 5

Embodiment 5 of the present application provides a computer-readable storage medium, which includes a program or instructions, and when the program or instructions are run on a computer, the speech recognition method as disclosed in embodiment 2 of the present application is executed.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored on a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website, computer, server, or data center to another website, computer, server, or data center via wire (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., digital Video Disk (DVD)), or a semiconductor medium (e.g., solid State Disk (SSD)), among others.

The method and the system for testing the definition of the terminal camera, the image card and the terminal equipment can realize the definition test of the multi-focus section of the terminal camera covered by one image card, are suitable for the application scene of batch test of the multi-camera multi-focus section, effectively reduce the test stations of the terminal camera, improve the test efficiency and eliminate the influence of edge distortion of a multi-camera wide-angle focus section definition test chamber.

Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the examples described in connection with the embodiments disclosed herein may be embodied in electronic hardware, computer software, or combinations of both, and that the components and steps of the examples have been described in a functional general in the foregoing description for the purpose of illustrating clearly the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the technical solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

The present invention is not intended to be limited to the particular embodiments shown and described, but is to be accorded the widest scope consistent with the principles and novel features herein disclosed.

Claims (13)

1. A method for testing the definition of a terminal camera is characterized by comprising the following steps:

aligning the camera to a test area corresponding to a focal section of the camera in a plurality of test areas of the graphic card;

shooting the test area to obtain a test picture and the resolution of the test picture;

selecting a plurality of fields of view with different radii based on the resolution of the test picture by taking the picture center of the test picture as an origin;

respectively acquiring intersection point coordinates of intersection points of each diagonal line of the test picture and the peripheries of the plurality of view fields;

selecting a black block to be tested which meets a preset squareness degree from a plurality of black blocks distributed in the test area;

selecting a target black block with an inclination angle meeting a preset angle from the plurality of black blocks to be detected;

and forming an ROI area based on the target black block.

2. The method for testing the definition of the terminal camera according to claim 1, wherein in the step of aligning the camera with a test area corresponding to a focal section of the camera among a plurality of test areas of a graphic card, the method comprises:

identifying a test area corresponding to the focal section of the camera in a plurality of test areas of the graphic card according to the focal section of the camera;

and adjusting the projection position of the central point of the camera on the graphic card to enable the central point of the camera to be aligned with the test area corresponding to the focal section of the camera.

3. The method for testing the sharpness of a camera in a terminal according to claim 1, wherein the step of obtaining the coordinates of the intersection points of the respective intersections where the respective diagonals of the test picture intersect with the peripheries of the plurality of fields of view includes:

obtaining each diagonal line of the test picture based on the resolution of the test picture;

obtaining diagonal coordinate values of the diagonals and field of view coordinate values of the peripheries of the plurality of fields of view based on the picture center and the resolution of the test picture;

and calculating the coordinate values of the diagonals and the coordinate values of the field of view to obtain each intersection point and intersection point coordinates of each diagonal line and the periphery of the plurality of fields of view.

4. The method for testing the definition of the terminal camera according to claim 1, wherein the step of selecting the black block to be tested which satisfies a preset squareness among the plurality of black blocks arranged in the test area comprises:

sequentially traversing the picture center of the test picture and each intersection point;

selecting a search area by taking the picture center and each intersection point as a center;

calculating the squareness of each black block in each search area;

and selecting black blocks meeting the preset squareness in each search area as black blocks to be detected.

5. The method for testing the definition of the terminal camera according to claim 1, wherein the step of selecting the target black block with the inclination angle satisfying the preset angle from the plurality of black blocks to be tested comprises:

extracting coordinate values of each edge of the black block to be detected;

calculating the slope of each edge to obtain the inclination angle of the black block to be detected;

matching and calculating the inclination angle of each black block to be detected with a preset angle respectively to obtain the matching degree of each black block to be detected;

and taking the black block to be detected with the highest matching degree as a target black block.

6. The method for testing the definition of the terminal camera according to claim 1, wherein in the step of forming the ROI area based on the target black block, the method comprises the following steps:

extracting coordinate values of all edges of the target black block;

obtaining coordinate values of the middle points of the edges;

an ROI area is formed based on each of the midpoints.

7. The method for testing the definition of the terminal camera according to claim 1, wherein the method further comprises:

aligning the shooting center of the camera to the calibration cross in the test area;

capturing four reference points symmetrically arranged around the calibration cross with respect to the center of the calibration cross;

calculating the slope of a connecting line between the two reference points which are positioned on the same side of the calibration cross to obtain a deflection angle;

comparing the deflection angle with a preset rotation angle;

and when the deflection angle is larger than the preset rotation angle, adjusting the position of the camera.

8. The utility model provides a test system of terminal camera definition which characterized in that, test system includes: the system comprises a camera alignment module, a test picture acquisition module, a view field selection module, an intersection point acquisition module, a black block to be tested selection module, a target black block screening module and an ROI area forming module which are in communication connection with each other;

the camera alignment module is used for aligning the camera to a test area corresponding to a focal section of the camera in a plurality of test areas of the graphic card;

the test picture acquisition module is used for shooting the test area to acquire a test picture and the resolution of the test picture;

the view field selection module is used for selecting a plurality of view fields with different radius sizes by taking the picture center of the test picture as an origin based on the resolution of the test picture;

the intersection point acquisition module is used for respectively acquiring intersection point coordinates of intersection points of each diagonal line of the test picture and the peripheries of the plurality of view fields;

the black block to be tested selecting module is used for selecting black blocks to be tested meeting the preset squareness from the plurality of black blocks distributed in the test area;

the target black block screening module is used for selecting a target black block of which the inclination angle meets a preset angle from the plurality of black blocks to be detected;

the ROI area forming module is used for forming an ROI area based on the target black block.

9. The graphic card is characterized by comprising a plurality of test areas, wherein the test areas correspond to different focal segments respectively, a plurality of black blocks are distributed in each test area, and the distribution density of the black blocks in each test area is increased along with the increase of the focal segments.

10. The graphic card of claim 9, wherein the plurality of test areas comprise a first test area, a second test area and a third test area, the first test area is used for testing 0.6-1.5 times of Jiao Duan cameras, the second test area is used for testing 3 times and above focal length cameras, and the third test area is used for testing 1.5-3 times of focal length cameras;

the first test area is in an X shape consisting of two oblique line areas, the two oblique line areas extend along the diagonal line of the graph card, the second test area is an upper triangular area and a lower triangular area which are divided by the two oblique line areas, and the third test area is a left triangular area and a right triangular area which are divided by the two oblique line areas;

the length of the right-angle side in the first test area, which is intersected with each side of the graphic card, is not more than 1/5 of the length of the corresponding side of the graphic card.

11. The card of claim 10, wherein in the first test area, each of the sloped line regions has a plurality of rows of black blocks extending along the respective corresponding diagonal line;

the black blocks in the rows have rotation angles relative to the edges of the graphic card, wherein the rotation angle of the black block in the row closest to the diagonal is the same as a preset rotation angle, the rotation angles of the black blocks in the other rows are positive and negative angles added on the basis of the preset rotation angle, and the positive and negative angles of the black blocks on the same side of the diagonal are the same.

12. A terminal device, comprising: a memory and a processor:

the memory for storing a computer program;

the processor is used for executing the computer program stored in the memory so as to enable the terminal equipment to execute the method for testing the definition of the terminal camera according to any one of claims 1 to 7.

13. A computer-readable storage medium, characterized by comprising a program or instructions for executing the method for testing the intelligibility of a terminal camera according to any one of claims 1 to 7 when said program or instructions are run on a computer.

Images