WO2017088594A1 - Mobile terminal, information processing method, and computer storage medium - Google Patents

Abstract

Disclosed in embodiments of the present invention are a mobile terminal, an information processing method, and a computer storage medium. The mobile terminal comprises: an image collection unit, configured to collect a first image and send the first image to an image processing unit; the image processing unit, configured to divide the first image into N×M regions and acquire an average gray scale value of each region, N and M being both positive integers; and a determining unit, configured to calculate a difference between the average gray scale value of a first region and the average gray scale value of a second region, and determining whether the difference between the average gray scale value of the first region and the average gray scale value of the second region is greater than a first threshold, and obtain the determining result; when the determining result is that the difference between the average gray scale value of the first region and the average gray scale value of the second region is greater than the first threshold, and determine that a first subregion of the first region corresponding to the image collection unit of the mobile terminal is in an abnormal state, or a second subregion of the second region corresponding to the image collection unit of the mobile terminal is in an abnormal state.

Description

Mobile terminal, information processing method and computer storage medium Technical field

The present invention relates to information processing technologies, and in particular, to a mobile terminal, an information processing method, and a computer storage medium.

Background technique

The mobile terminal lens module is mainly composed of a lens and a complementary metal oxide semiconductor (CMOS) sensor. In the process of assembling the lens module to the mobile terminal, it may be generated due to the influence of working conditions. Flower screen, dirty and other issues. The specific expression is that a color patch, a black spot, or a black stripe-like mark appears on the captured image of the mobile terminal. In the current technology, after the camera is photographed by the mobile terminal, the image is transmitted to the computer, and the image is enlarged on the computer to check the dirty state of the image by the naked eye, so as to know whether the lens module has a flower screen, dirt, etc. problem. This detection method not only consumes a lot of human resources, but also has low efficiency, is prone to errors, and it is difficult to make accurate judgments on the dirty situation due to human subjectivity.

Summary of the invention

In order to solve the existing technical problems, the embodiments of the present invention provide a mobile terminal, an information processing method, and a computer storage medium, which can quickly and accurately detect whether a lens module in a mobile terminal is dirty or a screen. Reduce human resources and improve detection efficiency.

To achieve the above objective, the technical solution of the embodiment of the present invention is implemented as follows:

An embodiment of the present invention provides a mobile terminal, where the mobile terminal includes: an image acquisition unit, an image processing unit, and a determination unit;

The image acquisition unit is configured to acquire a first image, and send the first image to the An image processing unit; the image acquisition area corresponding to the first image is uniform in brightness and the brightness parameter meets a preset threshold;

The image processing unit is configured to divide the first image into N×M regions, and obtain a gray average value of each region; N and M are positive integers;

The determining unit is configured to calculate a difference between the grayscale average values of the first region and the second region, and determine whether a difference between the grayscale average values of the first region and the second region is greater than a first threshold, Obtaining a judgment result; wherein the first area and the second area are any one of the N×M areas, and the first area and the second area are separated by a third area; When the result of the determination is that the difference between the grayscale average values of the first region and the second region is greater than the first threshold, determining that the first region corresponds to the first of the image acquisition unit of the mobile terminal The sub-area is in an abnormal state, or the second sub-area of the second area corresponding to the image acquisition unit of the mobile terminal is in an abnormal state.

As an embodiment, the first region A _{m, n,} and the second region A _{m-2, n} between the spaced apart in the vertical direction of the third region A _{m-1, n;} or, the first a region A _m,n and the second region A _m,n-2 are spaced apart from each other in the horizontal direction by a third region A _m,n-1 ; wherein m and n are positive integers greater than or equal to 2, and n is less than or equal to N, and m is less than or equal to M; the first region A _m,n represents the _{nth and the mth} region in the horizontal direction starting from the preset starting position in the N×M regions.

As an embodiment, the determining unit is configured to determine whether a difference between a gray average value of the first area A _m,n and the second area A _m-2,n is greater than a first threshold, and Or determining whether the difference between the gray average values of the first area A _m,n and the second area A _m,n-2 is greater than a first threshold, obtaining a first determination result; when the first The result of the determination is that the difference between the gray average values of the first area A _m,n and the second area A _m-2,n is greater than a first threshold, or the first area _Am,n and the the second region a _m, an average value of the gradation difference _n-2 is greater than a first threshold value, determining that the first area corresponds to a first sub-region of the image acquisition unit of the mobile terminal is in an abnormal state, or the The second area corresponding to the second sub-area of the image acquisition unit of the mobile terminal is in an abnormal state.

In one embodiment, the determining unit is configured to: when the first determination result is a difference between a gray average value of the first area A _m,n and the second area A _m-2,n When the difference between the gray level average of the first area _Am,n and the second area _Am,n-2 is greater than the first threshold, determining that the first area corresponds to the The first sub-area of the image acquisition unit of the mobile terminal is in an abnormal state.

In an embodiment, the determining unit is further configured to: when the first determination result is a difference between the gray average values of the first area A _m,n and the second area A _m-2,n The value is not greater than the first threshold, and when the difference between the gray level average values of the first area A _m,n and the second area A _m,n-2 is not greater than the first threshold, determining The first area corresponds to a first sub-area of the image acquisition unit of the mobile terminal in a normal state.

As an implementation manner, the determining unit determines that the first sub-region corresponding to the image acquiring unit of the mobile terminal is in an abnormal state, and includes: determining that the first region is in the first image a first position, determining a first relative positional relationship of the first region and the first image based on the first position; obtaining a first corresponding to the first relative positional relationship in the image acquisition unit a sub-area, determining that the first sub-area of the image acquisition unit is in an abnormal state.

As an implementation manner, the determining unit determines that the second area corresponding to the second sub-area of the image acquiring unit of the mobile terminal is in an abnormal state, and includes: determining that the second area is in the first image a second position, determining a second relative positional relationship of the second region and the first image based on the second position; obtaining a second corresponding to the second relative positional relationship in the image acquisition unit The two sub-areas determine that the second sub-area of the image acquisition unit is in an abnormal state.

As an embodiment, the image processing unit is configured to recognize red and green of each area a blue (RGB) value; performing a calculation process according to a preset algorithm based on the RGB values of each of the regions to obtain a grayscale average value of each of the regions; wherein the preset algorithm includes one of the following algorithms: floating Point algorithm, integer algorithm.

As an implementation manner, the image capture area corresponding to the first image has uniform brightness and the preset threshold value that the brightness parameter meets satisfies 1750 lux (Lux) to 1850 Lux.

An embodiment of the present invention further provides an information processing method, where the method includes:

Collecting a first image; the image capturing area corresponding to the first image is uniform in brightness and the brightness parameter meets a preset threshold;

Dividing the first image into N×M regions, obtaining a gray average value of each region; N and M are positive integers;

Calculating a difference between the grayscale average values of the first region and the second region, determining whether a difference between the grayscale average values of the first region and the second region is greater than a first threshold, and obtaining a determination result; The first area and the second area are any of the N×M areas, and the first area and the second area are separated by a third area;

When the result of the determination is that the difference between the grayscale average values of the first region and the second region is greater than the first threshold, determining that the first region corresponds to the first of the image acquisition unit of the mobile terminal The sub-area is in an abnormal state, or the second sub-area of the second area corresponding to the image acquisition unit of the mobile terminal is in an abnormal state.

As an embodiment, the first area A _m,n and the second area A _m-2,n are separated from each other by a third area A _m-1,n in the horizontal direction; or, the first area a _{m, n,} and the second region a _{m, n-2} spaced between the third region in a vertical direction a _{m, n-1;} wherein, m and n are positive integers greater than or equal to 2, and n is less than or equal to N, and m is less than or equal to M; the first region A _m,n represents the _{nth and the mth} region in the horizontal direction starting from the preset starting position in the N×M regions.

As an implementation manner, the determining the gray level of the first area and the second area Whether the mean is greater than the first threshold, including:

Determining whether a difference between a gray average value of the first area A _m,n and the second area A _m-2,n is greater than a first threshold, and/or determining the first area A _m,n And whether a difference between the gray average values of the second regions A _{m, n-2} is greater than a first threshold, obtaining a first determination result;

When the first determination result is that the difference between the gray average values of the first area A _m,n and the second area A _m-2,n is greater than a first threshold, or the first area A _{m And determining, when n} and the difference between the gray average values of the second regions A _{m, n-2} are greater than the first threshold, determining that the difference between the gray average values of the first region and the second region is greater than a threshold

Correspondingly, determining that the first area corresponds to an abnormal state of the first sub-area of the image acquisition unit of the mobile terminal, or that the second area is corresponding to the second sub-area of the image acquisition unit of the mobile terminal Abnormal state.

As an embodiment, when the first determination result is that the difference between the gray average values of the first area A _m,n and the second area A _m-2,n is greater than the first threshold, and When the difference between the gray level average values of the first area A _{m, n} and the second area A _{m, n-2} is greater than the first threshold, the method further includes: determining that the first area corresponds to the The first sub-area of the image acquisition unit of the mobile terminal is in an abnormal state.

As an embodiment, when the first determination result is that the difference between the gray average values of the first area A _m,n and the second area A _m-2,n is not greater than the first threshold And, when the difference between the gray average values of the first area A _m,n and the second area A _m,n-2 is not greater than the first threshold, the method further includes: determining the a difference between a gray level average of the first area and the second area is not greater than a first threshold;

Correspondingly, determining that the first area corresponds to a first sub-area of the image acquisition unit of the mobile terminal is in a normal state.

As an implementation manner, the determining that the first area corresponds to an abnormal state of the first sub-area of the image capturing unit of the mobile terminal, including:

Determining a first location of the first region in the first image, determining a first relative positional relationship of the first region and the first image based on the first location; in the image acquisition unit Obtaining a first sub-region corresponding to the first relative positional relationship, determining that the first sub-region of the image acquisition unit is in an abnormal state.

As an implementation manner, the determining that the second area corresponds to an abnormal state of the second sub-area of the image collection unit of the mobile terminal includes:

Determining a second position of the second region in the first image, determining a second relative positional relationship of the second region and the first image based on the second position; in the image acquisition unit Obtaining a second sub-region corresponding to the second relative positional relationship, determining that the second sub-region of the image acquisition unit is in an abnormal state.

As an implementation manner, the obtaining a gray average value of each region includes: identifying red, green, and blue (RGB) values of each region; and performing calculation processing according to a preset algorithm based on RGB values of each of the regions The grayscale average of each region; wherein the preset algorithm includes one of the following algorithms: a floating point algorithm, an integer algorithm.

As an implementation manner, the image capture area corresponding to the first image has uniform brightness and the preset threshold value that the brightness parameter meets satisfies 1750 lux (Lux) to 1850 Lux.

As an implementation manner, the N and M are pre-configured according to at least one of a screen resolution, a screen pixel density, and an image acquisition unit pixel parameter of the mobile terminal.

The embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are configured to execute the information processing method according to the embodiment of the invention.

The mobile terminal, the information processing method, and the computer storage medium provided by the embodiment of the present invention, the mobile terminal includes: an image acquisition unit, an image processing unit, and a determination unit; wherein the image acquisition unit is configured to collect the first image, and Sending the first image to the image processing unit; the image capturing area corresponding to the first image is uniform in brightness and the brightness parameter meets the preset a threshold value; the image processing unit configured to divide the first image into N×M regions, obtain a gray average value of each region; N and M are positive integers; and the determining unit is configured to calculate a difference between a gray average value of the first area and the second area, determining whether a difference between the gray average values of the first area and the second area is greater than a first threshold, and obtaining a determination result; The first area and the second area are any of the N×M areas, and the first area and the second area are separated by a third area; when the determination result is the When the difference between the grayscale average values of the first region and the second region is greater than the first threshold, determining that the first region corresponds to an abnormal state of the first sub-region of the image acquisition unit of the mobile terminal, or The second area corresponding to the second sub-area of the image acquisition unit of the mobile terminal is in an abnormal state. According to the technical solution of the embodiment of the present invention, on the one hand, it is not necessary to observe the collected photos through the human eye, whether there is abnormality such as dirt, greatly reducing human resources, shortening the detection time, improving the detection efficiency, and avoiding the manual detection. The misjudgment situation avoids the abnormal situation such as dirt in the mobile terminal and is not found when manually detected, and also greatly improves the product quality of the mobile terminal, thereby improving the user experience. On the other hand, the technical solution of the embodiment of the invention can quickly and accurately detect whether the image acquisition unit of the mobile terminal has abnormal conditions such as dirt and flower screen, shorten the detection time, and greatly improve the detection efficiency.

DRAWINGS

1 is a schematic structural diagram of hardware of an optional mobile terminal embodying various embodiments of the present invention;

2 is a schematic diagram of a wireless communication system of the mobile terminal shown in FIG. 1;

3 is a schematic structural diagram of a structure of a mobile terminal according to an embodiment of the present invention;

4 is a schematic diagram of an application scenario of a mobile terminal according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of dividing a first image into N×M regions according to an embodiment of the present invention; FIG.

6a and 6b are schematic diagrams showing display of a first image according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of a first process of an information processing method according to an embodiment of the present invention; FIG.

FIG. 8 is a second schematic flowchart diagram of an information processing method according to an embodiment of the present invention;

The implementation, functional features, and advantages of the present invention will be further described in conjunction with the embodiments.

detailed description

It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

A mobile terminal embodying various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, the use of suffixes such as "module", "component" or "unit" for indicating an element is merely an explanation for facilitating the present invention, and does not have a specific meaning per se. Therefore, "module" and "component" can be used in combination.

The mobile terminal can be implemented in various forms. For example, the terminal described in the present invention may include, for example, a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet), a PMP (Portable Multimedia Player), a navigation device, etc. Mobile terminals and fixed terminals such as digital TVs, desktop computers, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, those skilled in the art will appreciate that configurations in accordance with embodiments of the present invention can be applied to fixed type terminals in addition to components that are specifically for mobile purposes.

FIG. 1 is a schematic diagram showing the hardware structure of a mobile terminal embodying various embodiments of the present invention.

The mobile terminal 100 may include a wireless communication unit 110, an A/V (Audio/Video) input unit 120, a user input unit 130, an output unit 150, a memory 160, an interface unit 170, a controller 180, a power supply unit 190, and the like. Figure 1 illustrates a mobile terminal having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal will be described in detail below.

Wireless communication unit 110 typically includes one or more components that permit radio communication between mobile terminal 100 and a wireless communication system or network.

The A/V input unit 120 is for receiving an audio or video signal. The A/V input unit 120 may include a camera 121 that processes image data of still pictures or video obtained by an image capturing device in a video capturing mode or an image capturing mode. The processed image frame can be displayed on the display unit 151. The image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the configuration of the mobile terminal.

The user input unit 130 may generate key input data according to a command input by the user to control various operations of the mobile terminal. The user input unit 130 allows the user to input various types of information, and may include a keyboard, a pot, a touch pad (eg, a touch sensitive component that detects changes in resistance, pressure, capacitance, etc. due to contact), a scroll wheel , rocker, etc. In particular, when the touch panel is superimposed on the display unit 151 in the form of a layer, a touch screen can be formed.

The interface unit 170 serves as an interface through which at least one external device can connect with the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, and an audio input/output. (I/O) port, video I/O port, headphone port, and more. The identification module may be stored to verify various information used by the user using the mobile terminal 100 and may include a User Identification Module (UIM), a Customer Identification Module (SIM), a Universal Customer Identity Module (USIM), and the like. In addition, the device having the identification module (hereinafter referred to as "identification device") may take the form of a smart card, and thus the identification device may be connected to the mobile terminal 100 via a port or other connection device. The interface unit 170 can be configured to receive input from an external device (eg, data information, power, etc.) and transmit the received input to one or more components within the mobile terminal 100 or can be used at the mobile terminal and external device Transfer data between.

In addition, when the mobile terminal 100 is connected to the external base, the interface unit 170 may function as a path through which power is supplied from the base to the mobile terminal 100 or may be used as a transmission of various command signals allowing input from the base to the mobile terminal 100 The path to the terminal. Various types of input from the base The command signal or power can be used as a signal for identifying whether the mobile terminal is accurately mounted on the base. Output unit 150 is configured to provide an output signal (eg, an audio signal, a video signal, an alarm signal, a vibration signal, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151 and the like.

The display unit 151 can display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 can display a user interface (UI) or a graphical user interface (GUI) related to a call or other communication (eg, text messaging, multimedia file download, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or image and related functions, and the like.

Meanwhile, when the display unit 151 and the touch panel are superposed on each other in the form of a layer to form a touch screen, the display unit 151 can function as an input device and an output device. The display unit 151 may include at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as a transparent display, and a typical transparent display may be, for example, a TOLED (Transparent Organic Light Emitting Diode) display or the like. According to a particular desired embodiment, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown) . The touch screen can be used to detect touch input pressure as well as touch input position and touch input area.

The memory 160 may store a software program or the like that performs processing and control operations performed by the controller 180, or may temporarily store data (for example, a phone book, a message, a still image, a video, and the like) that has been output or is to be output. Moreover, the memory 160 can store data regarding vibrations and audio signals of various manners that are output when a touch is applied to the touch screen.

The memory 160 may include at least one type of storage medium including a flash Memory, hard disk, multimedia card, card type memory (eg SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read only memory (ROM), electrically erasable programmable only Read memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disk, optical disk, and the like. Moreover, the mobile terminal 100 can cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 typically controls the overall operation of the mobile terminal. For example, the controller 180 performs the control and processing associated with voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for reproducing (or playing back) multimedia data, which may be constructed within the controller 180 or may be configured to be separate from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.

The power supply unit 190 receives external power or internal power under the control of the controller 180 and provides appropriate power required to operate the various components and components.

The various embodiments described herein can be implemented in a computer readable medium using, for example, computer software, hardware, or any combination thereof. For hardware implementations, the embodiments described herein may be through the use of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ( An FPGA, a processor, a controller, a microcontroller, a microprocessor, at least one of the electronic units designed to perform the functions described herein, in some cases, such an embodiment may be at the controller 180 Implemented in the middle. For software implementations, implementations such as procedures or functions may be implemented with separate software modules that permit the execution of at least one function or operation. The software code can be implemented by a software application (or program) written in any suitable programming language, which can be stored in memory 160 and executed by controller 180.

So far, the mobile terminal has been described in terms of its function. Hereinafter, for the sake of brevity, various types of movement such as a folding type, a bar type, a swing type, a slide type mobile terminal, and the like will be described. A sliding type mobile terminal in the terminal is taken as an example. Therefore, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.

The mobile terminal 100 as shown in FIG. 1 may be configured to operate using a communication system such as a wired and wireless communication system and a satellite-based communication system that transmits data via frames or packets.

A communication system in which a mobile terminal according to the present invention can be operated will now be described with reference to FIG.

Such communication systems may use different air interfaces and/or physical layers. For example, air interfaces used by communication systems include, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)). ), Global System for Mobile Communications (GSM), etc. As a non-limiting example, the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.

Referring to FIG. 2, a CDMA wireless communication system can include a plurality of mobile terminals 100, a plurality of base stations (BS) 270, a base station controller (BSC) 275, and a mobile switching center (MSC) 280. The MSC 280 is configured to interface with a public switched telephone network (PSTN) 290. The MSC 280 is also configured to interface with a BSC 275 that can be coupled to the base station 270 via a backhaul line. The backhaul line can be constructed in accordance with any of a number of known interfaces including, for example, E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. It will be appreciated that the system as shown in FIG. 2 can include multiple BSCs 275.

Each BS 270 can serve one or more partitions (or regions), each of which is covered by a multi-directional antenna or an antenna directed to a particular direction radially away from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS 270 can be configured to support multiple frequency allocations, and each frequency allocation has a particular frequency spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of partitioning and frequency allocation can be referred to as a CDMA channel. BS 270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology. In such a case, the term "base station" can be used to generally refer to a single BSC 275 and at least one BS 270. A base station can also be referred to as a "cell station." Alternatively, each partition of a particular BS 270 may be referred to as a plurality of cellular stations.

As shown in FIG. 2, a broadcast transmitter (BT) 295 transmits a broadcast signal to the mobile terminal 100 operating within the system. A broadcast receiving module 111 as shown in FIG. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295. In Figure 2, several Global Positioning System (GPS) satellites 300 are shown. The satellite 300 helps locate at least one of the plurality of mobile terminals 100.

In Figure 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information can be obtained using any number of satellites. The GPS module 115 as shown in Figure 1 is typically configured to cooperate with the satellite 300 to obtain desired positioning information. Instead of GPS tracking technology or in addition to GPS tracking technology, other techniques that can track the location of the mobile terminal can be used. Additionally, at least one GPS satellite 300 can selectively or additionally process satellite DMB transmissions.

As a typical operation of a wireless communication system, BS 270 receives reverse link signals from various mobile terminals 100. Mobile terminal 100 typically participates in calls, messaging, and other types of communications. Each reverse link signal received by a particular base station 270 is processed within a particular BS 270. The obtained data is forwarded to the relevant BSC 275. The BSC provides call resource allocation and coordinated mobility management functions including a soft handoff procedure between the BSs 270. The BSC 275 also routes the received data to the MSC 280, which provides additional routing services for interfacing with the PSTN 290. Similarly, PSTN 290 interfaces with MSC 280, which forms an interface with BSC 275, and BSC 275 controls BS 270 accordingly to transmit forward link signals to mobile terminal 100.

Embodiment 1

The embodiment of the invention provides a mobile terminal. 3 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention; as shown in FIG. 3, the mobile terminal includes: an image collecting unit 31, an image processing unit 32, and a determining unit 33;

The image acquisition unit 31 is configured to acquire a first image, and send the first image to the image processing unit 32; the image collection area corresponding to the first image has uniform brightness and the brightness parameter meets a preset threshold;

The image processing unit 32 is configured to divide the first image into N×M regions, and obtain The average value of the gray scale of each region; N and M are positive integers;

The determining unit 33 is configured to calculate a difference between the gray average values of the first area and the second area, and determine whether a difference between the gray average values of the first area and the second area is greater than a first threshold Obtaining a judgment result; wherein the first area and the second area are any one of the N×M areas, and the first area and the second area are separated by a third area When the result of the determination is that the difference between the grayscale average values of the first region and the second region is greater than the first threshold, determining that the first region corresponds to the image acquisition unit 31 of the mobile terminal The first sub-area is in an abnormal state, or the second sub-area of the second area corresponding to the image acquisition unit 31 of the mobile terminal is in an abnormal state.

In this embodiment, the image collection area of the image acquisition unit 31 of the user control mobile terminal is an area where the brightness is uniform and the brightness parameter meets a preset threshold. FIG. 4 is a schematic diagram of a mobile terminal application scenario according to an embodiment of the present invention; as shown in FIG. 4, the application scenario includes a mobile terminal 41 and a uniform light panel 42; and the image acquisition unit 31 of the mobile terminal 41 faces The uniform light plate 42 is such that an image acquisition area of the image acquisition unit 31 is in the uniform light plate. The uniform light panel has a fixed light emitting area, such as a rectangular light emitting area (as shown in FIG. 4); the uniform light board can emit light having uniform brightness properties in its fixed light emitting area, that is, the uniform light board The luminance values of each position in the fixed illumination area are equal. In an actual application, the user controls the image acquisition unit 31 of the mobile terminal to face the fixed illumination area of the uniform light panel, that is, the image acquisition area of the image acquisition unit 31 is included in the fixed illumination area, so that the movement The first image acquired by the terminal is an image of at least a portion of the fixed illumination area of the uniform spot.

Specifically, in a practical application, the mobile terminal may pre-configure the image capturing unit 31 to be in an automatic exposure mode, and the surface brightness of the uniform light plate is about 1800 lux, that is, the surface brightness of the uniform spot is 1750 Lux to 1850 Lux. The brightness of the image acquired by the image acquisition unit 31 is made 128 to 135.

In this embodiment, the mobile terminal divides the first image into N×M regions, which may be understood as: dividing the short side of the first image into N shares, and dividing the long side into M shares, The first image is divided into N×M regions; of course, the long side of the first image may be divided into N parts, the short side is divided into M parts, and the first image is divided into N×M. Areas. Here, the N and M may be pre-configured according to at least one of a screen resolution of the mobile terminal, a screen pixel density, and an image acquisition unit 31 pixel parameter (eg, 8 million pixels). Wherein, M and N may not be equal. For example, if N is set to 8, and M is set to 10, then N×M is equivalent to 8×10; of course, M and N may be equal, for example, N and M are both set to 16, then N ×M is equivalent to 16×16.

Specifically, FIG. 5 is a schematic diagram of dividing a first image into N×M regions according to an embodiment of the present invention; as shown in the figure, dividing a horizontal edge of the first image into N shares, and dividing the vertical edge For M parts, the area of the first column of the first row is recorded as the area A _0,0 , and the area of the second row of the first row is recorded as the area A _0,1 , and correspondingly, the area of the first row and the Nth column is recorded as The area A _0,N ; correspondingly, the area of the first row of the second row is denoted as the area A _1,0 ; the area of the first column of the Mth row is denoted as the area A _M,0 , then the area of the Mth row and the Nth column Recorded as area A _M,N .

Further, the image processing unit 32 obtains a grayscale average value of each of the divided regions. Specifically, the first image is composed of three primary colors of red, green, and blue. For each region, the image processing unit 32 first identifies the RGB value of the region, and further follows The preset algorithm performs a calculation process on the obtained RGB values to obtain a gray average value corresponding to the region. The preset algorithm may refer to any conversion algorithm in the prior art, for example, a floating point algorithm: gray average value=R×0.3+G×0.59+B×0.11; or integer algorithm: gray average value=( R × 30 + G × 59 + B × 11) / 100; or averaging algorithm: gray average value = (R + G + B) / 3, and so on. The preset algorithm described in this embodiment is not limited to the above algorithm. Where R represents the red component of the identified corresponding region; G represents the green component of the identified corresponding region; and B represents the blue component of the identified corresponding region.

In this embodiment, as shown in FIG. 5, the first area is the area A _{m, n} as an example (the area A _{m, n} is the N×M areas divided by the first image, preset The starting position starts the nth in the horizontal direction and the mth region in the vertical direction. Since the first region and the second region are separated by a region, the second region may be A _{m, n-2} Or the area A _m-2,n . That is, in the detecting process, traversing from the preset starting position, detecting whether the average value of the gray levels of the two regions separated by one region is greater than a first threshold; wherein, any of the N×M regions The area may be used as a preset starting position; preferably, as shown in FIG. 5, any one of A _m,n , A _0,n , A _m,0 , A _0,0 of the first image is used. The area is used as the default starting position.

In this embodiment, when the gray level average of the first area and the second area is greater than the first threshold, determining that the first area corresponds to the first sub-area of the image collecting unit 31 of the mobile terminal Or the second area corresponds to an abnormal state of the second sub-area of the image acquisition unit 31 of the mobile terminal. Determining, by the determining unit 33, that the first area corresponding to the first sub-area of the image collecting unit 31 of the mobile terminal is in an abnormal state, comprising: determining a first position of the first area in the first image Determining a first relative positional relationship of the first area and the first image based on the first position; obtaining a first sub-area corresponding to the first relative positional relationship in the image acquisition unit 31 Determining that the first sub-area of the image acquisition unit 31 is in an abnormal state; correspondingly, the determining unit 33 determines that the second sub-area of the second area corresponding to the image acquisition unit 31 of the mobile terminal is in an abnormal state. Determining: determining a second location of the second region in the first image, determining a second relative positional relationship of the second region and the first image based on the second location; A second sub-region corresponding to the second relative positional relationship is obtained in the acquisition unit 31, and the second sub-region of the image acquisition unit 31 is determined to be in an abnormal state. The first threshold may be greater than or equal to 3, such as 5. For example, when the gray level average of the first area and the second area is greater than 5, it is determined that the first area corresponds to the first sub-area or the second of the image capturing unit 31 (lens module) The area corresponding to the second sub-area of the image acquisition unit 31 (lens module) is different In a normal state, the abnormal state is, for example, dirty, a flower screen, or the like.

According to the technical solution of the embodiment of the present invention, on the one hand, it is not necessary to observe the collected photos through the human eye, whether there is abnormality such as dirt, greatly reducing human resources, shortening the detection time, improving the detection efficiency, and avoiding the manual detection. The misjudgment situation avoids the abnormal situation such as dirt in the mobile terminal and is not found when manually detected, and also greatly improves the product quality of the mobile terminal, thereby improving the user experience. On the other hand, the technical solution of the embodiment of the invention can quickly and accurately detect whether the image acquisition unit of the mobile terminal has abnormal conditions such as dirt and flower screen, shorten the detection time, and greatly improve the detection efficiency.

Embodiment 2

The embodiment of the present invention further provides a mobile terminal. Specifically, as shown in FIG. 3, the mobile terminal includes: an image collection unit 31, an image processing unit 32, and a determination unit 33;

The image acquisition unit 31 is configured to acquire a first image, and send the first image to the image processing unit 32; the image collection area corresponding to the first image has uniform brightness and the brightness parameter meets a preset threshold;

The image processing unit 32 is configured to divide the first image into N×M regions, and obtain a gray average value of each region; N and M are positive integers; wherein, the first region A _m,n And the third region A _m-2,n is separated from the second region A _m-1,n in the horizontal direction; or, the first region A _{m, n} and the second region A _m,n-2 are vertically The third region A _m,n-1 is separated in the straight direction; wherein m and n are both positive integers greater than or equal to 2, and n is less than or equal to N, and m is less than or equal to M; the first region A _m,n represents In the N×M regions, the mth region in the horizontal direction and the mth region in the vertical direction are started with a preset starting position;

The determining unit 33 is configured to calculate a difference value of the gray average values of any two regions separated by one region, and determine the first region A _m,n and the second region A _m-2,n Whether the difference of the gray average values is greater than the first threshold, and/or determining whether the difference between the gray average values of the first area A _m,n and the second area A _m,n-2 is greater than a threshold value, obtaining a first determination result; when the first determination result is that the difference between the gray level average values of the first area A _m,n and the second area A _m-2,n is greater than the first threshold Or determining that the first region corresponds to the mobile terminal when a difference between a gray average value of the first region A _m,n and the second region A _m,n-2 is greater than a first threshold The first sub-area of the image acquisition unit 31 is in an abnormal state, or the second sub-area of the second area corresponding to the image acquisition unit 31 of the mobile terminal is in an abnormal state.

Further, the determining unit 33 is configured to: when the first determination result is that the difference between the gray average values of the first area A _m,n and the second area A _m-2,n is greater than the first Determining that the first region corresponds to the movement when a threshold value and a difference between a gray average value of the first region A _m,n and the second region A _m,n-2 is greater than a first threshold The first sub-area of the image acquisition unit of the terminal is in an abnormal state.

As another implementation manner, the determining unit 33 is further configured to: when the first determination result is a gray average value of the first area A _m,n and the second area A _m-2,n The difference is not greater than the first threshold, and the difference between the gray average values of the first region A _m,n and the second region A _m,n-2 is not greater than the first threshold Determining that the first area corresponds to the first sub-area of the image acquisition unit 31 of the mobile terminal is in a normal state.

In this embodiment, the image collection area of the image acquisition unit 31 of the user control mobile terminal is an area where the brightness is uniform and the brightness parameter meets a preset threshold. As an embodiment, as shown in FIG. 4, the application scenario includes a mobile terminal 41 and a uniform light panel 42; the image acquisition unit 31 of the mobile terminal 41 faces the uniform light panel 42 such that the image acquisition unit 31 The image acquisition area is in the uniform light panel. The uniform light panel has a fixed light emitting area, such as a rectangular light emitting area (as shown in FIG. 4); the uniform light board can emit light having uniform brightness properties in its fixed light emitting area, that is, the uniform light board The luminance values of each position in the fixed illumination area are equal. In an actual application, the user controls the image acquisition unit 31 of the mobile terminal to face the fixed illumination area of the uniform light panel, that is, the image acquisition area of the image acquisition unit 31 is included in the fixed illumination area, so that the movement The number collected by the terminal An image is an image of at least a portion of the fixed illumination area of the uniform spot.

Specifically, in a practical application, the mobile terminal may pre-configure the image capturing unit 31 to be in an automatic exposure mode, and the surface brightness of the uniform light plate is about 1800 lux, that is, the surface brightness of the uniform spot is 1750 Lux to 1850 Lux. The brightness of the image acquired by the image acquisition unit 31 is made 128 to 135.

In this embodiment, the mobile terminal divides the first image into N×M regions, which may be understood as: dividing the short side of the first image into N shares, and dividing the long side into M shares, The first image is divided into N×M regions; of course, the long side of the first image may be divided into N parts, the short side is divided into M parts, and the first image is divided into N×M. Areas. Here, the N and M may be pre-configured according to at least one of a screen resolution of the mobile terminal, a screen pixel density, and an image acquisition unit 31 pixel parameter (eg, 8 million pixels). Wherein, M and N may not be equal. For example, if N is set to 8, and M is set to 10, then N×M is equivalent to 8×10; of course, M and N may be equal, for example, N and M are both set to 16, then N ×M is equivalent to 16×16.

Specifically, as shown in FIG. 5, the horizontal side of the first image is divided into N parts, and the vertical side is divided into M parts, and the area of the first column of the first row is recorded as the area A _0,0 . The area of the second row of the first row is denoted as the area A _0,1 , and correspondingly, the area of the Nth column of the first row is recorded as the area A _0,N ; correspondingly, the area of the first column of the second row is recorded as the area A _1,0 ; the area of the first column of the Mth row is denoted as the area A _M,0 , and the area of the Mth column and the Nth column is denoted as the area A _M,N .

Further, the image processing unit 32 obtains a grayscale average value of each of the divided regions. Specifically, the first image is composed of three primary colors of red, green, and blue. For each region, the image processing unit 32 first identifies the RGB value of the region, and further follows The preset algorithm performs a calculation process on the obtained RGB values to obtain a gray average value corresponding to the region. The preset algorithm may refer to any conversion algorithm in the prior art, for example, a floating point algorithm: gray average value=R×0.3+G×0.59+B×0.11; or integer algorithm: gray Degree average = (R × 30 + G × 59 + B × 11) / 100; or average algorithm: gray average value = (R + G + B) / 3, and so on. The preset algorithm described in this embodiment is not limited to the above algorithm. Where R represents the red component of the identified corresponding region; G represents the green component of the identified corresponding region; and B represents the blue component of the identified corresponding region.

Specifically, in this embodiment, the determining unit 33 separates the first area A _m,n from the second area A _m-2,n and the second area A _m,n-2 respectively separated by a region Comparing the grayscale average values, determining that the difference between the grayscale average values of the first region _Am,n and the second region _Am-2,n is not greater than the first threshold, and the Determining that the first region corresponds to the mobile terminal when a difference between a gray level average of an area A _m,n and the second area A _m,n-2 is not greater than the first threshold The first sub-area of the image acquisition unit 31 is in a normal state. Correspondingly, determining that a difference between a gray average value of the first area A _m,n and the second area A _m-2,n is greater than the first threshold, or the first area _Am, and the second region _of the _n a _m, an average value of the gradation difference _n-2 is greater than the first threshold value, it may be determined the first region a _{m, n} corresponding to the image acquisition of the mobile terminal The first sub-area of the unit 31 or the second area A _m,n-2 or the second area A _m-2,n corresponds to the second sub-area of the image acquisition unit 31 of the mobile terminal being dirty Or flower screen status. Specifically, the determining unit 33 determines that the first sub-region corresponding to the first region of the image acquiring unit 31 of the mobile terminal is in an abnormal state, and includes: determining that the first region is in the first image. a first position, determining a first relative positional relationship of the first region and the first image based on the first position; obtaining a first corresponding to the first relative positional relationship in the image acquisition unit 31 a sub-region, determining that the first sub-region of the image acquisition unit 31 is in an abnormal state; correspondingly, the determining unit 33 determines that the second region corresponds to the second sub-region of the image acquisition unit 31 of the mobile terminal In an abnormal state, comprising: determining a second position of the second area in the first image, determining a second relative positional relationship of the second area and the first image based on the second position; A second sub-region corresponding to the second relative positional relationship is obtained in the image acquisition unit 31, and the second sub-region of the image acquisition unit 31 is determined to be in an abnormal state.

6a and FIG. 6b are schematic diagrams showing the display of the first image in the embodiment of the present invention; wherein FIG. 6a is a schematic diagram of determining that the image acquisition unit of the mobile terminal is in a normal state (ie, no stain, no flower screen, etc.); A schematic diagram for determining that the image acquisition unit of the mobile terminal is in an abnormal state (ie, there is dirt, a flower screen, etc.).

According to the technical solution of the embodiment of the present invention, on the one hand, it is not necessary to observe the collected photos through the human eye, whether there is abnormality such as dirt, greatly reducing human resources, shortening the detection time, improving the detection efficiency, and avoiding the manual detection. The misjudgment situation avoids the abnormal situation such as dirt in the mobile terminal and is not found when manually detected, and also greatly improves the product quality of the mobile terminal, thereby improving the user experience. On the other hand, the technical solution of the embodiment of the invention can quickly and accurately detect whether the image acquisition unit of the mobile terminal has abnormal conditions such as dirt and flower screen, shorten the detection time, and greatly improve the detection efficiency.

In the embodiment of the present invention, the mobile terminal may be implemented by a mobile terminal such as a mobile phone, a tablet computer, or a notebook computer having a camera in an actual application. The image processing unit 32 and the determining unit 33 in the mobile terminal may be used by a central processing unit (CPU), a digital signal processor (DSP), or a digital signal processor (DSP) in the mobile terminal. The Field-Programmable Gate Array (FPGA) is implemented; the image acquisition unit 31 in the mobile terminal can be implemented by a camera of the mobile terminal in an actual application.

Embodiment 3

The embodiment of the invention also provides an information processing method. FIG. 7 is a schematic diagram of a first process of an information processing method according to an embodiment of the present invention; as shown in FIG. 7, the method includes:

Step 501: Acquire a first image; the image collection area corresponding to the first image has uniform brightness and the brightness parameter meets a preset threshold.

In this embodiment, the image acquisition area of the image acquisition unit controlled by the user to the mobile terminal is bright. An area where the degree is uniform and the brightness parameter meets the preset threshold. As an embodiment, a uniform light plate is preset, the uniform light plate has a fixed light emitting region, such as a rectangular light emitting region (as shown in FIG. 4); the uniform light plate can be emitted in a fixed light emitting region thereof. The light having uniform brightness properties, that is, the brightness values at each position in the fixed light-emitting region of the uniform light plate are equal. In an actual application, the user controls the image acquisition unit of the mobile terminal to face the fixed illumination area of the uniform light panel, that is, the image collection area of the image acquisition unit is included in the fixed illumination area, so that the mobile terminal collects The first image obtained is an image of at least a portion of the fixed illumination area of the uniform spot.

Specifically, in a practical application, the mobile terminal may pre-configure the image acquisition unit to be in an automatic exposure mode, and the surface brightness of the uniform light panel is about 1800 lux, that is, the surface brightness of the uniform light spot is between 1750 Lux and 1850 Lux. The brightness of the image acquired by the image acquisition unit is 128Lux to 135Lux.

Step 502: Divide the first image into N×M regions, and obtain a gray average value of each region; N and M are both positive integers.

In this embodiment, the mobile terminal divides the first image into N×M regions, which may be understood as: dividing the short side of the first image into N shares, and dividing the long side into M shares, The first image is divided into N×M regions; of course, the long side of the first image may be divided into N parts, the short side is divided into M parts, and the first image is divided into N×M. Areas. Here, the N and M may be pre-configured according to at least one of a screen resolution of the mobile terminal, a screen pixel density, and an image acquisition unit pixel parameter (eg, 8 million pixels). Wherein, M and N may not be equal. For example, if N is set to 8, and M is set to 10, then N×M is equivalent to 8×10; of course, M and N may be equal, for example, N and M are both set to 16, then N ×M is equivalent to 16×16. Specifically, as shown in FIG. 5, to the level of the first side of the image divided into N parts, the vertical side is divided into M parts, the first column of the first row area is an area A _0,0, The area of the first row and the second column is denoted as the area A _0,1 , and correspondingly, the area of the first row and the Nth column is recorded as the area A _0,N ; correspondingly, the area of the second row and the first column is recorded as the area A _1,0 ; the area of the first column of the Mth row is denoted as the area A _M,0 , and the area of the Mth column and the Nth column is denoted as the area A _M,N .

Further, the average value of the gradation of each of the divided regions is obtained. Specifically, the first image is composed of three primary colors of red, green, and blue, and for each region, the RGB value of the region is first identified, and further obtained according to a preset algorithm. The RGB values are subjected to calculation processing to obtain gradation average values corresponding to the regions. The preset algorithm may refer to any conversion algorithm in the prior art, for example, a floating point algorithm: gray average value=R×0.3+G×0.59+B×0.11; or integer algorithm: gray average value=( R × 30 + G × 59 + B × 11) / 100; or averaging algorithm: gray average value = (R + G + B) / 3, and so on. The preset algorithm described in this embodiment is not limited to the above algorithm. Where R represents the red component of the identified corresponding region; G represents the green component of the identified corresponding region; and B represents the blue component of the identified corresponding region.

Step 503: Calculate a difference between the grayscale average values of the first region and the second region, and determine whether a difference between the grayscale average values of the first region and the second region is greater than a first threshold, and obtain a determination result; The first area and the second area are any of the N×M areas, and the first area and the second area are separated by a third area.

Here, the determining whether the gray level average of the first area and the second area meets the preset condition comprises: determining whether the gray level average of the first area and the second area is greater than a first threshold;

When the result of the determination is that the gray level average of the first area and the second area is greater than the first threshold, determining that the gray level average of the first area and the second area meets a preset condition;

When the result of the determination is that the gray level average of the first area and the second area is not greater than the first threshold, determining that the gray level average of the first area and the second area does not satisfy the preset condition.

In this embodiment, as shown in FIG. 5, the first area is the area A _{m, n} as an example (the area A _{m, n} is the N×M areas divided by the first image, preset The starting position starts the nth in the horizontal direction and the mth region in the vertical direction. Since the first region and the second region are separated by a region, the second region may be A _{m, n-2} Or the area A _m-2,n . That is, in the detecting process, traversing from the preset starting position, detecting whether the average value of the gray levels of the two regions separated by one region is greater than a first threshold; wherein, any of the N×M regions The area may be used as a preset starting position; preferably, as shown in FIG. 5, any one of A _m,n , A _0,n , A _m,0 , A _0,0 of the first image is used. The area is used as the starting detection position.

Step 504: When the result of the determination is that the difference between the gray average values of the first area and the second area is greater than a first threshold, determining that the first area corresponds to an image acquisition unit of the mobile terminal The first sub-area is in an abnormal state, or the second sub-area of the second area corresponding to the image acquisition unit of the mobile terminal is in an abnormal state.

In this embodiment, when the gray level average of the first area and the second area meets a preset condition, that is, the gray level average of the first area and the second area is greater than the first threshold, Determining that the first area corresponds to a first sub-area of the image acquisition unit of the mobile terminal or the second area corresponds to an abnormal state of a second sub-area of the image acquisition unit of the mobile terminal. Specifically, the determining that the first region corresponds to an abnormal state of the first sub-region of the image capturing unit of the mobile terminal, including: determining a first location of the first region in the first image, Determining a first relative positional relationship of the first area and the first image based on the first position; obtaining a first sub-area corresponding to the first relative positional relationship in the image acquisition unit, determining The first sub-area of the image acquisition unit is in an abnormal state; correspondingly, the determining that the second area corresponds to an abnormal state of the second sub-area of the image acquisition unit of the mobile terminal, including: determining the Determining, in a second position in the first image, a second relative positional relationship of the second region and the first image based on the second position; obtaining and in the image acquisition unit The second sub-region corresponding to the second relative positional relationship determines that the second sub-region of the image acquisition unit is in an abnormal state. The first threshold may be greater than or equal to 3, such as 5. For example, when the gray level average of the first area and the second area is greater than 5, it is determined that the first area corresponds to the first sub-area or the second area of the image capturing unit (lens module) Corresponding to the image acquisition unit (lens) The second sub-region of the module is in an abnormal state, such as a dirty state, a flower screen, or the like.

According to the technical solution of the embodiment of the present invention, on the one hand, it is not necessary to observe the collected photos through the human eye, whether there is abnormality such as dirt, greatly reducing human resources, shortening the detection time, improving the detection efficiency, and avoiding the manual detection. The misjudgment situation avoids the abnormal situation such as dirt in the mobile terminal and is not found when manually detected, and also greatly improves the product quality of the mobile terminal, thereby improving the user experience. On the other hand, the technical solution of the embodiment of the invention can quickly and accurately detect whether the image acquisition unit of the mobile terminal has abnormal conditions such as dirt and flower screen, shorten the detection time, and greatly improve the detection efficiency.

Embodiment 4

The embodiment of the invention also provides an information processing method. FIG. 8 is a second schematic flowchart of an information processing method according to an embodiment of the present invention; as shown in FIG. 8, the method includes:

Step 601: Acquire a first image; the image collection area corresponding to the first image has uniform brightness and the brightness parameter meets a preset threshold.

In this embodiment, the image collection area of the image acquisition unit of the user control mobile terminal is an area where the brightness is uniform and the brightness parameter meets the preset threshold. As an embodiment, a uniform light plate is preset, the uniform light plate has a fixed light emitting region, such as a rectangular light emitting region (as shown in FIG. 4); the uniform light plate can be emitted in a fixed light emitting region thereof. The light having uniform brightness properties, that is, the brightness values at each position in the fixed light-emitting region of the uniform light plate are equal. In an actual application, the user controls the image acquisition unit of the mobile terminal to face the fixed illumination area of the uniform light panel, that is, the image collection area of the image acquisition unit is included in the fixed illumination area, so that the mobile terminal collects The first image obtained is an image of at least a portion of the fixed illumination area of the uniform spot.

Specifically, in a practical application, the mobile terminal may pre-configure the image acquisition unit to be in an automatic exposure mode, and the surface brightness of the uniform light panel is about 1800 lux, that is, the surface brightness of the uniform light spot is between 1750 Lux and 1850 Lux. Making the image acquisition The brightness of the image acquired by the unit is 128 to 135.

Step 602: Divide the first image into N×M regions, and obtain a gray average value of each region; N and M are positive integers.

In this embodiment, the mobile terminal divides the first image into N×M regions, which may be understood as: dividing the short side of the first image into N shares, and dividing the long side into M shares, The first image is divided into N×M regions; of course, the long side of the first image may be divided into N parts, the short side is divided into M parts, and the first image is divided into N×M. Areas. Here, the N and M may be pre-configured according to at least one of a screen resolution of the mobile terminal, a screen pixel density, and an image acquisition unit pixel parameter (eg, 8 million pixels). Wherein, M and N may not be equal. For example, if N is set to 8, and M is set to 10, then N×M is equivalent to 8×10; of course, M and N may be equal, for example, N and M are both set to 16, then N ×M is equivalent to 16×16. Specifically, as shown in FIG. 5, the horizontal side of the first image is divided into N parts, and the vertical side is divided into M parts, and the area of the first column of the first row is recorded as the area A _0,0 . The area of the second row of the first row is denoted as the area A _0,1 , and correspondingly, the area of the Nth column of the first row is recorded as the area A _0,N ; correspondingly, the area of the first column of the second row is recorded as the area A _1,0 ; the area of the first column of the Mth row is denoted as the area A _M,0 , and the area of the Mth column and the Nth column is denoted as the area A _M,N .

Further, the average value of the gradation of each of the divided regions is obtained. Specifically, the first image is composed of three primary colors of red, green, and blue, and for each region, the RGB value of the region is first identified, and further obtained according to a preset algorithm. The RGB values are subjected to calculation processing to obtain gradation average values corresponding to the regions. The preset algorithm may refer to any conversion algorithm in the prior art, for example, a floating point algorithm: gray average value=R×0.3+G×0.59+B×0.11; or integer algorithm: gray average value=( R × 30 + G × 59 + B × 11) / 100; or averaging algorithm: gray average value = (R + G + B) / 3, and so on. The preset algorithm described in this embodiment is not limited to the above algorithm. Where R represents the red component of the identified corresponding region; G represents the green component of the identified corresponding region; and B represents the blue component of the identified corresponding region.

Step 603: Determine whether the difference between the gray average values of the first area A _m,n and the second area A _m-2,n is greater than a first threshold, and/or determine the first area A _m,n and Whether the difference of the gray average values of the second regions A _{m, n-2} is greater than a first threshold, obtaining a first determination result. Wherein the first area A _m,n and the second area A _m-2,n are separated from each other in the horizontal direction by the third area A _{m-1, n} ; or the first area A _{m, n} and the second region A _m,n-2 are separated from each other in the vertical direction by a third region A _m,n-1 ; wherein m and n are positive integers greater than or equal to 2, and n is less than or equal to N And m is less than or equal to M; the first area A _m,n represents the _{nth, the mth} area in the horizontal direction starting from the preset starting position in the N×M areas.

Step 604: When the first determination result is that the difference between the gray average values of the first area A _m,n and the second area A _m-2,n is greater than a first threshold, or the first Determining the difference between the gray average values of the first region and the second region when the difference between the grayscale average values of the regions _Am,n and the second regions _Am,n-2 is greater than the first threshold The value is greater than the first threshold.

Step 605: It is determined that the first sub-region corresponding to the image acquisition unit of the mobile terminal is in an abnormal state, or the second sub-region corresponding to the image acquisition unit of the mobile terminal is in the second region. Abnormal state.

As another implementation manner, when the determination result in step 603 is: the difference between the gray average values of the first area A _m,n and the second area A _m-2,n is not greater than the first a threshold, and when a difference between a gray average value of the first area A _m,n and the second area A _m,n-2 is not greater than the first threshold, the method further includes: determining The difference between the grayscale average values of the first region and the second region is not greater than the first threshold.

Specifically, taking the example shown in FIG. 5, the first area A _{m,n is} respectively separated by the second area A _{m-2,n of the} one area and the gray of the second area A _m,n-2 Comparing the average values, determining that the difference between the gray average values of the first region A _m,n and the second region A _m-2,n is not greater than the first threshold, and the first region Determining, when the difference between the gray average values of A _m,n and the second region A _m,n-2 is not greater than the first threshold, determining that the first region corresponds to image acquisition of the mobile terminal The first sub-area of the unit is in a normal state. Correspondingly, determining that a difference between a gray average value of the first area A _{m, n} and the second area A _{m-2, n} is greater than the first threshold, or the first area _Am, and the second region _of the _n a _m, an average value of the gradation difference _n-2 is greater than the first threshold value, it may be determined the first region a _{m, n} corresponding to the image acquisition of the mobile terminal The first sub-area of the unit or the second area A _m,n-2 or the second area A _m-2,n corresponds to the second sub-area of the image acquisition unit of the mobile terminal being dirty or smeared status. Specifically, the determining that the first region corresponds to an abnormal state of the first sub-region of the image capturing unit of the mobile terminal, including: determining a first location of the first region in the first image, Determining a first relative positional relationship of the first area and the first image based on the first position; obtaining a first sub-area corresponding to the first relative positional relationship in the image acquisition unit, determining The first sub-area of the image acquisition unit is in an abnormal state; correspondingly, the determining that the second area corresponds to an abnormal state of the second sub-area of the image acquisition unit of the mobile terminal, including: determining the Determining, in a second position in the first image, a second relative positional relationship of the second region and the first image based on the second position; obtaining and in the image acquisition unit The second sub-region corresponding to the second relative positional relationship determines that the second sub-region of the image acquisition unit is in an abnormal state. For details, refer to FIG. 6a and FIG. 6b. FIG. 6a is a schematic diagram of determining that the image capturing unit of the mobile terminal is in a normal state (ie, no dirt, no flower screen, etc.); FIG. 6b is determining image capturing of the mobile terminal. A schematic diagram of the unit in an abnormal state (ie, dirty, with a flower screen, etc.).

As an implementation manner, the determination result of step 603 may further be: a difference between the gray average values of the first area A _{m, n} and the second area A _{m-2, n} is greater than a first threshold, and The difference between the gray level average values of the first area A _m,n and the second area A _m,n-2 is also greater than the first threshold, the method further comprising: determining that the first area corresponds to the The first sub-area of the image acquisition unit of the mobile terminal is in an abnormal state.

The embodiments of the present invention are described in detail below in conjunction with the specific embodiments.

Embodiment 1

Taking the first image shown in FIG. 6a as an example, the first image is divided into 16×16 regions, and the grayscale average value of each region is identified as shown in Table 1. Traversing each zone, i.e. the first region A _{m, n} respectively, spaced with a second region of the region A _{m-2, n} A _m and the second _region, the mean gray value is compared to _n-2, Determining that a difference between a gray average value of the first area A _m,n and the second area A _m-2,n is not more than 5, and the first area _Am,n and the second area The difference between the gray average values of A _{m, n-2} is also not greater than 5, then it can be determined that the image acquisition unit of the mobile terminal is in a normal state, that is, the image acquisition unit is free of dirt, no flower screen, and the like.

158	160	159	158	158	159	159	159	160	160	160	161	163	165	165	162
160	160	158	158	158	158	159	159	160	160	160	161	162	164	165	164
160	159	158	158	159	159	160	160	160	161	161	162	162	163	165	166
160	159	158	158	159	159	160	160	160	161	161	162	162	163	165	166
160	158	158	158	159	159	160	160	161	161	161	162	162	163	164	166
159	158	158	158	159	159	159	160	160	161	161	161	162	162	164	166
158	158	158	158	159	159	159	160	160	160	161	161	162	162	163	165
159	158	158	159	159	159	160	161	161	161	161	162	162	163	164	166
159	158	159	159	159	159	160	161	161	161	161	162	162	163	164	166
160	159	159	159	159	160	160	161	161	161	161	162	163	163	164	166
160	159	158	159	159	159	160	160	160	161	161	162	162	163	164	166
160	159	158	158	159	159	159	160	160	160	161	161	162	163	164	166
161	160	159	159	159	160	160	160	161	161	161	162	163	163	165	166
161	161	160	160	160	160	160	161	161	161	161	162	163	164	166	165
161	162	161	160	160	160	160	161	161	162	162	163	164	165	166	164
158	162	161	161	160	160	160	161	161	162	162	163	165	166	165	163

Table 1

Embodiment 2

Taking the first image shown in FIG. 6b as an example, the first image is divided into 16×16 regions, and the grayscale average value of each region is identified as shown in Table 2. Traversing each zone, i.e. the first region A _{m, n} respectively, spaced with a second region of the region A _{m-2, n} A _m or the second _region, the mean gray value is compared to _n-2, Determining that a difference between a gray average value of the first area A _m,n and the second area A _m-2,n is greater than 4, or determining the first area A _m,n and the second The difference between the grayscale average values of the regions _{Am, n-2} is also greater than 4, as shown in Table 2, the 155 shown in the 12th row and the 3rd column and the 160 shown in the 12th column and the 5th column. If the difference is 5, it may be determined that there may be an abnormality in the sub-area of the image capturing unit corresponding to the area of the 12th row, the 3rd column, or the 12th row and the 5th column, and further detecting, the determining may be performed. The sub-area of the image acquisition unit corresponding to the area in the 12th row and the third column may have an abnormality; for example, the difference between the 163 shown in the 11th column of the 12th row and the 146 shown in the 13th column and the 13th column 17 and the 146 shown in the 12th column and the 13th column, the 164 shown in the 13th column and the 13th column, the difference between the two is 18, then the corresponding region of the 12th row and the 13th column can be determined. Image Sub-region is set in an abnormal state unit.

152	155	156	157	158	159	160	160	161	161	161	161	161	160	159	157
153	155	156	158	159	160	160	161	161	161	161	161	161	161	160	158
154	156	157	158	159	160	161	162	162	162	162	162	161	161	160	159
155	156	158	159	160	161	162	163	163	163	163	163	162	162	161	160
156	157	159	160	161	162	163	164	164	164	164	164	163	163	162	161
156	157	159	160	161	162	163	163	164	164	164	164	163	163	162	161
155	157	158	160	161	162	162	163	164	164	163	163	163	162	161	161
155	157	158	160	161	162	163	164	164	163	163	163	163	162	161	161
156	157	159	160	161	162	163	164	164	164	164	164	163	163	162	161
156	158	159	161	162	163	163	164	164	164	164	164	164	163	162	162
156	158	158	160	161	162	162	163	164	164	164	164	162	162	162	161
155	157	155	158	160	161	162	163	163	163	163	163	146	162	161	160
155	156	157	158	160	161	161	162	162	162	162	162	161	161	160	159
154	156	158	159	160	161	161	162	162	162	162	162	162	161	161	159
154	156	157	158	159	160	161	162	162	162	162	162	162	161	160	158
150	155	156	157	158	159	160	160	161	161	161	161	161	160	158	157

Table 2

According to the technical solution of the embodiment of the present invention, on the one hand, it is not necessary to collect photos through the human eye. Observing whether there are abnormalities such as dirt, greatly reducing human resources, shortening the detection time, improving the detection efficiency, and avoiding the misjudgment when the manual detection is performed, that is, avoiding abnormal conditions such as dirt in the mobile terminal and manually detecting It has not been discovered, and the product quality of the mobile terminal has been greatly improved, thereby improving the user experience. On the other hand, the technical solution of the embodiment of the invention can quickly and accurately detect whether the image acquisition unit of the mobile terminal has abnormal conditions such as dirt and flower screen, shorten the detection time, and greatly improve the detection efficiency.

It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes those elements. It also includes other elements that are not explicitly listed, or elements that are inherent to such a process, method, article, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.

The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

In the several embodiments provided by the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. The device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, such as: multiple units or components may be combined, or Can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, or direct coupling, or communication connection of the components shown or discussed may be indirect coupling or communication connection through some interfaces, devices or units, and may be electrical, mechanical or other forms. of.

The units described above as separate components may or may not be physically separated, and the components displayed as the unit may or may not be physical units, that is, may be located in one place or distributed to multiple network units; Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated in one processing order. In the meta element, each unit may be separately used as a unit, or two or more units may be integrated into one unit; the integrated unit may be implemented in the form of hardware or a hardware plus software functional unit. Formal realization.

A person skilled in the art can understand that all or part of the steps of implementing the above method embodiments may be completed by using hardware related to the program instructions. The foregoing program may be stored in a computer readable storage medium, and the program is executed when executed. The foregoing storage device includes the following steps: the foregoing storage medium includes: a mobile storage device, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk. A medium that can store program code.

Alternatively, the above-described integrated unit of the present invention may be stored in a computer readable storage medium if it is implemented in the form of a software function module and sold or used as a standalone product. Based on such understanding, the technical solution of the embodiments of the present invention may be embodied in the form of a software product in essence or in the form of a software product stored in a storage medium, including a plurality of instructions. A computer device (which may be a personal computer, server, or network device, etc.) is caused to perform all or part of the methods described in various embodiments of the present invention. The foregoing storage medium includes various media that can store program codes, such as a mobile storage device, a ROM, a RAM, a magnetic disk, or an optical disk.

The above is only a specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the present invention. It should be covered by the scope of the present invention. Therefore, the scope of the invention should be determined by the scope of the appended claims.

Industrial applicability

On the one hand, the embodiment of the present invention does not need to observe the collected photos through the human eye, whether there is abnormality such as dirt, greatly reduces the human resources, shortens the detection time, improves the detection efficiency, and avoids the misjudgment when the manual detection is performed. That is to avoid abnormal conditions such as dirt on the mobile terminal. The manual detection did not find out, and the product quality of the mobile terminal was greatly improved, thereby improving the user experience. On the other hand, the technical solution of the embodiment of the invention can quickly and accurately detect whether the image acquisition unit of the mobile terminal has abnormal conditions such as dirt and flower screen, shorten the detection time, and greatly improve the detection efficiency.

Claims (20)

1. A mobile terminal, comprising: an image acquisition unit, an image processing unit, and a determination unit; wherein

   The image acquisition unit is configured to acquire a first image, and send the first image to the image processing unit; the image collection area corresponding to the first image has uniform brightness and the brightness parameter meets a preset threshold;

   The image processing unit is configured to divide the first image into N×M regions, and obtain a gray average value of each region; N and M are positive integers;

   The determining unit is configured to calculate a difference between the grayscale average values of the first region and the second region, and determine whether a difference between the grayscale average values of the first region and the second region is greater than a first threshold, Obtaining a judgment result; wherein the first area and the second area are any one of the N×M areas, and the first area and the second area are separated by a third area; When the result of the determination is that the difference between the grayscale average values of the first region and the second region is greater than the first threshold, determining that the first region corresponds to the first of the image acquisition unit of the mobile terminal The sub-area is in an abnormal state, or the second sub-area of the second area corresponding to the image acquisition unit of the mobile terminal is in an abnormal state.
2. The mobile terminal of claim 1, wherein the first area _Am,n and the second area _Am-2,n are separated from each other by a third area _{Am-1, n} in a vertical direction Or the first region A _m,n and the second region A _m,n-2 are separated from each other in the horizontal direction by a third region A _m,n-1 ; wherein m and n are both greater than or equal to a positive integer of 2, and n is less than or equal to N, m is less than or equal to M; the first region A _m,n represents the nth, vertical direction in the horizontal direction starting from the preset starting position in the N×M regions The mth area.
3. The mobile terminal according to claim 1, wherein the determining unit is configured to determine whether a difference between the gradation average values of the first area A _m,n and the second area A _m-2,n is Or greater than the first threshold, and/or determining whether the difference between the grayscale average values of the first region A _m,n and the second region A _m,n-2 is greater than a first threshold, obtaining a first determination result When the first determination result is that the difference between the gray level average of the first area A _m,n and the second area A _m-2,n is greater than a first threshold, or the first area A Determining, when the difference between the gray average values of _{m, n} and the second region A _m,n-2 is greater than the first threshold, determining that the first region corresponds to the first sub-region of the image acquisition unit of the mobile terminal In an abnormal state, or the second sub-region of the second region corresponding to the image acquisition unit of the mobile terminal is in an abnormal state.
4. The mobile terminal according to claim 3, wherein the determining unit is configured to: when the first determination result is the gray of the first area A _m,n and the second area A _m-2,n Determining that the difference between the average values of the degrees is greater than the first threshold, and the difference between the gray average values of the first region A _m,n and the second region A _m,n-2 is greater than the first threshold The first area corresponds to an abnormal state of the first sub-area of the image acquisition unit of the mobile terminal.
5. The mobile terminal of claim 3, wherein

   The determining unit is further configured to: when the first determination result is that the difference between the gray average values of the first area A _m,n and the second area A _m-2,n is not greater than the first a threshold value, and when the difference between the gray level average values of the first area _Am,n and the second area _Am,n-2 is not greater than the first threshold, determining that the first area corresponds to The first sub-area of the image acquisition unit of the mobile terminal is in a normal state.
6. The mobile terminal according to any one of claims 1 to 5, wherein the determining unit determines that the first sub-region corresponding to the image capturing unit of the mobile terminal is in an abnormal state, and includes: determining Determining, in a first position in the first image, a first relative positional relationship of the first region and the first image based on the first location; obtaining and acquiring in the image acquisition unit Determining, in the first sub-region corresponding to the first relative positional relationship, that the first sub-region of the image collecting unit is in an abnormal state;
7. The mobile terminal according to any one of claims 1 to 5, wherein the determining unit determines that the second sub-region of the second region corresponding to the image capturing unit of the mobile terminal is An abnormal state, comprising: determining a second position of the second area in the first image, and determining a second relative positional relationship of the second area and the first image based on the second position; A second sub-region corresponding to the second relative positional relationship is obtained in the image acquisition unit, and the second sub-region of the image acquisition unit is determined to be in an abnormal state.
8. The mobile terminal according to claim 1, wherein the image processing unit is configured to identify red, green and blue RGB values of each region; and perform calculation processing according to a preset algorithm based on RGB values of each of the regions A grayscale average of each region; wherein the preset algorithm includes one of the following algorithms: a floating point algorithm, an integer algorithm.
9. The mobile terminal according to claim 1, wherein the image capturing area corresponding to the first image has uniform brightness and the preset threshold of the brightness parameter satisfies 1750 lux Lux ~ 1850 Lux.
10. An information processing method, the method comprising:

    Collecting a first image; the image capturing area corresponding to the first image is uniform in brightness and the brightness parameter meets a preset threshold;

    Dividing the first image into N×M regions, obtaining a gray average value of each region; N and M are positive integers;

    Calculating a difference between the grayscale average values of the first region and the second region, determining whether a difference between the grayscale average values of the first region and the second region is greater than a first threshold, and obtaining a determination result; The first area and the second area are any of the N×M areas, and the first area and the second area are separated by a third area;

    When the result of the determination is that the difference between the grayscale average values of the first region and the second region is greater than the first threshold, determining that the first region corresponds to the first of the image acquisition unit of the mobile terminal The sub-area is in an abnormal state, or the second sub-area of the second area corresponding to the image acquisition unit of the mobile terminal is in an abnormal state.
11. The method according to claim 10, wherein said first area A _m,n and said second area A _m-2,n are spaced apart from each other by a third area A _m-1,n in a horizontal direction; or The first region A _m,n and the second region A _m,n-2 are separated from each other in the vertical direction by a third region A _m,n-1 ; wherein m and n are both greater than or equal to 2 a positive integer, and n is less than or equal to N, m is less than or equal to M; the first region A _m,n represents the nth, vertical direction in the horizontal direction starting from the preset starting position in the N×M regions m areas.
12. The method according to claim 11, wherein the determining whether the gray level average of the first area and the second area is greater than a first threshold comprises:

    Determining whether a difference between a gray average value of the first area A _m,n and the second area A _m-2,n is greater than a first threshold, and/or determining the first area A _m,n And whether a difference between the gray average values of the second regions A _{m, n-2} is greater than a first threshold, obtaining a first determination result;

    When the first determination result is that the difference between the gray average values of the first area A _m,n and the second area A _m-2,n is greater than a first threshold, or the first area A _{m And determining, when n} and the difference between the gray average values of the second regions A _{m, n-2} are greater than the first threshold, determining that the difference between the gray average values of the first region and the second region is greater than a threshold

    Correspondingly, determining that the first area corresponds to an abnormal state of the first sub-area of the image acquisition unit of the mobile terminal, or that the second area is corresponding to the second sub-area of the image acquisition unit of the mobile terminal Abnormal state.
13. The method according to claim 12, wherein when said first determination result is that the difference between the gray average values of said first area A _m,n and said second area A _m-2,n is greater than a threshold, and when the difference between the gray average values of the first area A _m,n and the second area A _m,n-2 is greater than the first threshold, the method further includes: determining the first The first sub-area of the image acquisition unit corresponding to the mobile terminal is in an abnormal state.
14. The method according to claim 12, wherein when said first judgment result is that the difference between the gray average values of said first area A _m,n and said second area A _m-2,n is not greater than The first threshold, and when the difference between the gray average values of the first area _Am,n and the second area _Am,n-2 is not greater than the first threshold, the method further The method includes: determining that a difference between grayscale average values of the first region and the second region is not greater than a first threshold;

    Correspondingly, determining that the first area corresponds to a first sub-area of the image acquisition unit of the mobile terminal is in a normal state.
15. The method according to any one of claims 10 to 15, wherein the determining that the first area corresponds to an abnormal state of the first sub-area of the image acquisition unit of the mobile terminal comprises:

    Determining a first location of the first region in the first image, determining a first relative positional relationship of the first region and the first image based on the first location; in the image acquisition unit Obtaining a first sub-region corresponding to the first relative positional relationship, determining that the first sub-region of the image acquisition unit is in an abnormal state;
16. The method according to any one of claims 10 to 15, wherein the determining that the second region corresponds to an abnormal state of the second sub-region of the image acquisition unit of the mobile terminal comprises:

    Determining a second position of the second region in the first image, determining a second relative positional relationship of the second region and the first image based on the second position; in the image acquisition unit Obtaining a second sub-region corresponding to the second relative positional relationship, determining that the second sub-region of the image acquisition unit is in an abnormal state.
17. The method according to claim 10, wherein said obtaining a grayscale average value of each region comprises: identifying red, green and blue RGB values of each region; and performing RGB values based on said each region according to a preset algorithm The calculation process obtains a gray average value of each of the regions; wherein the preset algorithm includes one of the following algorithms: a floating point algorithm, an integer algorithm.
18. The method according to claim 10, wherein the image acquisition area corresponding to the first image has uniform brightness and the preset threshold value satisfying the brightness parameter satisfies 1750 lux Lux ~ 1850 Lux.
19. The method of claim 10, wherein the N and M are pre-configured according to at least one of a screen resolution, a screen pixel density, and an image acquisition unit pixel parameter of the mobile terminal.
20. A computer storage medium having computer executable instructions stored therein, the computer executable instructions being configured to perform the information processing method of any one of claims 11 to 19.

Images