CN109257463B - Terminal device, control method thereof and computer-readable storage medium - Google Patents

Terminal device, control method thereof and computer-readable storage medium Download PDF

Info

Publication number
CN109257463B
CN109257463B CN201810970592.8A CN201810970592A CN109257463B CN 109257463 B CN109257463 B CN 109257463B CN 201810970592 A CN201810970592 A CN 201810970592A CN 109257463 B CN109257463 B CN 109257463B
Authority
CN
China
Prior art keywords
ambient light
lens
image
brightness
image sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810970592.8A
Other languages
Chinese (zh)
Other versions
CN109257463A (en
Inventor
齐永红
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN201810970592.8A priority Critical patent/CN109257463B/en
Publication of CN109257463A publication Critical patent/CN109257463A/en
Application granted granted Critical
Publication of CN109257463B publication Critical patent/CN109257463B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026Details of the structure or mounting of specific components
    • H04M1/0264Details of the structure or mounting of specific components for a camera module assembly
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026Details of the structure or mounting of specific components
    • H04M1/0266Details of the structure or mounting of specific components for a display module assembly
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/71Circuitry for evaluating the brightness variation

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Environmental & Geological Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Telephone Function (AREA)

Abstract

The embodiment of the invention provides terminal equipment and a control method thereof, relates to the technical field of terminals, and is used for solving the problem that a photosensitive device limits the screen occupation ratio of the terminal equipment to be further increased. The terminal device includes: the device comprises a lens, an image sensor, a control module and a display screen; when a camera module consisting of a lens and an image sensor is used for shooting an image, the image sensor receives ambient light through the lens and senses the received ambient light to generate a first electric signal, and the control module converts the first electric signal into an image signal; when the camera module consisting of the lens and the image sensor is not used for shooting images and the display screen displays a picture, the image sensor receives ambient light through the lens and senses the received ambient light to generate a second electric signal, and the control module determines the brightness of the ambient light according to the second electric signal and adjusts the display brightness of the display screen according to the brightness of the ambient light. The embodiment of the invention is used for manufacturing the terminal equipment.

Description

Terminal device, control method thereof and computer-readable storage medium
Technical Field
The invention relates to the technical field of terminals, in particular to a terminal device and a control method thereof.
Background
With the development of terminal technology, terminal devices become more intelligent, and the screen occupation ratio of the terminal devices is larger. The display brightness of the display screen of the terminal device is automatically adjusted according to the ambient light brightness, which is an important embodiment of terminal device intellectualization.
At present, in the prior art, the display brightness of the display screen of the terminal device is automatically adjusted according to the ambient light brightness mainly by using a photosensitive device, that is, the ambient light brightness is detected by using the photosensitive device integrated in the terminal device, and then the display screen brightness of the terminal device is adjusted to the display screen brightness corresponding to the ambient light brightness. Along with the occupation ratio of the screen of the terminal equipment is higher and higher, the terminal equipment is lighter and thinner, the requirement on the structure stacking space of the terminal equipment is stricter and stricter, a photosensitive device used for automatically adjusting the display brightness of the display screen of the terminal equipment according to the ambient light brightness in the prior art only has a single photosensitive function and occupies a certain structural control, and the screen occupation ratio of the terminal equipment is further increased seriously.
Disclosure of Invention
The embodiment of the invention provides a terminal device and a control method thereof, which are used for solving the problem that a photosensitive device for automatically adjusting the display brightness of a display screen of the terminal device according to the ambient light brightness limits the screen ratio of the terminal device to be further increased.
In order to solve the technical problem, the invention is realized as follows:
in a first aspect, an embodiment of the present invention provides a terminal device, including: the device comprises a lens, an image sensor, a control module and a display screen;
the image sensor is positioned on the light emitting side of the lens and is electrically connected with the control module;
when a camera module consisting of the lens and the image sensor is used for shooting an image, the image sensor is used for receiving ambient light through the lens and sensing the received ambient light to generate a first electric signal, and the control module is used for converting the first electric signal into an image signal;
when the image is not shot through the camera module consisting of the lens and the image sensor and the display screen displays a picture, the image sensor is used for receiving the ambient light through the lens and sensing the received ambient light to generate a second electric signal, and the control module is used for determining the brightness of the ambient light according to the second electric signal and adjusting the display brightness of the display screen according to the brightness of the ambient light.
In a second aspect, an embodiment of the present invention provides a method for controlling a terminal device, including:
when an image is shot through a camera module of the terminal equipment, a photosensitive device of the camera module is controlled to sense received ambient light to generate a first electric signal, and the first electric signal is converted into an image signal;
when the image is not shot through the camera module of the terminal equipment and the display screen of the terminal equipment displays the display screen, controlling a photosensitive device of the camera module to sense the received ambient light to generate a second electric signal, determining the brightness of the ambient light according to the second electric signal, and adjusting the display brightness of the display screen according to the brightness of the ambient light.
In a third aspect, an embodiment of the present invention provides a terminal device, including a processor, a memory, and a computer program stored on the memory and operable on the processor, where the computer program, when executed by the processor, implements the steps of the control method of the terminal device according to the first aspect.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when executed by a processor, the computer program implements the steps of the control method for a terminal device according to the first aspect.
The terminal device provided by the embodiment of the invention comprises: the device comprises a lens, an image sensor, a control module and a display screen; the image sensor is positioned on the light emitting side of the lens and electrically connected with the control module; when the camera module consisting of the lens and the image sensor is used for shooting an image, the image sensor is used for receiving ambient light through the lens and sensing the received ambient light to generate a first electric signal, the control module is used for converting the first electric signal into an image signal, when the camera module consisting of the lens and the image sensor is not used for shooting the image and the display screen displays a picture, the image sensor is used for receiving the ambient light through the lens and sensing the received ambient light to generate a second electric signal, and the control module is used for determining the brightness of the ambient light according to the second electric signal and adjusting the display brightness of the display screen according to the brightness of the ambient light. When the image is shot through the camera module, the ambient light received by the image sensor of the camera module generates a first electric signal and then is converted into an image signal; the method comprises the steps of generating a second electric signal through ambient light received by an image sensor of a camera module when an image is not shot through the camera module and a display screen displays a picture, determining the brightness of the ambient light according to the second electric signal, and adjusting the display brightness of the display screen according to the brightness of the ambient light.
Drawings
Fig. 1 is an architecture diagram of an android operating system provided in an embodiment of the present invention;
fig. 2 is one of schematic structural diagrams of a terminal device according to an embodiment of the present invention;
FIG. 3 is a comparison graph of response frequency bands of an image sensor and a photosensitive device according to an embodiment of the present invention;
fig. 4 is a second schematic structural diagram of a terminal device according to an embodiment of the present invention;
FIG. 5 is a graph illustrating a response field contrast between an image sensor and a photosensor according to an embodiment of the present invention;
fig. 6 is a light path diagram of ambient light with an incident angle larger than the field angle of the camera module according to the embodiment of the present invention;
fig. 7 is a third schematic structural diagram of a terminal device according to an embodiment of the present invention;
FIG. 8 is a schematic diagram of a diffusion module according to an embodiment of the present invention;
FIG. 9 is a schematic diagram illustrating a state of a diffusion module according to an embodiment of the present invention;
FIG. 10 is a schematic view illustrating another state of a diffusion module according to an embodiment of the present invention;
fig. 11 is a flowchart illustrating steps of a method for controlling a terminal device according to an embodiment of the present invention;
fig. 12 is a schematic diagram of a hardware structure of a terminal device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The term "and/or" herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone.
The terms "first" and "second," and the like, in the description and in the claims of the present invention are used for distinguishing between synchronized objects, and are not used to describe a particular order of objects. For example, the first interface and the second interface, etc. are for distinguishing different interfaces, rather than for describing a particular order of the interfaces.
In the embodiments of the present invention, words such as "exemplary" or "for example" are used to mean serving as examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "e.g.," an embodiment of the present invention is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion. Further, in the description of the embodiments of the present invention, "a plurality" means two or more unless otherwise specified.
At present, in the prior art, the display brightness of the display screen of the terminal device is automatically adjusted according to the ambient light brightness mainly by using a photosensitive device, that is, the ambient light brightness is detected by using the photosensitive device integrated in the terminal device, and then the display screen brightness of the terminal device is adjusted to the display screen brightness corresponding to the ambient light brightness. Along with the occupation ratio of the screen of the terminal equipment is higher and higher, the terminal equipment is lighter and thinner, the requirement on the structure stacking space of the terminal equipment is stricter and stricter, a photosensitive device used for automatically adjusting the display brightness of the display screen of the terminal equipment according to the ambient light brightness in the prior art only has a single photosensitive function and occupies a certain structural control, and the screen occupation ratio of the terminal equipment is further increased seriously.
In order to solve the problem, an embodiment of the present invention provides a terminal device and a control method thereof, where the terminal device includes: the device comprises a lens, an image sensor, a control module and a display screen; the image sensor is positioned on the light emitting side of the lens and electrically connected with the control module; when the camera module consisting of the lens and the image sensor is used for shooting an image, the image sensor is used for receiving ambient light through the lens and sensing the received ambient light to generate a first electric signal, the control module is used for converting the first electric signal into an image signal, when the camera module consisting of the lens and the image sensor is not used for shooting the image and the display screen displays a picture, the image sensor is used for receiving the ambient light through the lens and sensing the received ambient light to generate a second electric signal, and the control module is used for determining the brightness of the ambient light according to the second electric signal and adjusting the display brightness of the display screen according to the brightness of the ambient light. When the image is shot through the camera module, the ambient light received by the image sensor of the camera module generates a first electric signal and then is converted into an image signal; the method comprises the steps of generating a second electric signal through ambient light received by an image sensor of a camera module when an image is not shot through the camera module and a display screen displays a picture, determining the brightness of the ambient light according to the second electric signal, and adjusting the display brightness of the display screen according to the brightness of the ambient light.
The terminal device in the embodiment of the present invention may be a terminal device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present invention are not limited in particular.
Next, a software environment applied to the control method of the terminal device provided by the embodiment of the present invention is described by taking an android operating system as an example.
Fig. 1 is a schematic diagram of an architecture of a possible android operating system according to an embodiment of the present invention. In fig. 1, the architecture of the android operating system includes 4 layers, which are respectively: an application layer, an application framework layer, a system runtime layer, and a kernel layer (specifically, a Linux kernel layer).
The application program layer comprises various application programs (including a system application program and a target application program) in an android operating system.
The application framework layer is a framework of the application, and a developer can develop some applications based on the application framework layer under the condition of complying with the development principle of the framework of the application.
The system runtime layer includes libraries (also called system libraries) and android operating system runtime environments. The library mainly provides various resources required by the android operating system. The android operating system running environment is used for providing a software environment for the android operating system.
The kernel layer is an operating system layer of an android operating system and belongs to the bottommost layer of an android operating system software layer. The kernel layer provides kernel system services and hardware-related drivers for the android operating system based on the Linux kernel.
Taking an android operating system as an example, in the embodiment of the present invention, a developer may develop a software program for implementing the control method of the terminal device provided in the embodiment of the present invention based on the system architecture of the android operating system shown in fig. 1, so that the control method of the terminal device may run based on the android operating system shown in fig. 1. That is, the processor or the terminal may implement the control method of the terminal device provided by the embodiment of the present invention by running the software program in the android operating system.
The terminal equipment in the embodiment of the invention can be a mobile terminal or a non-mobile terminal. The mobile terminal may be a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), etc.; the non-mobile terminal may be a Personal Computer (PC), a Television (TV), a teller machine, a self-service machine, or the like; the embodiments of the present invention are not particularly limited.
The first embodiment,
An embodiment of the present invention provides a terminal device, and specifically, as shown in fig. 2, the terminal device includes: a lens 11, an image sensor 12, a control module 13 and a display 14.
The image sensor 12 is located on the light emitting side of the lens 11, and the image sensor 12 and the display screen 14 are both electrically connected to the control module 13.
Specifically, the lens 11 in the embodiment of the present invention includes: a plurality of optical lenses for adjusting the received ambient light and outputting the modulated ambient light to the image sensor 12 at an output side; the image sensor 12 may be a Metal-Oxide Semiconductor (CMOS) image sensor.
When an image is shot through a camera module consisting of the lens 11 and the image sensor 12, the image sensor 12 is used for receiving ambient light through the lens 11 and sensing the received ambient light to generate a first electric signal, and the control module 13 is used for converting the first electric signal into an image signal.
That is, when the image is captured by the image capturing module comprising the lens 11 and the image sensor 12, the working principle and the working state of each component (the lens 11, the image sensor 12, and the control module 13) are the same as those in the prior art, so that firstly, the embodiment of the present invention can ensure that the image capturing module comprising the lens 11 and the image sensor 12 can capture images normally.
When an image is not shot through the camera module consisting of the lens 11 and the image sensor 12 and the display screen 14 displays a picture, the image sensor 12 is configured to receive ambient light through the lens 11 and sense the received ambient light to generate a second electrical signal, and the control module 13 is configured to determine the brightness of the ambient light according to the second electrical signal and adjust the display brightness of the display screen 14 according to the brightness of the ambient light.
For example, the application scene in which no image is captured by the camera module consisting of the lens 11 and the image sensor 12 and the display screen 14 displays a picture may include: the terminal device browses a webpage, plays games, edits characters, and takes pictures, videos, and video calls through other camera modules of the terminal device, which is not limited in the embodiment of the present invention, and the camera module which is not composed of the lens 11 and the image sensor 12 takes pictures and the display screen 14 displays pictures (which are not standby interfaces).
Further, referring to fig. 3, fig. 3 shows the response sensitivity of the image sensor in the conventional camera module to light with different wavelengths (shown by the solid curve in fig. 3) and the response sensitivity of the photosensitive device in the conventional photosensitive detection module to light with different wavelengths (shown by the dashed curve in fig. 3). As can be seen from the response sensitivity curve of the image sensor in fig. 3 to the light with different wavelengths, the wavelength range of the light that the image sensor can respond to is 400nm to 1000nm, the response sensitivity curve of the photosensitive device commonly used for photosensitive detection to the light with different wavelengths can be seen, the wavelength range of the light that the photosensitive device can respond to is 400nm to 700nm, and the response spectral range of the photosensitive device completely falls within the response spectral range of the image sensor, so that the image sensor in the camera module can be used to accurately detect the brightness of the ambient light.
It should be noted that, since the wavelength range to which the photosensor can respond falls entirely within the wavelength range of the light to which the image sensor can respond, the operating state of the image sensor in the above-described embodiment when capturing an image may thus be the same as the operating state when no image is captured and the display screen displays a picture, however, because the wavelength range which needs to be sensed by the image sensor is longer when the image is shot, the power consumption of the image sensor is larger, if the image sensor is operated in the working state when the image is shot when the image is not shot and the display screen displays the image, the power consumption of the terminal device is greatly increased, so that the operating state of the image sensor when shooting images can be different from the operating state when not shooting images and the display screen displays images, and the wavelength range sensed by the image sensor when the image is shot is larger than the wavelength range when the image is not shot and the display screen displays the picture.
The terminal device provided by the embodiment of the invention comprises: the device comprises a lens, an image sensor, a control module and a display screen; the image sensor is positioned on the light emitting side of the lens and electrically connected with the control module; when the camera module consisting of the lens and the image sensor is used for shooting an image, the image sensor is used for receiving ambient light through the lens and sensing the received ambient light to generate a first electric signal, the control module is used for converting the first electric signal into an image signal, when the camera module consisting of the lens and the image sensor is not used for shooting the image and the display screen displays a picture, the image sensor is used for receiving the ambient light through the lens and sensing the received ambient light to generate a second electric signal, and the control module is used for determining the brightness of the ambient light according to the second electric signal and adjusting the display brightness of the display screen according to the brightness of the ambient light. When the image is shot through the camera module, the ambient light received by the image sensor of the camera module generates a first electric signal and then is converted into an image signal; the method comprises the steps of generating a second electric signal through ambient light received by an image sensor of a camera module when an image is not shot through the camera module and a display screen displays a picture, determining the brightness of the ambient light according to the second electric signal, and adjusting the display brightness of the display screen according to the brightness of the ambient light.
Optionally, when the camera module consisting of the lens 11 and the image sensor 12 is used to capture an image, the control module 13 is further configured to determine the brightness of the ambient light according to the first electrical signal, and adjust the display brightness of the display screen 14 according to the brightness of the ambient light.
In the above embodiment, when the image is captured by the camera module including the lens and the image sensor, the control module is further configured to determine the brightness of the ambient light according to the first electrical signal, and adjust the display brightness of the display screen according to the brightness of the ambient light, so that the display brightness of the display screen can also be adjusted when the image is captured by the camera module including the lens and the image sensor.
Optionally, referring to fig. 4, the terminal device provided in the embodiment of the present invention may further include: a lens barrel 15, an infrared filter 16, a Printed Circuit Board (PCB) and/or a Flexible Printed Circuit Board (FPC);
the lens barrel 15 forms an accommodating cavity for accommodating the lens 11 and is used for fixing the lens 11; the infrared filter 16 is located between the light-emitting side of the lens 11 and the image sensor 12, and is used for filtering infrared light in the ambient light output by the lens 11; PCB) and/or FPC is electrically connected to the image sensor 12 for conducting electrical signals generated by the image sensor 12.
Still further, referring to fig. 5, fig. 5 shows the response sensitivity of the image sensor in the conventional camera module to the light rays with different angles of view (shown by the solid curve in fig. 5) and the response sensitivity of the photosensitive device in the conventional photosensitive detection to the light rays with different angles of view (shown by the dashed curve in fig. 5). As can be seen from fig. 5, the field angle of light received by the image sensor is about 80 °, and the field angle of light received by the photosensor exceeds 120 °, if the photosensor is directly used for detecting the environment of the image sensor of the camera module, the image sensor of the camera module can only detect light within the field range of the camera module, as shown in fig. 6, the light exceeding the wide-angle light within the field range of the camera module is limited by the fact that the structure of the camera module cannot reach the image sensor of the camera module, and therefore if the angle of ambient light exceeds the field angle of the image sensor of the camera module, the brightness of ambient light cannot be accurately detected, and further the display brightness of the display screen of the terminal device cannot be accurately adjusted.
In order to avoid the above problem, referring to fig. 7, the terminal device according to the embodiment of the present invention further includes: a diffusion module 18 located on the light incident side of the lens 11;
when the camera module consisting of the lens 11 and the image sensor 12 is used for shooting images, the diffusion module 18 is used for transmitting ambient light;
when an image is not captured by the camera module consisting of the lens 11 and the image sensor 12 and a picture is displayed on the display screen 14, the diffusion module 18 is configured to diffuse ambient light input into the lens 11.
That is, when the image is captured by the camera module comprising the lens 11 and the image sensor 12, the diffusion module 18 does not diffuse the ambient light but directly transmits the ambient light, so as to ensure that the camera module can normally capture images, and when the image is not captured by the camera module comprising the lens 11 and the image sensor 12 and the display screen 14 displays a picture, the diffusion module diffuses the ambient light input into the lens 11, so that the situation that the environment with an incident angle larger than the field angle of the camera module cannot be detected by the image sensor of the camera module can be avoided, and the brightness of the ambient light can be accurately detected.
Further, optionally, referring to fig. 8, the diffusion module 18 includes: a first light-transmitting electrode layer 181, a second light-transmitting electrode layer 182, and a liquid crystal layer 183 located between the first light-transmitting electrode layer 181 and the second light-transmitting electrode layer 182.
For example, the light-transmitting electrode may be made of a light-transmitting conductive material such as Indium Tin Oxide (ITO) or graphene.
The operation principle of the diffusion module 18 according to the above embodiment will be described below with reference to fig. 9 and 10.
First, referring to fig. 9, in one state of the diffusion module 18, the liquid crystal molecules in the liquid crystal layer 183 do not need to be aligned, and at this time, the diffusion module 18 scatters and transmits the received light.
Next, referring to fig. 10, when the diffusion module 18 is in another state, the liquid crystal molecules in the liquid crystal layer 183 need to be aligned, and at this time, the diffusion module 18 directly transmits the received light.
For example, the state shown in fig. 9 may be a state when both the first light-transmitting electrode contact 181 and the second light-transmitting electrode contact 182 are turned on at a low level, and the state shown in fig. 10 may be a state when the first light-transmitting electrode contact 181 is turned on at a low level and the second light-transmitting electrode contact 182 is turned on at a high level.
Optionally, the low level may be a reference ground of the terminal device, and the high level may be a power supply voltage of the terminal device; that is, when an image is captured by the camera module including the lens and the image sensor, a reference ground voltage is input to the first transparent electrode contact 181 and a power voltage is input to the first transparent electrode contact 181, and when an image is not captured by the camera module including the lens and the image sensor and a screen is displayed on the display screen, a reference ground voltage is input to both the first transparent electrode contact 181 and the second transparent electrode 182.
Optionally, the terminal device further includes: the light-transmitting cover plate is arranged on the light incidence side of the lens; the diffusion module is packaged in the light-transmitting cover plate.
Specifically, the light-transmitting cover plate is arranged on the light-incident side of the lens 11 of the terminal equipment camera module to play a role in protecting the lens 11 from dust and water, and in order to realize a photosensitive function by using the camera module without increasing structural burden and volume, the diffusion module 18 can be packaged in the light-transmitting cover plate in front of the lens 11 in the embodiment of the invention.
Example II,
An embodiment of the present invention provides a method for controlling a terminal device, and specifically, referring to fig. 11, the method includes:
and S11, determining whether the image is shot through the camera module of the terminal equipment.
In the above step S11, if an image is being captured by the camera module of the terminal device, step S12 is executed, and if an image is being captured by the camera module of the terminal device, step S13 is executed.
And S12, controlling a photosensitive device of the camera module to sense the received ambient light to generate a first electric signal, and converting the first electric signal into an image signal.
And S13, determining whether the display screen of the terminal equipment is displaying a picture.
In the above step S13, if the terminal device display screen does not display a screen, the process ends, and if the terminal device display screen is displaying a screen, the process goes to step S14.
And S14, controlling a photosensitive device of the camera module to sense the received ambient light to generate a second electric signal, determining the brightness of the ambient light according to the second electric signal, and adjusting the display brightness of the display screen according to the brightness of the ambient light.
Optionally, the method further includes: when the image is shot through the camera module of the terminal equipment, controlling the diffusion module of the terminal equipment to transmit ambient light;
and when the image is not shot through the camera module of the terminal equipment and the display screen of the terminal equipment displays a display picture, controlling the diffusion module of the terminal equipment to scatter the ambient light input into the lens of the camera module.
Optionally, the diffusion module includes: the liquid crystal display panel comprises a first light-transmitting electrode layer, a second light-transmitting electrode layer and a liquid crystal layer positioned between the first light-transmitting electrode layer and the second light-transmitting electrode layer;
control terminal equipment's diffusion module transmission ambient light includes: applying a first voltage to the second transparent electrode;
the control the diffusion module of terminal equipment carries out the scattering to the ambient light of the camera lens of inputing the module of making a video recording, include: applying a second voltage to the second transparent electrode.
Optionally, the method further includes:
when the image is shot through the camera module of the terminal device, the brightness of the ambient light is determined according to the first electric signal, and the display brightness of the display screen is adjusted according to the brightness of the ambient light.
According to the control method of the terminal device provided by the embodiment of the invention, when an image is shot through the camera module of the terminal device, the image sensor of the camera module senses received ambient light to generate a first electric signal and converts the first electric signal into an image signal, when the image is not shot through the camera module of the terminal device and a display screen of the terminal device displays a picture, the image sensor of the camera module senses the received ambient light to generate a second electric signal, the brightness of the ambient light is determined according to the second electric signal, and the display brightness of the display screen is adjusted according to the brightness of the ambient light. When the image is shot through the camera module, the ambient light received by the image sensor of the camera module generates a first electric signal and then is converted into an image signal; the method comprises the steps of generating a second electric signal through ambient light received by an image sensor of a camera module when an image is not shot through the camera module and a display screen displays a picture, determining the brightness of the ambient light according to the second electric signal, and adjusting the display brightness of the display screen according to the brightness of the ambient light.
Example III,
Fig. 12 is a schematic diagram of a hardware structure of a terminal device for implementing various embodiments of the present invention, and as shown in fig. 12, the terminal device 100 includes, but is not limited to: radio frequency unit 101, network module 102, audio output unit 103, input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art will appreciate that the terminal device configuration shown in fig. 12 does not constitute a limitation of the terminal device, and that the terminal device may include more or fewer components than shown, or combine certain components, or a different arrangement of components. In the embodiment of the present invention, the terminal device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.
The processor 110 is configured to, when an image is captured by a camera module of the terminal device, control a photosensitive device of the camera module to sense received ambient light to generate a first electrical signal, and convert the first electrical signal into an image signal; when the image is not shot through the camera module of the terminal equipment and the display screen of the terminal equipment displays the display screen, controlling a photosensitive device of the camera module to sense the received ambient light to generate a second electric signal, determining the brightness of the ambient light according to the second electric signal, and adjusting the display brightness of the display screen according to the brightness of the ambient light.
The terminal device provided by the embodiment of the invention comprises: the device comprises a lens, an image sensor, a control module and a display screen; the image sensor is positioned on the light emitting side of the lens, and the image sensor and the display screen are both electrically connected with the control module; when the camera module consisting of the lens and the image sensor is used for shooting an image, the image sensor is used for receiving ambient light through the lens and sensing the received ambient light to generate a first electric signal, the control module is used for converting the first electric signal into an image signal, when the camera module consisting of the lens and the image sensor is not used for shooting the image and the display screen displays a picture, the image sensor is used for receiving the ambient light through the lens and sensing the received ambient light to generate a second electric signal, and the control module is used for determining the brightness of the ambient light according to the second electric signal and adjusting the display brightness of the display screen according to the brightness of the ambient light. When the image is shot through the camera module, the ambient light received by the image sensor of the camera module generates a first electric signal and then is converted into an image signal; the method comprises the steps of generating a second electric signal through ambient light received by an image sensor of a camera module when an image is not shot through the camera module and a display screen displays a picture, determining the brightness of the ambient light according to the second electric signal, and adjusting the display brightness of the display screen according to the brightness of the ambient light.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 101 may be used for receiving and sending signals during a message transmission or call process, and specifically, after receiving downlink data from a base station, the downlink data is processed by the processor 110; in addition, the uplink data is transmitted to the base station. Typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with a network and other devices through a wireless communication system.
The terminal device provides wireless broadband internet access to the user through the network module 102, such as helping the user send and receive e-mails, browse webpages, access streaming media, and the like.
The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the network module 102 or stored in the memory 109 into an audio signal and output as sound. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the terminal device (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 includes a speaker, a buzzer, a receiver, and the like.
The input unit 104 is used to receive an audio or video signal. The input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, and the Graphics processor 1041 processes image data of a still picture or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the network module 102. The microphone 1042 may receive sound and may be capable of processing such sound into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode.
The terminal device also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or the backlight when the terminal device is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the terminal device posture (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration identification related functions (such as pedometer, tapping), and the like; the sensors 105 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.
The display unit 106 is used to display information input by a user or information provided to the user. The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the terminal device. Specifically, the user input unit 107 includes a touch panel 1071 and other input devices 1072. Touch panel 1071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 1071 (e.g., operations by a user on or near touch panel 1071 using a finger, stylus, or any suitable object or attachment). The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and receives and executes commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. Specifically, other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.
Further, the touch panel 1071 may be overlaid on the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although in fig. 12, the touch panel 1071 and the display panel 1061 are two independent components to implement the input and output functions of the terminal device, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the terminal device, and is not limited herein.
The interface unit 108 is an interface for connecting an external device to the terminal apparatus. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements in the terminal equipment or may be used to transmit data between the terminal equipment and the external device.
The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 110 is a control center of the terminal device, connects various parts of the entire terminal device by various interfaces and lines, and performs various functions of the terminal device and processes data by running or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the terminal device. Processor 110 may include one or more processing units; alternatively, the processor 110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.
The terminal device may further include a power supply 111 (such as a battery) for supplying power to each component, and optionally, the power supply 111 may be logically connected to the processor 110 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.
In addition, the terminal device includes some functional modules that are not shown, and are not described herein again.
Example four,
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the control method embodiment of the terminal device, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
The terminal device and the computer storage medium provided in the embodiments of the present invention are both configured to execute the corresponding methods provided above, and therefore, the beneficial effects achieved by the terminal device and the computer storage medium can refer to the beneficial effects in the corresponding methods provided above, which are not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims (8)

1. A terminal device, comprising: the device comprises a lens, an image sensor, a control module and a display screen;
the image sensor is positioned on the light emitting side of the lens and is electrically connected with the control module;
when a camera module consisting of the lens and the image sensor is used for shooting an image, the image sensor is used for receiving ambient light through the lens and sensing the received ambient light to generate a first electric signal, and the control module is used for converting the first electric signal into an image signal;
when an image is not shot through a camera module consisting of the lens and the image sensor and the display screen displays a picture, the image sensor is used for receiving ambient light through the lens and sensing the received ambient light to generate a second electric signal, and the control module is used for determining the brightness of the ambient light according to the second electric signal and adjusting the display brightness of the display screen according to the brightness of the ambient light;
the terminal device further includes: the diffusion module is positioned on the light incident side of the lens;
when the camera shooting module consisting of the lens and the image sensor shoots an image, the diffusion module is used for transmitting ambient light;
when the image is not shot through the camera module consisting of the lens and the image sensor and the display screen displays a display screen, the diffusion module is used for scattering the ambient light input into the lens.
2. The terminal device of claim 1, wherein the diffusion module comprises: the liquid crystal display panel comprises a first light-transmitting electrode layer, a second light-transmitting electrode layer and a liquid crystal layer located between the first light-transmitting electrode layer and the second light-transmitting electrode layer.
3. The terminal device according to claim 2, wherein the terminal device further comprises: the light-transmitting cover plate is arranged on the light incidence side of the lens; the diffusion module is packaged in the light-transmitting cover plate.
4. The terminal device according to any one of claims 1 to 3, wherein when an image is captured by a camera module comprising the lens and the image sensor, the control module is further configured to determine a brightness of ambient light according to the first electrical signal, and adjust the display brightness of the display screen according to the brightness of the ambient light.
5. A control method of a terminal device, comprising:
when an image is shot through a camera module of the terminal equipment, a photosensitive device of the camera module is controlled to sense received ambient light to generate a first electric signal, and the first electric signal is converted into an image signal;
when an image is not shot through a camera module of the terminal equipment and a display screen of the terminal equipment displays a picture, controlling a photosensitive device of the camera module to sense received ambient light to generate a second electric signal, determining the brightness of the ambient light according to the second electric signal, and adjusting the display brightness of the display screen according to the brightness of the ambient light;
the method further comprises the following steps:
when the image is shot through the camera module of the terminal equipment, controlling the diffusion module of the terminal equipment to transmit ambient light;
and when the image is not shot through the camera module of the terminal equipment and the display screen of the terminal equipment displays a display picture, controlling the diffusion module of the terminal equipment to scatter the ambient light input into the lens of the camera module.
6. The method of claim 5, wherein the diffusion module comprises: the liquid crystal display panel comprises a first light-transmitting electrode layer, a second light-transmitting electrode layer and a liquid crystal layer positioned between the first light-transmitting electrode layer and the second light-transmitting electrode layer;
control terminal equipment's diffusion module transmission ambient light includes: applying a first voltage to the second transparent electrode;
the control the diffusion module of terminal equipment carries out the scattering to the ambient light of the camera lens of inputing the module of making a video recording, include: applying a second voltage to the second transparent electrode.
7. The method according to any one of claims 5-6, further comprising:
when the image is shot through the camera module of the terminal device, the brightness of the ambient light is determined according to the first electric signal, and the display brightness of the display screen is adjusted according to the brightness of the ambient light.
8. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the steps of the control method of a terminal device according to any one of claims 5 to 7.
CN201810970592.8A 2018-08-24 2018-08-24 Terminal device, control method thereof and computer-readable storage medium Active CN109257463B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810970592.8A CN109257463B (en) 2018-08-24 2018-08-24 Terminal device, control method thereof and computer-readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810970592.8A CN109257463B (en) 2018-08-24 2018-08-24 Terminal device, control method thereof and computer-readable storage medium

Publications (2)

Publication Number Publication Date
CN109257463A CN109257463A (en) 2019-01-22
CN109257463B true CN109257463B (en) 2020-11-17

Family

ID=65050402

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810970592.8A Active CN109257463B (en) 2018-08-24 2018-08-24 Terminal device, control method thereof and computer-readable storage medium

Country Status (1)

Country Link
CN (1) CN109257463B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110336938B (en) * 2019-08-12 2021-02-26 浙江大华技术股份有限公司 Photosensitive element, image acquisition device, lens driving method, and storage medium
CN113747626B (en) * 2020-05-29 2023-08-29 北京小米移动软件有限公司 Ambient light determining method, device, terminal equipment and medium
CN114244927B (en) * 2021-12-06 2024-04-19 维沃移动通信有限公司 Electronic device, control method and control device
CN115103100A (en) * 2022-06-22 2022-09-23 Oppo广东移动通信有限公司 Camera module, control method thereof, electronic device and computer-readable storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1098203A (en) * 1993-06-07 1995-02-01 卡西欧计算机公司 Liquid crystal indicator
CN1357115A (en) * 1999-06-23 2002-07-03 时至准钟表股份有限公司 Liquid crystal display
CN102314840A (en) * 2010-06-30 2012-01-11 格科微电子(上海)有限公司 Image sensor, electronic device and backlight adjusting method thereof
CN107040730A (en) * 2017-04-28 2017-08-11 广东欧珀移动通信有限公司 Image formation control method, the imaging sensor of imaging sensor, and imaging device
CN206710760U (en) * 2017-05-12 2017-12-05 北京京东方光电科技有限公司 A kind of shooting part, display device
CN207491072U (en) * 2017-11-03 2018-06-12 成都野望数码科技有限公司 A kind of camera system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1098203A (en) * 1993-06-07 1995-02-01 卡西欧计算机公司 Liquid crystal indicator
CN1357115A (en) * 1999-06-23 2002-07-03 时至准钟表股份有限公司 Liquid crystal display
CN102314840A (en) * 2010-06-30 2012-01-11 格科微电子(上海)有限公司 Image sensor, electronic device and backlight adjusting method thereof
CN107040730A (en) * 2017-04-28 2017-08-11 广东欧珀移动通信有限公司 Image formation control method, the imaging sensor of imaging sensor, and imaging device
CN206710760U (en) * 2017-05-12 2017-12-05 北京京东方光电科技有限公司 A kind of shooting part, display device
CN207491072U (en) * 2017-11-03 2018-06-12 成都野望数码科技有限公司 A kind of camera system

Also Published As

Publication number Publication date
CN109257463A (en) 2019-01-22

Similar Documents

Publication Publication Date Title
US20220276909A1 (en) Screen projection control method and electronic device
CN109257463B (en) Terminal device, control method thereof and computer-readable storage medium
CN109743498B (en) Shooting parameter adjusting method and terminal equipment
CN110891144A (en) Image display method and electronic equipment
CN110602407B (en) Shooting method and electronic equipment
CN107645610B (en) Control method of mobile terminal and mobile terminal
CN108307106B (en) Image processing method and device and mobile terminal
CN109710349B (en) Screen capturing method and mobile terminal
KR20220092937A (en) Screen display control method and electronic device
CN109257505B (en) Screen control method and mobile terminal
CN107818038B (en) Information prompting method and mobile terminal
CN110489045B (en) Object display method and terminal equipment
US20220329741A1 (en) Camera start method and electronic device
CN110769174B (en) Video viewing method and electronic equipment
CN110661949A (en) Control method of display panel and electronic equipment
CN110753155A (en) Proximity detection method and terminal equipment
CN111343710B (en) Power adjustment method and electronic equipment
CN110868546B (en) Shooting method and electronic equipment
CN111050109B (en) Electronic equipment control method and electronic equipment
CN109859718B (en) Screen brightness adjusting method and terminal equipment
CN109151143B (en) Foreign matter detection structure and method and mobile terminal
CN109167917B (en) Image processing method and terminal equipment
JP7413546B2 (en) Photography method and electronic equipment
CN109561258B (en) Light supplementing method and terminal equipment
CN109491572B (en) Screen capturing method of mobile terminal and mobile terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant