CN111901539B - Image acquisition method, image acquisition device and terminal equipment - Google Patents
Image acquisition method, image acquisition device and terminal equipment Download PDFInfo
- Publication number
- CN111901539B CN111901539B CN202011004747.6A CN202011004747A CN111901539B CN 111901539 B CN111901539 B CN 111901539B CN 202011004747 A CN202011004747 A CN 202011004747A CN 111901539 B CN111901539 B CN 111901539B
- Authority
- CN
- China
- Prior art keywords
- photodiode
- mode
- photodiodes
- image acquisition
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
- H04N25/42—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by switching between different modes of operation using different resolutions or aspect ratios, e.g. switching between interlaced and non-interlaced mode
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
- H04N25/44—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Abstract
The application provides an image acquisition method, which is applied to terminal equipment comprising a camera, and the image acquisition method comprises the following steps: if the current image acquisition mode is a first mode, acquiring a first image according to a first photodiode set in the camera, wherein the first photodiode set comprises a first preset number of photodiodes; and if the current image acquisition mode is a second mode, acquiring a second image according to a second photodiode set in the camera, wherein the second photodiode set comprises a second preset number of photodiodes, and the second preset number is smaller than the first preset number. By the method, the problem that the hardware cost of the terminal equipment is high due to the fact that a plurality of cameras with different resolutions are set according to the requirements of different scenes can be solved.
Description
Technical Field
The present application relates to the field of image acquisition, and in particular, to an image acquisition method, an image acquisition apparatus, a terminal device, and a computer-readable storage medium.
Background
At present, in a terminal device, a plurality of cameras are often arranged according to the requirements of different scenes. For example, a front camera with higher resolution is arranged on the surface where the screen of the terminal device is located to meet the photographing requirement of a user, and in addition, a front camera with higher resolution is arranged to perform real-time gesture recognition, touch-free unlocking detection and other context awareness. However, more cameras result in higher hardware costs and take up more space.
Disclosure of Invention
The embodiment of the application provides an image acquisition method, an image acquisition device, a terminal device and a computer readable storage medium, which can solve the problem that the hardware cost of the terminal device is higher as a plurality of cameras with different resolutions are set according to the requirements of different scenes.
In a first aspect, an embodiment of the present application provides an image acquisition method, which is applied to a terminal device including a camera, where the image acquisition method includes:
if the current image acquisition mode is a first mode, acquiring a first image according to a first photodiode set in the camera, wherein the first photodiode set comprises a first preset number of photodiodes;
and if the current image acquisition mode is a second mode, acquiring a second image according to a second photodiode set in the camera, wherein the second photodiode set comprises a second preset number of photodiodes, and the second preset number is smaller than the first preset number.
In a second aspect, an embodiment of the present application provides an image acquisition apparatus, which is applied to a terminal device including a camera, where the image acquisition apparatus includes:
the camera comprises a first processing module, a second processing module and a third processing module, wherein the first processing module is used for obtaining a first image according to a first photodiode set in the camera if the current image acquisition mode is a first mode, and the first photodiode set comprises a first preset number of photodiodes;
and the second processing module is used for obtaining a second image according to a second photodiode set in the camera if the current image acquisition mode is a second mode, wherein the second photodiode set comprises a second preset number of photodiodes, and the second preset number is smaller than the first preset number.
In a third aspect, an embodiment of the present application provides a terminal device, which includes a camera, a memory, a processor, a display, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the image acquiring method according to the first aspect.
In a fourth aspect, the present application provides a computer-readable storage medium, where a computer program is stored, and the computer program, when executed by a processor, implements the image acquisition method according to the first aspect.
In a fifth aspect, the present application provides a computer program product, which when run on a terminal device, causes the terminal device to execute the image acquisition method described in the first aspect.
Compared with the prior art, the embodiment of the application has the advantages that: in the embodiment of the application, if the current image acquisition mode is a first mode, a first image is obtained according to a first photodiode set in the camera, wherein the first photodiode set comprises a first preset number of photodiodes; if the current image acquisition mode is the second mode, a second image is obtained according to a second photodiode set in the camera, wherein the second photodiode set comprises a second preset number of photodiodes, and the second preset number is smaller than the first preset number.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a schematic flowchart of an image acquisition method according to an embodiment of the present application;
FIG. 2 is a schematic flow chart diagram illustrating another image acquisition method according to an embodiment of the present disclosure;
FIG. 3 is a schematic diagram illustrating an exemplary control of a photodiode according to an embodiment of the present application;
FIG. 4 is a timing diagram of the first control signal and the second control signal according to an embodiment of the present application;
FIG. 5 is a schematic diagram illustrating another exemplary control of a photodiode provided by an embodiment of the present application;
FIG. 6 is another timing diagram of the first control signal and the second control signal according to an embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of an image capturing apparatus according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a terminal device according to an embodiment of the present application.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
As used in this specification and the appended claims, the term "if" may be interpreted contextually as "when", "upon" or "in response to" determining "or" in response to detecting ". Similarly, the phrase "if it is determined" or "if a [ described condition or event ] is detected" may be interpreted contextually to mean "upon determining" or "in response to determining" or "upon detecting [ described condition or event ]" or "in response to detecting [ described condition or event ]".
Reference throughout this specification to "one embodiment" or "some embodiments," or the like, means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," or the like, in various places throughout this specification are not necessarily all referring to the same embodiment, but rather "one or more but not all embodiments" unless specifically stated otherwise. The terms "comprising," "including," "having," and variations thereof mean "including, but not limited to," unless otherwise specifically stated.
Specifically, fig. 1 shows a flowchart of an image obtaining method provided in an embodiment of the present application, where the image obtaining method can be applied to a terminal device including a camera.
The image obtaining method provided by the embodiment of the present application may be applied to a server, a desktop computer, a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an Augmented Reality (AR)/Virtual Reality (VR) device, a notebook computer, a super-mobile personal computer (UMPC), a netbook, a Personal Digital Assistant (PDA), and other terminal devices, and the embodiment of the present application does not limit specific types of the terminal devices.
The specific type of the camera of the terminal device and the specific arrangement manner in the terminal device are not limited herein. For example, the camera may include a Charge Coupled Device (CCD), a Complementary Metal Oxide Semiconductor (CMOS), or a Contact Image Sensor (CIS). The camera can be arranged on the surface where the screen of the terminal equipment is located to serve as a front camera. Currently, in some other examples, the camera may be disposed at other positions of the terminal device. In the embodiment of the present application, the terminal device may further include other cameras besides the camera used for implementing the method embodiment of the present application.
As shown in fig. 1, the image acquisition method may include:
step S101, if the current image acquisition mode is a first mode, obtaining a first image according to a first photodiode set in the camera, wherein the first photodiode set comprises a first preset number of photodiodes.
In the embodiment of the present application, the specific setting manner of the first mode may be multiple. For example, the first mode may include at least one of a photographing mode and a video photographing mode, etc.
The specific pixel arrangement of the photodiode array in the camera may also be varied. For example, the photodiode array may be a Red Green Blue (RGB) pixel pattern, and may also be a Red Green Blue White (RGBW) pixel pattern. In the embodiments of the present application, the arrangement of the internal circuit of the photodiode is not limited herein. For example, the photo-electric analog signal output by the photodiode may be amplified by an amplifier, converted into a digital signal by an analog-to-digital converter (ADC), and output to a Graphics Processing Unit (GPU) for Processing to obtain corresponding images, such as the first image and the second image in the embodiment of the present application.
In the embodiment of the application, if the current image acquisition mode is the first mode, a first image is obtained according to the first photodiode set in the camera. At this time, the first preset number and the positions of the photodiodes included in the first photodiode set in the photodiode array of the camera may be determined according to actual scene requirements. For example, if the first mode is a photographing mode, and in the photographing mode, a user has a high requirement on the definition of an image, the photodiodes included in the first set of photodiodes may be all the photodiodes in the camera.
In this embodiment of the application, the first image may be obtained according to output signals of photodiodes included in the first photodiode set, so that the first preset number and positions of the photodiodes included in the first photodiode set in the photodiode array of the camera may be determined according to specific requirements of a first mode, so as to determine the number of pixel points and the pixel arrangement manner in the first image, and adjust the resolution of the obtained first image and the like according to the specific requirements of the first mode, so as to ensure the image quality of the first image in the first mode. Each pixel point in the first image may correspond to an output signal of one photodiode, or may be calculated from output signals of a plurality of photodiodes, and a specific generation manner of the first image is not limited herein.
For example, an initial image may be obtained based on an output signal of each photodiode included in the first set of photodiodes, where each pixel point in the initial image corresponds to an output signal of one photodiode. In addition, the initial image may be composed of a plurality of pixel sub-arrays, and the pixel point arrangement manner in each pixel sub-array may be various, and for example, the pixel sub-array may be an RGBW sub-array, and the RGBW sub-array may include pixel points of 4 different chrominance channels. In some examples, the pixel value of a pixel point at a corresponding position in the first image may be generated according to the pixel values of the pixel points in the RGBW sub-array. At this time, the resolution of the first image may be 1/4 of the resolution of the initial image.
Step S102, if the current image capturing mode is a second mode, obtaining a second image according to a second photodiode set in the camera, where the second photodiode set includes a second preset number of photodiodes, and the second preset number is smaller than the first preset number.
In the embodiment of the present application, the requirement on the resolution of the image in the second mode may be lower than that in the first mode. For example, the second mode may be a preview mode or a Context aware (Context aware) mode, etc. In the context awareness mode, the terminal device may detect a current context through a sensor such as a camera or an infrared sensing device. For example, in some examples, functions such as gesture recognition, object detection, and touchless unlocking may be performed by a camera.
In the embodiment of the present application, in the second mode, a second image may be acquired according to a second photodiode set in the camera. The two preset numbers and the positions of the photodiodes included in the second photodiode set in the photodiode array of the camera can be determined according to actual scene requirements. For example, in some examples, the photodiode array may include a plurality of sub-arrays 4*4, where 2 photodiodes may be respectively acquired from each sub-array to obtain the second set of photodiodes.
In the embodiment of the present application, the second preset number is smaller than the first preset number. Therefore, according to the embodiment of the application, the number of the photodiodes outputting the pixel values can be reduced according to the specific requirements of the second mode, so that the power consumption can be reduced, the resolution of the second image can be reduced, and the processing speed of the second image can be increased, so that the obtained second image better meets the requirements of the second mode.
In some embodiments, the image acquisition method further comprises:
step S201, when the camera is in an operating state, if a preset instruction is acquired, setting the current image acquisition mode to be a first mode;
step S202, if the preset instruction is not acquired, the current image acquisition mode is set to be a second mode.
Wherein the camera may be brought into a running state after specific triggering information is detected (e.g., a specific user operation is detected). In some embodiments, after the terminal device is powered on, the camera may be kept in an operating state, so as to achieve real-time image data acquisition through the camera, so as to achieve functions such as context awareness and shooting.
In the embodiment of the application, the preset instruction may be triggered based on a user operation and/or an application control instruction. For example, the preset instruction may be generated after it is detected that the terminal device starts a shooting function, or the preset instruction may be generated after it is detected that a user clicks a preset virtual key of the terminal device.
In the embodiment of the application, after the preset instruction is acquired, the current image acquisition mode is set to be the first mode, and in other cases, the current image acquisition mode may be the second mode, and at this time, the second preset number is smaller than the first preset number, so that generally speaking, the running power consumption of the camera in the second mode may be considered to be smaller, and the effect of reducing the power consumption is achieved.
In some embodiments, the first mode is a shooting mode, the second mode is a context-aware mode, and the first preset number is the number of all photodiodes in the camera.
In the embodiment of the present application, the shooting mode may be a mode for shooting an image, a mode for shooting a video, a preview mode during shooting, and the like. In the shooting mode, a user often wants to acquire an image with better quality, and therefore, the outputs of all the photodiodes in the camera can be acquired to acquire the first image, so that the image information in the first image is as rich as possible, and the image quality of the first image is ensured.
Under the situation perception mode, the camera can collect image information in real time so as to perform gesture recognition, target detection, touchless retrieval and the like.
At present, in the prior art, a Camera for realizing context awareness also becomes a normally open Camera (Always on Camera). In addition, since the normally open camera is often in a state of being always opened, the requirement on power consumption is high, and in order to achieve the purpose of low power consumption, a CIS with a resolution of 640 × 480 and a low-resolution display graphics Array (VGA) format is often deployed on the terminal device to serve as the normally open camera. In addition, in a current common application scenario, the normally open camera is generally arranged on the surface where the screen of the terminal device is located, but the image shooting quality of the normally open camera is difficult to meet the shooting requirements of a user such as self-shooting, and therefore the terminal device needs to be provided with a front camera to meet the shooting requirements of the user. At this time, at least two holes need to be opened on the surface of the screen of the terminal device to place two front cameras, so that the appearance of the terminal device is affected, and the hardware cost is increased.
In the embodiment of the application, if it is detected that the terminal device is in the shooting mode, the first image can be obtained according to all the photodiodes in the camera to obtain more image information, so that the image quality of the first image can meet the requirements of the shooting mode. And if the terminal equipment is detected to be in the situation awareness mode, a second image can be obtained according to part of the photodiodes in the camera, so that the power consumption in the situation awareness mode is reduced, and the detection efficiency of situation awareness can be improved. Therefore, according to the embodiment of the application, the output of the photodiode can be adjusted through one camera to meet the requirements of at least two scenes such as image shooting and context awareness, so that the requirements of different scenes can be met without arranging two cameras in the terminal equipment respectively, and the hardware cost is reduced.
In some embodiments, the camera includes a wide-angle lens, wherein an angle of view of the wide-angle lens is greater than a preset angle. Illustratively, the angle of view of the wide-angle lens may be 100 °. At this time, the wide-angle lens can simultaneously satisfy the requirements of scenes such as photographing, video photographing and the like and context-aware scenes. In addition, the pixel arrangement mode of the photodiode array in the camera can be an RGBW mode, so that the light sensing capability of the camera is improved, and the requirement of context sensing under dark light is met.
In the embodiment of the application, if the current image acquisition mode is a first mode, a first image is obtained according to a first photodiode set in the camera, wherein the first photodiode set comprises a first preset number of photodiodes; if the current image acquisition mode is the second mode, a second image is obtained according to a second photodiode set in the camera, wherein the second photodiode set comprises a second preset number of photodiodes, and the second preset number is smaller than the first preset number.
On the basis of the foregoing embodiments, in some embodiments, if the current image capturing mode is the second mode, obtaining a second image according to a second set of photodiodes in the camera includes:
if the current image acquisition mode is a second mode, acquiring an output signal of each photodiode in the second photodiode set in a preset sequence according to a target control signal;
and obtaining the second image according to the acquired output signal.
In an embodiment of the present application, the target control signal may be used to control exposure of each photodiode in the second set of photodiodes to generate an output signal of each photodiode in the second set of photodiodes, and may be used to read the output signal of each photodiode in the second set of photodiodes.
It is understood that the number of signals included in the target control signal, the signal timing information, and the specific control manner for each photodiode in the second set of photodiodes may be various. For example, the target control signal may be used to separately control each photodiode in the second photodiode set, or may also control all photodiodes in the second photodiode set synchronously, or may also divide each photodiode in the second photodiode set to obtain at least two preset subsets, and then sequentially control each preset subset.
In some embodiments, for each photodiode of the camera, the photodiode is controlled based on a corresponding first control signal for controlling the corresponding photodiode to generate an output signal and a corresponding second control signal for controlling reading of the output signal of the corresponding photodiode;
the target control signal includes a first control signal for each photodiode in the second set of photodiodes and a second control signal for each photodiode in the second set of photodiodes.
In this embodiment of the application, the first control signal and the second control signal corresponding to each photodiode may be generated and output by different control modules, or certainly, may be generated and output by the same control module.
The first control signal may control the photodiode to generate an output signal by controlling the on/off of a designated switch (such as a transistor or a radio frequency switch) in a related circuit of the corresponding photodiode, for example, a voltage may be applied to two ends of the corresponding photodiode by the first control signal, so that the related circuit of the photodiode forms a path to obtain the output signal of the photodiode; further, the arrangement of the light shielding member of the photodiode may also be controlled so that the photodiode can receive an optical signal and photoelectrically convert the optical signal to obtain an output signal of the photodiode.
The second control signal can also control the reading of the output signal of the corresponding photodiode by controlling the opening and closing of the corresponding preset control switch. It is understood that the reading of the output signal may refer to causing a designated data processing module (e.g., a Central Processing Unit (CPU)) in the terminal device to acquire the corresponding output signal.
It can be seen that, for any photodiode, the photodiode can output the output signal of the photodiode to the designated data processing module only after receiving the first control signal and the second control signal, and if only one of the first control signal and the second control signal is received, the photodiode cannot output an effective output signal to the designated data processing module.
Therefore, through the first control signal and the second control signal in the embodiment of the present application, the generation and reading of the output signals of the respective photodiodes in the camera can be dynamically controlled for different scenes.
Compared with the scheme that each photodiode generates output signals and reads in a unified mode in the prior art, the embodiment of the application can dynamically control the generation and reading of the output signals of each photodiode in the camera according to scene requirements in some scenes, the utilization rate of the photodiodes is reduced, power consumption is reduced, the number of the output signals can be reduced, and the subsequent processing rate is improved.
It should be noted that, in the embodiment of the present application, the number of the photodiodes controlled by any one of the first control signals is not limited herein. The number of photodiodes controlled by each first control signal may be the same or may differ. In addition, the number of photodiodes controlled by any one of the second control signals is not limited herein. The number of photodiodes controlled by each second control signal may be the same or may differ.
In some embodiments, for each first control signal, the first control signal is for controlling at least one row of photodiodes of the photodiode array of the camera along a first direction to generate an output signal;
for each second control signal, the second control signal is used for controlling the reading of the output signals of at least one row of photodiodes in a second direction of the photodiode array of the camera, the first direction and the second direction are mutually perpendicular, and the photodiodes respectively controlled by each second control signal are determined according to the position of each photodiode in the second photodiode array along the second direction.
It will be appreciated that a row of photodiodes may be a row of lateral photodiodes or a row of longitudinal photodiodes. The first direction may be a transverse direction, and the corresponding second direction may be a longitudinal direction; alternatively, the first direction may be a longitudinal direction, in which case the corresponding second direction may be a transverse direction. At this time, the intersection point of the first control signal and the second control signal in the photodiode array is the photodiode capable of transmitting the output signal to the designated data processing module.
In this embodiment, each first control signal may be sequentially generated according to a timing sequence, so as to control each row of photodiodes in the photodiode array along the first direction to sequentially generate an output signal according to the timing sequence. For example, each first control signal may control a row of photodiodes of the photodiode array along a first direction. And, each row of photodiodes of the photodiode array along the first direction may be sequentially controlled to generate an output signal according to the respective first control signals in an order from top to bottom.
The photodiodes respectively controlled by the second control signals are determined according to the positions of the photodiodes in the second photodiode set along the second direction in the photodiode array. For example, if the second direction is a longitudinal direction and the position of the photodiode in the second photodiode set in the photodiode array includes the second column and the sixth column in the photodiode array, there may be one second control signal, and the second control signal may be used to control reading of the output signals of the second row and the sixth row of photodiodes in the photodiode array along the longitudinal direction.
Of course, the photodiodes controlled by the second control signals may have other arrangement modes according to actual scenes.
In some embodiments, for each of the second control signals, the second control signal is controlled by a control line, the control line is used to control the on/off of a corresponding preset control switch, each preset control switch is used to control at least one row of photodiodes corresponding to the second control signal, and the control lines corresponding to different second control signals are different.
Illustratively, the preset control switch may be a triode. The triode can work in a cut-off region and a saturation region to respectively realize the cut-off and the conduction of a circuit. For any triode, a second control signal can be generated through a corresponding control line to control the voltage of the base electrode of the triode to be changed from low voltage to high voltage, so that the triode is switched from an off state to a closed state, and the specified row of photodiodes connected with the triode can be read.
Of course, the preset control switch may also be other types of switches, such as a radio frequency switch, etc.
In this embodiment, the number of the preset control switches controlled by each control line may be the number of rows of the photodiodes controlled by the corresponding second control signal. At this time, each control line is controlled, so that each second control signal can conveniently control the photodiode, and the control efficiency is high.
The following specific example describes an exemplary control manner of the photodiode in the embodiment of the present application.
An exemplary pixel distribution of a portion of the photodiode array of the camera is shown in fig. 3.
There may be a second control signal a that may control the 1 st, 3 rd, 4 th, 5 th, 7 th and 8 th vertical rows of photodiodes and a second control signal B that may control the 2 nd and 6 th vertical rows of photodiodes.
In some examples, control may be performed in one of the timing diagrams shown in fig. 4. At this time, the first control signal for the photodiode of the first horizontal row may control the photodiode of the first horizontal row to be exposed, and then, the base electrodes of the triodes respectively connected to the photodiodes of the second vertical row and the sixth vertical row may be at a high level by the second control signal to read the photodiodes of the second vertical row and the sixth vertical row for output. At this time, the output signal of the photodiode corresponding to the intersection of the first horizontal row, the second vertical row and the sixth vertical row is the effective output signal. The same applies to the photodiodes in the fifth row, and therefore, the output signals of the photodiodes corresponding to the intersections of the fifth row and the second and sixth vertical rows can be obtained as valid output signals.
It can be seen that, through the first control signal and the second control signal, output signals of 4 photodiodes can be obtained from the photodiode array shown in fig. 3, and the output signals of the 4 photodiodes can be converted into digital signals through an analog-to-digital converter and transmitted to a designated data processing module, so as to obtain pixel values of 4 pixels in the second image according to the 4 digital signals.
Another exemplary pixel distribution of a portion of the photodiode array of the camera is shown in fig. 5.
There may be a second control signal C that may control the 1 st and 5 th vertical rows of photodiodes, a second control signal D that may control the 2 nd and 6 th vertical rows of photodiodes, and a second control signal F that may control the 3 rd, 4 th, 7 th and 8 th vertical rows of photodiodes.
In some examples, control may be performed in one of the timing diagrams shown in fig. 6. At this time, the output signals of the two photodiodes in the first horizontal row may be obtained by the first control signal for the photodiodes in the first horizontal row and the second control signal C for the second and sixth vertical rows. Similarly, the output signals of the two photodiodes in each of the second, fifth, and sixth horizontal rows may be obtained separately.
After the output signals of the 8 photodiodes are obtained, the output signals may be converted into digital signals through an analog-to-digital converter, and the digital signals are transmitted to a designated data processing module, so as to obtain pixel values of 8 pixels in the second image according to the 8 digital signals.
Therefore, in the embodiment of the present application, the photodiodes controlled by the second control signals may be determined according to the requirements of the second images on the resolution and the pixel information, so as to adapt to the requirements of various application scenes to implement dynamic adjustment, without setting cameras with different resolutions for different scenes, thereby reducing the hardware cost.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by functions and internal logic of the process, and should not constitute any limitation to the implementation process of the embodiments of the present application.
Fig. 7 shows a block diagram of an image acquisition apparatus provided in an embodiment of the present application, where the image acquisition apparatus may be applied to a terminal device including a camera, and for convenience of description, only the relevant parts of the embodiment of the present application are shown.
Referring to fig. 7, the image acquisition apparatus 7 includes:
a first processing module 701, configured to obtain a first image according to a first photodiode set in the camera if a current image acquisition mode is a first mode, where the first photodiode set includes a first preset number of photodiodes;
a second processing module 702, configured to obtain a second image according to a second photodiode set in the camera if the current image acquisition mode is a second mode, where the second photodiode set includes a second preset number of photodiodes, and the second preset number is smaller than the first preset number.
Optionally, the image capturing device 7 further includes:
the first setting module is used for setting the current image acquisition mode to be a first mode if a preset instruction is acquired when the camera is in an operating state;
and the second setting module is used for setting the current image acquisition mode to be the second mode if the preset instruction is not acquired.
Optionally, the first mode is a shooting mode, the second mode is a context-aware mode, and the first preset number is the number of all photodiodes in the camera.
Optionally, the second processing module 702 specifically includes:
the acquisition unit is used for acquiring an output signal of each photodiode in the second photodiode set according to a target control signal in a preset sequence if the current image acquisition mode is a second mode;
and the processing unit is used for obtaining the second image according to the obtained output signal.
Optionally, for each photodiode of the camera, the photodiode is controlled based on a corresponding first control signal and a corresponding second control signal, where the first control signal is used to control the corresponding photodiode to generate an output signal, and the second control signal is used to control reading of the output signal of the corresponding photodiode;
the target control signal includes a first control signal for each photodiode in the second set of photodiodes and a second control signal for each photodiode in the second set of photodiodes.
Optionally, for each first control signal, the first control signal is used to control at least one row of photodiodes of the photodiode array of the camera along a first direction to generate an output signal;
for each second control signal, the second control signal is used for controlling the reading of the output signals of at least one row of photodiodes in a second direction of the photodiode array of the camera, the first direction and the second direction are mutually perpendicular, and the photodiodes respectively controlled by each second control signal are determined according to the position of each photodiode in the second photodiode array along the second direction.
Optionally, for each second control signal, the second control signal is controlled by a control line, the control line is used to control the opening and closing of a corresponding preset control switch, each preset control switch is used to control at least one row of photodiodes corresponding to the second control signal, and the control lines corresponding to different second control signals are different.
In the embodiment of the application, if the current image acquisition mode is a first mode, a first image is obtained according to a first photodiode set in the camera, wherein the first photodiode set comprises a first preset number of photodiodes; if the current image acquisition mode is the second mode, a second image is obtained according to a second photodiode set in the camera, wherein the second photodiode set comprises a second preset number of photodiodes, and the second preset number is smaller than the first preset number.
It should be noted that, for the information interaction, execution process, and other contents between the above-mentioned devices/units, the specific functions and technical effects thereof are based on the same concept as those of the embodiment of the method of the present application, and specific reference may be made to the part of the embodiment of the method, which is not described herein again.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned functions may be distributed as different functional units and modules according to needs, that is, the internal structure of the apparatus may be divided into different functional units or modules to implement all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only used for distinguishing one functional unit from another, and are not used for limiting the protection scope of the present application. For the specific working processes of the units and modules in the system, reference may be made to the corresponding processes in the foregoing method embodiments, which are not described herein again.
Fig. 8 is a schematic structural diagram of a terminal device according to an embodiment of the present application. As shown in fig. 8, the terminal device 8 of this embodiment includes: a camera 83, at least one processor 80 (only one is shown in fig. 8), a memory 81, and a computer program 82 stored in the memory 81 and executable on the at least one processor 80, wherein the processor 80 implements the steps of any of the above-described embodiments of the image acquisition method when executing the computer program 82.
The terminal device 8 may be a server, a mobile phone, a wearable device, an Augmented Reality (AR)/Virtual Reality (VR) device, a desktop computer, a notebook, a desktop computer, a palmtop computer, or other computing devices. The terminal device may include, but is not limited to, a processor 80, a memory 81. Those skilled in the art will appreciate that fig. 8 is merely an example of the terminal device 8, and does not constitute a limitation of the terminal device 8, and may include more or less components than those shown, or combine some of the components, or different components, such as may also include input devices, output devices, network access devices, etc. In the embodiment of the present application, the terminal device may further include other cameras besides the camera used for implementing the method embodiment of the present application. The input device may include a keyboard, a touch pad, a fingerprint sensor (for collecting fingerprint information of a user and direction information of a fingerprint), a microphone, a camera, and the like, and the output device may include a display, a speaker, and the like.
The Processor 80 may be a Central Processing Unit (CPU), and the Processor 80 may also be other general-purpose processors, digital Signal Processors (DSPs), application Specific Integrated Circuits (ASICs), field-Programmable Gate arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, and the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The storage 81 may be an internal storage unit of the terminal device 8, such as a hard disk or a memory of the terminal device 8. In other embodiments, the memory 81 may also be an external storage device of the terminal device 8, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are provided on the terminal device 8. Further, the memory 81 may include both an internal storage unit and an external storage device of the terminal device 8. The memory 81 is used for storing an operating system, an application program, a Boot Loader (Boot Loader), data, and other programs, such as program codes of the computer programs. The above-described memory 81 can also be used to temporarily store data that has been output or is to be output.
In addition, although not shown, the terminal device 8 may further include a network connection module, such as a bluetooth module Wi-Fi module, a cellular network module, and the like, which is not described herein again.
In this embodiment, when the processor 80 executes the computer program 82 to implement the steps in any of the image obtaining method embodiments, if a current image acquisition mode is a first mode, a first image is obtained according to a first photodiode set in the camera, where the first photodiode set includes a first preset number of photodiodes; if the current image acquisition mode is the second mode, a second image is obtained according to a second photodiode set in the camera, wherein the second photodiode set comprises a second preset number of photodiodes, and the second preset number is smaller than the first preset number.
The embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the computer program implements the steps in the above method embodiments.
The embodiments of the present application provide a computer program product, which when running on a terminal device, enables the terminal device to implement the steps in the above method embodiments when executed.
The integrated unit may be stored in a computer-readable storage medium if it is implemented in the form of a software functional unit and sold or used as a separate product. Based on such understanding, all or part of the processes in the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium and can implement the steps of the embodiments of the methods described above when the computer program is executed by a processor. The computer program includes computer program code, and the computer program code may be in a source code form, an object code form, an executable file or some intermediate form. The computer-readable medium may include at least: any entity or device capable of carrying computer program code to a photographing apparatus/terminal apparatus, a recording medium, computer Memory, read-Only Memory (ROM), random Access Memory (RAM), an electrical carrier signal, a telecommunications signal, and a software distribution medium. Such as a usb-disk, a removable hard disk, a magnetic or optical disk, etc. In certain jurisdictions, computer-readable media may not be an electrical carrier signal or a telecommunications signal in accordance with legislative and patent practice.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus/network device and method may be implemented in other ways. For example, the above-described apparatus/network device embodiments are merely illustrative, and for example, the division of the above modules or units is only one logical function division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
The above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present application and are intended to be included within the scope of the present application.
Claims (9)
1. An image acquisition method is applied to a terminal device comprising a camera, and comprises the following steps:
if the current image acquisition mode is a first mode, acquiring a first image according to a first photodiode set in the camera, wherein the first photodiode set comprises a first preset number of photodiodes, and different image acquisition modes correspond to different functions realized by the camera;
if the current image acquisition mode is a second mode, acquiring a second image according to a second photodiode set in the camera, wherein the second photodiode set comprises a second preset number of photodiodes, and the second preset number is smaller than the first preset number;
the first mode is a shooting mode, and the second mode is a context-aware mode;
if the current image acquisition mode is a second mode, acquiring a second image according to a second photodiode set in the camera, including:
if the current image acquisition mode is a second mode, acquiring an output signal of each photodiode in the second photodiode set in a preset sequence according to a target control signal; the target control signal comprises an output signal for controlling exposure of each photodiode in the second set of photodiodes to produce an output signal for each photodiode in the second set of photodiodes, and an output signal for reading each photodiode in the second set of photodiodes;
and obtaining the second image according to the acquired output signal.
2. The image acquisition method as set forth in claim 1, further comprising:
when the camera is in a running state, if a preset instruction is acquired, setting the current image acquisition mode to be a first mode;
and if the preset instruction is not acquired, setting the current image acquisition mode to be a second mode.
3. The image acquisition method as in claim 1, wherein the first preset number is the number of all photodiodes in the camera head.
4. The image acquisition method according to any one of claims 1 to 3, wherein, for each photodiode of the camera, the photodiode is controlled based on a corresponding first control signal for controlling the corresponding photodiode to generate an output signal and a corresponding second control signal for controlling reading of the output signal of the corresponding photodiode;
the target control signal includes a first control signal for each photodiode in the second set of photodiodes and a second control signal for each photodiode in the second set of photodiodes.
5. The image acquisition method of claim 4, wherein for each first control signal, the first control signal is used to control at least one row of photodiodes of the photodiode array of the camera along a first direction to generate output signals;
for each second control signal, the second control signal is used for controlling the reading of the output signals of at least one row of photodiodes in a second direction of the photodiode array of the camera, the first direction and the second direction are mutually perpendicular, and the photodiodes respectively controlled by each second control signal are determined according to the position of each photodiode in the second photodiode array along the second direction.
6. The image capturing method as claimed in claim 5, wherein for each of the second control signals, the second control signal is controlled by a control line, the control line is used for controlling the on/off of a corresponding preset control switch, each preset control switch is used for controlling at least one row of photodiodes corresponding to the second control signal, and the control lines corresponding to different second control signals are different.
7. An image acquisition apparatus, applied to a terminal device including a camera, the image acquisition apparatus comprising:
the first processing module is used for obtaining a first image according to a first photodiode set in the camera if the current image acquisition mode is a first mode, wherein the first photodiode set comprises a first preset number of photodiodes, and different image acquisition modes correspond to different functions realized by the camera;
a second processing module, configured to obtain a second image according to a second photodiode set in the camera if the current image acquisition mode is a second mode, where the second photodiode set includes a second preset number of photodiodes, and the second preset number is smaller than the first preset number;
the first mode is a shooting mode, and the second mode is a context-aware mode;
if the current image acquisition mode is a second mode, acquiring a second image according to a second photodiode set in the camera, including:
if the current image acquisition mode is a second mode, acquiring an output signal of each photodiode in the second photodiode set in a preset sequence according to a target control signal; the target control signal comprises an output signal for controlling exposure of each photodiode in the second set of photodiodes to produce each photodiode in the second set of photodiodes, and an output signal for reading each photodiode in the second set of photodiodes;
and obtaining the second image according to the acquired output signal.
8. A terminal device comprising a camera, a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the image acquisition method according to any one of claims 1 to 6 when executing the computer program.
9. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the image acquisition method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011004747.6A CN111901539B (en) | 2020-09-22 | 2020-09-22 | Image acquisition method, image acquisition device and terminal equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011004747.6A CN111901539B (en) | 2020-09-22 | 2020-09-22 | Image acquisition method, image acquisition device and terminal equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111901539A CN111901539A (en) | 2020-11-06 |
| CN111901539B true CN111901539B (en) | 2023-04-18 |
Family
ID=73224045
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011004747.6A Active CN111901539B (en) | 2020-09-22 | 2020-09-22 | Image acquisition method, image acquisition device and terminal equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111901539B (en) |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3376754A1 (en) * | 2017-03-17 | 2018-09-19 | CelePixel Technology Co. Ltd | Pixel acquisition circuit, optical flow sensor, and image acquisition system |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4568239B2 (en) * | 2006-03-03 | 2010-10-27 | 東芝マイクロエレクトロニクス株式会社 | Photoelectric conversion element array and solid-state imaging device |
| CN102724376A (en) * | 2012-06-26 | 2012-10-10 | 威海华菱光电股份有限公司 | Contact-type multi-resolution image sensor and control method thereof |
| CN105847680B (en) * | 2016-03-28 | 2017-09-15 | 维沃移动通信有限公司 | A kind of camera power consumption control method and mobile terminal |
| CN108156376A (en) * | 2017-12-27 | 2018-06-12 | 广东欧珀移动通信有限公司 | Image-pickup method, device, terminal and storage medium |
| CN110677621B (en) * | 2019-09-03 | 2021-04-13 | RealMe重庆移动通信有限公司 | Camera calling method and device, storage medium and electronic equipment |
-
2020
- 2020-09-22 CN CN202011004747.6A patent/CN111901539B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3376754A1 (en) * | 2017-03-17 | 2018-09-19 | CelePixel Technology Co. Ltd | Pixel acquisition circuit, optical flow sensor, and image acquisition system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111901539A (en) | 2020-11-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11138700B2 (en) | Method for image processing, non-transitory computer readable medium, and electronic device | |
| KR102156597B1 (en) | Optical imaging method and apparatus | |
| US11659298B2 (en) | Seamless readout mode transitions in image sensors | |
| US10095941B2 (en) | Vision recognition apparatus and method | |
| CN110784660B (en) | Method, system, equipment and medium for controlling camera brightness | |
| US9247109B2 (en) | Performing spatial and temporal image contrast detection in pixel array | |
| US11184523B2 (en) | Imaging apparatus with phase difference detecting element | |
| US10951816B2 (en) | Method and apparatus for processing image, electronic device and storage medium | |
| CN113674685B (en) | Pixel array control method and device, electronic equipment and readable storage medium | |
| CN112929563B (en) | Focusing method and device and electronic equipment | |
| CN111901539B (en) | Image acquisition method, image acquisition device and terminal equipment | |
| JP2023169254A (en) | Imaging element, operating method for the same, program, and imaging system | |
| CN112261296B (en) | Image enhancement method, image enhancement device and mobile terminal | |
| CN111131714A (en) | Image acquisition control method and device and electronic equipment | |
| CN114298889A (en) | Image processing circuit and image processing method | |
| CN113676674A (en) | Image processing method and device, electronic equipment and readable storage medium | |
| CN114630016B (en) | Image processing method, image processor and electronic equipment | |
| CN116385260B (en) | Image processing method, device, chip, electronic equipment and medium | |
| CN115767285A (en) | Image shading correction method, device, storage medium and electronic equipment | |
| CN115018736A (en) | Image brightness uniformity processing method and processing terminal | |
| CN113965688A (en) | Image sensor, camera module, camera device and control method | |
| CN115225789A (en) | Photosensitive module, image acquisition equipment, image acquisition method and intelligent terminal | |
| KR20210151613A (en) | Image Processing Device and Image Processing Method | |
| CN117082324A (en) | Photosensitive chip, image processing method and electronic equipment | |
| CN116934582A (en) | Demosaicing method, demosaicing device, storage medium and chip |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |