CN114095673A - Image output method and device and computer readable storage medium - Google Patents
Image output method and device and computer readable storage medium Download PDFInfo
- Publication number
- CN114095673A CN114095673A CN202111321399.XA CN202111321399A CN114095673A CN 114095673 A CN114095673 A CN 114095673A CN 202111321399 A CN202111321399 A CN 202111321399A CN 114095673 A CN114095673 A CN 114095673A
- Authority
- CN
- China
- Prior art keywords
- image
- output
- pixel array
- event
- sub
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 230000003068 static effect Effects 0.000 claims abstract description 36
- 238000004590 computer program Methods 0.000 claims description 11
- 238000001514 detection method Methods 0.000 claims description 5
- 238000004891 communication Methods 0.000 claims description 4
- 238000003491 array Methods 0.000 description 8
- 230000008859 change Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 108091008695 photoreceptors Proteins 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/71—Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Studio Devices (AREA)
Abstract
According to the image output method, the image output device and the computer-readable storage medium provided by the scheme of the application, the pixel array of the image sensor is controlled to detect the incident light intensity variation parameter and the pixel accumulated charge quantity of the pixel array; generating an event signal according to the incident light intensity variation parameter; outputting an event image according to the event signal; acquiring a region of interest from the pixel array according to the event image; a still image is output in accordance with the pixel accumulated charge amount of the region of interest. Through the implementation of the scheme, after the event image is output, the interested region is obtained from the pixel array according to the event image, and the static image is output according to the accumulated charge amount of the pixels on the interested region; on the other hand, the present invention outputs a small amount of image data compared to a conventional vision sensor, so that power consumption can be reduced.
Description
Technical Field
The present application relates to the field of electronic technologies, and in particular, to an image output method and apparatus, and a computer-readable storage medium.
Background
The image sensors currently in the mainstream include Complementary Metal Oxide Semiconductor (CMOS) image sensors and dynamic vision sensors. The CMOS image sensor has advantages of capturing real artwork, but the processed data amount is high and power consumption is large. Because the dynamic vision sensor detects only events of light intensity changes and outputs only the detected events, the dynamic vision sensor is well suited to handle scenes with low dynamic data. The disadvantage is that the noise of the dynamic vision sensor is relatively large compared to the former.
Since CMOS image sensors in mobile environments require minimal power consumption, it is desirable to have an image sensor that minimizes power consumption while still maintaining the performance of the CMOS image sensor because there is a trade-off between power consumption and performance.
Disclosure of Invention
Embodiments of the present application provide an image output method, an image output apparatus, and a computer-readable storage medium, which can at least solve the problems in the related art that the data size of an image output by using a CMOS image sensor is large, the power consumption is high, and the performance of an image output by using a dynamic vision sensor is low.
A first aspect of an embodiment of the present application provides an image output method, including:
controlling a pixel array of an image sensor to detect a parameter of incident light intensity variation and to detect an accumulated charge amount of pixels of the pixel array;
generating an event signal according to the incident light intensity variation parameter;
outputting an event image according to the event signal;
acquiring a region of interest from the pixel array according to the event image;
outputting a static image according to the pixel accumulated charge amount of the region of interest.
A second aspect of the embodiments of the present application provides an image output apparatus, including:
the detection module is used for controlling a pixel array of the image sensor to detect incident light intensity variation parameters and detecting pixel accumulated charge quantity of the pixel array;
the generating module is used for generating an event signal according to the incident light intensity variation parameter;
the first output module is used for outputting an event image according to the event signal;
the acquisition module is used for acquiring a region of interest from the pixel array according to the event image;
and the second output module is used for outputting a static image according to the pixel accumulated charge quantity of the region of interest.
A third aspect of embodiments of the present application provides an electronic apparatus, including: the system comprises a memory, a processor and a bus, wherein the bus is used for realizing the connection and communication between the memory and the processor; the processor is configured to execute a computer program stored on the memory, and the processor executes the computer program, where the processor performs each step in the image output method provided by the first aspect of the embodiment of the present application.
A fourth aspect of the embodiments of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the steps in the image output method provided by the first aspect of the embodiments of the present application.
As can be seen from the above, according to the image output method, the image output apparatus, and the computer-readable storage medium provided in the present application, the pixel array of the image sensor is controlled to detect the incident light intensity variation parameter and the pixel accumulated charge amount of the pixel array; generating an event signal according to the incident light intensity variation parameter; outputting an event image according to the event signal; acquiring a region of interest from the pixel array according to the event image; outputting a static image according to the pixel accumulated charge amount of the region of interest. Through the implementation of the scheme, after the event image is output, the interested region is obtained from the pixel array according to the event image, and the static image is output according to the accumulated charge amount of the pixels on the interested region; on the other hand, the present invention outputs a small amount of image data compared to a conventional vision sensor, so that power consumption can be reduced.
Drawings
Fig. 1 is a schematic basic flowchart of an image output method according to a first embodiment of the present application;
FIG. 2 is a schematic diagram of an image sensor and a control and processor provided in a first embodiment of the present application;
FIG. 3 is a schematic diagram of a pixel array and an output circuit according to a first embodiment of the present disclosure;
fig. 4 is a schematic flowchart of a refinement of an image output method according to a second embodiment of the present application;
fig. 5 is a schematic diagram of program modules of an image output apparatus according to a third embodiment of the present application;
fig. 6 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present application.
Detailed description of the preferred embodiments
In order to make the objects, features and advantages of the present invention more apparent and understandable, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In order to solve the problems of the related art that the data size is large, the power consumption is high when a CMOS image sensor is used for outputting an image, and the performance of outputting an image by using a dynamic vision sensor is low, the first embodiment of the present application provides an image output method. As shown in fig. 1, which is a basic flowchart of an image output method provided in this embodiment, the image output method includes the following steps:
Specifically, referring to fig. 2 and 3, the image sensor-based region of interest detection system includes an image sensor 201 and a control and processor 202, where the image sensor 201 includes a pixel array 301 composed of a plurality of pixels 302, and the entire pixel array may be divided into a plurality of sub-pixel arrays, and the sub-pixel arrays may be regularly divided or irregularly divided, preferably in a regular division manner, so as to facilitate control of image output, for example, the sub-pixel arrays 303, 304, 305 in fig. 3. In practical applications, the pixel array of the currently mainstream image sensor can only detect the variation intensity parameter of the incident light or the charge accumulated by the pixels of the pixel array alone, and it is difficult to meet different requirements of different application scenarios on the output image. In this embodiment, the pixel array 301 can detect both the incident light variation intensity parameter and the pixel accumulated charge amount, and flexibly configure each pixel on the pixel array according to different requirements of the application scenario.
In an optional implementation manner of this embodiment, the step of controlling the pixel array of the image sensor to detect the incident light intensity variation parameter and detect the accumulated charge amount of the pixels of the pixel array includes: dividing the pixel array into at least one sub-pixel array; the sub-pixel array is controlled to detect the incident light intensity variation parameter and/or detect the pixel accumulated charge quantity of the pixel array.
Specifically, in the present embodiment, the pixel array 301 is divided into different sub-pixel arrays, including but not limited to the sub-pixel array 303, the sub-pixel array 304, the sub-pixel array 305, and the like, and in different application scenarios, the sub-pixel arrays are flexibly configured, for example, when the sub-pixel array 303 is configured to detect the incident light intensity variation parameter, the sub-pixel array 304 or the sub-pixel array 305 may be configured to detect the accumulated charge amount of the pixels in the sub-pixel arrays, or the sub-pixel arrays may be configured to detect the accumulated charge amount of the pixels at the same time, and different requirements of different application scenarios are met by flexibly configuring the sub-pixel arrays. It should be understood that each pixel in the pixel array 301 is individually controlled, and the pixels of the sub-pixel array can be individually configured according to different requirements, i.e. each pixel can detect the incident light intensity variation parameter, and/or the amount of charge accumulated by the pixel.
In an optional implementation manner of this embodiment, the step of controlling the pixel array of the image sensor to detect the parameter of the variation of the incident light intensity includes: controlling the pixel array to detect the electric charge amount corresponding to the incident light; generating a photocurrent according to the amount of charge to output a logarithmic voltage; comparing the logarithmic voltage with a preset comparison voltage; and determining the incident light intensity variation parameter according to the comparison result.
Specifically, the image sensor 201 of the present embodiment further includes a photoelectric converter and a photoreceptor, and in the present embodiment, the photoelectric converter is controlled to generate light incident on the pixel array 301 with a corresponding charge amount, the photoreceptor is controlled to generate a photocurrent according to the charge amount and output a logarithmic voltage, the logarithmic voltage is amplified, the amplified logarithmic voltage is compared with a preset comparison voltage, and a change in intensity of the incident light can be determined according to the comparison result.
And 102, generating an event signal according to the incident light intensity variation parameter.
Specifically, in this embodiment, it should be noted that, assuming that the voltage of the pixel at the time t1 is V1, the voltage at the time t2 is V2, and the preset threshold V is a number smaller than 0, then V1-V2+ V is greater than 0, i.e. a valid event signal is generated, and conversely, an invalid event signal is generated; if V is a number greater than 0, then V1-V2+ V is less than 0, generating a valid event signal, and vice versa generating an invalid event signal. It should be understood that the voltage V1 at the time t1 represents the voltage stored in the pixel, the voltage V2 at the time t2 represents the voltage generated after the incident light intensity changes, the threshold value V represents the voltage value used for reference in the first output circuit, when V is less than 0, V1-V2+ V is greater than 0, which means that when V1-V2 subtracts the voltage threshold value V for reference and is still less than 0, the incident light intensity is decreasing, and thus the valid event signal is generated, and similarly, when V is greater than 0, V1-V2+ V is less than 0, which means that the incident light intensity is increasing, and also the valid event signal is generated.
And step 103, outputting an event image according to the event signal.
Specifically, in practical applications, the event image is usually a dynamic image, and in the present embodiment, the event image is output according to an event signal caused by a change in incident light intensity. It should be understood that both, a valid event signal and an invalid event signal, output an event image, with the difference that an invalid event signal typically outputs a blank event image.
And 104, acquiring a region of interest from the pixel array according to the event image.
Specifically, in this embodiment, according to the actual requirement information of the current application scene, the region of interest is determined in the pixel array according to the output event image, and it should be understood that the region of interest is selected according to the actual requirement, and may be selected from the pixel array on the event image or from the pixel array around the event image.
Specifically, in the present embodiment, after the region of interest is determined, whether the region of interest needs to output a still image is determined according to the actual application requirements, and after the region of interest is determined to need to output the still image, the still image is output according to the charge amount accumulated by the pixels in the region of interest.
In an alternative implementation manner of this embodiment, the step of outputting the event image according to the event signal and the step of outputting the still image according to the pixel accumulated charge amount of the region of interest include: a first sub-output circuit controlling the image output circuit, outputting an event image according to the event signal; and a second sub-output circuit controlling the image output circuit to output a still image according to the accumulated charge amount of the pixels in the region of interest.
Specifically, in practical applications, the currently mainstream image sensor only has one image output mode and only has one image output circuit, and even if there are multiple image output modes, it is necessary to switch to another output mode after one mode finishes outputting an image, which not only consumes a lot of power, but also wastes a lot of time. In the present embodiment, by preference of the image output circuit, one image output circuit is divided into the first sub-output circuit 306 and the second sub-output circuit 307 as shown in fig. 3, the first sub-output circuit 306 outputs an event image according to an event signal, and the second sub-output circuit 307 outputs a still image according to the pixel accumulated charge amount of the region of interest. It should be understood that the image output by the first sub-output circuit 306 is usually a dynamic image, the data size of the image is small, the power consumption is low, and the response speed of the pixel is fast; the image output by the second sub-output circuit 307 is usually a still image, and the data amount of the image is large and the power consumption is high.
Further, in an optional implementation manner of this embodiment, after the step of generating the event signal according to the incident light intensity variation parameter when the event signal is an invalid event signal, the method further includes: and controlling the first sub-output circuit to output the blank event image and closing the second sub-output circuit.
Specifically, in practical applications, the power consumption is large when the second sub-output circuit 307 is continuously turned on, the redundant data is large, and the memory needs to be cleaned every few days, in this embodiment, the channel of the first sub-output circuit 306 may be turned on all the time to determine whether there is a non-blank event image output, the entire pixel array 301 of the image sensor 201 is traversed, when the pixel array 301 generates an invalid event signal due to the change of the incident light intensity, a blank event image is output, and the second sub-output circuit 307 is turned off at the same time, so that the power consumption can be reduced, and the data can be reduced.
Furthermore, in an optional implementation manner of this embodiment, before the step of turning off the second sub-output circuit, the method further includes: judging whether the output condition of the static image is met or not according to the region of interest; when the static image output condition is met, the second sub-output circuit is switched on, and a static image is output according to the pixel accumulated charge amount of the region of interest; and when the static image output condition is not met, executing the step of closing the second sub-output circuit.
Specifically, in this embodiment, whether the selected region of interest has an actual requirement for outputting a static image is determined according to the actual requirement information of the current application scenario, for example, in an image sensor in the security field, regardless of which event image is output by the first sub-output circuit 306, the selected region of interest needs to output a static image, the second sub-output circuit 307 needs to keep on constantly, because the static image has more information than the event image, has higher resolution and is clearer in image, and meets the actual requirement in the security field, it should be understood that the channel of the first sub-output circuit 306 can be always turned on to determine whether there is a non-blank event image output, after the event image is output, a part of pixel array regions of the image sensor 201, such as the sub-pixel array 303, the sub-pixel array 304, the sub-pixel array 305, and the like, can also be selected to output the static image of the region of interest through the second sub-output circuit 307, therefore, redundant data volume can be reduced, power consumption is reduced, and when the static image output condition is not met, the second sub-output circuit 307 can be closed timely according to the situation, so that the power consumption of the image sensor 201 is reduced, and the storage volume of data is reduced.
It should be understood that, when the pixel array 301 detects a change in incident light intensity and generates an event signal according to the change in incident light intensity, the control and processor 202 controls the pixel array 301 of the image sensor 201 to output an event image according to the event signal generated by the first sub-output circuit 306, determines the region of interest as the pixel array 303 according to the event image, and the control and processor 202 controls the pixel array 303 of the image sensor 201 to output a static image according to the amount of charge accumulated by each pixel through the second sub-output circuit 307, it can be understood that the static image is equivalent to an image output in a conventional image sensor mode, the amount of information of the static image is greater than that of an image output by a motion vision sensor, and in this embodiment, the amount of information of the image means that the image is more detailed, the image is more complete, and the resolution is higher.
It should also be understood that, in the present embodiment, each pixel may output an event image from the first sub-output circuit 306 according to an event signal, and after the event image is output, a still image is output from the second sub-output circuit 307 according to the charge amount generated by each pixel in the region of interest, and compared with a conventional image sensor, it is not necessary to output an entire image each time, and only a corresponding image needs to be output to the region of interest, so that the power consumption of the image sensor 201 can be reduced, and subsequent calculation can be simplified.
Based on the scheme of the embodiment of the application, the pixel array of the image sensor is controlled to detect the incident light intensity variation parameter and the pixel accumulated charge amount of the pixel array; generating an event signal according to the incident light intensity variation parameter; outputting an event image according to the event signal; acquiring a region of interest from the pixel array according to the event image; a still image is output in accordance with the pixel accumulated charge amount of the region of interest. Through the implementation of the scheme, after the event image is output, the interested region is obtained from the pixel array according to the event image, and the static image is output according to the accumulated charge amount of the pixels on the interested region; on the other hand, the present invention outputs a small amount of image data compared to a conventional vision sensor, thereby reducing power consumption.
The method in fig. 4 is a refined image output method provided in the second embodiment of the present application, and the image output method includes:
And step 403, controlling the first sub-output circuit to output a blank event image and acquire the region of interest.
Specifically, in this embodiment, in different application scenarios, after the first sub-output circuit outputs the blank event image, the region of interest is acquired in the pixel array of the output event image according to actual needs.
And step 404, judging whether the output condition of the static image is met according to the region of interest.
Specifically, in this embodiment, whether the region of interest needs to output a still image is determined according to the actual needs of the application scene, and when it is determined that the region of interest needs to output a still image, the second sub-output circuit is turned on and the still image is output according to the accumulated charge amount of the pixels in the region of interest.
It should be understood that, the size of the serial number of each step in this embodiment does not mean the execution sequence of the step, and the execution sequence of each step should be determined by its function and inherent logic, and should not be limited uniquely to the implementation process of the embodiment of the present application.
The embodiment of the application discloses an image output method, which is used for controlling a pixel array of an image sensor to detect incident light intensity change parameters and detecting pixel accumulated charge quantity of the pixel array; when the incident light intensity variation parameter generates an invalid event signal, controlling the first sub-output circuit to output a blank event image and then acquiring an interested area; judging whether the output condition of the static image is met or not according to the region of interest; when the still image output condition is satisfied, the second sub-output circuit is turned on, and a still image is output according to the pixel accumulated charge amount of the region of interest. According to the application of the scheme, after the first sub-output circuit outputs the blank event image due to the generation of the invalid event signal, the interested area is obtained, when the interested area is determined to need to output the static image according to the actual requirement of the application scene, the second sub-output circuit is switched on, and the static image is output according to the accumulated charge quantity of the pixels of the interested area.
Fig. 5 is an image output device according to a third embodiment of the present application. The image output apparatus can be used to implement the image output method in the foregoing embodiments. As shown in fig. 5, the image output apparatus mainly includes:
a detecting module 501, configured to control a pixel array of the image sensor to detect a parameter of incident light intensity variation and detect an accumulated charge amount of pixels of the pixel array;
a generating module 502, configured to generate an event signal according to the incident light intensity variation parameter;
a first output module 503, configured to output an event image according to the event signal;
an acquisition module 504 for acquiring a region of interest from the pixel array based on the event image;
and a second output module 505 for outputting a still image according to the accumulated charge amount of the pixels of the region of interest.
In an optional implementation manner of this embodiment, the detection module is specifically configured to: dividing the pixel array into at least one sub-pixel array; the control sub-pixel array detects the incident light intensity variation parameter and/or detects the pixel accumulated charge quantity of the pixel array.
In an optional implementation manner of this embodiment, the first output module is specifically configured to: a first sub-output circuit controlling the image output circuit, outputting an event image according to the event signal; wherein the image output circuit comprises a plurality of independent sub-output circuits.
Further, in an optional implementation manner of this embodiment, the second output module is specifically configured to: and a second sub-output circuit controlling the image output circuit to output a still image according to the accumulated charge amount of the pixels in the region of interest.
Furthermore, in an optional implementation manner of this embodiment, the image output apparatus further includes: and closing the module. The first output module is further configured to: and controlling the first sub-output circuit to output a blank event image. The shutdown module is to: the second sub-output circuit is turned off.
Still further, in an optional implementation manner of this embodiment, the image output apparatus further includes: and a judging module. The judgment module is used for: and judging whether the output condition of the static image is met according to the region of interest. The second output module is further configured to: when the static image output condition is met, the second sub-output circuit is switched on, and a static image is output according to the pixel accumulated charge amount of the region of interest; and when the static image output condition is not met, executing the step of closing the second sub-output circuit.
In an optional implementation manner of this embodiment, the detection module is specifically configured to: controlling the pixel array to detect the electric charge amount corresponding to the incident light; generating a photocurrent according to the amount of charge to output a logarithmic voltage; comparing the logarithmic voltage with a preset comparison voltage; and determining the incident light intensity variation parameter according to the comparison result.
It should be noted that, the image output methods in the first and second embodiments can be implemented based on the image output device provided in this embodiment, and it can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process of the image output device described in this embodiment may refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.
According to the image output device provided by the scheme of the application, the pixel array of the image sensor is controlled to detect the incident light intensity variation parameter and the pixel accumulated charge quantity of the pixel array; generating an event signal according to the incident light intensity variation parameter; outputting an event image according to the event signal; acquiring a region of interest from the pixel array according to the event image; a still image is output in accordance with the pixel accumulated charge amount of the region of interest. Through the implementation of the scheme, after the event image is output, the interested region is obtained from the pixel array according to the event image, and the static image is output according to the accumulated charge amount of the pixels on the interested region; on the other hand, the present invention outputs a small amount of image data compared to a conventional vision sensor, so that power consumption can be reduced.
Fig. 6 is an electronic device according to a fourth embodiment of the present application. The electronic device can be used for realizing the image output method in the foregoing embodiment. As shown in fig. 6, the electronic device mainly includes:
The Memory 601 may be a high-speed Random Access Memory (RAM) Memory, or a non-volatile Memory (non-volatile Memory), such as a disk Memory. The memory 601 is used for storing executable program code, and the processor 602 is coupled with the memory 601.
Further, an embodiment of the present application also provides a computer-readable storage medium, where the computer-readable storage medium may be provided in an electronic device in the foregoing embodiments, and the computer-readable storage medium may be the memory in the foregoing embodiment shown in fig. 6.
The computer-readable storage medium has stored thereon a computer program which, when executed by a processor, implements the image output method in the foregoing embodiments. Further, the computer-readable storage medium may be various media that can store program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a RAM, a magnetic disk, or an optical disk.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of modules is merely a division of logical functions, and an actual implementation may have another division, for example, a plurality of modules or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or modules, and may be in an electrical, mechanical or other form.
Modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical modules, may be located in one place, or may be distributed on a plurality of network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.
The integrated module, if implemented in the form of a software functional module and sold or used as a separate product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed to by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a readable storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method of the embodiments of the present application. And the aforementioned readable storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.
It should be noted that, for the sake of simplicity, the above-mentioned method embodiments are described as a series of acts or combinations, but those skilled in the art should understand that the present application is not limited by the described order of acts, as some steps may be performed in other orders or simultaneously according to the present application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In view of the above description of the image output method, the image output apparatus, and the computer readable storage medium provided by the present application, those skilled in the art will recognize that there are variations from the foregoing description to the following description in terms of the embodiments and application scope of the present application, and therefore the content of the present specification should not be interpreted as limiting the scope of the present application.
Claims (10)
1. An image output method, comprising:
controlling a pixel array of an image sensor to detect a parameter of incident light intensity variation and to detect an accumulated charge amount of pixels of the pixel array;
generating an event signal according to the incident light intensity variation parameter;
outputting an event image according to the event signal;
acquiring a region of interest from the pixel array according to the event image;
outputting a static image according to the pixel accumulated charge amount of the region of interest.
2. The image output method according to claim 1, wherein the step of controlling the pixel array of the image sensor to detect the incident light intensity variation parameter and to detect the amount of accumulated charges of the pixels of the pixel array includes:
dividing the pixel array into at least one sub-pixel array;
and controlling the sub-pixel array to detect the incident light intensity variation parameter and/or detecting the pixel accumulated charge quantity of the pixel array.
3. The image output method according to claim 1, wherein the step of outputting an event image according to the event signal includes:
a first sub-output circuit controlling the image output circuit, and outputting an event image according to the event signal; wherein the image output circuit comprises at least one sub-output circuit.
4. The image output method according to claim 3, wherein the step of outputting the still image according to the pixel accumulated charge amount of the region of interest includes:
and a second sub-output circuit controlling the image output circuit to output a still image according to the pixel accumulated charge amount of the region of interest.
5. The image output method according to claim 4, wherein the step of outputting an event image according to the event signal is executed when the event signal is a valid event signal;
when the event signal is an invalid event signal, after the step of generating the event signal according to the incident light intensity variation parameter, the method further includes:
and controlling the first sub-output circuit to output a blank event image, and closing the second sub-output circuit.
6. The image output method according to claim 5, wherein the step of turning off the second sub-output circuit is preceded by:
judging whether a static image output condition is met according to the region of interest;
when the static image output condition is met, the second sub-output circuit is switched on, and a static image is output according to the pixel accumulated charge amount of the region of interest;
and when the static image output condition is not satisfied, executing the step of closing the second sub-output circuit.
7. The image output method according to any one of claims 1 to 6, wherein the step of controlling the pixel array of the image sensor to detect the incident light intensity variation parameter includes:
controlling the pixel array to detect the charge amount corresponding to incident light;
generating a photocurrent according to the amount of charge to output a logarithmic voltage;
comparing the logarithmic voltage with a preset comparison voltage;
and determining the incident light intensity variation parameter according to the comparison result.
8. An image output apparatus, characterized by comprising:
the detection module is used for controlling a pixel array of the image sensor to detect incident light intensity variation parameters and detecting pixel accumulated charge quantity of the pixel array;
the generating module is used for generating an event signal according to the incident light intensity variation parameter;
the first output module is used for outputting an event image according to the event signal;
the acquisition module is used for acquiring a region of interest from the pixel array according to the event image;
and the second output module is used for outputting a static image according to the pixel accumulated charge quantity of the region of interest.
9. An electronic device, comprising: the system comprises a memory, a processor and a bus, and is characterized in that the bus is used for realizing the connection and communication between the memory and the processor; the processor is configured to execute a computer program stored on the memory, and when the processor executes the computer program, the processor implements the steps of the method of any one of claims 1 to 7.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111321399.XA CN114095673B (en) | 2021-11-09 | 2021-11-09 | Image output method, device and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111321399.XA CN114095673B (en) | 2021-11-09 | 2021-11-09 | Image output method, device and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114095673A true CN114095673A (en) | 2022-02-25 |
| CN114095673B CN114095673B (en) | 2024-06-28 |
Family
ID=80299859
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111321399.XA Active CN114095673B (en) | 2021-11-09 | 2021-11-09 | Image output method, device and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114095673B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024192783A1 (en) * | 2023-03-22 | 2024-09-26 | Hong Kong Applied Science And Technology Research Institute Co., Ltd | Dynamic vision sensing system with a static capturing mode |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10345447B1 (en) * | 2018-06-27 | 2019-07-09 | Luminar Technologies, Inc. | Dynamic vision sensor to direct lidar scanning |
| CN112153309A (en) * | 2019-06-26 | 2020-12-29 | 三星电子株式会社 | Vision sensor, image processing apparatus, and method of operating vision sensor |
| WO2021001760A1 (en) * | 2019-07-01 | 2021-01-07 | Sony Advanced Visual Sensing Ag | Dynamic region of interest (roi) for event-based vision sensors |
| US20210152757A1 (en) * | 2018-12-05 | 2021-05-20 | Sony Semiconductor Solutions Corporation | Solid-state imaging device, signal processing chip, and electronic apparatus |
-
2021
- 2021-11-09 CN CN202111321399.XA patent/CN114095673B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10345447B1 (en) * | 2018-06-27 | 2019-07-09 | Luminar Technologies, Inc. | Dynamic vision sensor to direct lidar scanning |
| US20210152757A1 (en) * | 2018-12-05 | 2021-05-20 | Sony Semiconductor Solutions Corporation | Solid-state imaging device, signal processing chip, and electronic apparatus |
| CN112153309A (en) * | 2019-06-26 | 2020-12-29 | 三星电子株式会社 | Vision sensor, image processing apparatus, and method of operating vision sensor |
| US20200410272A1 (en) * | 2019-06-26 | 2020-12-31 | Samsung Electronics Co., Ltd. | Vision sensor, image processing device including the vision sensor, and operating method of the vision sensor |
| WO2021001760A1 (en) * | 2019-07-01 | 2021-01-07 | Sony Advanced Visual Sensing Ag | Dynamic region of interest (roi) for event-based vision sensors |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024192783A1 (en) * | 2023-03-22 | 2024-09-26 | Hong Kong Applied Science And Technology Research Institute Co., Ltd | Dynamic vision sensing system with a static capturing mode |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114095673B (en) | 2024-06-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3563563B1 (en) | Data rate control for event-based vision sensor | |
| CN112153309B (en) | Visual sensor, image processing apparatus, and method of operating visual sensor | |
| EP3324611B1 (en) | Event-based sensor, user device including the same, and operation method of the same | |
| US10917594B2 (en) | Event-based sensor and event-based sensing method | |
| US10248222B2 (en) | Method for processing event signal and event-based sensor performing the same | |
| US10133334B2 (en) | Event-based sensor and operating method of processor | |
| US11336852B2 (en) | Pixel collection circuit and image sensor | |
| EP3570138A1 (en) | Power efficient image sensing apparatus, method of operating the same and eye/gaze tracking system | |
| CN111510650B (en) | Image sensor | |
| KR20160038693A (en) | Dynamic vision sensor including pixel clusters, operation method thereof and system having the same | |
| KR20200068654A (en) | System and method for event camera data processing | |
| CN114026844B (en) | Dynamic region of interest (ROI) of an event-based vision sensor | |
| CN114095673A (en) | Image output method and device and computer readable storage medium | |
| CN114339089B (en) | Event image output method, device, equipment and readable storage medium | |
| CN115967864A (en) | Method, circuit, device and medium for collecting optical signal in image sensor | |
| EP3267678B1 (en) | Pixel acquisition circuit, image sensor and image acquisition system | |
| CN113628124B (en) | ISP and visual task joint optimization method, system, medium and electronic equipment | |
| CN114365479A (en) | Event-based delay equalization for visual sensors | |
| US12088925B1 (en) | Flicker detection using event-based readout circuits | |
| TW202032426A (en) | Motion detection method and circuit thereof | |
| CN220570631U (en) | Photoelectric sensor, pixel unit thereof, pulse camera and electronic equipment | |
| Habibi et al. | A Novel Segment-Based Data Transfer Scheme for Low-Power CMOS Surveillance Image Sensors | |
| US20230221419A1 (en) | Lidar adaptive single-pass histogramming for low power lidar system | |
| CN118695091A (en) | Dual-mode control method and related device of event sensor | |
| CN116939390A (en) | Image sensor, image signal processing method, apparatus, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |