CN112165560B - Image signal processing method, system, computer equipment and storage medium - Google Patents
Image signal processing method, system, computer equipment and storage medium Download PDFInfo
- Publication number
- CN112165560B CN112165560B CN202010941074.0A CN202010941074A CN112165560B CN 112165560 B CN112165560 B CN 112165560B CN 202010941074 A CN202010941074 A CN 202010941074A CN 112165560 B CN112165560 B CN 112165560B
- Authority
- CN
- China
- Prior art keywords
- image sensor
- isp
- acquisition module
- view image
- acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
- H04N5/12—Devices in which the synchronising signals are only operative if a phase difference occurs between synchronising and synchronised scanning devices, e.g. flywheel synchronising
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
Abstract
The present application relates to an image signal processing method, system, computer device and storage medium, the method comprising the steps of: synchronizing transmission signals of the multi-view image sensors, and setting a preset phase difference between the multi-view image sensors; according to the preset relative difference, setting a time-sharing multiplexing mode for a single ISP acquisition module, and switching and acquiring image signals for the multi-view image sensor by utilizing the ISP acquisition module; and adjusting the frame rate conversion of the transmission signal according to the ambient brightness during signal acquisition. By the method, the multi-view image sensor is correspondingly acquired by utilizing the single ISP acquisition module, and the heat productivity is relatively low because the chip architecture is relatively simple. On the other hand, the synchronization method of the multi-view image sensor has wider applicability, and the common image sensor has the functions of soft state and restoring output data, so that the multi-view image sensor acquisition system can be realized without major modification.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to an image signal processing method, an image signal processing system, a computer device, and a storage medium.
Background
Currently, in the process of image signal acquisition and processing, a mainstream multi-view scheme uses a plurality of ISP acquisition modules to synchronously acquire multi-view image sensor data and process the multi-view image sensor data. However, synchronous acquisition of multiple ISP acquisition modules can result in relatively high architecture power consumption and relatively high manufacturing costs.
On the other hand, there are many schemes for transmitting the synchronization signal by using a hardware mode, that is, one path of image sensor is set to work as a master mode, the other image sensors work as slave modes, and then the master control chip controls and outputs the synchronization signal to the master sensor, and the master sensor outputs the synchronization signal to be cascaded to the slave sensor. This necessitates the selection of sensor devices with synchronous control and the control terminal must take up an extra pin for synchronous control, which is a design that requires high process requirements for the device and also low power consumption.
Disclosure of Invention
Based on this, it is necessary to provide an image signal processing method, system, computer device, and storage medium in view of the above-described technical problems.
In a first aspect, an embodiment of the present invention provides an image signal processing method, including the steps of:
synchronizing transmission signals of the multi-view image sensors, and setting a preset phase difference between the multi-view image sensors;
according to the preset relative difference, setting a time-sharing multiplexing mode for a single ISP acquisition module, and switching and acquiring image signals for the multi-view image sensor by utilizing the ISP acquisition module;
and adjusting the frame rate conversion of the transmission signal according to the ambient brightness during signal acquisition.
Further, the transmission signals of the synchronous multi-eye image sensors are used for setting a preset phase difference between the multi-eye image sensors; comprising the following steps:
suspending the operation of the ISP acquisition module, closing an automatic exposure mechanism of the multi-eye image sensor, saving the current exposure time, and suspending the transmission signals of the multi-eye image sensor;
setting the minimum exposure time of the multi-view image sensor, and setting a preset phase difference according to the number of the multi-view image sensors and the time consumption of switching acquisition of the ISP acquisition module;
and recovering the transmission signal of the image sensor according to the preset phase difference, and recovering the current exposure time and the automatic exposure mechanism.
Further, setting a time-sharing multiplexing mode for a single ISP acquisition module according to the preset relative difference, and performing switching acquisition of image signals for the multi-view image sensor by using the ISP acquisition module; comprising the following steps:
downloading ISP parameters according to the ISP parameters corresponding to the multi-view image sensor;
according to the preset relative difference, the transmission signal is corresponding to the ISP parameter, and the switching of the single ISP acquisition module to the ISP is completed;
and acquiring the transmission signal of the currently designated image sensor by using the ISP acquisition module.
Further, the frame rate of the transmission signal is adjusted according to the ambient brightness during signal acquisition; comprising the following steps:
when the ambient brightness during signal acquisition is high, adjusting the transmission signals of the multi-view image sensor to be high-frame-rate phase output;
and when the ambient brightness during signal acquisition is low, adjusting the transmission signal of the multi-view image sensor to be a low frame rate phase output.
On the other hand, the embodiment of the invention also provides an image signal processing system, which comprises:
the synchronous execution module is used for synchronizing transmission signals of the multi-view image sensors and setting a preset phase difference between the multi-view image sensors;
the switching acquisition module is used for setting a time-sharing multiplexing mode for the single ISP acquisition module according to the preset relative difference, and switching acquisition of image signals is carried out for the multi-view image sensor by utilizing the ISP acquisition module;
and the frame rate adjusting module is used for adjusting the frame rate conversion of the transmission signal according to the ambient brightness during signal acquisition.
Further, the synchronization execution module includes a signal synchronization unit, where the signal synchronization unit is configured to:
suspending the operation of the ISP acquisition module, closing an automatic exposure mechanism of the multi-eye image sensor, saving the current exposure time, and suspending the transmission signals of the multi-eye image sensor;
setting the minimum exposure time of the multi-view image sensor, and setting a preset phase difference according to the number of the multi-view image sensors and the time consumption of switching acquisition of the ISP acquisition module;
and recovering the transmission signal of the image sensor according to the preset phase difference, and recovering the current exposure time and the automatic exposure mechanism.
Further, the switching acquisition module comprises a data processing unit, and the data processing unit is used for:
downloading ISP parameters according to the ISP parameters corresponding to the multi-view image sensor;
according to the preset relative difference, the transmission signal is corresponding to the ISP parameter, and the switching of the single ISP acquisition module to the ISP is completed;
and acquiring the transmission signal of the currently designated image sensor by using the ISP acquisition module.
Further, the frame rate adjustment module includes a luminance adaptive unit for:
when the ambient brightness during signal acquisition is high, adjusting the transmission signals of the multi-view image sensor to be high-frame-rate phase output;
and when the ambient brightness during signal acquisition is low, adjusting the transmission signal of the multi-view image sensor to be a low frame rate phase output.
The embodiment of the invention also provides computer equipment, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor realizes the following steps when executing the computer program:
synchronizing transmission signals of the multi-view image sensors, and setting a preset phase difference between the multi-view image sensors;
according to the preset relative difference, setting a time-sharing multiplexing mode for a single ISP acquisition module, and switching and acquiring image signals for the multi-view image sensor by utilizing the ISP acquisition module;
and adjusting the frame rate conversion of the transmission signal according to the ambient brightness during signal acquisition.
The embodiment of the invention also provides a computer readable storage medium, on which a computer program is stored, which when being executed by a processor, realizes the following steps:
synchronizing transmission signals of the multi-view image sensors, and setting a preset phase difference between the multi-view image sensors;
according to the preset relative difference, setting a time-sharing multiplexing mode for a single ISP acquisition module, and switching and acquiring image signals for the multi-view image sensor by utilizing the ISP acquisition module;
and adjusting the frame rate conversion of the transmission signal according to the ambient brightness during signal acquisition.
The image signal processing method, system, computer device and storage medium described above, the method comprising the steps of: synchronizing transmission signals of the multi-view image sensors, and setting a preset phase difference between the multi-view image sensors; according to the preset relative difference, setting a time-sharing multiplexing mode for a single ISP acquisition module, and switching and acquiring image signals for the multi-view image sensor by utilizing the ISP acquisition module; and adjusting the frame rate conversion of the transmission signal according to the ambient brightness during signal acquisition. By the method, the multi-view image sensor is correspondingly acquired by utilizing the single ISP acquisition module, and the heat productivity is relatively low because the chip architecture is relatively simple. In addition, the requirement of the multi-view system on the image frame rate is not high, and the time-sharing multiplexing of the ISP acquisition module can meet the requirement. On the other hand, the synchronization method of the multi-view image sensor has wider applicability, and the common image sensor has the functions of soft state and restoring output data, so that the multi-view image sensor acquisition system can be realized without major modification.
Drawings
Fig. 1 is a flowchart of an image signal processing method according to an embodiment of the present invention;
fig. 2 is a flowchart of an image signal synchronization method according to an embodiment of the present invention;
FIG. 3 is a flowchart of an image data processing method according to an embodiment of the present invention;
fig. 4 is a block diagram of an image signal processing system according to an embodiment of the present invention;
fig. 5 is an internal structure diagram of a computer device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.
In the process of image signal processing, an ISP (image signal processing) acquisition module is used for acquiring image signals, no image sensor control signal exists in the existing scheme, and the acquisition of multi-view image data can be realized in a software mode; such image sensors may also be software-based for image sensors that have no synchronous control or no master-slave mode. In addition, under the limited resource environment of pin, pin occupation can be saved by a software control mode, and pin is released for other purposes of the system.
At present, the multiple ISP acquisition modules correspondingly acquire the multiple image sensors, so that the system power consumption is higher, and the heat productivity of the chip is increased. When the ISP acquisition module correspondingly acquires the multi-mesh image sensor, the heat productivity is relatively low because the chip architecture is relatively simple. The requirement of the multi-view system on the image frame rate is not particularly high, and the ISP acquisition module can meet the requirement of time-sharing multiplexing. Because the synchronization method of the multi-view image sensor has wider applicability, the common image sensor has the functions of soft state and restoring output data. The existing chip scheme can realize a multi-view image sensor acquisition system without major modification. The software method for synchronizing the multi-view image sensors can meet market demands through simple and stable algorithm.
Accordingly, the present embodiment provides an image signal processing method including the steps of:
104, setting a time-sharing multiplexing mode for a single ISP acquisition module according to the preset relative difference, and performing switching acquisition of image signals for the multi-view image sensor by using the ISP acquisition module;
and 106, adjusting the frame rate conversion of the transmission signal according to the ambient brightness during signal acquisition.
The image sensor supported in the embodiment does not need to have a synchronous control function, and does not need to occupy extra pins. The sensor control bus (generally I2C bus) is a resource that must be used by the system, and the purpose of synchronous control can be achieved by sharing this resource.
In particular, since a single ISP acquisition module is applied to acquire a multi-view image sensor, the ISP acquisition module needs to be set to operate in a time-division multiplexing manner. The system is to ensure that all frame images output by all image sensors can be acquired, and the situation that the frame loss cannot be acquired is avoided. To achieve the goal of no frame loss, it is necessary to reasonably design the interrelationship of multiple timing sequences so as to have proper phase difference therebetween. The minimum time of the phase difference is the switching time of the ISP acquisition module switching module. The phase difference is required to be equal to or more than the switching time of the ISP acquisition module, so that the data of the next image sensor cannot be acquired. By the method, the multi-view image sensor is correspondingly acquired by utilizing the single ISP acquisition module, and the heat productivity is relatively low because the chip architecture is relatively simple. In addition, the requirement of the multi-view system on the image frame rate is not high, and the time-sharing multiplexing of the ISP acquisition module can meet the requirement. On the other hand, the synchronization method of the multi-view image sensor has wider applicability, and the common image sensor has the functions of soft state and restoring output data, so that the multi-view image sensor acquisition system can be realized without major modification.
In one embodiment, as shown in fig. 2, in the image signal processing process, a specific method for synchronizing an image signal includes:
and step 206, recovering the transmission signal of the image sensor according to the preset phase difference, and recovering the current exposure time and the automatic exposure mechanism.
Specifically, the image signal synchronization method can be divided into three main steps, namely, suspension signal acquisition, data setting and recovery signal acquisition, and is described in detail as follows:
the step of suspending signal acquisition comprises the following steps: and suspending the ISP acquisition module, wherein the image data is not stable in the multi-view synchronization process so as to control the operation of the suspended ISP acquisition module. The automatic exposure mechanism of the system is automatically adjusted in the brightness change process by suspending the multi-view automatic exposure mechanism, and the logic needs to be controlled under the determined exposure time condition, so that the automatic exposure mechanism of the system is closed. The current exposure time of multiple orders is saved, and in order to quickly restore to the proper exposure time in the future, the brightness of the image is ensured, so the exposure time of the field environment is reserved. The image sensor can be controlled to restart outputting data at a preset time point after pausing the outputting data of the image sensor according to the design characteristics of the image sensor. The specific operation of the image sensor is to send a control instruction of suspension to the image sensor (typically sending a control instruction over the I2C bus).
The data setting step includes: the multi-view is set to the minimum exposure time in order to ensure that the multi-view image sensor has the same exposure time, and to ensure that the time for controlling the restoration of the output data is as short as possible. And calculating a phase relation, and determining the phase relation according to the number of the multiple orders and the time consumption of switching and acquisition of the ISP acquisition module. When the number of the meshes is large, the phase difference is small; the time consuming of the ISP acquisition module to switch acquisitions is fixed. The phase difference must be greater than or equal to the time the ISP acquisition module switches acquisitions.
The step of suspending signal acquisition comprises the following steps: and gradually recovering the multi-order automatic output data according to the phase relation, obtaining the phase relation according to the calculation, and controlling the image sensor to automatically output data after delaying the time pointed by the phase. And recovering the current exposure time of the multiple orders, and recovering the current exposure time saved in the steps, so that the data output by the image sensor has proper brightness. The multi-view automatic exposure mechanism is restored, and the image sensor has been restored to the normal state so far, so that the automatic exposure mechanism of the system is restored. And recovering the ISP acquisition module to enable the ISP acquisition module to recover work, and acquiring the multi-view image data according to time division multiplexing.
In one embodiment, as shown in fig. 3, the process of performing switching acquisition on the image signal by the ISP acquisition module and then performing image data processing includes:
and step 306, acquiring the transmission signal of the currently designated image sensor by using the ISP acquisition module.
Specifically, the ISP parameters corresponding to the multiple image sensors are different, and the corresponding ISP parameters must be ensured to be downloaded before switching and acquisition, and the downloaded ISP parameters are enabled to be effective by controlling, i.e. the acquired data corresponds to the downloaded ISP parameters. And finally, enabling the acquisition of the currently specified image sensor data by controlling the acquisition module and corresponding to the current ISP parameters.
In one embodiment, the frame rate of the transmission signal is adjusted according to the ambient brightness at the time of signal acquisition; comprising the following steps:
Wherein the frame rate conversion is to support a better image experience for the client. Providing higher frame rate image data when ambient brightness is sufficient makes the image smoother. Reducing the frame rate when the ambient brightness is insufficient may set longer exposure times, making the image brightness more appropriate. Specifically, when the image sensor is in a phase relationship at a low frame rate, the time for outputting data by the image sensor is small and the time for outputting data is large. Other image sensors output data during the course of no data output. The ISP acquisition module can acquire the data output by all the image sensors in the mode. Because the period of the output data of the image sensor is larger in the mode, the exposure time of the image is larger, and the image sensor is suitable for being used in occasions with lower environment brightness. When the image sensors are in a phase relation of high frame rate, all the image sensors output data simultaneously, and a single ISP acquisition module is used for multiplexing the data acquired by each image sensor in a time-sharing mode. The period of the output data of the image sensor in the mode is short, so that the exposure time of the image is relatively short, and the image sensor is suitable for being used in occasions with higher environment brightness.
It should be understood that, although the steps in the above-described flowcharts are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in the flowcharts described above may include a plurality of sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, and the order of execution of the sub-steps or stages is not necessarily sequential, but may be performed alternately or alternately with at least a part of the sub-steps or stages of other steps or other steps.
In one embodiment, as shown in fig. 4, there is provided an image signal processing system including: a synchronization execution module 402, a handover acquisition module 404, a frame rate adjustment module 406, wherein:
a synchronization execution module 402, configured to synchronize transmission signals of the multiple image sensors, and set a predetermined phase difference between the multiple image sensors;
the switching acquisition module 404 is configured to set a time-division multiplexing mode for a single ISP acquisition module according to the predetermined relative difference, and perform switching acquisition of image signals for the multi-view image sensor by using the ISP acquisition module;
and the frame rate adjusting module 406 is configured to adjust the frame rate conversion of the transmission signal according to the ambient brightness during signal acquisition.
In one embodiment, as shown in fig. 4, the synchronization executing module 402 includes a signal synchronization unit 4022, where the signal synchronization unit 4022 is configured to: suspending the operation of the ISP acquisition module, closing an automatic exposure mechanism of the multi-eye image sensor, saving the current exposure time, and suspending the transmission signals of the multi-eye image sensor; setting the minimum exposure time of the multi-view image sensor, and setting a preset phase difference according to the number of the multi-view image sensors and the time consumption of switching acquisition of the ISP acquisition module; and recovering the transmission signal of the image sensor according to the preset phase difference, and recovering the current exposure time and the automatic exposure mechanism.
In one embodiment, as shown in fig. 4, the handover acquisition module 404 includes a data processing unit 4042, where the data processing unit 4042 is configured to: downloading ISP parameters according to the ISP parameters corresponding to the multi-view image sensor; according to the preset relative difference, the transmission signal is corresponding to the ISP parameter, and the switching of the single ISP acquisition module to the ISP is completed; and acquiring the transmission signal of the currently designated image sensor by using the ISP acquisition module.
In one embodiment, as shown in fig. 4, the frame rate adjustment module 406 includes a luminance adaptive unit 4062, where the luminance adaptive unit 4062 is configured to: when the ambient brightness during signal acquisition is high, adjusting the transmission signals of the multi-view image sensor to be high-frame-rate phase output; and when the ambient brightness during signal acquisition is low, adjusting the transmission signal of the multi-view image sensor to be a low frame rate phase output.
For specific limitations of the image signal processing system, reference may be made to the above limitations of the image signal processing method, and no further description is given here. The respective modules in the above-described image signal processing system may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.
FIG. 5 illustrates an internal block diagram of a computer device in one embodiment. As shown in fig. 5, the computer device includes a processor, a memory, a network interface, an input device, and a display screen connected by a system bus. The memory includes a nonvolatile storage medium and an internal memory. The non-volatile storage medium of the computer device stores an operating system, and may also store a computer program that, when executed by a processor, causes the processor to implement a rights abnormality detection method. The internal memory may also store a computer program that, when executed by the processor, causes the processor to perform the rights abnormality detection method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, the input device of the computer equipment can be a touch layer covered on the display screen, can also be keys, a track ball or a touch pad arranged on the shell of the computer equipment, and can also be an external keyboard, a touch pad or a mouse and the like.
It will be appreciated by those skilled in the art that the structure shown in fig. 5 is merely a block diagram of some of the structures associated with the present application and is not limiting of the computer device to which the present application may be applied, and that a particular computer device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor implementing the steps of when executing the computer program: synchronizing transmission signals of the multi-view image sensors, and setting a preset phase difference between the multi-view image sensors; according to the preset relative difference, setting a time-sharing multiplexing mode for a single ISP acquisition module, and switching and acquiring image signals for the multi-view image sensor by utilizing the ISP acquisition module; and adjusting the frame rate conversion of the transmission signal according to the ambient brightness during signal acquisition.
In one embodiment, the processor when executing the computer program further performs the steps of: suspending the operation of the ISP acquisition module, closing an automatic exposure mechanism of the multi-eye image sensor, saving the current exposure time, and suspending the transmission signals of the multi-eye image sensor; setting the minimum exposure time of the multi-view image sensor, and setting a preset phase difference according to the number of the multi-view image sensors and the time consumption of switching acquisition of the ISP acquisition module; and recovering the transmission signal of the image sensor according to the preset phase difference, and recovering the current exposure time and the automatic exposure mechanism.
In one embodiment, the processor when executing the computer program further performs the steps of: downloading ISP parameters according to the ISP parameters corresponding to the multi-view image sensor; according to the preset relative difference, the transmission signal is corresponding to the ISP parameter, and the switching of the single ISP acquisition module to the ISP is completed; and acquiring the transmission signal of the currently designated image sensor by using the ISP acquisition module.
In one embodiment, the processor when executing the computer program further performs the steps of: when the ambient brightness during signal acquisition is high, adjusting the transmission signals of the multi-view image sensor to be high-frame-rate phase output; and when the ambient brightness during signal acquisition is low, adjusting the transmission signal of the multi-view image sensor to be a low frame rate phase output.
In one embodiment, a computer readable storage medium is provided having a computer program stored thereon, which when executed by a processor, performs the steps of: synchronizing transmission signals of the multi-view image sensors, and setting a preset phase difference between the multi-view image sensors; according to the preset relative difference, setting a time-sharing multiplexing mode for a single ISP acquisition module, and switching and acquiring image signals for the multi-view image sensor by utilizing the ISP acquisition module; and adjusting the frame rate conversion of the transmission signal according to the ambient brightness during signal acquisition.
In one embodiment, the processor when executing the computer program further performs the steps of: suspending the operation of the ISP acquisition module, closing an automatic exposure mechanism of the multi-eye image sensor, saving the current exposure time, and suspending the transmission signals of the multi-eye image sensor; setting the minimum exposure time of the multi-view image sensor, and setting a preset phase difference according to the number of the multi-view image sensors and the time consumption of switching acquisition of the ISP acquisition module; and recovering the transmission signal of the image sensor according to the preset phase difference, and recovering the current exposure time and the automatic exposure mechanism.
In one embodiment, the processor when executing the computer program further performs the steps of: downloading ISP parameters according to the ISP parameters corresponding to the multi-view image sensor; according to the preset relative difference, the transmission signal is corresponding to the ISP parameter, and the switching of the single ISP acquisition module to the ISP is completed; and acquiring the transmission signal of the currently designated image sensor by using the ISP acquisition module.
In one embodiment, the processor when executing the computer program further performs the steps of: when the ambient brightness during signal acquisition is high, adjusting the transmission signals of the multi-view image sensor to be high-frame-rate phase output; and when the ambient brightness during signal acquisition is low, adjusting the transmission signal of the multi-view image sensor to be a low frame rate phase output.
Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above.
The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The above examples merely represent a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the invention. It should be noted that it would be apparent to those skilled in the art that various modifications and improvements could be made without departing from the spirit of the present application, which would be within the scope of the present application. Accordingly, the scope of protection of the present application is to be determined by the claims appended hereto.
Claims (6)
1. An image signal processing method, characterized by comprising the steps of:
synchronizing transmission signals of the multi-view image sensors by sharing a sensor control bus, and setting a preset phase difference between the multi-view image sensors, wherein the control bus is an I2C bus; comprising the following steps: suspending the operation of the ISP acquisition module, closing an automatic exposure mechanism of the multi-eye image sensor, saving the current exposure time, and suspending the transmission signals of the multi-eye image sensor; setting the minimum exposure time of the multi-view image sensor, and setting a preset phase difference according to the number of the multi-view image sensors and the time consumption of switching acquisition of the ISP acquisition module; restoring a transmission signal of the image sensor according to the preset phase difference, and restoring a plurality of current exposure time and an automatic exposure mechanism, wherein the current exposure time of the image sensor is restored to the current exposure time saved last time; wherein the predetermined phase difference is greater than or equal to the switching time of the ISP acquisition module; transmitting a control command to the multi-eye image sensor through the sensor control bus to suspend transmission signals of the multi-eye image sensor;
according to the preset phase difference, setting a time-sharing multiplexing mode for a single ISP acquisition module, and switching and acquiring image signals for the multi-view image sensor by utilizing the ISP acquisition module; wherein, the ISP parameters corresponding to the multi-mesh sensors are different, and before the switching acquisition, the multi-mesh sensors are made to correspond to the ISP parameters;
adjusting the frame rate conversion of the transmission signal according to the ambient brightness during signal acquisition; comprising the following steps: when the ambient brightness during signal acquisition is high, adjusting the transmission signals of the multi-view image sensor to be high-frame-rate phase output; and when the ambient brightness during signal acquisition is low, adjusting the transmission signal of the multi-view image sensor to be a low frame rate phase output.
2. The image signal processing method according to claim 1, wherein the setting of a time-division multiplexing mode is performed on a single ISP acquisition module according to the predetermined phase difference, and the switching acquisition of image signals is performed on the multi-view image sensor by using the ISP acquisition module; comprising the following steps:
downloading ISP parameters according to the ISP parameters corresponding to the multi-view image sensor;
according to the preset phase difference, the transmission signals are corresponding to the ISP parameters, and the switching of the single ISP acquisition module to the ISP is completed;
and acquiring the transmission signal of the currently designated image sensor by using the ISP acquisition module.
3. An image signal processing system, comprising:
the synchronous execution module is used for synchronizing transmission signals of the multi-image sensors through a shared sensor control bus, and setting a preset phase difference between the multi-image sensors, wherein the control bus is an I2C bus; the synchronization execution module comprises a signal synchronization unit, wherein the signal synchronization unit is used for: suspending the operation of the ISP acquisition module, closing an automatic exposure mechanism of the multi-eye image sensor, saving the current exposure time, and suspending the transmission signals of the multi-eye image sensor; setting the minimum exposure time of the multi-view image sensor, and setting a preset phase difference according to the number of the multi-view image sensors and the time consumption of switching acquisition of the ISP acquisition module; restoring a transmission signal of the image sensor according to the preset phase difference, and restoring a plurality of current exposure time and an automatic exposure mechanism, wherein the current exposure time of the image sensor is restored to the current exposure time saved last time; wherein the predetermined phase difference is greater than or equal to the switching time of the ISP acquisition module; transmitting a control command to the multi-eye image sensor through the control bus to suspend transmission signals of the multi-eye image sensor;
the switching acquisition module is used for setting a time-sharing multiplexing mode for the single ISP acquisition module according to the preset phase difference, and the ISP acquisition module is used for switching and acquiring image signals of the multi-view image sensor; wherein, the ISP parameters corresponding to the multi-mesh sensors are different, and before the switching acquisition, the multi-mesh sensors are made to correspond to the ISP parameters;
the frame rate adjusting module is used for adjusting the frame rate conversion of the transmission signals according to the ambient brightness during signal acquisition;
the frame rate adjustment module includes a luminance adaptation unit for: when the ambient brightness during signal acquisition is high, adjusting the transmission signals of the multi-view image sensor to be high-frame-rate phase output; and when the ambient brightness during signal acquisition is low, adjusting the transmission signal of the multi-view image sensor to be a low frame rate phase output.
4. An image signal processing system according to claim 3, wherein the switching acquisition module comprises a data processing unit for:
downloading ISP parameters according to the ISP parameters corresponding to the multi-view image sensor;
according to the preset phase difference, the transmission signals are corresponding to the ISP parameters, and the switching of the single ISP acquisition module to the ISP is completed;
and acquiring the transmission signal of the currently designated image sensor by using the ISP acquisition module.
5. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any one of claims 1 to 2 when the computer program is executed by the processor.
6. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010941074.0A CN112165560B (en) | 2020-09-09 | 2020-09-09 | Image signal processing method, system, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010941074.0A CN112165560B (en) | 2020-09-09 | 2020-09-09 | Image signal processing method, system, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112165560A CN112165560A (en) | 2021-01-01 |
| CN112165560B true CN112165560B (en) | 2023-07-04 |
Family
ID=73857689
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010941074.0A Active CN112165560B (en) | 2020-09-09 | 2020-09-09 | Image signal processing method, system, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112165560B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117729394B (en) * | 2024-02-18 | 2024-04-30 | 厦门瑞为信息技术有限公司 | Method for simultaneously processing multiple image sensors by single image processing module |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008203791A (en) * | 2007-02-22 | 2008-09-04 | Ricoh Co Ltd | Imaging apparatus and imaging method |
| CN101540843A (en) * | 2008-03-17 | 2009-09-23 | 索尼株式会社 | Imaging device, signal processing method, and computer program |
| CN105915780A (en) * | 2015-02-23 | 2016-08-31 | 三星电子株式会社 | Image signal processor and devices including the same |
| CN111064890A (en) * | 2019-12-25 | 2020-04-24 | 安凯(广州)微电子技术有限公司 | Multi-view circuit equipment and multi-view circuit control method |
| CN111182226A (en) * | 2019-07-16 | 2020-05-19 | 北京欧比邻科技有限公司 | Method, device, medium and electronic equipment for synchronous working of multiple cameras |
-
2020
- 2020-09-09 CN CN202010941074.0A patent/CN112165560B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008203791A (en) * | 2007-02-22 | 2008-09-04 | Ricoh Co Ltd | Imaging apparatus and imaging method |
| CN101540843A (en) * | 2008-03-17 | 2009-09-23 | 索尼株式会社 | Imaging device, signal processing method, and computer program |
| CN105915780A (en) * | 2015-02-23 | 2016-08-31 | 三星电子株式会社 | Image signal processor and devices including the same |
| CN111182226A (en) * | 2019-07-16 | 2020-05-19 | 北京欧比邻科技有限公司 | Method, device, medium and electronic equipment for synchronous working of multiple cameras |
| CN111064890A (en) * | 2019-12-25 | 2020-04-24 | 安凯(广州)微电子技术有限公司 | Multi-view circuit equipment and multi-view circuit control method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112165560A (en) | 2021-01-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20150220472A1 (en) | Increasing throughput on multi-wire and multi-lane interfaces | |
| JP2012164302A (en) | Global arming method for image processing pipeline | |
| CN111243532B (en) | Backlight control method and display device | |
| US20210152266A1 (en) | Communication apparatus, communication system, communication method, and computer readable medium | |
| CN112165560B (en) | Image signal processing method, system, computer equipment and storage medium | |
| CN104239120A (en) | State information synchronization method, state information synchronization device and state information synchronization system for virtual machine | |
| CN110996012A (en) | Continuous shooting processing method, image processor, shooting device and electronic equipment | |
| CN110569208A (en) | Control circuit, signal control device, signal control method and system | |
| US11200636B2 (en) | Method and apparatus for generating a series of frames with aid of synthesizer to offload graphics processing unit rendering in electronic device | |
| CN105553591A (en) | Node synchronization method for distributed computer system | |
| WO2019165780A1 (en) | Information processing method, dual-screen terminal, server and storage medium | |
| JP2019028651A (en) | Synchronous reset circuit and control method thereof | |
| CN105467870A (en) | Synchronous operation method and system thereof | |
| CN106097982A (en) | Method for controlling backlight thereof, device and liquid crystal indicator in liquid crystal indicator | |
| CN116193481A (en) | 5G core network processing method, device, equipment and medium | |
| US11757608B2 (en) | Communication apparatus, communication system, communication method, and computer readable medium | |
| KR102197116B1 (en) | Display device comprising power delivery network controller and display power management method using the same | |
| Dumitriu et al. | SoC self-integration mechanism for dynamic reconfigurable systems based on collaborative macro-function units | |
| CN115100996B (en) | Display configuration circuit, method, micro display panel and electronic device | |
| CN111757051A (en) | Data transmission method, intelligent terminal and radar system | |
| CN105094974B (en) | Burst signal processing method and system | |
| JP2009049649A (en) | Integrated circuit device | |
| US20220094829A1 (en) | Image frame processing from multiple image sensors | |
| US10693478B2 (en) | Clock generation system and method having time and frequency division activation mechanism | |
| JP7449062B2 (en) | Electronic equipment and its control method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 510555 No. 107 Bowen Road, Huangpu District, Guangzhou, Guangdong Applicant after: Guangzhou Ankai Microelectronics Co.,Ltd. Address before: Unit 301, 302, 303, 3 / F, C1 area, 182 science Avenue, Science City, Guangzhou hi tech Industrial Development Zone, Guangzhou, Guangdong 510000 Applicant before: ANYKA (GUANGZHOU) MICROELECTRONICS TECHNOLOGY Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |