WO2020097788A1 - Image signal processing device and method - Google Patents

Abstract

Disclosed is an image signal processing method, wherein the method comprises: obtaining first image signals respectively at multiple time points; obtaining a parameter set at the multiple time points, the parameter set comprising a first-type parameter corresponding to a first type of operation and a second-type parameter corresponding to a second type of operation, wherein the first type of operation is different from the second type of operation; performing, according to a parameter set obtained at time point T and the first image signal corresponding to time point T, the first type of operation, so as to generate a second image signal; and performing, according to the second image signal generated at time point T and the parameter set obtained at time point T+1, the second type of operation, so as to generate a third image signal.

Description

Image signal processing device and method Technical field

The invention relates to image signal processing, and in particular to an image signal processing device and method capable of reducing operation errors caused by external parameter reading delay.

Background technique

In general image signal processing, arithmetic processing is performed for each pixel, and the processing program is usually divided into several processing modules, and each processing module will have different processing delays. Therefore, the same pixel position in the image will be processed at different timings. The general processing delay may be different from the time difference of several image input lines. If these processing modules access the adjustment parameters stored externally for each pixel, the timing of obtaining these adjustment parameters must match the timing of the pixel's arithmetic processing.

The existing method is to store the adjustment parameters of different modules separately, so when reading external adjustment parameters, each processing module will only read the required parameters when it needs to use the corresponding parameters, which will cause additional Loss of read time.

Summary of the invention

One of the objects of the present invention is to provide an image signal processing device and method to solve the technical problem of additional reading time loss in reading image processing adjustment parameters in the prior art.

An embodiment of the present invention discloses an image signal processing method. The image signal processing method includes the following steps: acquiring the first image signal at multiple times; acquiring the parameter set at multiple times, which includes the first type parameter corresponding to the first type operation and the first type parameter corresponding to the second type operation Two types of parameters, wherein the first type of operation is different from the second type of operation; the first type of operation is performed according to the parameter set obtained at time T and the first image signal corresponding to the time T To generate a second image signal; and to perform the second type operation according to the second image signal generated at the corresponding time T and the parameter set acquired at the time T + 1 to generate a third image signal.

An embodiment of the present invention discloses an image signal processing device. The image signal processing device includes a storage unit that stores a first parameter group including a first parameter corresponding to a first type operation and a second parameter corresponding to a second type operation, wherein the first type operation is different from The second type of operation; the first processing unit receives the first parameter group and the first image signal, and performs the first type of operation according to the first parameter and the first image signal to generate a second An image signal; and a second processing unit that receives the second parameter and the second image signal of the first parameter group from the first processing unit, and based on the second parameter and the second image The signal performs the second type of operation to generate a third image signal.

The image signal processing method and device provided by the embodiments of the present invention can reduce the number of readings of the processing unit and the loss of reading time by combining the parameters required by different types of processing units into parameter groups and reading them out at a time.

BRIEF DESCRIPTION

FIG. 1 is a functional block diagram of an embodiment of an image signal processing device of the present invention.

FIG. 2 is a schematic functional block diagram of another embodiment of an image signal processing device of the present invention.

3A to 3D are schematic diagrams of the working process of an embodiment of an image signal processing device of the present invention.

4 is a schematic functional block diagram of another embodiment of an image signal processing device of the present invention.

5 is a flowchart of an embodiment of an image signal processing method of the present invention.

6 is a flowchart of another embodiment of an image signal processing method of the present invention.

Among them, the reference signs are described as follows:

100, 200, 300, 400 Image signal processing device

110 Storage unit for storage unit

111, 411, multiple parameter groups

112, 312, 412, 512, 612, 712 parameter groups

120 The first processing unit of the first processing unit

122 First parameter temporary storage unit The first parameter temporary storage unit

124 The first signal buffering unit is the first signal buffering unit

130 The second processing unit of the second processing unit

132 Second parameter temporary storage unit

134 The second signal buffer unit is the second signal buffer unit

140 The third processing unit is the third processing unit

142 Temporary storage unit for the third parameter of the third parameter temporary storage unit

144 The third signal buffering unit is the third signal buffer unit

150 The signal source of the signal source

210 The control unit of the control unit

500、600 Image signal processing method of image signal processing method

502, 504, 506, 508, 602, 604, 606, steps

608, 610

A1, A2, A3 The first parameter

B1, B2, the second parameter, the second parameter

C1 The third parameter is the third parameter

DA1 The first dummy parameter is the first dummy parameter

DB1, DB2, the second dummy parameter

DC1, DC2, DC3 The third dummy parameter

S1 The first image signal is the first image signal

S2 The second image signal is the second image signal

S3, the third image signal, the third image signal

S4 The fourth image signal is the fourth image signal

T1, the first time, the first time, the first time

T2 The second time is the second time

T3 The third time

T4 The fourth time

detailed description

In the description and previous claims, certain words are used to refer to specific components. Those skilled in the art should understand that manufacturers may use different terms to refer to the same component. This specification and the preceding claims do not use differences in names as a means of distinguishing components, but differences in functions of components as a basis for distinguishing. "Contains" mentioned in the entire specification and the preceding claims is an open-ended term, so it should be interpreted as "including but not limited to". In addition, the term "coupled" includes any direct and indirect means of electrical connection. Therefore, if it is described that a first device is coupled to a second device, it means that the first device may be directly electrically connected to the second device, or indirectly electrically connected to the first device through other devices or connection means二 装置。 Two devices.

The image signal processing device and method disclosed in the present invention can be read out by combining required parameters into a parameter group, so that when the image processing reads the parameter group, the number of readings by the processing unit can be reduced and the reading time can be reduced. Loss. Further explanation is as follows.

FIG. 1 is a functional block diagram of an embodiment of an image signal processing device 100 of the present invention. The image signal processing device 100 may include, but is not limited to, a storage unit 110, a first processing unit 120, and a second processing unit 130. In some embodiments, the image signal processing device 100 may further include a third processing unit 140. In some embodiments, the first processing unit 120 can perform a first type operation, the second processing unit 130 can perform a second type operation, and the third processing unit 140 can perform a third type operation. The first type operation, the second type operation, and the third type operation respectively perform different operation processing on the image data, and the first type operation, the second type operation, and the third type operation respectively include different image processing related algorithms. For example, the present invention is not limited to this. The first type of operation is used to perform image flatness calculation processing, the second type of operation is used to perform pixel defect operation processing, and the third type of operation is used to perform deformation operation processing. Specifically, the second processing unit 130 performs calculation based on the output second image signal S2 of the first processing unit 120, and the third processing unit 140 performs calculation based on the output third image signal S3 of the second processing unit 130 .

A plurality of parameter groups 111 (including parameter groups 112) may be stored in the storage unit 110. The storage unit 110 may be a non-volatile memory, and the storage unit 110 may also be a flash memory. The first, second, and third processing units 120, 130, and 140 may have (but not limited to) first, second, and third parameter temporary storage units 122, 132, and 142 and first, second, and third signals, respectively The buffer units 124, 134 and 144, the first, second and third parameter temporary storage units 122, 132 and 142 are used to temporarily store the parameter set read from the storage unit 110; the first signal buffer unit 124 is used to temporarily store The image signals read from the signal source (eg, image sensor) 150, and the second and third signal buffer units 134 and 144 are used to temporarily store the image signals output from the processing unit. When the first, second, and third processing units 120, 130, and 140 are performing the first, second, and third types of operations, the temporary storage units 122, 132, and 142 are based on the first, second, and third parameters, respectively And the temporarily stored data of the first, second, and third signal buffer units 124, 134, and 144 for operation. The first, second, and third processing units 120, 130, and 140 may include an operation unit and a control unit (not (Pictured in the figure).

For example, the first, second, and third parameter temporary storage units 122, 132, and 142 may be line buffers. The calculations performed by the first processing unit 120, the second processing unit 130, and the third processing unit 140 each time may include different signal amounts of image signals. For example, the first processing unit 120 performs calculations for each line of the image, The second processing unit 130 collects more than one line of data after the operation of the first processing unit 120 to perform the operation together. Therefore, the first processing unit 120, the second processing unit 130, and the third processing unit 140 may have different processing times, that is, because the first processing unit 120, the second processing unit 130, and the third processing unit 140 each The amount of signal to be processed may be different, so it may need to wait and cause timing delay. Each parameter group in the plurality of parameter groups 111 includes a first parameter AN, a second parameter BN, and a third parameter CN, where N is a positive integer, representing the order of output, for example, the first output parameter group 112 includes the first Parameter A1, second parameter B1 and third parameter C1. For example, when the storage unit 110 outputs the parameter group 112, the first parameter A1, the second parameter B1, and the third parameter C1 are output in a continuous sequence. The first, second, and third parameter temporary storage units 122, 132, and 142 may be used to temporarily store the first parameter A1, the second parameter B1, and the third parameter C1 of the parameter group 112, respectively. The first parameter A1, the second parameter B1, and the third parameter C1 are actual parameters, which are essentially the parameters required for the first, second, and third types of operations, respectively.

The first, second, and third signal buffer units 124, 134, and 144 may be line buffers, which are used to temporarily store image signals input to the first processing unit 120, the second processing unit 130, and the third processing unit 140, respectively. S1, S2, S3. Thereby, the first processing unit 120, the second processing unit 130, and the third processing unit 140 can obtain the first parameter A1, the second parameter B1, and the third parameter C1 from the parameter temporary storage units 122, 132, and 142, respectively. The image signals S1, S2, and S3 are subjected to arithmetic processing, respectively.

Hereinafter, the operation of the image signal processing device 100 will be described in detail.

As shown in FIG. 1, the first processing unit 120 may receive the parameter group 112 and receive the first image signal S1 from a signal source (eg, image sensor) 150. The first image signal S1 is, for example, image data (or original image data) that has not undergone adjustment processing. The first image signal S1 may be one row or several rows of pixel data in one frame, or may be pixel data of a certain block in one frame. In some embodiments, the parameter group 112 may include (but is not limited to) a first parameter A1 corresponding to a first type operation, a second parameter B1 corresponding to a second type operation, and a third parameter C1 corresponding to a third type operation. For example (but the invention is not limited thereto), the parameter group 112 may include a gain parameter, an offset parameter, a pixel defect parameter or a displacement parameter, etc. The parameter group 112 may be a combination of the first parameter A1, the second parameter B1, and the third parameter C1. For example, the first parameter A1 is arranged before the second parameter B1, and the second parameter B1 is arranged before the third parameter C1. The above are only examples, and the invention is not limited thereto.

Therefore, when the first image signal S1 is input to the first signal buffer unit 124 of the first processing unit 120, the parameter group 112 may also be input to the first processing unit 120 by the storage unit 110. The first processing unit 120 may perform the first type operation on the first image signal S1 according to the first parameter A1 of the parameter group 112 and output the second parameter B1 and the third parameter C1 of the parameter group 112 to the second processing unit 130. The second processing unit 130 may perform the second type operation on the second image signal S2 according to the second parameter B1, and output the third parameter C1 of the parameter group 112 to the third processing unit 140. The third processing unit 140 may perform the third type operation on the third image signal S3 according to the third parameter C1. Specifically, the first parameter A1 in the parameter group 112 may be temporarily stored in the first parameter temporary storage unit 122; the second parameter B1 in the parameter group 112 may be temporarily stored in the second parameter temporary storage unit 132; and the parameter group 112 The third parameter C1 can be temporarily stored in the third parameter temporary storage unit 142, and wait for the corresponding image signal to be in place, that is, when the first processing unit 120 performs the first type operation on the first image signal S1, it generates The second image signal S2 is output to the second processing unit 130, and then the second parameter B1 is used, which will be described in more detail later. In some embodiments, the time when the parameter group 112 is input to the first processing unit 120 may be earlier than the time when the first image signal S1 is input to the first processing unit 120.

When the second processing unit 130 receives the second parameter B1 and the third parameter C1 of the parameter group 112 output (transferred) by the first processing unit 120, the second processing unit 130 may not have started the second type of operation. Therefore, the second processing unit 130 may first temporarily store the second parameter B1 of the parameter group 112 in the second parameter temporary storage unit 132, and output the third parameter C1 of the parameter group 112 to the third processing unit 140, the third processing unit 140 temporarily stores the received third parameter C1 in the third parameter temporary storage unit 142. In other words, although the second processing unit 130 receives the second parameter B1 and the third parameter C1 at the same time, the second processing unit 130 recognizes the identification information included in the second parameter B1 and the third parameter C1 The second parameter B1 corresponding to the second type of operation is temporarily stored in the second parameter temporary storage unit 132, and the unused third parameter C1 is output to the third processing unit 140, so that the third processing unit 140 temporarily stores the Three parameter temporary storage unit 142.

The second image signal S2 will continue to be input to the second signal buffer unit 134 of the second processing unit 130. After the second processing unit 130 receives the default data amount, the second processing unit 130 will be ready to start the second type of operation. The second processing unit 130 may retrieve the second parameter B1 from the second parameter temporary storage unit 132, and perform the second type operation on the second image signal S2 according to the second parameter B1. After the second processing unit 130 performs the second type operation on the second image signal S2, the third image signal S3 is generated and output to the third processing unit 140.

When the third processing unit 140 receives the third parameter C1 of the parameter group 112 output by the second processing unit 130, the third processing unit 140 may not have started to perform the third type of operation. Therefore, the third processing unit 140 may temporarily store the third parameter C1 of the parameter group 112 in the third parameter temporary storage unit 142.

The third image signal S3 is continuously input to the third signal buffer unit 144 of the third processing unit 140. After the third processing unit 140 receives the default amount of data, the third processing unit 140 can retrieve it from the third parameter temporary storage unit 142 The third parameter C1 performs a third type operation on the third image signal S3 according to the third parameter C1. After the third processing unit 140 performs the third type operation on the third image signal S3, a fourth image signal S4 is generated and output. In this embodiment, the fourth image signal S4 can be used as the final output processed image signal. In some embodiments, the image signal processing apparatus 100 may also have more or less than three processing units, which is only an example here, and the present invention is not limited thereto.

In the existing image signal processing, the corresponding parameters are read separately when the corresponding parameters are required by each processing unit. In this embodiment, the parameters required by different types of processing units (such as the first processing unit 120, the second processing unit 130, and the third processing unit 140) are combined into the parameter group 112 and read out at a time. That is, the first parameter A1, the second parameter B1 and the third parameter C1 are combined into a parameter group 112 whose data is a continuous sequence. In some embodiments, in the storage unit 110, the first parameter A1 and the second parameter B1 and the third parameter C1 are stored in a continuous manner. Therefore, when the processing unit obtains the parameters, it can quickly obtain the parameters corresponding to the different types of processing units. Thereby, when the processing unit obtains the parameters, the number of readings can be reduced, and the loss of reading time can be reduced. In other words, the parameter group 112 can be transmitted by streaming, in addition, the second parameter B1 is stored in the second parameter temporary storage unit 132 of the second processing unit 130, and the third parameter C1 is stored in the third processing The third parameter temporary storage unit 142 of the unit 140, so that the time for obtaining the second parameter B1 and the third parameter C1 can be delayed until the second processing unit 130 and the third processing unit 140 start different types of image signals S2 and S3 The calculation time does not allow the second processing unit 130 and the third processing unit 140 to obtain the second parameter B1 and the third parameter C1 and start the calculation of the image signals S2 and S3, which causes a calculation error.

FIG. 2 is a functional block diagram of an embodiment of an image signal processing device 200 of the present invention. The difference between the image signal processing apparatus 200 and the image signal processing apparatus 100 is that the image signal processing apparatus 200 further includes a control unit 210, which is connected to the storage unit 110. The control unit 210 is used to receive and output the parameter group 112.

The control unit 210 can obtain the parameter group 112 from the storage unit 110 (as mentioned above, the first parameter A1, the second parameter B1 and the third parameter C1 can be combined into a continuous parameter group), and the control unit 210 can output the parameters The first parameter A1 in the group 112 to the first processing unit 120, the second parameter B1 in the output parameter group 112 to the second processing unit 130, and the third parameter C1 in the output parameter group 112 to the third processing unit 140. For example (but the invention is not limited thereto), in some embodiments, the control unit 210 may be controlled by hardware or software, and the control unit 210 may be, for example, a micro control unit (MCU).

As mentioned above, due to the different amount of data processed, the second type of operation may need to wait for multiple first type operations, and the third type of operation may need to wait for multiple second type operations, so the first type operation and the second type operation Between, and between the second type of operation and the third type of operation may need to wait and cause a timing delay. Therefore, in this embodiment, the control unit 210 can perform timing control on the output of the parameter group 112. In other words, the control unit 210 may output the first parameter A1, the second parameter B1 or the third parameter C1 to the first, second or third processing unit 120 only when the first, second or third type of operation starts , 130 or 140. Alternatively, the parameter group 112 may be used for control. For example, the parameter group 112 may include a plurality of dummy parameters to correspond to the preparation time before the first type operation, the first type operation, and the second type operation, respectively. Between the second and third types of operations, the control unit 210 reads the dummy parameters and outputs the first parameter A1, the second parameter B1, or the third parameter C1, which corresponds to the first 1. The time when the second or third type of operation starts.

In this way, the control unit 210 outputs the first parameter A1 of the parameter group 112 to the first processing unit 120 only when the first processing unit 120 starts the first type operation, and only when the second processing unit 130 starts the second type operation Only the control unit 210 outputs the second parameter B1 of the parameter group 112 to the second processing unit 130, and the control unit 210 outputs the third parameter C1 of the parameter group 112 to the second三 processing unit 140.

Specifically, the first, second, and third processing units 120, 130, and 140 may not perform calculation immediately after receiving the first, second, and third image signals S1, S2, and S3, respectively. Therefore, the timing of the control unit 210 outputting the parameter group 112 to each processing unit will be after each processing unit receives the image signal, at the same time as each processing unit starts to perform calculations. In other words, the control unit 210 allows each processing unit to receive the parameter group 112 at the same timing as when the calculation is started.

In this way, because the control unit 210 can process the timing delay between the first, second, and third processing units 120, 130, and 140, the first, second, and third parameter temporary storage units 122, 132, 142 For example, first-in first-out (FIFO) memory can be used to reduce the area and cost of the first processing unit 120, the second processing unit 130, and the third processing unit 140.

3A to 3D are schematic diagrams of the working process of another embodiment of an image signal processing device 300 of the present invention. The difference between the image signal processing device 300 and the image signal processing device 100 or 200 is that the first processing unit 120, the second processing unit 130, and the third processing unit 140 of the image signal processing device 300 are inserted by inserting dummy parameters at an appropriate time point There is no need to set the parameter temporary storage unit, and no control unit is required. Specifically, the parameter group of the image signal processing device 300 may include dummy parameters, that is, blank parameters.

The operation of the image signal processing device 300 will be described in detail below. FIG. 3A corresponds to the first time T1, FIG. 3B corresponds to the second time T2, FIG. 3C corresponds to the third time T3, and FIG. 3D corresponds to the fourth time T4. The second, third, and fourth times T1 to T4 occur in sequence.

As shown in FIG. 3A, at the first time T1, because the first image signal S1 has not arrived, or the default amount of data has not been collected from the first image signal S1, the first processing unit 120 cannot immediately start the operation, Of course, the second and third processing units 130 and 140 cannot start calculation. At this time, if real parameters are given to the first, second, and third processing units 120, 130, and 140, they must be temporarily stored. Since there is no control unit, the parameter set must be configured in advance in this embodiment and continuously supplied to the first, second, and third processing units 120, 130, and 140 without interruption. Therefore, in the initial stage, the parameter group 312 includes the first, second, and third dummy parameters DA1, DB1, and DC1 to fill the preparation time of the initial stage. In other words, the first dummy parameter DA1 is used to correspond to the preparation time before the first type of operation. In one embodiment, the first processing unit 120 obtains the first dummy parameter DA1 and can directly output the second dummy parameter DB1 and the third dummy parameter DC1 of the dummy parameter group 312 to the second processing unit 130. The second processing unit 130 may directly output the third dummy parameter DC1 to the third processing unit 140.

As shown in FIG. 3B, at the second time T2, the first image signal S1 arrives, or a default amount of data has been collected from the first image signal S1, and the first processing unit 120 simultaneously obtains the parameter group 412. The parameter group 412 includes a first parameter A1, a second dummy parameter DB2, and a third dummy parameter DC2. The first parameter A1 is an actual setting parameter, and is used to perform a first-type operation on the first image signal S1. In an embodiment, the first processing unit 120 directly outputs the second dummy parameter DB2 and the third dummy parameter DC2 to the second processing unit 130. After obtaining the second dummy parameter DB2, the second processing unit 130 outputs the third dummy parameter DC2 to the third processing unit 140.

Therefore, when the first processing unit 120 starts performing the first type operation on the first image signal S1, the first processing unit 120 also obtains the first parameter A1 corresponding to the first type operation at the same time. Thereby, the first processing unit 120 can perform the first type operation on the first image signal S1 according to the first parameter A1 and generate the second image signal S2.

On the other hand, before the second processing unit 130 starts to perform the second type operation, the second processing unit 130 will first read the second dummy parameter DB2. Before the third processing unit 140 performs the third type of operation, the third processing unit 140 will first read the third dummy parameter DC2. As above, this can avoid the timing mismatch between the start of the second type operation and the third type operation and the acquisition of the second parameter B1 and the third parameter C1.

As shown in FIG. 3C, at the third time T3, the second processing unit 130 has collected a default amount of data from the second image signal S2, and the second processing unit 130 simultaneously obtains the second parameter B1 of the parameter group 512. First, the first processing unit 120 first obtains the parameter group 512, which includes the first parameter A2, the second parameter B1, and the third dummy parameter DC3. The first parameter A2 and the second parameter B1 are actual parameters, which are used to perform first and second type operations on the first and second image signals S1 and S2, respectively. After obtaining the first parameter A2 of the parameter group 512, the first processing unit 120 outputs the second parameter B1 and the third dummy parameter DC3 to the second processing unit 130. After acquiring the second parameter B1, the second processing unit 130 outputs the third parameter DC3 to the third processing unit 140.

That is to say, the second dummy parameters DB1 and DB2 in FIGS. 3A to 3B are particularly used to correspond to the timing delay between performing the first type operation and the second type operation.

As in FIG. 3B, the first processing unit 120 may perform a first type operation on the new first image signal S1 according to the new first parameter A2 and generate a new second image signal S2.

In addition, after the second processing unit 130 receives the default data amount for the second image signal S2, when the second processing unit 130 starts to perform the second type operation on the second image signal S2, the second processing unit 130 also obtains the corresponding The second parameter B1 of the second type operation. Thereby, the second processing unit 130 can perform the second type operation on the second image signal S2 according to the second parameter B1 and generate the third image signal S3.

At this point in time, the third processing unit 140 has not yet started to perform the third type of operation, so the third processing unit 140 still continues to read the third dummy parameter DC3. As mentioned above, it can be avoided that the third parameter C1 is obtained earlier than the time point when the third type of operation is started. In other words, let the third processing unit 140 obtain the third parameter C1 at a time point until the third processing unit 140 starts to perform the third type operation on the third image signal S3, without allowing the third processing unit 140 to obtain the third There is a time difference between the parameter C1 and the start of the third type operation on the third image signal S3, which causes an operation error.

As shown in FIG. 3D, at the fourth time T4, the third processing unit 140 has collected a default amount of data from the third image signal S3, and the third processing unit 140 simultaneously obtains the third parameter C1 of the parameter group 612. First, the first processing unit 120 first obtains the parameter set 612. The parameter group 612 includes a first parameter A3, a second parameter B2, and a third parameter C1. The first parameter A2, the second parameter B1, and the third parameter C1 are actual parameters, and are used to perform first, second, and third type operations on the first, second, and third image signals S1, S2, and S3, respectively. After obtaining the first parameter A3 of the parameter group 612, the first processing unit 120 outputs the second parameter B2 and the third parameter C1 to the second processing unit 130. After obtaining the second parameter B2, the second processing unit 130 outputs the third parameter C1 to the third processing unit 140.

That is to say, the third dummy parameters DC1, DC2, and DC3 in FIGS. 3A to 3C are specifically used to correspond to the timing delay between performing the second type operation and the third type operation.

As in FIGS. 3B and 3C, the first processing unit 120 can perform a first type operation on the new first image signal S1 according to the new first parameter A3 and generate a new second image signal S2. The second processing unit 130 may perform a second type operation on the new second image signal S2 according to the new second parameter B2 and generate a new third image signal S3.

In addition, after the third processing unit 140 receives the default data amount, when the third processing unit 140 starts to perform the third type operation on the third image signal S3, the third processing unit 140 also obtains the third Three parameters C1. Thereby, the third processing unit 140 can perform the third type operation on the third image signal S3 according to the third parameter C1 and generate the processed fourth image signal S4 (not shown in the figure, it will be output at the next time point) .

In summary, taking the working process of FIGS. 3A-3D as an example, the operations of the image signal processing device 300 at each time point T1 to T4 will be sequentially described.

As described above, in this embodiment, when the parameter group 112 can be transmitted by streaming, by setting dummy parameters (such as the first dummy parameter, the second dummy parameter, and the third dummy parameter), The time of the first parameter A1, the second parameter B1, and the third parameter C1 is delayed until the first processing unit 120, the second processing unit 130, and the third processing unit 140 start different types of operations on the image signals S1, S2, S3 Time without letting the first processing unit 120, the second processing unit 130, and the third processing unit 140 obtain the first parameter A1, the second parameter B1, and the third parameter C1 and start calculating the image signals S1, S2, S3 There is a time difference between them, causing calculation errors. In addition, by setting the dummy parameters, the image signal processing device 300 may not have a control unit, and the parameter temporary storage unit may not be set in each processing unit, which further reduces the loss of reading time and reduces the cost.

FIG. 4 is a functional block diagram of an embodiment of an image signal processing device 400 of the present invention. The difference between the image signal processing device 400 and the image signal processing devices 100, 200, and 300 is that the storage unit 110 can store another type of multiple parameter groups (including the second parameter group 712). The difference between the second parameter group 712 and the aforementioned parameter group 112 or 612 is that the second parameter group 712 does not have parameters for certain types of operations.

For example, when the user selects that the second type of operation is not required, and the first image signal S1 is input to the first processing unit 120, the first processing unit 120 may instead obtain the second parameter set 712 from the storage unit 110. The second parameter group 712 only includes the first parameter A1 corresponding to the first type of operation and the third parameter C1 corresponding to the third type of operation. In other words, the parameter group 712 does not have the second parameter B1 corresponding to the second type of operation. Of course, the type of operation selected above is only an example, and the invention is not limited thereto.

Therefore, the first processing unit 120 can perform the first type operation on the first image signal S1 according to the first parameter A1 of the second parameter group 712. After the first processing unit 120 performs the first type operation on the first image signal S1, the generated second image signal S2 is directly output to the third processing unit 140. The third processing unit 140 may directly perform the third type operation on the second image signal S2 according to the third parameter C1 of the second parameter group 712, and generate the processed fourth image signal S4.

Of course, there may be preparation time before starting the first and third types of operations, so the processing method for the timing delay between the first processing unit 120 and the third processing unit 140 can be used as shown in FIG. 1 and FIG. 2 Or the processing methods of the image signal processing apparatuses 100, 200, and 300 of FIGS. 3A to 3D will not be repeated here. In some embodiments, the image signal processing device 400 may not have a control unit as in the image signal processing devices 100, 300 of FIGS. 1 or 3A to 3D, and each processing unit may not have a parameter temporary storage unit.

In this embodiment, by storing different types of parameter sets in the storage unit, different application methods of the present invention corresponding to different user needs can be further increased.

FIG. 5 is a flowchart of an embodiment of an image signal processing method 500 of the present invention. The image signal processing method 500 includes steps 502, 504, 506, and 508. Step 502 is to obtain the first image signal. Step 504 is to obtain the parameter set. The parameter group includes a first parameter corresponding to the first type operation and a second parameter corresponding to the second type operation, where the first type operation is different from the second type operation. Step 506 is to perform a first-type operation according to the first image signal and the first parameter of the parameter group to generate a second image signal. Step 508 is to perform the second type operation according to the second image signal and the second parameter after the first type operation to generate the third image signal.

The flow of the image signal processing method 500 has been described in detail in FIG. 1, FIG. 2, FIG. 3A to FIG. 3D and FIG. 4, and will not be repeated here.

FIG. 6 is a flowchart of an embodiment of another image signal processing method 600 of the present invention. The image signal processing method 600 includes steps 602, 604, 606, 608, and 610. Step 602 is to obtain the first image signal. Step 604 is to obtain a first parameter group. The first parameter group includes a first parameter corresponding to the first type of operation and a second parameter corresponding to the second type of operation. Step 606 is to perform a first type of operation based on the first image signal and the first parameter of the first parameter group to generate a second image signal. Step 608 is to obtain a second parameter group after obtaining the first parameter group. The second parameter group includes a third parameter corresponding to the first type operation and a fourth parameter corresponding to the second type operation. Step 610 is to perform the above-mentioned second type operation according to the second image signal and the fourth parameter of the second parameter group to generate a third image signal.

The flow of the image signal processing method 600 has been described in detail in FIGS. 3A to 3D and FIG. 4 and will not be repeated here.

In summary, in the existing image signal processing, the corresponding parameters are only read when the corresponding parameters are required for each processing unit. In this embodiment, the parameters required by different types of processing units (such as the first processing unit, the second processing unit, and the third processing unit) are combined into a parameter group and read out at once. A parameter, a second parameter and a third parameter are combined into a parameter group whose data is a continuous sequence. In some embodiments, in the storage unit, the first parameter, the second parameter and the third parameter are in a continuous manner Save. Therefore, when the processing unit obtains the parameters, it can quickly obtain the parameters corresponding to the different types of processing units. Thereby, when the processing unit obtains the parameters, the number of readings can be reduced, and the loss of reading time can be reduced. In some embodiments, when the parameter group can be transmitted by streaming, by setting dummy parameters (such as the first dummy parameter, the second dummy parameter, and the third dummy parameter), the first parameter, The time of the second parameter and the third parameter is delayed until the time when the first processing unit 0, the second processing unit, and the third processing unit start performing different types of operations on the image signal, without letting the first processing unit, the second processing There is a time difference between the unit and the third processing unit acquiring the first parameter, the second parameter, and the third parameter and starting to calculate the image signal, causing an operation error. In addition, by setting the dummy parameters, the image signal processing device may not have a control unit, and the parameter temporary storage unit may not be set in each processing unit, which further reduces the loss of reading time and reduces the cost.

The above are only the preferred embodiments of the present invention and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims (16)

1. An image signal processing method, characterized in that the method includes:

   Obtain the first image signal at multiple times;

   Obtaining parameter groups at multiple times, which include a first type parameter corresponding to a first type operation and a second type parameter corresponding to a second type operation, wherein the first type operation is different from the second type operation;

   Performing the first type of operation based on the parameter set obtained at time T and the first image signal corresponding to the time T to generate a second image signal; and

   The second type operation is performed according to the second image signal generated at the corresponding time T and the parameter set obtained at time T + 1 to generate a third image signal.
2. The image signal processing method according to claim 1, wherein the first type operation is performed according to the parameter set obtained at time T and the first image signal corresponding to the time T to generate The steps of the second image signal include:

   According to the first type parameter in the parameter group obtained at time T and the first image signal corresponding to the time T, the first type operation is performed to generate a second image signal.
3. The image signal processing method according to claim 1, wherein the second type is performed according to the second image signal generated at the corresponding time T and the parameter set obtained at the time T + 1 The operation to generate the third image signal includes:

   The second type operation is performed according to the second image signal generated at the corresponding time T and the second type parameter in the parameter group obtained at the time T + 1 to generate a third image signal.
4. The image signal processing method according to claim 1, wherein the step of obtaining the first image signal at multiple times includes:

   The first image signal is acquired from the image sensor at multiple times.
5. The image signal processing method according to claim 1, wherein the first type parameter includes a first dummy parameter.
6. The image signal processing method according to claim 1, wherein the second type parameter includes a second dummy parameter.
7. The image signal processing method according to claim 1, wherein the first type of operation includes image flatness operation.
8. The image signal processing method of claim 1, wherein the second type of operation includes pixel defect operation.
9. The image signal processing method of claim 1, wherein the parameter group further includes a third type parameter used for a third type operation, and the method further includes:

   The third type operation is performed according to the second image signal generated at the corresponding time T + 1 and the third type parameter in the parameter group obtained at the time T + 2 to generate a third image signal.
10. The image signal processing method according to claim 9, wherein the third type of operation includes a deformation operation.
11. The image signal processing method according to any one of claims 1-10, wherein the parameter groups are output in a continuous sequence.
12. An image signal processing device, characterized by comprising:

    A storage unit that stores a first parameter group, the first parameter group including a first parameter corresponding to a first type operation and a second parameter corresponding to a second type operation, wherein the first type operation is different from the second type Operation

    The first processing unit receives the first parameter group and the first image signal, and performs the first type operation according to the first parameter and the first image signal to generate a second image signal; and

    The second processing unit receives the second parameter and the second image signal of the first parameter group from the first processing unit, and performs the process according to the second parameter and the second image signal The second type of operation generates a third image signal.
13. The image signal processing device according to claim 12, wherein the first parameter group further includes a plurality of dummy parameters corresponding to the first-type operation and the second-type operation, respectively.
14. The image signal processing device according to claim 12, wherein the second processing unit has a parameter temporary storage unit, and the parameter temporary storage unit receives and stores the second parameter.
15. The image signal processing device according to claim 12, further comprising a third processing unit, the first parameter group further includes a third parameter corresponding to a third type of operation, and the third processing unit selects from The second processing unit receives the third parameter and the third image signal of the first parameter group, and performs the third type operation according to the third parameter and the third image signal.
16. The image signal processing device according to claim 15, wherein the storage unit further stores a second parameter group, the second parameter group including the first parameter corresponding to the first type operation and the corresponding The third parameter of the three types of operations, and does not include the second parameter corresponding to the second type of operations.

Images