KR100931841B1 - Processor chip, array processor, image data encoding method and recording medium therefor - Google Patents

Abstract

PURPOSE: A processor chip, an array processor, an image data encoding method, and a recording medium for recording a program are provided to vary processing functions of each component, thereby preventing an unnecessary increase of size of a multimedia chip. CONSTITUTION: By using an original image signal inputted from an image sensor, a pixel-based processing unit(310) generates/outputs frame image data. The pixel-based processing unit outputs more than one intermediate result generated during a sequential processing procedure for generating the frame image data. By using the intermediate result, a parameter extracting unit(315) extracts image parameters. A processing unit(320) performs image adjustment processing using the image parameters.

Description

Processor chip, array processor, image data encoding method and recording medium recording program

The present invention relates to a processor chip and a processing method, and more particularly, to a processor chip and a variable processing method having a variable processing unit having a pipelined structure.

The portable terminal of the digital processing device is a small electronic device implemented to facilitate the user's portability. The user can use a designated function such as a game or mobile communication by using the portable terminal. The portable terminal may include, for example, a mobile communication terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, or the like, depending on the implemented function.

Among them, a mobile communication terminal is basically a device implemented so that a mobile user can make a phone call with a remote receiver. However, due to the development of science and technology, recent mobile communication terminals have additional functions such as a camera function and a multimedia data reproduction function in addition to basic functions such as a phone call function, a short message transmission and reception function, and an address book management function.

1 is a block diagram of a mobile communication terminal having a camera function according to the prior art.

Referring to FIG. 1, a mobile communication terminal 100 having a camera function as an additional function includes a high frequency processor 110, an A / D converter 115, a D / A converter 120, a controller 125, The power supply unit 130, a key input unit 135, a main memory 140, a display unit 145, a camera 150, an auxiliary memory 155, and an image processor 160 are included.

The high frequency processor 110 processes a high frequency signal to be received through an antenna or transmitted through the antenna.

The A / D converter 115 converts an analog signal input from the high frequency processor 110 into a digital signal and transmits the analog signal to the controller 125.

The D / A converter 120 converts the digital signal input from the controller 125 into an analog signal and transmits the digital signal to the high frequency processor 110.

The controller 125 controls the overall operation of the mobile communication terminal 100. The controller 125 may include, for example, a central processing unit (CPU) or a micro controller.

The power supply unit 130 is a means for supplying power necessary for the operation of the mobile communication terminal 100. The power supply unit 130 may include a terminal for coupling to an external power source or a battery.

The key input unit 135 generates key data for performing various function setting, dialing, etc. of the mobile communication terminal 100 and transmits the generated key data to the controller 125. For example, the key input unit 135 may be implemented as a keypad including a plurality of key buttons.

The main memory 140 stores an operation program, various data, and the like of the mobile communication terminal 100. The main memory 140 may be configured as a flash memory or an electrically erasable programmable read only memory (EEPROM).

The display unit 145 displays an operation state of the mobile communication terminal 100 and an external image captured by the camera 150. For example, the display unit 145 may include a liquid crystal display (LCD) panel.

The camera 150 captures an external image (subject) and generates and outputs an image signal corresponding to the captured external image.

The auxiliary memory 155 stores an external image processed by the image processor 160.

The image processor 160 processes an image signal input from the camera 150. The image processor 160 performs functions such as color interpolation, gamma correction, image quality correction, JPEG encoding, and the like. The camera 150 and the image processor 160 may be controlled by the controller 125.

2 is a block diagram of an image processor according to the prior art, and FIG. 3 is a diagram conceptually illustrating a processing function of an image processor according to the prior art.

Referring to FIG. 2, the image processor 160 may include an interface unit 205, a control unit 210, a first hardware unit 215, a second hardware unit 220, a video coding unit 225, and a display controller ( 230, working memory 235, JPEG coding unit 240, and auxiliary memory controller 245. Each component, such as control unit 210 and first hardware unit 215, is connected via a system bus.

The interface unit 205 receives a Bayer pattern raw image signal input from the camera 150 and outputs the raw image signal to the first hardware unit 215.

The control unit 210 performs an overall control function so that the image processor 160 performs a specified operation.

As illustrated in FIG. 3, the first hardware unit 215 generates data for one frame by performing a necessary processing operation using a Bayer pattern raw image signal input through the interface unit 205. The data and / or image frames generated by the first hardware unit 215 are stored in the secondary memory 155.

In detail, the first hardware unit 215 performs functions such as dead pixel correction (DPC), lens shading correction (LSC), interpolation, RGB gamma, and edge enhancement. Here, interpolation is a processing operation performed by using neighboring pixel values to extract RGB values for each pixel, and RGB gamma refers to applying a gamma function to each of R, G, and B values. it means. Edge Enhance is to more clearly perform the edge extraction of the image.

The second hardware unit 220 uses AWB (Auto White Balance), AE (Auto Exposure), face detection, image stabilization, zoom, etc. using the data and the image frame generated by the first hardware unit 215. Performs the processing of.

The video coding unit 225 encodes image data processed by the first hardware unit 215 and the second hardware unit 220 into moving image data, and stores the image data in the auxiliary memory 155. In addition, the JPEG coding unit 240 encodes the image data processed by the first hardware unit 215 and the second hardware unit 220 into still image data, and stores the image data in the auxiliary memory 155. In addition, the video coding unit 225 and the JPEG coding unit 240 also perform decoding processing for causing the image data encoded and stored in the auxiliary memory 155 to be displayed on the display unit 145.

The display controller 230 controls the display 145 under the control of the control unit 210 so that any image data is displayed through the display 145.

The working memory 235 is a storage area that can be used when working with the first hardware unit 215, the second hardware unit 220, the video coding unit 225, and / or the JPEG coding unit 240.

The auxiliary memory controller 245 stores data generated by operations such as the first hardware unit 215, the second hardware unit 220, the video coding unit 225, and / or the JPEG coding unit 240. The data stored in the 155 and stored in the auxiliary memory 155 may be one or more of the first hardware unit 215, the second hardware unit 220, the video coding unit 225, and / or the JPEG coding unit 240. It is controlled so that it can be read and used.

However, in the conventional image processor 160, components such as the first hardware unit 215, the second hardware unit 220, the video coding unit 225, and the JPEG coding unit 240 are implemented in hardware. The size of the multimedia processor chip was increased and the price was high.

In addition, the conventional image processor 160 does not use a block that is not used when the Bayer pattern raw image signal is not input from the camera 150 or an image signal processor (ISP) function is provided in the image sensor inside the camera 150. There was also a problem in that the chip area was wasted.

In addition, the conventional image processor 160 may allow each component such as the first hardware unit 215, the second hardware unit 220, the video coding unit 225, and the JPEG coding unit 240 to perform only a corresponding function. There was also a disadvantage of poor flexibility because it is fixed.

In addition, the conventional image processing unit 160 is a process of improving the image quality, processing information in units of frame and video encoding is fixed by hardware that is a combination of logic circuits, so that the unit function is to be used for other purposes in other parts. Even in this case, there was a problem that the multimedia processor had to be redesigned because the logic circuit could not be modified and updated in real time.

In order to solve the above problems, the present invention provides a processor chip and a variable processing method having a variable processing unit having a pipelined structure capable of changing the function to be processed only by modification and / or update of the program for the processing unit. It is for.

In addition, the present invention provides a processor chip and a variable processing method having a variable processing unit having a pipelined structure that can solve the problem of unnecessarily increasing the size of a multimedia chip by varying the processing function of each component provided. It is to provide.

In addition, the present invention is to provide a processor chip and a variable processing method having a variable processing unit having a pipeline structure that can add and upgrade the function that can be processed only by the modification and / or update of the program for the processing unit. .

In addition, the present invention provides a processor chip and a variable processing method having a variable processing unit having a pipeline structure capable of performing efficient functions and concurrent processing by providing a plurality of unit processing units having a pipeline processing structure inside the processing unit. It is for.

In addition, the present invention is provided with a variable processing unit having a pipeline structure capable of rapid image processing by performing a process for extracting the image parameters required during the image processing process in parallel with the processing of the raw image signal input through the image sensor It is to provide one processor chip and a variable processing method.

Other objects of the present invention will be readily understood through the following description.

According to one aspect of the invention there is provided a processor chip and / or an array processor having a variable processing unit.

The processor chip according to an embodiment of the present invention generates and outputs frame image data by using a raw image signal input from an image sensor, and at least one intermediate result generated during sequential processing for generating the frame image data. A pixel-based processing unit for outputting a; A parameter extraction unit for extracting image parameters using the intermediate result; A processing unit for performing image adjustment processing using the extracted image parameters; And a coding unit for encoding the image adjustment processed frame image data.

The processing unit may include one or more variable processing units including two or more unit processing units to perform processing according to a program to be fetched; And one or more program patch units storing programs to be patched in each unit processing unit.

After determining the processing operation by the processor chip, the processor chip determines processing to be processed by each unit processing unit among the programs stored in the auxiliary memory and controls the corresponding program to be stored in the program patch unit. The control unit may further include. Here, the auxiliary memory may store programs corresponding to the processing to be processed by each unit processing unit.

The raw video signal input from the image sensor is a video signal of a Bayer pattern.

The processor chip may further include an interface unit configured to output the raw image signal to the coding unit when the raw image signal input from the image sensor under the control of the control unit is not a Bayer pattern image signal.

Each unit processing unit may perform pipeline processing according to the patched program.

Programs to be patched to the two or more unit processing units may each be different programs.

The variable processing unit may be an array processor.

An array processor according to another exemplary embodiment of the present invention may include two or more unit processing units that independently perform processing according to a program being fetched; And an internal memory connected to the two or more unit processing units to provide a storage area.

The internal memory may store image parameters extracted by using one or more intermediate results generated during sequential processing for generating frame image data using the raw image signal.

The unit processing unit may perform an image adjustment process on the frame image data using the image parameters.

The two or more unit processing units may perform pipeline processing according to the data processing order determined by the patched program.

The two or more unit processing units may receive a program patch from a program patch unit corresponding to the unit processing unit.

According to another aspect of the present invention, there is provided a variable processing method of a processor chip and / or a recording medium having recorded thereon a program for enabling the method.

An image data encoding method according to an embodiment of the present invention comprises the steps of: (a) generating at least one intermediate result in a sequential process for generating frame image data using a raw video signal; (b) extracting image parameters using the intermediate result; (c) performing an image adjustment process on the frame image data using the image parameters; And (d) encoding the frame image data on which the image adjustment process is completed.

 Step (a) and step (b) may be repeated until the frame image data is generated.

Step (c) may include: (d) determining a processing function of each of two or more unit processing units by determining a processing operation to be performed; (e) selecting a program according to a processing function determined for each unit processing unit among a plurality of programs stored in advance; And (f) providing the selected program to each unit processing unit to perform processing corresponding to a processing function.

The image data encoding method may include: determining whether to change the processing operation determined in the step (d); And if changed may further comprise the step of performing step (d) to step (f) again.

Two or more unit processing units may perform pipeline processing.

The present invention has the effect that the function to be processed can be changed only by modification and / or update of the program for the processing unit.

In addition, the present invention also has the effect of eliminating the problem of unnecessarily increasing the size of the multimedia chip by varying the processing function of each component provided.

In addition, the present invention also has the effect of adding and upgrading a function that can be processed only by modification and / or update of the program for the processing unit.

In addition, the present invention has an effect that can be processed quickly to extract the image parameters required during the image processing process in parallel with the processing of the raw image signal input through the image sensor.

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all transformations, equivalents, and substitutes included in the spirit and scope of the present invention. In the following description of the present invention, if it is determined that the detailed description of the related known technology may obscure the gist of the present invention, the detailed description thereof will be omitted.

Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In addition, the present specification will be described with reference to a mobile communication terminal equipped with a multimedia processor chip, but the present invention is not limited to the mobile communication terminal, and it is obvious that the present invention may be applied to any digital processing apparatus in which the multimedia chip may be mounted.

4 is a block diagram of an image processing unit according to an embodiment of the present invention, FIG. 5 is a block diagram of a processing unit according to an embodiment of the present invention, and FIG. 6 is a processing diagram according to another embodiment of the present invention. 7 is a block diagram of a unit, and FIG. 7 conceptually illustrates a processing function of an image processor according to an exemplary embodiment.

Referring to FIG. 4, the image processor 160 may include an interface unit 205, a control unit 210, a display controller 230, a working memory 235, an auxiliary memory controller 245, and a pixel-based processing unit 310. A parameter extraction unit 315 and a processing unit 320. Each component of the control unit 210, the pixel-based processing unit 310, the processing unit 320, and the like are connected through a system bus.

The interface unit 205 inputs the raw image signal input from the camera 150 to the pixel-based processing unit 310 by the control of the control unit 210, or the video coding unit 225 or the JPEG coding unit 240. Enter The interface unit 205 inputs the input image signal to the pixel-based processing unit 310 when the input image signal is a Bayer pattern image signal, and otherwise inputs the raw image signal to the video coding unit 225 or the JPEG coding unit 240. Can be entered. For example, when the camera 150 includes an image signal processing function, the output image signal may be an image signal other than a Bayer pattern. Here, the JPEG coding unit 240 assumes JPEG among various methods of coding still images, and the present invention is not limited thereto.

The control unit 210 performs an overall control function so that the image processor 160 performs a specified operation.

For example, when the raw image signal input from the image sensor included in the camera 150 is a Bayer pattern signal, the control unit 210 may input the interface unit 205 such that the raw image signal is input to the pixel-based processing unit 310. ) And control the pixel-based processing unit 310 to process the input raw image signal.

In addition, the control unit 210 may control the pixel-based processing unit 310 to input the intermediate results generated in the process of processing the raw image signal to the parameter extraction unit 315.

That is, the pixel-based processing unit 310 may generate image data corresponding to one frame by performing sequential processing on the input raw image signal, and generate the sequential processing. The intermediate results are input to the parameter extraction unit 315.

For example, the pixel-based processing unit 310 may be implemented in hardware logic, and sequential processing may include dead pixel correction (DPC), lens shading correction (LSC), interpolation, RGB gamma, and brightness signal ( Y) and the color signal C may be separated, and the filtering of the separated brightness and color signals may be performed.

Of course, a series of processes for generating image data corresponding to one frame by performing sequential processing on the raw video signal and each process may be variously changed and modified, which is obvious to those skilled in the art. The details are omitted since they are only one.

In addition, when the raw image signal input from the image sensor included in the camera 150 is not a Bayer pattern signal, the control unit 210 inputs the raw image signal to the video coding unit 225 or the JPEG coding unit 240. The interface unit 205 may be controlled to be able to.

In addition, the control unit 210 determines what processing the processing unit 320 should perform at present (for example, determining what processing each unit processing unit included in the variable processing unit 430 should perform, etc.). For example, a corresponding program may be stored in the program patch unit 410 to be provided to the variable processing unit 430 so that the variable processing unit 430 performs the determined processing function. This is a case where the processing contents performed by the variable processing unit 430 are changed only by storing the program according to the control of the control unit 210. If the processing content performed by the variable processing unit 430 is fixed, the control unit 210 may not perform the control for storing the program in the program patch unit 410.

As illustrated in FIG. 7, the pixel-based processing unit 310 performs a necessary processing operation using a Bayer pattern raw image signal input through the interface unit 205, thereby performing an image for one frame. Generate data. The image data generated by the pixel-based processing unit 310 is stored in the auxiliary memory 155 or the working memory 235 and provided to the video coding unit 225 or the JPEG coding unit 240, or the image data is directly It may be input to the video coding unit 225 or the JPEG coding unit 240.

In addition, the pixel-based processing unit 310 outputs an intermediate result generated during a series of processing for generating image data for one frame to the parameter extraction unit 315 for image parameter extraction.

The display controller 230 controls the display 145 under the control of the control unit 210 so that any image data is displayed through the display 145.

The working memory 235 is a storage area that can be used when working with the pixel based processing unit 310, the processing unit 320, or the like. In addition, an image frame generated by the pixel-based processing unit 310 may be stored in the working memory 235. The working memory 235 may be, for example, buffer memory.

The auxiliary memory controller 245 may be controlled by operations such as the pixel-based processing unit 310, the processing unit 320, the video coding unit 225, and / or the JPEG coding unit 240 by the control of the control unit 210. The generated data is stored in the auxiliary memory 155, and the data stored in the auxiliary memory 155 may be stored in the first hardware unit 215, the processing unit 320, the video coding unit 225, and / or the JPEG coding unit ( 240) to control the read and use. The auxiliary memory 155 stores programs for functions to be processed by each unit processing unit 440, 445, and the like, and the programs may be predefined for each purpose of use.

The parameter extraction unit 315 generates an image parameter that can be used in processing the image data in the processing unit 320 using the intermediate result input in real time from the pixel-based processing unit 310. The image parameter generated by the parameter extraction unit 315 is stored in an internal memory included in the variable processing unit 430 so that each unit processing unit can use it. If a plurality of variable processing units are included in the processing unit 320, the image parameters may be equally stored in an internal memory included in each variable processing unit. Of course, the storage space of the image parameter is not limited to the internal memory as long as it is a storage space that can read and use the image parameter required for processing the unit processing units. Similarly, even when the image parameters generated by the parameter extraction unit 315 are stored in any storage space, the image parameters may be moved or copied to the internal memory by the control of the control unit 210 when necessary. .

The processing performed by the parameter extraction unit 315 may include, for example, a resize operation for reducing the size of the original image, an operation for detecting edges in the small image, and a color space for the small image. There may be a task of converting (color space), a task of obtaining a sum of Y values and / or C values in the converted color space, and such processing may be performed repeatedly or cyclically. In addition, it will be apparent to those skilled in the art that a process for extracting an image parameter additionally required for processing of the processing unit may be further included.

As described above, since the processing of the parameter extraction unit is performed in parallel with the real-time processing of the pixel-based processing unit 310, the image data processing after the same time point or after a minimum time delay is completed when the image data of one frame is completed. All of the image parameters necessary for this can be generated to enable fast image data processing.

As illustrated in FIG. 5, the program patch unit 410 of the processing unit 320 performs a function on each unit processing unit 440, 445, etc. in the variable processing unit 430 included in the processing unit 320. Save the program to fetch. The control unit 210 reads a program stored in the auxiliary memory 155 and stores the program in the program patch unit 410, and the program stored in the program patch unit 410 is patched with a corresponding unit processing unit. The program patch unit 410 may include unit program patch units 415 and 420 of a corresponding quantity in order to patch a program to each unit processing unit.

As illustrated in FIG. 5, the variable processing unit 430 of the processing unit 320 includes one internal memory 435 and a plurality of unit processing units 440 and 445. The processing unit 320 according to the present invention may be implemented as, for example, an array processor. However, the conventional array processor includes one internal memory and one unit processing unit, whereas the variable processing unit 430 according to the present invention may include two or more unit processing units.

The unit processing units included in the variable processing unit 430 perform processing according to a program fetched from a corresponding program patch unit, and processing operations between the unit processing units are performed in a pipelined manner. Accordingly, by updating and modifying only programs stored in the auxiliary memory 155 as a program to be patched to the program patch unit 410, functions to be performed by each unit processing unit may be updated and modified.

As illustrated in FIG. 5, assuming that the variable processing unit 430 includes two unit processing units, that is, the first unit processing unit 440 and the second unit processing unit 445, the first program By the programs stored in the patch unit 415 and the second program patch unit 420, the first unit processing unit 440 and the second unit processing unit 445 perform corresponding functions. For example, each unit processing unit may perform color correction, automatic white balance (AWB), automatic exposure using image parameters extracted by the parameter extraction unit 315 according to a program stored in each unit program patch unit. (AE), face detection, facial expression detection, video stabilization, still image stabilization, digital zoom, or the like.

As described above, the processing unit 320 performs image adjustment processing (eg, color correction, automatic white balance (AWB), automatic exposure (AE), according to a program stored in the program patch unit 410). One or more of face detection, facial expression detection, motion image stabilization, still image stabilization, digital zoom, etc.).

For example, it is assumed that a program for color correction is stored in the first program patch 415 and a program for face / expression detection is stored in the second program patch 420. In this case, for the image data for one frame generated in the pixel-based processing unit 310, the first unit processing unit 440 uses the image parameter extracted by the parameter extraction unit 315 according to the patched program. The color correction is performed, and the second unit processing unit 445 performs face / expression detection using the image parameter extracted by the parameter extraction unit 315 according to the patched program.

In addition, the processing unit 320 may include a number of program patch units and a plurality of variable processing units to correspond thereto. 6 illustrates a case in which two program patch units 410 ?? 1 and 410 ?? 2 and two variable processing units 430 ?? 1 and 430 ?? 2 are included.

As illustrated in FIG. 6, since two unit processors are included in each of the two variable processing units 430 ′ 1 and 430 ′ 2, four unit processing units are included in the processing unit 320. Correspondingly, the two program patch units 410 ?? 1 and 410 ?? 2 also include two unit program patch units, respectively.

When the processing unit 320 includes a plurality of variable processing units, the internal memories included in each variable processing unit are shared not only by the unit processing units included in the same variable processing unit but also by the unit processing units included in the other variable processing units. Each unit processing unit performs pipeline processing. For example, the first, second, third and fourth unit processing units 440 ?? 1, 445 ?? 1, 440 ?? 2 and 445 ?? 2 are designated to be pipelined, or some unit processor Only among them (eg, the first unit processing unit and the third unit processing unit, the second unit processing unit and the fourth unit processing unit) may be designated to be pipelined.

As such, the plurality of unit processing units may individually perform operations according to programs stored in the corresponding unit program patch units, thereby enabling various processing processes to be performed at the same time. In addition, more efficient and enhanced pipeline processing may be possible.

As described above, a function performed by each unit processing unit included in the variable processing unit is determined by a program stored in each program patch unit under the control of the control unit 210. Therefore, the processing function of each unit processing unit may be flexibly changed, so that various functions may be performed without changing hardware, and the processing efficiency of the image processing unit 160 may be maximized.

8 is a flowchart illustrating a variable processing method according to an embodiment of the present invention.

Referring to FIG. 8, in step 710, the control unit 210 determines an operation to be processed by the current image processor 160 to process a processing function of the processing unit 320 (that is, a processing function performed by each unit processing unit). Is determined.

Subsequently, the control unit 210 reads a program for performing a function of each unit processing unit included in the variable processing units of the processing unit 320 from the auxiliary memory 155 to perform the processing function determined in operation 720. Each of them is stored in the corresponding program patch section.

If the processing unit 320 is fixed to perform image adjustment processing using the image parameters extracted by the parameter extraction unit 315, steps 710 and 720 may be omitted. However, even in this case, if it is determined whether the program for performing the image adjustment processing is updated in the auxiliary memory and if it is to be stored in the program patch unit 410, steps 710 and 720 may be performed. .

In operation 730, each unit processing unit performs an operation according to the patched program using the image parameter extracted by the parameter extraction unit 315. As described above, the pipeline processing may be performed between the unit processing units.

In operation 740, the control unit 210 determines whether to change a processing function of at least one unit processing unit.

If it is determined that the processing function for one or more unit processing units is to be changed, the control unit 210 stores a program corresponding to the function to be changed in the program patch unit corresponding to the unit processing unit determined to be changed in step 750.

Although the above has been described with reference to embodiments of the present invention, those skilled in the art may variously modify the present invention without departing from the spirit and scope of the present invention as set forth in the claims below. And can be changed.

1 is a block diagram of a mobile communication terminal having a camera function according to the prior art.

2 is a block diagram of an image processing unit according to the related art.

3 is a diagram conceptually illustrating a processing function of an image processor according to the related art.

4 is a block diagram of an image processor according to an exemplary embodiment of the present invention.

5 is a block diagram of a processing unit according to an embodiment of the present invention.

6 is a block diagram of a processing unit according to another embodiment of the present invention.

7 conceptually illustrates a processing function of an image processor according to an exemplary embodiment of the present invention.

8 is a flowchart illustrating a variable processing method according to an embodiment of the present invention.

Claims (13)

In the processor chip, A pixel-based processing unit which generates and outputs frame image data using a raw image signal input from an image sensor, and outputs one or more intermediate results generated in a sequential process for generating the frame image data; A parameter extraction unit for extracting image parameters using the intermediate result; And A processing unit for performing an image adjustment process using the extracted image parameters, The processing unit, One or more variable processing units including two or more unit processing units to perform processing according to a program to be fetched; And And at least one program patch unit for storing a program to be patched in each unit processing unit. delete The method of claim 1, After determining the processing operation by the processor chip, and further comprising a control unit for determining the processing to be processed by each unit processing unit of the programs stored in the auxiliary memory to control the corresponding program is stored in the program patch unit, , And the auxiliary memory stores programs corresponding to the processing to be processed by each unit processing unit. The method of claim 1, And a controller configured to output the raw image signal to a coding unit when the raw image signal input from the image sensor is not a Bayer pattern image signal under the control of a control unit. The method of claim 1, Each unit processing unit is a processor chip, characterized in that for performing pipeline processing according to the patched program. In an array processor, Two or more unit processing units which independently perform processing according to a program to be fetched; And An internal memory connected to the at least two unit processing units for providing a storage area; And the at least two unit processing units receive a program from a program patch unit corresponding to the at least two unit processing units. The method of claim 6, And the internal memory stores image parameters extracted by using one or more intermediate results generated in a sequential process for generating frame image data using a raw image signal. The method of claim 7, wherein And the unit processing unit performs image adjustment processing on the frame image data using the image parameters. delete In the image data encoding method in the image processing unit, (a) generating at least one intermediate result in a sequential process for generating frame image data using the raw image signal; (b) extracting image parameters using the intermediate result; And (c) performing image adjustment processing on the frame image data using the image parameters, Step (c) is, (d) determining a processing function of each of two or more unit processing units by determining a processing operation to be performed; (e) selecting a program according to a processing function determined for each unit processing unit among a plurality of programs stored in advance; And (f) providing the selected program to each unit processing unit so that processing corresponding to a processing function is performed. delete The method of claim 10, Determining whether to change the processing operation determined in the step (d); And And re-implementing the steps (d) to (f) if changed. A recording medium on which a program of instructions that can be executed by a digital processing apparatus is tangibly implemented to perform the variable processing method according to any one of claims 10 and 12, and which records a program which can be read by the digital processing apparatus. .

Images