JP2016201585A - Image processing apparatus and image processing apparatus control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To avoid increase in data amount stored in a storage device in accordance with a generated composite image.SOLUTION: An image processing apparatus comprises: a retaining part for retaining plural images captured with plural cameras; a calculation part which calculates, from the images, pixel information indicating pixels included in a designated range out of a captured range obtained by composing the images; a control part which transfers the pixels indicated by the pixel information, among the images retained by the retaining part, from the retaining part to the storage part; and a composing part which composes the pixels transferred to the storage part and generates ap composite image indicating the designated range.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image processing apparatus and a control method for the image processing apparatus.

  There has been proposed an image processing apparatus that combines a plurality of images photographed by a plurality of cameras installed in an automobile to generate a composite image indicating the situation around the automobile (see, for example, Patent Document 1). In this type of image processing apparatus, the storage device stores in advance composite information indicating pixels used to generate a composite image among images captured by each camera. Then, the image processing apparatus transfers the pixels indicated by the combination information from the plurality of cameras to the storage device. Thereby, pixels that are not used in the composite image are not transferred from the plurality of cameras to the storage device, and the amount of data stored in the storage device is reduced.

JP 2002-302001 A

  In an image processing apparatus in which pixels used to generate a composite image are specified by composite information, it takes time to acquire new composite information from an external device every time the range displayed in the composite image is changed. Note that in a configuration in which the range displayed in the composite image is changed without acquiring new composite information, pixels other than the pixels indicated by the composite information may be transferred to the storage device together with the pixels indicated by the composite information. In this case, the amount of data transferred to the storage device increases.

  In one aspect, an object of the image processing apparatus and the control method for the image processing apparatus disclosed by the present invention is to reduce the amount of data transferred to a storage device according to a generated composite image.

  An image processing apparatus according to one aspect includes a holding unit that holds a plurality of images shot by a plurality of cameras, and pixels that indicate pixels included in a specified range among shooting ranges obtained by combining the plurality of images. A calculation unit that calculates information from a plurality of images, a control unit that transfers pixels indicated by pixel information from the holding unit to the storage unit among the plurality of images held in the holding unit, and a pixel that is transferred to the storage unit And a combining unit that generates a combined image indicating the specified range.

  Another aspect of the image processing apparatus control method is an image processing apparatus control method including a holding unit that holds a plurality of images captured by a plurality of cameras. Pixel information indicating pixels included in the specified range is calculated from a plurality of images, and among the plurality of images held in the holding unit, the pixels indicated by the pixel information are transferred from the holding unit to the storage unit, and the storage unit Are combined to generate a composite image indicating the specified range.

  The image processing apparatus and the control method for the image processing apparatus disclosed in the present invention can reduce the amount of data transferred to the storage device in accordance with the generated composite image.

It is a figure which shows one Embodiment of the control method of an image processing apparatus and an image processing apparatus. It is a figure which shows another embodiment of the control method of an image processing apparatus and an image processing apparatus. It is a figure which shows an example of arrangement | positioning of the camera shown in FIG. It is a figure which shows an example of the synthesized image produced | generated using the image image | photographed with the camera shown in FIG. It is a figure which shows an example of the pixel information in the synthesized image shown to Fig.4 (a). It is a figure which shows an example of the pixel information in the synthesized image shown in FIG.4 (b). It is a figure which shows an example of the image received from the camera shown in FIG. It is a figure which shows an example of the image process in the image processing apparatus shown in FIG. FIG. 3 is a diagram illustrating an example of hardware of the image processing apparatus illustrated in FIGS. 1 and 2.

  Hereinafter, embodiments will be described with reference to the drawings.

  FIG. 1 shows an embodiment of an image processing apparatus and a control method for the image processing apparatus.

  The image processing apparatus 100 illustrated in FIG. 1 is connected to a storage unit 50 and a plurality of cameras 60. The image processing apparatus 100 receives an image captured by each camera 60. The image processing apparatus 100 transfers at least a part of the received image to the storage unit 50. The storage unit 50 has a storage area for storing an image transferred from the image processing apparatus 100. When the function of the image processing apparatus 100 is realized by a program, the storage unit 50 may store the program. The storage unit 50 may be disposed in the image processing apparatus 100.

  The image processing apparatus 100 is realized by a computer device including an arithmetic processing device such as a CPU (Central Processing Unit) that executes a program. The image processing apparatus 100 is mounted on a moving body such as an automobile, and synthesizes a plurality of images taken by a camera 60 installed on the moving body to generate a combined image. For example, the image processing apparatus 100 includes a holding unit 10, a calculation unit 20, a control unit 30, and a synthesis unit 40.

  The holding unit 10 acquires an image output from each of the cameras 60 and holds the acquired image.

  The calculation unit 20 calculates pixel information indicating pixels included in a designated range from a plurality of images, among imaging ranges obtained by combining a plurality of images. For example, when the synthesized image to be generated is shot with one virtual camera, the calculation unit 20 specifies the position where the virtual camera is arranged, the direction in which the virtual camera lens faces, the focal length of the lens, and the like. Information is received from an input device such as a touch panel connected to the image processing apparatus 100. Then, the calculation unit 20 calculates pixel information indicating pixels included in the specified range for each of the plurality of images based on the received specification information.

  The control unit 30 transfers the pixel indicated by the pixel information calculated by the calculation unit 20 from the plurality of images held in the holding unit 10 from the holding unit 10 to the storage unit 50. The synthesizer 40 synthesizes the pixels transferred to the storage unit 50 and generates a synthesized image indicating the designated range.

  The image processing apparatus 100 may store the generated composite image in the storage unit 50 or may output it to a monitor such as a liquid crystal display connected to the image processing apparatus 100.

  As described above, in the embodiment illustrated in FIG. 1, the image processing apparatus 100 calculates, from a plurality of images, pixel information indicating pixels included in a specified range among display ranges displayed by combining a plurality of images. Then, the pixel indicated by the calculated pixel information is transferred from the holding unit 10 to the storage unit 50. As described above, the number of pixels transferred from the holding unit 10 to the storage unit 50 is adjusted according to the generated composite image. As a result, the amount of data transferred from the holding unit 10 to the storage unit 50 can be reduced.

  Further, the image processing apparatus 100 calculates pixel information corresponding to the generated composite image. Thereby, the memory | storage part 50 can avoid the increase in the data amount memorize | stored, without memorize | storing beforehand the pixel information according to the synthesized image to produce | generate.

  FIG. 2 shows another embodiment of the image processing apparatus and the control method of the image processing apparatus.

  The image processing apparatus 100a illustrated in FIG. 2 is a computer apparatus including an arithmetic processing apparatus such as a CPU. The image processing apparatus 100a is connected to four cameras 200 (200a, 200b, 200c, 200d). The image processing apparatus 100a receives an image captured by each camera 200. The image processing apparatus 100 a is connected to the output device 300 and outputs the generated composite image and the like to the output device 300. The image processing apparatus 100 a is connected to the input device 400 and receives instructions from the user via the input device 400. For example, the image processing device 100a, the camera 200, the output device 300, and the input device 400 are mounted on a moving body such as an automobile.

  The cameras 200a, 200b, 200c, and 200d capture, for example, the surroundings of a mounted moving body. The cameras 200a, 200b, 200c, and 200d output images obtained by shooting to the image processing apparatus 100a. The arrangement of the camera 200 will be described with reference to FIG.

  The output device 300 is a monitor such as a liquid crystal display, receives data including a composite image from the image processing device 100a, and displays the received data.

  The input device 400 includes a keyboard, a touch panel, a joystick, etc., and receives instructions from the user. For example, when the composite image generated by the image processing apparatus 100a is captured by one virtual camera, the input device 400 is positioned where the virtual camera is disposed, the direction in which the virtual camera lens faces, and the focal point of the lens. Designation information indicating a distance or the like is received by a user input operation. The input device 400 outputs the received designation information to the image processing device 100a. Note that the position at which the virtual camera is arranged indicates, for example, the position of the viewpoint of the user to be displayed as a composite image, and is designated by three-dimensional coordinates such as XYZ coordinates. The direction in which the lens of the virtual camera faces is, for example, the direction of the user's line of sight displayed in the composite image, and is indicated by a three-dimensional vector such as XYZ coordinates. The focal length of the lens indicates, for example, enlargement or reduction of the range to be displayed in the composite image, and is designated by a numerical value such as an enlargement ratio or a reduction ratio. Hereinafter, the position where the virtual camera is arranged is also referred to as “viewpoint position”, and the direction in which the lens of the virtual camera is directed is also referred to as “line-of-sight direction”.

  The image processing apparatus 100a includes IF (Interface) units 110a, 110b, 110c, and 110d and FIFOs (First In First Out) 120a, 120b, 120c, and 120d. The image processing apparatus 100a includes a storage unit 130, a calculation unit 140, a control unit 150, and a synthesis unit 160.

  The IF unit 110 (110a, 110b, 110c, 110d) is connected to the camera 200 and receives an image taken by the camera 200. The IF unit 110 outputs the image received from the camera 200 to the FIFO 120 (120a, 120b, 120c, 120d).

  The FIFO 120 is a buffer or the like and holds an image received from the camera 200. For example, when receiving a synchronization signal indicating the start of an image from the camera 200, the FIFO 120 sequentially holds the first pixel of the image received following the synchronization signal.

  The storage unit 130 is a RAM (Random Access Memory) or the like, and has a storage area for storing an image transferred from the FIFO 120. When the function of the image processing apparatus 100a is realized by a program, the program may be stored in the storage unit 130. Note that the storage unit 130 may be disposed outside the image processing apparatus 100a.

  The calculation unit 140 calculates, from a plurality of images, pixel information indicating pixels included in a specified range among shooting ranges obtained by combining images shot by the cameras 200. For example, the calculation unit 140 receives designation information indicating the position of the viewpoint, the line-of-sight direction, the focal length of the lens, and the like from the input device 400 when the generated composite image is captured by one virtual camera. The calculation unit 140 calculates a range designated by the position of the viewpoint, the line-of-sight direction, the focal length of the lens, and the like based on the designation information, and pixel information indicating pixels included in the designated range is captured by the camera 200. For each of the images. The operation of the calculation unit 140 will be described with reference to FIGS. 4, 5, and 6.

  The control unit 150 transfers, from the FIFO 120 to the storage unit 130, the pixel indicated by the pixel information calculated by the calculation unit 140 among the images held in each FIFO 120. In addition, the control unit 150 deletes pixels other than the pixel indicated by the pixel information from the FIFO 120 to the storage unit 130, but deletes them using the FIFO 120. The operation of the control unit 150 will be described with reference to FIG.

  The synthesizing unit 160 synthesizes the pixels transferred to the storage unit 130 to generate a synthesized image indicating the designated range. The combining unit 160 outputs the combined image to the output device 300.

  FIG. 3 shows an example of the arrangement of the camera 200 shown in FIG. For example, the camera 200 has a lens such as a fisheye lens and shoots a subject in a range indicated by a dotted line (hereinafter also referred to as “field of view”). As shown in FIG. 3, the cameras 200 a, 200 b, 200 c, and 200 d are arranged around a moving body such as an automobile VC so that parts of the fields of view of the cameras 200 adjacent to each other overlap each other. For example, the camera 200a is disposed on the front surface of the vehicle VC, the camera 200b is disposed on the left side surface of the vehicle VC, the camera 200c is disposed on the right side surface, and the camera 200d is disposed on the rear surface of the vehicle VC. The image processing apparatus 100a obtains a shooting range (shooting range including the periphery of the vehicle VC) indicated by shading by combining the images shot by 200a, 200b, 200c, and 200d.

  The cameras 200a, 200b, 200c, and 200d may be disposed at the four corners of the automobile VC. In addition, a plurality of cameras 200 other than four may be arranged in the automobile VC.

  FIG. 4 shows an example of a composite image generated using an image taken by the camera 200 shown in FIG. FIG. 4A shows a composite image CI1 in the line-of-sight direction looking down from a viewpoint located directly above the automobile VC. The composite image CI1 is generated using an image IMGa photographed by the camera 200a, an image IMGb photographed by the camera 200b, an image IMGc photographed by the camera 200c, and an image IMGd photographed by the camera 200d. Note that the image IVC is an image when the automobile VC is viewed in the viewing direction from the set viewpoint. For example, the synthesis unit 160 generates the image IVC based on image processing such as three-dimensional computer graphics.

  FIG. 4B shows a composite image CI2 in the line-of-sight direction when the automobile VC is viewed from the viewpoint located in front of the automobile VC. The synthesized image CI2 is synthesized using the image IMGb taken by the camera 200b, the image IMGc taken by the camera 200c, and the image IMGd taken by the camera 200d. Note that in the composite image CI2, since the viewpoint is located in front of the automobile VC and the line of sight is the direction of the automobile VC, the pixels of the image IMGa taken by the camera 200a are not used.

  FIG. 5 shows an example of pixel information in the composite image CI1 shown in FIG. FIG. 5 shows an image IMGa taken by the camera 200a as a rectangle arranged in front of the automobile VC, and an image IMGb taken by the camera 200b as a rectangle arranged on the left side of the automobile VC. FIG. 5 shows an image IMGc taken by the camera 200c as a rectangle arranged on the right side of the automobile VC, and shows an image IMGd taken by the camera 200d as a rectangle arranged after the automobile VC. The white (non-shaded) area of each image IMG (IMGa, IMGb, IMGc, IMGd) shown in FIG. 5 is designated information to generate the composite image CI1 shown in FIG. Indicates the specified range.

  For example, the calculation unit 140, based on the designation information received from the input device 400 (designation information including the position of the viewpoint, the line-of-sight direction, the focal length of the lens, and the like), a designated range (white color) in the generated composite image CI1. Region). The calculation unit 140 identifies pixels of each image IMG included in the designated range. Then, the calculation unit 140 outputs pixel information indicating the pixel specified in each image IMG to the control unit 150 and the synthesis unit 160.

  FIG. 6 shows an example of pixel information in the composite image CI2 shown in FIG. The arrangement of the images IMGa, IMGb, IMGc, and IMGd is the same as that in FIG. A white area in each image IMG shown in FIG. 6 indicates a range designated by the designation information in order to generate the composite image CI2 shown in FIG. 4B. Based on the designation information received from the input device 400 (designation information including the position of the viewpoint, the line-of-sight direction, the focal length of the lens, and the like), the calculation unit 140 designates a designated range (white region) in the generated composite image CI2. Is calculated. The calculation unit 140 identifies pixels in each image IMG included in the specified range. Then, the calculation unit 140 outputs pixel information indicating the pixel specified in each image IMG to the control unit 150 and the synthesis unit 160. Note that in the composite image CI2, the pixels of the image IMGa are not used, and therefore the entire image IMGa is shaded.

  FIG. 7 shows an example of an image IMG received from the camera 200 shown in FIG. FIG. 7A shows a signal including an image IMG received from the camera 200 via the IF unit 110. The signal including the image IMG illustrated in FIG. 7A includes a synchronization signal SS indicating the start of the image IMG and k pixels P1, P2,... Pk. The signals including the image IMG are sequentially transmitted from the camera 200 with the synchronization signal SS as the head. Note that the value of k indicates the number of pixels of the received image IMG. Further, the value of k may be different for each image IMG (that is, the camera 200).

  FIG. 7B shows pixels held in the FIFO 120 by the control of the control unit 150 based on the pixel information in the image IMG shown in FIG. For example, in the pixel information, when the pixels included in the specified range of the image IMG are the pixels P1, P2, P101,... Pk, the control unit 150 sets the pixels P1, P2, P101,. The FIFO 120 is selected. The control unit 150 holds the selected pixels P1, P2, P101,... Pk in a FIFO 120 with a storage area packed. Further, the control unit 150 causes the FIFO 120 to delete the pixels P3,... P100 other than the pixel indicated by the synchronization signal SS and the pixel information. The control unit 150 transfers the pixels P1, P2, P101,... Pk held in the FIFO 120 to the storage unit 130.

  Thereby, the number of pixels held in the FIFO 120 can be reduced, and the storage area of the FIFO 120 can be used efficiently. In addition, the amount of data transferred from the FIFO 120 to the storage unit 130 can be reduced.

  Note that the control unit 150 may store empty data in the storage area of the pixel to be deleted in the FIFO 120 and may not transfer a pixel in which empty data is stored from the FIFO 120 to the storage unit 130. Further, the FIFO 120 may hold all the pixels of the image IMG. In this case, the control unit 150 selects a pixel indicated by the pixel information and transfers it to the storage unit 130. For example, the FIFO 120 holds all the pixels of the image IMG and executes a transfer process for transferring the held pixels to the storage unit 130, and the control unit 150 invalidates the transfer process for pixels other than the pixels indicated by the pixel information. May be.

  FIG. 8 shows an example of image processing in the image processing apparatus 100a shown in FIG. The processing from step S100 to step S160 shown in FIG. 8 is realized by the CPU of the image processing apparatus 100a executing the image processing program. That is, FIG. 8 shows another embodiment of the control method of the image processing apparatus. Note that the processing illustrated in FIG. 8 may be executed by hardware installed in the image processing apparatus 100a. In this case, the calculation unit 140, the control unit 150, and the synthesis unit 160 illustrated in FIG. 2 are realized by circuits arranged in the image processing apparatus 100a.

  In step S100, the calculation unit 140 acquires designation information including the position of the viewpoint, the line-of-sight direction, the focal length of the lens, and the like via the input device 400. That is, the range displayed in the composite image is indicated by the designation information.

  In step S110, the calculation unit 140 calculates the range specified by the specification information acquired in step S100 (the range displayed in the composite image).

  In step S120, the calculation unit 140 identifies pixels of the images IMGa, IMGb, IMGc, and IMGd included in the range calculated in step S110 (the range specified by the specification information).

  In step S130, the calculation unit 140 outputs pixel information indicating the pixel of each image IMG specified in step S120 to the control unit 150 and the synthesis unit 160.

  In step S140, the control unit 150 causes the FIFO 120 to hold the pixel indicated by the pixel information received in step S130 out of the image received from the camera 200.

  In step S150, the control unit 150 transfers the pixel indicated by the pixel information held in step S140 from the FIFO 120 to the storage unit 130. That is, the control unit 150 transfers the pixel indicated by the pixel information from the FIFO 120 to the storage unit 130.

  In step S160, the synthesizing unit 160 generates an image (synthesized image) indicating the specified range using the pixels transferred to the storage unit 130 in step S150. The combining unit 160 outputs the generated combined image to the output device 300.

  Then, the image processing apparatus 100a ends the process. Note that the process shown in FIG. 8 is preferably executed every time the image processing apparatus 100a receives the designation information via the input apparatus 400.

  As described above, in the embodiment illustrated in FIGS. 2 to 8, the image processing apparatus 100 a displays pixel information indicating pixels included in a designated range among a plurality of display ranges displayed by combining a plurality of images. Calculate from the image. The image processing apparatus 100 a transfers the pixel indicated by the calculated pixel information from the FIFO 120 to the storage unit 130. As described above, the number of pixels transferred from the FIFO 120 to the storage unit 130 is adjusted according to the generated composite image. As a result, the amount of data transferred from the FIFO 120 to the storage unit 130 can be reduced.

  In addition, the image processing apparatus 100a calculates pixel information corresponding to the composite image generated based on the received designation information. Thereby, the memory | storage part 130 can avoid the increase in the data amount memorize | stored, without memorize | storing beforehand the pixel information according to the synthesized image to produce | generate.

  FIG. 9 shows an example of hardware of the image processing apparatuses 100 and 100a shown in FIGS. Elements having the same or similar functions as those described in FIGS. 1 and 2 are denoted by the same or similar reference numerals, and detailed description thereof will be omitted.

  The computer apparatus 500 includes a processor 510, a plurality of buffers 520, a plurality of camera IFs (Interface) 530, a memory 540, and an input / output IF 550. The processor 510, the buffer 520, the memory 540, and the input / output IF 550 illustrated in FIG. 9 are connected to each other via the bus BUS.

  The plurality of camera IFs 530 are connected to the plurality of cameras 600 by wire or wireless, respectively. Thereby, the computer apparatus 500 receives an image captured by the camera 600 via the camera IF 530. The computer device 500 is connected to the output device 300 and the input device 400 via an input / output IF 550 in a wired or wireless manner.

  The buffer 520 holds an image received by the camera 600 via the camera IF 530. The buffer 520 transfers the held pixels to the memory 540 via the bus BUS under the control of the processor 510.

  The memory 540 stores the pixels transferred from the buffer 520. In addition, the memory 540 stores an operating system of the computer device 500, an application program for executing image processing for the processor 510 to generate a composite image, and the like.

  Note that an application program for executing image processing can be recorded and distributed on an optical disc such as a CD (Compact Disc) or a DVD (Digital Versatile Disc). Further, the computer device 500 may download an application program for executing image processing through a network via a network IF included in the computer device 500 and store the application program in the memory 540.

  The processor 510 functions as the calculation unit 20, the control unit 30, and the synthesis unit 40 illustrated in FIG. 1 by executing an image processing application program stored in the memory 540. In addition, the processor 510 functions as the calculation unit 140, the control unit 150, and the synthesis unit 160 illustrated in FIG. 2 by executing an image processing application program stored in the memory 540.

  That is, the image processing apparatuses 100 and 100a are realized by the cooperation of the processor 510 and the memory 540.

  From the above detailed description, features and advantages of the embodiments will become apparent. This is intended to cover the features and advantages of the embodiments described above without departing from the spirit and scope of the claims. Also, any improvement and modification should be readily conceivable by those having ordinary knowledge in the art. Therefore, there is no intention to limit the scope of the inventive embodiments to those described above, and appropriate modifications and equivalents included in the scope disclosed in the embodiments can be used.

Regarding the above embodiment, the following additional notes are disclosed.
(Appendix 1)
A holding unit for holding a plurality of images taken by a plurality of cameras;
A calculation unit that calculates pixel information indicating pixels included in a specified range from a plurality of images, among imaging ranges obtained by combining the plurality of images;
A control unit that transfers a pixel indicated by the pixel information from the plurality of images held in the holding unit to the storage unit;
An image processing apparatus comprising: a combining unit that combines the pixels transferred to the storage unit and generates a combined image indicating the specified range.
(Appendix 2)
In the image processing apparatus according to attachment 1,
The control unit causes the holding unit to hold a pixel indicated by the pixel information among the plurality of images.
(Appendix 3)
In the image processing apparatus according to attachment 1,
The holding unit holds a plurality of images taken by the plurality of cameras, and executes a transfer process of transferring pixels of the held images to the storage unit.
The control unit invalidates execution of the transfer process for pixels other than the pixel indicated by the pixel information.
(Appendix 4)
In the image processing apparatus according to attachment 1,
The image processing apparatus, wherein the storage unit is disposed outside the image processing apparatus.
(Appendix 5)
In a control method of an image processing apparatus including a holding unit that holds a plurality of images taken by a plurality of cameras,
Among the imaging ranges obtained by combining the plurality of images, pixel information indicating pixels included in a specified range is calculated from the plurality of images,
Of the plurality of images held in the holding unit, the pixel indicated by the pixel information is transferred from the holding unit to the storage unit,
A control method for an image processing apparatus, comprising combining the pixels transferred to the storage unit to generate a composite image indicating the designated range.
(Appendix 6)
In the control method of the image processing device according to attachment 5,
A control method for an image processing apparatus, wherein the holding unit holds a pixel indicated by the pixel information among the plurality of images.
(Appendix 7)
In the control method of the image processing device according to attachment 5,
The process of transferring performs a transfer process of holding a plurality of images captured by the plurality of cameras in the holding unit, and transferring pixels of the held images to the storage unit, and the pixel information is A method of controlling an image processing apparatus, wherein execution of the transfer process for pixels other than the pixels shown is invalidated.
(Appendix 8)
In the control method of the image processing device according to attachment 5,
The method for controlling an image processing apparatus, wherein the storage unit is arranged outside the image processing apparatus.

DESCRIPTION OF SYMBOLS 10 ... Holding part; 20,140 ... Calculation part; 30,150 ... Control part; 40,160 ... Synthesis | combination part; 50,130 ... Storage part; 60,200a, 200b, 200c, 200d, 600 ... Camera; 100,100a 110a, 110b, 110c, 110d, IF unit; 120a, 120b, 120c, 120d, FIFO; 300, output device, 400, input device, 500, computer device, 510, processor, 520, buffer; ... Camera IF; 540 ... Memory; 550 ... Input / output IF; BUS ... Bus; CI1, CI2 ... Composite image; IMGa, IMGb, IMGc, IMGd, IVC ... Image; VC ... Automobile

Claims (4)

A holding unit for holding a plurality of images taken by a plurality of cameras;
A calculation unit that calculates pixel information indicating pixels included in a specified range from a plurality of images, among imaging ranges obtained by combining the plurality of images;
A control unit that transfers a pixel indicated by the pixel information from the plurality of images held in the holding unit to the storage unit;
An image processing apparatus comprising: a combining unit that combines the pixels transferred to the storage unit to generate a combined image indicating the specified range. The image processing apparatus according to claim 1.
The control unit causes the holding unit to hold a pixel indicated by the pixel information among the plurality of images. The image processing apparatus according to claim 1.
The holding unit holds a plurality of images taken by the plurality of cameras, and executes a transfer process of transferring pixels of the held images to the storage unit.
The control unit invalidates execution of the transfer process for pixels other than the pixel indicated by the pixel information. In a control method of an image processing apparatus including a holding unit that holds a plurality of images taken by a plurality of cameras,
Among the imaging ranges obtained by combining the plurality of images, pixel information indicating pixels included in a specified range is calculated from the plurality of images,
Of the plurality of images held in the holding unit, the pixel indicated by the pixel information is transferred from the holding unit to the storage unit,
A method for controlling an image processing apparatus, comprising combining the pixels transferred to the storage unit to generate a combined image indicating the designated range.

Images