JP7492331B2 - IMAGE PROCESSING APPARATUS, CONTROL METHOD AND PROGRAM FOR IMAGE PROCESSING APPARATUS - Google Patents

Description

The present invention relates to an image processing device, a control method for an image processing device, and a program.

In recent years, technology has been gaining attention for its use in which multiple cameras are installed in different positions to capture images from multiple viewpoints simultaneously, and a virtual viewpoint image is generated using the multiple images obtained by the capture. This technology for generating virtual viewpoint images allows users to view, for example, highlight scenes from a soccer or basketball game from a variety of angles, providing a greater sense of realism to the user than with normal images.

In addition, virtual viewpoint images can be generated and viewed by collecting images captured by multiple cameras on a server or the like, performing processing such as three-dimensional model generation and rendering on the server, and transmitting the images to a user terminal. In a system that generates such virtual viewpoint images, multiple cameras need to capture multiple images and transmit them to the server, and if sufficient bandwidth cannot be secured for the transmission path, the image quality of the generated virtual viewpoint image will deteriorate. In addition, if the transmission bandwidth required for each camera dynamically changes depending on the scene, it is necessary to allocate the bandwidth adaptively.

In response to this, Patent Document 1 discloses a transmission method that transmits data using a token control method. By using tokens to determine the transmission timing of captured data for each camera, it is possible to allocate bandwidth to each camera efficiently.

Japanese Patent Application Laid-Open No. 11-220473

However, the technology described in Patent Document 1 requires a mechanism for controlling the circulation of tokens between cameras in addition to transmitting captured data. Also, as the number of cameras increases, the overhead required to obtain a token and start transmission increases.

The present invention has been made in consideration of the above problems, and aims to provide a technique for appropriately transmitting processed image data in an image processing device.

One aspect of the image processing device according to the present invention that achieves the above object is to
An image processing device connected to a first image processing device and a second image processing device in an imaging system that synchronously captures images using a plurality of imaging devices ,
a receiving means for receiving image data processed by the first image processing device from the first image processing device;
a transfer means for transferring the image data received by the receiving means to the second image processing device;
a detection means for detecting that transfer of the image data received by the receiving means to the second image processing device is completed based on header information of the image data received by the receiving means;
a transmitting means for transmitting the image data processed by the image processing device to the second image processing device based on the detection means detecting that the transfer of the image data received by the receiving means to the second image processing device is completed;
a time measuring means for measuring time based on a synchronization signal of the plurality of image capturing devices;
having
The transmitting means is characterized in that if the detection means does not detect the end of the transfer before the time measured by the measurement means reaches a predetermined time, the transmitting means discards the image data processed by the image processing device .

According to the present invention, it is possible for an image processing device to appropriately transmit processed image data.

FIG. 1 is a diagram illustrating a configuration of an imaging system according to an embodiment. 1A and 1B are diagrams for explaining the arrangement of a camera and a camera adapter and the position of a gaze point in one embodiment. FIG. 2A is a diagram showing an example of a hardware configuration of a camera adapter according to an embodiment; FIG. 2B is a diagram showing an example of a functional configuration of the camera adapter according to an embodiment; FIG. 2 illustrates a header format in one embodiment. 5 is a flowchart showing a procedure of a transfer operation in the first embodiment. 5 is a flowchart showing a procedure of a transmission operation in the first embodiment. FIG. 4 is a diagram showing an operation sequence of the imaging system in the first embodiment. 10 is a flowchart showing the procedure of a transfer operation in the second embodiment. 10 is a flowchart showing the procedure of a transmission operation in the second embodiment.

The following embodiments are described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe multiple features, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicate explanations are omitted.

(Embodiment 1)
First, an imaging system that captures images by installing multiple cameras in a facility such as a sports field (stadium) or concert hall will be described with reference to Fig. 1. The imaging system 100 includes cameras (imaging devices) 112a-112h, camera adapters (image processing devices) 120a-120h, a switching hub 180, an image computing server 200, a time server 290, and a controller 300.

In this embodiment, unless otherwise specified, cameras 112a through 112h will not be differentiated from one another and will be referred to as camera 112. Similarly, unless otherwise specified, camera adapters 120a through 120h will not be differentiated from one another and will be referred to as camera adapter 120.

In this embodiment, unless otherwise specified, the term "image" is explained as including the concepts of moving images and still images. In other words, the imaging system 100 of this embodiment is capable of capturing both still images and moving images.

In the imaging system 100 of this embodiment, an image computing server 200, a time server 290, and a camera adapter 120a are connected to a switching hub 180. A controller 300 is connected to the image computing server 200. The camera adapters 120a-120h are connected in a daisy chain. The cameras 112a-112h are associated with and connected to the camera adapters 120a-120h, respectively.

The camera adapter 120 is connected to the camera 112 and has functions such as controlling the camera 112, acquiring captured images, providing a synchronization signal, and setting the time. The control of the camera 112 includes, for example, setting and referencing shooting parameters (such as the number of pixels, color depth, frame rate, and white balance settings), acquiring the state of the camera 112 (shooting, stopped, synchronizing, error, etc.), starting and stopping shooting, and adjusting the focus. The synchronization signal is provided by providing the shooting timing (control clock) to the camera 112 using the time synchronized by the camera adapter 120 with the time server 290. The time is set by providing the time synchronized by the camera adapter 120 with the time server 290 in a time code that conforms to the SMPTE12M format, for example. As a result, the provided time code is added to the image data received from the camera 112. Note that the time code format is not limited to SMPTE12M and may be another format.

The controller 300 controls the photography of the cameras 112a-112h by sending control signals to the camera adapters 120a-120h via the network of the photography system 100. The controller 300 also transfers image data captured by the cameras 112a-112h to the image computing server 200 via the network, and retrieves selected image data from the image computing server 200.

Figure 2 is a diagram explaining the gaze point and camera arrangement in one embodiment. The cameras 112a-112h and camera adapters 120a-120h are installed to surround the field 250. In addition, the optical axis of each of the cameras 112a-112h is directed toward the gaze point A.

<Hardware Configuration>
3A, the hardware configuration of the camera adapter 120 functioning as an image processing device will be described. The camera adapter 120 includes a CPU 211, a ROM 212, a RAM 213, an auxiliary storage device 214, a communication I/F 215, and a bus 216.

The CPU 211 realizes each function of the camera adapter 120 shown in FIG. 1 by controlling the entire camera adapter 120 using computer programs and data stored in the ROM 212 and the RAM 213. The camera adapter 120 may have one or more dedicated hardware components different from the CPU 211, and at least a part of the processing by the CPU 211 may be executed by the dedicated hardware components. Examples of the dedicated hardware components include an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), and a DSP (Digital Signal Processor). The ROM 212 stores programs that do not require modification. The RAM 213 temporarily stores programs and data supplied from the auxiliary storage device 214, and data supplied from the outside via the communication I/F 215. The auxiliary storage device 214 is composed of, for example, a hard disk drive, and stores various data such as image data and audio data.

The communication I/F 215 is used for communication between the camera adapter 120 and an external device. For example, if the camera adapter 120 is connected to an external device via a wired connection, a communication cable is connected to the communication I/F 215. If the camera adapter 120 has a function for wireless communication with an external device, the communication I/F 215 is equipped with an antenna. The bus 216 connects each part of the camera adapter 120 to transmit information.

<Functional configuration>
Next, the functional configuration of the camera adapter 120 functioning as an image processing device will be described with reference to Fig. 3(b). Fig. 3(b) particularly shows the configuration around the transmission/reception processing unit 130 of the camera adapter 120. As shown in Fig. 3(b), the camera adapter 120 includes a photographing data generating unit 121, a transmission/reception processing unit 130, a port 122, and a port 123. The transmission/reception processing unit 130 includes a received data holding unit 131, a reception processing unit 132, a transmission processing unit 133, a delivery data holding unit 134, a counter 135, and a counter 136.

The image data generation unit 121 transmits image data captured by the camera 112. The ports 122 and 123 are input and output units for transmitting and receiving packets between adjacent camera adapters 120.

The transmission/reception processing unit 130 processes packets transmitted and received by the camera adapter 120. The received data holding unit 131 temporarily holds packets received by the port 122. The reception processing unit 132 performs reception processing based on the header information of the received packets temporarily held in the received data holding unit 131.

The transmission processing unit 133 performs a transmission process for transmitting the reception data that has been subjected to the reception processing by the reception processing unit 132 and the photographing data that has been generated by the photographing data generating unit 121. The transmission data holding unit 134 temporarily holds the transmission data that has been subjected to the transmission processing by the transmission processing unit 133.

The counter 135 is reset at the start of a frame based on the vertical synchronization signal of the camera 112, and then counts the clock. When a predetermined value is reached, transfer in the camera adapter 120 is disabled. The counter 136 is reset at the start of a frame based on the vertical synchronization signal of the camera 112, and then counts the clock. When a predetermined value is reached, the captured data generated by the camera 112 is discarded.

<Header format>
4 is a diagram showing a header format of the Internet Protocol. In this embodiment, a packet in which a header is added to the photographic data of the camera 112 is transmitted from the camera adapter 120 to the image computing server 200 on the network shown in FIG. 1. In this embodiment, a common initial value is given to all the camera adapters 120 in the time-to-live field 402 of the header, and one is subtracted each time the packet passes through a camera adapter 120. Therefore, if the value of the time-to-live field 402 of the packet to be transferred is "initial value - 1", it can be determined that the photographic data was transmitted by the adjacent camera adapter 120 one step upstream. In this embodiment, bit 2 of the flag field 401 is referenced to determine whether there is a subsequent fragmented packet.

<Camera adapter transfer operation>
FIG. 5 is a flowchart showing the procedure of the transfer operation of the camera adapter 120, particularly the transmission/reception processing unit 130, in the first embodiment.

In step S501, the transmission/reception processing unit 130 monitors the vertical synchronization signal of the camera 112 and detects the start of a frame. After detecting the start of a frame, the counter 135 starts counting the clock and the process proceeds to step S502. On the other hand, if the start of a frame has not been detected, the process waits until it is detected.

In step S502, the transmission/reception processing unit 130 determines whether the count value of the counter 135 has reached a preset value and timed out. If it is determined that a timeout has occurred, the process proceeds to step S508. On the other hand, if it is determined that a timeout has not occurred, the process proceeds to step S503.

In step S503, the camera adapter 120 determines whether or not a packet transferred from the upstream camera adapter 120 via the port 122 has been received. If a packet has been received, the process proceeds to step S504. On the other hand, if a packet has not been received, the process returns to step S502.

In step S504, the reception processing unit 132 determines whether the transfer status in the transmission/reception processing unit 130 is transferable. In this embodiment, the transfer status is transferable until the transmission/reception processing unit 130 determines that all of the captured data sent by the upstream camera adapter 120 has been transferred, and then becomes transferable after all transfer is completed. If it is determined that transfer is possible, the process proceeds to step S505. On the other hand, if it is determined that transfer is not possible, the process proceeds to step S509.

In step S505, since the transfer status is transferable, the camera adapter 120 transfers the data to the downstream camera adapter 120 via port 123.

In step S506, the camera adapter 120 references the header information of the received packet and determines from the time to live field 402 whether the received packet is image capture data of an adjacent camera adapter 120. As described above, if the time to live field 402 of the received packet is the initial value -1, it can be determined that transmission data of an adjacent camera adapter 120 is being transferred. If it is determined that the data is image capture data of an adjacent camera adapter 120, the process proceeds to step S507. On the other hand, if it is determined that the data is not image capture data of an adjacent camera adapter 120, the process proceeds to step S510.

In step S507, the reception processing unit 132 refers to the flag field 401 of the received packet and determines whether or not there is subsequent fragment data, i.e., whether or not it is the last flag. If it is determined that there is subsequent fragment data, it is not the last flag, so the process proceeds to step S510. On the other hand, if it is determined that there is no subsequent fragment data, it is the last flag, so the process proceeds to step S508.

In step S508, the reception processing unit 132 changes the transfer status to transfer not possible. For example, when transitioning from step S507 to step S508, since the transferred packet is the last packet of the adjacent camera adapter 120, it is determined that all the image capture data of the upstream camera adapter 120 has been transferred, and the transfer status is changed to transfer not possible.

In step S509, the reception processing unit 132 discards the received packet and proceeds to step S510.

In step S510, the transmission/reception processing unit 130 detects the start of the next frame. If the start of the next frame is not detected, the process returns to step S502. On the other hand, if the start of the next frame is detected, the process proceeds to step S511.

In step S511, the transmission/reception processing unit 130 changes the forwarding status to forwardable, and then proceeds to step S512.

In step S512, the camera adapter 120 determines whether or not to end the process. If not, the process returns to step S502 and repeats the series of steps.

After step S508, the transmission/reception processing unit 130 normally does not receive packets until the next frame. However, if a packet is received as an abnormal case, the process proceeds from step S502 to step S503 and step S504, and because the forwarding status indicates that forwarding is not possible, the process proceeds to step S509, and as a result, the received abnormal packet is discarded.

<Camera adapter transmission operation>
FIG. 6 is a flowchart showing the procedure of the transmission operation of the camera adapter 120, particularly the transmission/reception processing unit 130, in the first embodiment.

In step S601, the transmission/reception processing unit 130 monitors the vertical synchronization signal of the camera 112 and detects the start of a frame. After detecting the start of a frame, the counter 136 starts counting the clock and the process proceeds to step S602. On the other hand, if the start of a frame has not been detected, the process waits until it is detected.

In step S602, the transmission/reception processing unit 130 determines whether the count value of the counter 136 has reached a preset value and timed out. If it is determined that a timeout has occurred, the process proceeds to step S605. On the other hand, if it is determined that a timeout has not occurred, the process proceeds to step S603.

In step S603, the reception processing unit 132 refers to the forwarding status in the transmission/reception processing unit 130 and determines whether the forwarding status is forwardable. If it is determined that the forwarding status is forwardable, the process returns to step S602. On the other hand, if it is determined that the forwarding status is not forwardable, the process proceeds to step S604.

In step S604, the transmission/reception processing unit 130 transmits the transmission data temporarily stored in the transmission data storage unit 134 to the next camera adapter 120 via the port 123. Note that the transmission data temporarily stored in the transmission data storage unit 134 is data captured by the camera 112 to which a header has been added by the transmission processing unit 133.

In step S605, the transmission/reception processing unit 130 discards the transmission data temporarily stored in the transmission data storage unit 134. In this way, if the end of the transfer is not detected within a predetermined time, the image data processed by the camera adapter 120 is discarded.

In step S606, the camera adapter 120 determines whether or not to end the process. If not, the process returns to step S601 and repeats the series of steps.

If the end of the transfer is not detected within a specified time, the camera adapter 120 may start sending the processed image data to the downstream camera adapter.

<Operation of the imaging system>
FIG. 7 is a diagram showing an operation sequence of the imaging system 100 in the first embodiment.

In step S701, the controller 300 sets camera parameters that determine the shooting conditions of the camera 112 via each camera adapter 120. The controller 300 also performs time synchronization between the camera adapter 120 and the camera 112.

In step S702, the controller 300 sets transmission and reception parameters related to transmission and reception control in each camera adapter 120. In step S703, the controller 300 causes the camera 112 to start capturing images via the camera adapter 120.

In step S704, the camera 112 captures images for one frame period. In step S705, the camera 112 outputs image data for one frame to the camera adapter 120. In step S706, the camera adapter 120h adds a header to the data captured by the camera 112h and transmits the data to the adjacent camera adapter 120g.

In step S707, camera adapter 120g receives data captured by camera 112h from adjacent camera adapter 120h and transfers the data to adjacent camera adapter 120f. Similarly, camera adapter 120f transfers data captured by camera 112h to camera adapter 120e, camera adapter 120d, camera adapter 120c, and camera adapter 120b in sequence.

Then, in step S712, the data captured by the camera 112h is transferred from the camera adapter 120b to the camera adapter 120a. After that, in step S713, the data captured by the camera 112h is transferred from the camera adapter 120a to the image computing server 200. In this way, the data captured by the camera 112h can be transmitted from the camera adapter 120h to the image computing server 200.

On the other hand, when the camera adapter 120g detects in step S707 that the transfer of the data captured by the camera 112h has been completed, in step S714 the camera adapter 120g transmits the data captured by the camera 112g to the camera adapter 120f. Then, as in the case of the camera 112h, the data captured by the camera 112g is finally transferred to the image computing server 200. In a similar procedure, the data captured by the cameras 112f to 112a is transmitted to the image computing server 200.

The transmission of data captured by the camera 112 to the image computing server 200 from step S706 onwards described above must be completed within one frame period. The camera 112 can perform the image capturing operation and the transmission operation of the captured data shown in step S704 in parallel. Therefore, the camera adapter 120 can start the transmission operation of the next frame after completing the transmission of one frame to the image computing server 200b.

As described above, according to this embodiment, it is possible to transmit image data from multiple cascaded cameras sequentially and seamlessly using only IP header information, without using token packets.

(Embodiment 2)
In this embodiment, an example will be described in which the transfer operation and the transmission operation of the camera's photographed data are performed partly at the same time. In this embodiment, a transmission status is introduced in addition to the transfer status shown in the first embodiment, and transmission is performed when the transmission status is transmission possible. Also, the header format shown in FIG. 4 is partially changed, and bit 0 of the flag field 401 is set to 1 in the last four fragmented packets and transmitted. Since it can be seen that there are only four packets remaining, it is possible to detect that the transmission is finished. Then, when the downstream camera adapter 120 receives the last four packets of the adjacent camera adapter 120, it changes the transmission status to transmission possible and starts transmission. Note that the last four packets are just an example, and other numbers such as the last three packets or the last two packets may be set.

The device configuration included in the imaging system 100 is the same as in embodiment 1, so a detailed description will be omitted.

<Camera adapter transfer operation>
FIG. 8 is a flowchart showing the procedure of the transfer operation of the camera adapter 120, particularly the transmission/reception processing unit 130, in the second embodiment.

The processes from step S801 to step S804 are the same as the processes from step S501 to step S504 in embodiment 1, so their explanations are omitted. Also, the process from step S810 is the same as the process from step S508, so their explanations are omitted.

In step S805, the camera adapter 120 references the header information of the received packet and determines from the time to live field 402 whether the received packet is imaging data from an adjacent camera adapter 120. As described above, if the time to live field 402 of the received packet is the initial value -1, it can be determined that transmission data from an adjacent camera adapter 120 is being transferred. If it is determined that the data is imaging data from an adjacent camera adapter 120, the process proceeds to step S50806. On the other hand, if it is determined that the data is not imaging data from an adjacent camera adapter 120, the process proceeds to step S811.

In step S806, the camera adapter 120 refers to bit 0 of the flag field 401 of the received packet and determines whether or not the received packets are the last four packets, i.e., whether or not they can be transmitted. If they are the last four packets, it can be determined that they can be transmitted, and the process proceeds to step S807. On the other hand, if they are not the last four packets, it can be determined that they cannot be transmitted, and the process proceeds to step S811.

In step S807, the transmission/reception processing unit 130 changes the transmission status, which is initially disabled, to enabled.

In step S808, the reception processing unit 132 refers to the flag field 401 of the received packet and determines whether there is subsequent fragment data, i.e., whether it is the last flag. If it is determined that there is subsequent fragment data, it is not the last flag, so the process proceeds to step S811. On the other hand, if it is determined that there is no subsequent fragment data, it is the last flag, so the process proceeds to step S809. In step S809, the reception processing unit 132 determines that all of the shooting data of the upstream camera adapter 120 has been transferred, because the transferred packet is the last packet of the adjacent camera adapter 120, and changes the transfer status to transfer not possible.

In step S810, the reception processing unit 132 discards the received packet and proceeds to step S811. In step S811, the transmission/reception processing unit 130 detects the start of the next frame based on the vertical synchronization signal of the camera 112. If the start of the next frame is not detected, the process returns to step S802. On the other hand, if the start of the next frame is detected, the process proceeds to step S812.

In step S812, the transmission/reception processing unit 130 changes the transmission status to transmission not possible. Then, in step S813, the transmission/reception processing unit 130 changes the forwarding status to forwarding possible.

In step S814, the camera adapter 120 determines whether or not to end the process. If not, the process returns to step S802 and repeats the series of steps.

After step S809, the transmission/reception processing unit 130 normally does not receive packets until the next frame. However, if a packet is received as an abnormal case, the process proceeds from step S802 to step S803, and since the forwarding status indicates that forwarding is not possible, the process proceeds to step S810, and as a result, the received abnormal packet is discarded.

<Camera adapter transmission operation>
FIG. 9 is a flowchart showing the procedure of the transmission operation of the camera adapter 120, particularly the transmission/reception processing unit 130, in the second embodiment.

In step S901, the transmission/reception processing unit 130 monitors the vertical synchronization signal of the camera 112 and detects the start of a frame. After detecting the start of a frame, the process proceeds to step S902.

In step S902, the transmission/reception processing unit 130 refers to the transmission status and determines whether the transmission status is ready for transmission. If it is determined that the transmission status is ready for transmission, the process proceeds to step S903. On the other hand, if it is determined that the transmission status is not ready for transmission, the process waits until the transmission status is ready for transmission.

In step S903, the transmission/reception processing unit 130 transmits the transmission data temporarily stored in the transmission data storage unit 134 to the next camera adapter 120 via the port 123.

As described above, according to this embodiment, it is possible to transmit the image data of multiple cascaded cameras sequentially and seamlessly using only the IP header information, without using token packets. Furthermore, according to this embodiment, it is possible to perform the transfer and transmission operations of the camera's image data partially simultaneously.

Other Embodiments
The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention.

112: Camera, 120: Camera adapter, 121: Shooting data generation unit, 122, 123: Port, 130: Transmission/reception processing unit, 131: Received data storage unit, 132: Reception processing unit, 133: Transmission processing unit, 134: Transmitted data storage unit, 135, 136: Counter, 180: Switching hub, 200: Image computing server, 290: Time server, 300: Controller

Claims (10)

An image processing device connected to a first image processing device and a second image processing device in an imaging system that synchronously performs imaging using a plurality of imaging devices ,
a receiving means for receiving image data processed by the first image processing device from the first image processing device;
a transfer means for transferring the image data received by the receiving means to the second image processing device;
a detection means for detecting that transfer of the image data received by the receiving means to the second image processing device is completed based on header information of the image data received by the receiving means;
a transmitting means for transmitting the image data processed by the image processing device to the second image processing device based on the detection means detecting that the transfer of the image data received by the receiving means to the second image processing device is completed;
a time measuring means for measuring time based on a synchronization signal of the plurality of image capturing devices;
having
The image processing device is characterized in that the transmitting means discards the image data processed by the image processing device if the detection means does not detect the end of the transfer before the time measured by the measurement means elapses a predetermined time . the header information includes a flags field;
2. The image processing apparatus according to claim 1, wherein said detection means detects that the transfer is to end by referring to the flag field of the header information and detecting that there is no subsequent fragment data. the header information includes a time to live field;
3. The image processing device according to claim 1, wherein the detection means further detects, by referring to the survival time field of the header information and based on the value of the survival time field, that the image data received by the receiving means is image data processed by the first image processing device. the header information includes a flags field;
The image processing device according to claim 1, characterized in that the detection means detects that the transfer is completed by referring to the flag field of the header information and detecting that the remaining packets of image data to be processed by the first image processing device have a predetermined value . The image processing device further includes an acquisition unit for acquiring image data captured by a photographing device associated with the image processing device from the photographing device,
5. The image processing apparatus according to claim 1 , wherein the transmitting means transmits the image data acquired by the acquiring means and processed by the image processing apparatus to the second image processing apparatus. The image processing device according to any one of claims 1 to 5, characterized in that the image data received by the receiving means is image data captured by a first photographing device associated with the first image processing device and processed by the first image processing device. 7. The image processing apparatus according to claim 1, wherein the image processing apparatus is cascaded with a plurality of image processing apparatuses including the first image processing apparatus and the second image processing apparatus. another image processing apparatus located most downstream in the cascade connection among the plurality of image processing apparatuses is connected to a server apparatus via a switching hub;
8. The image processing apparatus according to claim 7 , wherein each image data processed by said image processing apparatus is transmitted to said server apparatus via said cascade connection. A method for controlling an image processing device connected to a first image processing device and a second image processing device in an image capture system that captures images synchronously using a plurality of image capture devices , comprising:
a receiving step of receiving image data processed by the first image processing device from the first image processing device;
a transfer step of transferring the image data received in the receiving step to the second image processing device;
a detection step of detecting that transfer of the image data received in the receiving step to the second image processing device is completed based on header information of the image data received in the receiving step;
a transmitting step of transmitting the image data processed by the image processing device to the second image processing device based on the detection step of the completion of the transfer of the image data received by the receiving step to the second image processing device;
a measurement step of measuring time based on a synchronization signal of the plurality of image capturing devices;
having
A method for controlling an image processing device, characterized in that, in the transmission process, if the detection process does not detect the end of the transfer before the time measured by the measurement process elapses a predetermined time, the image data processed by the image processing device is discarded . A program for causing a computer to function as the image processing device according to any one of claims 1 to 8 .

Images