JP7214414B2 - Imaging device - Google Patents

Description

The present invention relates to an imaging device .

Communication may fail due to a failure occurring during communication. As a countermeasure against communication failure, for example, a technique of requesting retransmission of data that could not be transmitted is known. Further, Patent Document 1 proposes switching to on-demand learning when communication is interrupted due to a network failure during synchronous learning of e-learning.

JP 2007-334797 A

Delays are likely to occur in systems that require retransmission of data when communication fails. On the other hand, if no retransmission is requested, the required data will not be transmitted. Also, in a system that switches to another communication method when communication is interrupted, as disclosed in Patent Document 1, the configuration tends to be complicated.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an imaging apparatus that can cope with communication failures with a simple configuration.

An imaging device according to a first aspect of the present invention comprises a capture circuit for acquiring a plurality of first images by imaging, a transmission circuit for continuously transmitting the first images to an external display device, and the transmission circuit. determining whether or not transmission of the first image of one frame or more has failed, processing the untransmitted first image when it is determined that the transmission of the first image has failed, and performing communication; and a control circuit configured to control the transmission circuit to transmit the second image obtained by the processing after recovery, wherein the number of untransmitted first images is two or more. , the control circuit arranges the untransmitted first images to generate a set of images, which is the second image, and transmits the set of images after the communication is restored .

An imaging device according to a second aspect of the present invention comprises a capture circuit that acquires a plurality of first images by imaging, a transmission circuit that continuously transmits the first images to an external display device, and the transmission circuit. determining whether or not transmission of the first image of one frame or more has failed, processing the untransmitted first image when it is determined that the transmission of the first image has failed, and performing communication; and a control circuit configured to control the transmission circuit to transmit a second image obtained by the processing after recovery, wherein the control circuit controls the untransmitted first image. is processed to generate a reduced image that is the second image by reducing the size of the second image, and after the communication is restored, the reduced image is transmitted at a speed faster than the transmission speed when the first image is continuously transmitted. The transmitter circuitry is controlled to transmit at a transmission rate .

According to the present invention, it is possible to provide an imaging device that can cope with communication failures with a simple configuration.

FIG. 1 is a diagram showing an example configuration of a communication system according to each embodiment. FIG. 2A is a diagram showing an application example of the communication system in the first embodiment. FIG. 2B is a diagram showing the operation of the communication system in the first embodiment; FIG. 3 is a flow chart showing an example of the operation of the imaging device according to the first embodiment. FIG. 4 is a flowchart showing countermeasure processing. FIG. 5 is a flow chart showing an example of the operation of the terminal according to the first embodiment. FIG. 6 is a diagram showing a first modification of the communication system according to the first embodiment. FIG. 7 is a diagram showing a second modification of the communication system in the first embodiment. FIG. 8 is a diagram showing a third modification of the communication system in the first embodiment. FIG. 9 is a diagram showing a fourth modification of the communication system in the first embodiment. FIG. 10 is a diagram showing a fifth modification of the communication system in the first embodiment. FIG. 11A is a diagram showing a sixth modification of the communication system according to the first embodiment. FIG. 11B is a diagram showing a seventh modification of the communication system in the first embodiment; FIG. 12 is a diagram showing an application example of a communication system according to the second embodiment. FIG. 13A is a diagram showing a schematic configuration of a glasses-type terminal. FIG. 13B is a diagram showing a state when the glasses-type terminal is worn. FIG. 14A is a flowchart illustrating an example of the operation of the glasses-type terminal according to the second embodiment. 14B is a flowchart illustrating an example of the operation of the glasses-type terminal according to the second embodiment; FIG. FIG. 15A is a flowchart illustrating an example of terminal operation in the second embodiment. 15B is a flowchart illustrating an example of the operation of the terminal according to the second embodiment; FIG.

Embodiments of the present invention will be described below with reference to the drawings.
[First Embodiment]
A first embodiment will be described. FIG. 1 is a diagram showing an example configuration of a communication system according to each embodiment. The communication system 1 has, for example, an imaging device 100 and a terminal 200 . The imaging device 100 and the terminal 200 communicate wirelessly, for example. The wireless communication method is, for example, Wi-Fi (registered trademark). The wireless communication method is not limited to Wi-Fi, and may be Bluetooth (registered trademark) or the like.

An imaging device 100 as an example of a communication device acquires an image by imaging. The imaging device 100 is, for example, a digital camera (digital still camera or digital movie camera). The imaging device 100 may also acquire audio. In the example of FIG. 1, the imaging device 100 has a control circuit 102, a capture circuit 104, a memory 106, a recording medium 108, a display element 110, an operation section 112, and a communication circuit 114. The imaging device 100 may have a configuration other than that shown in FIG. 1, or may not have a part of the configuration shown in FIG. For example, the imaging device 100 may not have a display element.

A control circuit 102 controls the operation of each unit of the imaging apparatus 100 . Also, the control circuit 102 performs various image processing on the image acquired by the capture circuit 104 . This image processing includes processing for image display and processing for image recording. Furthermore, this image processing includes image processing when communication fails. The control circuit 102 includes hardware such as a CPU, GPU, ASIC, FPGA, and main memory. The control circuit 102 may be configured by a single CPU or the like, or may be configured by a plurality of CPUs or the like. Also, part of the processing by the control circuit 102 may be realized by software.

A capture circuit 104 acquires an image of the object. The capture circuit 104 includes, for example, an optical system, an imaging device, and a preprocessing circuit. The optical system causes light from an object to enter the imaging element. The imaging device converts light from an object into an electrical signal. The preprocessing circuit preprocesses the electrical signal obtained by the imaging device. This preprocessing includes, for example, correlated double sampling processing, gain adjustment processing, and analog/digital conversion processing. The capture circuit 104 may also be configured to capture the audio of the object. In this case, capture circuitry 104 includes a microphone and preprocessing circuitry. A microphone converts sound from an object into an electrical signal. The preprocessing circuit preprocesses the electrical signal obtained by the microphone. This preprocessing includes, for example, gain adjustment, noise removal, and analog/digital conversion processing.

The memory 106 is memory such as RAM and ROM. The memory 106 stores programs and parameters for the operation of the imaging device 100 . Memory 106 may be single or multiple.

The recording medium 108 includes memory such as flash memory. Images captured by the imaging device 100 are recorded on the recording medium 108 . The recording medium 108 does not have to be built in the imaging device 100 . For example, the recording medium 108 may be configured to be detachable from the imaging device 100 .

The display element 110 displays various images. The display element 110 is a display element such as a liquid crystal display or an organic EL display. Moreover, the display element 110 may have a speaker or the like for reproducing sound.

The operation unit 112 includes mechanical operation members such as buttons, switches, and dials. Moreover, the operation unit 112 may include a touch panel. When the imaging device 100 includes a display element, the touch panel may be provided integrally with the display element.

The communication circuit 114 includes circuits for the imaging device 100 to communicate with the terminal 200 . Communication circuit 114 is, for example, a communication circuit for Wi-Fi. Communication circuitry 114 may include communication circuitry for Bluetooth, for example.

The terminal 200 is an external display device having a display element such as a smart phone, a tablet terminal, a portable game machine, or a personal computer (PC). The terminal 200 displays and stores images sent from the imaging device 100 . In the example of FIG. 1, the terminal 200 has a control circuit 202, a memory 204, a recording medium 206, a display element 208, an operation section 210, and a communication circuit 212. Terminal 200 may have a configuration other than that shown in FIG. For example, terminal 200 may have a capture circuit.

The control circuit 202 controls the operation of each unit of the terminal 200 . The control circuit 202 includes hardware such as a CPU, GPU, ASIC, FPGA, and main memory. The control circuit 202 may be composed of a single CPU or the like, or may be composed of a plurality of CPUs or the like. Also, part of the processing by the control circuit 202 may be realized by software.

The memory 204 is memory such as RAM and ROM. Memory 204 stores programs and parameters for operation of terminal 200 . In addition, the memory 204 may store a cooperative application for cooperative shooting with the imaging apparatus 100 . Memory 204 may be single or multiple.

The recording medium 206 includes memory such as flash memory. For example, an image sent from the imaging device 100 is recorded on the recording medium 206 . Recording medium 206 may not be built in terminal 200 . For example, the recording medium 206 may be configured to be removable from the terminal 200 .

The display element 208 displays various images. A display element 208 is a display element such as a liquid crystal display or an organic EL display. Further, the display element 208 may have a speaker or the like for reproducing sound.

The operation unit 210 includes mechanical operation members such as buttons, switches, and dials. Moreover, the operation unit 210 may include a touch panel. The touch panel may be provided integrally with the display element 208 .

The communication circuit 212 includes circuits for the terminal 200 to communicate with the imaging device 100 . For example, the communication circuit 212 is a communication circuit for Wi-Fi, for example. Communication circuitry 212 may include communication circuitry for Bluetooth, for example.

The operation of the communication system 1 according to the first embodiment will be described below. 2A and 2B are diagrams for explaining the operation of the communication system 1 according to the first embodiment.

FIG. 2A shows an application example of the communication system 1 in the first embodiment. The example of FIG. 2A shows an example of application to a shooting site. That is, the cameraman C photographs the subject S using the imaging device 100 . The imaging device 100 is, for example, a digital still camera.

An image acquired by the imaging device 100 is sent to the terminal 200 . The image sent from the imaging device 100 is displayed on the display element 208 of the terminal 200 . Terminal 200 is, for example, a PC. The user U looks at the image displayed on the display device 208 and instructs the cameraman C how to photograph the subject S as necessary.

In order to allow the terminal 200 to check the state of the subject S in real time, the imaging device 100 continuously images the subject S at regular intervals as shown in (a) of FIG. 2B, for example. Then, as shown in (b) of FIG. 2B , the imaging device 100 sequentially transmits the first images obtained by continuous imaging to the terminal 200 . As a result, the first image obtained by the imaging device 100 is displayed in real time on the display element 208 of the terminal 200, as shown in (c) of FIG. 2B.

Here, communication between the imaging device 100 and the terminal 200 may fail due to various failures. The images I1, I2, and I3 acquired by the imaging device 100 will not be transmitted to the terminal 200 while the communication is unsuccessful. In this state, user U of terminal 200 cannot check images I1, I2, and I3.

The imaging device 100 of the present embodiment processes the untransmitted first image, and transmits the second image obtained by the processing to the terminal 200 after resuming communication. For example, the image capturing apparatus 100 may store reduced images of the unsent images I1, I2, and I3 acquired while the communication failed and the unsent image I4 acquired immediately after the communication was resumed, within one frame image. It is processed to line up. Then, the imaging device 100 transmits the combined image I5 to the terminal 200 in synchronization with the transmission timing of the image I4, as shown in (c) of FIG. 2B. Here, the image size of the combined image I5 may be the same size as the images I1, I2, I3 and I4. Generating such a set of images corresponds to generating a summary of the content of the unsent images. Note that the number of images arranged in a set of images is not limited to four frames. If the number of untransmitted images is small, images of three frames or less may be arranged, and if the number of untransmitted images is large, images of five frames or more may be arranged. Also, two or more frames of combined images may be generated. In the case where a set of images consists of images of four frames, for example, untransmitted images of the fifth and subsequent frames may be arranged in the set of images of the second frame. When a plurality of reduced images are arranged in one frame image, if the number of reduced images increases, it becomes difficult to distinguish each image when arranged. Therefore, when the number of reduced images reaches a predetermined number or more, the images acquired after that are arranged in another image, thereby facilitating discrimination of individual images.

In this way, the imaging device 100 transmits the combined image I5 to the terminal 200 after resuming communication. Thereby, the user U of the terminal 200 can also check the images acquired by the imaging device 100 during communication failure. Also, if the image size of the combined image I5 and the images I1, I2, I3 and I4 are the same size, the combined image I5 is transmitted with the same time length as the images I1, I2, I3 or I4. Therefore, even after resuming communication, the imaging device 100 can transmit an image at the same timing as before resuming communication.

The operation of the communication system 1 according to the first embodiment will be described in more detail below. FIG. 3 is a flow chart showing an example of the operation of the imaging device 100 according to the first embodiment. The processing in FIG. 3 is controlled by the control circuit 102, for example.

In step S1, the control circuit 102 determines whether or not the operation mode of the imaging apparatus 100 is set to the cooperative shooting mode. The imaging apparatus 100 has two operation modes, for example, a cooperative shooting mode and a normal shooting mode. The cooperative shooting mode is an operation mode in which shooting is performed with communication between the imaging device 100 and the terminal 200 . The normal shooting mode is an operation mode in which shooting is performed by the imaging device 100 alone. Of course, the imaging apparatus 100 may have operation modes other than the cooperative shooting mode and the normal shooting mode. The operation mode is set by the cameraman C operating the operation unit 112, for example. When it is determined in step S1 that the operation mode of the imaging device 100 is not set to the cooperative shooting mode, the process proceeds to step S2. When it is determined in step S1 that the operation mode of the imaging device 100 is set to the cooperative shooting mode, the process proceeds to step S3.

In step S2, the image capturing apparatus 100 performs normal image capturing mode processing. After that, the process moves to step S13. The processing in normal shooting mode will be briefly described. In the normal shooting mode, the control circuit 102 executes the shooting by the capture circuit 104 in response to the user's operation of the operation unit 112 to start shooting. Then, the control circuit 102 performs image processing so that the image obtained by the capture circuit 104 is in a recordable format, and records the image file obtained by the image processing on the recording medium 108 .

In step S<b>3 , the control circuit 102 determines whether or not a communication request signal has been received from the terminal 200 by the communication circuit 114 . When it is determined in step S3 that the communication request signal has not been received from terminal 200, the process proceeds to step S13. When it is determined in step S3 that the communication request signal from terminal 200 has been received, the process proceeds to step S4.

In step S<b>4 , control circuit 102 uses communication circuit 114 to transmit a response signal to terminal 200 .

In step S<b>5 , the control circuit 102 executes imaging by the capture circuit 104 . The imaging in step S<b>5 may be performed in response to the cameraman C's operation of the operation unit 112 to start imaging. In this case, if there is no operation to start shooting for a certain period of time, the process may proceed to step S9. In addition, the control circuit 102 may perform sound collection by the capture circuit 104 as well as image capturing by the capture circuit 104 . In step S6, the control circuit 102 causes the memory 106 to store the image obtained by the capture circuit 104. FIG. In step S<b>7 , the control circuit 102 uses the communication circuit 114 to transmit the image stored in the memory 106 to the terminal 200 . At this time, the control circuit 102 copies the image to be transmitted to the memory 106 . The copies stored in memory 106 may be deleted, starting with the oldest, for example, each time a certain number of images have been transmitted.

In step S8, the control circuit 102 determines whether or not image transmission has failed. Transmission failure includes both actual failure and failure. Specifically, transmission failure includes, for example, a state in which an image cannot be transmitted, and a state in which the terminal 200 does not receive the image correctly even though the image has been transmitted. For example, the control circuit 102 determines that image transmission is not possible when the radio wave intensity of the radio wave from the terminal 200 detected by the communication circuit 114 is equal to or less than a threshold. Further, for example, the control circuit 102 determines that the terminal 200 has not correctly received the image when the communication circuit 114 receives a packet retransmission request from the terminal 200 a predetermined number of times or more. In addition, when communication between the imaging device 100 and the terminal 200 is performed by Wi-Fi communication via an access point, the control circuit 102 detects whether or not the communication circuit 114 is connected to the access point. It may be determined whether or not communication is possible based on whether or not the radio field intensity at the access point is equal to or less than a threshold. Further, when communication between the imaging device 100 and the terminal 200 is performed by Bluetooth communication, the control circuit 102 determines whether the pairing between the imaging device 100 and the terminal 200 by the communication circuit 114 continues. You may judge whether it is in the state where it can do. Thus, the determination in step S8 is not limited to a specific technique. When it is determined in step S8 that communication has failed, the process proceeds to step S9. When it is determined in step S8 that communication has not failed, the process proceeds to step S10.

In step S9, the control circuit 102 performs countermeasure processing for communication failure. Details of the countermeasure processing will be described later. After the countermeasure process ends, the process moves to step S10.

In step S10, the control circuit 102 determines whether or not to end image transmission. For example, when the communication circuit 114 receives an image transmission end instruction from the terminal 200, it is determined to end the image transmission. When it is determined in step S10 that the image transmission is not finished, the process returns to step S5. In this case, control circuitry 102 continues to acquire, store and transmit images. When it is determined in step S10 that the image transmission is finished, the process proceeds to step S11.

In step S<b>11 , the control circuit 102 determines whether or not the communication circuit 114 has received an image retransmission request from the terminal 200 . As will be described later, in the present embodiment, even if the image transmission fails, while the image continues to be displayed on the terminal 200, the image generated by processing the untransmitted image The image is transmitted to terminal 200 . On the other hand, there may be cases where the unsent image itself is required. Therefore, after the terminal 200 finishes displaying the image, it is made possible to transmit the untransmitted image in response to a request from the terminal 200 . Step S11 is a judgment of the presence or absence of this retransmission. When it is determined in step S11 that there is a request to resend the image, the process proceeds to step S12. When it is determined in step S11 that there is no request to resend the image, the process proceeds to step S13.

In step S<b>12 , the control circuit 102 uses the communication circuit 114 to transmit the unsent image requested by the terminal 200 to the terminal 200 . After the image transmission is completed, the process moves to step S13. In step S12, since the image is not displayed in real time on the terminal 200, the transmission of the image from the imaging device 100 may be repeated until successful.

In step S<b>13 , the control circuit 102 determines whether or not to end the operation of the imaging device 100 . For example, when the operation unit 112 of the cameraman C instructs to turn off the imaging device 100 and the operation unit 112 remains in a non-operating state, it is determined that the operation of the imaging device 100 is to be terminated. When it is determined in step S13 that the operation of the imaging device 100 is not to be terminated, the process returns to step S1. In step S<b>13 , when it is determined to end the operation of the imaging device 100 , the control circuit 102 ends the operation of the imaging device 100 .

FIG. 4 is a flowchart showing countermeasure processing. In step S101, imaging by the capture circuit 104 is performed. The imaging in step S<b>101 may be performed in response to an operation by the cameraman C to start imaging through the operation unit 112 . In this case, the process may proceed to step S104 when there is no operation to start shooting for a certain period of time. In step S<b>102 , control circuit 102 causes memory 106 to store the image obtained by capture circuit 104 .

In step S103, the control circuit 102 acquires the unsent image copied to the memory 106 and processes the acquired unsent image. For example, the control circuit 102 arranges the reduced image of the image copied to the memory 106 in step S7 and the reduced image of the image newly stored in the memory 106 in step S102 within the image of one frame. . After that, the process moves to step S104.

In step S104, control circuit 102 determines whether or not communication has been restored. For example, the control circuit 102 determines that communication has been restored when the radio wave intensity of the radio wave from the terminal 200 exceeds a threshold. The determination in step S104 is not limited to a specific technique. When it is determined in step S104 that communication has not recovered, the process returns to step S101. In other words, image acquisition, storage, and processing are repeated until communication is restored. In this repetition, it is also possible that an image that does not change due to processing is not processed, and only an image that changes due to processing is processed. When it is determined in step S104 that communication has recovered, the process proceeds to step S105.

In step S<b>105 , the control circuit 102 uses the communication circuit 114 to transmit to the terminal 200 the image obtained by processing and the information of the untransmitted image. The information of the untransmitted image includes, for example, the untransmitted frame number. The information of the untransmitted image may be any information that can identify the untransmitted image in the terminal 200, and is not limited to the frame number.

In step S106, the control circuit 102 determines whether or not transmission of all images obtained by processing has been completed. When it is determined in step S106 that transmission of all images obtained by processing has not been completed, the process returns to step S101. When it is determined in step S106 that transmission of all images obtained by processing has been completed, the process proceeds to step S107.

In step S107, the control circuit 102 determines whether or not a predetermined time has passed since the transmission of the first image. If it is determined in step S107 that the predetermined time has not elapsed, the process returns to step S101. That is, even when communication is restored, image acquisition, storage, processing, and transmission are repeated until it is determined that communication has stabilized after a predetermined period of time has elapsed. When it is determined in step S107 that the predetermined time has passed, the control circuit 102 terminates the processing of FIG. In this case, the process proceeds to step S9 in FIG. Then, if it is determined in step S9 that the image transmission is not finished, the process returns to step S5. Thereafter, normal image acquisition, storage, and transmission operations are resumed.

FIG. 5 is a flow chart showing an example of the operation of the terminal 200 according to the first embodiment. The processing in FIG. 5 is controlled by the control circuit 202, for example.

In step S201, the control circuit 202 determines whether or not the cooperative application has been activated. When it is determined in step S201 that the cooperative application has not been activated, the process proceeds to step S202. When it is determined in step S201 that the cooperative application has been activated, the process proceeds to step S203.

In step S202, the control circuit 202 performs processing other than when the cooperative application is activated. Other processing includes, for example, e-mail transmission/reception processing and browser start-up processing. After other processing, the processing moves to step S214.

In step S<b>203 , the control circuit 202 uses the communication circuit 212 to transmit a communication request signal to the imaging apparatus 100 . In step S<b>204 , the control circuit 202 determines whether or not the communication circuit 212 has received a response signal from the imaging device 100 . When it is determined in step S204 that no response signal has been received, the process returns to step S203. That is, the transmission of the communication request signal by the communication circuit 212 is repeated until the response signal is received. After transmitting the communication request signal a certain number of times, the control circuit 202 may timeout the process. In this case, the process proceeds to step S214. When it is determined in step S204 that the response signal has been received, the process proceeds to step S205.

In step S205, the control circuit 202 determines whether image reception has failed. For example, the control circuit 202 determines whether or not the image has been received without error for a predetermined period of time. Then, when it is determined that the image has been successfully received within the predetermined time, the control circuit 202 determines that the image reception has not failed. On the other hand, when the control circuit 202 determines that the image could not be received within the predetermined time or that the received image has an error, the control circuit 202 requests the imaging apparatus 100 to resend the image. When the number of requests for retransmission of the image reaches a predetermined number of times or more, it is determined that the reception of the image has failed. When it is determined in step S205 that image reception has not failed, the process proceeds to step S209. When it is determined in step S205 that image reception has failed, the process proceeds to step S206.

In step S206, the control circuit 202 records the most recently received image on the recording medium 206 as an image file. By keeping the latest image received immediately before the communication failure, this latest image can be used in some form as an evidence image immediately before the communication failure.

In step S207, the control circuit 202 determines whether communication has been restored. For example, the control circuit 202 determines that communication has been restored when the radio wave intensity of the radio waves from the imaging device 100 detected by the communication circuit 212 exceeds a threshold. The determination in step S207 is not limited to a specific method. The determination is repeated until it is determined in step S207 that communication has been restored. After a certain number of determinations, the control circuit 202 may timeout the process. In this case, the process proceeds to step S214. When it is determined in step S207 that communication has recovered, the process proceeds to step S208.

In step S<b>208 , the control circuit 202 waits for reception of an image from the imaging device 100 . When an image is received from the imaging device 100 by the communication circuit 212 , the control circuit 202 causes the memory 204 to store the received image. Further, the control circuit 202 causes the memory 204 to store the information of the unsent image received together with the image as the information of its own unreceived image. After that, the process moves to step S209.

In step S209, the control circuit 202 causes the display element 208 to display the received image. Thereby, as shown in FIG. 2A , the user U can check the image acquired by the imaging device 100 on the terminal 200 . Here, immediately after resuming communication, the image processed by the imaging device 100 as described above is transmitted from the imaging device 100 . Also in this case, the control circuit 202 causes the display element 208 to display the image processed by the imaging device 100 .

In step S210, the control circuit 202 determines whether or not to end the display of the image. For example, when the user U operates the operation unit 210 to give an instruction to end the cooperative application, it is determined to end the display of the image. When it is determined in step S210 that the image display is not finished, the process returns to step S205. When it is determined in step S210 that the display of the image is finished, the process proceeds to step S211.

In step S211, since the control circuit 202 has received only the processed digest image and not the original image, it records the information of its own unreceived image on the recording medium 206. FIG. After that, the process moves to step S212. By recording the information of the unreceived image in the recording medium 206, the terminal 200 can transmit the unreceived image to the imaging device 100 as necessary even after the cooperative application is terminated. can be requested. Also, the received image may be recorded as a file. The unreceived image may be recorded as a movie file along with other successfully received images (replaced with frames of the processed image). For example, if something happens when communication is not working well, it is preferable to record images similar to those taken in this way, because there is important evidence in the images that have not been received. In addition, as long as it is evidence, it is possible to improve the reliability and evidence of the data by recording a signal indicating which frame was not received but was later restored. In this way, the system consists of the sending side and the receiving side working together, but there are also important points on the receiving side. That is, in a receiving device that receives images transmitted from an imaging device by wireless communication, the first images that have been continuously transmitted without failure are received, and if there is a failure in communication, the first image is received. The communication method of the image receiving device that receives the information that it was determined that the transmission of the frame was not possible, and receives the image of the frame whose transmission failed after the display after the communication is restored. can also be said to be a devised communication method for receiving the image of the frame whose transmission failed after recovery, and recording it together with the frame whose transmission did not fail as a moving image file. When image transmission/reception fails, there is a possibility that various secondary troubles have occurred, and conversely, image transmission/reception may have failed as a side effect of other troubles. Specifications that make it possible to confirm what happened or record it as evidence are important technologies for things like surveillance cameras.

In step S212, the control circuit 202 determines whether or not an instruction to resend an image that has not been received has been issued. For example, when retransmission of a specific unreceived image is instructed by the user U operating the operation unit 210, it is determined that retransmission of the unreceived image has been instructed. When it is determined in step S212 that retransmission of the unreceived image has been instructed, the process proceeds to step S213. When it is determined in step S212 that retransmission of the unreceived image has not been instructed, the process proceeds to step S214.

In step S<b>213 , the control circuit 202 uses the communication circuit 212 to request the imaging apparatus 100 to resend the unreceived image. Note that the image received after the request for retransmission may be displayed or recorded.

In step S214, the control circuit 202 determines whether or not to end the operation of the terminal 200. FIG. For example, when the operation unit 210 of the user U instructs to turn off the power of the terminal 200, it is determined that the operation of the terminal 200 is finished. When it is determined in step S214 that the operation of terminal 200 is not to be ended, the process returns to step S201. When it is determined in step S214 that the operation of the terminal 200 should be terminated, the control circuit 202 terminates the operation of the terminal 200. FIG.

As described above, the imaging apparatus of this embodiment processes an image acquired while communication fails, and transmits the processed image to the terminal after communication is resumed. This processing includes, for example, processing of arranging reduced images of an image acquired during communication failure and an image acquired immediately after communication is resumed in one frame image. The set of images generated by such processing allows the user of the terminal to check the images captured by the imaging device while the communication is unsuccessful without any communication delay. That is, in this embodiment, when a communication failure occurs due to the occurrence of a communication failure or the like, the number of retransmissions of images is suppressed by allowing some communication failures.

[Modification of First Embodiment]
Modifications of the first embodiment will be described below. In the first embodiment, as an example of processing an image acquired while communication is unsuccessful, an image acquired while communication is unsuccessful and a reduced image of an image acquired immediately after communication is resumed are reduced to 1 The process of arranging in the image of the frame is exemplified. However, the processing is not necessarily limited to arranging the reduced images in one frame image.

For example, the image capturing apparatus 100 selects only the reduced images of the images I1, I2, and I3 that have not been transmitted from among the images that have been acquired as shown in FIG. A group image I6 obtained by this processing and a reduced image I7 of the current unsent image I4 obtained immediately after the communication is resumed are arranged as shown in FIG. 6(b). may be transmitted to the terminal 200 respectively. Then, the terminal 200 may display the combined image I6 and the current image I7 in different display areas of the display element 208, as shown in (c) of FIG. In the display as shown in FIG. 6, the user U can view a summary of the images at the time of communication failure using the combined images, and can also view the current image in real time.

Further, for example, the imaging device 100 may reduce the unsent images I1, I2, and I3 acquired while the communication fails among the images acquired as shown in FIG. 7A. You may process only to generate. At this time, the imaging device 100 may transmit the reduced images I7, I8, and I9 of the untransmitted images at a transmission speed higher than that of normal images, as shown in FIG. 7B. Then, the terminal 200 may sequentially display the reduced images I7, I8, and I9 on the display element 208 as shown in (c) of FIG. Note that when a reduced image is transmitted, the terminal 200 may reproduce the image acquired during communication failure in fast-forward mode or in time-lapse mode. If it is a reduced image, the transmission is completed in a relatively short time, so even if the reduced image is transmitted after the communication is restored, the original display can be restored in a relatively short time.

Further, when images acquired during communication failure have the same image characteristics, the imaging device 100 generates a group image using only some of the unsent images, or uses only some of the unsent images. You may generate|occur|produce the reduced image of only. For example, of the images acquired as shown in FIG. may be arranged in one frame image, and the combined image I10 obtained by this processing may be transmitted to the terminal 200 as shown in FIG. 8(b). Then, the terminal 200 may display the combined image I10 on the display element 208 as shown in (c) of FIG. In addition, the imaging device 100 performs processing only to generate a reduced image of the first image I1 acquired during communication failure among the images acquired as shown in FIG. 9A, The reduced image I11 obtained by this processing may be transmitted to the terminal 200 as shown in FIG. 9(b). Then, the terminal 200 may display the reduced image I11 on the display element 208, as shown in (c) of FIG.

In addition, only when a characteristic change such as a scene change or an object change is detected from the image characteristics of the image acquired during communication failure, the imaging apparatus 100 captures images before and after the change as one frame. It may be aligned with the image, or a reduced image of the image before and after the change may be generated. For example, when a communication failure occurs while acquiring a series of images from when a person, who is an object, enters a room until it leaves the room, the imaging device 100 can generate an image when the person enters the room and an image when the person exits the room. It is also possible to arrange only the images in one frame, or to generate a reduced image of those images. Further, when a communication failure occurs while acquiring images of a series of flow of product manufacturing, the imaging device 100 arranges only images in which process changes occur in one frame image, or arranges those images in one frame. A reduced image of the image may be generated. Furthermore, the characteristics of the image to be sent when communication fails may be set by the user or the like by operating buttons or inputting voice instructions.

Also, the processed image need not necessarily be sent immediately after communication is restored. For example, the image capturing apparatus 100 reduces the unsent images I1, I2, and I3 acquired while the communication fails among the images acquired as shown in FIG. 10A to 1 Process to arrange in the image of the frame. Then, as shown in (b) of FIG. 10, the imaging device 100 may transmit the combined image I5 generated by the processing to the terminal 200 after finishing the imaging. Then, the terminal 200 may display the combined image I5 on the display element 208 as shown in (c) of FIG. Sufficient time for communication can be secured after the end of imaging by the imaging device 100 . Thus, images can be reliably transmitted.

In addition, the imaging device 100 may acquire audio as well as acquiring an image. Audio may also be transmitted together with the transmission of the processed image. The sound associated with each processed image may be transmitted as it is, or may be transmitted after being compressed. As shown in FIG. 2B, with respect to a group image formed by arranging a plurality of reduced images in one frame image, audio is associated with each reduced image. In this case, the terminal 200 causes the display element 208 to display the audio reproduction mark M together with the combined image, as shown in FIG. 11A, for example. When the audio reproduction mark M is selected, the control circuit 202 of the terminal 200 reproduces the selected audio reproduction mark M and the corresponding audio.

In addition, the imaging device 100 may convert the acquired voice into characters using a well-known voice recognition technique. In this case, the imaging device 100 may transmit character data to the terminal 200 together with the combined image. In this case, the terminal 200 may cause the display element 208 to display, as a telop T, characters representing voice together with the combined image, as shown in FIG. 11B, for example. The telop T need not be generated for all sounds. For example, the imaging apparatus 100 detects a characteristic change such as a change in scene or a change in an object from the image characteristics of an image acquired during communication failure, or only when characteristic sound is generated. may be generated. Furthermore, the terminal 200 may be configured to set features of an image or sound for which a telop is to be generated. If further audio corresponding to each image can be acquired, the control circuit causes the transmission circuit to transmit the processed image in which the audio corresponding to each of the images that could not be transmitted is converted into characters after recovery from the communication failure. It is possible to devise a control method. Of course, this processing may be performed so that the device on the receiving side superimposes and displays. In this case, it is sufficient to receive the voice or a signal obtained by converting the voice into text and process it at the time of display.

[Second embodiment]
Next, a second embodiment will be described. FIG. 12 is a diagram showing an application example of the communication system 1 in the second embodiment. The example of FIG. 12 shows an example of application to a factory or the like. In other words, the worker W is doing work such as inspection of equipment. A worker W wears a wearable terminal 300 that is the imaging device 100 . The terminal 300 acquires an image in the direction of the worker W's face. The image acquired by the imaging device 100 is sent to the terminal 200 of the operator O at a remote location.

FIG. 13A is a diagram showing a schematic configuration of terminal 300. As shown in FIG. The terminal 300 is, for example, a glasses-type terminal. An example terminal 300 has a spectacle-like external shape that is worn on one ear of the worker W, and has one temple (vine) 302 . Here, assuming that the tip side of the temple 302 is the side of the modulus and the proximal side is the side of the frame, the tip side of the temple 302, more specifically, when the terminal 300 is worn, it is positioned approximately at the ear of the worker W. A speaker 304 is provided at the position. Speaker 304 emits various sounds. Note that the speaker 304 may further have a vibration generator made up of a piezoelectric element or the like. In this case, the speaker 304 vibrates near the ears of the worker W as needed.

A circuit housing portion 306 extends from the proximal end of temple 302 . The circuit housing section 306 is provided with the aforementioned control circuit 102 , capture circuit 104 , memory 106 , recording medium 108 , display element 110 , operation section 112 , and communication circuit 114 . The objective optical system 104a of the capture circuit 104 is exposed on the front surface of the circuit housing portion 306, that is, the surface of the circuit housing portion 306 positioned in the line of sight of the operator when the terminal 300 is attached. Further, the display panel 110a of the display element 110 is exposed on the side surface of the circuit housing portion 306, that is, the surface of the circuit housing portion 306 facing the face of the operator when the terminal 300 is worn.

Further, a light guide element 308 is arranged so as to face the display panel 110a. The light guide element 308 is composed of, for example, a prism, and guides the display light emitted from the display panel 110a to the eye E of the worker W wearing the terminal 300 . This light guide element 308 has a width that covers about half of the eyes of the operator as shown in FIG. 13B when the terminal is attached. With such a configuration, the operator W can obtain a clear field of view by directing his/her line of sight to the portion not hidden by the light guide element 308, while directing his/her line of sight to the light guide element 308 allows the operator W to view the display panel 110a. You can see the image displayed in

A microphone 104 b of the capture circuit 104 is attached to the light guide element 308 . The voice of the worker W is acquired by this microphone 104b.

The terminal 200 is an external display device having a display element such as a smart phone, tablet terminal, or personal computer (PC). The terminal 200 displays and stores images sent from the imaging device 100 . Terminal 200 has control circuit 202, memory 204, recording medium 206, display element 208, operation unit 210, and communication circuit 212 shown in FIG. Also, the terminal 200 may have a configuration other than that shown in FIG. For example, terminal 200 may have a capture circuit.

The operation of the communication system 1 according to the second embodiment will be described in more detail below. 14A and 14B are flowcharts showing an example of the operation of terminal 300 in the second embodiment. The processes of FIGS. 14A and 14B are controlled by the control circuit 102, for example. In FIGS. 14A and 14B, descriptions of the processes common to those in FIG. 3 will be omitted as appropriate.

In step S<b>401 , the control circuit 102 determines whether or not the communication circuit 114 has received a communication request signal from the terminal 200 . When it is determined in step S401 that the communication request signal has not been received from the terminal 200, the process proceeds to S416. When it is determined in step S401 that the communication request signal from terminal 200 has been received, the process proceeds to step S402.

In step S<b>402 , control circuit 102 uses communication circuit 114 to transmit a response signal to terminal 200 .

In step S403, the control circuit 102 determines whether or not the operation mode is set to the image transmission mode. The terminal 300 has an image transmission mode and a guide mode as operation modes. The image transmission mode is a mode for transmitting an image acquired by the capture circuit 104 to the terminal 200 . The image transmitted to terminal 200 is displayed on display element 208 of terminal 200 . On the other hand, the guide mode is a mode in which a guide for worker W is displayed on display element 110 of terminal 300 . The contents of the guide can be changed variously according to the contents of the work. When it is determined in step S403 that the operation mode is not set to the image transmission mode, the process proceeds to step S404. When it is determined in step S403 that the operation mode has been set to the image transmission mode, the process proceeds to step S405.

In step S404, the control circuit 102 causes the display element 110 to display a guide corresponding to the current situation. After that, the process moves to step S416. As described above, the display light based on the image displayed on the display element 110 is emitted from the display panel 110 a and enters the light guide element 308 . The light guide element 308 guides the incident display light to the eye E of the worker W. As shown in FIG. The worker W can see the guide by directing the line of sight to the light guide element 308 .

In step S405, the control circuit 102 causes the capture circuit 104 to perform imaging. Further, the control circuit 102 may also perform sound pickup by the microphone 104 b of the capture circuit 104 as well as the image pickup by the capture circuit 104 . In step S406, the control circuit 102 causes the memory 106 to store the image obtained by the capture circuit 104. FIG. In step S<b>407 , the control circuit 102 uses the communication circuit 114 to transmit the image stored in the memory 106 to the terminal 200 . At this time, the control circuit 102 copies the image to be transmitted to the memory 106 . The copies stored in memory 106 may be deleted, starting with the oldest, for example, each time a certain number of images have been transmitted. Further, in step S407, the control circuit 102 may also transmit voice to the terminal 200. FIG.

In step S408, the control circuit 102 determines whether or not image transmission has failed. The determination as to whether or not image transmission has failed may be performed in the same manner as in step S8 of the first embodiment. When it is determined in step S408 that communication has failed, the process proceeds to step S409. When it is determined in step S408 that communication has not failed, the process proceeds to step S411. Incidentally, when the communication fails, the operator W may be notified of the communication failure.

In step S409, the control circuit 102 determines whether or not a predetermined time has passed since the communication failed. This predetermined time is a time during which there is no effect even if the display on the terminal 200 is interrupted. If the image changes in a short time, the predetermined time is set short. For example, the predetermined time is set short when the object to be imaged by the capture circuit 104 moves quickly or when the scene to be imaged changes in a short period of time. Conversely, when the movement of the object is slow or when the scene to be imaged changes little, the predetermined time is set longer. Also, the predetermined time may be shortened when the terminal 300 moves quickly instead of the movement of the object. Furthermore, the predetermined time may be set by a user such as the worker W. When it is determined in step S409 that the predetermined time has not elapsed since the communication failed, the process returns to step S408. In other words, when a short-time failure or the like is considered to have no effect on the display, countermeasure processing is not performed. When it is determined in step S409 that the predetermined time has passed since communication failed, the process proceeds to step S410.

In step S410, the control circuit 102 performs countermeasure processing for communication failure. The countermeasure processing may be the same as that of the first embodiment, so the explanation is omitted. After the countermeasure process ends, the process moves to step S411.

In step S<b>411 , control circuit 102 determines whether communication circuit 114 has received an instruction from terminal 300 . When it is determined in step S411 that an instruction from terminal 300 has been received, the process proceeds to step S412. When it is determined in step S411 that an instruction from terminal 300 has not been received, the process proceeds to step S413.

In step S<b>412 , control circuit 102 reproduces the instruction from terminal 200 . When voice is received from terminal 200 , control circuit 102 reproduces the received voice from speaker 304 . Thereby, the worker W can hear the voice instruction from the operator O. Also, when an image is received from the terminal 200 , the control circuit 102 reproduces the received image on the display element 110 . Thereby, the operator W can confirm, through the light guide element 308, the instruction by the operator O reproduced on the display panel 110a. In addition, when there is an instruction by voice or image, the control circuit 102 may cause the worker W to recognize the instruction by generating vibration from the speaker 304 as necessary.

In step S413, the control circuit 102 determines whether or not to end image transmission. For example, when the communication circuit 114 receives an image transmission end instruction from the terminal 200, it is determined to end the image transmission. When it is determined in step S413 that image transmission is not to end, the process returns to step S405. In this case, control circuitry 102 continues to acquire, store and transmit images. When it is determined in step S413 that the image transmission is finished, the process proceeds to step S414.

In step S<b>414 , the control circuit 102 determines whether or not the communication circuit 114 has received an image retransmission request from the terminal 200 . When it is determined in step S414 that there is a request to resend the image, the process proceeds to step S415. When it is determined in step S414 that there is no request for image retransmission, the process proceeds to step S416.

In step S<b>415 , the control circuit 102 uses the communication circuit 114 to transmit the unsent image requested by the terminal 200 to the terminal 200 . After the image transmission is completed, the process proceeds to step S416. In step S415, since no real-time image is displayed on the terminal 200, transmission of the image from the imaging device 100 may be repeated until successful.

In step S416, the control circuit 102 determines whether or not to end the operation of the terminal 300. FIG. For example, when the operation unit 112 of the worker W instructs to turn off the power of the terminal 300 and the operation unit 112 remains in a non-operating state, it is determined to end the operation of the terminal 300 . When it is determined in step S416 that the operation of terminal 300 is not to end, the process returns to step S401. When it is determined in step S<b>416 that the operation of terminal 300 should be terminated, control circuit 102 terminates the operation of terminal 300 .

15A and 15B are flowcharts showing an example of the operation of terminal 200 in the second embodiment. The processes of FIGS. 15A and 15B are controlled by the control circuit 202, for example.

In step S501, the control circuit 202 determines whether or not the cooperative application has been activated. When it is determined in step S501 that the cooperative application has not been activated, the process proceeds to step S502. When it is determined in step S501 that the cooperative application has been activated, the process proceeds to step S503.

In step S502, the control circuit 202 performs processing other than when the cooperative application is activated. Other processing includes, for example, e-mail transmission/reception processing and browser start-up processing. After other processing, the processing moves to step S516.

In step S<b>503 , the control circuit 202 uses the communication circuit 212 to transmit a communication request signal to the terminal 300 . In step S<b>504 , the control circuit 202 determines whether or not the communication circuit 212 has received a response signal from the terminal 300 . When it is determined in step S504 that no response signal has been received, the process returns to step S503. In other words, transmission of the communication request signal is repeated until the response signal is received. After the communication circuit 212 has transmitted the communication request signal a certain number of times, the control circuit 202 may timeout the process. In this case, the process moves to step S516. When it is determined in step S504 that the response signal has been received, the process proceeds to step S505.

In step S505, the control circuit 202 determines whether image reception has failed. Determination as to whether image reception has failed may be performed in the same manner as in step S205 of the first embodiment. When it is determined in step S505 that image reception has not failed, the process proceeds to step S509. When it is determined in step S505 that image reception has failed, the process proceeds to step S506.

In step S506, the control circuit 202 records the most recently received image on the recording medium 206 as an image file.

In step S507, the control circuit 202 determines whether communication has been restored. The determination as to whether or not communication has been restored may be the same as in step S207 of the first embodiment. The determination is repeated until it is determined in step S507 that communication has been restored. After a certain number of determinations, the control circuit 202 may timeout the process. In this case, the process moves to step S516. When it is determined in step S507 that communication has recovered, the process proceeds to step S508.

In step S<b>508 , the control circuit 202 waits for the communication circuit 212 to receive an image from the imaging device 100 . When an image is received from imaging device 100 , control circuit 202 causes memory 204 to store the received image. Further, the control circuit 202 causes the memory 204 to store the information of the unsent image received together with the image as the information of its own unreceived image. After that, the process moves to step S509.

In step S509, the control circuit 202 causes the display element 208 to display the received image. Here, in the second embodiment, as in the first embodiment, the image processed by the imaging device 100 as described above is transmitted from the imaging device 100 immediately after resuming communication. Also in this case, the control circuit 202 causes the display element 208 to display the image processed in the terminal 300 .

In step S510, the control circuit 202 determines whether or not an instruction to the terminal 300 has been input from the operator O. This instruction may be an audio instruction or an image instruction. Also, this instruction may be an instruction by operating a specific button. When it is determined in step S510 that the operator O has input an instruction to the terminal 300, the process proceeds to step S511. When it is determined in step S510 that the operator O has not input an instruction to the terminal 300, the process proceeds to step S512.

In step S<b>511 , the control circuit 202 uses the communication circuit 212 to transmit an instruction to the terminal 300 .

In step S512, the control circuit 202 determines whether or not to end the display of the image. For example, when the user U operates the operation unit 210 to give an instruction to end the cooperative application, it is determined to end the display of the image. When it is determined in step S512 that the image display is not to end, the process returns to step S505. When it is determined in step S512 that the display of the image is finished, the process proceeds to step S513.

In step S<b>513 , the control circuit 202 records information of its own unreceived image on the recording medium 206 . After that, the process moves to step S514. By recording the information of the unreceived image in the recording medium 206, the terminal 200 can transmit the unreceived image to the imaging device 100 as necessary even after the cooperative application is terminated. can be requested.

In step S514, the control circuit 202 determines whether or not an instruction to retransmit an image that has not been received has been issued. For example, when retransmission of a specific unreceived image is instructed by operator O's operation of the operation unit 210, it is determined that retransmission of the unreceived image has been instructed. When it is determined in step S514 that retransmission of the unreceived image has been instructed, the process proceeds to step S515. When it is determined in step S514 that retransmission of the unreceived image has not been instructed, the process proceeds to step S516.

In step S<b>515 , the control circuit 202 uses the communication circuit 212 to request the imaging apparatus 100 to resend the unreceived image. Note that the image received after the request for retransmission may be displayed or recorded.

In step S516, the control circuit 202 determines whether or not to end the operation of the terminal 200. FIG. For example, when the operation unit 210 of the user U instructs to turn off the power of the terminal 200, it is determined that the operation of the terminal 200 is finished. When it is determined in step S516 that the operation of terminal 200 is not to be ended, the process returns to step S501. When it is determined in step S516 to end the operation of the terminal 200, the control circuit 202 ends the operation of the terminal 200. FIG.

As described above, the imaging apparatus of this embodiment processes an image acquired while communication fails, and transmits the processed image to the terminal after communication is resumed. With such processing, the user of the terminal can check the image acquired by the imaging device while the communication is unsuccessful without any communication delay. Further, in the present embodiment, countermeasure processing is not performed until a predetermined period of time has elapsed after the communication has failed to such an extent that the display on the external display device is not affected. As a result, the processing load on the imaging device 100 can be reduced.

Although the present invention has been described above based on the embodiments, the present invention is not limited to the above-described embodiments, and various modifications and applications are of course possible within the scope of the present invention. The technology of the present embodiment is particularly suitable for situations where real-time confirmation of an image acquired at a remote location is required. Therefore, the technique of this embodiment can also be used for security purposes.

In addition, in the explanation of each of the operation flowcharts described above, the operations are described using "first", "next", etc. for the sake of convenience, but it does not mean that it is essential to perform the operations in this order. Absent.

Further, each process according to the above-described embodiment can also be stored as a program that can be executed by the control circuit 102, which is a computer. In addition, it can be distributed by being stored in a storage medium of an external storage device such as a magnetic disk, an optical disk, or a semiconductor memory. The control circuit 102 reads the program stored in the storage medium of the external storage device, and the operation is controlled by the read program, thereby executing the above-described processing.

In the embodiments, parts described as "parts" (sections or units) may be configured by combining a dedicated circuit or a plurality of general-purpose circuits, and if necessary, according to pre-programmed software It may be configured by combining a microcomputer that operates, a processor such as a CPU, or a sequencer such as an FPGA. Also, it is possible to design such that part or all of the control is taken over by an external device, in which case a wired or wireless communication circuit intervenes. Communication may be performed by Bluetooth communication, Wi-Fi communication, telephone line, or the like, and may be performed by USB or the like. A dedicated circuit, a general-purpose circuit, and a control unit may be integrated into an ASIC.

Reference Signs List 1 communication system 100 imaging device 102 control circuit 104 capture circuit 106 memory 108 recording medium 110 display element 112 operation unit 114 communication circuit 200 terminal 202 control circuit 204 memory 206 recording medium 208 Display element, 210 operation unit, 212 communication circuit, 300 terminal.

Claims (12)

a capture circuit that acquires a plurality of first images by imaging;
a transmission circuit for continuously transmitting the first image to an external display device;
Determining whether transmission of the first image of one frame or more by the transmission circuit has failed;
processing the first image that has not been transmitted when it is determined that transmission of the first image has failed;
after communication is restored, controlling the transmission circuit to transmit the second image obtained by the processing;
a control circuit configured to
and
The number of the unsent first images is two or more,
The control circuit is
processing to generate a group image that is the second image by arranging the untransmitted first images;
transmitting the set of images after the communication is restored;
Imaging device. The control circuit controls the transmission circuit to transmit the second image after communication is restored and after the capture circuit finishes the imaging.
The imaging device according to claim 1 . The control circuit controls the transmission circuit to retransmit the first image requested from the external display device among the untransmitted first images.
The imaging device according to claim 1 . The control circuit performs the processing when a period during which transmission of the first image fails is longer than a predetermined period.
The imaging device according to claim 1 . the capture circuit further acquires audio corresponding to each of the first images;
the control circuitry controls the transmission circuitry to also transmit the audio corresponding to each of the second images after the communication is restored;
The imaging device according to claim 1 . the capture circuit further acquires audio corresponding to each of the first images;
the control circuit, after the communication is restored, controls the transmission circuit to transcribe the audio corresponding to each of the second images and transmit with the second images;
The imaging device according to claim 1 . a capture circuit that acquires a plurality of first images by imaging;
a transmission circuit for continuously transmitting the first image to an external display device;
Determining whether transmission of the first image of one frame or more by the transmission circuit has failed;
processing the first image that has not been transmitted when it is determined that transmission of the first image has failed;
after communication is restored, controlling the transmission circuit to transmit the second image obtained by the processing;
a control circuit configured to
and
The control circuit is
processing to generate a reduced image that is the second image by reducing the untransmitted first image;
After the communication is restored, the transmission circuit is controlled so as to transmit the reduced images at a transmission speed higher than a transmission speed when the first images are continuously transmitted.
Imaging device. The control circuit controls the transmission circuit to transmit the second image after communication is restored and the imaging by the capture circuit is finished.
The imaging device according to claim 7. The number of the unsent first images is two or more,
The control circuitry controls the transmission circuitry to retransmit the first image requested from the external display device among the first images not yet transmitted.
The imaging device according to claim 7. The control circuit performs the processing when a period during which transmission of the first image fails is longer than a predetermined period.
The imaging device according to claim 7. the capture circuit further acquires audio corresponding to each of the first images;
the control circuitry controls the transmission circuitry to also transmit the audio corresponding to each of the second images after the communication is restored;
The imaging device according to claim 7. the capture circuit further acquires audio corresponding to each of the first images;
the control circuit, after the communication is restored, controls the transmission circuit to transcribe the audio corresponding to each of the second images and transmit with the second images;
The imaging device according to claim 7.

Images