JP2013255749A - Image data communication method of endoscope system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image data communication method reducing a ratio wherein a frame defect occurs and allowing the communication of image data, in an endoscope system for communicating the image data via a network.SOLUTION: An image data communication method of an endoscope system includes steps of: dividing image data into thinned-out extraction image data and incidental image data by a transmission image thinning-out division means; converting each piece of the thinned-out extraction image data and the incidental image data into a packet having a signal format transmitted to a reception device by a transmission image packet conversion means; transmitting the thinned-out extraction image packet or the incidental image packet selected according to a communication situation of a communication network by a packet selection transmission means; receiving the transmission packet by a packet reception means; and generating combination image data wherein the thinned-out extraction image data and the incidental image data included in the transmission packet capable of being normally received are combined by a data selection combination means.

Description

  The present invention relates to an image data communication method in an endoscope system that performs image processing using a server or the like connected to a network environment.

  Conventionally, as a countermeasure for a communication error in a technology for transmitting and receiving data via a network, when a data receiving side detects a communication error, the receiving side outputs a data retransmission request signal to the transmitting side, and the transmitting side transmits the same data again. Sending is done. Thus, even when a communication error occurs, data transmission / reception can be reliably performed by performing data transmission / reception a plurality of times.

  In recent years, for example, an endoscope system that communicates photographed image data via a network, such as the endoscope apparatus disclosed in Patent Document 1, is increasing. In communication of image data in the endoscope apparatus, data is transmitted according to the communication state.

JP 2003-88497 A

  By the way, in an endoscope system, a moving image may be taken in order to observe the state of a subject. The video image is composed of a plurality of frame images that need to be processed at a specified period (frame period), and each frame image is generated from corresponding one frame of image data. The When communicating the image data of each frame composing the moving image, if the network communication line is in a poor state and the above-mentioned communication error countermeasure processing causes frequent image data retransmission requests, it is necessary for observation. There is a high possibility that transmission of image data of each frame is not completed within the frame period. If transmission of any image data is not in time for the end timing of the corresponding frame period, that is, if transmission of image data is not completed, an image of a frame that has not been transmitted when displaying a moving image is displayed. There is a problem that the display of data is lost (frame loss), which hinders observation using an endoscope system.

  Here, the operation when data is retransmitted due to a communication error in the conventional data communication method will be described. FIG. 11 is a diagram schematically showing an example of communication timing in the conventional data communication method. In FIG. 11, for ease of explanation, all image data for one frame composed of a plurality of communication packets is shown as one image data.

  All the image data in each frame is transmitted within each frame period from the transmission side by the data transmission line. FIG. 11 shows a case where the image data A is transmitted from the transmission side and all the image data A is received by the reception side without any problem in the first frame period. As a result, the image data A can be image-processed in the next frame period, and the image of the image data A can be output as the image of the first frame.

  FIG. 11 shows a case where a communication error occurs in a part of the image data B transmitted from the transmission side in the second frame period due to the influence of the communication line of the network. In general, in communication of image data of each frame constituting a moving image, a request for retransmission of all image data of a frame in which a communication error has occurred is made based on a result of determining a communication error. In FIG. 11, since a communication error has occurred during reception of the image data B, a retransmission request signal for the image data B output by the reception side is transmitted to the transmission side via the retransmission request line. When the transmission side receives the retransmission request signal from the reception side, the transmission side transmits again the same requested image data B (image data B2 in FIG. 11) through the data transmission line. Thereby, as shown in FIG. 11, the image data B2 can be reliably transmitted.

  However, as can be seen from FIG. 11, the reception of the image data B2 is not in time for the end timing of the second frame period, and the period during which the image data B is received spans the third frame period. I'm stuck. Therefore, communication of the image data C cannot be performed in the third frame cycle, and image processing of the image data C cannot be performed in the next frame cycle. As a result, the image of the image data C cannot be output as an image of the third frame, and the image of the image data C is lost in the display of the moving image, which hinders observation in the endoscope system. End up.

  The present invention has been made based on the above problem recognition, and in an endoscope system that communicates image data via a network, reduces the rate at which frame loss occurs due to the influence of the state of the communication line of the network. An object of the present invention is to provide an image data communication method capable of communicating image data.

  In order to solve the above problems, an image data communication method of an endoscope system according to the present invention includes a scope that outputs image data of a photographed subject as original image data, and a display device that displays a video of the input image data. And an external image processing apparatus provided with an image processing means for outputting processed image data after performing image processing on input original image data via a communication network. The endoscope device transmits the original image data input from the scope to the external image processing device via the communication network, and the external image processing device receives the original image data received by the endoscope device. The processed image data subjected to image processing is transmitted to the endoscopic device via the communication network, and the endoscopic device receives the processed image data received. In the endoscope system that outputs the data to the display device, either the endoscope device or the external image processing device is used as a transmission device, and either the endoscope device or the external image processing device is used as the other device. An image data communication method for an endoscope system in which each image data is communicated between the transmission device and the reception device via the communication network when the reception device is used, and the transmission device includes the image data communication method. The transmitted image decimation and division means is effective for improving the image quality of the image data to be transmitted, the decimation extracted image data important for constructing the image by the image data, and the image based on the decimation extracted image data. The transmission image decimation and division step for dividing the image into auxiliary image data and the transmission image packet conversion means provided in the transmission device, the decimation process. A transmission image packet converting step for converting each of the image data and the accompanying image data into a thinned-out extracted image packet and an accompanying image packet which are packets in a signal format for transmission to the receiving device; The packet selection / transmission means selects the thinned-out extracted image packet or the incidental image packet according to the communication status of the communication network, and transmits the selected thinned-out extracted image packet or the transmission packet including the incidental image packet. Packet selecting and transmitting step, packet receiving means provided in the receiving device, packet receiving step for receiving the transmission packet transmitted from the transmitting device, and data selecting and combining means provided in the receiving device, In the receive packet step The transmission packet that can be normally received is selected, the thinned extracted image data and the auxiliary image data included in the selected transmission packet are extracted, and the extracted thinned extracted image data and the auxiliary image are extracted. A data selecting and combining step for generating combined image data similar to the image data before being divided by the transmission image thinning and dividing means included in the transmission device by combining the data, To do.

  Further, in the transmission image thinning and dividing step of the present invention, the transmission image thinning and dividing means thins out and extracts pixel data included in the image data to be transmitted, and the thinning and extraction extracts the pixel data. Image data is used, and the data of the pixels remaining without being thinned out is used as the incidental image data.

  Further, the transmission image thinning and dividing means of the present invention is characterized in that the pixel data is extracted by being thinned at equal intervals.

  Further, the transmission image thinning and dividing means of the present invention is characterized in that only the pixel data of a specific color is thinned and extracted.

  Further, the transmission image thinning and dividing means of the present invention is characterized in that the pixel data is thinned and extracted while maintaining the color ratio of each pixel included in the image data to be transmitted. .

  Further, in the transmission image decimation and division step of the present invention, the transmission image decimation / division means decimates upper bits of a predetermined number of bits in a digital signal representing the size of pixel data included in the image data to be transmitted. The pixel data of the number of bits extracted and extracted by being thinned out is used as the thinned-out extracted image data, and the data of the pixel of the number of bits remaining without being thinned out is used as the auxiliary image data.

  Further, the image data communication method of the endoscope system according to the present invention is such that when the endoscope apparatus is a transmission apparatus and the external image processing apparatus is a reception apparatus, the original image format conversion means provided in the transmission apparatus, An original image format conversion step of converting the format of the original image data input from the scope into a different format, wherein the transmission image decimation / division means in the transmission image decimation / division step has a format determined by the original image format conversion step. The converted original image data is divided into the thinned extracted image data and the incidental image data as the image data to be transmitted.

  Further, in the original image format conversion step of the present invention, the original image format conversion means converts the original image data into frequency space data, and in the transmission image decimation division step, the transmission image decimation division means transmits the image to be transmitted. Of the data in the frequency space included in the data, the data of the predetermined low frequency component is thinned and extracted, and the data of the low frequency component extracted by the thinning is used as the thinned extracted image data, and remains without being thinned. High frequency component data is used as the incidental image data.

  Further, in the original image format conversion step of the present invention, the original image format conversion means converts the original image data into data of a format of luminance and color difference, and in the transmission image decimation and division step, the transmission image decimation and division means includes: A predetermined number of bits of luminance data in a digital signal representing the magnitude of luminance included in the image data to be transmitted and a smaller number of bits than the number of bits of the luminance data in the digital signal representing the magnitude of a color difference The luminance data of the number of bits and the color difference data extracted by thinning out are extracted as the thinned-out extracted image data, and the luminance data and the color difference data of the number of bits remaining without being thinned out are added to the auxiliary data. It is characterized by image data.

  Further, in the packet selective transmission step of the present invention, the packet selective transmission means transmits the transmission packet including the thinned extracted image packet a plurality of times within a transmission cycle of the transmission packet in the communication network, and the auxiliary image packet The transmission packet including the message is transmitted once.

  Further, the packet selection / transmission means of the present invention is characterized in that the transmission packet of the number of transmissions is transmitted using the same communication line in the communication network.

  Further, the packet selective transmission means of the present invention uses the plurality of communication lines in the communication network to transmit the transmission packet including the thinned extracted image packet of the number of transmissions and the transmission packet including the incidental image packet. Are transmitted.

  Further, the packet selection transmission means of the present invention transmits the transmission packet including the thinned extracted image packet of the number of transmissions in parallel using all of a plurality of communication lines in the communication network, and the auxiliary image The transmission packet including the packet is transmitted using any one of a plurality of communication lines in the communication network.

  In the image data communication method of the endoscope system according to the present invention, the communication error determination means provided in the receiving device determines whether or not the transmission packet received in the receiving packet reception step has a communication error. A communication error determination step, wherein the data selection / combination means includes the transmission packet including the thinned-out extracted image packet based on the communication error determination result determined in the communication error determination step. It is determined whether to combine the auxiliary image data extracted from the transmission packet including the auxiliary image packet with the combined image data generated from the thinned extracted image data extracted from the image.

  In addition, the data selection / combining means of the present invention, when the number of the transmission packets including the incidental image packet determined to have a communication error in the communication error determination step is one in the same transmission cycle, The combined image data is generated by combining only the thinned extracted image data extracted from the transmission packet including the thinned extracted image packet received within a transmission cycle.

  Further, the data selection / combining means of the present invention extracts only the transmission packet including the incidental image packet determined to have no communication error in the communication error determination step from the transmission packet including the thinned extraction image packet. The combined image data combined with the combined image data generated with the thinned extracted image data is generated.

  Further, the image data communication method of the endoscope system according to the present invention includes the transmission including the thinned extracted image packet that is determined to have a communication error in the communication error determination step by a communication result transmission unit provided in the reception device. A communication result transmission step for transmitting a packet retransmission request, and a communication result receiving means provided in the transmission apparatus instruct to retransmit the transmission packet including the thinned-out extracted image packet requested for retransmission in the communication result transmission step. A communication result receiving step, wherein the packet selective transmission step retransmits the transmission packet including the thinned-out extracted image packet instructed by the communication result receiving step.

  The image data communication method of the endoscope system according to the present invention includes a transmission packet in the communication network based on a result of determining a communication error in the communication error determination step by a communication result analyzing unit provided in the receiving device. The communication result analyzing step for analyzing the timing at which a communication error occurs within the transmission period of the communication information, and the information on the timing at which the communication error analyzed in the communication result analyzing step is generated by the communication result transmitting means provided in the receiving device. The communication result transmitting step for transmitting, and the transmission timing adjusting means provided in the transmitting device, based on the information on the timing at which the communication error transmitted in the communication result transmitting step occurs, including the thinned extracted image packet Adjust the transmission timing of transmission packets Further comprising transmitting the timing adjustment step, the that, the packet selection transmission step, at the timing adjusted by the transmission timing adjusting step, transmitting the transmission packet including the thinned extracted image packets, and wherein the.

  The image data communication method of the endoscope system according to the present invention is a treatment instrument control information acquisition means provided in the transmission device when the endoscope device is a transmission device and the external image processing device is a reception device. The treatment instrument control information is obtained by a treatment instrument control information acquisition step for acquiring control signal information when driving the treatment instrument connected to the endoscope apparatus, and the transmission timing adjustment means provided in the transmission apparatus. A transmission timing adjustment step of adjusting a timing of transmitting the transmission packet including the thinned-out extracted image packet based on the information of the control signal acquired in the acquisition step, wherein the packet selection transmission step includes the transmission The transmission packet including the thinned extracted image packet at the timing adjusted by the timing adjustment step. Transmitting the, characterized in that.

  According to the present invention, in an endoscope system that communicates image data via a network, an image that can communicate image data while reducing the rate at which frame loss occurs due to the influence of the state of the communication line of the network. The effect that a data communication method can be provided is obtained.

It is the block diagram which showed an example of schematic structure of the endoscope system in the 1st Embodiment of this invention. It is the figure which showed typically an example of the communication timing in the endoscope system of the 1st embodiment. It is the block diagram which showed an example of schematic structure of the endoscope system in the 2nd Embodiment of this invention. It is the block diagram which showed an example of schematic structure of the endoscope system in the 3rd Embodiment of this invention. It is the figure which showed typically an example of the communication timing in the endoscope system of the 3rd embodiment. It is the figure which showed typically another example of the communication timing in the endoscope system of the 3rd embodiment. It is the figure which showed typically another example of the communication timing in the endoscope system of the 3rd embodiment. It is the block diagram which showed an example of schematic structure of the endoscope system in the 4th Embodiment of this invention. It is the block diagram which showed an example of schematic structure of the endoscope system in the 5th Embodiment of this invention. It is the block diagram which showed an example of schematic structure of the endoscope system in the 6th Embodiment of this invention. It is the figure which showed typically an example of the communication timing in the conventional data communication method.

<First Embodiment>
Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram illustrating an example of a schematic configuration of the endoscope system according to the first embodiment. An endoscope system 100 illustrated in FIG. 1 is a system including a scope 1, an endoscope apparatus 2, an external image processing apparatus 3, and a display apparatus 4.

  The scope 1 includes a solid-state imaging device that photoelectrically converts and outputs an optical image of a subject, and sequentially captures image data of the subject (hereinafter referred to as “original image data”) taken for each frame period of the moving image for each frame. Output to the endoscope apparatus 2.

  The endoscope apparatus 2 converts the original image data input from the scope 1 into a signal format (format) that can be processed by the external image processing apparatus 3, and transmits it to the external image processing apparatus 3 via a network. . The format conversion of the original image data by the endoscope apparatus 2 is performed for each frame input from the scope 1, and the original image data after the format conversion is sequentially transmitted to the external image processing apparatus 3 for each frame. .

  The external image processing device 3 performs image processing for displaying on the display device 4 on the original image data after format conversion transmitted from the endoscope device 2 via the network, and after image processing. The image data (hereinafter referred to as “processed image data”) is transmitted to the endoscope apparatus 2 via the network. Note that image processing by the external image processing device 3 is performed for each frame input from the endoscope device 2, and processed image data is sequentially transmitted to the endoscope device 2 for each frame.

  In addition, the endoscope apparatus 2 converts the processed image data of each frame transmitted from the external image processing apparatus 3 via the network into the image data (hereinafter, referred to as the image data of each frame constituting the video (image) of the moving image). As “display image data”), it is sequentially output to the display device 4 for each frame period of the moving image.

  The display device 4 includes a monitor such as an LCD (Liquid Crystal Display), and displays the display image data of each frame input from the endoscope device 2 as a video image.

  In the endoscope system 100, the endoscope apparatus 2 operates as a transmission apparatus when transmitting original image data captured by the scope 1 to the external image processing apparatus 3, and the processed image data output to the display apparatus 4 is output to the external image. When receiving from the processing device 3, it operates as a receiving device. In the endoscope system 100, the external image processing device 3 operates as a receiving device when receiving the original image data captured by the scope 1 from the endoscope device 2, and outputs the processed image data to be output to the display device 4. When transmitting to the endoscope apparatus 2, it operates as a transmitting apparatus.

  The endoscope apparatus 2 includes a transmission image thinning and dividing unit 2c, a transmission image packet conversion unit 2d, a packet selection transmission unit 2r, a communication result reception unit 2u, a packet reception unit 2s, a data selection combination unit 2g, Communication error determination means 2e and communication result transmission means 2h are provided. The endoscope apparatus 2 operates as a transmission apparatus by the configuration of the transmission image thinning and dividing unit 2c, the transmission image packet conversion unit 2d, the packet selection transmission unit 2r, and the communication result reception unit 2u. Further, the endoscope apparatus 2 operates as a receiving apparatus by the configuration of the packet receiving unit 2s, the data selective combining unit 2g, the communication error determining unit 2e, and the communication result transmitting unit 2h.

  The external image processing device 3 includes a packet reception unit 3f, a data selection / combination unit 3b, a communication error determination unit 3a, a communication result transmission unit 3g, an image processing unit 3c, a transmission image thinning and division unit 3d, and a transmission image. A packet conversion unit 3e, a packet selection / transmission unit 3h, and a communication result reception unit 3u are provided. The external image processing device 3 operates as a receiving device by the configuration of the packet receiving unit 3f, the data selective combining unit 3b, the communication error determining unit 3a, and the communication result transmitting unit 3g. The external image processing device 3 operates as a transmission device by the configuration of the transmission image thinning and dividing unit 3d, the transmission image packet conversion unit 3e, the packet selection transmission unit 3h, and the communication result reception unit 3u.

  Hereinafter, according to the operation in the endoscope system 100, each component of the endoscope apparatus 2 and the external image processing apparatus 3 will be described.

  The transmission image thinning / splitting means 2c thins out the minimum necessary original image data for constructing a moving image frame from original image data that has not been subjected to image processing, such as RAW data, input from the scope 1. Extract. The transmission image thinning and dividing means 2c then extracts the original image data input from the scope 1 by thinning out the original image data (hereinafter referred to as “thinned-out extracted image data”) and the other originals remaining without being thinned out. The image data is divided into image data (hereinafter referred to as “accompanying image data”). Note that the thinned-out extracted image data is important image data for constructing a moving image, and the accompanying image data is effective image data for improving the quality of the moving image based on the thinned-out extracted image data. It is. Thereafter, the transmission image thinning and dividing unit 2c outputs each of the divided thinned extracted image data and the accompanying image data to the transmission image packet converting unit 2d. Note that a detailed description of a method (thinning extraction method) in which the transmission image thinning and dividing unit 2c thins and extracts the thinned extracted image data from the original image data will be described later.

  The transmission image packet converting means 2d converts (packetizes) the thinned extracted image data and the auxiliary image data input from the transmission image thinning and dividing means 2c into respective packets to be transmitted to the external image processing device 3. Then, the transmission image packet converting means 2d selectively transmits packetized thinned extracted image data (hereinafter referred to as “decimated extracted image packet”) and incidental image data (hereinafter referred to as “accompanying image packet”). Output to means 2r.

  The packet selection / transmission unit 2r transmits each of the thinned extracted image packet and the incidental image packet input from the transmission image packet conversion unit 2d to the external image processing device 3 via the network. When the packet selection / transmission means 2r transmits each packet to the external image processing device 3, the thinned-out extracted image packet and the accompanying image packet to be transmitted are transmitted according to the communication result input from the communication result receiving means 2u. And the transmission packet formed by the packet selection transmission unit 2r is transmitted to the packet reception unit 3f of the external image processing apparatus 3.

  The packet receiving unit 3f receives the transmission packet transmitted from the packet selection transmission unit 2r of the endoscope apparatus 2 via the network, and sends the received transmission packet to the communication error determination unit 3a and the data selection combination unit 3b. Output.

  The communication error determination unit 3a determines a communication status representing the state of the communication line of the network based on the transmission packet input from the packet reception unit 3f. More specifically, a communication error with respect to the thinned extracted image packet and the incidental image packet included in the transmission packet input from the packet receiving unit 3f is determined. Then, the communication error determination unit 3a outputs a communication error determination result to the communication result transmission unit 3g. The communication error determination unit 3a may be configured to output only the communication error determination result for the thinned extracted image packet to the communication result transmission unit 3g.

  The communication result transmitting unit 3g transmits the determination result of the communication error input from the communication error determining unit 3a as a communication result to the communication result receiving unit 2u of the endoscope apparatus 2 via the network.

  The communication result receiving unit 2u outputs the communication result transmitted from the communication result transmitting unit 3g of the external image processing apparatus 3 to the packet selection transmitting unit 2r. Thereby, the packet selection / transmission means 2r confirms from the communication result input from the communication result receiving means 2u whether or not a communication error has occurred in the thinned extracted image packet or the incidental image packet included in the transmitted transmission packet. be able to. When the packet selection transmission means 2r confirms that a communication error has occurred in the thinned-out extracted image packet, the packet selection / transmission means 2r transmits again the next thinned-out extracted image packet configured in the transmission packet in which the communication error has occurred. The packet is configured in a packet and transmitted to the packet receiving means 3f of the external image processing apparatus 3 via the network. Thereby, the endoscope apparatus 2 can reliably transmit to the external image processing apparatus 3 a packet of thinned extracted image data (thinned extracted image packet) that is at least necessary for constituting a moving image frame.

  The communication result transmitting unit 3g transmits the retransmission request signal generated according to the communication error determination result input from the communication error determining unit 3a to the communication result receiving unit 2u of the endoscope apparatus 2 via the network. It may be configured to. In this case, the communication result receiving unit 2u outputs the retransmission request signal transmitted from the communication result transmitting unit 3g of the external image processing device 3 to the packet selection transmitting unit 2r. Then, in response to the retransmission request signal input from the communication result receiving unit 2u, the packet selection transmission unit 2r sends the requested thinned extracted image packet to the packet reception unit 3f of the external image processing device 3 again via the network. Send.

  The data selection / combining means 3b converts the thinned extracted image packet and the accompanying image packet included in the transmission packet input from the packet receiving means 3f into the original thinned extracted image data and the accompanying image data, and converted the thinned extracted image data. And image data (hereinafter referred to as “combined image data”) combined with the accompanying image data. Then, the generated combined image data is output to the image processing means 3c.

  Note that different combined image data is generated from the combined image data generated by the data selective combining unit 3b according to the transmission packet received by the packet receiving unit 3f. More specifically, when the packet receiving unit 3f is able to normally receive all transmission packets transmitted from the endoscope apparatus 2, the data selection / combining unit 3b Combined image data similar to the original image data (for example, RAW data) can be generated. That is, the combined image data obtained by restoring the original image data output from the scope 1 by combining the thinned extracted image data converted from the thinned extracted image packet included in the transmission packet and the incidental image data converted from the incidental image packet. Can be generated.

  However, when the packet receiving unit 3f cannot normally receive all the transmission packets transmitted from the endoscope apparatus 2, the data selective combining unit 3b outputs the original image data output from the scope 1. It is not possible to generate combined image data that has been restored. However, in the endoscope system 100, as described above, the thinned extracted image packet can be reliably received. Therefore, the data selection / combination means 3b generates the thinned extracted image data converted from the thinned extracted image packet as the combined image data. As a result, the data selection / combining means 3b can generate combined image data obtained by restoring the minimum-thinned extracted image data necessary for constituting a moving image frame, which hinders observation using the endoscope system 100. It is possible to reduce the rate of occurrence of frame defects that cause a loss.

  The image processing means 3c performs image processing on the combined image data generated by the data selective combining means 3b, and outputs the processed image data after the image processing to the transmission image thinning and dividing means 3d.

  Thereafter, the external image processing device 3 transmits the processed image data to the endoscope device 2 via the network. Then, the endoscope apparatus 2 generates combined image data from the processed image data transmitted from the external image processing apparatus 3 via the network, and uses the generated combined image data for each frame constituting the video image. Is output to the display device 4 as display image data. Thereby, the display device 4 displays the display image data of each frame input from the endoscope device 2 as a video image.

  Note that a method for transmitting processed image data by the external image processing device 3, a method for receiving processed image data by the endoscope device 2, and a method for generating combined image data are the methods for transmitting original image data by the endoscope device 2 described above. This method is the same as the method of receiving original image data and the method of generating combined image data by the external image processing apparatus 3. More specifically, the original image data is replaced with the processed image data, and the operations of the endoscope apparatus 2 that has been operated as the transmitting apparatus and the external image processing apparatus 3 that has been operated as the receiving apparatus are interchanged, that is, externally The same can be considered by using the image processing device 3 as a transmission device and the endoscope device 2 as a reception device.

  More specifically, in the external image processing apparatus 3, the transmission image thinning / dividing means 3d is used as the transmission image thinning / dividing means 2c, the transmission image packet converting means 3e is used as the transmission image packet converting means 2d, and the packet selection / transmission means 3h is used as the packet selection. By replacing the communication result receiving means 3u with the communication result receiving means 2u in the transmission means 2r, the operation of the transmission apparatus that transmits the processed image data to the endoscope apparatus 2 can be understood. In the endoscope apparatus 2, the packet receiving means 2s is the packet receiving means 3f, the communication error determining means 2e is the communication error determining means 3a, the communication result transmitting means 2h is the communication result transmitting means 3g, and the data selective combining means. By replacing 2g with the data selection / combining means 3b, the processed image data transmitted from the external image processing device 3 is received, and the minimally-thinned extracted image data necessary for constructing the frame of the moving image is restored. The operation of the receiving device that generates the combined image data can be understood. Therefore, detailed descriptions of the external image processing device 3 that operates as a transmission device and the endoscope device 2 that operates as a reception device are omitted.

  As described above, in the endoscope system 100, as described above, the endoscope apparatus 2 or the external image processing apparatus 3 that operates as a transmission apparatus transmits image data (original image data or processed image data) to a moving image. Are transmitted after being divided into the minimum-thinned-out extracted image data and other incidental image data necessary to construct the frame. Then, the external image processing device 3 or the endoscope device 2 operating as a receiving device reliably receives at least the thinned-out extracted image data by transmitting the transmitted communication result regarding the thinned-out extracted image data to the transmitting device. I am doing so. Thereby, in the endoscope system 100, it is possible to reduce the rate of occurrence of frame defects that hinder observation.

  Next, the communication timing of image data performed between the endoscope apparatus 2 and the external image processing apparatus 3 in the endoscope system 100 will be described. FIG. 2 is a diagram schematically illustrating an example of communication timing in the endoscope system 100 according to the first embodiment. In FIG. 2, for ease of explanation, the image data for one frame composed of a plurality of communication packets are all shown as one image data.

  In the following description, the endoscope apparatus 2 and the external image processing apparatus 3 that are operating as a transmission apparatus are also referred to as a transmission apparatus 2 and a transmission apparatus 3, respectively. In addition, the endoscope apparatus 2 and the external image processing apparatus 3 operating as the receiving apparatus are also referred to as the receiving apparatus 2 and the receiving apparatus 3, respectively. In the following description, a case where original image data is transmitted from the transmission device 2 (endoscope device 2) to the reception device 3 (external image processing device 3) will be described. The actual communication operation is performed by the respective constituent elements provided in the transmission device 2 and the reception device 3, but in the following description, the transmission device 2 and the reception device 3 communicate with each other for ease of explanation. A description will be given assuming that the operation is performed.

  In the endoscope system 100, as described above, the transmission device 2 divides all original image data of each frame into thinned-out extracted image data and incidental image data, and the divided thinned-out extracted image data packet The packet of the accompanying image data is transmitted to the receiving device 3 through the data transmission line within the corresponding frame period. At the communication timing shown in FIG. 2, as shown in FIG. 2A, the transmission apparatus 2 converts the original image data of N (N = 1 to 3) frames into the thinned-out extracted image data DN and the accompanying image data. The packet is divided into DNa and DNb, and the divided packets of the original image data are sequentially transmitted to the receiving device 3 at the respective packet transmission periods within the corresponding frame period.

  Hereinafter, the communication timing in the endoscope system 100 will be described in order. First, as illustrated in FIG. 2B, the transmission device 2 transmits the original image data of the frame 1 in the first frame period. Within the first frame period, first, the transmission apparatus 2 transmits a packet of the thinned extracted image data D1 in the first packet transmission period. Then, the reception device 3 determines a communication error with respect to the received packet of the thinned extracted image data D1, and transmits a retransmission request signal based on the communication error determination result to the transmission device 2.

  Based on the communication result (retransmission request signal) transmitted from the reception device 3, the transmission device 2 confirms a communication error in the first packet transmission cycle, and determines the configuration of the transmission packet to be transmitted next. The communication timing shown in FIG. 2B shows a state in which a retransmission request signal is not transmitted because the packet of the thinned extracted image data D1 is normally transmitted. Since the retransmission request signal is not transmitted from the reception device 3, the transmission device 2 transmits the packet of the auxiliary image data D1a in the subsequent second packet transmission cycle, and then in the third packet transmission cycle. A packet of incidental image data D1b is transmitted. As described above, when the packet of the thinned extracted image data D1 is normally transmitted, the transmitting device 2 transmits the packet of the auxiliary image data D1a and D1b to the receiving device 3 following the packet of the thinned extracted image data D1. Sequentially.

  Subsequently, as illustrated in FIG. 2B, the transmission device 2 transmits the original image data of the frame 2 in the second frame period. Even in the second frame period, similarly to the first frame period, first, the transmission apparatus 2 transmits a packet of the thinned extracted image data D2 in the first packet transmission period. Then, the reception device 3 determines a communication error with respect to the received packet of the thinned extracted image data D2, and transmits a retransmission request signal based on the communication error determination result to the transmission device 2.

  Similarly to the first frame cycle, the transmission device 2 confirms a communication error in the first packet transmission cycle based on the communication result (retransmission request signal) transmitted from the reception device 3, and then transmits it. The structure of the transmission packet to be determined is determined. The communication timing shown in FIG. 2B shows a state in which a retransmission request signal has been transmitted because the packet of the thinned extracted image data D2 has not been transmitted normally. Since the retransmission request signal has been transmitted from the reception device 3, the transmission device 2 transmits the packet of the thinned extracted image data D2 again at the subsequent second packet transmission cycle. Then, the transmission device 2 confirms the communication error in the second packet transmission cycle based on the communication result (retransmission request signal) for the retransmitted thinned extracted image data D2 packet transmitted from the reception device 3, Next, the configuration of the transmission packet to be transmitted is determined. The communication timing shown in FIG. 2B shows a state in which the retransmission request signal has been transmitted again because the packet of the thinned extracted image data D2 has not been transmitted normally. Since the retransmission request signal has been transmitted from the reception device 3, the transmission device 2 transmits the packet of the thinned extracted image data D2 again in the subsequent third packet transmission cycle. Thus, the transmission device 2 repeats transmission of the packet of the thinned extracted image data D2 to the receiving device 3 until the packet of the thinned extracted image data D2 is normally transmitted.

  Then, after the packet of the thinned-out extracted image data D2 is normally transmitted, the transmitting device 2 transmits the packets of the additional image data D2a and D2b as in the first frame period. At the communication timing shown in FIG. 2B, the transmission device 2 transmits the packet of the incidental image data D2a in the fourth packet transmission cycle. However, when transmitting the packet of the incidental image data D2b, The second frame period has ended. In this case, as illustrated in FIG. 2B, the transmission device 2 does not transmit the packet of the incidental image data D2b, and receives the original image data of the frame 3 in the third frame period. Start sending to

  Thus, in the endoscope system 100, the transmission device 2 or the transmission device 3 gives priority to the packet of the thinned-out extracted image data (thinned-out extracted image packet) and transmits it to the receiving device 3 or the receiving device 2. Then, the transmission device 2 or the transmission device 3 transmits a packet of incidental image data (accompanying image packet) to the reception device 3 or the reception device 2 in the period in which the frame period remains. As a result, the endoscope system 100 can reliably transmit at least the thinned-out extracted image data necessary for constructing a frame of a moving image, and hinders observation using the endoscope system 100. The rate at which such frame loss occurs can be reduced.

  Next, a method of thinning out and extracting image data from image data in the transmission device 2 and the transmission device 3 of the endoscope system 100 will be described. In the endoscope system 100, as described above, the transmission image thinning and dividing means 2c provided in the transmission device 2 (endoscopic device 2) and the transmission image thinning provided in the transmission device 3 (external image processing device 3). Each of the dividing units 3d extracts the thinned-out extracted image data necessary for constituting a moving image frame by thinning out the image data (original image data or processed image data).

  There are various methods as described below for the method of thinning out extracted image data from the image data in the transmission image thinning and dividing unit 2c and the transmission image thinning and dividing unit 3d. In the following description, a method will be described in which the transmission image thinning and dividing unit 2c included in the transmission device 2 (endoscope device 2) extracts the thinned extracted image data from the original image data.

<First thinning extraction method>
The first thinning-out extraction method thins out and extracts pixel data (for example, RAW data) arranged at a predetermined position based on the position of the pixel arranged in the solid-state imaging device provided in the scope 1. It is a method to do. As a result, the number of pixel data (number of pixels) included in the thinned-out extracted image data can be made to be the extracted number, and the data amount of the thinned-out extracted image data is made smaller than the data amount of the original image data and transmitted. In this case, the possibility of a communication error can be reduced.

<Second thinning extraction method>
The second thinning extraction method is a method of extracting pixel data by thinning out at equal intervals based on the positions of the pixels arranged in the solid-state imaging device provided in the scope 1. Thereby, like the first thinning extraction method, the data amount of the thinned extracted image data can be made smaller than the data amount of the original image data.

<Third thinning extraction method>
The third thinning extraction method is a method of thinning and extracting only the data of a pixel of a specific color based on the color of the color filter attached to each pixel arranged in the solid-state imaging device provided in the scope 1 It is. Thereby, the number of colors of pixels included in the thinned-out extracted image data can be set to the number of specific colors only.

<Fourth thinning extraction method>
In the fourth thinning extraction method, the ratio of the color of each pixel is calculated based on the color of the color filter attached to each pixel arranged in the solid-state imaging device provided in the scope 1 and the position of the pixel. This is a method of extracting and extracting pixel data arranged at a predetermined position in a maintained state. Thereby, it is possible to reduce the number of pixel data (number of pixels) while maintaining the color ratio of each pixel included in the thinned extracted image data.

<Fifth thinning extraction method>
In the fifth decimation extraction method, the number of bits of each pixel data (for example, RAW data) included in the original image data is thinned out to the number of bits that can be displayed as a video having a resolution necessary for the minimum observation. This is the extraction method. More specifically, the upper bits of a predetermined number of bits in the data of each pixel included in the original image data are thinned out and extracted. As a result, the number of bits of pixel data included in the thinned-out extracted image data can be reduced to the number of extracted bits, and when the data amount of the thinned-out extracted image data is made smaller than the data amount of the original image data, the data is transmitted. This can reduce the possibility of communication errors. In the fifth decimation extraction method, for example, the lower bits of the data of each pixel included in the original image data become the accompanying image data.

  For example, if the original image data is 16-bit gradation data, the gradation reproducibility is reduced by reducing the gradation of the original image data to 8 bits. However, the deterioration is such that the observation is hindered. Absent. For this reason, in the fifth thinning extraction method, the upper 8 bits are used as the thinned extracted image data, and the lower 8 bits are used as the accompanying image data. Further, for example, when transmitting original image data of 16-bit gradation at the communication timing shown in FIG. 2, the thinned-out extracted image data DN, the accompanying image data DNa, and the accompanying image data DNb are changed from the upper bits to 8 bits, Divide into 4 bits and 4 bits. In this way, even if only the thinned-out extracted image data D1 can be transmitted, the upper 8-bit gradation can be ensured, and a frame loss that interferes with observation due to a communication error during transmission occurs. The ratio to do can be reduced.

  In the fifth decimation extraction method, the upper bits of the original image data may be simply divided into decimation extracted image data and the lower bits may be divided as incidental image data. However, the incidental image data is received by the receiving device 3 (external image). In consideration of the case where transmission to the processing device 3) is not possible, a determination bit for reflecting the value of the auxiliary image data can be added to the thinned extracted image data. More specifically, the result of rounding the incidental image data is added to the thinned extracted image data as a determination bit. Then, the data selection / combining means 3b, when the incidental image data is normally transmitted, ignores the determination bit and combines the thinned extracted image data and the incidental image data, thereby reconstructing the original image data. Generate image data. In addition, when the auxiliary image data is not normally transmitted, the data selection / combining unit 3b adds the auxiliary image data to the lower bits of the thinned extracted image data based on the determination bit added to the thinned extracted image data. Combined image data reflecting the result of the rounding process performed on the image is generated. Thereby, it is possible to generate combined image data with less sense of incongruity reflecting the value of the incidental image data than the image data obtained by thinning out only the upper bits in the original image data.

  For example, when the upper 8 bits of 16-bit gradation original image data is thinned out extracted image data and the lower 8 bits are incidental image data, a carry occurs in the upper 8 bits when the entire lower 8 bit incidental image data is rounded. A 1-bit decision bit indicating whether or not to perform is added to the upper 8-bit thinned-out image data, and the thinned-out extracted image data is used as 9-bit data. Then, if only the thinned-out extracted image data can be transmitted, the lower 8-bit thinned-out extracted image data is reflected on the upper 8-bit thinned-out extracted image data based on the determination bit, thereby lowering the lower-order simpler 8-bit thinned-out extracted image data. Subsequent processing can be performed in a state where the entire value of the 8-bit incidental image data is reflected.

  As described above, in the endoscope system 100 according to the first embodiment, image data extracted by reducing the data amount to the minimum necessary amount for constituting a moving image frame is stored in the frame period. Will be sent preferentially. Then, the image data remaining without being extracted is transmitted in a period in which the frame period remains. As a result, at least the image data necessary for constructing the frame of the moving image can be reliably transmitted, and the rate of occurrence of frame loss that hinders observation using the endoscope system 100 is reduced. be able to.

<Second Embodiment>
Next, an endoscope system according to a second embodiment will be described. FIG. 3 is a block diagram illustrating an example of a schematic configuration of the endoscope system according to the second embodiment. The endoscope system 200 illustrated in FIG. 3 is a system including a scope 1, an endoscope device 21, an external image processing device 3, and a display device 4. In the endoscope system 200 of the second embodiment, the scope 1, the external image processing device 3, and the display device 4 are the same components as the components of the endoscope system 100 of the first embodiment. It is. Also, in the endoscope apparatus 21 of the endoscope system 200 of the second embodiment, which is different from the components of the endoscope system 100 of the first embodiment, the endoscope system 100 of the first embodiment. The same configuration is included. Therefore, the same reference numerals are given to the same components and configurations as those of the endoscope system 100 of the first embodiment, and detailed description thereof is omitted.

  The endoscope apparatus 21 processes the original image data input from the scope 1 by the external image processing apparatus 3 in the same manner as the endoscope apparatus 2 provided in the endoscope system 100 of the first embodiment. Is converted to a signal format (format) that can be transmitted to the external image processing apparatus 3 via a network. Note that the difference between the endoscope apparatus 21 and the endoscope apparatus 2 provided in the endoscope system 100 of the first embodiment is that the endoscope apparatus 21 uses the original image data input from the scope 1. The format is converted and then transmitted to the external image processing apparatus 3. Thereby, in the endoscope apparatus 21, the original picture format conversion means 2a is added to the components of the endoscope apparatus 2 provided in the endoscope system 100 of the first embodiment. In the following description, components and operations different from those of the endoscope apparatus 2 provided in the endoscope system 100 of the first embodiment will be described.

  The original image format conversion means 2a converts the format (type) of the original image data (RAW data) input from the scope 1, and outputs the converted original image data to the transmission image thinning and dividing means 2c.

  The transmission image thinning and dividing unit 2c divides the original image data converted by the original image format conversion unit 2a into thinned extracted image data and incidental image data. Subsequent processing is the same as that of the endoscope apparatus 2 provided in the endoscope system 100 of the first embodiment.

  Note that the method of thinning out and extracting image data from the original image data by the transmission image thinning and dividing unit 2c converts the format (type) of the original image data, and thus the endoscope system 100 of the first embodiment. This is a method different from the transmission image thinning and dividing means 2c of the endoscope apparatus 2 provided in the above. Here, a method for extracting and extracting the thinned extracted image data from the original image data converted by the original image format converting means 2a will be described.

<Sixth thinning extraction method>
The sixth decimation extraction method is a method corresponding to a case where the original image format conversion means 2a converts the original image data input from the scope 1 into frequency space data such as a low frequency component and a high frequency component, for example. . The transmission image thinning and dividing unit 2c includes original image data obtained by removing high-frequency components from the converted original image data input from the original image format conversion unit 2a within a range that does not affect the observation using the endoscope system 200, That is, the low-frequency component original image data is thinned out and extracted. More specifically, for example, low-frequency component original image data obtained by performing a low-pass filter process having a predetermined frequency characteristic to remove a high-frequency component is used as the thinned-out extracted image data. Note that the high-frequency component original image data is supplementary image data. Thereby, the data amount of the thinned extracted image data can be made smaller than the data amount of all the original image data input from the scope 1, and the number of thinned extracted image data to be transmitted per one frame period is increased. Can do. If only the thinned-out extracted image data can be transmitted, only the low-frequency component original image data is obtained, so that the reproducibility of the edge component is reduced, so that the sharpness in the video image to be displayed is deteriorated. However, it is possible to reduce the rate of occurrence of frame loss that hinders observation due to a communication error during transmission. In the sixth thinning-out extraction method, the original image data of the removed high frequency component is incidental image data.

<Seventh thinning extraction method>
In the seventh thinning extraction method, the original image format conversion means 2a converts the original image data input from the scope 1 into Y (luminance) data, Cb (color difference: blue) data, and Cr (color difference: (Red) This method corresponds to the case of conversion to data. The transmission image thinning and dividing unit 2c extracts the number of bits of the converted original image data (YCbCr data) input from the original image format conversion unit 2a by thinning out the number of bits different between the luminance data and the color difference data. More specifically, the number of bits of color difference data is thinned out more than the number of bits of luminance data. For example, when the number of bits of Y data, Cb data, and Cr data included in the original image data is 16 bits, the thinned-out image data is left as 16 bits and the Cb data and Cr data are 8 bits. . This is because the human eye generally uses the characteristic that the resolution with respect to the luminance is higher than the resolution with respect to the color difference. As a result, the number of bits of the luminance data and the color difference data included in the thinned extracted image data is reduced. If a communication error occurs, the luminance data included in the thinned-out extracted image data is preferentially transmitted, so that the rate of occurrence of frame loss that hinders observation can be reduced.

  As described above, the endoscope system 200 according to the second embodiment forms a moving image frame as in the case of the endoscope apparatus 2 provided in the endoscope system 100 according to the first embodiment. Therefore, the amount of data is reduced to the minimum necessary amount. As a result, at least the image data necessary for constructing a frame of the moving image can be reliably transmitted, and the rate of occurrence of frame defects that hinder observation using the endoscope system 200 is reduced. be able to.

  Note that the communication timing of image data in the endoscope system 200 of the second embodiment is the same as the communication timing of image data in the endoscope system 100 of the first embodiment shown in FIG. Detailed description is omitted.

<Third Embodiment>
Next, an endoscope system according to a third embodiment will be described. FIG. 4 is a block diagram illustrating an example of a schematic configuration of the endoscope system according to the third embodiment. The endoscope system 300 illustrated in FIG. 4 is a system including the scope 1, the endoscope device 22, the external image processing device 32, and the display device 4. In the endoscope system 300 of the third embodiment, the scope 1 and the display device 4 are the components of the endoscope system 100 of the first embodiment and the endoscope system 200 of the second embodiment. It is the same component. Also, the endoscope apparatus 22 and the outside of the endoscope system 300 of the third embodiment, which are different from the constituent elements of the endoscope system 100 of the first embodiment and the endoscope system 200 of the second embodiment. The image processing apparatus 32 also includes the same configuration as the endoscope system 100 of the first embodiment or the endoscope system 200 of the second embodiment. Accordingly, the same components and configurations as those of the endoscope system 100 of the first embodiment or the endoscope system 200 of the second embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

  Similarly to the endoscope apparatus 21 provided in the endoscope system 200 of the second embodiment, the endoscope apparatus 22 converts the format of the original image data input from the scope 1 and then performs external image processing. The signal is converted into a signal format (format) that can be processed by the device 32 and transmitted to the external image processing device 32 via the network.

  The external image processing device 32 is transmitted from the endoscope device 22 in the same manner as the external image processing device 3 provided in the endoscope system 100 of the first embodiment and the endoscope system 200 of the second embodiment. The processed image data obtained by performing image processing for display on the display device 4 is transmitted to the endoscope device 22 via the network with respect to the original image data after the format conversion.

  Note that, in the endoscope system 300 according to the third embodiment, the endoscope device 22 is similar to the endoscope system 100 according to the first embodiment and the endoscope system 200 according to the second embodiment. When the original image data is transmitted to the external image processing device 32, it operates as a transmitting device, and when the processed image data is received from the external image processing device 32, it operates as a receiving device. The external image processing device 3 operates as a receiving device when receiving the original image data from the endoscope device 22, and operates as a transmitting device when transmitting the processed image data to the endoscope device 22.

  The endoscope apparatus 22 includes an original picture format conversion unit 2a, a transmission image thinning / dividing unit 2c, a transmission image packet conversion unit 2i, a packet selection transmission unit 2w, packet reception units 2s and 2t, and a data selection combination unit 2n. And communication error determination means 2e and 2f. The endoscope apparatus 22 operates as a transmission apparatus by the configuration of the original picture format conversion means 2a, the transmission image thinning and dividing means 2c, the transmission image packet conversion means 2i, and the packet selection transmission means 2w. Further, the endoscope apparatus 22 operates as a receiving apparatus by the configuration of the packet receiving means 2s and 2t, the data selection / coupling means 2n, and the communication error determination means 2e and 2f.

  The external image processing device 32 includes a packet receiving unit 3f, a data selection / combining unit 3i, a communication error determining unit 3a, an image processing unit 3c, a transmission image decimation / dividing unit 3d, and transmission image packet conversion units 3j and 3k. And packet selection transmission means 3l and 3m. The external image processing device 32 operates as a receiving device by the configuration of the packet receiving unit 3f, the data selective combining unit 3i, and the communication error determining unit 3a. The external image processing device 32 operates as a transmission device by the configuration of the transmission image thinning and dividing unit 3d, the transmission image packet conversion units 3j and 3k, and the packet selection transmission units 3l and 3m.

  The difference between the operation of the endoscope system 300 according to the third embodiment and the operation of the endoscope system 100 according to the first embodiment and the endoscope system 200 according to the second embodiment is that a thinned-out extracted image. This is a communication operation of data and incidental image data. More specifically, the endoscope system 100 according to the first embodiment and the endoscope system 200 according to the second embodiment determine a communication error with respect to the transmitted transmission packet, and a communication error occurs. In such a case, by resending a transmission packet in which a communication error has occurred in response to a retransmission request, the rate of occurrence of frame loss that hinders observation has been reduced. On the other hand, the endoscope system 300 according to the third embodiment does not request retransmission even when a communication error occurs, and transmits a plurality of predetermined transmission packets in one frame period. By processing the image data included in the transmission packet in which no communication error has occurred, it is possible to reduce the rate of occurrence of frame loss that hinders observation. ing.

  Note that a method of transmitting a plurality of transmission packets in one frame period includes a method of transmitting a plurality of transmission packets using one communication line (single line) without increasing the number of network communication lines, There is a method of increasing the number of communication lines and transmitting a plurality of transmission packets using a plurality of communication lines.

  Hereinafter, according to the operation in the endoscope system 300, each component of the endoscope apparatus 22 and the external image processing apparatus 32 will be described, and the endoscope apparatus 22 and the external image processing apparatus 32 in the endoscope system 300 will be described. A communication operation of image data performed between the two will be described. First, in the communication operation of transmitting original image data from the endoscope apparatus 22 to the external image processing apparatus 32, the endoscope system 100 of the first embodiment and the second embodiment are not increased without increasing the network communication line. A case where a plurality of transmission packets are transmitted using one communication line (single line) similar to the endoscope system 200 will be described.

  In the following description, an example of communication timing in the endoscope system 300 of the third embodiment shown in FIG. 5 will be referred to. In FIG. 5, for ease of explanation, the image data for one frame composed of a plurality of communication packets is all shown as one image data. Further, at the communication timing shown in FIG. 5, the endoscope apparatus 22 converts the original image data of N (N = 1 to 3) frames from the thinned-out extracted image, similarly to the communication timing shown in FIG. Data DN and auxiliary image data DNa and DNb are divided, and the divided original image data packets are sequentially transmitted to the external image processing device 32 at respective packet transmission periods within the corresponding frame period. To do.

  The original image format conversion means 2a converts the original image data into a format of luminance data and color difference data by performing, for example, YC processing on the original image data (RAW data) input from the scope 1, and transmits it. This is output to the image thinning and dividing means 2c. The conversion method of the original image data by the original image format conversion means 2a is not limited to the conversion to the luminance data and the color difference data described above.

  The transmission image thinning / splitting means 2c is thinned out so that the number of bits of the luminance data converted by the original picture format conversion means 2a is large and the number of bits of the color difference data is small, for example, by the seventh thinning extraction method described above. The extracted image data and the additional image data of the number of bits remaining without being thinned are divided. Then, the transmission image thinning and dividing unit 2c outputs each of the divided thinned extracted image data and the accompanying image data to the transmission image packet converting unit 2i. Note that the decimation extraction method by the transmission image decimation division unit 2c is not limited to the seventh decimation extraction method described above.

  The transmission image packet converting means 2i packetizes the thinned extracted image data and the auxiliary image data input from the transmission image thinning and dividing means 2c for transmission to the external image processing device 32, and packetizes the thinned extracted image packet. Each of the accompanying image packets is output to the packet selection / transmission means 2w.

  The packet selection / transmission means 2w transmits each of the thinned extracted image packet and the incidental image packet input from the transmission image packet conversion means 2i to the packet reception means 3f of the external image processing apparatus 32 via the network. When the packet selection / transmission means 2w transmits each packet to the external image processing device 32, a transmission packet including the same decimation-extracted image packet is transmitted a plurality of times within one frame period, and an accompanying image packet is transmitted. The transmission packet including is transmitted once each.

  The communication timing shown in FIG. 5 shows an example in which a transmission packet including the same thinned and extracted image data is transmitted twice within one frame period. More specifically, the case where the packet of the thinned-out extracted image data D1 is transmitted in the first packet transmission cycle and the third packet transmission cycle in the first frame cycle is shown. Further, the case where the packet of the incidental image data D1a is transmitted in the second packet transmission period within the first frame period and the packet of the incidental image data D1b is transmitted in the fourth packet transmission period is shown. . Similarly, the packet of the thinned-out extracted image data D2 is transmitted at the first packet transmission cycle and the third packet transmission cycle in the second frame cycle, and the second packet transmission cycle and the fourth packet transmission cycle. The case where the respective packets of the accompanying image data D2a and the accompanying image data D2b are transmitted is shown. Similarly, the packet of the thinned extracted image data D3 is transmitted at the first packet transmission cycle and the third packet transmission cycle within the third frame cycle, and the second packet transmission cycle and the fourth packet transmission are transmitted. The case where the packets of the accompanying image data D3a and the accompanying image data D3b are transmitted in a cycle is shown. This reduces the rate at which packets, especially packets of thinned-out extracted image data, are not normally transmitted due to communication errors, rather than transmitting each packet of thinned-out extracted image data and incidental image data once within one frame period. can do.

  The packet receiving unit 3f receives the transmission packet transmitted from the packet selection transmission unit 2w of the endoscope apparatus 22 via the network, and sends the received transmission packet to the communication error determination unit 3a and the data selection combination unit 3i. Output.

  The communication error determination unit 3a determines a communication error with respect to the thinned extracted image packet and the incidental image packet included in the transmission packet input from the packet reception unit 3f, and outputs the communication error determination result to the data selective combination unit 3i. .

  The data selection / combining means 3i selects a thinned-out extracted image packet or an incidental image packet included in the transmission packet input from the packet receiving means 3f based on the determination result of the communication error input from the communication error determination means 3a. The selected thinned-out extracted image packet or incidental image packet is converted into the original thinned-out extracted image data or incidental image data to generate combined image data. Then, the generated combined image data is output to the image processing means 3c.

  In the selection of the thinned-out extracted image packet and the accompanying image packet by the data selection / combining means 3i, the thinned-out extracted image packet and the accompanying image packet included in the transmission packet determined not to have a communication error are selected. In the endoscope system 300, the packet selection transmission unit 2w transmits a transmission packet including the same thinned extraction image packet a plurality of times. For this reason, a plurality of transmission packets including the same thinned-out extracted image packet that are determined not to have a communication error may be input to the data selective combining unit 3i. Therefore, in the selection of the thinned extracted image packet by the data selection / combining means 3i, the thinned extracted image packet included in any one of the plurality of transmission packets including the same thinned extracted image packet is selected. Thereby, even if a communication error occurs in any one of the thinned-out extracted image packets within one frame period, it is possible to select a thinned-out extracted image packet that is determined not to be a communication error. As a result, the data selection / combining means 3i can generate combined image data obtained by restoring the minimum-thinned extracted image data necessary for constructing a frame of the moving image, and can be used for observation using the endoscope system 300. It is possible to reduce the rate of occurrence of frame defects that cause trouble.

  Further, in the endoscope system 300, the packet selection / transmission means 2w transmits the transmission packet including the incidental image packet once each. Therefore, in the selection of the incidental image packet by the data selection / combining means 3i, the incidental image packet is selected only when it is determined that all the incidental image packets are not communication errors within one frame period. In other words, if it is determined that at least one of the incidental image packets transmitted within one frame period is a communication error, all the incidental image packets transmitted within the current frame period are not selected. . For example, if it is determined at the communication timing shown in FIG. 5 that the packet of the incidental image data D1b transmitted within one frame period is a communication error, the communication other than the packet of the incidental image data D1b The packet of the accompanying image data D1a determined not to be an error is not selected. Then, the data selection / combining means 3i generates the thinned extracted image data D1 converted from the thinned extracted image packet as combined image data. Thereby, it is possible to avoid the influence on the display of the video of the moving image due to the combination of a part of the auxiliary image data with the thinned-out extracted image data. For example, if the incidental image data is only color difference data, even if some of the incidental image data is selected and the combined image data is generated, the desired color cannot be reproduced in the video image. If the color information is cut off, the observation using the endoscope system 300 is not hindered.

  The image processing unit 3c performs image processing on the combined image data generated by the data selective combining unit 3i, and outputs the processed image data after the image processing to the transmission image thinning and dividing unit 3d. Thereafter, the external image processing device 32 transmits the processed image data to the endoscope device 22 via the network.

  Subsequently, in a communication operation in which processed image data is transmitted from the external image processing device 32 to the endoscope device 22, a plurality of transmission packets are transmitted using a plurality of communication lines with an increased number of network communication lines. explain.

  In the following description, another example of the communication timing in the endoscope system 300 of the third embodiment shown in FIG. 6 will be referred to. In FIG. 6 as well, for ease of explanation, the image data for one frame composed of a plurality of communication packets are all shown as one image data. Further, at the communication timing shown in FIG. 6, the external image processing device 32 converts the processed image data of N (N = 1 to 3) frames into the thinned-out extracted image, similarly to the communication timing shown in FIG. Data DN and auxiliary image data DNa and DNb are divided, and the divided packets of processed image data are sequentially transmitted to the endoscope apparatus 22 at respective packet transmission periods within the corresponding frame period. To do.

  The transmission image decimation / dividing means 3d is processed by the image processing means 3c, for example, by the above-described second decimation extraction method from the processed image data input from the image processing means 3c, such as YCbCr data. The pixel data in the processed image data that has been subjected to image processing is divided into thinned-out extracted image data that has been thinned out uniformly and incidental image data with the number of bits remaining without being thinned out. Then, the transmission image thinning and dividing unit 3d outputs the divided thinned extracted image data and the accompanying image data to the transmission image packet converting units 3j and 3k, respectively. The image processing by the image processing means 3c is not limited to the image processing for generating YCbCr data, and the thinning extraction method by the transmission image thinning and dividing means 3d is also limited to the second thinning extraction method described above. Is not to be done.

  Each of the transmission image packet converting means 3j and 3k packetizes the thinned extracted image data and the auxiliary image data input from the transmission image thinning and dividing means 3d for transmission to the endoscope apparatus 22, and packetized thinning. Each of the extracted image packet and the accompanying image packet is output to one of the corresponding packet selection / transmission means 3l or 3m.

  Each of the packet selecting / transmitting means 3l and 3m receives the packet of the thinned extracted image packet and the incidental image packet input from either the corresponding transmission image packet converting means 3j or 3k, and the network of the corresponding communication line. Is transmitted to either one of the corresponding packet receiving means 2s or 2t provided in the endoscope apparatus 22. When each of the packet selection transmission means 3l and 3m transmits each packet to the endoscope apparatus 22, a transmission packet including a thinned-out extracted image packet and an accompanying image packet within one frame period Each of the transmission packets including “1” is transmitted once.

  In the communication timing shown in FIG. 6, a transmission packet including the thinned extracted image data and a transmission packet including any one of the accompanying image packets are transmitted once each within one frame period. An example is shown. More specifically, within the first frame period, one of the packet selection transmission means 3l or 3m uses the data transmission line 1 to send a packet of the thinned extracted image data D1 and a packet of the auxiliary image data D1a. This shows a case where either one of the packet selection transmission means 3l or 3m is transmitting the packet of the thinned extracted image data D1 and the packet of the incidental image data D1b through the data transmission line 2. Similarly, within the second frame period, either one of the packet selection transmission means 3l or 3m transmits the packet of the thinned extracted image data D2 and the packet of the auxiliary image data D2a through the data transmission line 1, In this example, either one of the packet selection transmission means 3l or 3m is transmitting the packet of the thinned extracted image data D2 and the packet of the incidental image data D2b through the data transmission line 2. Similarly, in the third frame period, either the packet selection transmission means 3l or 3m transmits the packet of the thinned extracted image data D3 and the packet of the auxiliary image data D3a through the data transmission line 1. In this example, either one of the packet selection transmission means 3l or 3m transmits the packet of the thinned extracted image data D3 and the packet of the incidental image data D3b through the data transmission line 2. Thus, rather than transmitting each packet of the thinned-out extracted image data and the incidental image data once in one frame cycle by one communication line (single line), the packet, particularly the thinned-out extracted image data, due to a communication error. It is possible to reduce the rate at which no packets are normally transmitted.

  Further, as can be seen by comparing the communication timing shown in FIG. 6 with the communication timing shown in FIG. 5, at the communication timing shown in FIG. 6, the same thinned extracted image packet is transmitted a plurality of times using the same communication line. Since transmission is not performed, the number of transmission packets transmitted in one frame period is smaller than the communication timing shown in FIG. This is because the communication timing shown in FIG. 6 has more margin in the communication area of one communication line, and the communication amount shown in FIG. It means that you can do more than timing.

  The packet receiving means 2s and 2t receive the transmission packet transmitted from the corresponding packet selection / transmission means 3l or 3m of the external image processing apparatus 32 via the network of the corresponding communication line, and correspond to the received transmission packet. Output to the communication error determination means 2e or 2f and the data selective combination means 2n.

  Each of the communication error determination means 2e and 2f determines a communication error for the thinned extracted image packet and the incidental image packet included in the transmission packet input from either the corresponding packet reception means 2s or 2t, and The determination result is output to the data selective combining unit 2n.

  The data selection / combining means 2n is based on the communication error determination results input from the communication error determination means 2e and 2f, and the thinned-out extracted image packet included in the transmission packet input from each of the packet receiving means 2s and 2t. Or the accompanying image packet is selected, and the selected thinned extracted image packet or the accompanying image packet is converted into the original thinned extracted image data or the accompanying image data to generate combined image data. Then, the generated combined image data is output to the display device 4 as display image data of each frame constituting the video image. Thereby, the display device 4 displays the display image data of each frame input from the endoscope device 22 as a video image.

  In the selection of the thinned-out extracted image packet or the accompanying image packet by the data selection / combining means 2n, the thinned-out extracted image packet or the accompanying image packet included in the transmission packet determined not to have a communication error is selected. In the endoscope system 300, each of the packet selection transmission units 3l and 3m transmits a transmission packet including the same thinned-out extracted image packet once each in a network of different communication lines. For this reason, a plurality of transmission packets including the same thinned-out extracted image packet that are determined not to have a communication error may be input to the data selective combining unit 2n. For this reason, in the selection of the thinned extracted image packet by the data selection / combining means 2n, the thinned extracted image packet included in any one of the plurality of transmission packets including the same thinned extracted image packet is selected. As a result, even if a communication error occurs in a thinned extracted image packet transmitted via a network of any communication line within one frame period, a thinned extracted image packet determined not to be a communication error You can choose. As a result, the data selection / combining means 2n can generate combined image data obtained by restoring the minimum-thinned extracted image data necessary for constructing the frame of the moving image, and can be used for observation using the endoscope system 300. It is possible to reduce the rate of occurrence of frame defects that cause trouble.

  Further, in the endoscope system 300, each of the packet selection transmission units 3l and 3m transmits a transmission packet including different incidental image packets once each in a network of different communication lines. For this reason, the data selection / combining means 2n receives the transmission packet including the incidental image packet determined not to be a communication error and the transmission packet including the incidental image packet determined to be a communication error. Sometimes. In this case, in the selection of the incidental image packet by the data selection / combining means 2n, only the incidental image packet determined not to have a communication error is selected. For example, at the communication timing shown in FIG. 6, if it is determined that the packet of the incidental image data D1a transmitted by the data transmission line 1 is a communication error within one frame period, it is not a communication error. Only the packet of the determined incidental image data D1b is selected. Then, the data selection / combining means 2n generates combined image data obtained by combining the thinned extracted image data D1 converted from the thinned extracted image packet and the incidental image data D1b converted from the incidental image packet. As a result, combined image data can be generated by combining the thinned extracted image data converted from the thinned extracted image packet with the incidental image data converted from the accompanying image packet.

  Note that in the endoscope system 300 of the third embodiment, when a packet of processed image data is transmitted from the external image processing device 32 to the endoscope device 22, the communication differs from the communication timing shown in FIG. A plurality of transmission packets can be transmitted at the timing. Here, another communication timing for transmitting a plurality of transmission packets using a plurality of communication lines with an increased number of network communication lines will be described.

  FIG. 7 is a diagram schematically illustrating still another example of communication timing in the endoscope system 300 according to the third embodiment. In FIG. 7 as well, for ease of explanation, all image data for one frame composed of a plurality of communication packets is shown as one image data. Further, at the communication timing shown in FIG. 7, the external image processing device 32 converts the processed image data of N (N = 1 to 3) frames into the thinned-out extracted image, similarly to the communication timing shown in FIG. Data DN and auxiliary image data DNa and DNb are divided, and the divided packets of processed image data are sequentially transmitted to the endoscope apparatus 22 at respective packet transmission periods within the corresponding frame period. To do. It should be noted that the transmission image thinning and dividing means 3d provided in the external image processing device 32, the operation of the transmission image packet converting means 3j and 3k, the packet receiving means 2s and 2t provided in the endoscope device 22, and a communication error Since each operation | movement with the determination means 2e and 2f is the same as that of the example mentioned above, detailed description is abbreviate | omitted.

  Each of the packet selecting / transmitting means 3l and 3m receives the packet of the thinned extracted image packet and the incidental image packet input from either the corresponding transmission image packet converting means 3j or 3k, and the network of the corresponding communication line. Is transmitted to either one of the corresponding packet receiving means 2s or 2t provided in the endoscope apparatus 22. Each of the packet selection transmission means 3l and 3m transmits a transmission packet including the same thinned-out extracted image packet a plurality of times within one frame period when transmitting each packet to the endoscope apparatus 22. A transmission packet including different incidental image packets is transmitted once. At this time, the packet selection transmission means 3l and 3m transmit the same combination of transmission packets.

  At the communication timing shown in FIG. 7, a transmission packet including the same decimation-extracted image data is transmitted twice within one frame period, and a transmission packet including any one additional image packet is transmitted once each. An example in the case of transmitting one by one is shown. More specifically, the packet of the thinned extracted image data D1 is transmitted in the first packet transmission cycle and the third packet transmission cycle in the first frame cycle, and the incidental image data D1a is transmitted in the second packet transmission cycle. This is a case where the packet of incidental image data D1b is transmitted in the fourth packet transmission cycle. Similarly, the packet of the thinned-out extracted image data D2 is transmitted in the first packet transmission cycle and the third packet transmission cycle in the second frame cycle, and the incidental image data D2a packet is transmitted in the second packet transmission cycle. This shows a case where the packet of incidental image data D2b is transmitted in the fourth packet transmission cycle. Similarly, the packet of the thinned extracted image data D3 is transmitted at the first packet transmission period and the third packet transmission period within the third frame period, and the incidental image data D3a packet is transmitted at the second packet transmission period. , And a packet of incidental image data D3b is transmitted in the fourth packet transmission cycle. At this time, in each frame period, either one of the packet selection / transmission means 3l or 3m transmits the above-mentioned combination of transmission packets via the data transmission line 1, and either one of the packet selection / transmission means 3l or 3m The transmission packets of the same combination are transmitted through the data transmission line 2. As a result, similar to the communication timing shown in FIG. 6, rather than transmitting each packet of the thinned extracted image data and the incidental image data once in one frame period with one communication line (single line). The ratio of packets that are not normally transmitted due to communication errors, in particular, packets of thinned extracted image data, can be reduced.

  Further, as can be seen by comparing the communication timing shown in FIG. 7 with the communication timing shown in FIG. 6, at the communication timing shown in FIG. 7, the same thinned extracted image packet is transmitted a plurality of times using the same communication line. In addition to transmitting, all accompanying image packets are transmitted. That is, at the communication timing shown in FIG. 7, the thinned extracted image packet and the accompanying image packet are transmitted a plurality of times using a plurality of communication lines. Therefore, at the communication timing shown in FIG. 7, even if a communication error occurs in one of the data transmission line thinned extracted image data packet or incidental image data packet in a certain frame period, the other data is transmitted normally. Since it is possible to select a thinned-out extracted image data packet or an accompanying image data packet, which has been completed, it is possible to improve resistance to frame loss.

  The data selection / combining means 2n is based on the communication error determination results input from the communication error determination means 2e and 2f, and the thinned-out extracted image packet included in the transmission packet input from each of the packet receiving means 2s and 2t. Or the accompanying image packet is selected, and the selected thinned extracted image packet or the accompanying image packet is converted into the original thinned extracted image data or the accompanying image data to generate combined image data.

  In the selection of the thinned-out extracted image packet or the accompanying image packet by the data selection / combining means 2n, the communication is performed in the same manner as when the thinned-out extracted image packet or the accompanying image packet transmitted at the communication timing shown in FIG. 6 is selected. A thinned-out extracted image packet or an accompanying image packet included in a transmission packet determined not to be an error is selected. For example, in the communication timing shown in FIG. 7, if it is determined that the packet of the incidental image data D1a transmitted by the data transmission line 1 is a communication error within one frame period, it is not a communication error. The packet of the incidental image data D1a transmitted through the determined data transmission line 2 is selected. Then, the data selection / combining means 2n converts the thinned extracted image data D1 converted from the thinned extracted image packet transmitted from either the data transmission line 1 or the data transmission line 2 and the auxiliary image packet selected above. Combined image data is generated by combining the incidental image data D1a and the incidental image data D1b transmitted by either the data transmission line 1 or the data transmission line 2. As a result, combined image data obtained by combining all the auxiliary image data converted from the auxiliary image packet to the thinned extraction image data converted from the thinned extraction image packet, that is, more auxiliary image data than the communication timing shown in FIG. Combined image data combined can be generated.

  As described above, in the endoscope system 300 of the third embodiment as well, as with the endoscope system 100 of the first embodiment and the endoscope system 200 of the second embodiment, The data is transmitted after being divided into thinned-out extracted image data extracted by reducing the data amount to the minimum necessary amount for constituting a frame and other accompanying image data. At this time, in the endoscope system 300 of the third embodiment, the thinned extracted image data is transmitted a plurality of times within the frame period. As a result, at least image data necessary for constructing a frame of a moving image can be reliably transmitted, and the rate of occurrence of frame defects that hinder observation using the endoscope system 300 is reduced. be able to.

  In the endoscope system 300 according to the third embodiment, when transmitting original image data from the endoscope apparatus 22 to the external image processing apparatus 32, one communication line (single line) is used. The case where a plurality of communication lines are used when processing image data is transmitted from the external image processing device 32 to the endoscope device 22 has been described. However, the number of communication lines used in communication of image data performed between the endoscope apparatus 22 and the external image processing apparatus 32 is not limited to the above-described example. For example, when transmitting original image data from the endoscope apparatus 22 to the external image processing apparatus 32, a plurality of communication lines are used, and when transmitting processed image data from the external image processing apparatus 32 to the endoscope apparatus 22. A configuration using one communication line (single line) can also be used. Further, for example, in both communication of transmission of original image data from the endoscope apparatus 22 to the external image processing apparatus 32 and transmission of processed image data from the external image processing apparatus 32 to the endoscope apparatus 22, One communication line (single line) or a plurality of communication lines may be used. The configuration in such a case can be dealt with by providing the components corresponding to the endoscope system 300 in the same manner as in the above-described example, and the communication operation is also considered in the same manner as in the above-described example. Therefore, detailed description is omitted.

  In the endoscope system 300 of the third embodiment, the configuration in which the packet of processed image data is transmitted from the external image processing device 32 to the endoscope device 22 includes two components, which are different from each other. The case where data is transmitted through a network of two communication lines has been described. More specifically, the external image processing device 32 includes transmission image packet conversion means 3j and 3k and packet selection transmission means 3l and 3m, and the endoscope device 22 has packet reception means 2s and 2t and communication error determination. A case has been described in which the means 2e and 2f are provided and the respective transmission packets are transmitted by the data transmission line 1 and the data transmission line 2. However, the number of communication lines and the number of components corresponding to the communication lines provided in the endoscope apparatus 22 and the external image processing apparatus 32 are not limited to the above-described example, and depend on the number of communication lines. By providing the number of components in the endoscope apparatus 22 and the external image processing apparatus 32, packets of image data can be transmitted using more communication lines.

  In the endoscope system 300 according to the third embodiment, the configuration in which the endoscope apparatus 22 includes the original image format conversion unit 2a has been described. However, the configuration of the endoscope apparatus 22 is the same as that described above. For example, as with the endoscope apparatus 2 of the endoscope system 100 according to the first embodiment shown in FIG. 1, the original image format conversion means 2a may be omitted. In this case, the transmission image thinning / splitting unit 2c provided in the endoscope apparatus 22 is an image input from the scope 1 in the same manner as the transmission image thinning / splitting unit 2c provided in the endoscope system 100 of the first embodiment. Original image data that has not been processed is divided into thinned-out extracted image data and incidental image data.

<Fourth Embodiment>
Next, an endoscope system according to a fourth embodiment will be described. FIG. 8 is a block diagram illustrating an example of a schematic configuration of the endoscope system according to the fourth embodiment. An endoscope system 400 illustrated in FIG. 8 is a system including the scope 1, the endoscope device 23, the external image processing device 33, and the display device 4. In the endoscope system 400 of the fourth embodiment, the scope 1 and the display device 4 are the same components as the components of the endoscope system of the first to third embodiments. Also in the endoscope apparatus 23 and the external image processing apparatus 33 of the endoscope system 400 of the fourth embodiment, which are different from the constituent elements of the endoscope system of the first to third embodiments, A configuration similar to that of the endoscope system according to the third embodiment is included. Therefore, the same reference numerals are given to the same components and configurations as those of the endoscope systems of the first to third embodiments, and detailed description thereof is omitted.

  The endoscope device 23 converts the format of the original image data input from the scope 1 and performs external image processing in the same manner as the endoscope device 22 provided in the endoscope system 300 of the third embodiment. The signal is converted into a signal format (format) that can be processed by the device 33 and transmitted to the external image processing device 33 via the network. Note that the difference between the endoscope apparatus 23 and the endoscope apparatus 22 provided in the endoscope system 300 of the third embodiment is that the endoscope apparatus 23 uses the network to transfer the original image data after the format conversion. Is to adjust the timing of transmission to the external image processing apparatus 33 via the.

  Similarly to the external image processing device 32 provided in the endoscope system 300 of the third embodiment, the external image processing device 33 processes the original image data after the format conversion transmitted from the endoscope device 23. Then, the processed image data subjected to the image processing for display on the display device 4 is transmitted to the endoscope device 23 via the network. The difference between the external image processing device 33 and the external image processing device 32 provided in the endoscope system 300 of the third embodiment is that the external image processing device 33 uses the network to process the processed image data via the network. This is to adjust the timing when transmitting to the mirror device 23.

  Note that, in the endoscope system 400 of the fourth embodiment as well, as in the endoscope systems of the first to third embodiments, the endoscope apparatus 23 sends the original image data to the external image processing apparatus 33. It operates as a transmitting device when transmitting, and operates as a receiving device when receiving processed image data from the external image processing device 33. The external image processing device 33 operates as a receiving device when receiving the original image data from the endoscope device 23, and operates as a transmitting device when transmitting the processed image data to the endoscope device 23.

  The endoscope apparatus 23 includes an original picture format conversion means 2a, a transmission image decimation / division means 2c, a transmission image packet conversion means 2j, a packet selection transmission means 2x, a transmission timing adjustment means 2k, and packet reception means 2s and 2t. And data selection / coupling means 2n, communication error determination means 2e and 2f, communication result analysis means 2o and 2p, and communication result transmission means 2h and 2y. The endoscope apparatus 23 is configured as a transmission apparatus by the configuration of the original picture format conversion means 2a, the transmission image thinning and division means 2c, the transmission image packet conversion means 2j, the packet selection transmission means 2x, and the transmission timing adjustment means 2k. Operate. Further, the endoscope apparatus 23 includes packet receiving means 2s and 2t, data selection / combining means 2n, communication error determining means 2e and 2f, communication result analyzing means 2o and 2p, and communication result transmitting means 2h and 2y. With this configuration, it operates as a receiving device.

  The external image processing device 33 includes a packet receiving unit 3f, a data selective combining unit 3i, a communication error determining unit 3a, a communication result analyzing unit 3n, a communication result transmitting unit 3g, an image processing unit 3c, and a transmission image thinning-out. A dividing unit 3d, transmission image packet conversion units 3j and 3k, packet selection transmission units 3q and 3r, and transmission timing adjustment units 3s and 3t are provided. The external image processing device 33 operates as a receiving device by the configuration of the packet receiving unit 3f, the data selective combining unit 3i, the communication error determining unit 3a, the communication result analyzing unit 3n, and the communication result transmitting unit 3g. Further, the external image processing device 33 is configured to include a transmission image thinning and dividing unit 3d, transmission image packet conversion units 3j and 3k, packet selection transmission units 3q and 3r, and transmission timing adjustment units 3s and 3t. Works as.

  The difference between the operation of the endoscope system 400 of the fourth embodiment and the operation of the endoscope system of the first to third embodiments is the timing at which the thinned extracted image data and the auxiliary image data are transmitted. is there. More specifically, the endoscope system according to the first to second embodiments determines a communication error for a transmitted packet that has been transmitted, and responds to a retransmission request when a communication error occurs. By retransmitting a transmission packet in which a communication error has occurred or by transmitting a plurality of transmission packets in one frame period, processing is performed on the image data included in the transmission packet in which no communication error has occurred, The rate of occurrence of frame defects that hindered observation was reduced. On the other hand, the endoscope system 400 according to the fourth embodiment analyzes the timing at which a communication error occurs in the transmitted transmission packet, avoids the timing at which the communication error occurs, and thins out the extracted image data. A transmission packet including is transmitted. This is because, for example, when the periodic noise generated when using a treatment instrument such as an electric knife is in the vicinity of the environment where the endoscope system 400 is used, the timing matches the period of the noise. This is a measure for dealing with the fact that the frequency of occurrence of communication errors increases when a transmission packet including thinned extracted image data is transmitted. With this measure, the endoscope system 400 according to the fourth embodiment can reduce the rate of occurrence of frame defects that hinder observation.

  For this reason, in the endoscope system 400 according to the fourth embodiment, the transmission device transmits a test data transmission packet to the reception device in advance before the transmission device transmits the thinned-out extracted image data or the auxiliary image data packet. The receiving apparatus analyzes the timing at which the communication error occurs based on the result of determining the communication error for the transmitted test data transmission packet, and transmits the analyzed result to the transmitting apparatus. The transmission apparatus adjusts the timing for transmitting the thinned-out extracted image data and incidental image data packets based on the analysis result transmitted from the reception apparatus.

  Hereinafter, according to the operation in the endoscope system 400, each component of the endoscope apparatus 23 and the external image processing apparatus 33 will be described, and the endoscope apparatus 23 and the external image processing apparatus 33 in the endoscope system 400 will be described. A communication operation of image data performed between the two will be described. In the following description, regarding communication operations for transmitting original image data from the endoscope device 23 to the external image processing device 33, components and operations different from those of the endoscope systems of the first and second embodiments. explain.

  The transmission image packet conversion means 2j packetizes test data for analyzing the timing at which a communication error occurs into a packet for transmission to the external image processing device 33, and packetizes the test data (hereinafter referred to as “test packet”). Is output to the packet selection transmission means 2x.

  The packet selection / transmission means 2x transmits the test packet input from the transmission image packet conversion means 2j to the external image processing device 33 via the network. When the packet selection / transmission means 2x transmits a test packet to the external image processing apparatus 33, the same test packet is sent to the packet reception means of the external image processing apparatus 33 in each packet transmission period within one frame period. Send to 3f. Thereby, it is possible to confirm the timing at which a communication error occurs due to the influence of periodic noise or the like.

  The packet receiving unit 3f receives the test packet transmitted from the packet selection / transmission unit 2x of the endoscope apparatus 23 via the network, and outputs the received test packet to the communication error determination unit 3a.

  The communication error determination unit 3a determines a communication error with respect to the test packet input from the packet reception unit 3f, and outputs a communication error determination result to the communication result analysis unit 3n.

  The communication result analyzing unit 3n analyzes the timing at which the communication error occurs based on the communication error determination result input from the communication error determining unit 3a, and transmits the analyzed result of the timing at which the communication error occurs to the communication result. Output to means 3g.

  The communication result transmission unit 3g transmits the result of the timing at which the communication error occurs input from the communication result analysis unit 3n as a communication result to the transmission timing adjustment unit 2k of the endoscope apparatus 23 via the network.

  The transmission timing adjustment unit 2k adjusts the timing for transmitting the thinned-out extracted image packet based on the communication result transmitted from the communication result transmission unit 3g of the external image processing device 33 so as to shift from the timing at which the communication error occurs. Then, the adjusted timing is output to the packet selection transmission means 2x.

  Thereafter, the packet selection transmission unit 2x transmits the thinned extracted image packet to the external image processing apparatus via the network at the timing adjusted by the transmission timing adjusting unit 2k when transmitting the thinned extracted image packet and the incidental image packet. 3 to the packet receiving means 3f.

  Thereby, the endoscope apparatus 23 can reliably transmit the thinned extracted image packet to the external image processing apparatus 3 at a timing at which a communication error does not occur due to the influence of periodic noise or the like. As a result, the external image processing apparatus 3 can generate combined image data obtained by restoring the minimum-thinned extracted image data necessary for constituting a moving image frame, and can be used for observation using the endoscope system 400. It is possible to reduce the rate of occurrence of frame defects that cause trouble.

  Thereafter, in the external image processing apparatus 33, the image processing means 3c performs image processing on the combined image data generated by the data selection / combining means 3i, and the processed image data after the image processing is processed via an endoscope. Transmit to device 23. FIG. 8 shows a configuration in which a network of a plurality of communication lines is used when the external image processing device 33 transmits processed image data to the endoscope device 23. However, the communication operation in this case is a communication operation in which original image data is transmitted from the endoscope device 23 to the external image processing device 33 in consideration of the communication operation in the endoscope system 300 of the third embodiment. Can be thought of as well. More specifically, in the communication operation for transmitting the original image data from the endoscope device 23 to the external image processing device 33, the endoscope that has been operated as a transmission device by replacing the original image data with the processed image data. Similar considerations are made by switching the operation of the device 23 and the external image processing device 33 that has been operating as a receiving device, that is, by setting the external image processing device 33 as a transmitting device and the endoscope device 23 as a receiving device. Can do.

  More specifically, in the communication operation for transmitting the original image data from the endoscope apparatus 23 to the external image processing apparatus 33, the transmission image packet conversion means 2j is changed to the transmission image packet conversion means 3j and 3k, and the packet selection transmission means. 2x for packet selective transmission means 3q and 3r, packet reception means 3f for packet reception means 2s and 2t, communication error determination means 3a for communication error determination means 2e and 2f, and communication result analysis means 3n for communication result analysis means 2o 2p, the communication result transmitting means 3g is replaced with the communication result transmitting means 2h and 2y, and the transmission timing adjusting means 2k is replaced with the transmission timing adjusting means 3s and 3t. Can understand the communication operation of transmitting processed image data to the device 23Accordingly, a detailed description of the communication operation in which the external image processing device 33 transmits the processed image data to the endoscope device 23 will be omitted.

  In addition, the communication timing of the image data by the endoscope system 400 of the fourth embodiment is the endoscope of the first to third embodiments except that the thinned extracted image packet is transmitted at a timing at which no communication error occurs. Since it is the same as the communication timing of the image data in the system, detailed description is omitted.

  As described above, in the endoscope system 400 according to the fourth embodiment as well, as in the case of the endoscope systems according to the first to third embodiments, it is the minimum necessary for constituting a moving image frame. The image data is transmitted after being divided into thinned-out extracted image data extracted by reducing the data amount to the amount and other accompanying image data. At this time, in the endoscope system 400 according to the fourth embodiment, the timing at which a communication error occurs is analyzed by transmitting test data in advance, and the thinned extracted image data is transmitted at a timing at which no communication error occurs. . This avoids the timing when a communication error occurs due to the influence of noise with periodicity, etc., and at least it is possible to reliably transmit at least the image data necessary to construct a video frame. It is possible to reduce the rate at which frame defects that interfere with observation using the endoscope system 400 occur.

  In the endoscope system 400 of the fourth embodiment, the communication result analyzing unit 3n analyzes the timing at which a communication error occurs based on the determination result of the communication error, and the transmission timing adjusting unit 2k is analyzed. The case where the timing for transmitting the thinned-out extracted image packet is adjusted based on the result of the timing at which the communication error occurs (communication result) has been described. However, the method for analyzing the timing at which a communication error occurs and the method for adjusting the timing at which the extracted image packet is transmitted are not limited to the examples described above. For example, the transmission timing adjustment unit 2k analyzes the timing at which a communication error occurs based on the determination result of the communication error, and adjusts the number of times to transmit the thinned extracted image packet based on the frequency of the communication error. You can also

  In the endoscope system 400 of the fourth embodiment, a test data packet (test packet) is transmitted in advance, and the timing at which a communication error occurs is determined based on the determination result of the communication error for the test packet. Although the case of analyzing has been described, the method of analyzing the timing at which a communication error occurs is not limited to the above-described example. For example, regardless of whether or not it is used for observation using the endoscope system 400, a packet of image data (thinned-out extracted image data or incidental image data) is transmitted and the timing at which a communication error occurs is analyzed as appropriate. The timing at which the thinned-out extracted image packet is transmitted can be appropriately adjusted based on the analyzed timing result (communication result).

  In the endoscope system 400 of the fourth embodiment, the original image data is transmitted from the endoscope apparatus 23 to the external image processing apparatus 33 as in the endoscope system 300 of the third embodiment. In this case, a case where one communication line (single line) is used, and a plurality of communication lines are used when processing image data is transmitted from the external image processing apparatus 33 to the endoscope apparatus 23 has been described. However, the endoscope apparatus 23 and the external image processing apparatus are used in accordance with the number of communication lines used in the communication of image data performed between the endoscope apparatus 23 and the external image processing apparatus 33, or the number of communication lines. Similarly to the endoscope system 300 according to the third embodiment, the number of components included in the number 33 is not limited to the above-described example.

  In the endoscope system 400 of the fourth embodiment, the configuration in which the endoscope apparatus 23 includes the original image format conversion means 2a has been described. However, the configuration of the endoscope apparatus 23 is the same as the above-described example. However, the present invention is not limited, and the original image format conversion means 2a may not be provided.

<Fifth Embodiment>
Next, an endoscope system according to a fifth embodiment will be described. FIG. 9 is a block diagram showing an example of a schematic configuration of the endoscope system according to the fifth embodiment. An endoscope system 500 shown in FIG. 9 includes a scope 1, an endoscope device 24, an external image processing device 33, a display device 4, an external output terminal 5, and a user setting device 7. System. In the endoscope system 500 of the fifth embodiment, the scope 1, the external image processing device 33, and the display device 4 are the same components as the components of the endoscope system 400 of the fourth embodiment. It is. Also in the endoscope apparatus 24 of the endoscope system 500 of the fifth embodiment, which is different from the components of the endoscope system 400 of the fourth embodiment, the endoscope system 400 of the fourth embodiment. The same configuration is included. Accordingly, the same components and configurations as those of the endoscope system 400 of the fourth embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

  The difference between the endoscope system 500 of the fifth embodiment and the endoscope system 400 of the fourth embodiment is that the method of adjusting the timing of transmitting the thinned extracted image packet via the network is different. That is. More specifically, the endoscope system 400 according to the fourth embodiment analyzes the timing at which a communication error occurs by transmitting test data in advance, and automatically adjusts the timing at which the thinned extracted image packet is transmitted. By doing so, the rate of occurrence of frame defects that hinder observation was reduced. On the other hand, the endoscope system 500 of the fifth embodiment uses the result of analyzing the timing at which a communication error occurs (communication result) as the endoscope system 500 of the fifth embodiment. It presents so that a user can recognize, and the timing which transmits a thinning | extracting extraction image packet is adjusted with the timing which the user set based on the presented communication result. Thereby, in the endoscope system 500 according to the fifth embodiment, it is possible to reduce the rate of occurrence of a frame defect that hinders observation within a range allowed by the user. .

  The endoscope device 24 converts the format of the original image data input from the scope 1 and performs external image processing in the same manner as the endoscope device 23 provided in the endoscope system 400 of the fourth embodiment. The signal is converted into a signal format (format) that can be processed by the device 33 and transmitted to the external image processing device 33 via the network. Further, the endoscope apparatus 24 presents the communication result transmitted from the external image processing apparatus 33 so that the user can recognize it, and performs the thinning extraction based on the timing set in the user setting apparatus 7 by the user's operation. Adjust the transmission timing of image packets. That is, the difference between the endoscope apparatus 24 and the endoscope apparatus 23 provided in the endoscope system 400 of the fourth embodiment is that a thinned extracted image packet is transmitted to the external image processing apparatus 3 via the network. The method for adjusting the timing is different.

  The external image processing device 33 is the same as the external image processing device 33 provided in the endoscope system 400 of the fourth embodiment. The external image processing device 33 converts processed image data obtained by performing image processing for display on the display device 4 to the original image data after format conversion transmitted from the endoscope device 24 via a network. To the endoscope device 24. However, in the endoscope system 500 of the fifth embodiment, the external image processing device 33 adjusts the timing for transmitting the thinned extracted image packet based on the timing set in the user setting device 7 by the user's operation. To do.

  The external output terminal 5 outputs communication result information output from the endoscope device 24. The external output terminal 5 is connected to, for example, a display device (not shown) connected to the outside of the endoscope system 500 of the fifth embodiment, and the communication result information output from the endoscope device 24 is displayed. Then, it is displayed on a display device (not shown) so that the user can recognize it.

  The user setting device 7 sets the timing at which the thinned-out extracted image packet is transmitted by the user who uses the endoscope system 500 of the fifth embodiment, and sets the information on the set timing to the endoscope device 24 and The data is output to the external image processing device 33.

  Note that, in the endoscope system 500 of the fifth embodiment as well, the endoscope apparatus 24 sends the original image data to the external image processing apparatus 33 as in the endoscope systems of the first to fourth embodiments. It operates as a transmitting device when transmitting, and operates as a receiving device when receiving processed image data from the external image processing device 33. The external image processing device 33 operates as a receiving device when original image data is received from the endoscope device 24, and operates as a transmitting device when transmitting processed image data to the endoscope device 24.

  The endoscope apparatus 24 includes an original picture format conversion means 2a, a transmission image decimation / division means 2c, a transmission image packet conversion means 2j, a packet selection transmission means 2x, a transmission timing adjustment means 2k, and packet reception means 2s and 2t. , Data selection / coupling means 2n, communication error determination means 2e and 2f, communication result analysis means 2o and 2p, and transmission timing display means 2v. The endoscope apparatus 24 is configured as a transmission apparatus by the configuration of the original picture format conversion means 2a, the transmission image thinning and division means 2c, the transmission image packet conversion means 2j, the packet selection transmission means 2x, and the transmission timing adjustment means 2k. Operate. Further, the endoscope device 24 operates as a receiving device by the configuration of the packet receiving means 2s and 2t, the data selective combining means 2n, the communication error determining means 2e and 2f, and the communication result analyzing means 2o and 2p. .

  As described above, the endoscope device 24 presents the communication result transmitted from the external image processing device 33 so that the user can recognize it, and based on the timing set in the user setting device 7 by the user's operation. The timing for transmitting the thinned extracted image packet is adjusted. Thereby, in the endoscope apparatus 24, the communication result transmitting means 2h and 2y provided in the endoscope apparatus 23 provided in the endoscope system 400 of the fourth embodiment are deleted, and the transmission timing display means 2v is added. Has been. In the following description, components and operations different from those of the endoscope device 23 and the external image processing device 33 provided in the endoscope system 400 of the fourth embodiment will be described.

  As described above, the external image processing device 33 also adjusts the timing at which the thinned extracted image packet is transmitted based on the timing set in the user setting device 7 by the user's operation. The destination of the communication result by the provided communication result transmitting means 3g and the input source of the timing for transmitting the thinned extracted image packet input to the transmission timing adjusting means 3s and 3t are different, and the operation of each component is the same It is. Therefore, a detailed description of the operation of each component of the external image processing device 33 is omitted.

  The communication result transmitting unit 3g transmits a communication result, which is a result of timing at which a communication error occurs, to the transmission timing display unit 2v of the endoscope apparatus 24 via the network.

  The communication result analysis means 2o and 2p are based on the determination result of the communication error input from the corresponding communication error determination means 2e or 2f when the external image processing apparatus 33 transmits the processed image data to the endoscope apparatus 24. The timing results (communication results) at which the communication error occurs are output to the transmission timing display means 2v.

  The transmission timing display means 2v displays the communication result input from the communication result transmission means 3g and the result of the timing at which a communication error occurs, input from each of the communication result analysis means 2o and 2p, and the display device 4 and external output. Output to terminal 5 respectively. Thereby, the endoscope apparatus 24 can present information on the timing at which a communication error occurs in the endoscope system 500 of the fifth embodiment so that the user can recognize it.

  The user operates the user setting device 7 with reference to the timing information when the communication error presented from the endoscope device 24 occurs, and sets the timing for transmitting the thinned extracted image packet. The user setting device 7 sets transmission timing adjustment means 2k provided in the endoscope device 24 and transmission timing adjustment provided in the external image processing device 33 with respect to timing information transmitted by the user, which is set by the user. Output to the means 3s and the transmission timing adjustment means 3t, respectively.

  The transmission timing adjusting unit 2k adjusts the timing for transmitting the thinned extracted image packet so as to be shifted from the timing at which the communication error occurs based on the timing information for transmitting the thinned extracted image packet input from the user setting device 7. Then, the adjusted timing is output to the packet selection transmission means 2x. Similarly, each of the transmission timing adjusting units 3s and 3t adjusts and adjusts the timing for transmitting the thinned extracted image packet based on the timing information for transmitting the thinned extracted image packet input from the user setting device 7. The timing is output to one of the corresponding packet selection / transmission means 3q or 3r.

  Thereby, the endoscope apparatus 24 and the external image processing apparatus 33 can reliably transmit the thinned extracted image packet within the timing set by the user, that is, within the range of the state allowed by the user. As a result, the endoscope apparatus 24 and the external image processing apparatus 33 can generate combined image data in which the minimally extracted image data necessary for constituting a moving image frame is restored. It is possible to reduce the rate of occurrence of frame defects that hinder observation using 500.

  Note that the communication timing of the image data by the endoscope system 500 of the fifth embodiment is the endoscope system of the fourth embodiment, except that the timing at which the thinned extracted image packet is transmitted is the timing set by the user. Since it is the same as the communication timing of the image data in 400, detailed description is omitted.

  As described above, in the endoscope system 500 according to the fifth embodiment as well, as in the case of the endoscope systems according to the first to fourth embodiments, it is the minimum necessary for constituting a moving image frame. The image data is transmitted after being divided into thinned-out extracted image data extracted by reducing the data amount to the amount and other accompanying image data. At this time, in the endoscope system 500 according to the fifth embodiment, similarly to the endoscope system 400 according to the fourth embodiment, the timing at which the communication error occurs is analyzed, and the timing at which the communication error occurs is analyzed. The result (communication result) is presented so that the user can recognize it. Then, the thinned-out extracted image packet is transmitted at a timing set by the user based on the presented communication result. Thereby, in the endoscope system 500 of the fifth embodiment, it is possible to reliably transmit at least the image data necessary for constructing the frame of the moving image within the range allowed by the user. In addition, it is possible to reduce the rate of occurrence of frame defects that interfere with observation using the endoscope system 500.

  In the endoscope system 500 according to the fifth embodiment, the original image data is transmitted from the endoscope apparatus 24 to the external image processing apparatus 33 as in the endoscope system 400 according to the fourth embodiment. In the above description, a case where one communication line (single line) is used and a plurality of communication lines are used when processing image data is transmitted from the external image processing apparatus 33 to the endoscope apparatus 24 has been described. However, the endoscope apparatus 24 and the external image processing apparatus are used in accordance with the number of communication lines used in the communication of image data performed between the endoscope apparatus 24 and the external image processing apparatus 33 or the number of communication lines. Similarly to the endoscope system 400 of the fourth embodiment, the number of constituent elements provided in 33 is not limited to the above-described example.

  In the endoscope system 500 of the fifth embodiment, the configuration in which the endoscope apparatus 24 includes the original image format conversion means 2a has been described. However, the configuration of the endoscope apparatus 24 is the same as the above-described example. However, the present invention is not limited, and the original image format conversion means 2a may not be provided.

<Sixth Embodiment>
Next, an endoscope system according to a sixth embodiment will be described. FIG. 10 is a block diagram illustrating an example of a schematic configuration of the endoscope system according to the sixth embodiment. An endoscope system 600 illustrated in FIG. 10 is a system including the scope 1, the endoscope device 25, the external image processing device 32, the display device 4, and the treatment tool 8. In the endoscope system 600 of the sixth embodiment, the scope 1, the external image processing device 32, and the display device 4 are the same components as the components of the endoscope system 300 of the third embodiment. It is. Also in the endoscope apparatus 25 of the endoscope system 600 of the sixth embodiment, which is different from the constituent elements of the endoscope system 300 of the third embodiment, the endoscope system 300 of the third embodiment. The same configuration is included. Accordingly, the same components and configurations as those of the endoscope system 300 of the third embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

  The difference between the endoscope system 600 of the sixth embodiment and the endoscope system 300 of the third embodiment is that the treatment tool 8 such as an electric knife is connected. is there. Thereby, in the endoscope system 600 of the sixth embodiment, the endoscope apparatus 22 provided in the endoscope system 300 of the third embodiment is replaced with the endoscope apparatus 25. Further, in the endoscope apparatus 25, the transmission timing adjustment means 2z and the treatment instrument control information acquisition means 2q are added to the constituent elements of the endoscope apparatus 22 provided in the endoscope system 300 of the third embodiment. ing. In the following description, components and operations different from those of the endoscope apparatus 22 provided in the endoscope system 300 of the third embodiment will be described.

  The treatment instrument control information acquisition unit 2q acquires a control signal for operating (driving) the treatment instrument 8 input from the treatment instrument 8, and outputs information on the acquired control signal to the transmission timing adjustment unit 2z.

  The transmission timing adjustment means 2z is a noise generated when the treatment instrument 8 does not operate, that is, when the treatment instrument 8 is used, based on the control signal information of the treatment instrument 8 transmitted from the treatment instrument control information acquisition means 2q. Detects when no occurrence occurs. Then, the transmission timing adjustment unit 2z adjusts the timing for transmitting the thinned extracted image packet so that the thinned extracted image packet is transmitted with priority at the timing when the treatment instrument 8 does not operate, and the adjusted timing is used for packet selection transmission. Output to means 2x.

  Thereafter, the packet selection transmission unit 2x transmits the thinned extracted image packet to the external image processing apparatus via the network at the timing adjusted by the transmission timing adjusting unit 2z when transmitting the thinned extracted image packet and the incidental image packet. 32 packet reception means 3f.

  Thereby, the endoscope apparatus 25 can reliably transmit the thinned extracted image packet to the external image processing apparatus 32 at a timing at which no communication error occurs due to the influence of noise or the like generated when using the treatment instrument 8. . As a result, the external image processing device 32 can generate combined image data obtained by restoring the minimum-thinned extracted image data necessary for constituting a moving image frame, and can be used for observation using the endoscope system 600. It is possible to reduce the rate of occurrence of frame defects that cause trouble.

  Note that the communication timing of the image data by the endoscope system 600 of the sixth embodiment is the first to fifth embodiments except that the thinned extracted image packet is preferentially transmitted at a timing when the treatment instrument 8 does not operate. Since this is the same as the communication timing of image data in the endoscope system, detailed description is omitted.

  As described above, in the endoscope system 600 of the sixth embodiment as well, as in the case of the endoscope systems of the first to fifth embodiments, it is the minimum necessary for constructing a moving image frame. The image data is transmitted after being divided into thinned-out extracted image data extracted by reducing the data amount to the amount and other accompanying image data. At this time, in the endoscope system 600 of the sixth embodiment, the thinned extracted image data is preferentially transmitted at a timing at which no communication error occurs by detecting the timing at which the treatment tool 8 does not operate. Thus, even when noise occurs in the environment in which the endoscope system 600 is used due to the operation of the treatment instrument 8, the timing at which a communication error occurs due to the influence of noise generated by the treatment instrument 8 is avoided, and at least Thus, it is possible to reliably transmit the minimum necessary image data for constructing a moving image frame, and to reduce the rate of occurrence of frame defects that hinder observation using the endoscope system 600.

  In the endoscope system 600 according to the sixth embodiment, the original image data is transmitted from the endoscope apparatus 25 to the external image processing apparatus 32 as in the endoscope system 300 according to the third embodiment. In this case, a case where one communication line (single line) is used and a plurality of communication lines are used when processing image data is transmitted from the external image processing apparatus 32 to the endoscope apparatus 25 has been described. However, the endoscope apparatus 25 and the external image processing apparatus are used in accordance with the number of communication lines used in the communication of the image data performed between the endoscope apparatus 25 and the external image processing apparatus 32 or the number of communication lines. Similarly to the endoscope system 300 of the third embodiment, the number of components included in 32 is not limited to the above-described example.

  In the endoscope system 600 according to the sixth embodiment, the configuration in which the endoscope apparatus 25 includes the original image format conversion unit 2a has been described. However, the configuration of the endoscope apparatus 25 is the same as that described above. However, the present invention is not limited, and the original image format conversion means 2a may not be provided.

  As described above, according to the mode for carrying out the present invention, the thinned-out extracted image data extracted by reducing the data amount to the minimum necessary amount for constructing a moving image frame, and other incidental Divide into image data. Then, a transmission packet including the thinned extracted image data is preferentially transmitted so that the thinned extracted image data is reliably transmitted. As a result, even if the state of the communication line of the network is poor and retransmission requests occur frequently, at least the thinned-out extracted image data can be reliably transmitted, and observation using an endoscope system It is possible to reduce the rate of occurrence of frame defects that hinder the operation.

  In the present embodiment, several examples of the thinning extraction method when thinning out and extracting the thinned extraction image data are shown. However, the thinning extraction method of the thinning extraction image data is in the form for carrying out the present invention. The present invention is not limited, and various thinning extraction methods that are effective in an endoscope system can be applied as appropriate. In addition, any thinning extraction method including the thinning extraction method shown in the present embodiment can be applied to each endoscope system shown in the present embodiment.

  In the present embodiment, the format of the network communication line is not defined, but the format of the network communication line may be any format such as wired or wireless. Further, the format of the network communication line used in one endoscope system is not limited to the same format, but may be a combination of different types of communication lines.

  In the present embodiment, the case where the scope 1 outputs original image data that has not been subjected to image processing, such as RAW data, has been described. However, the image data of the subject that the scope 1 outputs as original image data is described. However, the present invention is not limited to the mode for carrying out the present invention. For example, the concept of the present invention can be applied to a configuration in which image data of a photographed subject is subjected to image processing in the scope 1 and the image data after the image processing is output as original image data.

  The embodiment of the present invention has been described above with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes various modifications within the scope of the present invention. It is.

100, 200, 300, 400, 500, 600 ... Endoscope system 1 ... Scope 2, 21, 22, 23, 24, 25 ... Endoscope device, transmitting device, receiving device 2a ... Original image format conversion means 2c... Transmission image decimation and division means 2d, 2i, 2j... Transmission image packet conversion means 2e, 2f... Communication error determination means 2g, 2n. , 2p, 2y ... communication result transmitting means 2k, 2z ... transmission timing adjusting means 2q ... treatment instrument control information acquiring means 2r, 2w, 2x ... packet selection transmitting means 2s, 2t ... packet Receiving means 2u ... communication result receiving means 2v ... transmission timing display means 3, 32, 33 ... external image processing device, receiving device, transmitting device 3a ... communication error determining means 3b, 3i,. Data selection / combination means 3c ... image processing means 3d ... transmission image decimation and division means 3e, 3j, 3k ... transmission image packet conversion means 3f ... packet reception means 3g ... communication result transmission means 3h, 3l, 3m, 3q, 3r ... packet selection transmission means 3n ... communication result analysis means 3s, 3t ... transmission timing adjustment means 3u ... communication result reception means 4 ... display device 5 ... External output terminal 7... User setting device 8.

Claims (19)

An endoscope device to which a scope that outputs image data of a photographed subject as original image data, a display device that displays a video of the input image data, and image processing on the input original image data And an external image processing apparatus having an image processing means for outputting processed image data after performing the processing, and the endoscope apparatus receives the original image data input from the scope. The processed image data transmitted to the external image processing device via the communication network and processed by the external image processing device with respect to the received original image data is transmitted to the internal image via the communication network. In an endoscope system that transmits to a mirror device and the endoscope device outputs the received processed image data to the display device, the endoscope device or When either one of the external image processing devices is a transmission device and the other one of the endoscope device or the external image processing device is a reception device, each of the external image processing devices between the transmission device and the reception device An image data communication method for an endoscope system for communicating image data via the communication network,
The transmission image thinning / splitting means provided in the transmission device increases the image quality of the image data to be transmitted, the thinned extracted image data important for constructing the image by the image data, and the image based on the thinned extracted image data. A transmission image decimation and division step for dividing the image into effective auxiliary image data to perform
By the transmission image packet conversion means provided in the transmitting device, the thinned extracted image packet and the incidental image packet, which are packets in a signal format for transmitting the thinned extracted image data and the incidental image data to the receiving device, respectively. A transmission image packet conversion step to convert to
According to the communication status of the communication network, the packet selection transmission means provided in the transmission device selects the thinned-out extracted image packet or the incidental image packet, and the selected thinned-out extracted image packet or the incidental image packet is selected. A packet selection transmission step for transmitting a transmission packet including:
A packet receiving step of receiving the transmission packet transmitted from the transmitting device by a packet receiving means provided in the receiving device;
The data selection / combining means provided in the receiving device selects the transmission packet that was successfully received in the received packet receiving step, and the thinned extracted image data included in the selected transmission packet and the Similar to the image data before being divided by the transmission image thinning and dividing means included in the transmission device by extracting the auxiliary image data and combining the extracted thinned extracted image data and the auxiliary image data. A data selection and combining step for generating combined image data;
including,
An image data communication method for an endoscope system. In the transmission image decimation division step, the transmission image decimation division means
The pixel data included in the image data to be transmitted is thinned and extracted, the pixel data extracted by the thinning is used as the thinned extracted image data, and the data of the pixels remaining without being thinned is referred to as the incidental image data. To
The image data communication method of the endoscope system according to claim 1. The transmission image thinning and dividing means is
Extracting the pixel data by thinning them out at equal intervals;
The image data communication method for an endoscope system according to claim 2. The transmission image thinning and dividing means is
Extract and extract only the data of the pixels of a specific color,
The image data communication method for an endoscope system according to claim 2. The transmission image thinning and dividing means is
In the state where the ratio of the color of each pixel included in the image data to be transmitted is maintained, the pixel data is thinned and extracted.
The image data communication method for an endoscope system according to claim 2. In the transmission image decimation division step, the transmission image decimation division means
The high-order bits of a predetermined number of bits in a digital signal representing the size of pixel data included in the image data to be transmitted are thinned out and extracted, and the pixel data of the number of bits extracted by the thinning out is extracted in the thinned-out image Data, the data of the pixel of the number of bits remaining without being thinned out as the incidental image data,
The image data communication method of the endoscope system according to claim 1. When the endoscope device is a transmission device and the external image processing device is a reception device,
An original image format conversion step of converting the format of the original image data input from the scope into a different format by the original image format conversion means provided in the transmission device;
Further including
In the transmission image decimation division step, the transmission image decimation division means
The original image data whose format has been converted by the original image format conversion step is divided into the thinned extracted image data and the incidental image data as the image data to be transmitted,
The image data communication method of the endoscope system according to claim 1. In the original image format conversion step, the original image format conversion means includes:
Converting the original image data into frequency space data;
In the transmission image decimation division step, the transmission image decimation division means
Of the data in the frequency space included in the image data to be transmitted, predetermined low frequency component data is thinned and extracted, and the thinned and extracted low frequency component data is used as the thinned extracted image data. The data of the high frequency component remaining without any changes is used as the incidental image data.
The image data communication method for an endoscope system according to claim 7. In the original image format conversion step, the original image format conversion means includes:
Converting the original image data into data in the form of luminance and color difference;
In the transmission image decimation division step, the transmission image decimation division means
A predetermined number of bits of luminance data in a digital signal representing the magnitude of luminance included in the image data to be transmitted and a smaller number of bits than the number of bits of the luminance data in the digital signal representing the magnitude of a color difference The luminance data of the number of bits and the color difference data extracted by thinning out are extracted as the thinned-out extracted image data, and the luminance data and the color difference data of the number of bits remaining without being thinned out are added to the auxiliary data. Image data,
The image data communication method for an endoscope system according to claim 7. In the packet selection transmission step, the packet selection transmission means includes:
Within a transmission cycle of the transmission packet in the communication network, the transmission packet including the thinned extracted image packet is transmitted a plurality of times, and the transmission packet including the incidental image packet is transmitted once.
The image data communication method for an endoscope system according to any one of claims 1 to 9, wherein the image data communication method is used. The packet selection transmission means includes
Using the same communication line in the communication network, transmitting the transmission packet of the number of transmissions;
The image data communication method of an endoscope system according to claim 10. The packet selection transmission means includes
Using a plurality of communication lines in the communication network, transmitting the transmission packet including the thinned-out extracted image packet of the transmission count and the transmission packet including the incidental image packet;
The image data communication method of an endoscope system according to claim 10. The packet selection transmission means includes
The transmission packet including the thinned-out extracted image packet of the transmission count is transmitted in parallel using all of a plurality of communication lines in the communication network, and the transmission packet including the incidental image packet is transmitted in the communication network. Send using one of multiple communication lines,
The image data communication method of the endoscope system according to claim 12. A communication error determination step for determining whether or not there is a communication error in the transmission packet received in the packet reception step received by the communication error determination means provided in the receiving device;
Further including
In the data selective combining step, the data selective combining means includes:
Based on the determination result of the communication error determined in the communication error determination step, the additional image packet is added to the combined image data generated by the thinned extracted image data extracted from the transmission packet including the thinned extracted image packet. Determining whether to combine the incidental image data extracted from the transmission packet including,
The image data communication method for an endoscope system according to any one of claims 1 to 13, wherein the image data communication method is used. The data selective combining means is
When at least one of the transmission packets including the incidental image packet determined to have a communication error in the communication error determination step is within the same transmission cycle, the thinned extracted image packet received within the transmission cycle is Generating the combined image data obtained by combining only the thinned extracted image data extracted from the transmission packet including:
The image data communication method of the endoscope system according to claim 14. The data selective combining means is
The combined image generated by the thinned-out extracted image data extracted from the transmission packet including the thinned-out extracted image packet only for the transmission packet including the incidental image packet determined as having no communication error in the communication error determining step. Generating the combined image data combined with the data;
The image data communication method of the endoscope system according to claim 14. A communication result transmission step of transmitting a retransmission request for the transmission packet including the thinned-out extracted image packet determined by the communication result transmission means included in the reception device as having a communication error in the communication error determination step;
A communication result receiving step instructing retransmission of the transmission packet including the thinned-out extracted image packet requested to be retransmitted in the communication result transmitting step by a communication result receiving means provided in the transmitting device;
Further including
The packet selection transmission step includes:
Resending the transmission packet including the thinned extracted image packet instructed by the communication result receiving step;
The image data communication method of an endoscope system according to any one of claims 14 to 16, wherein the image data communication method is an endoscope system. A communication result for analyzing a timing at which a communication error occurs within a transmission period of a transmission packet in the communication network based on a result of determining a communication error in the communication error determination step by a communication result analyzing unit provided in the receiving device An analysis step;
A communication result transmitting step for transmitting information on the timing at which the communication error analyzed in the communication result analyzing step occurs by the communication result transmitting means provided in the receiving device;
The transmission timing adjustment means provided in the transmission device adjusts the timing for transmitting the transmission packet including the thinned extracted image packet based on the timing information at which the communication error transmitted in the communication result transmission step occurs. A transmission timing adjustment step,
Further including
The packet selection transmission step includes:
Transmitting the transmission packet including the thinned extracted image packet at a timing adjusted by the transmission timing adjustment step;
The image data communication method of an endoscope system according to any one of claims 14 to 16, wherein the image data communication method is an endoscope system. When the endoscope device is a transmission device and the external image processing device is a reception device,
A treatment instrument control information acquisition step of acquiring information of a control signal when driving the treatment instrument connected to the endoscope apparatus by a treatment instrument control information acquisition means provided in the transmission device;
A transmission timing for adjusting a timing for transmitting the transmission packet including the thinned extracted image packet based on information of the control signal acquired in the treatment instrument control information acquisition step by a transmission timing adjusting means provided in the transmission device An adjustment step;
Further including
The packet selection transmission step includes:
Transmitting the transmission packet including the thinned extracted image packet at a timing adjusted by the transmission timing adjustment step;
The image data communication method of an endoscope system according to any one of claims 14 to 16, wherein the image data communication method is an endoscope system.

Images