WO2017033617A1 - Moving image transmission and reception system - Google Patents

Moving image transmission and reception system Download PDF

Info

Publication number
WO2017033617A1
WO2017033617A1 PCT/JP2016/071007 JP2016071007W WO2017033617A1 WO 2017033617 A1 WO2017033617 A1 WO 2017033617A1 JP 2016071007 W JP2016071007 W JP 2016071007W WO 2017033617 A1 WO2017033617 A1 WO 2017033617A1
Authority
WO
WIPO (PCT)
Prior art keywords
moving image
image data
file
communication
transmission
Prior art date
Application number
PCT/JP2016/071007
Other languages
French (fr)
Japanese (ja)
Inventor
雄吾 小泉
Original Assignee
オリンパス株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by オリンパス株式会社 filed Critical オリンパス株式会社
Publication of WO2017033617A1 publication Critical patent/WO2017033617A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/4425—Monitoring of client processing errors or hardware failure

Definitions

  • the present invention relates to a technique for dealing with communication failures in a moving image transmission / reception system that transmits and stores moving images.
  • an endoscope apparatus is connected to a personal computer (PC) or a tablet computer wirelessly, and an image under examination is wirelessly transferred to the personal computer or tablet computer for storage.
  • PC personal computer
  • an image under examination is wirelessly transferred to the personal computer or tablet computer for storage.
  • Patent Literature 1 describes a television broadcast receiving apparatus including a tuner unit that wirelessly transfers a television signal to a display unit.
  • the tuner unit is provided with a memory, and that image data is stored in the memory when the communication state deteriorates, and then the image data recorded in the memory is transferred to the display unit.
  • the present invention has been made in view of the above problems, and an object of the present invention is to provide a moving image transmission / reception system capable of storing continuous moving images even if the communication state deteriorates during moving image transfer.
  • the transmission An apparatus includes: a first communication unit that performs wireless communication with the reception device; a first communication control unit that controls the first communication unit; and the moving image data according to a communication state as a first recording medium.
  • the first communication control unit stores the video data in a stream format to the receiving device when the communication state is good. If the communication state is poor, the first communication unit is controlled to stop transmission of the moving image data to the receiving device, and the first recording control unit is poor in the communication state.
  • the moving image data is stored in the first recording medium as a recovery moving image file
  • the first communication control unit After receiving the moving image recording end instruction, the first communication unit is controlled to transmit the recovery moving image file stored in the first recording medium to the receiving device.
  • a second communication unit that performs wireless communication; and the moving image data received in the stream format by the second communication unit is stored in a second recording medium in a stream format, and the second communication unit receives the video data
  • a second recording control unit that stores the recovery moving image file in a file format on a second recording medium.
  • the present invention it is possible to provide a moving image transmission / reception system capable of storing continuous moving images even if the communication state deteriorates during moving image transfer.
  • FIG. 1 is an overall view of a moving image transmission / reception system according to an embodiment. It is a flowchart explaining the procedure of the transmission / reception process of moving image data. It is a figure which shows the process of the moving image data when a communication state is favorable. It is a figure which shows the process of the moving image data when a communication state is bad. It is a figure which shows the process of the moving image data when a communication state recovers from the state of FIG. It is a figure which shows the transfer process of moving image data. It is a figure which shows a moving image data combination process. It is a timing chart explaining a process when a communication state deteriorates repeatedly. It is a figure explaining that a some file is couple
  • FIG. 1 is an overall view of a moving image transmission / reception system 1 according to the present embodiment.
  • the moving image transmission / reception system 1 is a system in which an image captured by a video input device such as a camera is transmitted from a transmission device 100 to a reception device 200 such as a personal computer or a tablet terminal, and stored in the reception device 200.
  • the moving image transmission / reception system 1 is used for recording and storing an inspection image of an endoscope using a medical site, for example, an endoscope as a video input device.
  • the moving image transmission / reception system 1 is used for recording and storing experimental images and microscope observation images in a laboratory or the like.
  • the moving image transmission / reception system 1 includes a transmission device 100 that captures image data input from the video input device 300 and wirelessly transmits it, and a reception device 200 that receives and stores the image data transmitted from the transmission device 100.
  • the video input device 300 may be an endoscope device, a microscope device, a monitoring camera device, or the like that outputs an image signal.
  • the video input device 300 may output, for example, an electric signal representing an image signal by a wire to the transmission device 100, or modulate and output an electric signal to an optical signal or a radio signal. Also good.
  • the transmission device 100 includes a transmission control unit 110, a first recording medium 130, a RAM (Random Access Memory) 140, an instruction unit 150, a first communication unit 160, and a video signal input unit 170.
  • the transmission control unit 110 is a control unit that comprehensively controls the entire transmission apparatus 100.
  • the transmission control unit 110 includes a CPU and a memory, and implements each control process by software processing by the CPU that reads a control program from the memory and executes control according to the control program.
  • the first recording medium 130 is a memory for storing moving image data to be transmitted, and is, for example, an HDD (Hard Disk Drive) or a flash memory. On the first recording medium 130, moving image data during a period in which the communication state is bad is recorded as a recovery moving image file in a file format.
  • HDD Hard Disk Drive
  • flash memory On the first recording medium 130, moving image data during a period in which the communication state is bad is recorded as a recovery moving image file in a file format.
  • the RAM 140 is a temporary storage memory, and is particularly used as a video memory for encoding processing or a buffer area for temporarily storing image data for transmission.
  • the instruction unit 150 is used to input an instruction from the operator to the transmission control unit 110, and is a button, dial, keyboard, touch panel, or the like. A moving image recording start instruction and a moving image recording end instruction are input from the instruction unit 150, and the instruction content is notified to the transmission control unit 110.
  • the instruction unit 150 is also called an operation unit.
  • the first communication unit 160 performs wireless communication with the receiving device 200.
  • the first communication unit 160 is connected to a communication unit (second communication unit 260 described later) on the receiving device 200 side by radio, for example, near field radio such as a wireless LAN (Local Area Network) or Bluetooth (trademark).
  • the first communication unit 160 transmits the encoded image data to the reception device 200 in a stream format or a file format.
  • the first communication unit 160 also transmits / receives various data other than image data to / from the receiving device 200.
  • the video signal input unit 170 inputs an image signal output from the video input device 300.
  • the transmission control unit 110 includes a first recording control unit 112, a first identification data adding unit 114, a moving image data generation unit 116, a first communication control unit 118, and a first communication as functional units realized by the CPU.
  • a state detection unit 120 is included.
  • the first recording control unit 112 controls the recording of image data on the first recording medium 130.
  • the 1st identification data provision part 114 provides the identification data which show the time order in the whole moving image data to the header part of the recovery moving image file, for example. This is because it is combined with other moving image data later to form one file as a whole.
  • the moving image data generation unit 116 compresses and encodes the image signal input to the video signal input unit 170.
  • the moving image data generation unit 116 uses, for example, H.264, MPEG4, or AVI (Audio Video Interleave) as an encoding format.
  • the first communication control unit 118 controls the first communication unit 160 to control transmission of image data to the reception device 200 and transmission / reception of various data performed with the reception device 200 as needed.
  • the first communication state detection unit 120 detects the communication state (line quality) on the transmission device 100 side. For example, the first communication state detection unit 120 detects that the communication state is good on the transmitting device 100 side when the radio wave intensity is equal to or greater than a specified value or the number of access points is equal to or less than a specified value. The communication state is good when image data can be expected to have a predetermined bit rate (for example, 54 Mbps). Further, the first communication state detection unit 120 may detect the communication state using error rate detection and a carrier-to-interference wave ratio (C / I ratio) in addition to the reception intensity and the number of access points.
  • C / I ratio carrier-to-interference wave ratio
  • the transmission processing of image data by the transmission control unit 110 will be briefly described.
  • the communication state is determined when the transmission device 100 performs communication on the transmission device 100 side based on the first communication state detection unit 120 and communication on the reception device 200 side based on information of the second communication state detection unit 220 described later. Judging from both states.
  • the transmission control unit 110 determines that the communication state is good when both the transmission state of the transmission device 100 and the reception device 200 are good. Then, the transmission control unit 110 notifies the reception device 200 of the determination result of the communication state.
  • the first communication control unit 118 converts the image data encoded by the moving image data generation unit 116 into the first communication unit 160 in a stream format. Send from.
  • the first communication control unit 118 stops transmitting image data to the receiving device 200. Instead, the first recording control unit 112 records the moving image data encoded by the moving image data generation unit 116 on the first recording medium 130 as a recovery moving image file in a file format during a period of poor communication. .
  • the 1st identification data provision part 114 provides the identification data which shows the time order in the whole moving image data to a recovery moving image file.
  • the transmission control unit 110 determines that the communication state has been recovered (improved)
  • the first communication control unit 118 resumes transmission of image data in the stream format from the first communication unit 160.
  • the first recording control unit 112 ends the first recovery moving image file.
  • the first communication control unit 118 stops transmitting the image data in the stream format to the receiving device 200 and the first recording control unit 112. Starts creating a new recovery video file (second recovery video file). In the first recording medium 130, recovery moving image files corresponding to the number of transmission interruptions are recorded.
  • the first communication control unit 118 transmits the created recovery moving image files to the receiving apparatus 200 in a file format.
  • the receiving apparatus 200 includes a reception control unit 210, a second recording medium 230, a RAM 240, and a second communication unit 260.
  • the receiving device 200 may be a personal computer, a tablet terminal, or a server having a wireless communication function.
  • the reception control unit 210 is a control unit that comprehensively controls the entire receiving device 200.
  • the reception control unit 210 includes a CPU and a memory, and implements each control process by software processing by the CPU that reads a control program from the memory and executes control according to the control program.
  • the second recording medium 230 is a memory for storing received moving image data, and is, for example, an HDD (Hard Disk Drive) or a flash memory.
  • the RAM 240 is a temporary storage memory, and temporarily stores, for example, when received image data is recorded on the second recording medium 230.
  • the second communication unit 260 performs wireless communication with the transmission device 100.
  • the second communication unit 260 receives stream format image data and a recovery moving image file as image data.
  • the second communication unit 260 also transmits / receives various data other than image data to / from the transmission device 100.
  • the reception control unit 210 includes a second recording control unit 212, a second identification data adding unit 214, a second communication control unit 218, a second communication state detection unit 220, and a moving image as functional units realized by the CPU.
  • a data combination unit 222 is included.
  • the second recording control unit 212 controls image data recording on the second recording medium 230.
  • the second recording control unit 212 stores the image data received in the stream format in the stream format, and stores the recovery moving image file received in the file format in the file format. Also, the second recording control unit 212 saves the moving image data saved in the stream format as a file at a predetermined timing.
  • a stream of moving image data is referred to as a first moving image file.
  • the second identification data adding unit 214 adds identification data indicating the order of time in the entire moving image data to, for example, the header portion of the first moving image file. This is because the first moving image file which is a moving image file in a stream format is combined with the recovery moving image file later to form one file as a whole.
  • the second communication control unit 218 controls the second communication unit 260 to control reception of image data from the transmission device 100 and transmission / reception of various data performed with the transmission device 100 as needed.
  • the second communication state detection unit 220 detects the communication state (line quality) on the receiving device 200 side. Since the detection method is the same as that of the first communication state detection unit 120, description thereof is omitted.
  • the moving image data combining unit 222 combines the first moving image file and the recovery moving image file stored in the second recording medium 230 into one file in the recording order (in time series order).
  • the image data reception and storage process performed by the reception control unit 210 will be briefly described.
  • the second communication unit 260 receives stream format image data transmitted from the transmission device 100. As described above, whether or not the communication state is good is notified from the transmission device 100.
  • the second recording control unit 212 stores the received image data in the second recording medium 230 in a stream format.
  • the transmission from the transmission device 100 is stopped, so the second communication unit 260 does not receive the image data.
  • the second recording control unit 212 converts the image data saved in the stream format on the second recording medium 230 into the first moving image file, saves it,
  • the second identification data adding unit 214 adds identification data to the first moving image file.
  • the second recording control unit 212 stores the image data in the stream format received after the resume in the second recording medium 230 in the stream format.
  • the second recording control unit 212 converts the image data stored in the stream format on the second recording medium 230 into the first moving image file.
  • the second recording control unit 212 stores the recovery moving image file transmitted from the transmission device 100 in the second recording medium 230.
  • the moving image data combining unit 222 arranges the recovery moving image file and the first moving image file stored in the second recording medium 230 in the recording order (in chronological order) based on the identification data attached to each file. Join.
  • FIG. 2 is a flowchart for explaining the procedure of moving image data transmission / reception processing.
  • the procedure of moving image data transmission / reception processing will be described with reference to FIGS. 3 to 7 showing the moving image data processing in each scene.
  • a moving image recording start instruction is input from the instruction unit 150 and recording of image data is started.
  • An image signal output from the video input device 300 is input to the video signal input unit 170, encoded by the moving image data generation unit 116, and converted into moving image data.
  • the first communication state detection unit 120 monitors the communication state of the transmission device 100
  • the second communication state detection unit 220 monitors the communication state of the reception device 200 (step S10).
  • the transmission control unit 110 determines whether the communication state on the transmission device 100 side is good based on the information of the first communication state detection unit 120 (step S12).
  • the transmission control unit 110 uses the information of the second communication state detection unit 220 to determine the communication state on the reception device 200 side. Is good (step S14).
  • Information on the communication state detected by the second communication state detection unit 220 is transmitted to the transmission device 100.
  • the transmission control unit 110 determines that the communication state on the receiving device 200 side is good based on the information from the second communication state detection unit 220 (Yes in step S14), the first communication control unit 118 The encoded moving image data is transmitted from the communication unit 160 in a stream format (step S16).
  • the second communication unit 260 of the receiving device 200 receives the moving image data in the stream format.
  • the second recording control unit 212 of the receiving device 200 stores the moving image data in the second recording medium 230 in the stream format (step S18).
  • the transmission control unit 110 determines whether there is a moving image recording end instruction from the instruction unit 150 (step S26). When determining that there is no moving image recording end instruction (No in step S26), the transmission control unit 110 returns to step S10.
  • FIG. 3 is a diagram showing processing of moving image data when the communication state is good in step S16 and step S18.
  • the moving image data is transmitted from the first communication unit 160 to the second communication unit 260 in a stream format, and stored in the second recording medium 230 in a stream format.
  • the transmission control unit 110 determines that the communication state on the transmission device 100 side is not good based on the information of the first communication state detection unit 120 (No in step S ⁇ b> 12), or the second communication state detection
  • the transmitting device 100 shifts to the recovery mode (step S20).
  • the transmission control unit 110 determines the transition to the recovery mode and notifies the receiving apparatus 200 of the transition to the recovery mode.
  • the first recording control unit 112 of the transmission device 100 stores the image data encoded by the moving image data generation unit 116 as a recovery moving image file in the file format in the first recording medium 130 (step S22).
  • the second recording control unit 212 of the receiving device 200 converts the moving image data in the stream format stored in the second recording medium 230 during the period in which the communication state is good (step S24). ).
  • the second identification data adding unit 214 adds identification data to the first moving image file.
  • FIG. 4 is a diagram showing processing of moving image data when the communication state is bad in step S22 and step S24.
  • the first recording control unit 112 stores the encoded moving image data generated by the moving image data generation unit 116 in the first recording medium 130 as a recovery moving image file.
  • the recovery moving image file is illustrated as a moving image file 2R.
  • the second recording control unit 212 converts the stream format moving image data stored in the second recording medium 230 during a period in which the communication state is good into the first moving image file.
  • the second identification data adding unit 214 adds identification data to the first moving image file.
  • the first moving image file is illustrated as moving image file 1.
  • FIG. 5 is a diagram showing processing of moving image data when the communication state is recovered from the state of FIG.
  • the first communication control unit 118 transmits moving image data in a stream format.
  • the first recording medium 130 stores a recovery moving image file (moving image file 2R).
  • the second recording control unit 212 stores the moving image data transmitted in the stream format in the second recording medium 230 in the stream format.
  • the second recording medium 230 stores a first moving image file (moving image file 1) and stream format image data.
  • the transmission control unit 110 determines whether there is an instruction to end moving image recording (Yes in step S26).
  • the transmission control unit 110 determines whether there is an untransferred image on the first recording medium 130 of the transmission device 100 (step S30).
  • An untransferred image is a recovery moving image file of the first recording medium 130.
  • the transmission control unit 110 determines that there is no untransferred image on the first recording medium 130 of the transmission device 100 (No in step S30)
  • the transmission control unit 110 executes a recording end process of the transmission device 100 (step S36).
  • the transmission control unit 110 transmits information on the end of recording to the receiving device 200.
  • the reception control unit 210 executes a recording end process of the receiving device 200.
  • the transmission control unit 110 determines that there is an untransferred image on the first recording medium 130 of the transmission device 100 (Yes in step S30)
  • the first communication control unit 118 transmits the recovery video file to the reception device 200 ( Step S32).
  • the receiving device 200 receives the recovery moving image file.
  • the second recording control unit 212 converts the stored image data stored in the second recording medium 230 into a file.
  • the second identification data adding unit 214 adds identification data to image data to be filed.
  • the moving image data combining unit 222 combines the received recovery moving image file with another file stored in the second recording medium 230 (step S34).
  • the moving image data combining unit 222 combines the recovery moving image file and other files in time order to generate one moving image file as a whole.
  • FIG. 6 is a diagram showing the moving image data transfer process in step S32.
  • the first communication unit 160 transmits the recovery moving image file to the receiving device 200.
  • the second recording control unit 212 stores the received recovery moving image file (moving image file 2R) in the second recording medium 230. Further, the second recording control unit 212 converts the remaining stream-format moving image data into a moving image file.
  • the converted moving image file is indicated as moving image file 3. Movie file 1 is a movie that has already been filed.
  • FIG. 7 is a diagram showing the moving image data combining process in step S34.
  • the second recording medium 230 stores the moving image file 1, the moving image file 3, and the recovery moving image file 2R.
  • the recording order is the moving image file 1, the recovery moving image file 2R, and the moving image file 3.
  • the moving image data combining unit 222 combines the moving image file 1, the recovery moving image file 2R, and the moving image file 3 in the recording order to generate the moving image file S.
  • step S ⁇ b> 34 the process proceeds to step S ⁇ b> 36, and the transmission device 100 and the reception device 200 perform the recording end process.
  • the first recording control unit 112 deletes the recovery image file stored in the first recording medium 130 after the transfer.
  • FIGS. 3 to 7 show an example in which the communication state is deteriorated only once during recording in order to avoid complicated explanation, but the same is true even when interruptions occur multiple times.
  • FIG. 8 is a timing chart for explaining processing when the communication state repeatedly deteriorates. Suppose that time advances to the right. The upper row shows the operation timing of the instruction unit 150, the middle row shows the image data stored in the second recording medium 230, and the lower row shows the recovery image file stored in the first recording medium 130.
  • the image data encoded by the moving image data generation unit 116 is stored as stream-format image data in the second recording medium 230. It is stored in the first recording medium 130 as a recovery moving image file.
  • the image data transmitted in the stream format is stored in the second recording medium 230 in the stream format (filed to become the file 1).
  • the file 2R is stored in the first recording medium 130 as a recovery moving image file. Thereafter, it is assumed that communication state recovery and deterioration are repeated.
  • the image data transmitted in the stream format is filed on the second recording medium 230 and stored as file 1, file 3, and file 5.
  • the first recording medium 130 stores a file 2R, a file 4R, and a file 6R.
  • the file 2R, the file 4R, and the file 6R are transferred to the receiving device 200 and stored in the second recording medium 230. Finally, the image data saved in the stream format is converted into a file 7. Then, the seven files are combined in the order shown in FIG. 9, one file is generated, and the image recording process is completed.
  • the transfer timing of the recovery video file to the receiving device 200 is set after the end of recording, there is no possibility of disturbing image data transmission during recording.
  • identification information indicating the order of time (recording order) in the entire moving picture data is added to the individual files of the recovery moving picture file and the first moving picture file, it becomes easy to combine them in the order of recording.
  • the image data that has been stored in the second recording medium 230 in the stream format up to that point is converted into a file and used as the first moving image file, so that the free time of the receiving device 200 can be used effectively.
  • the moving image transmission / reception system 1 can be stopped when shooting (for example, inspection) is completed. Smoothly move to the next shooting (inspection).
  • the transmission device 100 may be a video processor connected to the endoscope.
  • the video processor includes a light source integrated type in which a video processor and a light source device for supplying illumination light to the endoscope are integrally provided, a separate light source type in which the video processor and the light source device are configured separately, a video processor, Any type in which the light source function is built in the endoscope may be used.
  • Endoscopes used are flexible endoscopes (electronic scope type equipped with an imaging device at the distal end of the endoscope insertion portion), flexible endoscopes (optical images formed by the optical system at the distal end of the insertion portion).
  • a white LED light source device RGB individual LED light source devices, laser light source devices, lamp light source devices, and the like can be used.
  • the instruction unit 150 may be a button provided on the front panel of the video processor or the light source device.
  • the instruction unit 150 may be a touch panel provided on the front panel of the video processor or the light source device.
  • the instruction unit 150 may be a keyboard connected to the video processor, or a switch provided on the grasping unit of the endoscope scope.
  • the instruction unit 150 has been described as being provided in the transmission device 100, but may be provided in the reception device 200.
  • a time stamp attached to the image data may be used as the recording order of the recovery moving image file and the first moving image file.
  • you may give the file name of a recovery moving image file or a 1st moving image file in order of recording time. For example, 0001.mpg, 0002.mpg, and 0003.mpg.
  • the image data for recovery may be stored in the first recording medium in the stream format instead of the file format, and may be transmitted to the receiving apparatus in the stream format.
  • the present invention is not limited to this, and the recovery moving image file may be transmitted from the transmitting device to the receiving device before the recording ends.
  • the communication state detection unit may be simply mounted on either the transmission device 100 or the reception device 200.
  • -Transmission control part 110 and reception control part 210 are not limited to what is realized by software processing by CPU which read the control program, and a part or all may be constituted by hardware.
  • Transmission apparatus 110 Transmission control part 112 1st recording control part 114 1st identification data provision part 116 Movie data generation part 118 1st communication control part 120 1st communication state detection part 130 1st Recording medium 140 RAM 150 instruction unit 160 first communication unit 170 video signal input unit 200 receiving device 210 reception control unit 212 second recording control unit 214 second identification data adding unit 218 second communication control unit 220 second communication state detection Unit 222 moving image data combination unit 230 second recording medium 240 RAM 260 Second communication unit 300 Video input device

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

In a moving image transmission and reception system, a first communication control unit 118 of a transmission device 100 transmits moving image data in a stream format when a communication state is good, and stops the transmission of the moving image data when the communication state is bad, a first recording control unit 112 stores the moving image data as a recovery moving image file in a first recording medium when the communication state is bad, the first communication control unit transmits the recovery moving image file after receiving a moving image recording end instruction, and a reception device 200 stores the moving image data received in the stream format in a second recording medium 230 in a stream format, and stores the recovery moving image file in the second recording medium.

Description

動画像送受信システムVideo transmission / reception system
　本発明は、動画像を送信して保存する動画像送受信システムにおける、通信障害に対処する技術に関する。 The present invention relates to a technique for dealing with communication failures in a moving image transmission / reception system that transmits and stores moving images.
　近年、動画圧縮技術の進歩や通信速度の高速化等で、動画像送信の環境が整備され、家庭や事業所で、無線ＬＡＮ(Local Area Network)等を利用した高画質動画の転送が手軽に利用される。医療分野でも、カメラや内視鏡装置等の画像機器からの動画像の無線通信が進められている。医療現場での無線通信化は、種々設置される医療機器間を接続するケーブルの煩雑さを解消するためでもある。 In recent years, with the advancement of video compression technology and higher communication speeds, the environment for moving image transmission has been improved, making it easy to transfer high-quality video using a wireless local area network (LAN) at home or office. Used. Also in the medical field, wireless communication of moving images from image devices such as cameras and endoscope devices is being promoted. Wireless communication at a medical site is also for eliminating the complexity of cables connecting various medical devices installed.
　医療分野では、例えば、内視鏡装置とパソコン(Personal Computer)やタブレット型コンピュータが無線で接続され、検査中の画像が無線でパソコンやタブレット型コンピュータに転送され、保存されるようセットされる。検査時に、体内の撮影データを同時にパソコン等に保存することで、診察終了後に、改めて画像をパソコン等に転送する手間が省け、効率がよくなる。また、医療分野以外の例えば研究所でも、顕微鏡の画像やカメラのモニタ画像を無線で送信して、パソコン等に保存記録することが行われる。 In the medical field, for example, an endoscope apparatus is connected to a personal computer (PC) or a tablet computer wirelessly, and an image under examination is wirelessly transferred to the personal computer or tablet computer for storage. By saving the in-vivo imaging data simultaneously to a personal computer or the like at the time of the examination, it is possible to save the trouble of transferring the image to the personal computer or the like after completion of the examination, thereby improving efficiency. Also, in laboratories other than the medical field, for example, microscope images and camera monitor images are transmitted wirelessly and stored and recorded in a personal computer or the like.
　一方、データ回線の容量は一定であるので、同時に多人数が使用したり、あるいは大容量のデータが送信されると、送信中断等の不具合が発生することがある。特に、無線の場合には、無線伝送路に障害物があったり、妨害電波やノイズが入ると、安定した動画像の送信ができなくなる。 On the other hand, since the capacity of the data line is constant, if a large number of people use it at the same time or if a large amount of data is transmitted, problems such as transmission interruption may occur. In particular, in the case of wireless communication, if there are obstacles in the wireless transmission path, or if disturbing radio waves or noise enter, stable moving images cannot be transmitted.
　そこで、動画像の送信中に中断が発生した場合の対策が種々提案されている。例えば、特許文献１には、テレビ信号を表示部に無線で転送するチューナ部を備えるテレビ放送受信装置についてが記載されている。このテレビ放送受信装置では、チューナ部にメモリが備えられ、通信状態悪化時にメモリに画像データを蓄積し、その後メモリに記録した画像データを表示部に転送することが提案されている。 Therefore, various countermeasures have been proposed in the case where an interruption occurs during moving image transmission. For example, Patent Literature 1 describes a television broadcast receiving apparatus including a tuner unit that wirelessly transfers a television signal to a display unit. In this television broadcast receiving apparatus, it has been proposed that the tuner unit is provided with a memory, and that image data is stored in the memory when the communication state deteriorates, and then the image data recorded in the memory is transferred to the display unit.
特開２０１０－１２４３４１号公報JP 2010-124341 A
　撮影機器を使用する事業所、例えば、病院の検査室内や顕微鏡を使用するラボ環境内等では、他の医療機器や計測機器が作動していたり、人が移動したりもするので、通信状態が一定ではない。特に送信される動画像が高画質の場合には、高い転送レートに対応して要求される通信環境のレベルも高くなり、その分だけ通信状態が必要な通信環境レベルを下回るケースが増えるので、通信に中断が生じて保存する画像にとぎれが発生する可能性も多くなる。 In business establishments that use photographic equipment, such as in the laboratory of a hospital or in a laboratory environment that uses a microscope, other medical equipment and measuring equipment are operating or people are moving, so the communication status is It is not constant. Especially when the moving image to be transmitted has a high image quality, the level of the communication environment required corresponding to the high transfer rate becomes high, and the number of cases where the communication state is lower than the required communication environment level increases accordingly. There is also a high possibility that interruptions occur in communication and interruptions occur in the stored images.
　本願発明は、上記課題に鑑み、動画像転送中に通信状態が悪化しても、連続した動画像の保存が可能な動画送受信システムを提供することを目的とする。 The present invention has been made in view of the above problems, and an object of the present invention is to provide a moving image transmission / reception system capable of storing continuous moving images even if the communication state deteriorates during moving image transfer.
　上記目的を達成するために、入力される動画像に基づく動画データを無線送信する送信装置と、前記無線送信された動画データを受信して記録する受信装置を有する動画像送受信システムにおいて、前記送信装置は、前記受信装置と無線通信を行う第１の通信部と、前記第１の通信部を制御する第１の通信制御部と、通信状態に応じて、前記動画データを第１の記録媒体に保存する第１の記録制御部とを備え、前記第１の通信制御部は、通信状態が良好な場合には前記動画データをストリーム形式で前記受信装置に送信するよう前記第１の通信部を制御し、前記通信状態が悪い場合には前記受信装置への前記動画データの送信を停止するよう前記第１の通信部を制御し、前記第１の記録制御部は、前記通信状態が悪い場合に前記第１の通信制御部により前記受信装置への前記動画データの送信が停止された場合に、前記動画データをリカバリ動画ファイルとして前記第１の記録媒体に保存し、更に、前記第１の通信制御部は、前記動画像記録終了指示を受けた後に、前記第１の記録媒体に保存されたリカバリ動画ファイルを前記受信装置に送信するよう前記第１の通信部を制御し、前記受信装置は、前記送信装置と無線通信を行う第２の通信部と、前記第２の通信部により前記ストリーム形式で受信した前記動画データをストリーム形式で第２の記録媒体に保存し、前記第２の通信部により受信した前記リカバリ動画ファイルをファイル形式で第２の記録媒体に保存する第２の記録制御部と、を備える。 In order to achieve the above object, in the moving image transmission / reception system comprising: a transmitting device that wirelessly transmits moving image data based on an input moving image; and a receiving device that receives and records the wirelessly transmitted moving image data, the transmission An apparatus includes: a first communication unit that performs wireless communication with the reception device; a first communication control unit that controls the first communication unit; and the moving image data according to a communication state as a first recording medium. The first communication control unit stores the video data in a stream format to the receiving device when the communication state is good. If the communication state is poor, the first communication unit is controlled to stop transmission of the moving image data to the receiving device, and the first recording control unit is poor in the communication state. If the first communication When the transmission of the moving image data to the receiving device is stopped by the control unit, the moving image data is stored in the first recording medium as a recovery moving image file, and the first communication control unit After receiving the moving image recording end instruction, the first communication unit is controlled to transmit the recovery moving image file stored in the first recording medium to the receiving device. A second communication unit that performs wireless communication; and the moving image data received in the stream format by the second communication unit is stored in a second recording medium in a stream format, and the second communication unit receives the video data A second recording control unit that stores the recovery moving image file in a file format on a second recording medium.
　本発明によれば、動画像転送中に通信状態が悪化しても、連続した動画像の保存が可能な動画送受信システムを提供することができる。 According to the present invention, it is possible to provide a moving image transmission / reception system capable of storing continuous moving images even if the communication state deteriorates during moving image transfer.
本実施形態に係る動画像送受信システムの全体図である。1 is an overall view of a moving image transmission / reception system according to an embodiment. 動画データの送受信処理の手順を説明するフローチャートである。It is a flowchart explaining the procedure of the transmission / reception process of moving image data. 通信状態が良好な場合の動画データの処理を示す図である。It is a figure which shows the process of the moving image data when a communication state is favorable. 通信状態が悪い場合の動画データの処理を示す図である。It is a figure which shows the process of the moving image data when a communication state is bad. 通信状態が図４の状態から回復した場合の動画データの処理を示す図である。It is a figure which shows the process of the moving image data when a communication state recovers from the state of FIG. 動画データの転送処理を示す図である。It is a figure which shows the transfer process of moving image data. 動画データ結合処理を示す図である。It is a figure which shows a moving image data combination process. 通信状態が繰り返し悪化した場合の処理を説明するタイミングチャートである。It is a timing chart explaining a process when a communication state deteriorates repeatedly. 複数のファイルが時間順に結合されて１つのファイルが生成されるのを説明する図である。It is a figure explaining that a some file is couple | bonded in time order and one file is produced | generated.
　以下、図面に従って本発明の実施形態を説明する。図１は、本実施形態に係る動画像送受信システム１の全体図である。動画像送受信システム１は、カメラ等の映像入力装置で撮影された画像を、送信装置１００からパソコンやタブレット型端末等である受信装置２００に送信して、受信装置２００で保存するシステムである。動画像送受信システム１は、医療現場、例えば、内視鏡を映像入力装置とし、内視鏡の検査画像の記録保存に利用される。あるいは、動画像送受信システム１は、ラボ等で実験画像や顕微鏡観察画像の記録保存に利用される。 Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is an overall view of a moving image transmission / reception system 1 according to the present embodiment. The moving image transmission / reception system 1 is a system in which an image captured by a video input device such as a camera is transmitted from a transmission device 100 to a reception device 200 such as a personal computer or a tablet terminal, and stored in the reception device 200. The moving image transmission / reception system 1 is used for recording and storing an inspection image of an endoscope using a medical site, for example, an endoscope as a video input device. Alternatively, the moving image transmission / reception system 1 is used for recording and storing experimental images and microscope observation images in a laboratory or the like.
　動画像送受信システム１は、映像入力装置３００から入力される画像データを取り込んで無線送信する送信装置１００と、送信装置１００から送信される画像データを受信して保存する受信装置２００を有する。映像入力装置３００は、具体的には、内視鏡装置、顕微鏡装置、監視カメラ装置等々で、画像信号を出力するものであればよい。また、映像入力装置３００は、例えばワイヤによって画像信号を表す電気信号を送信装置１００に出力するものであっても良いし、電気信号を光信号や無線信号に変調して出力するものであっても良い。 The moving image transmission / reception system 1 includes a transmission device 100 that captures image data input from the video input device 300 and wirelessly transmits it, and a reception device 200 that receives and stores the image data transmitted from the transmission device 100. Specifically, the video input device 300 may be an endoscope device, a microscope device, a monitoring camera device, or the like that outputs an image signal. Further, the video input device 300 may output, for example, an electric signal representing an image signal by a wire to the transmission device 100, or modulate and output an electric signal to an optical signal or a radio signal. Also good.
〈送信装置の構成〉
　まず、送信装置１００の主な構成から説明する。送信装置１００は、送信制御部１１０、第１の記録媒体１３０、ＲＡＭ（Random Access Memory）１４０、指示部１５０、第１の通信部１６０及び映像信号入力部１７０を有する。送信制御部１１０は、送信装置１００全体を統括的に制御する制御部である。送信制御部１１０は、ＣＰＵとメモリを有し、メモリから制御プログラムを読み出し制御プログラムに従った制御を実行するＣＰＵによるソフトウェア処理により、各制御処理を実現する。 <Configuration of transmitter>
First, the main configuration of the transmission apparatus 100 will be described. The transmission device 100 includes a transmission control unit 110, a first recording medium 130, a RAM (Random Access Memory) 140, an instruction unit 150, a first communication unit 160, and a video signal input unit 170. The transmission control unit 110 is a control unit that comprehensively controls the entire transmission apparatus 100. The transmission control unit 110 includes a CPU and a memory, and implements each control process by software processing by the CPU that reads a control program from the memory and executes control according to the control program.
　第１の記録媒体１３０は、送信される動画データを記憶するメモリで、例えばＨＤＤ（Hard Disk Drive）やフラッシュメモリである。第１の記録媒体１３０には、通信状態が悪い期間中の動画データがファイル形式のリカバリ動画ファイルとして記録される。 The first recording medium 130 is a memory for storing moving image data to be transmitted, and is, for example, an HDD (Hard Disk Drive) or a flash memory. On the first recording medium 130, moving image data during a period in which the communication state is bad is recorded as a recovery moving image file in a file format.
　ＲＡＭ１４０は、一時記憶メモリで、特に符号化処理用のビデオメモリあるいは送信する際の画像データを一時的に格納するバッファーエリアとして用いられる。 The RAM 140 is a temporary storage memory, and is particularly used as a video memory for encoding processing or a buffer area for temporarily storing image data for transmission.
　指示部１５０は、操作者から送信制御部１１０への指示を入力するもので、ボタン、ダイヤル、キーボードあるいはタッチパネル等である。指示部１５０から、動画像記録開始指示及び動画像記録終了指示が入力され、指示内容が送信制御部１１０に通知される。指示部１５０は、操作部とも呼ばれる。 The instruction unit 150 is used to input an instruction from the operator to the transmission control unit 110, and is a button, dial, keyboard, touch panel, or the like. A moving image recording start instruction and a moving image recording end instruction are input from the instruction unit 150, and the instruction content is notified to the transmission control unit 110. The instruction unit 150 is also called an operation unit.
　第１の通信部１６０は、受信装置２００と無線通信を行うものである。第１の通信部１６０は、受信装置２００側の通信部（後述する第２の通信部２６０）と無線、例えば、無線ＬＡＮ（Local Area Network）やBluetooth（商標）等の近距離無線で接続される。第１の通信部１６０は、符号化された画像データをストリーム形式やファイル形式で受信装置２００に送信する。また、第１の通信部１６０は、受信装置２００と、画像データ以外の各種データの送受信も行う。映像信号入力部１７０は、映像入力装置３００から出力される画像信号を入力する。 The first communication unit 160 performs wireless communication with the receiving device 200. The first communication unit 160 is connected to a communication unit (second communication unit 260 described later) on the receiving device 200 side by radio, for example, near field radio such as a wireless LAN (Local Area Network) or Bluetooth (trademark). The The first communication unit 160 transmits the encoded image data to the reception device 200 in a stream format or a file format. The first communication unit 160 also transmits / receives various data other than image data to / from the receiving device 200. The video signal input unit 170 inputs an image signal output from the video input device 300.
　送信制御部１１０は、ＣＰＵにより実現される機能部として、第１の記録制御部１１２、第１の識別データ付与部１１４、動画データ生成部１１６、第１の通信制御部１１８及び第１の通信状態検知部１２０を有する。 The transmission control unit 110 includes a first recording control unit 112, a first identification data adding unit 114, a moving image data generation unit 116, a first communication control unit 118, and a first communication as functional units realized by the CPU. A state detection unit 120 is included.
　第１の記録制御部１１２は、第１の記録媒体１３０への画像データの記録を制御する。
　第１の識別データ付与部１１４は、リカバリ動画ファイルの例えばヘッダー部に、動画データ全体の中での時間順を示す識別データを付与する。後で、他の動画データと結合して、全体として１つのファイルにするためである。 The first recording control unit 112 controls the recording of image data on the first recording medium 130.
The 1st identification data provision part 114 provides the identification data which show the time order in the whole moving image data to the header part of the recovery moving image file, for example. This is because it is combined with other moving image data later to form one file as a whole.
　動画データ生成部１１６は、映像信号入力部１７０に入力された画像信号を、圧縮して符号化する。動画データ生成部１１６は、符号化形式として、例えばＨ.２６４、ＭＰＥＧ４あるいはＡＶＩ（Audio Video Interleave）等を利用する。 The moving image data generation unit 116 compresses and encodes the image signal input to the video signal input unit 170. The moving image data generation unit 116 uses, for example, H.264, MPEG4, or AVI (Audio Video Interleave) as an encoding format.
　第１の通信制御部１１８は、第１の通信部１６０を制御して、受信装置２００への画像データの送信や、受信装置２００と随時行われる各種データの送受信を制御する。 The first communication control unit 118 controls the first communication unit 160 to control transmission of image data to the reception device 200 and transmission / reception of various data performed with the reception device 200 as needed.
　第１の通信状態検知部１２０は、送信装置１００側の通信状態（回線品質）を検知する。第１の通信状態検知部１２０は、例えば、送信装置１００側で、電波強度が規定以上の場合やアクセスポイント数が規定値以下の場合に、通信状態が良好であると検知する。通信状態が良好とは、画像データが、所定のビットレート（例えば、５４Ｍｂｐｓ）が期待できる場合である。また、第１の通信状態検知部１２０は、受信強度やアクセスポイント数以外に、エラーレート検出、搬送波対干渉波比（Ｃ／Ｉ比）を利用して、通信状態を検知しても良い。 The first communication state detection unit 120 detects the communication state (line quality) on the transmission device 100 side. For example, the first communication state detection unit 120 detects that the communication state is good on the transmitting device 100 side when the radio wave intensity is equal to or greater than a specified value or the number of access points is equal to or less than a specified value. The communication state is good when image data can be expected to have a predetermined bit rate (for example, 54 Mbps). Further, the first communication state detection unit 120 may detect the communication state using error rate detection and a carrier-to-interference wave ratio (C / I ratio) in addition to the reception intensity and the number of access points.
　送信制御部１１０による画像データの送信処理を簡単に説明する。なお、通信状態は、送信装置１００が、第１の通信状態検知部１２０に基づく送信装置１００側の通信状態と、後述する第２の通信状態検知部２２０の情報に基づく受信装置２００側の通信状態の両方から判定する。送信制御部１１０は、送信装置１００と受信装置２００の通信状態が共に良い場合に、通信状態が良好と判定する。そして、送信制御部１１０は、通信状態の判定結果を受信装置２００に通知する。 The transmission processing of image data by the transmission control unit 110 will be briefly described. Note that the communication state is determined when the transmission device 100 performs communication on the transmission device 100 side based on the first communication state detection unit 120 and communication on the reception device 200 side based on information of the second communication state detection unit 220 described later. Judging from both states. The transmission control unit 110 determines that the communication state is good when both the transmission state of the transmission device 100 and the reception device 200 are good. Then, the transmission control unit 110 notifies the reception device 200 of the determination result of the communication state.
　送信制御部１１０が通信状態が良好と判定している期間中は、第１の通信制御部１１８は、動画データ生成部１１６で符号化された画像データを、ストリーム形式で第１の通信部１６０から送信する。 During the period when the transmission control unit 110 determines that the communication state is good, the first communication control unit 118 converts the image data encoded by the moving image data generation unit 116 into the first communication unit 160 in a stream format. Send from.
　送信制御部１１０が通信状態が悪いと判定している期間中は、第１の通信制御部１１８は、受信装置２００への画像データの送信を停止する。代りに、第１の記録制御部１１２は、通信状態の悪い期間中は、動画データ生成部１１６によって符号化された動画データを、リカバリ動画ファイルとしてファイル形式で第１の記録媒体１３０に記録する。第１の識別データ付与部１１４は、リカバリ動画ファイルに、動画データ全体の中での時間順を示す識別データを付与する。 During the period when the transmission control unit 110 determines that the communication state is bad, the first communication control unit 118 stops transmitting image data to the receiving device 200. Instead, the first recording control unit 112 records the moving image data encoded by the moving image data generation unit 116 on the first recording medium 130 as a recovery moving image file in a file format during a period of poor communication. . The 1st identification data provision part 114 provides the identification data which shows the time order in the whole moving image data to a recovery moving image file.
　そして、送信制御部１１０が通信状態が回復した（良くなった）と判定すると、第１の通信制御部１１８は、第１の通信部１６０からのストリーム形式での画像データの送信を再開する。あわせて、第１の記録制御部１１２は、１つ目のリカバリ動画ファイルを、終了させる。 When the transmission control unit 110 determines that the communication state has been recovered (improved), the first communication control unit 118 resumes transmission of image data in the stream format from the first communication unit 160. In addition, the first recording control unit 112 ends the first recovery moving image file.
　そして、送信制御部１１０が通信状態が再度悪化したと判定すると、第１の通信制御部１１８は、受信装置２００へのストリーム形式での画像データの送信を停止し、第１の記録制御部１１２は、新たなリカバリ動画ファイル（２つ目のリカバリ動画ファイル）の作成を開始する。第１の記録媒体１３０には、送信中断回数分のリカバリ動画ファイルが記録されることになる。 When the transmission control unit 110 determines that the communication state has deteriorated again, the first communication control unit 118 stops transmitting the image data in the stream format to the receiving device 200 and the first recording control unit 112. Starts creating a new recovery video file (second recovery video file). In the first recording medium 130, recovery moving image files corresponding to the number of transmission interruptions are recorded.
　指示部１５０から動画像記録終了指示が入力されると、第１の通信制御部１１８は、作成されたリカバリ動画ファイルを、ファイル形式で、まとめて受信装置２００に送信する。 When a moving image recording end instruction is input from the instruction unit 150, the first communication control unit 118 transmits the created recovery moving image files to the receiving apparatus 200 in a file format.
〈受信装置の構成〉
　次に、受信装置２００の主な構成につき説明する。受信装置２００は、受信制御部２１０、第２の記録媒体２３０、ＲＡＭ２４０及び第２の通信部２６０を有する。受信装置２００は、無線通信機能を備えるパソコンやタブレット型端末あるいはサーバであってもよい。 <Receiver configuration>
Next, the main configuration of the receiving apparatus 200 will be described. The receiving apparatus 200 includes a reception control unit 210, a second recording medium 230, a RAM 240, and a second communication unit 260. The receiving device 200 may be a personal computer, a tablet terminal, or a server having a wireless communication function.
　受信制御部２１０は、受信装置２００全体を統括的に制御する制御部である。受信制御部２１０は、ＣＰＵとメモリを有し、メモリから制御プログラムを読み出し制御プログラムに従った制御を実行するＣＰＵによるソフトウェア処理により、各制御処理を実現する。 The reception control unit 210 is a control unit that comprehensively controls the entire receiving device 200. The reception control unit 210 includes a CPU and a memory, and implements each control process by software processing by the CPU that reads a control program from the memory and executes control according to the control program.
　第２の記録媒体２３０は、受信される動画データを記憶するメモリで、例えばＨＤＤ（Hard Disk Drive）やフラッシュメモリである。ＲＡＭ２４０は、一時記憶メモリで、例えば、受信される画像データを第２の記録媒体２３０に記録する際に一時的に格納する。 The second recording medium 230 is a memory for storing received moving image data, and is, for example, an HDD (Hard Disk Drive) or a flash memory. The RAM 240 is a temporary storage memory, and temporarily stores, for example, when received image data is recorded on the second recording medium 230.
　第２の通信部２６０は、送信装置１００と無線通信を行うものである。第２の通信部２６０は、画像データとして、ストリーム形式の画像データやリカバリ動画ファイルを受信する。また、第２の通信部２６０は、送信装置１００と、画像データ以外の各種データの送受信も行う。 The second communication unit 260 performs wireless communication with the transmission device 100. The second communication unit 260 receives stream format image data and a recovery moving image file as image data. The second communication unit 260 also transmits / receives various data other than image data to / from the transmission device 100.
　受信制御部２１０は、ＣＰＵにより実現される機能部として、第２の記録制御部２１２、第２の識別データ付与部２１４、第２の通信制御部２１８、第２の通信状態検知部２２０及び動画データ結合部２２２を有する。 The reception control unit 210 includes a second recording control unit 212, a second identification data adding unit 214, a second communication control unit 218, a second communication state detection unit 220, and a moving image as functional units realized by the CPU. A data combination unit 222 is included.
　第２の記録制御部２１２は、第２の記録媒体２３０への画像データ記録を制御する。第２の記録制御部２１２は、ストリーム形式で受信された画像データをストリーム形式で保存し、ファイル形式で受信されたリカバリ動画ファイルはファイル形式で保存する。また、第２の記録制御部２１２は、ストリーム形式で保存した動画データを、所定のタイミングでファイル化して保存する。ストリーム形式の動画データがファイル化されたものを、第１動画ファイルと呼ぶ。 The second recording control unit 212 controls image data recording on the second recording medium 230. The second recording control unit 212 stores the image data received in the stream format in the stream format, and stores the recovery moving image file received in the file format in the file format. Also, the second recording control unit 212 saves the moving image data saved in the stream format as a file at a predetermined timing. A stream of moving image data is referred to as a first moving image file.
　第２の識別データ付与部２１４は、第１動画ファイルの例えばヘッダー部に、動画データ全体の中での時間順を示す識別データを付与する。後で、ストリーム形式の動画ファイルである第１動画ファイルをリカバリ動画ファイルと結合して、全体として１つのファイルにするためである。 The second identification data adding unit 214 adds identification data indicating the order of time in the entire moving image data to, for example, the header portion of the first moving image file. This is because the first moving image file which is a moving image file in a stream format is combined with the recovery moving image file later to form one file as a whole.
　第２の通信制御部２１８は、第２の通信部２６０を制御して、送信装置１００からの画像データの受信や、送信装置１００と随時行われる各種データの送受信を制御する。第２の通信状態検知部２２０は、受信装置２００側の通信状態（回線品質）を検知する。検知方法は、第１の通信状態検知部１２０と同様なので、説明は、省略する。 The second communication control unit 218 controls the second communication unit 260 to control reception of image data from the transmission device 100 and transmission / reception of various data performed with the transmission device 100 as needed. The second communication state detection unit 220 detects the communication state (line quality) on the receiving device 200 side. Since the detection method is the same as that of the first communication state detection unit 120, description thereof is omitted.
　動画データ結合部２２２は、第２の記録媒体２３０に保存された第１動画ファイルとリカバリ動画ファイルを、記録順（時系列順）に、１つのファイルに結合する。 The moving image data combining unit 222 combines the first moving image file and the recovery moving image file stored in the second recording medium 230 into one file in the recording order (in time series order).
　受信制御部２１０で行われる画像データの受信及び保存処理を簡単に説明する。通信状態が良好と判定されている期間中は、第２の通信部２６０は、送信装置１００から送信されるストリーム形式の画像データを受信する。前述のように、通信状態の良否は、送信装置１００から通知される。第２の記録制御部２１２は、受信した画像データをストリーム形式で第２の記録媒体２３０に保存する。 The image data reception and storage process performed by the reception control unit 210 will be briefly described. During a period in which the communication state is determined to be good, the second communication unit 260 receives stream format image data transmitted from the transmission device 100. As described above, whether or not the communication state is good is notified from the transmission device 100. The second recording control unit 212 stores the received image data in the second recording medium 230 in a stream format.
　通信状態が悪いと判定されている期間中は、送信装置１００からの送信が停止されるので、第２の通信部２６０は、画像データを受信しない。通信状態が悪いと判定されている期間中に、第２の記録制御部２１２は、第２の記録媒体２３０にストリーム形式で保存された画像データを第１動画ファイルに変換して保存し、第２の識別データ付与部２１４が、第１動画ファイルに識別データを付与する。 During the period when it is determined that the communication state is bad, the transmission from the transmission device 100 is stopped, so the second communication unit 260 does not receive the image data. During the period when it is determined that the communication state is bad, the second recording control unit 212 converts the image data saved in the stream format on the second recording medium 230 into the first moving image file, saves it, The second identification data adding unit 214 adds identification data to the first moving image file.
　通信が再開されると、第２の記録制御部２１２は、再開後に受信したストリーム形式の画像データをストリーム形式で第２の記録媒体２３０に保存する。そして、送信装置１００から動画像記録終了指示が通知されると、第２の記録制御部２１２は、第２の記録媒体２３０にストリーム形式で保存された画像データを第１動画ファイルに変換する。また、第２の記録制御部２１２は、送信装置１００から送信されたリカバリ動画ファイルを第２の記録媒体２３０に保存する。 When the communication is resumed, the second recording control unit 212 stores the image data in the stream format received after the resume in the second recording medium 230 in the stream format. When the moving image recording end instruction is notified from the transmission apparatus 100, the second recording control unit 212 converts the image data stored in the stream format on the second recording medium 230 into the first moving image file. In addition, the second recording control unit 212 stores the recovery moving image file transmitted from the transmission device 100 in the second recording medium 230.
　最後に、動画データ結合部２２２が、第２の記録媒体２３０に保存されたリカバリ動画ファイルと第１動画ファイルを、各ファイルに付された識別データに基づき、記録順（時系列順）に並べて結合する。 Finally, the moving image data combining unit 222 arranges the recovery moving image file and the first moving image file stored in the second recording medium 230 in the recording order (in chronological order) based on the identification data attached to each file. Join.
〈動画データの送受信処理〉
　次に、動画像送受信システム１における、動画データの送受信処理を説明する。図２は、動画データの送受信処理の手順を説明するフローチャートである。動画データの送受信処理の手順を、各場面における動画データの処理を示す図３～図７を参照しながら、説明する。 <Video data transmission / reception processing>
Next, moving image data transmission / reception processing in the moving image transmission / reception system 1 will be described. FIG. 2 is a flowchart for explaining the procedure of moving image data transmission / reception processing. The procedure of moving image data transmission / reception processing will be described with reference to FIGS. 3 to 7 showing the moving image data processing in each scene.
　指示部１５０から動画像記録開始指示が入力され、画像データの記録が開始されたとする。映像入力装置３００から出力される画像信号が、映像信号入力部１７０に入力され、動画データ生成部１１６で、符号化され動画データに変換される。 Suppose that a moving image recording start instruction is input from the instruction unit 150 and recording of image data is started. An image signal output from the video input device 300 is input to the video signal input unit 170, encoded by the moving image data generation unit 116, and converted into moving image data.
　第１の通信状態検知部１２０が送信装置１００の通信状態を、第２の通信状態検知部２２０が受信装置２００の通信状態を、それぞれ監視する（ステップＳ１０）。送信制御部１１０が、第１の通信状態検知部１２０の情報により、送信装置１００側の通信状態が良好であるかを判定する（ステップＳ１２）。送信制御部１１０が、送信装置１００側の通信状態が良好であると判定すると（ステップＳ１２Ｙｅｓ）、送信制御部１１０は、第２の通信状態検知部２２０の情報により、受信装置２００側の通信状態が良好であるかを判定する（ステップＳ１４）。送信装置１００には、第２の通信状態検知部２２０により検知された通信状態の情報が送信される。 The first communication state detection unit 120 monitors the communication state of the transmission device 100, and the second communication state detection unit 220 monitors the communication state of the reception device 200 (step S10). The transmission control unit 110 determines whether the communication state on the transmission device 100 side is good based on the information of the first communication state detection unit 120 (step S12). When the transmission control unit 110 determines that the communication state on the transmission device 100 side is good (Yes in step S12), the transmission control unit 110 uses the information of the second communication state detection unit 220 to determine the communication state on the reception device 200 side. Is good (step S14). Information on the communication state detected by the second communication state detection unit 220 is transmitted to the transmission device 100.
　送信制御部１１０が、第２の通信状態検知部２２０からの情報により、受信装置２００側の通信状態が良好であると判定すると（ステップＳ１４Ｙｅｓ）、第１の通信制御部１１８は、第１の通信部１６０から符号化された動画データをストリーム形式で送信する（ステップＳ１６）。 When the transmission control unit 110 determines that the communication state on the receiving device 200 side is good based on the information from the second communication state detection unit 220 (Yes in step S14), the first communication control unit 118 The encoded moving image data is transmitted from the communication unit 160 in a stream format (step S16).
　受信装置２００の第２の通信部２６０は、ストリーム形式の動画データを受信する。受信装置２００の第２の記録制御部２１２は、ストリーム形式で動画データを第２の記録媒体２３０に保存する（ステップＳ１８）。送信制御部１１０は、指示部１５０から動画記録終了指示があったかを判断する（ステップＳ２６）。送信制御部１１０は、動画記録終了指示がないと判断すると（ステップＳ２６Ｎｏ）、ステップＳ１０に戻る。 The second communication unit 260 of the receiving device 200 receives the moving image data in the stream format. The second recording control unit 212 of the receiving device 200 stores the moving image data in the second recording medium 230 in the stream format (step S18). The transmission control unit 110 determines whether there is a moving image recording end instruction from the instruction unit 150 (step S26). When determining that there is no moving image recording end instruction (No in step S26), the transmission control unit 110 returns to step S10.
　図３は、ステップＳ１６及びステップＳ１８における、通信状態が良好な場合の動画データの処理を示す図である。動画データは、ストリーム形式で第１の通信部１６０から第２の通信部２６０に送信され、ストリーム形式で第２の記録媒体２３０に保存される。 FIG. 3 is a diagram showing processing of moving image data when the communication state is good in step S16 and step S18. The moving image data is transmitted from the first communication unit 160 to the second communication unit 260 in a stream format, and stored in the second recording medium 230 in a stream format.
　図２に戻り、送信制御部１１０が、第１の通信状態検知部１２０の情報により、送信装置１００側の通信状態が良好でないと判定する場合（ステップＳ１２Ｎｏ）、あるいは、第２の通信状態検知部２２０の情報により、受信装置２００側の通信状態が良好でないと判定する場合には（ステップＳ１４Ｎｏ）、送信装置１００は、リカバリモードへ移行する（ステップＳ２０）。 Returning to FIG. 2, when the transmission control unit 110 determines that the communication state on the transmission device 100 side is not good based on the information of the first communication state detection unit 120 (No in step S <b> 12), or the second communication state detection When it is determined from the information of the unit 220 that the communication state on the receiving device 200 side is not good (No in step S14), the transmitting device 100 shifts to the recovery mode (step S20).
　送信制御部１１０は、リカバリモードへの移行を決定し、リカバリモードへの移行を受信装置２００に通知する。送信装置１００の第１の記録制御部１１２は、動画データ生成部１１６により符号化された画像データをリカバリ動画ファイルとして、ファイル形式で、第１の記録媒体１３０に保存する（ステップＳ２２）。 The transmission control unit 110 determines the transition to the recovery mode and notifies the receiving apparatus 200 of the transition to the recovery mode. The first recording control unit 112 of the transmission device 100 stores the image data encoded by the moving image data generation unit 116 as a recovery moving image file in the file format in the first recording medium 130 (step S22).
　また、受信装置２００の第２の記録制御部２１２は、通信状態が良好な期間中に第２の記録媒体２３０に保存されたストリーム形式の動画データを、第１動画ファイルに変換する（ステップＳ２４）。あわせて、第２の識別データ付与部２１４が、第１動画ファイルに識別データを付与する。 In addition, the second recording control unit 212 of the receiving device 200 converts the moving image data in the stream format stored in the second recording medium 230 during the period in which the communication state is good (step S24). ). In addition, the second identification data adding unit 214 adds identification data to the first moving image file.
　図４は、ステップＳ２２及びステップＳ２４における、通信状態が悪い場合の動画データの処理を示す図である。送信装置１００においては、第１の記録制御部１１２が、動画データ生成部１１６で生成される符号化された動画データを、リカバリ動画ファイルとして、第１の記録媒体１３０に保存する。図４では、リカバリ動画ファイルを、動画ファイル２Ｒと図示する。 FIG. 4 is a diagram showing processing of moving image data when the communication state is bad in step S22 and step S24. In the transmission device 100, the first recording control unit 112 stores the encoded moving image data generated by the moving image data generation unit 116 in the first recording medium 130 as a recovery moving image file. In FIG. 4, the recovery moving image file is illustrated as a moving image file 2R.
　また、受信装置２００においては、第２の記録制御部２１２は、第２の記録媒体２３０に、通信状態が良好な期間中の保存されたストリーム形式の動画データを、第１動画ファイルに変換する。あわせて、第２の識別データ付与部２１４が、第１動画ファイルに識別データを付与する。図４では、第１動画ファイルを動画ファイル１と図示する。 In the receiving device 200, the second recording control unit 212 converts the stream format moving image data stored in the second recording medium 230 during a period in which the communication state is good into the first moving image file. . In addition, the second identification data adding unit 214 adds identification data to the first moving image file. In FIG. 4, the first moving image file is illustrated as moving image file 1.
　図５は、通信状態が図４の状態から回復した場合の動画データの処理を示す図である。送信装置１００においては、第１の通信制御部１１８は、ストリーム形式で動画データを送信する。第１の記録媒体１３０には、リカバリ動画ファイル（動画ファイル２Ｒ）が保存されている。 FIG. 5 is a diagram showing processing of moving image data when the communication state is recovered from the state of FIG. In the transmission device 100, the first communication control unit 118 transmits moving image data in a stream format. The first recording medium 130 stores a recovery moving image file (moving image file 2R).
　また、受信装置２００においては、第２の記録制御部２１２が、ストリーム形式で送信された動画データをストリーム形式で第２の記録媒体２３０に保存する。第２の記録媒体２３０には、第１動画ファイル（動画ファイル１）とストリーム形式の画像データが保存される。 In the receiving apparatus 200, the second recording control unit 212 stores the moving image data transmitted in the stream format in the second recording medium 230 in the stream format. The second recording medium 230 stores a first moving image file (moving image file 1) and stream format image data.
　図２のステップ２６に戻る。送信制御部１１０は、動画記録終了指示があったと判断すると（ステップＳ２６Ｙｅｓ）、送信制御部１１０は、送信装置１００の第１の記録媒体１３０に未転送画像があるかを判断する（ステップＳ３０）。未転送画像とは、第１の記録媒体１３０のリカバリ動画ファイルである。 Return to step 26 in FIG. When the transmission control unit 110 determines that there is an instruction to end moving image recording (Yes in step S26), the transmission control unit 110 determines whether there is an untransferred image on the first recording medium 130 of the transmission device 100 (step S30). . An untransferred image is a recovery moving image file of the first recording medium 130.
　送信制御部１１０は、送信装置１００の第１の記録媒体１３０に未転送画像がないと判断すると（ステップＳ３０Ｎｏ）、送信装置１００の記録終了処理を実行する（ステップＳ３６）。また、送信制御部１１０は、記録終了の情報を受信装置２００に送信する。受信制御部２１０は、記録終了の情報を受信すると、受信装置２００の記録終了処理を実行する。 When the transmission control unit 110 determines that there is no untransferred image on the first recording medium 130 of the transmission device 100 (No in step S30), the transmission control unit 110 executes a recording end process of the transmission device 100 (step S36). In addition, the transmission control unit 110 transmits information on the end of recording to the receiving device 200. When receiving the recording end information, the reception control unit 210 executes a recording end process of the receiving device 200.
　送信制御部１１０は、送信装置１００の第１の記録媒体１３０に未転送画像があると判断すると（ステップＳ３０Ｙｅｓ）、第１の通信制御部１１８は、リカバリ動画ファイルを受信装置２００に送信する（ステップＳ３２）。受信装置２００は、リカバリ動画ファイルを受信する。 When the transmission control unit 110 determines that there is an untransferred image on the first recording medium 130 of the transmission device 100 (Yes in step S30), the first communication control unit 118 transmits the recovery video file to the reception device 200 ( Step S32). The receiving device 200 receives the recovery moving image file.
　また、第２の記録制御部２１２は、第２の記録媒体２３０の保存されているファイル化されていない画像データを、ファイル化する。第２の識別データ付与部２１４は、ファイル化される画像データに識別データを付与する。 Also, the second recording control unit 212 converts the stored image data stored in the second recording medium 230 into a file. The second identification data adding unit 214 adds identification data to image data to be filed.
　動画データ結合部２２２は、受信したリカバリ動画ファイルと、第２の記録媒体２３０に保存された他のファイルを結合する（ステップＳ３４）。動画データ結合部２２２は、リカバリ動画ファイルと他のファイルを時間順に結合して、全体として１つの動画ファイルを生成する。 The moving image data combining unit 222 combines the received recovery moving image file with another file stored in the second recording medium 230 (step S34). The moving image data combining unit 222 combines the recovery moving image file and other files in time order to generate one moving image file as a whole.
　図６は、ステップＳ３２における、動画データの転送処理を示す図である。第1の記録媒体１３０にリカバリ動画ファイル（動画ファイル２Ｒ）がある場合には、第１の通信部１６０は、リカバリ動画ファイルを受信装置２００に送信する。受信装置２００では、第２の記録制御部２１２は、受信したリカバリ動画ファイル（動画ファイル２Ｒ）を、第２の記録媒体２３０に保存する。更に、第２の記録制御部２１２は、残っているストリーム形式の動画データを動画ファイルに変換する。図6では、変換された動画ファイルを動画ファイル３と示す。動画ファイル１は、既にファイル化された動画である。 FIG. 6 is a diagram showing the moving image data transfer process in step S32. When there is a recovery moving image file (moving image file 2R) on the first recording medium 130, the first communication unit 160 transmits the recovery moving image file to the receiving device 200. In the receiving device 200, the second recording control unit 212 stores the received recovery moving image file (moving image file 2R) in the second recording medium 230. Further, the second recording control unit 212 converts the remaining stream-format moving image data into a moving image file. In FIG. 6, the converted moving image file is indicated as moving image file 3. Movie file 1 is a movie that has already been filed.
　図７は、ステップＳ３４における、動画データ結合処理を示す図である。第２の記録媒体２３０には、動画ファイル１と動画ファイル３とリカバリ動画ファイル２Ｒが保存される。記録の順番は、動画ファイル１、リカバリ動画ファイル２Ｒ、動画ファイル３である。動画データ結合部２２２が、動画ファイル１、リカバリ動画ファイル２Ｒ、動画ファイル３を記録順に結合して、動画ファイルＳを生成する。 FIG. 7 is a diagram showing the moving image data combining process in step S34. The second recording medium 230 stores the moving image file 1, the moving image file 3, and the recovery moving image file 2R. The recording order is the moving image file 1, the recovery moving image file 2R, and the moving image file 3. The moving image data combining unit 222 combines the moving image file 1, the recovery moving image file 2R, and the moving image file 3 in the recording order to generate the moving image file S.
　図２に戻り、ステップＳ３４のファイル結合後に、ステップＳ３６に進み、送信装置１００及び受信装置２００は、それぞれ記録終了処理を行う。なお、第１の記録制御部１１２は、第１の記録媒体１３０に保存されたリカバリ画像ファイルを転送後に消去する。 Returning to FIG. 2, after the files are combined in step S <b> 34, the process proceeds to step S <b> 36, and the transmission device 100 and the reception device 200 perform the recording end process. Note that the first recording control unit 112 deletes the recovery image file stored in the first recording medium 130 after the transfer.
　なお、図３～図７では、説明の煩雑さを避けるために、記録中に通信状態の悪化が１回だけ発生する例を示したが、中断が複数回発生しても同様である。図８は、通信状態が繰り返し悪化した場合の処理を説明するタイミングチャートである。右方向に時間が進むとする。上段が指示部１５０の操作タイミングを示し、中段が第２の記録媒体２３０に保存される画像データを示し、下段が第１の記録媒体１３０に保存されるリカバリ画像ファイルを示す。 Note that FIGS. 3 to 7 show an example in which the communication state is deteriorated only once during recording in order to avoid complicated explanation, but the same is true even when interruptions occur multiple times. FIG. 8 is a timing chart for explaining processing when the communication state repeatedly deteriorates. Suppose that time advances to the right. The upper row shows the operation timing of the instruction unit 150, the middle row shows the image data stored in the second recording medium 230, and the lower row shows the recovery image file stored in the first recording medium 130.
　前述のように、通信状態が良好な期間は、動画データ生成部１１６で符号化された画像データは、第２の記録媒体２３０にストリーム形式の画像データとして保存され、通信状態が悪い期間は、第１の記録媒体１３０にリカバリ動画ファイルとして保存される。 As described above, during a period in which the communication state is good, the image data encoded by the moving image data generation unit 116 is stored as stream-format image data in the second recording medium 230. It is stored in the first recording medium 130 as a recovery moving image file.
　指示部１５０による記録開始指示後、ストリーム形式で送信された画像データは、第２の記録媒体２３０にストリーム形式で保存される（ファイル化されてファイル１となる）。通信状態悪化後、第１の記録媒体１３０にリカバリ動画ファイルとしてファイル２Ｒが保存される。その後、通信状態回復と悪化が繰り返されるとする。最終的に、第２の記録媒体２３０には、ストリーム形式で送信された画像データがファイル化されて、ファイル１、ファイル３、ファイル５として保存される。第１の記録媒体１３０には、ファイル２Ｒ、ファイル４Ｒ、ファイル６Ｒが保存される。 After the recording start instruction by the instructing unit 150, the image data transmitted in the stream format is stored in the second recording medium 230 in the stream format (filed to become the file 1). After the communication state deteriorates, the file 2R is stored in the first recording medium 130 as a recovery moving image file. Thereafter, it is assumed that communication state recovery and deterioration are repeated. Finally, the image data transmitted in the stream format is filed on the second recording medium 230 and stored as file 1, file 3, and file 5. The first recording medium 130 stores a file 2R, a file 4R, and a file 6R.
　指示部１５０による記録終了指示後、ファイル２Ｒ、ファイル４Ｒ及びファイル６Ｒが、受信装置２００に転送されて第２の記録媒体２３０に保存される。また、最後にストリーム形式で保存された画像データがファイル化されファイル７となる。そして、７つのファイルが、図９に示すような順番で結合されて、１つのファイルが生成されて、画像記録処理が終了する。 After the recording end instruction by the instruction unit 150, the file 2R, the file 4R, and the file 6R are transferred to the receiving device 200 and stored in the second recording medium 230. Finally, the image data saved in the stream format is converted into a file 7. Then, the seven files are combined in the order shown in FIG. 9, one file is generated, and the image recording process is completed.
〈効果〉
　以上説明したように、本実施形態によれば、記録途中で通信状態が悪化して、動画データの通信が一時的に途絶えても、記録終了後には、欠落のない動画像が受信装置に記録保存される。 <effect>
As described above, according to the present embodiment, even if the communication state deteriorates during recording and the communication of moving image data is temporarily interrupted, a moving image with no omission is recorded in the receiving device after the recording is completed. Saved.
　また、受信装置２００へのリカバリ動画ファイルの転送タイミングを、記録終了後にしたので、記録途中の画像データ送信を妨害するおそれがない。 Further, since the transfer timing of the recovery video file to the receiving device 200 is set after the end of recording, there is no possibility of disturbing image data transmission during recording.
　また、リカバリ動画ファイルや第１動画ファイルの個別ファイルに、動画データ全体の中での時間順（記録順）を示す識別情報を付与するので、記録順に並べて結合することが容易になる。 In addition, since identification information indicating the order of time (recording order) in the entire moving picture data is added to the individual files of the recovery moving picture file and the first moving picture file, it becomes easy to combine them in the order of recording.
　また、通信状態悪化時に、それまで第２の記録媒体２３０にストリーム形式で保存された画像データをファイル化して第１動画ファイルとするようにしたので、受信装置２００の空き時間が有効に利用できる。 Further, when the communication state deteriorates, the image data that has been stored in the second recording medium 230 in the stream format up to that point is converted into a file and used as the first moving image file, so that the free time of the receiving device 200 can be used effectively. .
　また、記録終了後直ちに、受信装置２００でリカバリ動画ファイルや第１動画ファイルの個別ファイルが１ファイル化されるので、撮影（例えば検査）が終われば、動画像送受信システム１を停止させることができ、次の撮影（検査）へスムースに移行できる。 Further, since the individual files of the recovery video file and the first video file are made into one file by the receiving device 200 immediately after the recording is completed, the moving image transmission / reception system 1 can be stopped when shooting (for example, inspection) is completed. Smoothly move to the next shooting (inspection).
〈変形例〉
・送信装置１００は、内視鏡に接続されるビデオプロセッサでもよい。また、ビデオプロセッサは、ビデオプロセッサと内視鏡へ照明光を供給する光源装置が一体的に備えられた光源一体型、ビデオプロセッサと光源装置が別体に構成された光源別体型、ビデオプロセッサ・光源機能を内視鏡に内蔵させたもの、いずれの形式でもよい。また、使用される内視鏡は、軟性内視鏡(内視鏡挿入部先端に撮像素子を備えた電子スコープタイプ)、軟性内視鏡(挿入部先端の光学系で結像された光学像を光ファイバによって挿入部の基端に伝送し、この挿入部基端に設けた撮像素子で光学像を撮像するハイブリッドスコープタイプ) 、硬性内視鏡または光学式内視鏡＋カメラヘッド等種々利用可能である。また、光源装置としては、白色LED光源装置、RGBで個別のLED光源装置、レーザー光源装置またはランプ光源装置等種々利用可能である。 <Modification>
The transmission device 100 may be a video processor connected to the endoscope. The video processor includes a light source integrated type in which a video processor and a light source device for supplying illumination light to the endoscope are integrally provided, a separate light source type in which the video processor and the light source device are configured separately, a video processor, Any type in which the light source function is built in the endoscope may be used. Endoscopes used are flexible endoscopes (electronic scope type equipped with an imaging device at the distal end of the endoscope insertion portion), flexible endoscopes (optical images formed by the optical system at the distal end of the insertion portion). Is transmitted to the proximal end of the insertion section through an optical fiber, and an optical image is picked up by an image sensor provided at the proximal end of the insertion section), rigid endoscope or optical endoscope + camera head, etc. Is possible. In addition, as the light source device, a white LED light source device, RGB individual LED light source devices, laser light source devices, lamp light source devices, and the like can be used.
・指示部１５０は、ビデオプロセッサまたは光源装置のフロントパネルに設けられたボタンでもよい。指示部１５０は、ビデオプロセッサまたは光源装置のフロントパネルに設けられたタッチパネルでもよい。指示部１５０は、ビデオプロセッサに接続されたキーボード、あるいは、内視鏡スコープの把持部に設けられたスイッチでもよい。 The instruction unit 150 may be a button provided on the front panel of the video processor or the light source device. The instruction unit 150 may be a touch panel provided on the front panel of the video processor or the light source device. The instruction unit 150 may be a keyboard connected to the video processor, or a switch provided on the grasping unit of the endoscope scope.
・指示部１５０は、送信装置１００に設けられると説明したが、受信装置２００に備えられていてもよい。
・リカバリ動画ファイルや第１動画ファイルの記録順は、画像データに付されるタイムスタンプを利用してもよい。また、記録時間順に、リカバリ動画ファイルや第１動画ファイルのファイル名を付けてもよい。例えば、0001.mpg、0002.mpg、0003.mpgのようである。・リカバリ用の画像データは、第１の記録媒体にファイル形式ではなく、ストリーム形式で保存しておいて、ストリーム形式のままで、受信装置に送信してもよい。 The instruction unit 150 has been described as being provided in the transmission device 100, but may be provided in the reception device 200.
A time stamp attached to the image data may be used as the recording order of the recovery moving image file and the first moving image file. Moreover, you may give the file name of a recovery moving image file or a 1st moving image file in order of recording time. For example, 0001.mpg, 0002.mpg, and 0003.mpg. The image data for recovery may be stored in the first recording medium in the stream format instead of the file format, and may be transmitted to the receiving apparatus in the stream format.
・リカバリ動画ファイルを記録終了後に送信すると説明したが、これに限定するものではなく、記録終了前に、送信装置からリカバリ動画ファイルを受信装置に送信するようにしてもよい。
・通信状態検知部は、送信装置１００又は受信装置２００のいずれかに搭載されているだけでも良い。 Although it has been described that the recovery moving image file is transmitted after the recording ends, the present invention is not limited to this, and the recovery moving image file may be transmitted from the transmitting device to the receiving device before the recording ends.
The communication state detection unit may be simply mounted on either the transmission device 100 or the reception device 200.
・送信制御部１１０及び受信制御部２１０は、制御プログラムを読込んだＣＰＵによるソフトウェア処理により実現されるものには限定されず、一部または全部がハードウェアで構成されてもよい。 -Transmission control part 110 and reception control part 210 are not limited to what is realized by software processing by CPU which read the control program, and a part or all may be constituted by hardware.
　なお、本発明は上述した実施形態そのままに限定されるものではなく、実施段階でのその要旨を逸脱しない範囲で構成要素を変形して具体化することができる。また、上記実施形態に開示されている複数の構成要素の適宜な組み合わせにより、種々の発明を形成することができる。例えば、実施形態に示される全構成要素を適宜組み合わせても良い。さらに、異なる実施形態にわたる構成要素を適宜組み合わせてもよい。このような、発明の趣旨を逸脱しない範囲内において種々の変形や応用が可能であることはもちろんである。 Note that the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the components without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, all the constituent elements shown in the embodiments may be appropriately combined. Furthermore, constituent elements over different embodiments may be appropriately combined. It goes without saying that various modifications and applications are possible without departing from the spirit of the invention.
１　動画像送受信システム
　１００　送信装置
　　１１０　送信制御部
　　　１１２　第１の記録制御部
　　　１１４　第１の識別データ付与部
　　　１１６　動画データ生成部
　　　１１８　第１の通信制御部
　　　１２０　第１の通信状態検知部
　　１３０　第１の記録媒体
　　１４０　ＲＡＭ
　　１５０　指示部
　　１６０　第１の通信部
　　１７０　映像信号入力部
　２００　受信装置
　　２１０　受信制御部
　　　２１２　第２の記録制御部
　　　２１４　第２の識別データ付与部
　　　２１８　第２の通信制御部
　　　２２０　第２の通信状態検知部
　　　２２２　動画データ結合部
　　２３０　第２の記録媒体
　　２４０　ＲＡＭ
　　２６０　第２の通信部
　３００　　映像入力装置 DESCRIPTION OF SYMBOLS 1 Moving image transmission / reception system 100 Transmission apparatus 110 Transmission control part 112 1st recording control part 114 1st identification data provision part 116 Movie data generation part 118 1st communication control part 120 1st communication state detection part 130 1st Recording medium 140 RAM
150 instruction unit 160 first communication unit 170 video signal input unit 200 receiving device 210 reception control unit 212 second recording control unit 214 second identification data adding unit 218 second communication control unit 220 second communication state detection Unit 222 moving image data combination unit 230 second recording medium 240 RAM
260 Second communication unit 300 Video input device

Claims (12)

  1. 　入力される動画像に基づく動画データを無線送信する送信装置と、前記無線送信された動画データを受信して記録する受信装置を有する動画像送受信システムにおいて、
    　前記送信装置は、
    　　前記受信装置と無線通信を行う第１の通信部と、
    　　前記第１の通信部を制御する第１の通信制御部と、
    　　前記動画データを第１の記録媒体に保存する第１の記録制御部とを備え、
    　　前記第１の通信制御部は、通信状態が良好な場合には前記動画データをストリーム形式で前記受信装置に送信するよう前記第１の通信部を制御し、前記通信状態が悪い場合には前記受信装置への前記動画データの送信を停止するよう前記第１の通信部を制御し、
    　　前記第１の記録制御部は、前記通信状態が悪い場合に前記第１の通信制御部により前記受信装置への前記動画データの送信が停止された場合に、前記動画データをリカバリ動画ファイルとして前記第１の記録媒体に保存し、
    　　更に、前記第１の通信制御部は、前記第１の記録媒体に保存されたリカバリ動画ファイルを、前記動画像の記録終了指示を受けた後に、前記受信装置に送信するよう前記第１の通信部を制御し、
    　前記受信装置は、
    　　前記送信装置と無線通信を行う第２の通信部と、
    　　前記第２の通信部により前記ストリーム形式で受信した前記動画データをストリーム形式で第２の記録媒体に保存し、前記第２の通信部により受信した前記リカバリ動画ファイルをファイル形式で第２の記録媒体に保存する第２の記録制御部と、を備える
    ことを特徴とする動画像送受信システム。     In a moving image transmission / reception system having a transmitting device that wirelessly transmits moving image data based on an input moving image and a receiving device that receives and records the wirelessly transmitted moving image data,
    The transmitter is
    A first communication unit that performs wireless communication with the receiving device;
    A first communication control unit for controlling the first communication unit;
    A first recording control unit for storing the moving image data in a first recording medium;
    The first communication control unit controls the first communication unit to transmit the moving image data in a stream format to the receiving device when the communication state is good, and when the communication state is bad, the first communication control unit Controlling the first communication unit to stop transmission of the video data to the receiving device;
    The first recording control unit, when the transmission of the moving image data to the receiving device is stopped by the first communication control unit when the communication state is bad, the moving image data as the recovery moving image file. Save to the first recording medium,
    Further, the first communication control unit receives the recovery video file stored in the first recording medium after receiving the moving image recording end instruction, and then transmits the recovery video file to the receiving device. Control the part
    The receiving device is:
    A second communication unit that performs wireless communication with the transmission device;
    The moving image data received in the stream format by the second communication unit is stored in a second recording medium in the stream format, and the recovery moving image file received by the second communication unit is recorded in a second format in the file format. A moving image transmission / reception system comprising: a second recording control unit that stores the medium in a medium.
  2. 　前記第２の記録制御部は、前記ストリーム形式で保存した動画データを、所定のタイミングでファイル化して第１動画ファイルとして保存する、
    ことを特徴とする請求項１に記載の動画像送受信システム。     The second recording control unit saves the moving image data stored in the stream format as a first moving image file as a file at a predetermined timing.
    The moving image transmission / reception system according to claim 1.
  3. 　前記第２の記録制御部は、通信状態が悪く前記送信装置から前記受信装置への前記動画データ送信が停止された場合に、前記ストリーム形式で保存した動画データをファイル化して第１動画ファイルとして保存する、
    ことを特徴とする請求項２に記載の動画像送受信システム。     The second recording control unit converts the moving image data stored in the stream format into a file as a first moving image file when the transmission of moving image data from the transmitting device to the receiving device is stopped due to poor communication conditions. save,
    The moving image transmission / reception system according to claim 2.
  4. 　前記第２の記録制御部は、前記動画像の記録終了指示を受けた後に、前記ストリーム形式で保存した動画データをファイル化して第１動画ファイルとして保存する、
    ことを特徴とする請求項２に記載の動画像送受信システム。     The second recording control unit, after receiving the recording end instruction of the moving image, files the moving image data stored in the stream format and stores it as a first moving image file.
    The moving image transmission / reception system according to claim 2.
  5. 　前記受信装置は、前記第２の記録媒体に保存された前記第１動画ファイルとリカバリ動画ファイルを、時系列順に、１つのファイルに結合する動画データ結合部を備える
    ことを特徴とする請求項２に記載の動画像送受信システム。     The receiving apparatus includes a moving image data combining unit that combines the first moving image file and the recovery moving image file stored in the second recording medium into one file in time series. The moving image transmission / reception system described in 1.
  6. 　前記送信装置は、前記第１の記録媒体に保存されるリカバリ動画ファイルに、動画データ全体の中での時間順を示す識別データを付与する第１の識別データ付与部を備える
    ことを特徴とする請求項１に記載の動画像送受信システム。     The transmission device includes a first identification data adding unit that adds identification data indicating a time order in the entire moving image data to the recovery moving image file stored in the first recording medium. The moving image transmission / reception system according to claim 1.
  7. 　前記受信装置は、前記第２の記録媒体に保存される第１動画ファイルに、動画データ全体の中での時間順を示す識別データを付与する第２の識別データ付与部を備える
    ことを特徴とする請求項２に記載の動画像送受信システム。     The receiving device includes a second identification data adding unit that adds identification data indicating a time order in the entire moving image data to the first moving image file stored in the second recording medium. The moving image transmission / reception system according to claim 2.
  8. 　入力される動画像に基づく動画データを無線送信する送信装置と、前記無線送信された動画データを受信して記録する受信装置を有する動画像送受信システムにおいて、
    　前記送信装置は、
    　　前記受信装置と無線通信を行う第１の通信部と、
    　　前記第１の通信部を制御する第１の通信制御部と、
    　　前記動画データを第１の記録媒体に保存する第１の記録制御部とを備え、
    　　前記第１の通信制御部は、通信状態が良好な場合には前記動画データをストリーム形式で前記受信装置に送信するよう前記第１の通信部を制御し、前記通信状態が悪い場合には前記受信装置への前記動画データの送信を停止するよう前記第１の通信部を制御し、
    　　前記第１の記録制御部は、前記通信状態が悪い場合に前記第１の通信制御部により前記受信装置への前記動画データの送信が停止された場合に、前記動画データをリカバリ動画ファイルとして前記第１の記録媒体に保存し、
    　　更に、前記第１の通信制御部は、前記第１の記録媒体に記録されたリカバリ動画ファイルを所定のタイミングで前記受信装置に送信するよう、前記第１の通信部を制御し、
    　前記受信装置は、
    　　前記送信装置と無線通信を行う第２の通信部と、
    　　前記第２の通信部により前記ストリーム形式で受信した動画データをストリーム形式で第２の記録媒体に保存し、前記第２の通信部により受信した前記リカバリ動画ファイルをファイル形式で前記第２の記録媒体に保存し、更に、前記ストリーム形式で保存した動画データを、所定のタイミングでファイル化して第１動画ファイルとして前記第２の記録媒体に保存する第２の記録制御部と、
    　　前記第２の記録媒体に保存された前記第１動画ファイルと前記リカバリ動画ファイル
    を、時系列順に、１つのファイルに結合する動画データ結合部と、を備える
    ことを特徴とする動画像送受信システム。     In a moving image transmission / reception system having a transmitting device that wirelessly transmits moving image data based on an input moving image and a receiving device that receives and records the wirelessly transmitted moving image data,
    The transmitter is
    A first communication unit that performs wireless communication with the receiving device;
    A first communication control unit for controlling the first communication unit;
    A first recording control unit for storing the moving image data in a first recording medium;
    The first communication control unit controls the first communication unit to transmit the moving image data in a stream format to the receiving device when the communication state is good, and when the communication state is bad, the first communication control unit Controlling the first communication unit to stop transmission of the video data to the receiving device;
    The first recording control unit, when the transmission of the moving image data to the receiving device is stopped by the first communication control unit when the communication state is bad, the moving image data as the recovery moving image file. Save to the first recording medium,
    Further, the first communication control unit controls the first communication unit to transmit the recovery video file recorded on the first recording medium to the receiving device at a predetermined timing,
    The receiving device is:
    A second communication unit that performs wireless communication with the transmission device;
    The moving image data received in the stream format by the second communication unit is stored in a second recording medium in the stream format, and the recovery moving image file received by the second communication unit is stored in the second format in the file format. A second recording control unit that stores the moving image data stored in the medium and further stored in the stream format as a first moving image file on the second recording medium at a predetermined timing;
    A moving image transmission / reception system comprising: a moving image data combining unit that combines the first moving image file and the recovery moving image file stored in the second recording medium into one file in time series.
  9. 　動画データを受信して記録する受信装置に対して、入力される動画像に基づく動画データを無線送信する送信装置において、
    　前記送信装置は、
    　　前記受信装置と無線通信を行う第１の通信部と、
    　　前記第１の通信部を制御する第１の通信制御部と、
    　　前記動画データを第１の記録媒体に保存する第１の記録制御部とを備え、
    　　前記第１の通信制御部は、通信状態が良好な場合には前記動画データをストリーム形式で前記受信装置に送信するよう前記第１の通信部を制御し、前記通信状態が悪い場合には前記受信装置へストリーム形式での前記動画データの送信を停止するよう前記第１の通信部を制御し、
    　　前記第１の記録制御部は、前記通信状態が悪い場合に前記第１の通信制御部により前記受信装置への前記動画データの送信が停止された場合に、前記動画データをリカバリ動画ファイルとして前記第１の記録媒体に保存し、
    　　更に、前記第１の通信制御部は、前記第１の記録媒体に記録されたリカバリ動画ファイルを、前記動画像の記録終了指示を受けた後に、前記受信装置に送信するよう前記第１の通信部を制御する
    ことを特徴とする送信装置。     In a transmitting device that wirelessly transmits moving image data based on an input moving image to a receiving device that receives and records moving image data,
    The transmitter is
    A first communication unit that performs wireless communication with the receiving device;
    A first communication control unit for controlling the first communication unit;
    A first recording control unit for storing the moving image data in a first recording medium;
    The first communication control unit controls the first communication unit to transmit the moving image data in a stream format to the receiving device when the communication state is good, and when the communication state is bad, the first communication control unit Controlling the first communication unit to stop transmission of the moving image data in a stream format to the receiving device;
    The first recording control unit, when the transmission of the moving image data to the receiving device is stopped by the first communication control unit when the communication state is bad, the moving image data as the recovery moving image file. Save to the first recording medium,
    Further, the first communication control unit transmits the recovery moving image file recorded on the first recording medium to the receiving device after receiving the moving image recording end instruction. A transmission apparatus for controlling the unit.
  10. 　送信装置から無線送信される動画データを受信して記録する受信装置において、
    　前記送信装置との無線通信の状態が良好な場合には前記送信装置からストリーム形式で送信される動画データを受信し、前記送信装置との無線通信の状態が悪い場合には、いったん前記送信装置で前記動画データがリカバリ動画ファイルとして保存され、所定のタイミングで、前記送信装置から送信される前記リカバリ動画ファイルを受信する第２の通信部と、
    　前記送信装置から前記動画データを前記ストリーム形式で受信した場合には、該動画データをストリーム形式で第２の記録媒体に保存し、前記送信装置から前記動画データを前記リカバリ動画ファイルとして受信した場合には、該リカバリ動画ファイルをファイル形式で前記第２の記録媒体に保存し、更に、前記ストリーム形式で保存した動画データをファイル化して第１動画ファイルとして保存する第２の記録制御部と、
    　前記第２の記録媒体に保存された前記第１動画ファイルと前記リカバリ動画ファイルを、時系列順に、１つのファイルに結合する動画データ結合部とを備える
    ことを特徴とする受信装置。     In a receiving device that receives and records moving image data wirelessly transmitted from a transmitting device,
    When the state of wireless communication with the transmission device is good, the video data transmitted from the transmission device in a stream format is received, and when the state of wireless communication with the transmission device is bad, the transmission device is once The video data is stored as a recovery video file, and at a predetermined timing, the second communication unit that receives the recovery video file transmitted from the transmission device;
    When the moving image data is received from the transmitting device in the stream format, the moving image data is stored in a second recording medium in the stream format, and the moving image data is received as the recovery moving image file from the transmitting device. A second recording control unit that stores the recovery moving image file in the file format in the second recording medium, and further converts the moving image data stored in the stream format into a file and stores the file as a first moving image file;
    A receiving apparatus, comprising: a moving image data combining unit that combines the first moving image file and the recovery moving image file stored in the second recording medium into one file in time series.
  11. 　入力される動画像に基づく動画データを無線送信する送信装置と、前記無線送信された動画データを受信して保存する受信装置とにおける動画像送受信方法において、
    　前記送信装置は、
    　　通信状態が良好な場合には前記動画データをストリーム形式で前記受信装置に送信し、
    　　前記通信状態が悪い場合には、前記受信装置へストリーム形式での前記動画データの送信を停止し、前記動画データをリカバリ動画ファイルとして保存し、
    　　前記保存されたリカバリ動画ファイルを、前記動画像記録終了指示を受けた後に、前記受信装置に送信し、
    　前記受信装置は、
    　　前記送信装置から送信されたストリーム形式の動画データを受信した場合には、受信した前記ストリーム形式の動画データをストリーム形式で保存し、
    　　前記送信装置から送信されたリカバリ動画ファイルを受信した場合には、受信した前記リカバリ動画ファイルをファイル形式で保存する
    ことを特徴とする動画像送受信方法。     In a moving image transmission / reception method in a transmitting device that wirelessly transmits moving image data based on an input moving image and a receiving device that receives and stores the wirelessly transmitted moving image data,
    The transmitter is
    When the communication state is good, the moving image data is transmitted to the receiving device in a stream format,
    If the communication state is bad, stop sending the video data in the stream format to the receiving device, save the video data as a recovery video file,
    The saved recovery video file is transmitted to the receiving device after receiving the moving image recording end instruction,
    The receiving device is:
    When receiving the moving image data in the stream format transmitted from the transmission device, the received moving image data in the stream format is saved in the stream format,
    A moving image transmission / reception method characterized by storing the received recovery video file in a file format when the recovery video file transmitted from the transmission device is received.
  12. 　入力される動画像に基づく動画データを無線送信する送信装置と、前記無線送信された動画データを受信して記録する受信装置とによる動画像送受信方法において、
    　前記送信装置は、
    　　通信状態が良好な場合には前記動画データをストリーム形式で前記受信装置に送信し、
    　　前記通信状態が悪い場合には、前記受信装置へストリーム形式での前記動画データの送信を停止し、前記動画データをリカバリ動画ファイルとして保存し、
    　　前記保存されたリカバリ用の動画データを、所定のタイミングで、前記受信装置に送信し、
    　前記受信装置は、
    　　前記送信装置から送信されたストリーム形式の動画データを受信した場合には、受信した前記ストリーム形式の動画データをストリーム形式で保存し、
    　　前記送信装置から送信されたリカバリ動画ファイルを受信した場合には、受信した前記リカバリ動画ファイルをファイル形式で保存し、
    　　更に、前記ストリーム形式で保存した動画データを、所定のタイミングでファイル化して第１動画ファイルとして保存し、
    　　前記動画像記録終了指示を受けた時に、前記保存された前記第１の動画ファイルとリカバリ動画ファイルを、時系列順に、１つのファイルに結合する
    ことを特徴とする動画像送受信方法。
          In a moving image transmission / reception method by a transmitting device that wirelessly transmits moving image data based on an input moving image and a receiving device that receives and records the wirelessly transmitted moving image data,
    The transmitter is
    When the communication state is good, the moving image data is transmitted to the receiving device in a stream format,
    If the communication state is bad, stop sending the video data in the stream format to the receiving device, save the video data as a recovery video file,
    The stored video data for recovery is transmitted to the receiving device at a predetermined timing,
    The receiving device is:
    When receiving the moving image data in the stream format transmitted from the transmission device, the received moving image data in the stream format is saved in the stream format,
    When the recovery video file transmitted from the transmission device is received, the received recovery video file is saved in a file format,
    Furthermore, the moving image data stored in the stream format is filed at a predetermined timing and stored as a first moving image file,
    A moving picture transmission / reception method, wherein when the moving picture recording end instruction is received, the stored first moving picture file and recovery moving picture file are combined into one file in time series.
PCT/JP2016/071007 2015-08-25 2016-07-15 Moving image transmission and reception system WO2017033617A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2015-166291 2015-08-25
JP2015166291 2015-08-25

Publications (1)

Publication Number Publication Date
WO2017033617A1 true WO2017033617A1 (en) 2017-03-02

Family

ID=58099849

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/071007 WO2017033617A1 (en) 2015-08-25 2016-07-15 Moving image transmission and reception system

Country Status (1)

Country Link
WO (1) WO2017033617A1 (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010088005A (en) * 2008-10-02 2010-04-15 Hitachi Ltd Content transmitting apparatus, and content receiving apparatus

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010088005A (en) * 2008-10-02 2010-04-15 Hitachi Ltd Content transmitting apparatus, and content receiving apparatus

Similar Documents

Publication Publication Date Title
US8908756B2 (en) Image transmission apparatus and image reception apparatus
US8821379B2 (en) Industrial endoscope apparatus
US20120200683A1 (en) System for recording and reproducing images
US8553996B2 (en) Image transmission terminal
US20170303767A1 (en) Endoscope for storing images
JP5063866B2 (en) Image display device
WO2017010114A1 (en) Image pickup device and electronic endoscope system
JP4477451B2 (en) Image display device, image display method, and image display program
KR100896773B1 (en) Capsule endoscope system and method for controlling time-shift thereof
JPWO2016167119A1 (en) Medical system and medical device
WO2017033617A1 (en) Moving image transmission and reception system
CN109964487B (en) Management device and management method
US10390017B2 (en) Compressed image data transmitting device, compressed image data transmitting and receiving system, compressed image data transmitting method, and non-transitory medium saving program
CN109937574B (en) Transmission device, transmission method, and content distribution system
JP2012254182A (en) Image processing device, image file storing method, image file storing program, and electronic endoscope system
WO2022029954A1 (en) Medical system and treatment protocol control method
JP2004024340A (en) Endoscope equipment
WO2020172809A1 (en) Method for video playback by photography apparatus and photography apparatus
JP6289076B2 (en) Information processing apparatus, information processing method, and program
JP6033523B1 (en) Imaging apparatus and electronic endoscope system
US20140059027A1 (en) Server device, client device, medical image processing system, and medical image processing method
CN218162689U (en) Audio and video transmission system for medical endoscope
WO2019003954A1 (en) Communication system and transmitting device
WO2023189520A1 (en) Information processing system, information processing method, and program
JP2012161541A (en) Medical image processing device and electronic endoscope system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16838964

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16838964

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP