JP4303535B2 - Decode display device, imaging device, and image transmission system including the same - Google Patents

Description

  The present invention relates to an imaging device that transmits captured information and a decoding display device that decodes and displays information captured by the imaging device, and more particularly to an imaging device and a decoding display device connected via a network.

  2. Description of the Related Art Conventionally, in an image transmission system in which an image captured by an imaging device such as a monitoring system is transmitted to a decode display device and displayed, the image capture device and the decode display device are connected by a coaxial cable or the like to display or record by analog transmission. Therefore, the delay, jitter, etc. due to the transmission line are very small and not worrisome.

  In recent years, digitized image transmission systems have been constructed by connecting an imaging device and a decoding display device via a network. In such a system, delay or jitter occurs in the network, or encoding / decoding is performed. There may be a case where a delay occurs to affect the control of the imaging apparatus.

  In order to reduce the influence of such a delay or the like, when the amount of data transmitted by the imaging apparatus increases, there is a technique in which the delay is reduced by increasing the compression rate (see, for example, Patent Document 1).

In addition, there is a technique that reduces the amount of transmission information to reduce delay by reducing the resolution of a transmission image or coarsely quantizing each frame of image encoding (for example, Patent Document 2).
JP 11-239329 A JP-A-7-250322

  However, such a conventional image transmission system only attempts to reduce the delay by controlling the amount of data transmitted from the imaging device, and cannot cope with delays in the network, jitter, or delay during decoding. .

  Also, if the network path from the imaging device to the decoding display device is different, the delay and jitter in each route will be different, so even if the information of the same imaging device is decoded, it will depend on the delay and jitter difference in the network path. There were problems such as not being able to switch the display at the same time, or echoing the sound.

  The present invention has been made to solve such a problem, and can suppress the influence of delays in the network, jitters, delays in encoding / decoding, and the like, and can perform stable display reproduction. It is an object to provide an image transmission system capable of simultaneously displaying and reproducing images even if they are different.

  According to a first aspect of the present invention, there is provided a data display unit for temporarily storing processing data received via a network, and a time when the processing data is sent to the network is added to the processing data. And a communication processing unit for processing the processing data at a time calculated by adding a predetermined network delay time to the time.

  With this configuration, the received processing data is temporarily stored, a time obtained by adding a preset time to the time when the processing data is sent to the network is calculated, and the processing data is processed at this time. Accordingly, network delay and jitter are suppressed, and differences in delay and jitter due to differences in network paths between different decode display devices are absorbed.

  In the decoding display device of the second invention, in addition to the configuration of the first invention, the processing data is encoded data encoded, and the communication processing unit captures the encoded data in the encoded data. When the imaging time which is the time and the encoding delay time which is the time taken to encode the encoded data are added, the calculation is performed by adding the encoding delay time and the network delay time to the imaging time. At this time, the encoded data is decoded and displayed and reproduced.

  With this configuration, the received encoded data is temporarily stored, the time obtained by adding the encode delay time and the network delay time to the time when the encoded data was captured is calculated, and the encoded data is decoded at this time. Displayed and played back. Therefore, the delay and jitter of the network and the delay and jitter due to the encoding can be suppressed, and the delay and the difference of the jitter due to the difference of the network path in the different decoding display devices are absorbed.

  In addition to the configuration of the second invention, the decode display device of the third invention includes a decode delay storage unit that calculates and stores a decode delay time based on the time taken to decode the measured encoded data. The communication processing unit is configured to display and reproduce the encoded data at a time calculated by adding the encoding delay time, the network delay time, and the decoding delay time to the imaging time.

  With this configuration, the received encoded data is temporarily stored, and the time obtained by adding the encode delay time, the network delay time, and the measured decode delay time to the time when the encoded data was captured is calculated. The encoded data is displayed and reproduced at the time. Therefore, network delay and jitter, encoding delay and jitter, decoding delay and jitter can be suppressed, and differences in delay and jitter due to different network paths in different decoding display devices can be absorbed. .

  In addition to the configuration of the third invention, the decode display device of the fourth invention measures the time taken for the data to be transmitted through the network from the data received from the network, and based on the measured time It has a configuration including a jitter / delay measurement unit for calculating the network delay time.

  With this configuration, the received encoded data is temporarily stored, and the time obtained by adding the encoded delay time, the measured network delay time, and the measured decode delay time to the time when the encoded data was imaged is calculated. The encoded data is displayed and reproduced at this time. Accordingly, network delay and jitter, encoding delay and jitter, and decoding delay and jitter can be suppressed.

  According to a fifth aspect of the present invention, in addition to the configuration of the fourth aspect of the invention, the communication processing unit receives data for setting the encoding delay time, the decoding delay time, and the network delay time from the network. The received encoding delay time, decoding delay time and network delay time are used as the encoding delay time, decoding delay time and network delay time.

  With this configuration, the received encoded data is temporarily stored, and the time obtained by adding the encode delay time, network delay time, and decode delay time set via the network to the time when the encoded data was imaged is obtained. The encoded data is displayed and reproduced at this time. Therefore, network delay and jitter, encoding delay and jitter, decoding delay and jitter can be suppressed, and differences in delay and jitter due to different network paths in different decoding display devices can be absorbed. .

  An imaging apparatus according to a sixth aspect of the invention has a configuration including a communication processing unit that transmits the encoded data obtained by encoding the captured data with a time for transmitting the encoded data to the network.

  With this configuration, the time when the encoded data is transmitted to the network is added to the encoded data and transmitted. Therefore, the delay and jitter of the network can be controlled from the time when the encoded data is received and sent to the network.

  In addition to the configuration of the sixth invention, the imaging device of the seventh invention includes an encode delay storage unit that calculates and stores an encode delay time based on the time taken to encode the measured imaged data, The communication processing unit has a configuration in which the encoded delay time and the time when the encoded data is captured are added to the encoded data and transmitted.

  With this configuration, the time when the encoded data was captured and the encoding delay time are added to the encoded data and transmitted. Therefore, the delay and jitter due to encoding can be suppressed from the time when the encoded data is received and the encoding delay time, and the delay and jitter of the network can be controlled.

  An image transmission system according to an eighth aspect has a configuration including the decode display device according to any one of the first to fourth aspects and the imaging device according to the sixth aspect or the seventh aspect.

  With this configuration, the data captured by the imaging device is temporarily stored in the decode display device, and the display reproduction time is controlled and displayed and reproduced by each delay time. Therefore, when network delay and jitter, encoding delay and jitter, decoding delay and jitter, etc. are suppressed and displayed stably, or images from one imaging device are displayed and reproduced by a plurality of decode display devices. However, it is possible to absorb the delay and jitter due to the difference in the network route and to display and reproduce at the same time.

  An image transmission system according to a ninth aspect is the decoding display device according to the fifth aspect, the imaging device according to the seventh aspect, and the decode delay time and the network delay calculated by the decode display device via the network. Collecting the encoding delay time calculated by the imaging device, the encoding delay time, the decoding delay time, and the network delay time based on the collected encoding delay time, decoding delay time, and network delay time, and calculating the calculated encoding A reproduction time control device that sets a delay time, a decode delay time, and a network delay time in the decode display device.

  With this configuration, each delay time is collected from the decode display device and the imaging device connected to the network, and each delay time calculated based on each collected delay time is set in the decode display device. Display reproduction time is controlled by the delay time, and display reproduction is performed. Therefore, the delay and jitter of the network, the delay and jitter due to encoding, the delay and jitter of decoding, and the like can be suppressed and reproduced stably, and an image of one imaging device can be displayed by a plurality of decoding display devices. Even in the case of reproduction, it is possible to absorb the delay and jitter due to the difference in the network route and display and reproduce at the same time.

  According to the present invention, the processing data is temporarily stored, and the processing time of the processing data is controlled by the delay time, thereby suppressing the influence of the delay in the network, the jitter, the delay at the encoding / decoding, and the stable display reproduction. In addition, even if the network route is different, it can be displayed and reproduced simultaneously.

  Embodiments of the present invention will be described below with reference to the drawings.

(First embodiment)
FIG. 1 is a schematic block diagram showing an image transmission system according to a first embodiment of the present invention.

  As shown in FIG. 1, an image transmission system according to the present embodiment includes an imaging device 1 that transmits a captured image, and a decode display device 2 that decodes and displays an image from imaging information transmitted from the imaging device 1. A network 3 for connecting the imaging device 1 and the decode display device 2 is provided.

  The imaging apparatus 1 includes a CPU (Central Processing Unit) 11 that controls each unit of the imaging apparatus 1 and executes its function, an imaging control unit 12 that captures an image and sound by controlling the imaging direction and zoom, and the like. An encoding unit 13 that encodes image data captured by the imaging control unit 12, a communication interface unit 14 that is connected to the network 3 and controls transmission and reception of data by controlling the communication protocol of the network 3, and encoding encoded by the encoding unit 13 And a communication processing unit 15 that transmits imaging information including image data to the decode display device 2 through the communication interface unit 14.

  The decode display device 2 includes a CPU 21 that controls each unit of the decode display device 2 to execute its function, a communication interface unit 22 that is connected to the network 3 and controls the communication protocol of the network 3 to transmit and receive data, and a communication A communication processing unit 23 that performs processing such as extraction of encoded image data (process data) from imaging information received by the interface unit 22, and a data storage unit 24 that stores encoded image data extracted by the communication processing unit 23. A decoder 25 for decoding the encoded image data input from the communication processing unit 23, a display unit 26 for displaying and reproducing the image data decoded by the decoder 25, and a display / reproduction time control unit for controlling the display / reproduction time of the image 27 and a user interface unit 28 that receives an instruction and an operation input from the user. Eteiru.

  As shown in FIG. 2, the image transmission system including the imaging device 1 and the decoding display device 2 includes a plurality of imaging devices 1a to 1c and decoding display devices 2a to 2c connected to the network 3. An image pickup device to be displayed can be selected from the decode display devices 2a to 2c, and an image from the image pickup device can be displayed and reproduced.

  In FIG. 2, branch lines 32 a to 32 c are connected to the network 3 by bridges 31 a to 31 c, and imaging devices 1 a to 1 c and decode display devices 2 a to 2 c are connected to these branch lines 32 a to 32 c. .

  In such an image transfer system, even when an image of the same imaging device is displayed and reproduced, delay and jitter differ depending on the network path between the decode display device 2 and the imaging device 1.

  For this reason, in this embodiment, the delay between each of the imaging devices 1a to 1c and the decode display devices 2a to 2c is measured by a measuring instrument, and the worst value is determined by the user interface unit in each decode display device 2a to 2c. 28, the CPU 21 sets the network delay time in the CPU 21 as the network delay time. The CPU 21 sets the network delay time in the display reproduction time control unit 27 through the communication processing unit 23. Display playback is started and the display playback time is aligned.

  For example, when the decode display device 2b selects the image pickup device 1a, the images picked up by the image pickup control unit 12 of the image pickup device 1a are combined into image data at a preset time interval, and the image pickup time is added and encoded. The data is output to the unit 13 and is encoded by the encoding unit 13 into encoded image data.

  The communication processing unit 15 is a standard network delay time set in advance at a transmission time or a transmission time in which the imaging time added to the image data or the current time is added to the encoded image data encoded by the encoding unit 13. Is added to the decoding display device 2b via the network 3 by the communication interface unit 14 as imaging information.

  When receiving the data, the communication interface unit 22 of the decode display device 2 b passes the received data to the communication processing unit 23.

  The communication processing unit 23 extracts imaging information from the data received by the communication interface unit 22, further extracts encoded image data from the extracted imaging information, stores it in the data storage unit 24, extracts a transmission time, and controls display reproduction time. The network delay time is read from the unit 27, the network delay time is added to the transmission time to obtain the reproduction start time, and when the reproduction start time is reached, the encoded image data is read from the data storage unit 24 and output to the decoder 25.

  When the encoded image data is input, the decoder 25 decodes the encoded image data into image data, and outputs the image data to the display unit 26 for display.

  As described above, according to the present embodiment, the encoded image data transmitted from the imaging device 1 is temporarily stored in the data storage unit 24, and the display reproduction time is set in the display reproduction time control unit 27. Since control is performed according to the delay time, network delays and jitters are suppressed, differences in delays and jitters due to differences in network paths are absorbed, and a plurality of decode display devices 2 can stably reproduce at the same time. it can.

  In this embodiment, the case where only image data is transmitted is shown, but audio data may be transmitted together.

  In this embodiment, the display / reproduction time is adjusted with the network delay time on the decode display device 2 side. However, the network delay time is provided on the imaging device 1 side, and the reproduction start time is set based on the network delay time. The calculated reproduction start time may be set in the imaging information as a reproduction time and transmitted, and may be reproduced in accordance with the reproduction time set in the imaging information on the decode display device 2 side.

  In the present embodiment, the case where image data, audio data, and the like are transmitted from the imaging device 1 to the plurality of decoding display devices 2 has been described. However, the imaging device 1 is connected to the plurality of imaging devices 1 from the decoding display device 2. Similarly, when transmitting data to be controlled, the plurality of imaging devices 1 can be controlled at the same time.

(Second Embodiment)
FIG. 3 is a schematic block diagram showing an image transmission system according to the second embodiment of the present invention. In addition, since this Embodiment is comprised substantially the same as the above-mentioned embodiment, it attaches | subjects the same code | symbol to the same structure, and demonstrates only a characteristic part.

  As shown in FIG. 3, in the present embodiment, the imaging apparatus 4 is measured by an encode delay measuring unit 41 that measures the time required for encoding by the encoding unit 43 that varies depending on the image, and the encode delay measuring unit 41. An encoding delay storage unit 42 that stores the time required for encoding and outputs the worst value thereof is provided.

  In such an image pickup apparatus 4, the image picked up by the image pickup control unit 12 is added with the image pickup time and output to the encoding unit 43 as image data, as in the above-described embodiment.

  The encoding unit 43 notifies the encoding delay measurement unit 41 of the start and end of encoding of image data.

  The encoding delay measurement unit 41 measures the time required for encoding based on the input notification of the start and end of encoding, and notifies the encoding delay storage unit 42 of the time.

  The encode delay storage unit 42 compares the time input from the encode delay measurement unit 41 with the stored encode delay time, and stores the larger one as the encode delay time.

  The encoded image data encoded by the encoding unit 43 is output to the communication processing unit 44.

  When the encoded image data is input from the encoding unit 43, the communication processing unit 44 encodes the encoding delay time read from the encoding delay storage unit 42, the imaging time added to the encoded image data, or the current time. Is added to the decode display device 5 via the network 3 by the communication interface unit 14 by adding the reproduction time calculated by adding a preset standard network delay time to the transmission time and the transmission time. To do.

  When receiving the data, the communication interface unit 22 of the decode display device 5 passes the received data to the communication processing unit 51.

  The communication processing unit 51 extracts the imaging information from the data received by the communication interface unit 22, further extracts the encoded image data from the extracted imaging information, stores the encoded image data in the data storage unit 24, extracts the imaging time and the encoding delay time, The network delay time is read from the display / reproduction time control unit 27, the encoding delay time and the network delay time are added to the imaging time to obtain the reproduction start time. When the reproduction start time is reached, the encoded image data is read from the data storage unit 24. Read and output to the decoder 25.

  When the encoded image data is input, the decoder 25 decodes the encoded image data into image data, and outputs the image data to the display unit 26 for display.

  As described above, according to the present embodiment, the encoded image data transmitted from the imaging device 4 is temporarily stored in the data storage unit 24, and the reproduction time is measured with the encoding delay time measured by the imaging device and the display reproduction. Since the control is performed according to the network delay time set in the time control unit 27, the delay and jitter of the network are suppressed, the difference of the delay and jitter due to the difference in the network path, and the delay and jitter of the encoding in the imaging device 4 It can be absorbed and reproduced stably at the same time by a plurality of decode display devices 5.

  In this embodiment, the case where only image data is transmitted is shown, but audio data may be transmitted together.

  In this embodiment, the encoding delay storage unit 42 stores the largest value (worst value) of the encoding time in the encoding unit 43 as the encoding delay time. May be stored as the encoding delay time.

  In this embodiment, the playback time is adjusted with the network delay time on the decode display device 5 side. However, the network delay time is provided on the imaging device 4 side, and based on the network delay time and the encode delay time. The reproduction start time may be calculated, and the calculated reproduction start time may be set and transmitted as imaging time in the imaging information, and may be reproduced in accordance with the reproduction time set in the imaging information on the decode display device 5 side. .

(Third embodiment)
FIG. 4 is a schematic block diagram showing an image transmission system according to the third embodiment of the present invention. In addition, since this Embodiment is comprised substantially the same as the above-mentioned embodiment, it attaches | subjects the same code | symbol to the same structure, and demonstrates only a characteristic part.

  As shown in FIG. 4, in the present embodiment, the decode display device 6 is measured by the decode delay measuring unit 61 that measures the time required for decoding by the decoder 63 that varies depending on the image, and the decode delay measuring unit 61. The decoding delay storage unit 62 stores the time required for decoding and outputs the worst value.

  In such a decode display device 6, the decoder 63 notifies the decode delay measuring unit 61 of the start and end of decoding of the encoded image data.

  The decode delay measurement unit 61 measures the time required for decoding based on the input notification of start and end of decoding, and notifies the decode delay storage unit 62 of the time.

  The decode delay storage unit 62 compares the time input from the decode delay measurement unit 61 with the stored decode delay time, and stores the larger one as the decode delay time.

  In this way, the worst value of the time taken for decoding is stored in the decode delay storage unit 62 as the decode delay time.

  Similarly to the above-described embodiment, the image captured by the imaging control unit 12 of the imaging device 4 is encoded by the encoding unit 43, the encoding delay time is added by the communication processing unit 44, and the communication is performed as imaging information. The data is transmitted to the decode display device 6 by the interface unit 14.

  When receiving the data, the communication interface unit 22 of the decode display device 6 passes the received data to the communication processing unit 64.

  The communication processing unit 64 extracts imaging information from the data received by the communication interface unit 22, further extracts encoded image data from the extracted imaging information, stores the encoded image data in the data storage unit 24, extracts an imaging time and an encoding delay time, The network delay time is read from the display reproduction time control unit 27, the decode delay time is read from the decode delay storage unit 62, and the reproduction start time is obtained by adding the encode delay time, the network delay time, and the decode delay time to the imaging time, The encoded image data is read from the data storage unit 24, and the read encoded image data and the calculated reproduction start time are output to the decoder 63.

  When the encoded image data and the reproduction start time are input, the decoder 63 decodes the encoded image data into image data, and outputs the decoded image data to the display unit 26 when the reproduction start time is reached. Let As a matter of course, the decoding start and end are notified to the decoding delay measuring unit 61 and are subject to measurement of the decoding delay time.

  As described above, according to the present embodiment, the encoded image data transmitted from the imaging device 4 is temporarily stored in the data storage unit 24, and the reproduction time is displayed with the encoding delay time measured by the imaging device 4. Since control is performed according to the network delay time set in the reproduction time control unit 27 and the decode delay time stored in the decode delay storage unit 62, the network delay and jitter are suppressed, and the delay and jitter due to the difference in the network path are suppressed. The difference, the delay and jitter of encoding in the image pickup device 4 and the delay and jitter of decoding in the decode display device 6 can be absorbed, and a plurality of decode display devices 6 can stably reproduce at the same time.

  In this embodiment, the case where only image data is transmitted is shown, but audio data may be transmitted together.

  In the present embodiment, the decoding delay storage unit 62 stores the largest value (worst value) of the time required for decoding by the decoder 63 as the decoding delay time. The value may be stored as a decode delay time.

  In this embodiment, the playback time is adjusted with the network delay time on the decode display device 6 side. However, the network delay time is provided on the imaging device 4 side, and based on the network delay time and the encode delay time. The reproduction start time is calculated, the calculated reproduction start time is set as the reproduction information in the imaging information and transmitted, and the decoding start time is added to the reproduction time set in the imaging information on the decode display device 6 side. And may be played back at the playback start time.

(Fourth embodiment)
FIG. 5 is a schematic block diagram showing an image transmission system according to the fourth embodiment of the present invention. In addition, since this Embodiment is comprised substantially the same as the above-mentioned embodiment, it attaches | subjects the same code | symbol to the same structure, and demonstrates only a characteristic part.

  As shown in FIG. 5, in the present embodiment, the decode display device 7 is provided with a jitter / delay measurement unit 71 that measures the delay time of the network from the received imaging information.

  As shown in FIG. 6, the jitter / delay measurement unit 71 includes an imaging time extraction unit 711 that extracts imaging time from imaging information, a transmission time extraction unit 712 that extracts transmission time from imaging information, and an imaging time extraction unit 711. The time synchronization unit 713 that synchronizes the time to the imaging device 4 from the image capturing time extracted by the image capturing device 4, and the jitter that calculates the network delay time from the time created by the time synchronization unit 713 and the transmission time extracted by the transmission time extraction unit 712 A delay calculation unit 714.

  In such a decoding display device 7, when the jitter / delay measurement unit 71 receives imaging information extracted from data received by the communication interface unit 22 from the communication processing unit 72, the imaging time extraction unit 711 The imaging time is extracted from the data and output to the time synchronization unit 713.

  The time synchronization unit 713 synchronizes the time with the input imaging time, and outputs the time synchronized with the time of the imaging device 4 to the jitter / delay calculation unit 714.

  The transmission time extraction unit 712 extracts the transmission time from the input imaging information and outputs it to the jitter / delay calculation unit 714.

  The jitter / delay calculation unit 714 decodes and displays the imaging information from the imaging device 4 based on the transmission time extracted by the transmission time extraction unit 712 and the current time synchronized with the imaging device 4 by the time synchronization unit 713. The time taken to arrive at the device 7 is calculated, and the calculated time is input to the display reproduction time control unit 73 via the communication processing unit 72.

  When the time is input from the communication processing unit 72, the display reproduction time control unit 73 compares the stored network delay time with the input time, and stores the larger one as the network delay time. .

  Similarly to the above-described embodiment, the image captured by the imaging control unit 12 of the imaging device 4 is encoded by the encoding unit 43, the encoding delay time is added by the communication processing unit 44, and the communication is performed as imaging information. The data is transmitted to the decode display device 7 by the interface unit 14.

  When receiving the data, the communication interface unit 22 of the decode display device 7 passes the received data to the communication processing unit 72.

  The communication processing unit 72 extracts imaging information from the data received by the communication interface unit 22, outputs the extracted imaging information to the jitter / delay measurement unit 71, and further extracts encoded image data from the extracted imaging information. Store in the storage unit 24, take out the imaging time and encoding delay time, read out the network delay time from the display reproduction time control unit 73, read out the decoding delay time from the decoding delay storage unit 62, and read out the encoding delay time and network delay at the imaging time The reproduction start time is obtained by adding the time and the decode delay time, the encoded image data is read from the data storage unit 24, and the read encoded image data and the calculated reproduction start time are output to the decoder 63.

  When the encoded image data and the reproduction start time are input, the decoder 63 decodes the encoded image data into image data, and outputs the decoded image data to the display unit 26 when the reproduction start time is reached. Let

  As described above, according to the present embodiment, the encoded image data transmitted from the imaging device 4 is temporarily stored in the data storage unit 24, and the reproduction time is measured by the encoding delay time and jitter measured by the imaging device 4. Since control is performed according to the network delay time measured by the delay measurement unit 71 and the decode delay time stored in the decode delay storage unit 62, the network delay and jitter, the encoding delay and jitter in the imaging device 4, Thus, the decoding delay and jitter in the decode display device 7 can be absorbed and reproduced stably.

  As another aspect of the present embodiment, as shown in FIG. 7, a jitter / delay measurement unit 74 is provided with a GPS unit 741 that acquires time from a GPS (Global Positioning System), and the time synchronization unit 742 The time synchronized with the time output by the unit 741 is output.

  In this case, needless to say, it is necessary for the imaging device 4 side to also synchronize the time by GPS.

  In this embodiment, the case where only image data is transmitted is shown, but audio data may be transmitted together.

  In the present embodiment, the largest value (worst value) of the time required for network transmission is stored as the network delay time in the jitter / delay measurement units 71 and 74. The average value may be stored as the network delay time.

(Fifth embodiment)
FIG. 8 is a schematic block diagram showing an image transmission system according to the fifth embodiment of the present invention. In addition, since this Embodiment is comprised substantially the same as the above-mentioned embodiment, it attaches | subjects the same code | symbol to the same structure, and demonstrates only a characteristic part.

  As shown in FIG. 8, in the present embodiment, the encode delay time, network delay time, and decode delay time measured by the respective devices are collected from the imaging device 4 and the decode display device 9 on the network 3. The reproduction time control device 8 is provided that calculates the worst value of the collected delay times and notifies the decode display device 9 of the calculated delay times.

  In such an image transmission system, the reproduction time control device 8 includes an encoding delay time measured from a plurality of preset imaging devices 4 and decoding display devices 9 connected to the network 3 for each preset period. Collect network delay time, decode delay time.

  The reproduction time control device 8 calculates the longest delay time from the collected delay times for each delay time, and sends the calculated encode delay time, network delay time, and decode delay time via the network 3. It transmits to all the decoding display apparatuses 9.

  When receiving the delay time from the playback time control device 8 from the communication interface unit 22, the communication processing unit 91 of the decode display device 9 sets the encode delay time, network delay time, and decode delay time in the display playback time control unit 92. To do.

  When the encoding / delay time, the network delay time, and the decode delay time are input from the communication processing unit 91, the display / reproduction time control unit 92 stores each delay time.

  Similarly to the above-described embodiment, the image captured by the imaging control unit 12 of the imaging device 4 is encoded by the encoding unit 43, the encoding delay time is added by the communication processing unit 44, and the communication is performed as imaging information. The data is transmitted to the decode display device 9 by the interface unit 14.

  When receiving the data, the communication interface unit 22 of the decode display device 9 passes the received data to the communication processing unit 91.

  The communication processing unit 91 extracts imaging information from the data received by the communication interface unit 22, outputs the extracted imaging information to the jitter / delay measurement unit 71, and further extracts encoded image data from the extracted imaging information. Store in the storage unit 24, extract the imaging time, read out the encoding delay time, network delay time, and decoding delay time from the display reproduction time control unit 92, and add the encoding delay time, network delay time, and decoding delay time to the imaging time Then, the reproduction start time is obtained, the encoded image data is read from the data storage unit 24, and the read encoded image data and the calculated reproduction start time are output to the decoder 63.

  When the encoded image data and the reproduction start time are input, the decoder 63 decodes the encoded image data into image data, and outputs the decoded image data to the display unit 26 when the reproduction start time is reached. Let

  As described above, according to the present embodiment, the encoded image data transmitted from the imaging device 4 is temporarily stored in the data storage unit 24, and the reproduction time is measured by the imaging device 4 and the decode display device 9. Since control is performed according to the worst values of encoding delay time, network delay time, and decoding delay time, network delay and jitter are suppressed, delay and jitter differences due to differences in network paths, and encoding by the image pickup apparatus 4. Can be reproduced stably at the same time on a plurality of decode display devices 9.

  In this embodiment, the case where only image data is transmitted is shown, but audio data may be transmitted together.

  Further, in the present embodiment, the largest value (worst value) among the encode delay time, network delay time, and decode delay time collected from each imaging device 4 and decode display device 9 by the reproduction time control device 8 respectively. However, the average value of each delay time may be transmitted as each delay time.

  In the present embodiment, the case where image data, audio data, and the like are transmitted from the imaging device 4 to the plurality of decoding display devices 9 has been described. However, the imaging device 4 is connected to the plurality of imaging devices 4 from the decoding display device 9. Similarly, when transmitting data to be controlled, the plurality of imaging devices 4 can be controlled at the same time.

  As described above, the decoding display device, the imaging device, and the image transmission system including the decoding device according to the present invention perform stable display reproduction while suppressing the influence of delay in the network, jitter, delay in encoding / decoding, and the like. Furthermore, even if the route of the network is different, it has the effect that it can be displayed and reproduced at the same time, and is useful as an imaging device and a decoding display device connected via the network.

The block diagram which shows the image transmission system of the 1st Embodiment of this invention 1 is a system configuration diagram showing an image transmission system according to a first embodiment of the present invention. The block diagram which shows the image transmission system of the 2nd Embodiment of this invention The block diagram which shows the image transmission system of the 3rd Embodiment of this invention The block diagram which shows the image transmission system of the 4th Embodiment of this invention The block diagram which shows the jitter and delay measurement part of the image transmission system of the 4th Embodiment of this invention The block diagram which shows the jitter and delay measurement part of the image transmission system of the other aspect of the 4th Embodiment of this invention The block diagram which shows the image transmission system of the 5th Embodiment of this invention

Explanation of symbols

1, 1a to 1c Imaging device 11 CPU (Central Processing Unit)
DESCRIPTION OF SYMBOLS 12 Imaging control part 13 Encoding part 14 Communication interface part 15 Communication processing part 2, 2a-2c Decoding display apparatus 21 CPU
DESCRIPTION OF SYMBOLS 22 Communication interface part 23 Communication processing part 24 Data storage part 25 Decoder 26 Display part 27 Display reproduction time control part 28 User interface part 3 Network 31a-31c Bridge 32a-32c Branch line 4 Imaging device 41 Encode delay measurement part 42 Encode delay memory part 43 Encoding Unit 44 Communication Processing Unit 5 Decode Display Device 51 Communication Processing Unit 6 Decode Display Device 61 Decode Delay Measurement Unit 62 Decode Delay Storage Unit 63 Decoder 64 Communication Processing Unit 7 Decode Display Device 71 Jitter / Delay Measurement Unit 711 Imaging Time Extraction Unit 712 Transmission time extraction unit 713 Time synchronization unit 714 Jitter / delay calculation unit 72 Communication processing unit 73 Display reproduction time control unit 74 Jitter / delay measurement unit 741 GPS unit 742 Time synchronization unit 8 Playback time control device 9 Over de display device 91 communication processing unit 92 displays the playback time control unit

Claims (6)

A data storage unit that temporarily stores encoded encoded data received via a network , an imaging time that is a time at which the encoded data is imaged, and the encoded data are encoded in the encoded data. when the encoding delay time is the time taken was added to the added to the encoding delay time及beauty network delay time is displayed reproduced by decoding the encoded data to the calculated time to the imaging time features and to Lud code display device that includes a communication processing unit. A decoding delay storage unit that calculates and stores a decoding delay time based on the time taken to decode the measured encoded data, and the communication processing unit includes the encoding delay time and the network delay at the imaging time decoding display device according to claim 1, wherein the displaying reproduce the coded data time and time that is calculated by adding the decoding delay time. A jitter / delay measurement unit is provided for measuring a time taken for the data to be transmitted through the network from data received from the network and calculating the network delay time based on the measured time. The decoding display device according to claim 2 . When the communication processing unit receives data for setting the encoding delay time, the decoding delay time, and the network delay time from the network, the communication processing unit converts the received encoding delay time, decoding delay time, and network delay time to the encoding delay time. 4. The decoding display device according to claim 3 , wherein the decoding display device is used as the decoding delay time and the network delay time. A communication processing unit to send the encoded data obtained by encoding the captured data to the network,
An encoding delay storage unit that calculates and stores an encoding delay time based on the measured time taken to encode the captured data, and the communication processing unit includes the encoding delay time and the encoded delay time in the encoded data imaging device encoded data, wherein the benzalkonium be transmitted by adding the time taken. The decode display device according to claim 4 , the image pickup device according to claim 5 , and the decode delay time and the network delay time calculated by the decode display device via the network, the image pickup device calculated Collecting the encoding delay time, calculating the encoding delay time, decoding delay time and network delay time based on the collected encoding delay time, decoding delay time and network delay time, and calculating the calculated encoding delay time, decoding delay time and network An image transmission system comprising: a reproduction time control device that sets a delay time in the decode display device.

Images