JP2006352648A - Camera image distribution method and system thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To distribute high-quality camera image even if it is distributed to many receivers in distributing one camera image to multipoints. <P>SOLUTION: A transmitter duplicates a camera image corresponding to reception requests for the number of repeaters which transmit reception requests inside the repeaters connected to the transmitter without interposing other repeaters, and transmits the camera image to the repeaters. The repeater stores the number of receivers or repeaters which transmit the reception requests among downstream receivers or repeaters connected to the repeater without interposing the other repeaters, and duplicates the camera image for the stored number when the camera image corresponding to the reception request is received by upstream repeaters or transmitters, and transmits the camera image to the downstream receivers or repeaters. Further, the transmitter regulates sending intervals of packets so as not to be more than a predetermined value when transmitting the camera image, and transfers the camera image. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a technique for distributing video information output from a camera to a plurality of receiving devices via a network such as the Internet.

  In recent years, there has been an increasing demand for applications that distribute camera video to multiple points using the Internet. For example, an application called WebCam distributes video that the user wants to distribute, such as a neighborhood landscape or a video of a pet, with a relatively low image quality, and is widely used because a camera is inexpensive. In addition, applications that distribute relatively high-quality video along with audio, such as remote lectures and concert video distribution, are also spreading.

  However, since most of these applications use unicast (one-to-one communication protocol), it is necessary for the transmission device to copy and transmit the camera video by the number of recipients. Therefore, as the number of recipients increases, the load on the transmission device and communication line increases, data loss occurs, and camera video quality degradation such as frame dropping and block noise is caused.

  In particular, in the Internet, the uplink capacity of ADSL, which is widely spread as an access line, is often relatively low at about 1 Mbps. When camera video is distributed using a low-capacity access line in this way, an increase in the number of recipients increases the load on the access line and greatly affects video quality degradation. For example, when unicasting a camera video with a bandwidth of 300 kbps from an ADSL line is considered, the number of recipients that can be delivered without video quality deterioration is limited to three.

  On the other hand, several multicast protocols that efficiently perform one-to-many communication have been proposed. A typical protocol is IP multicast. In IP multicast, when a transmission device transmits data to a certain IP multicast address, a plurality of IP multicast routers installed in the network appropriately replicate the data, and a plurality of recipients participating in the destination IP multicast address. Transfer data to.

  As described above, by duplicating data only at a necessary place in the network, the load on the transmission apparatus and the network can be greatly improved.

  However, if there is a router in the network that does not understand the IP multicast address, distribution stops there. That is, to realize IP multicast, it is necessary to make all routers in the network compatible with IP multicast. For this reason, in a network having many routers that do not understand IP multicast such as the Internet, it is very difficult to realize IP multicast.

  FIG. 11 shows an example of multi-point distribution of camera video by conventional unicast. The video output from the camera 10 is converted into an IP packet by the transmission device 20, and is copied and transmitted by the number of recipients.

  Here, for example, the camera 10 may be a USB camera (a camera that outputs video to a USB interface), and the transmission device 20 may be a PC having a USB interface. That is, the PC receives the video from the USB camera via the USB interface, converts it into an IP packet, and transmits it.

  Alternatively, for example, the camera 10 may be a camera having a composite output, and the transmission device 20 may be a PC having a composite input and capable of converting an image received from the camera via the composite into an IP packet.

  Alternatively, for example, a camera called a network camera that can output camera video in an IP packet can be used. In this case, the camera 10 is a network camera, and the transmission device 20 is provided inside the camera 10.

A plurality of camera images from the transmission apparatus 10 pass through an access line and are connected to an ISP (Internet
The data is received by a plurality of receiving devices 40 through a plurality of routers 30 in Service Provider) and IX (Internet Exchange).

  At this time, it is necessary to duplicate and distribute the camera video from the transmission device 20 by the number of reception devices 40 used by a plurality of recipients. As the number of recipients increases, the load on the transmission device and the load on the communication path increase. Data loss occurs and video quality deteriorates. In particular, the access line often has a low line capacity like ADSL, and even a small number of receivers may deteriorate the video quality.

  Here, FIG. 11 is a simplified example, and the number of receiving devices 40 is further larger, and the number of routers 30 between the transmitting device 20 and the receiving device 40 is generally larger.

  FIG. 12 shows an example in which camera video is distributed at multiple points when an ASP (Application Service Provider) has a branch device. The video output from the camera 10 is converted into an IP packet by the transmission device 20 and transmitted to the ASP branching device 50. In the branching device 50, the camera video received from the transmitting device 20 is duplicated and transmitted by the number of receivers, and the transmitted plurality of camera videos pass through the plurality of routers 30 in the ISP and IX, and the plurality of receiving devices. 40.

  At this time, since only a single stream needs to be delivered from the transmission device 20, the load on the access line is reduced compared to the example of FIG. However, in the branching device 50, it is necessary to copy and transmit the camera video as many as the number of the receiving devices 40. Therefore, as the number of recipients increases, the load on the branching device 50 and the load on the communication path downstream from the branching device 50 increase. The video quality will be degraded.

  Further, the branching device 50 is generally configured to process camera images from a plurality of transmission devices 20. Even when the number of the transmission devices 20 increases, the processing load on the branching device 50 increases, leading to degradation of video quality. I will.

  Further, in order to solve this problem, if the processing capability of the branching device 50 is increased and the capacity of the communication path downstream from the branching device 50 is increased, the facility cost increases. When the usage fee is collected from the sender for collecting the facility cost, the usage fee also increases due to the increase in the facility cost.

  On the other hand, the protocol of Patent Document 1 performs multicast distribution by the following method.

  The plurality of receiving apparatuses transmit a reception request with the IP address of the transmitting apparatus transmitting the content to be received as a destination, and the transmitting apparatus that receives the request is requested to the plurality of receiving apparatuses that transmitted the reception request. Send the content.

  Here, when a plurality of relay devices are installed on the communication path between the transmitting and receiving devices, the relay device captures reception requests from a plurality of downstream receiving devices and relay devices, and substitutes itself as the source. Send the request to the sending device. The content received from the upstream is copied and transferred to a plurality of receiving devices and relay devices that are the transmission source of the captured reception request.

  Here, the IP addresses used for this distribution are all commonly used (unicast addresses). Therefore, even if a router that does not understand the protocol of Patent Document 1 exists in the communication path, multicast distribution is possible. In other words, the protocol of Patent Document 1 is a multicast protocol that can be used without a relay device in the network and becomes more efficient as the number of relay devices installed increases. For this reason, it can also be used in a non-IP multicast compatible network such as the Internet.

  In addition, video distribution using an IP network has a problem of degradation of video quality due to burstiness of video data. That is, when a video is packetized and transmitted, if the packet transmission interval continues for a short period, the distribution bandwidth increases, packet loss may occur due to congestion, and video quality may be degraded.

JP 2003-32300 A

  As described above, since the multi-point distribution system for camera video currently used on the Internet is based on unicast, there is a problem that the quality of video deteriorates as the number of recipients increases.

  In addition, there is a problem that the distribution bandwidth increases due to the burstiness of the video data, packet loss occurs due to congestion, and the video quality deteriorates.

  The present invention has been made in consideration of this problem. Based on the protocol of Patent Document 1, high-quality video can be distributed even if the number of recipients is large, and the packet transmission interval can be reduced. It is an object of the present invention to provide a camera video distribution method and system capable of preventing an increase in distribution band by adjusting.

  A first aspect of the present invention includes a step of transmitting a reception request for a camera image desired to be received by a receiving device to an upstream relay device or transmitting device, and a relay device receiving a receiving request from a downstream relay device or receiving device. A step of relaying to an upstream relay device or transmission device; and a transmission device receives a reception request relayed from the relay device or a reception request transmitted from the reception device, and receives a camera image corresponding to the reception request downstream of the relay device or reception Transmitting to the device, the relay device relaying the camera video from the upstream relay device or transmission device to the downstream relay device or reception device, and the receiving device being transmitted from the upstream relay device or transmission device. A camera video distribution method for executing the step of receiving a camera video.

  Here, a feature of the present invention is that the transmission device has the same number of reception requests as the number of devices that have transmitted a reception request among relay devices or reception devices connected to the transmission device without passing through other relay devices. A step of copying a camera image corresponding to the image and transferring the image to the relay device or the reception device, wherein the relay device is connected to a downstream relay device or reception device connected to the relay device or the reception device without passing through another relay device. Storing the number of devices that transmitted the reception request in step S3, and when receiving a camera image corresponding to the reception request from an upstream relay device or transmission device, the camera image corresponding to the number of devices stored in the storing step. And copying the data to the downstream relay device or receiving device.

  According to this, the camera image duplicated by the transmission device or the relay device is connected to the own device without passing through another relay device, not to the total number of the reception devices, and the relay device or the reception device that has transmitted the reception request. Just a few minutes of equipment. In other words, considering that the distribution tree has a transmitting device at the top and branches toward the downstream, the total number of receiving devices is enormous, but the number of replicas handled by the transmitting device or individual relay devices is at most. Since only a few minutes are required for the receiving device or the relay device connected to the own device without passing through another relay device, the load reducing effect is great.

  In addition, when transmitting the camera video, the transmission device can perform a step of adjusting and transferring the packet transmission interval so as not to be less than a predetermined value.

  According to this, since it is possible to avoid the camera video data from becoming bursty data, it is possible to avoid the deterioration of the video quality.

  According to a second aspect of the present invention, a receiving apparatus transmits a reception request for a camera image desired to be received to an upstream relay apparatus or transmitting apparatus, and a camera image transmitted from the upstream relay apparatus or transmitting apparatus. Means for receiving, the relay device in the previous period relays the reception request from the downstream relay device or receiving device to the upstream relay device or transmitting device, and the camera image from the upstream relay device or transmitting device downstream. Means for relaying to the relay device or the receiving device, and the transmitting device receives the reception request relayed from the relay device or the reception request transmitted from the receiving device, and transmits the camera video corresponding to the reception request to the downstream relay device Or it is a camera image | video delivery system provided with the means to transmit with respect to a receiver.

  Here, a feature of the present invention is that the transmission device has the same number of reception requests as the number of devices that have transmitted a reception request among relay devices or reception devices connected to the transmission device without passing through other relay devices. Means for copying and transferring the camera video corresponding to the relay device or receiving device to the relay device or the receiving device, and the relay device receives it within the downstream relay device or receiving device connected to itself without going through another relay device. The means for storing the number of devices that sent the request and when the camera video corresponding to the reception request is received from an upstream relay device or transmission device, the camera video is duplicated by the number of devices stored in the storage means. And means for transferring to the downstream relay device or receiving device.

  For example, the relay device can be provided in an ISP or ASP in a network that constitutes the camera video distribution system.

  A third aspect of the present invention is a transmission device used in the camera video distribution system of the present invention, and sends a reception request within a relay device or a reception device connected to itself without going through another relay device. It is characterized in that there is provided means for duplicating the camera video corresponding to the reception request and transferring it to the relay device or the receiving device for the number of devices.

  In addition, when transferring the camera video, it is possible to provide means for adjusting and transferring the packet transmission interval so that it does not become a predetermined value or less.

  Further, the transmission device of the present invention may be provided in the same casing as the casing in which the camera is provided, or may be provided in the camera. Thereby, a camera and a transmission apparatus can be comprised compactly as one apparatus.

  In addition, the relay apparatus already disclosed by patent document 1 can be diverted to the relay apparatus used for the camera video delivery system of this invention. That is, a means for storing the number of devices that have transmitted a reception request among downstream relay devices or receiving devices connected to the device without going through another relay device, and a camera image corresponding to the reception request is relayed upstream. Means for replicating the camera video for the number of devices stored in the storing means and transferring it to the downstream relay device or receiving device when received from the device or transmitting device.

  A fourth aspect of the present invention is a program that, when installed in an information processing apparatus, causes the information processing apparatus to realize a function corresponding to the transmission apparatus of the present invention. A function is realized in which the camera video corresponding to the reception request is duplicated and transferred to the relay device or the reception device for the number of devices that have transmitted the reception request among the relay devices or reception devices connected without being connected. And

  In addition, when transferring the camera video, it is possible to realize a function of adjusting and transferring the packet transmission interval so that it does not become a predetermined value or less.

  A fifth aspect of the present invention is the information processing apparatus-readable recording medium on which the program of the present invention is recorded. By recording the program of the present invention on the recording medium of the present invention, the information processing apparatus can install the program of the present invention using this recording medium. Alternatively, the program of the present invention can be directly installed in the information processing apparatus via a network from a server holding the program of the present invention.

  Thereby, the transmission apparatus which comprises the camera video delivery system of this invention is realizable using a general purpose information processing apparatus.

  According to the present invention, the video output from the camera can be distributed efficiently by using the protocol of Patent Document 1, and high-quality video can be distributed even if the number of recipients is large. Further, by setting the transmission interval of packets to be transmitted to a certain value or more, it is possible to prevent an increase in distribution bandwidth and reduce the amount of lost packets in the communication path.

  A camera video distribution method according to an embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a diagram illustrating an example of a distribution form when a camera is directly connected to the transmission apparatus according to the present embodiment. FIG. 2 is a flowchart showing a procedure in the transmission apparatus of the camera video distribution method of this embodiment. FIG. 3 is a flowchart showing a procedure in the relay apparatus of the camera video distribution method of the present embodiment. FIG. 10 is a diagram illustrating an example of a distribution form when a plurality of reception requests arrive at the transmission apparatus according to the present embodiment.

  In the following description, when the receiving device 40 and the relay device 60 are described instead of the receiving devices 40a to 40e and the relay devices 60a to 60c, the receiving device in general, the relay device in general, or the receiving devices 40a to 40e and the relay device 60a are described. It represents that it points out any unspecified apparatus of -60c.

  In this embodiment, as shown in FIG. 1 or FIG. 10, a reception request for a camera image desired to be received by the receiving device 40 is sent to the upstream relay device 60a (in the example of FIG. 1, via the routers 30a and 30b) or the relay device 60c. Alternatively, a step (S1) of transmitting to the transmitting device 20 (in the example of FIG. 10, via the routers 30a to 30c) and a step of the relay device 60 relaying a reception request from the receiving device 40 to the upstream relay device 60 or the transmitting device 20 (S2) and the transmission device 20 receives the reception request (example in FIG. 1) relayed from the relay device 60a or the reception request (example in FIG. 10) transmitted from the reception devices 40d and 40e, and responds to the reception request. A step of transmitting the camera image to the downstream relay device 60a (example in FIG. 1) or the relay device 60b and the receiving devices 40d and 40e (example in FIG. 10) (S3) The relay device 60 relays the camera video from the transmission device 20 to the downstream relay device 60 or the reception device 40 (S4), and the reception device 40 has the upstream relay devices 60a to 60c (example of FIG. 1) or This is a camera video distribution method for executing the step (S5) of receiving a camera video transmitted from the transmission device 20 (example in FIG. 10).

  Here, as a feature of the present embodiment, as shown in FIG. 2, when the transmission apparatus 20 receives a reception request (S10), the transmission apparatus 20 is connected to itself without going through another relay apparatus 60. 60 or the number of devices that have transmitted reception requests among the receiving devices 40 (only one relay device 60a in the example of FIG. 1, three relay devices 60b, 40d, and 40e in the example of FIG. 10), A step of copying (S11) the camera video corresponding to the reception request and transferring (S13) to the relay device 60 or the reception device 40 is executed, and the relay devices 60a to 60c issue the reception request as shown in FIG. When receiving (S20), the number of devices of the relay device 60 or the receiving device 40 that has sent a reception request among the downstream relay devices 60 or the receiving devices 40 connected to the device without going through the other relay device 60 is stored. Step (S21), the step of transferring the reception request upstream (S22), and when the camera video corresponding to the reception request is received from the upstream relay device 60 or the transmission device 20 (S23), the camera video is If it is a camera video corresponding to the received reception request (S24), the camera video is duplicated (S25) for the number of devices stored in the storing step and transferred to the downstream relay device 60 or receiving device 40. (S26) is executed.

  Further, as shown in FIG. 2, the transmission device 20 executes steps (S12, S14) of adjusting and transferring the packet transmission interval so as not to be less than a predetermined value when transferring the camera video.

  Next, the camera video distribution system of the present embodiment will be described with reference to FIGS. 1, 4 to 6, and 10. FIG. 4 is a block diagram showing functional expansion of the inside of the relay device that constitutes the distribution form of this embodiment. FIG. 5 is a block diagram showing the functions of the inside of the transmission apparatus constituting the distribution form of the present embodiment. FIG. 6 is a block diagram showing an expanded function of the inside of the transmission apparatus provided with the packet interval adjustment unit constituting the distribution form of the present embodiment.

  The receiving device 40 transmits a reception request for a camera image desired to be received to the upstream relay device 60 or the transmission device 20, and receives a camera image transmitted from the upstream relay device 60 or the transmission device 20. Is provided. Since the receiving device 40 can be implemented by a conventional device, detailed description thereof is omitted.

  As illustrated in FIG. 4, the relay device 60 includes a reception request relay unit 65 that relays a reception request from the downstream relay device 60 or the reception device 40 to the upstream relay device 60 or the transmission device 20, and an upstream relay device 60. Alternatively, the packet duplicating unit 62 that relays the camera video from the transmission device 20 to the downstream relay device 60 or the reception device 40, and the downstream relay device 60 or the reception device 40 connected to the packet replication unit 62 without passing through another relay device 60. And a reception request storage unit 64 that stores the number of devices of the reception device 40 that has transmitted the reception request, and the packet duplication unit 62 transmits the camera video corresponding to the reception request to the upstream relay device 60. Alternatively, when received from the transmission device 20, the camera image is duplicated by the number of devices stored in the reception request storage unit 64 and the downstream relay device 60 or the reception is received. It comprises means for transferring the location 40.

  In addition, the relay apparatus 60 can divert the relay apparatus disclosed by patent document 1 to a present Example.

  As illustrated in FIG. 5, the transmission device 20 receives a reception request relayed from the downstream relay device 60 or a reception request transmitted from the reception device 40, and transmits a camera image corresponding to the reception request to the downstream relay device 60 or A reception request processing unit 25 and a packet duplication unit 23 that transmit to the reception device 40 are provided.

  Here, the feature of the present embodiment is that the transmission device 20 is equal to the number of devices that have transmitted a reception request among the relay devices 60 or the reception devices 40 connected to the transmission device 20 without going through the other relay devices 60. The reception request processing unit 25 and the packet replication unit 23 are provided with means for copying the camera video corresponding to the reception request and transferring it to the relay device 60 or the reception device 40.

  Furthermore, as shown in FIG. 6, the transmission apparatus 20 of the present embodiment includes a packet interval adjustment unit 26 that adjusts and transfers a packet so that the packet transmission interval does not become a predetermined value or less when the camera video is transferred. It is characterized by that.

  This embodiment can be implemented as a program that, when installed in a general-purpose information processing apparatus, causes the information processing apparatus to realize functions corresponding to the transmission apparatus 20 or the relay apparatus 60 of the present embodiment. This program is recorded in a recording medium and installed in the information processing apparatus, or installed in the information processing apparatus via a communication line, so that the information processing apparatus, the transmission apparatus 20 or the relay apparatus 60 of the present embodiment has the program. The corresponding functions can be realized.

  Hereinafter, this embodiment will be described in more detail.

  An example of the distribution form of the present embodiment will be described with reference to FIG. FIG. 7 is a diagram illustrating an example of a distribution form according to the present embodiment. The video output from the camera 10 is converted into an IP packet by the transmission device 20 and transmitted. The camera video transmitted from the transmission device 20 is appropriately copied by the relay device 60 installed in the ISP and IX, and is received by the plurality of reception devices 40 through the router 30.

  At this time, it is only necessary to deliver a single stream from the transmission device 20, and since a plurality of relay devices 60 in the communication path copy and transfer the camera video as many times as necessary at a necessary location. The load on the transmission device 20 and the load on the communication path are reduced, data loss is reduced, and high-quality video distribution is possible.

  Here, FIG. 7 is a simplified example, and the same operation is performed even if the number of receiving apparatuses 40, the number of routers 30 between the transmitting apparatus 20 and the receiving apparatus 40, and the number of relay apparatuses 60 are different.

  FIG. 4 is a block diagram showing an expanded function of the inside of the relay device 60 constituting the distribution form of the present invention. The relay device 60 includes an upstream communication I / F (interface) 61 for communicating with the upstream relay device 60 or the transmission device 20, and a downstream communication for communicating with the downstream relay device 60 or the reception device 40. I / F 63, reception request relay unit 65 that relays a reception request received from downstream relay device 60 or reception device 40 to upstream relay device 60 or transmission device 20, and reception device 40 or relay device that has transmitted the reception request When the reception request storage unit 64 that stores the number of devices 60 and the camera video corresponding to the reception request are received from the upstream relay device 60 or the transmission device 20, the number of devices stored in the reception request storage unit 64, A packet duplicating unit 62 for duplicating the camera video and transferring it to the downstream receiving device 40 or the relay device 60;

  FIG. 5 is a block diagram showing the functions of the inside of the transmission apparatus 20 constituting the distribution form of the present invention. The transmission device 20 includes a camera communication I / F 21 that receives video from the camera, a packetizing unit 22 that converts the video from the camera into an IP packet, and a plurality of downstream devices to be transmitted (relay device 60, reception device). 40) from the reception request processing unit 25, and the packet duplicating unit 23 for duplicating the IP packetized camera video as many as the number of downstream devices to be transmitted, and the duplicated packet to a plurality of downstream devices The communication I / F 24 that forwards and receives reception requests from a plurality of downstream devices and the downstream plurality of devices that are the transmission source of the received reception requests are the devices to be transmitted, and the packet replication unit 23 is notified. And a request processing unit 25.

  FIG. 6 is a block diagram showing an expanded function of the inside of the transmission apparatus 20 including the packet interval adjustment unit 26 that constitutes the distribution form of this embodiment. The transmission apparatus 20 includes a camera communication I / F 21 that receives video from the camera, a packetizing unit 22 that converts the video from the camera into an IP packet, and sets the packet interval of the IP packetized camera video to a predetermined value or more. Information on the packet interval adjustment unit 26 to be adjusted and information on a plurality of downstream devices (relay device 60 and reception device 40) to be transmitted are acquired from the reception request processing unit 25, and the IP packetized camera video is to be transmitted downstream A packet duplicating unit 23 that duplicates the number of the devices, a communication I / F 24 that transfers the duplicated packets to a plurality of downstream devices and receives reception requests from the plurality of downstream devices, and a received reception request A plurality of downstream devices as transmission sources are set as devices to be transmitted, and a reception request processing unit 25 that notifies the packet duplication unit 23 is provided.

  Compared to the configuration of FIG. 5, the configuration of FIG. 6 includes a packet interval adjustment unit 26. By increasing the packet transmission interval to a predetermined value or more, the increase in distribution bandwidth is prevented, and packet loss in the communication path The amount can be reduced.

  The packet interval adjusting unit 26 receives a packet from the packetizing unit 22, passes the packet to the packet duplicating unit 23, and then receives a next packet, which is shorter than the set predetermined time, The latter packet is passed to the packet duplicating unit 23 after waiting for a predetermined time. Here, the longer the predetermined time is, the more the increase in the distribution bandwidth can be reduced. However, if the predetermined time is too long, the video transmission delay becomes large. Therefore, this predetermined time is a time adjusted according to the condition of the communication path.

  On the other hand, when the packet interval output from the packetizing unit 22 is originally large, the packet interval adjusting unit 26 is not necessary. This depends on the video encoding method. As the transmitting apparatus 20 described in the following description, either the transmitting apparatus 20 in FIG. 5 or the transmitting apparatus 20 in FIG. 6 may be used.

  Here, a plurality of downstream relay devices 60 and a plurality of reception devices 40 are directly connected to the transmission device 20 in FIGS. 5 and 6, but a plurality of routers 30 may exist between them.

  FIG. 1 shows an example of a distribution form when the camera 10 is directly connected to the transmission apparatus 20 according to the present embodiment, and the embodiment will be described.

  First, the reception devices 40a to 40e each transmit a reception request to the transmission device 20. Reception requests from the receiving devices 40a and 40b are captured by the relay device 60c. Then, the relay device 60c stores that the reception request has been captured from the reception devices 40a and 40b, and transmits the reception request to the transmission device 20. Similarly, the relay device 60b captures the reception request from the downstream relay device 60c and the reception device 40c, stores that the reception request is captured from the relay device 60c and the reception device 40c, and transmits the reception request to the transmission device 20. To do.

  Reception requests from the receiving devices 40d and 40e are captured by the relay device 60a via the routers 30a and 30b. The relay device 60a captures the reception request from the downstream relay device 60b and the reception devices 40d and 40e, stores that the reception request from the relay device 60b and the reception devices 40d and 40e is captured, and the transmission device 20 Send a receive request to

  As a result, the transmission device 20 receives only the reception request from the relay device 60a. Therefore, the reception request processing unit 25 of the transmission device 20 notifies the packet duplication unit 23 of the device that should transmit the camera video as the relay device 60a.

  Since the camera is directly connected to the transmission device 20, the video from the camera is IP packetized by the packetizing unit 22 via the camera communication I / F 21 and passed to the packet duplicating unit 23.

  In the packet duplicating unit 23, since only the relay device 60a is notified from the reception request processing unit 25, the packet duplication is not performed, and the camera video is transmitted to the relay device 60a via the communication I / F 24. To do.

  The relay device 60a duplicates and transfers the camera video to a downstream device that captures the stored reception request, that is, the relay device 60b and the receiving devices 40d and 40e. Similarly, the relay device 60b duplicates and transfers the camera video to the stored downstream device, that is, the relay device 60c and the receiving device 40c. Similarly, the relay device 60c duplicates and transfers the camera video to the stored downstream device, that is, the receiving devices 40a and 40b. As a result, it is possible to distribute the camera video to each of the receiving devices 40a to 40e.

  Here, FIG. 1 is a simplified example, and the same operation is performed even if the number of receiving apparatuses 40, the number of routers 30 between the transmitting apparatus 20 and the receiving apparatus 40, and the number of relay apparatuses 60 are different.

  FIG. 8 shows an example of a distribution form in the case where the transmission device 20 is installed in the camera 10 according to the present embodiment, and the embodiment will be described. FIG. 8 shows an embodiment in which the transmission device 20 is provided in the same casing where the camera 10 is provided, or the camera 10 is provided inside the camera 10, although the camera 10 and the transmission device 20 are separate devices. An embodiment in which the transmission device 20 is provided as one functional block is shown.

  First, the reception devices 40a to 40e each transmit a reception request to the transmission device 20. Reception requests from the receiving devices 40a and 40b are captured by the relay device 60c. Then, the relay device 60c stores that the reception request has been captured from the reception devices 40a and 40b, and transmits the reception request to the transmission device 20.

  Similarly, the relay device 60b captures the reception request from the downstream relay device 60c and the reception device 40c, stores that the reception request is captured from the relay device 60c and the reception device 40c, and transmits the reception request to the transmission device 20. To do.

  Reception requests from the receiving devices 40d and 40e are captured by the relay device 60a via the routers 30a and 30b. The relay device 60a captures the reception request from the downstream relay device 60b and the reception devices 40d and 40e, stores that the reception request from the relay device 60b and the reception devices 40d and 40e is captured, and the transmission device 20 Send a receive request to

  As a result, the transmission device 20 receives only the reception request from the relay device 60a. Therefore, the reception request processing unit 25 of the transmission device 20 notifies the packet duplication unit 23 of the device that should transmit the camera video as the relay device 60a.

  Since the transmission device 20 is installed inside the camera 10, the camera video is converted into an IP packet by the packetization unit 22 via the camera communication I / F 21 of the transmission device 20 inside the camera 10, and the packet duplication unit. 23.

  In the packet duplicating unit 23, since only the relay device 60a is notified from the reception request processing unit 25, the packet duplication is not performed, and the camera video is transmitted to the relay device 60a via the communication I / F 24. To do.

  The relay device 60a duplicates and transfers the camera video to a downstream device that captures the stored reception request, that is, the relay device 60b and the receiving devices 40d and 40e. Similarly, the relay device 60b duplicates and transfers the camera video to the stored downstream device, that is, the relay device 60c and the receiving device 40c. Similarly, the relay device 60c duplicates and transfers the camera video to the stored downstream device, that is, the receiving devices 40a and 40b. As a result, it is possible to distribute the camera video to each of the receiving devices 40a to 40e.

  Here, FIG. 8 is a simplified example, and the same operation is performed even if the number of receiving apparatuses 40, the number of routers 30 between the transmitting apparatus 20 and the receiving apparatus 40, and the number of relay apparatuses 60 are different.

  FIG. 9 shows an example of a distribution form when the transmission apparatus 20 according to the present embodiment is installed in an ISP or ASP, and the embodiment will be described. Here, it is assumed that the camera 10 is equipped with a function of packetizing camera video. Alternatively, the camera 10 is a combination of a camera and an apparatus that converts the camera into an IP packet.

  First, the reception devices 40a to 40e each transmit a reception request to the transmission device 20. Reception requests from the receiving devices 40a and 40b are captured by the relay device 60c. Then, the relay device 60c stores that the reception request has been captured from the reception devices 40a and 40b, and transmits the reception request to the transmission device 20. Similarly, the relay device 60b captures the reception request from the downstream relay device 60c and the reception device 40c, stores that the reception request is captured from the relay device 60c and the reception device 40c, and transmits the reception request to the transmission device 20. To do.

  Reception requests from the receiving devices 40d and 40e are captured by the relay device 60a via the routers 30a and 30b. The relay device 60a captures the reception request from the downstream relay device 60b and the reception devices 40d and 40e, stores that the reception request from the relay device 60b and the reception devices 40d and 40e is captured, and the transmission device 20 Send a receive request to

  As a result, the transmission device 20 receives only the reception request from the relay device 60a. Therefore, the reception request processing unit 25 of the transmission device 20 notifies the packet duplication unit 23 of the device that should transmit the camera video as the relay device 60a.

  The camera video is converted into an IP packet inside the camera 10 and transmitted to the transmission device 20 installed in the ISP or ASP. The packetizing unit 22 of the transmission apparatus 20 converts the received camera video into an IP packet again and passes it to the packet duplicating unit 23. Here, the camera video is already converted into an IP packet by the camera 10, but it is necessary to perform packet conversion in the transport layer or application layer, for example, from TCP to UDP or from HTTP to RTP. In some cases, this conversion is performed by the packetizing unit 22 and converted into IP packets again. In the packet duplicating unit 23, since only the relay device 60a is notified from the reception request processing unit 25, the packet duplication is not performed, and the camera video is transmitted to the relay device 60a via the communication I / F 24. To do.

  The relay device 60a duplicates and transfers the camera video to a downstream device that captures the stored reception request, that is, the relay device 60b and the receiving devices 40d and 40e. Similarly, the relay device 60b duplicates and transfers the camera video to the stored downstream device, that is, the relay device 60c and the receiving device 40c. Similarly, the relay device 60c duplicates and transfers the camera video to the stored downstream device, that is, the receiving devices 40a and 40b. As a result, it is possible to distribute the camera video to each of the receiving devices 40a to 40e.

  Here, FIG. 9 is a simplified example, and the same operation is performed even if the number of receiving apparatuses 40, the number of routers 30 between the transmitting apparatus 20 and the receiving apparatus 40, and the number of relay apparatuses 60 are different.

  FIG. 10 shows an example of a distribution form when a plurality of reception requests arrive at the transmission device 20 according to the present embodiment, and the embodiment will be described.

  First, the reception devices 40a to 40e each transmit a reception request to the transmission device 20. Reception requests from the receiving devices 40a and 40b are captured by the relay device 60c. Then, the relay device 60c stores that the reception request has been captured from the reception devices 40a and 40b, and transmits the reception request to the transmission device 20. Similarly, the relay device 60b captures the reception request from the downstream relay device 60c and the reception device 40c, stores that the reception request is captured from the relay device 60c and the reception device 40c, and transmits the reception request to the transmission device 20. To do.

  The reception request from the relay device 60b reaches the transmission device 20 via the router 30c, and the reception request from the reception devices 40d and 40e reaches the transmission device 20 via the routers 30a, 30b, and 30c. Accordingly, the reception request processing unit 25 of the transmission device 20 notifies the packet duplication unit 23 of the devices to which the camera video is to be transmitted as the relay device 60b and the reception devices 40d and 40e.

  Since the camera is directly connected to the transmission device 20, the video from the camera is IP packetized by the packetizing unit 22 via the camera communication I / F 21 and passed to the packet duplicating unit 23. In the packet duplicating unit 23, since the device that should transmit the camera video is notified from the reception request processing unit 25 as the relay device 60b and the receiving devices 40d and 40e, three packets of the camera video are duplicated, and the communication I / F 24 To the relay device 60b and the receiving devices 40d and 40e.

  The relay device 60b copies and transfers the camera video to a downstream device that captures the stored reception request, that is, the relay device 60c and the reception device 40c. Similarly, the relay device 60c duplicates and transmits the camera video to the stored downstream device, that is, the receiving devices 40a and 40b. As a result, it is possible to distribute the camera video to each of the receiving devices 40a to 40e.

  Here, FIG. 10 is a simplified example, and the same operation is performed even if the number of receiving apparatuses 40, the number of routers 30 between the transmitting apparatus 20 and the receiving apparatus 40, and the number of relay apparatuses 60 are different. In FIG. 10, the camera 10 is directly connected to the transmission device 20, but as shown in FIGS. 8 and 9, the transmission device 20 is installed inside the camera 10, or the transmission device 20 is connected to an ISP or ASP. Even if it is installed, it operates in the same way.

  The transmission device 20 or the relay device 60 described above has an information processing device inside. The above-described operation process is stored in a recording medium readable by the information processing apparatus in the form of a program, and the above processing is performed by the information processing apparatus reading and executing the program. Here, the information processing apparatus includes an OS and hardware such as peripheral devices.

  In addition to ROM, “information processing apparatus-readable recording medium” refers to a portable medium such as a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, and a hard disk built in the information processing apparatus. A storage device. Further, the “information processing apparatus readable recording medium” refers to a volatile memory (RAM) in an information processing apparatus as a system or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. In this way, it is assumed to include those that hold a program for a certain period of time.

  The program may be transmitted from an information processing apparatus that stores the program in a storage device or the like to another information processing apparatus via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line.

  The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on information processing apparatus, what is called a difference file (difference program) may be sufficient.

  According to the present invention, the video output from the camera can be distributed efficiently by using the protocol of Patent Document 1, and high-quality video can be distributed even if the number of recipients is large. In addition, by setting the transmission interval of packets to be transmitted to a certain value or more, it is possible to prevent an increase in the distribution bandwidth and reduce the amount of lost packets in the communication path. Network management is possible, and for users who receive camera video, service quality can be improved.

The figure which shows an example of a delivery form in case the camera is directly connected to the transmitter by a present Example. The flowchart which shows the procedure in the transmitter of the camera image delivery method of a present Example. The flowchart which shows the procedure in the relay apparatus of the camera video delivery method of a present Example. The block diagram which expanded and showed the function inside the transmitter which comprises the delivery form of a present Example. The block diagram which expanded and showed the function inside the relay apparatus which the distribution form of a present Example comprises. The block diagram which expanded and showed the function inside the transmission apparatus provided with the packet space | interval adjustment part which comprises the delivery form of a present Example. The figure which shows an example of the delivery form of a present Example. The figure which shows an example of the delivery form in case the transmission apparatus by a present Example is equipped in the inside of a camera. The figure which shows an example of the delivery form in case the transmitter by a present Example is installed in ISP or ASP. The figure which shows an example of the delivery form when a several reception request reaches | attains the transmission apparatus by a present Example. The figure which shows the delivery form of the camera image | video using the conventional unicast. The figure which shows the delivery form of the camera image | video in case a conventional ASP has a branch device.

Explanation of symbols

10 Camera 20 Transmitter 21 Camera Communication I / F
22 Packetizing unit 23, 62 Packet duplicating unit 24 Communication I / F
25 reception request processing unit 26 packet interval adjustment unit 30, 30a to 30c router 40, 40a to 40e receiving device 50 branching device 60, 60a to 60c relay device 61 upstream communication I / F
63 Downstream communication I / F
64 Reception Request Storage Unit 65 Reception Request Relay Unit

Claims (11)

Transmitting a reception request for a camera image desired to be received by the reception device to an upstream relay device or transmission device;
A relay device relays a reception request from a downstream relay device or reception device to an upstream relay device or transmission device;
A transmission device receiving a reception request relayed from a relay device or a reception request transmitted from the reception device, and transmitting a camera image corresponding to the reception request to a downstream relay device or reception device;
The relay device relays the camera video from the upstream relay device or transmission device to the downstream relay device or reception device;
Receiving a camera image transmitted from an upstream relay device or transmitting device;
The transmission device replicates the camera video corresponding to the reception request by the number of devices that have transmitted the reception request among the relay devices or reception devices connected to the transmission device without passing through other relay devices. Or perform the transfer step to the receiving device,
The relay device is
Storing the number of devices that have sent a reception request among downstream relay devices or receiving devices connected to the device without going through other relay devices;
When a camera video corresponding to the reception request is received from an upstream relay device or transmission device, the camera video is duplicated and transferred to the downstream relay device or reception device for the number of devices stored in the storing step. And a step of performing a camera video distribution method.   2. The camera video distribution method according to claim 1, wherein when transmitting the camera video, the transmission device executes a step of adjusting and transferring so that a packet transmission interval does not become a predetermined value or less. The receiving device
Means for transmitting a reception request for a camera image desired to be received to an upstream relay device or transmission device;
Means for receiving a camera image transmitted from an upstream relay device or transmission device,
The relay device
Means for relaying a reception request from a downstream relay device or reception device to an upstream relay device or transmission device;
Means for relaying the camera video from the upstream relay device or transmission device to the downstream relay device or reception device;
The transmission device receives a reception request relayed from the relay device or a reception request transmitted from the reception device, and has a means for transmitting a camera image corresponding to the reception request to a downstream relay device or reception device. In the distribution system,
The transmission device replicates the camera video corresponding to the reception request by the number of devices that have transmitted the reception request among the relay devices or reception devices connected to the transmission device without passing through other relay devices. Or a means for transferring to the receiving device,
The relay device is
Means for storing the number of devices that have transmitted a reception request among downstream relay devices or receiving devices connected to the device without going through other relay devices;
When a camera video corresponding to the reception request is received from an upstream relay device or transmission device, the camera video is duplicated and transferred to the downstream relay device or reception device for the number of devices stored in the storage means. And a camera video distribution system. The relay device is an ISP (Internet (Internet Service Provider)) in a network constituting the camera video distribution system.
4. The video distribution system according to claim 3, which is provided in a service provider (ASP) or an application service provider (ASP). A transmission device used in the camera video distribution system according to claim 3,
Duplicate the camera video corresponding to the reception request and transfer it to the relay device or receiving device for the number of devices that sent the reception request among the relay devices or receiving devices connected to itself without going through other relay devices Means for Transmitting   6. The transmission apparatus according to claim 5, further comprising means for adjusting and transferring the packet transmission interval so as not to be less than or equal to a predetermined value when transferring the camera video.   The transmission apparatus according to claim 5, wherein the transmission apparatus is provided in the same casing as the casing in which the camera is provided.   The transmission device according to claim 5, provided inside the camera. By installing on an information processing device,
A program for realizing a function corresponding to the transmission device according to claim 5,
Copy the camera video corresponding to the reception request to the relay device or the receiving device for the number of devices that sent the reception request among the relay devices or the receiving devices connected to the transmitting device without passing through another relay device. A program characterized by realizing the transfer function.   10. The program according to claim 9, which realizes a function of adjusting and transferring a packet transmission interval so as not to be a predetermined value or less when transferring a camera image.   The information processing apparatus-readable recording medium on which the program according to claim 9 or 10 is recorded.

Images