JP7431207B2 - Data receiving device, data receiving method, and program - Google Patents

Description

The present invention relates to a data receiving device, a data receiving method, and a program.

Conventionally, regarding the production method of TV programs, "remote production" involves transmitting the video source from the relay destination site to a remote program production base, etc., and then performing video switching and audio mixing to create the program remotely. It has been known. Remote production has the advantage of reducing costs because it eliminates the need to station personnel at the relay destination site.

Regarding this, Non-Patent Document 1 describes IP remote production, in which remote control for remote production (control of cameras, etc. placed from the program production base to the relay destination site) and video transmission, etc. are carried out over an IP network. This article describes how to further reduce costs by making this possible.

Internet, [About "IP remote production" initiatives], <https://www.ntte-sports.co.jp/topics20210628.html>

However, in the IP remote production system in Non-Patent Document 1, although cost reduction is taken into consideration, while ensuring the real-time nature of the relay destination local video that is referenced by the operator at the program production base during remote control, No consideration is given to enabling the transmission of high-quality on-air images or archival images.

Therefore, the present invention has been made in view of the above, and provides data that improves real-time performance regarding remote control when receiving data via a packet communication network, and enables high-quality data to be received. The purpose is to provide reception technology.

A data receiving device according to one aspect of the present invention is a data receiving device that receives data from a data transmitting device via a packet communication network, and includes a receiving unit that receives a first packet from the data transmitting device; a first generating unit that generates first output data based on the data; a requesting unit that requests the data transmitting device to transmit the missing packets when some of the packets are missing; and a second generation unit that generates second output data based on the second packet supplemented with packets transmitted from the data transmission device.

A data receiving method according to one aspect of the present invention is a data receiving method executed by a data receiving device that receives data from a data transmitting device via a packet communication network, and includes the step of receiving a first packet from the data transmitting device. a first generation step of generating first output data based on the first packet; a step of requesting the data transmitter to transmit the missing packet when some packets are missing; and a second generation step of generating second output data based on a second packet supplemented with packets transmitted from the data transmitting device in response to a request.

A program according to an aspect of the present invention includes a data receiving device that receives data from a data transmitting device via a packet communication network, a receiving unit that receives a first packet from the data transmitting device, and a receiving unit that receives data from the data transmitting device via a packet communication network. a first generation unit that generates one output data; a request unit that requests the data transmission device to transmit the missing packets when some of the packets are missing; a second generation unit that generates second output data based on a second packet supplemented with transmitted packets; and a program for executing the second generation unit.

In the present invention, "section", "device", and "system" do not simply mean physical means, but when the functions of the "section", "device", and "system" are realized by software. Also included. Furthermore, even if the function of one "department," "device," or "system" is realized by two or more physical means or devices, two or more "departments," "devices," or "systems" A function may be implemented by a single physical means or device.

According to aspects of the present invention, it is possible to improve real-time performance regarding remote control when receiving data via a packet communication network, and to receive high-quality data.

1 is a diagram showing an example of the overall configuration of a data transmission system according to an embodiment of the present invention. FIG. 1 is a diagram showing functional blocks of a receiving device according to an embodiment of the present invention. FIG. 2 is a conceptual diagram illustrating an example of an overview of data generation processing that generates a plurality of different output data according to an embodiment of the present invention. 3 is an example of a flowchart of data generation processing according to an embodiment of the present invention. FIG. 3 is a diagram showing another example of the overall configuration of a data transmission system according to an embodiment of the present invention. 1 is a diagram showing an example of a hardware configuration of a computer according to an embodiment of the present invention.

Embodiments of the present invention will be described below with reference to the drawings. However, the embodiments described below are merely examples, and there is no intention to exclude the application of various modifications and techniques not specified below. That is, the present invention can be implemented with various modifications (such as combining the embodiments) without departing from the spirit thereof. In addition, in the description of the drawings below, the same or similar parts are denoted by the same or similar symbols.

FIG. 1 is a diagram showing an example of the overall configuration of a data transmission system according to an embodiment of the present invention. The data transmission system 100 is, for example, a data transmission system that employs IP remote production in which remote control, video transmission, and the like for remote production are performed over an IP network. The data transmission system 100 exemplarily includes a receiving device 1 (data receiving device), a transmitting device 3 (data transmitting device), a camera 5, a display device 7, and a switching device 9.

Note that the data transmission system 100 may each include a plurality of receiving devices 1, transmission devices 3, cameras 5, and display devices 7. In this case, each receiving device 1 receives data acquired by different cameras 5 from a plurality of relay destination sites. Then, the switching device 9 receives OA data and storage data, which will be described later, generated by each receiving device 1, and switches and outputs them as appropriate.

The receiving device 1 is a device that is placed, for example, at a program production base such as a television station, and receives audio data including video data and audio data transmitted from the transmission device 3. The receiving device 1 requests the transmitting device 3 to retransmit the missing packet, which is a missing data packet among the plurality of data packets (packets) transmitted from the transmitting device 3.

The receiving device 1 generates, for example, three output data: operation data (first output data), on-air (OA) data (second output data), and storage data (third output data). . The receiving device 1 may generate two, four or more pieces of output data. The operation data, OA data, and storage data are data generated by the receiving device 1 and include at least one of video data and sound data.

The operation data includes, for example, data for reference by the user U who is located at the program production base and who operates the camera 5 placed at the relay destination site in real time. The user U checks the state of the relay destination site while referring to the operation data displayed (output) on the display device 7, and controls the arrangement position, direction, height, etc. of the camera 5. Note that the object of the remote control by the user U is not limited to the camera, and may be any other device.

As mentioned above, the operation data is data that the user U refers to in order to operate the camera 5 in real time, so although it has more data packet loss than the OA data and storage data, it is data with low delay. There is a need. That is, the operation data may be of a quality that allows the user U to check the relay destination site and appropriately operate the camera 5, and may be of lower quality than the OA data and storage data.

The OA data includes, for example, data that is generated as data that is actually broadcasted as broadcast content at a broadcast station. The OA data is, for example, data with a higher delay than the operation data and with a lower delay than the storage data. OA data refers to data of a quality (medium quality) with less data packet loss than operation data and more data packet loss (data loss) than storage data. The OA data is sent to a predetermined broadcasting device so that it can be broadcast as content, for example.

The storage data includes, for example, data recorded for storage in a predetermined database of the program production base. The storage data is, for example, data with a higher delay than the operation data and the OA data. Storage data refers to high-quality data with less data packet loss or no packet loss (no data loss or almost no data loss) than operation data and OA data.

The receiving device 1 transmits the generated operation data to the display device 7. The receiving device 1 transmits at least one of the generated OA data and storage data to the switching device 9.

The transmission device 3 is a device that is placed, for example, at a relay destination site, receives video data and sound data acquired by the camera 5, and transmits it to the reception device 1. The transmission device 3 receives the request for retransmission of the missing data packet from the receiving device 1, and retransmits the missing data packet.

The camera 5 is a device that is placed, for example, at a relay destination site and acquires video data generated by capturing an image of the surrounding area. Furthermore, the camera 5 may further acquire surrounding sound data. The camera 5 transmits the acquired video data and sound data to the transmission device 3.

The display device 7 is disposed at a program production base, for example, and receives operation data transmitted from the receiving device 1 and displays (outputs) the data. The display device 7 is operated by the user U, and transmits an operation control signal for operating the camera 5 to the camera 5 based on an input from the user U.

The switching device 9 is a device that is disposed at a program production base, for example, and receives at least one of OA data and storage data transmitted from the receiving device 1, and switches and outputs the data. The switching device 9 is operated by an operator different from the user U, but may be operated by the user U who operates the display device 7.

The receiving device 1, the transmitting device 3, the camera 5, the display device 7, and the switching device 9 are connected through a predetermined network and are configured to be able to transmit and receive various data and signals. The predetermined network is a communication line for transmitting data between the receiving device 1, the transmitting device 3, the camera 5, the display device 7, and the switching device 9.

The predetermined network may be a packet communication network (or a combination thereof) such as a LAN or the Internet, and is not affected by the physical layer. Therefore, the physical layer may be Ethernet (registered trademark), a wireless communication network, a public telephone communication network, a general telephone line network, other communication lines, a combination thereof, or the like. The network may also include gateways, various base stations, exchanges, etc. for connecting communication networks.

As described above, the IP remote production system in Non-Patent Document 1 can reduce costs. However, in such conventional IP remote production systems, while ensuring the real-time nature of the relay destination local video that is referred to by the operator at the program production base during remote control, it is possible to obtain high-quality on-air images or images for storage. Requests to enable transmission cannot be met.

Therefore, according to an embodiment of the present invention, the receiving device 1 receives a plurality of data packets (first packets) from the transmitting device 3, and provides first output data (for example, operation data) based on the plurality of data packets. ОPD). The receiving device 1 requests the transmitting device 3 to transmit the missing data packets when some of the packets are missing, and the receiving device 1 requests the transmitting device 3 to transmit the missing data packets, and in response to the request from the receiving device 1, the receiving device 1 requests the transmitting device 3 to send a plurality of supplementary data packets transmitted from the transmitting device 3 in response to the request from the receiving device 1. second output data (for example, OA data OAD or storage data SD) is generated based on the data packet (second packet).

Therefore, the user U at the program production base can appropriately operate the camera 5 located at the relay destination site while appropriately referring to the operation data displayed in real time on the display device 7. Further, the receiving device 1 is capable of generating and outputting at least one of OA data OAD and storage data SD, which have higher quality than the operation data. Therefore, the receiving device 1 can improve real-time performance regarding remote control when receiving data via a packet communication network, and can receive high-quality data.

Functions of a receiving device according to an embodiment of the present invention will be described with reference to FIGS. 2 and 3. FIG. 2 is a diagram showing functional blocks of a receiving device according to an embodiment of the present invention. FIG. 3 is a conceptual diagram illustrating an example of an overview of data generation processing that generates a plurality of different output data according to an embodiment of the present invention.

As shown in FIG. 2, the receiving device 1 functionally includes an information processing unit 10 that executes various processes for generating output data, and an information processing unit 10 that executes various processes for generating output data. A storage unit 11 that stores execution results of the various processes.

Note that the receiving device 1 is configured by, for example, an information processing device configured as a computer system, and is implemented by a software program. The program may be provided by being downloaded from outside the receiving device 1 via a predetermined network, or may be provided on various computer-readable information recording media such as CD-ROM or DVD-ROM. may be provided by.

The information processing unit 10 functionally includes a receiving unit 12, a missing packet detecting unit 13 (detecting unit), a setting unit 14, a missing packet requesting unit 15 (requesting unit), and an operation data generating unit 16 (requesting unit). 1 generation section), an OA data generation section 17 (second generation section), and a storage data generation section (third generation section) 18.

The receiving unit 12 receives the data packet P transmitted from the transmission device 3. In the example of FIG. 3, the receiving unit 12 receives a plurality of packets in which some data packets P are missing ("(1) Packet sending" and "(2) Packet receiving" in FIG. 3). The receiving unit 12 receives frames FR of data packets with frame numbers 101, 102, 103, 104, 105, . . . from the transmission device 3, for example. The transmitting device 3 may perform a predetermined encoding process when transmitting the data packet P to the receiving device 1.

In the example of FIG. 3, among the plurality of data packets P received by the receiving unit 12, data packet "2" of frame 101, data packet "4" of frame 102, data packet "3" of frame 103, and data packet "3" of frame 104 are shown. Data packet “2” and data packets “3” and “4” of frame 105 are missing.

The operation data generation unit 16 generates operation data OPD based on a plurality of packets transmitted from the transmission device 3 in which some data packets P are missing. First, the operation data generation unit 16 replenishes the data packet by, for example, forward error correction (FEC) ("Recovery by FEC" in FIG. 3). In the example of FIG. 3, the data packets supplemented by FEC are data packet “2” in frame 101 and data packet “3” in frame 103. Although FEC is mentioned as an error correction encoding technique, other techniques may be adopted.

The operation data generation unit 16 generates operation data OPD based on a plurality of data packets including data packets supplemented by FEC (for example, data packet "2" of frame 101 and data packet "3" of frame 103). ("(4) Operation data generation" in FIG. 3). As mentioned above, the operation data OPD is data that the user U at the program production base refers to in order to operate the camera 5 placed at the relay destination site in real time, so it is more important than the OA data and storage data. It must be data with low delay (shortest delay).

The missing packet detection unit 13 detects missing data packets in the plurality of data packets received by the receiving unit 12 (“(5) Missing packet detection” in FIG. 3). The missing packet detection unit 13 detects missing packets among the plurality of data packets received by the receiving unit 12 and supplemented by FEC.

Specifically, in the example of FIG. 3, the missing packet detection unit 13 detects data packet "4" of frame 102, data packet "2" of frame 104, and data packets "3" and "4" of frame 105. is detected as a missing data packet. Note that in this case, data packet "2" of frame 101 and data packet "3" of frame 103 are data packets supplemented by FEC, and therefore are not detected as missing data packets.

The missing packet detection unit 13 may detect a missing data packet every time the missing data packet is repeatedly retransmitted from the transmission device 3. According to this configuration, it is possible to appropriately manage the replenishment status of data packets received by the receiving unit 12.

The missing packet detection unit 13 may detect missing data packets in a plurality of data packets (a plurality of data packets first received by the receiving unit 12) before being supplemented by FEC.

The setting unit 14 sets a permissible period (for example, 2 to 3 seconds) (predetermined period) regarding a delay in transmitting data from the transmission device 3 ("(6) Delay period setting" in FIG. 3). The setting unit 14 stores the set tolerance value in the storage unit 11 as setting information SI. The setting unit 14 sets the allowable period based on information regarding packet loss of a plurality of data packets transmitted from the transmission device 3 (for example, data packet information PI) and decoding processing results of a plurality of data packets transmitted from the transmission device 3. The setting is based on at least one of the information related to the decoding processing information (for example, decoding processing information DPI). Note that the permissible period is arbitrary and may be set shorter or longer than the above-mentioned limit of 2 to 3 seconds.

The information regarding the packet loss of the plurality of data packets transmitted from the transmission device 3 includes information regarding the degree of packet loss, and includes, for example, at least one of the packet loss rate and the number of packet losses.

Information regarding the decoding processing results of multiple packets transmitted from the transmission device 3 includes, for example, the number of frames FR that could not be supplemented (decoded) by FEC, the ratio of frames FR that could not be decoded by FEC, and the number of frames FR that could not be decoded by FEC. It includes at least one of the number of data packets P that were decoded and the percentage of data packets P that could not be decoded by FEC.

The missing packet requesting unit 15 requests the transmission device 3 to transmit the missing data packet detected by the missing packet detecting unit 13 (“(7) Request for missing packet” in FIG. 3). In the example of FIG. 3, the missing packet request unit 15 sends the missing data packets "4" of frame 102, "2" of frame 104, and the data packet of frame 105 that could not be supplemented by FEC. The transmission device 3 is requested to retransmit "3" and "4".

The transmission device 3 transmits the missing data packet to the receiving device 1 based on the request from the missing packet requesting unit 15 (“(8) Sending the missing packet” in FIG. 3). Transmission device 3 attempts to retransmit data packet “4” of frame 102, data packet “2” of frame 104, and data packets “3” and “4” of frame 105 as requested by receiving device 1. However, in the example of FIG. 3, data packets "3" and "4" of frame 105 are lost during transmission, and only data packet "4" of frame 102 and data packet "2" of frame 104 are transmitted to the receiving device. Reach 1.

The missing packet requesting unit 15 may repeatedly request the transmission device 3 to transmit the missing data packet until the missing data packet is no longer detected by the missing packet detecting unit 13 (until the number falls below a predetermined standard). The predetermined criteria are arbitrary and can be changed as appropriate. The predetermined criterion includes, for example, that the number of missing data packets is a predetermined number (eg, several).

The OA data generation unit 17 generates OA data OAD based on a plurality of packets (second packets) including a data packet transmitted from the transmission device 3 in response to a request from the reception device 1 (see FIG. 3). "(9) OA data generation"). The OA data generation unit 17 generates the OA data OAD, for example, when the transmission delay of the transmission data from the transmission device 3 is longer than the allowable period X (for example, 2 to 3 seconds).

As described above, the OA data OAD includes, for example, data generated as data that is actually aired as broadcast content. By setting a limit of, for example, 2 to 3 seconds as the permissible period of transmission delay by the setting unit 14, the OA data generation unit 17 has less data packet loss than the operation data OPD and more than the storage data SD. It is possible to generate data of high quality (medium quality) with a large amount of data packet loss (data loss).

When a plurality of packets in which some packets are missing are supplemented by a data packet transmitted from the transmission device 3 in response to a request from the receiving device 1, the storage data generation unit 18 generates a plurality of supplemented packets. (3rd packet) to generate storage data SD ("(10) Storage data generation" in FIG. 3). For example, the storage data generation unit 18 can generate at least one of higher quality image data and sound data after waiting until there are no missing data packets.

The storage unit 11 stores, for example, data packet information PI, decoding processing information DPI, setting information SI, operation data OPD, OA data OAD, and storage data SD.

The data packet information PI is information regarding a data packet that the receiving device 1 receives from the transmitting device 3. The data packet information PI includes information regarding the frame FR of the data packet, for example, identification information such as the number of the frame FR, and a claim FR. The data packet information PI includes, for example, information regarding at least one data packet of a missing data packet, a data packet supplemented or supplemented by retransmission, a data packet for FEC, and a data packet supplemented or supplemented by FEC.

<Data generation process>
Referring to FIG. 4, the overall flow of data generation processing for generating a plurality of different data according to an embodiment of the present invention will be described. FIG. 4 is an example of a flowchart of data generation processing according to an embodiment of the present invention.

As a premise, in the data generation process, data transmission application software including the data generation process according to an embodiment of the present invention is downloaded from, for example, a predetermined site on the network or from a recording medium, and can be executed on the receiving device 1 shown in FIG. Save it like this. When the execution of the data generation process is instructed, the program operation based on the software starts. Note that the software is executed in advance in the transmission device 3, the display device 7, and the switching device 9 so that they operate appropriately as elements of the data transmission system 100.

As shown in FIG. 4, the receiving device 1 shown in FIGS. 1 to 3 receives a plurality of data packets from the transmission device 3 shown in FIGS. 1 and 3 (step S1). The receiving device 1 generates operation data based on the plurality of received data packets (step S3).

The receiving device 1 detects missing packets based on a plurality of received data packets. The receiving device 1 requests the transmitting device 3 to transmit the missing data packets when some data packets are missing (step S5). The receiving device 1 receives a plurality of data packets transmitted based on the request from the transmitting device 3 (step S7).

The receiving device 1 determines whether there is a missing data packet based on the plurality of received data packets (step S9). If the receiving device 1 determines that there is no missing data packet and that the data packet has been supplemented by the processing in steps S5 and S7 described above (in the case of Yes), the process proceeds to step S15. In step S15, the receiving device 1 generates storage data. On the other hand, if the receiving device 1 determines that there are still missing data packets and the data packets have not been supplemented (No in step S9), the process proceeds to step S11.

The receiving device 1 determines whether the transmission delay of data from the transmitting device 3 is longer than a predetermined period (for example, 2 to 3 seconds) (step S11). If the data transmission delay from the transmission device 3 is longer than the predetermined period (in the case of Yes), the process advances to step S13. In step S13, the receiving device 1 generates OA data. On the other hand, if the data transmission delay from the transmission device 3 is not longer than the predetermined period (No in step S11), the process returns to step S5.

Returning to step S5, the receiving device 1 repeats requesting the transmitting device 3 to retransmit the missing data packets and receiving the missing data packets until there are no missing data packets.

FIG. 5 is a diagram showing another example of the overall configuration of the data transmission system according to an embodiment of the present invention. As shown in FIG. 5, the data transmission system 100A differs from the data transmission system 100 shown in FIG. 1 in that it includes a camera switching device 8 that switches between a plurality of cameras 5 at a relay destination site or the like. In the following, points that are different from the data transmission system 100 shown in FIG. 1 will be explained in particular.

The camera switching device 8 switches the plurality of cameras 5 based on the camera switching signal from the display device 7 and transmits at least one of video data and sound data input from a specific camera 5 to the transmission device 3. The receiving device 1 generates, for example, operation data, OA data, and storage data based on the plurality of data packets transmitted from the transmission device 3.

FIG. 6 is a diagram showing an example of the hardware configuration of a computer according to an embodiment of the present invention. Referring to FIG. 6, the hardware configuration of a computer that can be used to configure the receiving device 1, the transmitting device 3, the display device 7, the camera switching device 8, and the data switching device 9 shown in FIGS. 1 and 5 will be explained. An example will be explained.

As shown in FIG. 6, the computer 40 mainly includes a processor 41, a main storage device 42, an auxiliary storage device 43, an input/output interface 44, and a communication interface 45 as hardware resources. These are interconnected via bus lines 46 including an address bus, a data bus, a control bus, and the like. Note that an appropriate interface circuit (not shown) may be interposed between the bus line 46 and each hardware resource.

Processor 41 controls the entire computer. The processor 41 corresponds to the information processing section 10 shown in FIG. 2, for example. The main storage device 42 provides a work area for the processor 41, and is a volatile memory such as SRAM ( Static Random Access Memory ) or DRAM ( Dynamic Random Access Memory ). The auxiliary storage device 43 is a nonvolatile memory such as an HDD, an SSD, or a flash memory that stores software such as programs and data. The program, data, etc. are loaded from the auxiliary storage device 43 to the main storage device 42 via the bus line 46 at any time. The auxiliary recording device 43 corresponds to the storage section 11 shown in FIG. 2, for example.

The input/output interface 44 performs one or both of presenting information and receiving input information, and includes a camera, keyboard, mouse, display, touch panel display, microphone, speaker, and the like. The communication interface 45 is connected to the above-described predetermined communication network, and transmits and receives data via the predetermined communication network. The communication interface 45 may also obtain information related to the network, for example, information related to Wi-Fi access points, information related to base stations of communication carriers, and the like.

It will be clear to those skilled in the art that the cooperation of the hardware resources and software exemplified above enables the computer 40 to function as any desired means, perform any desired steps, and achieve any desired functionality. .

Note that the above embodiments are for facilitating understanding of the present invention, and are not to be construed as limiting the present invention. The present invention may be modified/improved without departing from its spirit, and the present invention also includes equivalents thereof. Moreover, the present invention can form various disclosures by appropriately combining the plurality of constituent elements disclosed in the above embodiments. For example, some components may be deleted from all the components shown in the embodiments. Furthermore, components may be combined as appropriate in different embodiments.

DESCRIPTION OF SYMBOLS 1... Receiving device, 3... Transmission device, 5... Camera, 7... Display device, 8... Camera switching device, 9... Data switching device, 10... Information processing section, 11... Storage section, 12... Receiving section, 13... Missing Packet detection unit, 14... Setting unit, 15... Missing packet request unit, 16... Operation data generation unit, 17... OA data generation unit, 18... Storage data generation unit, 41... Processor, 42... Main recording device, 43... Auxiliary recording device, 44... Input/output interface, 45... Communication interface, 46... Bus line, 100, 100A... Data transmission system

Claims (8)

A data receiving system that receives data from a data transmitting device via a packet communication network,
a receiving unit that receives a first packet related to data including at least image data acquired by a camera from the data transmitting device;
a first generation unit that generates first output data based on the first packet;
a requesting unit that requests the data transmitting device to transmit the missing packets when some packets are missing;
a second generation unit that generates second output data based on a second packet supplemented with packets transmitted from the data transmission device in response to a request from the data reception system;
an output unit that outputs the first output data in a manner that is visible to the user;
The output unit transmits control information for controlling the camera to the camera based on the user's input,
The first output data includes data output for the user to control the camera.
Data reception system. A data receiving system that receives data from a data transmitting device via a packet communication network,
a receiving unit that receives a first packet from the data transmitting device;
a first generation unit that generates first output data based on the first packet;
a requesting unit that requests the data transmitting device to transmit the missing packets when some packets are missing;
a second generation unit that generates second output data based on a second packet supplemented with a packet transmitted from the data transmission device in response to a request from the data reception system, a second generation unit that generates the second output data when a predetermined period or more is reached;
a setting unit that sets the predetermined period based on information regarding the decoding processing result of a packet transmitted from the data transmitting device , the decoding processing result including the result of replenishment processing of the packet ;
Data reception system. When the second packet, in which some packets are missing, is supplemented by a packet transmitted from the data transmitting device in response to a request from the data receiving system, a third output is generated based on the supplemented third packet. further comprising a third generation unit that generates data;
The data receiving system according to claim 1 or 2. a detection unit that detects the missing packet;
The requesting unit repeatedly requests the data transmitting device to transmit the missing packets until the number of missing packets in the detecting unit becomes equal to or less than a predetermined standard.
The data receiving system according to any one of claims 1 to 3. A data reception method executed by a data reception system that receives data from a data transmission device via a packet communication network, the method comprising:
receiving from the data transmitting device a first packet relating to data acquired by a camera and including at least image data;
a first generation step of generating first output data based on the first packet;
requesting the data transmitting device to transmit the missing packets when some packets are missing;
a second generation step of generating second output data based on a second packet supplemented with packets transmitted from the data transmitting device in response to a request from the data receiving system;
an output step of outputting the first output data so that the first output data can be visually recognized by the user,
The output step transmits control information for controlling the camera to the camera based on the user's input,
The first output data includes data output for the user to control the camera.
How to receive data. A data receiving system that receives data from a data transmitting device via a packet communication network,
a receiving unit that receives a first packet related to data including at least image data acquired by a camera from the data transmitting device;
a first generation unit that generates first output data based on the first packet;
a requesting unit that requests the data transmitting device to transmit the missing packets when some packets are missing;
a second generation unit that generates second output data based on a second packet supplemented with packets transmitted from the data transmission device in response to a request from the data reception system;
an output unit that outputs the first output data so that it can be visually recognized by a user;
Run it as
The output unit transmits control information for controlling the camera to the camera based on the user's input,
The first output data includes data output for the user to control the camera.
program. A data reception method executed by a data reception system that receives data from a data transmission device via a packet communication network, the method comprising:
receiving a first packet from the data transmitting device;
a first generation step of generating first output data based on the first packet;
requesting the data transmitting device to transmit the missing packets when some packets are missing;
a second generation step of generating second output data based on a second packet supplemented with packets transmitted from the data transmitting device in response to a request from the data receiving system, the second generating step a second generation step of generating the second output data when a predetermined period or longer;
a setting step of setting the predetermined period based on information regarding the decoding processing result of a packet transmitted from the data transmitting device, including a result of replenishment processing of the packet ;
How to receive data. A data receiving system that receives data from a data transmitting device via a packet communication network,
a receiving unit that receives a first packet from the data transmitting device;
a first generation unit that generates first output data based on the first packet;
a requesting unit that requests the data transmitting device to transmit the missing packets when some packets are missing;
a second generation unit that generates second output data based on a second packet supplemented with a packet transmitted from the data transmission device in response to a request from the data reception system, a second generation unit that generates the second output data when a predetermined period or more is reached;
a setting unit that sets the predetermined period based on information regarding the decoding processing result of a packet transmitted from the data transmitting device , the decoding processing result including a replenishment processing result of the packet ;
A program to be executed as

Images