WO2019207695A1 - Dispositif de transfert, système de transfert, procédé de transfert et programme - Google Patents

Dispositif de transfert, système de transfert, procédé de transfert et programme Download PDF

Info

Publication number
WO2019207695A1
WO2019207695A1 PCT/JP2018/016859 JP2018016859W WO2019207695A1 WO 2019207695 A1 WO2019207695 A1 WO 2019207695A1 JP 2018016859 W JP2018016859 W JP 2018016859W WO 2019207695 A1 WO2019207695 A1 WO 2019207695A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
unit
transmission
transfer
stream
Prior art date
Application number
PCT/JP2018/016859
Other languages
English (en)
Japanese (ja)
Inventor
輝 柏崎
裕高 梶田
Original Assignee
株式会社アプトポッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社アプトポッド filed Critical 株式会社アプトポッド
Priority to PCT/JP2018/016859 priority Critical patent/WO2019207695A1/fr
Publication of WO2019207695A1 publication Critical patent/WO2019207695A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units

Definitions

  • the present invention relates to a technique for transferring data.
  • Patent Document 1 describes a technique for transmitting and recording a stream received from a network to an external device in real time.
  • An object of the present invention is to provide data to a receiving apparatus in response to the request even when the data received from the transmitting apparatus is transferred to the receiving apparatus, even if the received data does not meet the request of the receiving apparatus. .
  • the present invention includes a receiving unit that receives data in time series from a transmitting device, a determining unit that determines a transmission condition of the data by exchanging information with the receiving device, and the transmission determined by the determining unit.
  • a processing unit that processes the data according to conditions, a transmission unit that transmits the data processed by the processing unit to the receiving device when the data is transferred in real time, and the data in the real time
  • a transfer device including a storage unit that stores the data along the time series is provided.
  • the storage unit may store a copy of the data after the data is transmitted to the receiving device.
  • real-time information indicating whether or not to transfer the data in real time is added to the head of the data, and when the head of the data is received by the receiving unit, based on the real-time information
  • a determination unit that determines whether to transfer the data in real time, and the processing unit receives the data when the determination unit determines to transfer the data in real time.
  • start processing the received data sequentially process the received data, and when the transmission unit determines to transfer the data in real time by the determination unit, Before the reception of the data is completed, transmission of the processed data may be started and the processed data may be transmitted sequentially.
  • the storage unit stores the real-time information and the identifier of the data in association with each other, the identifier is added to the head of the data instead of the real-time information, and the determination unit Whether or not to transfer the data in real time may be determined based on the real-time information stored in the storage unit in association with the identifier added to the head.
  • the data is moving image data indicating a moving image
  • the receiving device includes a display device that displays the moving image indicated by the moving image data
  • the information includes a resolution or a frame rate corresponding to the display device.
  • the processing unit may change the resolution or frame rate of the moving image data according to the resolution or the frame rate.
  • the receiving device includes a display device that displays the data on a designated time scale, the information includes the time scale, and the processing unit may thin the data according to the time scale. Good.
  • the information may include a status of communication with the receiving device, and the processing unit may thin out the data according to the status of the communication.
  • Last information indicating the end is added to the end of the data transmitted from the transmission device, and when the last information is received, the transfer device determines that reception of the data is completed.
  • the transmission unit may further transmit the data stored in the storage unit to a predetermined processing unit when the determination unit determines that the reception of the data is completed.
  • the data transmitted by the transmission device includes a plurality of data blocks each including at least one of a plurality of detection amounts detected by a sensor, and each of the plurality of data blocks includes a data block.
  • Number information indicating the number of the at least one detection amount included is added, and the transfer device uses the number information of the at least one detection amount included in the data block and the number information added to the data block.
  • a determination unit that determines whether or not the data block is missing according to a difference from the number shown; and when the determination unit determines that the data block is missing, the transmission
  • a retransmission request unit requesting retransmission of the lost data block to the apparatus; and retransmitting from the transmission apparatus in response to a request from the retransmission request unit.
  • Using said data blocks may further include a completion unit which complements the missing data blocks.
  • the present invention includes a transfer device, a transmission device, and a reception device, and the transfer device exchanges information with the reception device and a first reception unit that receives data in time series from the transmission device. And a processing unit that processes the data according to the transmission condition determined by the determination unit, and the processing unit when transferring the data in real time.
  • the transmission device includes an acquisition unit that acquires the data, and a second transmission unit that transmits the data acquired by the acquisition unit to the transfer device, and the reception device receives the information
  • a third transmission unit that transmits to the transfer device, a second reception unit that receives the data transmitted from the transfer device, and a processing unit that performs processing using the data received by the second reception unit;
  • a transfer system is provided.
  • the data includes moving image data indicating a moving image taken by the imaging device and measurement data output from the measuring device, and the processing unit sets the moving image data and the measured data along the same time axis. May be output.
  • the present invention includes a step of receiving data in time series from a transmission device, a step of determining a transmission condition of the data by exchanging information with the reception device, and a response to the determined transmission condition.
  • a step of processing the data a step of transmitting the data in real time; a step of transmitting the processed data to the receiving device; and a case of not transferring the data in real time.
  • a step of storing along the time series a step of receiving data in time series from a transmission device, a step of determining a transmission condition of the data by exchanging information with the reception device, and a response to the determined transmission condition.
  • a step of processing the data a step of transmitting the data in real time; a step of transmitting the processed data to the receiving device; and a case of not transferring the data in real time.
  • a step of storing along the time series a step of storing along the time series.
  • the present invention includes a step of receiving data in time series from a transmission device to a computer, a step of determining a transmission condition of the data by exchanging information with the reception device, and the determined transmission condition And processing the data, and transferring the data in real time, transmitting the processed data to the receiving device, and not transferring the data in real time,
  • a program for executing the step of storing the data along the time series is provided.
  • the data corresponding to the request can be provided to the reception device.
  • FIG. 1 is a diagram illustrating an example of a transfer system 100 according to an embodiment. It is a figure which shows an example of the hardware constitutions of the terminal device. It is a figure which shows an example of a function structure of the terminal device.
  • 6 is a diagram illustrating an example of a format of a creation request message 220.
  • FIG. 6 is a diagram illustrating an example of a format of a creation request message 230.
  • FIG. It is a figure which shows an example of the format of a section.
  • 3 is a diagram illustrating an example of a hardware configuration of a transfer device 130.
  • FIG. 3 is a diagram illustrating an example of a functional configuration of a transfer device 130.
  • FIG. It is a figure which shows an example of the format of the response message.
  • FIG. 6 is a diagram illustrating an example of a stream table 320.
  • FIG. It is a figure which shows an example of the database. It is a sequence chart which shows an example of a transmission process. It is a sequence chart which shows an example of a transfer process. It is a sequence chart which shows an example of a resending process. It is a figure which shows the example of an output of moving image data and measurement data.
  • FIG. 1 is a diagram illustrating an example of a transfer system 100 according to an embodiment.
  • the transfer system 100 is a system that transfers data received from the terminal device 120 to another terminal device 120.
  • the transfer system 100 includes an imaging device 110, a plurality of terminal devices 120, and a transfer device 130.
  • the plurality of terminal devices 120 include a terminal device 120A and a terminal device 120B.
  • the numbers of the imaging device 110, the terminal device 120, and the transfer device 130 illustrated in FIG. 1 are examples, and are not limited thereto.
  • the imaging device 110 is connected to the terminal device 120A via the communication line 150.
  • the terminal devices 120A and 120B are connected to the transfer device 130 via the communication line 160.
  • the communication line 160 may include a wireless network such as a mobile line and the Internet, for example.
  • a wireless network such as a mobile line and the Internet
  • 3G, LTE (Long Term Evolution), Wi-Fi (registered trademark), WiMAX (registered trademark), or Bluetooth (registered trademark) may be used as a communication standard of the wireless network.
  • the imaging device 110 is a device that captures an image.
  • the imaging device 110 is, for example, a digital video camera, and captures a moving image by converting an image onto an imaging element using an optical system, and converts the moving image data to output.
  • This moving image data is composed of a plurality of frames arranged in time series.
  • the imaging device 110 may include a microphone.
  • the moving image data may include audio data indicating audio.
  • FIG. 2 is a diagram illustrating an example of a hardware configuration of the terminal device 120.
  • the terminal device 120 is also called an edge, and is a device that transmits and receives data.
  • the terminal device 120 is a computer that includes a processor 121, a memory 122, a storage 123, a communication device 124, and a display device 125. These devices are connected via a bus 126.
  • the processor 121 executes various processes by reading the program into the memory 122 and executing it.
  • the processor 121 may be configured by a CPU (Central Processing Unit).
  • the memory 122 stores a program executed by the processor 121.
  • the memory 122 may be configured by a ROM (Read Only Memory) or a RAM (Random Access Memory).
  • the storage 123 stores various data and programs.
  • the storage 123 may be configured by a hard disk drive or a flash memory.
  • the communication device 124 is a communication interface connected to the communication lines 150 and 160.
  • the communication device 124 transmits and receives data via the communication line 150 or 160.
  • the display device 125 displays various information.
  • the display device 125 may be configured by a liquid crystal display.
  • FIG. 3 is a diagram illustrating an example of a functional configuration of the terminal device 120.
  • the terminal device 120 has both a function as a transmission device that transmits data to the transfer device 130 and a function as a reception device that receives data from the transfer device 130.
  • the terminal device 120 includes a connection control unit 201, a message transmission unit 202 (an example of a third transmission unit), a message reception unit 203, an acquisition unit 204, a generation unit 205, an addition unit 206, and a data transmission unit 207. (An example of a second transmission unit), a data retransmission unit 208, a data reception unit 209 (an example of a second reception unit), and a processing unit 210.
  • These functions are realized when the processor 121 performs an operation or controls communication by the communication device 124 in cooperation with the program stored in the memory 122 and the processor 121 that executes the program.
  • the connection control unit 201 controls the connection between the terminal device 120 and the transfer device 130.
  • This connection refers to a virtual dedicated communication path established in connection-type communication.
  • a message requesting establishment of a connection is transmitted from the connection control unit 201 to the transfer apparatus 130.
  • a response message is transmitted from the transfer device 130 to the terminal device 120 in response to this message, a connection is established between the terminal device 120 and the transfer device 130.
  • a message requesting disconnection of the connection is transmitted from the connection control unit 201 to the transfer apparatus 130.
  • the connection is disconnected between the terminal device 120 and the transfer device 130.
  • the message transmission unit 202 transmits various messages used for negotiation performed between the terminal device 120 and the transfer device 130.
  • various messages include an information transmission message and a creation request message 220 or 230.
  • the information transmission message includes information for determining data transmission conditions.
  • This information may include performance information indicating the resource performance of the terminal device 120, for example.
  • This resource may be hardware or software.
  • the software may include a browser. Further, this information may be the transmission condition itself.
  • the creation request message 220 or 230 includes information for determining data processing conditions.
  • FIG. 4 is a diagram illustrating an example of a format of the creation request message 220 transmitted from the terminal device 120 on the transmission side.
  • the creation request message 220 includes a request ID, the number of streams, a stream ID, a flag, a measurement ID, a transmission source ID, and a transfer destination ID.
  • the request ID is information that uniquely identifies the creation request message 220.
  • the number of streams indicates the number of stream attribute information included in the creation request message 220.
  • This attribute information is composed of a set of a stream ID, a flag, a measurement ID, a transmission source ID, and a transfer destination ID. This attribute information generally has a larger data amount than the stream ID.
  • the creation request message 220 includes stream attribute information as many as indicated by the number of streams. That is, the creation request message 220 may include attribute information of a plurality of streams.
  • Stream ID is information that uniquely identifies a stream.
  • the stream ID is associated with the connection being connected. That is, the stream ID may be used as an identifier for uniquely identifying the stream in the connection being connected.
  • the stream ID may be determined by the terminal device 120 or the transfer device 130.
  • the flag includes a retransmission flag and a storage flag.
  • the retransmission flag is information indicating whether data has been retransmitted. When the retransmission flag is “0”, it indicates that the data is not retransmitted, that is, transmitted first. If the data is not retransmitted, the data is transferred in real time. On the other hand, when the retransmission flag is “1”, this indicates that the data has been retransmitted. If the data is retransmitted, it is not transferred in real time. As described above, the retransmission flag may be used as real-time information indicating whether to transmit data in real time.
  • the save flag is information indicating whether to save data. When the save flag is “0”, it indicates that data is not saved. On the other hand, when the save flag is “1”, it indicates that the data is to be saved.
  • Measurement ID is information that uniquely identifies the measurement that generated the data. For example, when the data is moving image data output from the imaging device 110, one unit of measurement is from when the imaging device 110 starts shooting a moving image to when it ends. Therefore, the same measurement ID is assigned to the moving image data generated during this time.
  • the transmission source ID is information that uniquely identifies the terminal device 120 that is the transmission source of the stream.
  • the transfer destination ID is information that uniquely identifies the terminal device 120 that is a data transfer destination. When the transfer destination ID is “ ⁇ ”, it indicates that data is not transferred from the transfer device 130.
  • FIG. 5 is a diagram showing an example of the format of the creation request message 230 transmitted from the terminal device 120 on the receiving side.
  • the creation request message 230 includes a request ID, the number of streams, a stream ID, and a transmission source ID, similar to the creation request message 220 described above.
  • the creation request message 230 includes a transfer source ID.
  • the transfer source ID is information for identifying the terminal device 120 that is the transfer source of the stream.
  • the creation request message 230 may not include the flag, measurement ID, and transfer destination ID included in the creation request message 220.
  • the acquisition unit 204 acquires data from an external device.
  • This data may be moving image data output from the imaging device 110, for example.
  • the generation unit 205 generates a stream based on the data acquired by the acquisition unit 204.
  • This stream refers to a data string handled by streaming.
  • Streaming refers to a system in which output is started before input of the entire data is completed, and the input data is sequentially output while the data is being input.
  • a stream is composed of a plurality of sections. This section may be used as a data block constituting data.
  • FIG. 6 is a diagram showing an example of a section format.
  • the section includes SOS (Start of Section), a plurality of units, and EOS (End of Section).
  • SOS is included at the beginning of the section.
  • EOS is included at the end of the section.
  • SOS is information indicating the start of a section.
  • Each of the plurality of units includes one frame included in the moving image data.
  • a sensor ID and a time stamp are added to each frame. This sensor ID is information for uniquely identifying the sensor from which data is acquired.
  • the time stamp is information indicating the time when the data is acquired.
  • This time may be, for example, an elapsed time from the time when the measurement is started to the time when the data is acquired, that is, a relative time based on the time when the measurement is started.
  • EOS is information indicating the end of a section.
  • the EOS includes a unit count and a serial number.
  • the unit count is number information indicating the number of units included in the section.
  • the serial number is information for uniquely identifying sections related to the same measurement unit.
  • SOS, unit, and EOS are also collectively referred to as “element”.
  • the adding unit 206 adds a stream ID for uniquely identifying the stream generated by the generating unit 205 to the SOS, the plurality of units, and the EOS included in each section of the stream.
  • the data transmission unit 207 transmits the stream to which the stream ID is added to the transfer device 130.
  • This stream is transmitted by streaming. Transmission of this stream may be performed in section units or in element units.
  • the data retransmission unit 208 retransmits the section to the transfer device 130 in response to a request from the transfer device 130.
  • the data receiving unit 209 receives a stream from the transfer device 130.
  • the processing unit 210 performs processing using data included in the stream received by the data receiving unit 209.
  • FIG. 7 is a diagram illustrating an example of a hardware configuration of the transfer device 130.
  • the transfer device 130 is also called a hub, and is a device that relays data exchange between the plurality of terminal devices 120.
  • the transfer device 130 performs non-real time processing and real time processing.
  • the non-real time processing is processing for accumulating data received from the terminal device 120, for example. Thereby, the data received from the terminal device 120 are managed collectively. This data is used, for example, for various types of analysis on the status of the sensing target. Therefore, data accuracy is required in non-real time processing.
  • the real-time processing is processing for transmitting data received from the terminal device 120 to another terminal device 120 in real time, for example. Note that this real time does not have to be completely simultaneous, and there may be a slight delay. This data is used, for example, for the user to grasp the current status of the sensing target. Therefore, immediacy is required in real-time processing.
  • the transfer device 130 is a computer that includes a processor 131, a memory 132, a storage 133 (an example of a storage unit), and a communication device 134. These devices are connected via a bus 135. Since the processor 131, the memory 132, the storage 133, the communication device 134, and the bus 135 are the same as the processor 121, the memory 122, the storage 123, the communication device 124, and the bus 126 described above, description thereof is omitted.
  • FIG. 8 is a diagram illustrating an example of a functional configuration of the transfer device 130.
  • the transfer device 130 includes a message reception unit 301, a message transmission unit 302, a determination unit 303, a data reception unit 304 (an example of a reception unit or a first reception unit), a determination unit 305, a processing unit 306, data
  • a transmission unit 307 (an example of a transmission unit or a first transmission unit), a retransmission request unit 308, and a complement unit 309 are provided.
  • These functions are realized when the processor 131 performs an operation or controls communication by the communication device 134 in cooperation with the program stored in the memory 132 and the processor 131 that executes the program.
  • the message receiving unit 301 receives various messages from the terminal device 120.
  • the various messages include the information transmission message and the creation request message 220 described above.
  • the message transmission unit 302 transmits various messages to the terminal device 120.
  • various messages include a response message 310 to the creation request message 220 received from the terminal device 120.
  • FIG. 9 is a diagram illustrating an example of the format of the response message 310.
  • the response message 310 includes a request ID included in the creation request message 220 or 230 and result information.
  • the result information is information indicating whether or not the creation of the stream attribute information is successful. For example, when the result information is “0”, it indicates that the creation of the attribute information of the stream is successful. On the other hand, when the result information is “1”, it indicates that the creation of the stream attribute information has failed. For example, when a necessary item is not included in the creation request message 220 or 230, or when an item included in the creation request message 220 or 230 does not have a valid value, creation of stream attribute information is performed. May fail. When a plurality of stream IDs are included in the creation request message 220 or 230, result information may be included for each stream ID.
  • the determination unit 303 determines the data transmission condition by exchanging information with the terminal device 120.
  • the transmission condition includes a condition regarding the data format.
  • the data format may include at least one of the compression method, resolution, and frame rate of the moving image data.
  • the attribute information included in the creation request message 220 and the transmission conditions determined by the determination unit 303 are managed by the stream table 320, for example.
  • FIG. 10 is a diagram illustrating an example of the stream table 320.
  • the stream table 320 is stored in the storage 133, for example.
  • the stream table 320 is determined by the determination unit 303 with the stream ID, retransmission flag, storage flag, measurement ID, transmission source ID, transfer destination ID, or transfer source ID included in the creation request message 220 or 230.
  • the transmission conditions are stored in association with each other.
  • the data receiving unit 304 receives a stream from the terminal device 120 on the transmission side.
  • the determination unit 305 determines whether or not to transfer the stream received by the data reception unit 304 in real time.
  • the processing unit 306 processes the data included in the stream according to the transmission conditions stored in the stream table 320 when the determination unit 305 determines to transfer in real time. This processing means, for example, changing the data format, although the data contents are not changed. For example, when the data format is included in the transmission condition, the data format may be changed according to the format included in the transmission condition.
  • the data transmission unit 207 transmits a stream including the processed data to the terminal device 120 on the reception side. This stream is transmitted by streaming.
  • the determination unit 305 determines not to transfer in real time, the data included in the stream is stored in the storage 133 in time series. If the determination unit 305 determines to transfer in real time, the data transmission unit 207 transmits a stream, and then a copy of the data included in the stream is stored in the storage 133 in time series. This data is managed by the database 330, for example.
  • FIG. 11 is a diagram illustrating an example of the database 330.
  • the database 330 is stored in the storage 133, for example.
  • the database 330 includes information indicating the time when each frame included in the moving image data is acquired, a frame included in the moving image data, and a completion flag. Stored in association. The time is obtained based on, for example, a time stamp added to the frame.
  • the completion flag is information indicating whether or not reception of the stream is completed. For example, when the completion flag is “0”, it indicates that the reception of the stream has not been completed. When the completion flag is “1”, it indicates that the reception of the stream has been completed.
  • the retransmission request unit 308 requests the terminal device 120 on the transmission side to retransmit the missing section.
  • the complementing unit 309 supplements the missing section using the section retransmitted from the terminal device 120 on the transmission side in response to the request from the retransmission requesting unit 308.
  • FIG. 12 is a sequence chart showing an example of transmission processing.
  • the terminal device 120A negotiates with the transfer device 130 before transmitting the moving image data.
  • step 401 in the terminal device 120A, the connection control unit 201A establishes a connection with the transfer device 130.
  • negotiation is performed between the terminal device 120A and the transfer device 130.
  • the message transmission unit 202A transmits a creation request message 220 as illustrated in FIG. 4 to the transfer apparatus 130 via the connection being connected.
  • the creation request message 220 includes a request ID “1” and the number of streams “2”. This indicates that the creation request message 220 having the request ID “1” includes attribute information of two streams.
  • the creation request message 220 includes a stream ID “1”, a retransmission flag “0”, a storage flag “1”, a measurement ID “M001”, and a transmission source ID “EAAA” that identifies the terminal device 120A.
  • a pair with a transfer destination ID “EBBB” for identifying the terminal device 120B is included. This is because the stream with the stream ID “1” includes the moving image data generated by the measurement with the measurement ID “M001”, and this moving image data is not retransmitted and needs to be stored in the transfer device 130.
  • the creation request message 220 includes a stream ID “2”, a retransmission flag “1”, a storage flag “1”, a measurement ID “M001”, a transmission source ID “EAAA”, and a transfer destination ID “ ⁇ ”. Is included. This is because the stream with the stream ID “2” includes the moving image data generated by the measurement with the measurement ID “M001”, and this moving image data has been retransmitted and needs to be stored in the transfer device 130. Furthermore, it indicates that there is no need to transfer from the transfer device 130.
  • the message transmission unit 202A transmits an information transmission message including the transmission condition of the stream with the stream ID “1” to the transfer apparatus 130 via the connection being connected.
  • the transmission condition includes the resolution of the imaging device 110.
  • step 403 when the message receiving unit 301 receives the creation request message 220 and the information transmission message in the transfer device 130, the attribute information included in the creation request message 220 and the transmission conditions included in the information transmission message are streamed.
  • table 320 For example, in the first record of the stream table 320, as shown in FIG. 10, the stream ID “1”, the retransmission flag “0”, the storage flag “1”, the measurement ID “M001”, and the transmission source ID “ “EAAA”, the transfer destination ID “EBBB”, and the transmission condition included in the information transmission message are stored.
  • the second record of the stream table 320 includes a stream ID “2”, a retransmission flag “1”, a storage flag “1”, a measurement ID “M001”, a transmission source ID “EAAA”, and a transfer.
  • the destination ID “ ⁇ ” and the transmission condition included in the information transmission message are stored.
  • step 404 when the storage of the attribute information and the transmission conditions is completed, the message transmission unit 302 transmits a response message as shown in FIG. 9 to the terminal device 120A via the connection being connected.
  • the response message 310 includes a request ID “1” and result information “0”.
  • the terminal device 120A receives this response message, the negotiation between the terminal device 120A and the transfer device 130 ends.
  • the process of the terminal device 120A proceeds to step 405.
  • step 405 when the moving image data output from the imaging device 110 is received by the acquisition unit 204A in the terminal device 120A, the generation unit 205 generates a stream using the moving image data.
  • the generation of the stream is started before the reception of the entire moving image data is completed, and is sequentially performed while the moving image data is being received.
  • the stream is composed of a plurality of sections shown in FIG. A stream ID “1” corresponding to this stream is added to the SOS, the plurality of units, and the EOS included in each section of the stream by the adding unit 109A.
  • an end flag indicating the end of the stream is added to the last section constituting the stream by the adding unit 109A. This end flag may be used as last information indicating the end of data.
  • step 406 the data transmission unit 207A sequentially transmits the stream to which the streaming ID is added to the transfer apparatus 130 via the connected connection. Transmission of this stream is started before the reception of the entire moving image data is completed, and is sequentially performed while the moving image data is being received.
  • the data reception unit 304 sequentially receives the streams transmitted from the terminal device 120A. When the transmission of this stream ends, the terminal device 120A proceeds to step 407.
  • step 407 the connection control unit 201A disconnects the connection with the transfer apparatus 130.
  • step 408 the transfer device 130 deletes all the attribute information and transmission conditions stored in association with the stream IDs “1” and “2” from the stream table 320 in response to the disconnection of the connection.
  • the association between the stream IDs “1” and “2” stored in the stream table 320 and the connection is released, and the stream IDs “1” and “2” stored in the stream table 320 are released.
  • these stream IDs can be used as identifiers of other streams. Note that the same processing as in step 408 may be performed even when the connection is disconnected without depending on the terminal device 120.
  • the attribute information stored in the stream table 320 may be changed during connection.
  • the message transmission unit 202A transmits a change request message including the change target stream ID and the changed attribute information to the transfer device 130.
  • the stream table 320 is updated according to the change request message. For example, when a change request message including a combination of the stream ID “1” and the changed attribute information is transmitted, the attribute information associated with the stream ID “1” in the stream table 320 includes the attribute included in the change request. Rewritten with information.
  • the stream ID stored in the stream table 320 may be released during connection.
  • the message transmitting unit 202A transmits this stream ID release request message to the transfer device 130.
  • the release request message may use the same format as the creation request message 220 shown in FIG. For example, when requesting the release of the stream ID “1”, a release request message including the stream ID “1” and the transmission source ID “0” is transmitted.
  • the release request message is received from the terminal device 120, the record including the stream ID “1” is deleted from the stream table 320.
  • the association between the stream ID “1”, the retransmission flag “0”, the storage flag “1”, the measurement ID “M001”, the transmission source ID “EAAA”, and the transfer destination ID “EBBB” is released.
  • the stream ID “1” is released and can be used as an identifier of another stream. Thereby, even when a large number of streams are transmitted, it is possible to prevent the available stream IDs from being exhausted.
  • FIG. 13 is a sequence chart showing an example of the transfer process.
  • the terminal device 120B negotiates with the transfer device 130 before receiving the moving image data.
  • step 501 in the terminal device 120B, the connection control unit 201B establishes a connection with the transfer device 130.
  • negotiation is performed between the terminal device 120 ⁇ / b> B and the transfer device 130.
  • the message transmission unit 202B transmits a creation request message 230 as illustrated in FIG. 5 to the transfer apparatus 130 via the connection being connected.
  • the creation request message 230 includes a request ID “2”, the number of streams “1”, a stream ID “3”, a transmission source ID “EBBB”, and a transfer source ID “EAAA”. This is because the creation request message 230 with the request ID “2” includes the attribute information of one stream with the stream ID “3”, and the transfer source of the moving image data included in this stream is the terminal device 120A. It shows that there is.
  • the message transmission unit 202B transmits an information transmission message regarding the stream with the stream ID “3” to the transfer apparatus 130 via the connected connection.
  • the information transmission message may include information indicating MPEG-4.
  • the resolution of the display device 125B is R1
  • the information transmission message may include the resolution R1.
  • the maximum frame rate that can be displayed by the display device 125B is F1
  • the frame rate F1 may be included in the information transmission message.
  • the determination unit 303 determines the transmission condition of the stream based on the information included in the information transmission message. For example, when information indicating MPEG-4 is included in the information transmission message, a compression method called MPEG-4 may be determined. For example, when the information transmission message includes the resolution R1, the resolution R1 may be determined. For example, when the frame rate F1 is included in the information transmission message, the frame rate F1 may be determined.
  • the transfer apparatus 130 stores the attribute information included in the creation request message 230 and the transmission condition determined by the determination unit 303 in the stream table 320.
  • the stream table 320 corresponds to the stream ID “3”, the transmission source ID “EBBB”, the transfer source ID “EAAA”, and the transmission conditions determined by the determination unit 303, as shown in FIG. Stored with. Note that the retransmission flag, the storage flag, and the measurement ID are not stored because they are not included in the creation request message 230.
  • step 504 the message transmission unit 302 transmits the response message 310 shown in FIG. 9 to the terminal device 120B via the connection being connected.
  • the response message 310 includes a request ID “2” and result information “0”.
  • the terminal device 120B receives the response message, the negotiation between the terminal device 120B and the transfer device 130 ends.
  • the processing of the transfer device 130 proceeds to step 505 shown in FIG.
  • step 505 in the transfer device 130, when the data reception unit 304 starts receiving the stream from the terminal device 120A, the determination unit 305 determines whether or not to transfer the stream in real time. Specifically, when the SOS placed at the head of the section is received, the stream ID “1” is extracted from the SOS. As shown in FIG. 10, the stream table 320 stores a stream ID “1” and a retransmission flag “0” in association with each other. This indicates that the stream with the stream ID “1” is transferred in real time. Therefore, in this case, it is determined that the stream is transferred in real time. If it is determined that the stream is transferred in real time (YES in step 505), the processing of the transfer device 130 proceeds to step 506 shown in FIG.
  • the processing unit 306 processes the moving image data included in the received stream based on the transmission condition stored in the stream table 320 in association with the stream ID “3”.
  • the processing of the moving image data is started before the section EOS is received, and sequentially performed while the section is received.
  • the moving image data may be compressed according to MPEG-4.
  • the resolution R1 is included in the transmission condition
  • the resolution of the moving image data is higher than R1
  • the resolution of the moving image data may be changed to R1.
  • the frame rate F1 is included in the transmission condition and the frame rate of the moving image data is higher than F1
  • the frame rate of the moving image data may be changed to F1, for example, by thinning out the moving image data.
  • step 507 the data transmission unit 307 sequentially transmits the stream including the processed moving image data to the terminal device 120B. Transmission of this stream is started before the section's EOS is received, and is performed sequentially while the section is being received.
  • step 508 when the data receiving unit 304 receives the EOS of the section in the transfer device 130, the frame included in the section is duplicated and stored in the database 330 shown in FIG.
  • the database 330 stores the first to nth frames (n is a natural number) included in a section and the times T1 to Tn (n is a natural number) at which these frames are acquired in association with each other.
  • the These times T1 to Tn may be absolute times obtained from the relative time indicated by the time stamp added to each frame. For example, in the case where the video recording start time is 12:00, when the time stamp added to the first frame indicates an elapsed time of 12 minutes, the time T1 is 12:12 Good.
  • the processing in step 508 is performed every time reception of the section is completed.
  • the determination unit 305 determines that reception of the stream is completed. In this case, “1” is stored in the database 330 as a completion flag as shown in FIG.
  • step 509 when the terminal 120B receives the stream at the data receiving unit 209B, the processing unit 210B displays the moving image according to the moving image data included in the stream on the display device 125B.
  • the This moving image display is started before reception of the entire stream is completed, and is sequentially performed while the stream is being received.
  • the moving image data is compressed according to MPEG-4, the moving image data is used after being decoded according to MPEG-4. Thereby, the user of the terminal device 120B can browse the moving image.
  • the terminal device 120B may perform the same processing as in steps 407 and 408 described above.
  • the determination unit 305 causes the stream to be transmitted in real time. It is determined not to transfer (NO in step 505). In this case, the processing of the transfer device 130 proceeds to step 508 without performing the processing of steps 506 and 507 described above. That is, in this case, the moving image data is not transferred in real time.
  • the terminal device 120B requests transmission of moving image data after the moving image data is stored in the database 330, the above-described processing in steps 506 and 507 may be performed in response to this request. In this case, the moving image data is transferred to the terminal device 120B in non-real time.
  • FIG. 14 is a sequence chart showing an example of retransmission processing. This retransmission processing may be performed every time reception of the section transmitted from the terminal device 120A is completed in the transfer device 130, for example.
  • step 601 in the transfer apparatus 130, the number of units included in the section received by the data reception unit 304 is counted by the retransmission request unit 308.
  • step 602 based on the difference between the number of units counted by the retransmission request unit 308 and the number of units indicated by the unit count included in the EOS of the received section, whether or not there is a missing section. Is determined. If the numbers of these units match, it is determined that there is no missing section (NO in step 602). In this case, for example, an ACK (acknowledgement) message is transmitted from the transfer apparatus 130 to the terminal apparatus 120A, and then this process ends. This ACK message may include SOS and EOS included in the received section. On the other hand, if the number of these units is different, it is determined that there is a section defect (YES in step 602). In this case, the processing of the transfer device 130 proceeds to step 603.
  • the message transmission unit 302 transmits a message requesting retransmission of the missing section (hereinafter referred to as “retransmission request message”) to the terminal device 120A.
  • the retransmission request message may include information for identifying a missing section, for example.
  • the data retransmission unit 208A transmits a stream including the requested section to the transfer apparatus 130. Since this section is retransmitted, for example, a stream ID “2” is added to the SOS, the plurality of units, and the EOS included in this section, respectively.
  • the processing of the transfer device 130 proceeds to step 505 shown in FIG.
  • the stream ID “2” is included in the SOS of the retransmitted section included in the stream.
  • the stream table 320 stores a stream ID “2” and a retransmission flag “1” in association with each other. This indicates that the stream with the stream ID “2” is not transferred in real time. Therefore, in this case, the determination unit 305 determines not to transfer the stream in real time (NO in step 505).
  • the processing of the transfer device 130 proceeds to step 508 described above.
  • the frame included in the retransmitted section is stored in the database 330 by the complementing unit 309. For example, when the first frame is included in the retransmitted section, the first frame stored in the database 330 may be overwritten by the newly received first frame. This complements the missing section.
  • the moving image data transmitted from the terminal device 120A to the transfer device 130 is processed according to the transmission condition determined by the negotiation between the transfer device 130 and the terminal device 120B, and then the terminal device. 120B. Therefore, even when the moving image data received by the transfer device 130 does not meet the request of the terminal device 120B, the moving image data according to the request can be provided to the terminal device 120B.
  • the transfer device 130 starts to transfer the moving image data in response to receiving the SOS of the section from the terminal device 120A, compared to the case where the transfer of the moving image data is started after reception of the entire section is completed. Thus, the transfer delay of moving image data is reduced.
  • a plurality of imaging devices 110 may be connected to the terminal device 120A.
  • the transmission condition may include information for identifying the moving image data requested by the terminal device 120B.
  • the transmission condition includes the first Information for identifying the moving image data and the third moving image data may be included.
  • the data transmission unit 307 may transmit only the first moving image data and the third moving image data among the first moving image data to the tenth moving image data to the terminal device 120B.
  • a plurality of data may be transferred in parallel.
  • the imaging device 110 and the measurement device are connected to the terminal device 120A
  • the moving image data output from the imaging device 110 and the measurement data output from the measurement device may be transferred in parallel.
  • the measurement data includes a plurality of measurement values measured along the time series.
  • the terminal device 120B may output these data along the same time axis.
  • FIG. 15 is a diagram showing an output example of moving image data and measurement data.
  • a moving image corresponding to moving image data and a measured value corresponding to measurement data are displayed side by side along the same time axis on the display device 125B of the terminal device 120B.
  • a moving image and a measured value corresponding to the same time are displayed simultaneously.
  • a moving image shot at time T10 and a measured value measured at time T10 are displayed simultaneously.
  • the user of the terminal device 120 ⁇ / b> B can browse the moving image shot at a certain time and the measured value measured at the time.
  • the display device 125 may display data on a time scale specified by a user operation, for example.
  • the data includes a plurality of measurement values measured along the time series.
  • the measurement values may be displayed on the display device 125 at 1 second intervals.
  • the transmission condition may include a designated time scale.
  • the processing unit 306 may thin out data according to a designated time scale. For example, when the time scale is 1 second, data may be thinned out so that only one measurement value is included in one second. Thereby, it is possible to prevent unnecessary data from being transmitted in the terminal device 120 on the receiving side.
  • the processing unit 210 performs processing for displaying data, but the processing performed by the processing unit 210 is not limited to data display.
  • the processing unit 210 may perform processing for controlling or operating another device using data.
  • the processing unit 306 may process the data before the data is stored in the database 330.
  • the database 330 stores processed data.
  • the information included in the transmission condition is not limited to the compression method supported by the terminal device 120, the resolution supported by the display device 125, and the frame rate supported by the display device 125.
  • the transmission condition may include a bit rate supported by the terminal device 120 and an image size supported by the display device 125.
  • the information transmission message may include information indicating the status of communication between the transfer device 130 and the terminal device 120B.
  • the communication status may include a communication type, a communication method, a communication band, or a communication speed.
  • the processing unit 306 may thin out the data according to the communication status. For example, when the current communication band is smaller than a predetermined band, data may be thinned out according to the current communication band. Thereby, even when the communication band is small, the data transfer delay is reduced.
  • the transfer device 130 may transmit an error message to the terminal device 120B when the transmission condition received from the terminal device 120A does not match the transmission condition determined by the determination unit 303.
  • the transmission condition determined by the determination unit 303 cannot be satisfied, and therefore an error message is transmitted to the terminal device 120B. Good.
  • data used in the transfer system 100 is not limited to moving image data.
  • sensor data output from the sensor may be used.
  • This sensor detects a detection amount from the sensing target, and outputs sensor data indicating the detected detection amount.
  • the sensor in addition to the imaging device 110 described above, for example, when the sensing target is a car, the sensor includes a tachometer that measures the number of revolutions of the engine, a speedometer that measures the speed of the car, and a steering angle.
  • Various measuring devices provided in the vehicle such as an angle meter, a fuel injection amount meter, a thermometer, and a GPS (Global Positioning System) that measures the position of the vehicle may be used.
  • the data transmission unit 307 transmits all the data stored in the database 330 to a predetermined processing unit.
  • the predetermined processing unit may perform predetermined later-stage processing such as analysis processing and batch processing using data, for example.
  • this number when serial numbers are assigned to each section in chronological order, this number may be stored in the database 330 instead of the information indicating the time.
  • the stream ID is included in the SOS, but the retransmission flag itself may be included in the SOS.
  • each section may be an arbitrary length. Furthermore, the number of units included in each section need not necessarily be the same. The number of units included in one section may vary from section to section.
  • the stream ID may be added to only a part of the SOS, the plurality of units, and the EOS included in each section of the stream.
  • the stream ID may be added only to the SOS, or may be added only to the EOS.
  • the stream does not necessarily have to be composed of a plurality of sections.
  • a stream may include only a plurality of units.
  • the stream does not need to include SOS and EOS.
  • the data transmitted from the terminal device 120 to the transfer device 130 is not necessarily limited to data output from an external device.
  • this data may be data generated by the terminal device 120.
  • the steps of processing performed in the transfer system 100 are not limited to the example described in the above-described embodiment.
  • the steps of this process may be interchanged as long as there is no contradiction.
  • the present invention may be provided as a transfer method including steps of processing performed in the transfer system 100 or the transfer apparatus 130.
  • the present invention may be provided as a program executed in the terminal device 120 or the transfer device 130.
  • This program may be downloaded via a communication line such as the Internet.
  • These programs are provided in a state where they are recorded on a computer-readable recording medium such as a magnetic recording medium (magnetic tape, magnetic disk, etc.), an optical recording medium (optical disk, etc.), a magneto-optical recording medium, or a semiconductor memory. May be.
  • first and second are used only to distinguish one element from another, and do not limit the amount or order of the elements. . Therefore, these terms may be used, for example, by exchanging numbers.
  • transfer system 110 imaging device 120: terminal device 130: transfer device 201: connection control unit 202: message transmission unit 203: message reception unit 204: acquisition unit 205: generation unit 206: Addition unit, 207: Data transmission unit, 208: Data retransmission unit, 209: Data reception unit, 210: Processing unit, 301: Message reception unit, 302: Message transmission unit, 303: Determination unit, 304: Data reception unit, 305 : Determination unit, 306: processing unit, 307: data transmission unit, 308: retransmission request unit, 309: complementing unit

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

Selon la présente invention, lorsque des données reçues d'un dispositif de transmission doivent être transférées à un dispositif de réception, si les données reçues ne satisfont pas les exigences du dispositif de réception, des données satisfaisant ces exigences sont fournies à la place au dispositif de réception. Une unité de réception (304) d'un dispositif de transfert (130) reçoit des données chronologiques en provenance d'un dispositif de transmission. Une unité de détermination (303) détermine des conditions de transmission de données en échangeant des informations avec un dispositif de réception. Une unité de traitement (306) traite les données en fonction des conditions de transmission déterminées. Une unité de transmission (307) transmet les données traitées au dispositif de réception si un transfert de données en temps réel est effectué. Si un transfert de données en temps réel n'est pas effectué, alors une unité de stockage stocke les données sous la forme de données chronologiques.
PCT/JP2018/016859 2018-04-25 2018-04-25 Dispositif de transfert, système de transfert, procédé de transfert et programme WO2019207695A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2018/016859 WO2019207695A1 (fr) 2018-04-25 2018-04-25 Dispositif de transfert, système de transfert, procédé de transfert et programme

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2018/016859 WO2019207695A1 (fr) 2018-04-25 2018-04-25 Dispositif de transfert, système de transfert, procédé de transfert et programme

Publications (1)

Publication Number Publication Date
WO2019207695A1 true WO2019207695A1 (fr) 2019-10-31

Family

ID=68293864

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/016859 WO2019207695A1 (fr) 2018-04-25 2018-04-25 Dispositif de transfert, système de transfert, procédé de transfert et programme

Country Status (1)

Country Link
WO (1) WO2019207695A1 (fr)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1055374A (ja) * 1996-08-12 1998-02-24 Mitsubishi Heavy Ind Ltd データ中継装置
JP2004336105A (ja) * 2003-04-30 2004-11-25 I-O Data Device Inc 画像撮影装置、画像記録装置及び画像記録方法
JP2005057632A (ja) * 2003-08-07 2005-03-03 Nippon Telegr & Teleph Corp <Ntt> ストリーム生成方法および装置
JP2011176490A (ja) * 2010-02-23 2011-09-08 Fujitsu Ltd 映像配信システム、中継装置及び映像配信プログラム
JP2014233062A (ja) * 2013-05-29 2014-12-11 株式会社Ｙ・Ｓ・Ｙ・エンタープライズ マルチデバイス向けライブ・録画映像変換・配信システム
JP2017046270A (ja) * 2015-08-28 2017-03-02 株式会社Ihi 中継サーバ、中継方法、および中継プログラム

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1055374A (ja) * 1996-08-12 1998-02-24 Mitsubishi Heavy Ind Ltd データ中継装置
JP2004336105A (ja) * 2003-04-30 2004-11-25 I-O Data Device Inc 画像撮影装置、画像記録装置及び画像記録方法
JP2005057632A (ja) * 2003-08-07 2005-03-03 Nippon Telegr & Teleph Corp <Ntt> ストリーム生成方法および装置
JP2011176490A (ja) * 2010-02-23 2011-09-08 Fujitsu Ltd 映像配信システム、中継装置及び映像配信プログラム
JP2014233062A (ja) * 2013-05-29 2014-12-11 株式会社Ｙ・Ｓ・Ｙ・エンタープライズ マルチデバイス向けライブ・録画映像変換・配信システム
JP2017046270A (ja) * 2015-08-28 2017-03-02 株式会社Ihi 中継サーバ、中継方法、および中継プログラム

Similar Documents

Publication Publication Date Title
US7783700B2 (en) Server apparatus, screen sharing method and computer readable medium
TWI430095B (zh) A video supply system, an image supply device, a video display device, and a computer-readable recording medium
CN105450785B (zh) 一种文件传输方法和装置
US7957269B2 (en) Method and system for synchronization of packet
US20190320212A1 (en) Picture storage method, apparatus and video monitoring system
CN110830460B (zh) 一种连接建立方法、装置、电子设备及存储介质
US8811180B2 (en) Communication apparatus and communication method
US9219795B2 (en) Moving picture file transmitting server and method of controlling operation of same
WO2019207695A1 (fr) Dispositif de transfert, système de transfert, procédé de transfert et programme
JP5573167B2 (ja) コンテンツ共有システム，コンテンツ共有方法及びプログラム
US20040236785A1 (en) Method and system for transmitting a digital image over a communication network
KR20200143881A (ko) 제어기 통신 장치 및 그 방법
JP2010258894A (ja) 映像受信装置、映像受信方法及びプログラム
JP2014096162A (ja) インタフェース変換装置及びインタフェース変換方法
JP6893009B2 (ja) クライアント装置、データ収集システム、データ送信方法、及びプログラム
JP7004982B2 (ja) クライアント装置、データ収集システム、データ送信方法、及びプログラム
JP2004289748A (ja) マルチメディア通信の品質監視システム及びその品質監視方法
US9743037B2 (en) Method for transmitting device indicator data in network-based AV system
JP2022509406A (ja) データ送信プロトコル
JP5398364B2 (ja) ファイル伝送システム、ファイル伝送管理サーバ及びファイル検査方法
US10356792B2 (en) Communication terminal device, communication system, communication method compatible with at least two communication schemes
JP2006109016A (ja) 送受信装置、送受信制御方法、プログラム、およびメモリ
JP6939220B2 (ja) データ解析プログラム、データ解析方法、およびデータ解析装置
TW201142611A (en) Method and system for a universal serial bus (USB) camera with two isochronous transfers
JP2007184710A (ja) 情報処理装置および方法、並びにプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18916113

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18916113

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP