KR101879445B1 - Sensing Data Transmitting Apparatus and Receiving Apparatus for data type dependent package processing - Google Patents

Abstract

Disclosed is a sensing data transmission apparatus that performs package processing on sensing data through a plurality of transmission channels and transmits the sensing data. According to an embodiment of the present invention, there is provided a sensing data transmission apparatus including: a plurality of data input units receiving a plurality of sensing data from a plurality of different sensors and supplying the sensing data to the plurality of transmission channels; And a plurality of transmission channels configured with different channel types such that different data processing is performed depending on the type of each of the plurality of sensing data supplied through the plurality of data input sections,
A first network unit for transmitting the plurality of sensing data to the outside, and a first codec for compressing the plurality of sensing data and a first intra-synchronization unit for performing synchronization between the plurality of sensing data, Depending on the channel type.

Description

TECHNICAL FIELD [0001] The present invention relates to a sensing data transmission device and a sensing data reception device for package processing for each data type,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to sensing data processing, and relates to a sensing data transmission device and a sensing data reception device for package processing by data type.

With the development of networks and codecs, it is time to watch Internet TV at home and free remote video conferencing. This is because large amounts of data, video and audio, can be transmitted in real time. In recent years, real - time transmission of haptic data acquired from multiple sensors is increasing to support not only conventional multimedia data (video, audio) but also various user interaction.

 In addition to real-time transmission of multimedia, synchronization between media is becoming more important in order to guarantee user's sense of quality (QoE). As an example of a typical synchronization, there is a lip sync, and as mentioned above, the range of data synchronization support for interaction is expanding.

  In this regard, the conventional method used a method of separately developing and integrating a network module, a codec, and a synchronization module for data synchronization necessary for real-time data transmission.

The disadvantage of this method is that it is easy to implement individual functions, but when it is desired to support both real-time data transmission and synchronization, the process of integrating them in accordance with the requirements is complicated, resulting in a low efficiency as a whole.

Korean Patent Laid-Open Publication No. 2012-012401 (filed on October 29, 2012, entitled: Apparatus and method for providing additional information to a functional unit in a reconfigurable codec)

It is an object of the present invention to provide a sensing data transmission device and a sensing data reception device for package processing for each data type capable of processing data through a channel customized according to the type of data.

According to an aspect of the present invention, there is provided a sensing data transmission apparatus for performing package processing on sensing data through a plurality of transmission channels and receiving the sensing data from a plurality of different sensors, A plurality of data input units for supplying a plurality of input sensing data to the plurality of transmission channels; And a plurality of transmission channels configured with different channel types such that different data processing is performed depending on the type of each of the plurality of sensing data supplied through the plurality of data input sections, And a first network unit for transmitting sensing data to the outside, wherein at least one of a first codec for compressing the plurality of sensing data and a first intrasynchronization unit for performing synchronization between the plurality of sensing data is connected to the channel type And optionally further included.

Preferably, when the channel type of each of the plurality of transmission channels is predetermined in accordance with the type of the plurality of sensing data to be input to each of the plurality of transmission channels, each of the plurality of different sensors is connected to one of the plurality of data input units Each of the plurality of data input units may be connected to one corresponding transmission channel among the plurality of transmission channels.

Advantageously, the plurality of transport channels comprise a first type transport channel comprising a package comprising the first network portion, the first codec and the first intrasynchronization portion; A second type transmission channel comprising a package including the first network unit and the first intra-synchronization unit; A third type transport channel comprising a package comprising the first network portion and the first codec; And a fourth type transport channel including a package including only the first network unit.

Preferably, the sensing data transmission device according to an embodiment of the present invention includes a network input unit receiving the plurality of sensing data and supplying the sensing data to the first network unit; A network output unit outputting the plurality of sensing data through the first network unit; A codec input unit for receiving the plurality of sensing data and supplying the received sensing data to the first codec; A codec output unit outputting the plurality of sensing data through the first codec; A synchronization input unit receiving the plurality of sensing data and supplying the sensing data to the first intra-synchronization unit; And a synchronization output unit outputting the plurality of sensing data through the first intra-synchronization unit.

Preferably, the first type transport channel includes: a COSI relay unit for relaying the sensing data from the codec output unit to the synchronization input unit; And an SOCI relay unit relaying the sensing data from the synchronization output unit to the codec input unit and an SONI relay unit relaying the sensing data from the synchronization output unit to the network input unit. And a CONI relay for relaying the sensing data from the CODEC output unit to the network input unit, wherein the second type transport channel further comprises the SONI relay unit, and the third type transport channel includes the CONI The fourth type transport channel may further include a DINI relay unit for relaying the plurality of sensing data supplied from the data input unit to the network input unit.

Preferably, the sensing data transmission apparatus according to an embodiment of the present invention performs synchronization of the plurality of sensing data in each of the plurality of transmission channels by the first intrinsic unit included in each of the plurality of transmission channels And a first inter-synchronization unit for synchronizing channels of the plurality of first synchronization sensing data generated for each of the plurality of transmission channels when generating the plurality of first synchronization sensing data.

Advantageously, the first network portion included in each of the plurality of transmission channels comprises: a first channel identification layer for identifying the channel type of each of the plurality of transmission channels; A first port layer for setting a communication protocol corresponding to the channel type among a plurality of communication protocols; And a first communication layer for communicating with the outside using a communication protocol set in the first port layer.

Advantageously, the first codec included in each of the plurality of transmission channels comprises: a first audio codec for compressing audio sensing data; A first video codec for compressing video sensing data; And a first depth value codec for compressing depth value sensing data, wherein the first codec included in each of the plurality of transmission channels is based on the channel type of each of the plurality of transmission channels among a plurality of codecs And may be a selected codec.

According to another aspect of the present invention, there is provided a sensing data receiving apparatus for receiving a plurality of sensing data through an external network, A plurality of receive channels comprising a channel type; And a data output unit outputting the sensing data to the at least one user device, the sensing data being transmitted from the plurality of reception channels, wherein each of the plurality of reception channels transmits the sensing data to the external network A second codec for decompressing the compressed data when the plurality of sensed data is compressed data, and a second intra-synchronization unit for performing synchronization between the plurality of sensed data, In accordance with the channel type.

Preferably, when the channel type of each of the plurality of reception channels is predetermined in accordance with the type of the plurality of sensing data to be input to each of the plurality of reception channels, each of the plurality of data output units includes: Lt; RTI ID = 0.0 > a < / RTI > corresponding transport channel.

Advantageously, the plurality of receive channels comprises a first type receive channel comprising a package comprising the second network portion, the second codec and the second intra-synchronization portion; A second type receive channel comprising a package including the second network portion and the second intra-synchronization portion; A third type receive channel comprising a package comprising the second network portion and the second codec; And a fourth type receive channel configured by a package including only the second network unit.

Preferably, the sensing data receiving apparatus according to an embodiment of the present invention includes: a network input unit for supplying a plurality of sensing data received through the external network to the second network unit; A network output unit for outputting the plurality of sensing data received by the second network unit to the reception channel including the second network unit; A codec input unit receiving the plurality of sensing data and supplying the received sensing data to the second codec; A codec output unit outputting the plurality of sensing data through the second codec; A synchronization input unit for receiving the plurality of sensing data and supplying the sensing data to the second intra-synchronization unit; And a synchronization output unit outputting the plurality of sensing data through the second intramarrier unit.

Preferably, the first type reception channel includes: an NOCI relay unit for relaying the sensing data from the network output unit to the codec input unit; And a COSI relay unit relaying the sensing data from the codec output unit to one of the NOSI relay units relaying the sensing data to the synchronization input unit from the network output unit and the synchronization input unit. And an SODO relay unit for relaying the sensing data from the synchronization output unit to the data output unit and one of SOCI relay units relaying the sensing data from the synchronization output unit to the codec input unit. And a CODO relay unit for relaying the sensing data from the codec output unit to the data output unit, wherein the second type reception channel comprises: the NOSI relay unit; And the SODO relay unit, wherein the third type reception channel comprises: the NOCI relay unit; And the CODO relay unit, and the fourth type reception channel may further include a NODO relay unit for relaying the sensing data from the second network unit to the data output unit.

Preferably, the sensing data receiving apparatus according to an embodiment of the present invention performs synchronization between the plurality of sensing data in each of the plurality of reception channels, wherein the second intrinsic unit included in each of the plurality of reception channels And a second inter-synchronization unit performing synchronization between the channels of the plurality of second synchronization sensing data generated for each of the plurality of reception channels when the plurality of second synchronization sensing data is generated.

Preferably, the second network unit included in each of the plurality of reception channels includes a second channel identification layer for identifying the channel type of each of the plurality of reception channels; A second port layer for setting a communication protocol corresponding to the channel type among a plurality of communication protocols; And a second communication layer for communicating with the outside using a communication protocol set in the second port layer.

Preferably, the second codec included in each of the plurality of reception channels includes a second audio codec for decompressing the audio sensing data if the audio sensing data is compressed data; A second video codec for decompressing the video sensing data when the video sensing data is compressed data; And a second depth value codec for decompressing the compressed depth data when the depth value sensing data is compressed data, wherein the second codec included in each of the plurality of reception channels comprises a plurality of codecs And may be a codec selected based on the channel type of each of the receive channels.

According to an embodiment of the present invention, there is provided a network unit of independent channel unit capable of transmitting heterogeneous data and supporting heterogeneous network protocol, a codec capable of encoding and decoding on a channel basis, intra data synchronization between intra- And a synchronization unit for supporting synchronization. Thus, it is possible to process heterogeneous data through a customized channel according to the type of data.

According to another embodiment of the present invention, a data input unit and a data output unit, which are common interfaces, are provided so that data can be always input and output through the same interface regardless of the package configuration of a plurality of channels included in each of the sensing data transmission apparatus and the reception apparatus. A codec output unit, a synchronization input unit, and a synchronization output unit, and provides a plurality of repeaters for data transfer between the common interfaces, thereby improving the convenience of data processing package development And the compatibility of the sensing data transmission apparatus and the reception apparatus is improved.

1 is a diagram illustrating a sensing data transmission apparatus and a reception apparatus for package processing according to a data type according to a first embodiment of the present invention.
FIG. 2 is a view for explaining the difference between the present invention and the prior art.
3 is a diagram illustrating a sensing data transmission apparatus and a reception apparatus for package processing according to a data type according to a second embodiment of the present invention.
4 is a diagram illustrating a common interface according to an embodiment of the present invention.
5 is a diagram illustrating a sensing data transmission apparatus and a reception apparatus for package processing according to a data type according to a third embodiment of the present invention.
FIG. 6 is a diagram illustrating a network unit according to an embodiment of the present invention. Referring to FIG.
7 is a diagram illustrating a sensing data transmission apparatus and a reception apparatus for package processing according to a data type according to a fourth embodiment of the present invention.
8 is a diagram illustrating a configuration of a codec according to an embodiment of the present invention.
9 is a diagram for explaining a method of setting a video codec according to an embodiment of the present invention.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It is to be understood, however, that the invention is not to be limited to the specific embodiments, but includes all changes, equivalents, and alternatives falling within the spirit and scope of the invention. Like reference numerals are used for like elements in describing each drawing.

The terms first, second, A, B, etc. may be used to describe various elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a sensing data transmission apparatus and a reception apparatus for package processing according to a data type according to a first embodiment of the present invention.

FIG. 1 (a) illustrates a sensing data transmission apparatus according to an embodiment of the present invention, which includes a plurality of data input units 112 and a plurality of transmission channels 114.

The plurality of data input units 112 receives a plurality of sensing data from a plurality of different sensors (sensors A and B), and supplies the received plurality of sensing data to the plurality of transmission channels 114.

At this time, the sensing data may be various kinds of data such as video data, audio data, haptic data, and depth value data.

1 (a), the sensor A transmits the sensing data collected by itself to the left data input unit 112, and the sensor B transmits the sensing data collected by itself to the right data input unit 112).

The plurality of transmission channels 114 may be configured with different channel types so that different data processing is performed depending on the type of each of the plurality of sensing data supplied through the plurality of data input units 112. [

At this time, the channel type of each of the plurality of transmission channels 114 may be predetermined according to a type of a plurality of sensing data to be input to each of the plurality of transmission channels.

According to the present invention, each of the plurality of different sensors is connected to a corresponding one of the plurality of data input units 112, and each of the plurality of data input units 112 includes a plurality of transmission channels 114 And may be connected to one corresponding transmission channel 114.

Each of the plurality of transmission channels 114 includes a first codec 114a, a first intra-synchronization unit 114b, and a first network unit 114c.

The first codec 114a compresses (encodes) a plurality of pieces of sensing data.

The first intra-synchronization unit 114b performs synchronization between a plurality of pieces of sensing data in each of the plurality of transmission channels 114. [

The first network unit 114c transmits a plurality of sensing data to the outside.

1 (a), each of the plurality of transmission channels 114 includes the first codec 114a, the first intra-synchronization unit 114b, and the first network unit 114c. However, In the example, each of the plurality of transmission channels 114 includes only the first network portion 114c, or may include at least one of the first codec 114a and the first intra-synchronization portion 114b, May further be selectively included according to the channel type of each of the plurality of transmission channels (114).

Accordingly, in another embodiment, data processing for a plurality of sensing data supplied to each of the plurality of transmission channels 114 may be performed differently according to the channel type of each of the plurality of transmission channels 114. [

The plurality of transmission channels 114 transmit a plurality of sensing data to the sensing data receiving device through the external network 130 when the data processing of the plurality of sensing data is completed.

FIG. 1B illustrates a sensing data receiving apparatus according to an embodiment of the present invention, and includes a plurality of reception channels 122 and a data output unit 124.

The plurality of receive channels 122 are configured with different channel types to receive a plurality of sensing data through the external network 130 and to perform different data processing depending on the type of each of the plurality of sensing data.

At this time, the channel type of each of the plurality of reception channels is predetermined according to a type of a plurality of sensing data to be input to each of the plurality of reception channels 122, and each of the plurality of data output units 124 includes a plurality of reception channels 122 The transmission channel 122 may be connected to a corresponding one of the transmission channels 122.

At this time, each of the plurality of reception channels 122 includes a second network unit 122a, a second codec 122b, and a second intra-synchronization unit 122c.

The second network unit 122a receives a plurality of sensing data through the external network 130. [

The second codec 122b performs decompression (decoding) of a plurality of pieces of sensing data received through the second network unit 122a when the data is compressed (coded).

The second intra-synchronization unit 122c performs synchronization between the plurality of sensing data in each of the plurality of reception channels 122. [

The data output unit 124 outputs the sensing data subjected to the data processing, which is transmitted from the plurality of reception channels 122, to a plurality of user devices (user device A and user device B).

As described above, according to the embodiment of the present invention, each of the plurality of transmission channels 114 and the plurality of reception channels 122 is configured to perform package processing on the corresponding sensing data according to the type of sensing data, This will be described later with reference to FIG.

In FIG. 1, the sensing data transmission device and the reception device are shown as separate devices. However, in another embodiment, the sensing data transmission device and the reception device may be integrated into one device.

In each of the plurality of transmission channels 114 in FIG. 1, modules are arranged in the order of a first codec 114a, a first intra-synchronization unit 114b, and a first network unit 114c, The modules are arranged in the order of the second network unit 122a, the second codec 122b and the second intrasynchronization unit 122c in each of the modules 122. However, the present invention is not limited to this, .

FIG. 2 is a view for explaining the difference between the present invention and the prior art.

2 (a) is a diagram for explaining the configuration of a conventional sensing data transmission apparatus, wherein S denotes an intra synchronization unit, C denotes a codec, and N denotes a network unit.

As shown in FIG. 2 (a), when a plurality of transmission channels for processing sensing data are configured, the configuration of each transmission channel is not fixed, but an arbitrary synchronization unit among a plurality of synchronizing units developed individually, A plurality of transmission channels are configured in such a manner that an arbitrary codec is selected from a plurality of codecs and an arbitrary network portion is selected from among a plurality of network portions. Accordingly, the integration process between the intra synchronization unit, the codec, and the network unit becomes complicated, thereby reducing the overall efficiency.

In contrast, according to an embodiment of the present invention, as shown in FIG. 2 (b), when a plurality of transmission channels are configured, the sensing data transmission apparatus according to an embodiment of the present invention shown in FIG. The intra-synchronization unit, the codec, and the network unit are packaged and configured so as to match the type of data to be processed in the corresponding channel, thereby minimizing the complexity of the module integration process and improving the efficiency of the sensing data transmission device.

Meanwhile, as described above, each of the plurality of transmission channels 114 and the plurality of reception channels 122 has various configurations depending on the channel type, which will be described with reference to FIG.

3 is a diagram illustrating a sensing data transmission apparatus and a reception apparatus for package processing according to a data type according to a second embodiment of the present invention.

3, a description will be given on the assumption that the sensing data transmission device and the reception device are integrated into one device.

Referring to FIG. 3, the sensing data transmission apparatus and the reception apparatus may include a network, a codec, and an intra-synchronization unit, respectively, as shown in FIGS. 3A to 3D, ), An NC package, which is a package composed of a network unit and a codec, and a fourth type channel, which is a package composed of an NCS package, a second type channel, an NS package, And the N package, which is a package consisting of only a single package.

In the sensing data transmission device, sensing data is input from a sensor through a data input unit (DI), and the first type transmission channel to the fourth type transmission channel in FIGS. 3 (a) to 3 (d) And transmits the sensing data to the external network.

Also, in the case of the sensing data receiving apparatus, the sensing data is received through the network unit to process the data through the first type reception channel to the fourth type reception channel in Figs. 3 (a) to 3 (d) The completed sensing data is transmitted to the user device through a data input unit (DO).

3, the network unit includes a first network unit 114c and a second network unit 122a, and the codec includes a first codec 114a and a second codec 122b, and the intra- An intra synchronization unit 114b and a second intra synchronization unit 122c.

3, a synchronization input unit (SI), a synchronization output unit (SO), and a codec input unit (Codec Input) are provided as common interfaces of the intra synchronization unit, the codec, (CI), a codec output unit (CO), a network input unit (NI), and a network output unit (NO) (NCS package, NS package, NC package, N package), data input / output in each of the intra synchronization unit, the codec and the network unit is performed through the same type of interface (input unit, output unit) . That is, in the present invention, each of the intra-synchronization unit, the codec, and the network unit has a pair of input units and output units corresponding thereto.

For example, even when the codecs included in each of the plurality of channels are made by different manufacturers, data input to and output from the codec is processed through the same codec output unit (CO) as the same codec input unit (CI) Even if the codec of the codec output unit (CO) is arranged, the developer does not need to separately perform coding on the input / output interface every time according to the type of the codec to be placed, It is possible to constitute a plurality of channels, and the convenience of development is greatly improved.

The sensing data transmission device and the sensing data reception device also have a data input part DI and a data output part DO as a common interface, which includes a plurality of channels 114, 122 included in the sensing data transmission device and the reception device The data input unit DI and the data output unit DO are connected via the data input unit DI and the data output unit DO without any new coding of the interfaces to the data input unit DI and the data output unit DO, And to connect with the user device. As a result, compatibility with external devices such as sensors and devices is enhanced.

4 is a diagram illustrating a common interface according to an embodiment of the present invention.

4A shows a transmission channel (or reception channel) 410, a data input unit 410a, and a data output unit 410b.

The data input unit 410a receives a plurality of sensing data from the sensor and supplies the plurality of sensed data to the transmission channel 410. [

The data output unit 410b outputs the sensed data, which is transmitted from the reception channel 410, to at least one user device.

The data input unit 410a may receive the sensing data from the sensor at the same interface without changing the coding for the data input unit 410a regardless of the package configuration of the transmission channel 410, 410b can always output the sensing data to the user device on the same interface without changing the coding for the data output unit 410b regardless of the package configuration of the receiving channel 410. [

4 (b) shows a synchronization unit 412, a synchronization input unit 412a, and a synchronization output unit 412b.

The synchronization input unit 412a receives the plurality of sensing data and supplies the received sensing data to the synchronization unit 512. [

The synchronization output unit 412b outputs a plurality of synchronized sensing data generated by synchronizing the plurality of sensing data in the synchronization unit 412. [

4C shows a codec 414, a codec input unit 414a, and a codec output unit 414b.

The codec input unit 414a receives a plurality of sensing data and supplies the received sensing data to the codec 414.

The codec output unit 414b outputs a plurality of pieces of sensing data through the codec 414. At this time, the codec output unit 414b may output the compressed sensing data or may output the decompressed sensing data.

4 (d) shows a network unit 416, a network input unit 416a, and a network output unit 416b.

The network input unit 416a receives a plurality of sensing data and supplies the sensing data to the network unit 416. [

The network output unit 416b outputs a plurality of sensing data via the network unit 416. [

In this case, the synchronization input unit 412a, the synchronization output unit 412b, the codec input unit 414a, the codec output unit 414b, the network input unit 416a, and the network output unit 416b are, Regardless of the package configuration of the receiving channel (i. E., The receiving channel) 410, the coding may be provided as the same interface without change.

5 is a diagram illustrating a sensing data transmission apparatus and a reception apparatus for package processing according to a data type according to a third embodiment of the present invention. However, in FIG. 5, only one transmission channel and one reception channel are shown instead of a plurality of transmission channels and a reception channel for convenience of explanation.

5A, a sensing data transmission apparatus according to a first type transmission channel is illustrated. The sensing data transmission apparatus according to a first type transmission channel includes a data input unit 510, a codec input unit 502a, A first codec 520, a codec output unit 502b, a COSI relay unit 590a, a synchronization input unit 504a, a first intrinsic synchronization unit 530, a synchronization output unit 504b, an SONI relay unit 590b, A network input unit 506a, a first network unit 540, and a network output unit 506b.

The data input unit 510 receives a plurality of pieces of sensing data from a sensor corresponding to a transmission channel included therein, and supplies the received plurality of sensing data to the codec input unit 502a.

The codec input unit 502a receives a plurality of sensing data from the data input unit 510 and supplies the received sensing data to the first codec 520. [

The first codec 520 compresses the plurality of sensing data supplied through the codec input unit 502a.

The codec output unit 502b outputs a plurality of compressed sensing data compressed by the first codec 520. [

The COSI relay unit 590a relays the plurality of pieces of compression sensing data output from the codec output unit 502b to the synchronization input unit 504a.

At this time, the COSI relay unit 590a can be implemented by selecting and arranging the instance of the COSI relay unit 590a among the instances of the plurality of relay units defined by the developer in advance.

That is, according to an embodiment of the present invention, there is no need to newly code each time a package configuration of a plurality of channels has a form, and a channel is selected by arranging an instance for a relay unit corresponding to the package configuration, So that the development convenience of the developer can be improved.

The synchronization input unit 504a receives a plurality of pieces of compression sensing data from the COSI relay unit 590a and supplies the compressed sensing data to the first intra-synchronization unit 530. [

The first intra-synchronization unit 530 performs synchronization between the plurality of compressed sensing data supplied from the synchronization input unit 504a.

For example, when the compression sensing data is video sensing data, the first intrasynchronization unit 530 is video compression sensing data photographed at 30 frames per second so that the compression sensing data is input every 33 ms, In case of delay input, intra-synchronization can be performed on a plurality of pieces of compression sensing data in a manner of adjusting at intervals of 33 ms. At this time, the first intra-synchronization unit 530 may perform intra-synchronization based on the time stamp corresponding to each of the plurality of compression sense data.

The synchronization output unit 504b outputs the synchronized compression sensing data in the first intra-synchronization unit 530. [

The SONI relay unit 590b relays the synchronized compression sensing data output from the synchronization output unit 504b to the network input unit 506a.

The network input unit 506a supplies the plurality of synchronized compression sensing data supplied through the second relay unit 590b to the first network unit 540. [

The first network unit 540 performs network processing according to protocols (TCP, UDP, etc.) to be applied to a plurality of synchronized compression sensing data input through the network input unit 506a.

The network output unit 506b outputs the synchronized compression sensing data processed by the first network unit 540 to the external network.

Referring to the right side of FIG. 5A, a sensing data receiving apparatus according to a first type transmission channel is illustrated. A sensing data receiving apparatus according to a first type transmission channel includes a network input unit 506a, a second network unit A network output unit 506b, a NOCI relay unit 590e, a codec input unit 502a, a second codec 560, a codec output unit 502b, a COSI relay unit 590a, a synchronization input unit 504a, A second intra-synchronization unit 570, a synchronization output unit 504b, an SODO relay unit 590f, and a data output unit 580.

The network input unit 506a receives a plurality of sensing data through an external network.

The second network unit 550 performs network processing according to protocols (TCP, UDP, etc.) applied to the plurality of sensing data received through the network input unit 506a. The network output unit 506b transmits a plurality of sensing data via the second network unit 550 to the NOCI relay unit 590e.

The NOCI relay unit 590f relays the plurality of sensing data output from the network output unit 506b to the codec input unit 502a.

The codec input unit 502a supplies the second codec 560 with a plurality of sensing data transmitted from the NOCI relay unit 590e.

When the plurality of sensing data supplied through the codec input unit 502a is compressed data, the second codec 560 generates a plurality of decompression sensing data generated by decompressing the plurality of sensing data.

The codec output unit 502b outputs a plurality of decompression sensing data generated by the second codec 560 to the COSI relay unit 590a.

The COSI relay unit 590a relays the plurality of decompression sensing data output from the codec output unit 502b to the synchronization input unit 504a.

The synchronization input unit 504a supplies the second intrasynchronization unit 570 with a plurality of decompression sensing data received from the COSI relay unit 590. [

The second intra-synchronization unit 570 generates a plurality of synchronized decompression sensing data by synchronizing the plurality of decompression sensing data supplied through the synchronization input unit 504a.

The synchronization output unit 504b outputs a plurality of synchronized decompression sensing data generated by the second intra-synchronization unit 570. [

The SODO relay unit 590f relays the plurality of synchronized decompression sensing data output from the synchronization output unit 504b to the data output unit 580.

The data output unit 580 outputs a plurality of synchronized decompression sensing data received from the SODO relay unit 590f to a sensor corresponding to the decompression sensing data.

In another embodiment, the arrangement order of the first codec 520 and the first intrinsic synchronization unit 530 is changed in FIG. 5 (a), or the arrangement of the second codec 560 and the second intrinsic synchronization unit 570 The order may change.

Accordingly, in the sensing data transmission apparatus, the COSI relay unit 590a can be replaced with an SOCI relay unit (not shown) that relays the sensing data from the synchronization output unit 504b to the codec input unit 502a, and the SONI relay unit 590b may be replaced with a CONI relay unit (not shown) for relaying the sensing data from the codec output unit 502b to the network input unit 506a.

The NOCI relay unit 590e may be replaced with a NOSI relay unit 590g that relays the sensing data from the network output unit 506b to the synchronization input unit 504a and the COSI relay unit 590a, May be replaced with an SOCI relay unit (not shown) for relaying the sensing data from the synchronization output unit 504b to the codec input unit 502a.

5 (a), all of the sensing data supplied through the data input unit 510 is input to the first codec 520. However, in another embodiment, the first codec 520 may receive first sensing data, such as a time stamp, The sensing data that does not need to go through the CODEC 520 is transmitted from the data input unit 510 to the network input unit 506a through the DINI relay unit 590d when the sensing data transmission apparatus further includes the DINI relay unit 590d, (Not shown), it may be transmitted from the data input unit 510 to the synchronization input unit 504a.

The sensing data that does not need to go through the second CODEC 560 in the sensing data receiving apparatus of FIG. 5 (a) is transmitted to the network output unit (not shown) through the NODO relay unit 590i when the sensing data receiving apparatus further includes the NODO relay unit 590i 506b to the data output unit 580 or to the synchronization output unit 504a through the network output unit 506b when the NOSI 590g further includes the NOSI 590g relay unit. The sensing data transmission apparatus and sensing data reception apparatus of FIG. 5 (a) may further include a separate relay unit for processing the sensing data that does not need to go through the codec.

The modules included in FIG. 5B to FIG. 5D are mostly the same as the modules included in FIG. 5A. Therefore, the description of the module for performing the same operation in FIG. And explain the operation of the relay units mainly.

5B, the SONI relay unit 504b relays a plurality of synchronized sensing data output from the synchronization output unit 504b to the network input unit 506a, and the NOSI relay unit 590g relays the network output unit 506b To the synchronization input unit 504a and the SODO relay unit 590f transmits a plurality of synchronized sensing data output from the synchronization output unit 504b to the data output unit 580 .

In another embodiment, the sensing data which does not need to go through the first intra-synchronization unit 530 in the sensing data transmission apparatus of FIG. 5 (b) includes the DINI relay unit 590d if the sensing data transmission apparatus further includes the DINI relay unit 590d The sensing data receiving unit of the sensing data receiving apparatus of FIG. 5B may transmit the sensing data to the network input unit 506a through the data input unit 510, The data output unit 580 can transmit data to the data output unit 580 via the network output unit 506b.

5C, the CONI relay unit 590c relays a plurality of pieces of compression sensing data output from the codec output unit 502b to the network input unit 506a, and the NOCI relay unit 590e transmits the compressed sensing data to the network output unit 506b. The CODO relay unit 590h transmits a plurality of decompression sensing data output from the codec output unit 502b to the data output unit 580. The data output unit 580 outputs the decompression sensing data output from the CODO output unit 502b to the CODO input unit 502a.

In another embodiment, the sensing data that does not need to go through the first codec 520 in the sensing data transmission apparatus of Fig. 5 (c) includes the DINI relay unit 590d when the sensing data transmission apparatus further includes the DINI relay unit 590d, The sensing data receiving apparatus of FIG. 5C may transmit the sensing data to the NODO relay unit 590i through the second CODEC 560, The network output unit 506b can transmit the data to the data output unit 580 via the network output unit 506b.

5D, the DINI relay unit 590d relays a plurality of sensing data supplied from the data input unit 510 to the network input unit 506a, and the NODO relay unit 590i outputs the sensing data from the network output unit 506b And transmits the sensed data to the data output unit 580.

In another embodiment, when the developer determines the package configuration of each of the plurality of channels such as the NCS package, the NS package, the NC package, and the N package, the relay section 590a to 590i corresponding to the package configuration of each of the plurality of channels The instance for that can be selected automatically.

The first intrinsic unit 530, the first network unit 540, the second network unit 550, the second codec 560, and the first codec 520 included in each of the plurality of channels, The codec output unit 502b, the synchronization input unit 504a, the synchronization output unit 504b, and the synchronization output unit 504b of the second intra- , Network input unit 506a, network output unit 506b, and the like, and the mutual connection between the common interfaces is performed by using an instance for the relay unit 590a to 590i that is automatically selected, So that it can be easily developed.

FIG. 6 is a diagram illustrating a network unit according to an embodiment of the present invention. Referring to FIG.

Referring to FIG. 6, a first network portion in three transmission channels is shown on the left, and a second network portion in three reception channels is shown on the right.

The first network unit includes first channel identification layers 612a, 612b and 612c, first port layers 614a, 614b and 614b and first communication layers 616a, 616b and 616c.

The first channel identification layers 612a, 612b, and 612c are layers for identifying the channel types of the three transmission channels.

For example, each of the first channel identification layers 612a, 612b, and 612c in each of the first through third transmission channels in FIG. 6 may be a type of channel for processing haptic sensing data, video sensing data, and audio sensing data.

The first port layers 614a, 614b, and 614b set communication protocols corresponding to the channel types among the plurality of communication protocols.

For example, in FIG. 6, the first port layer 614a, 614b, and 614b in each of the first to third transport channels are set to TCP port, UDP port, and TCP port.

The first communication layers 616a, 616b, and 616c communicate with the outside using a communication protocol set in the first port layers 614a, 614b, and 614b.

For example, the first communication layers 616a, 616b, and 616c in each of the first through third transmission channels in FIG. 6 can communicate externally with a TCP protocol, a UDP protocol, and a TCP protocol.

The second network portion includes a second channel identification layer 622a, 622b, 622c, a second port layer 624a, 624b, 624b, and a second communication layer 626a, 626b, 626c.

The second channel identification layer 622a, 622b, 622c is a layer for identifying the channel type of each of the three reception channels.

The second port layer (624a, 624b, 624b) establishes a communication protocol corresponding to the channel type among the plurality of communication protocols.

The second communication layers 626a, 626b, and 626c communicate with the outside using a communication protocol set in the second port layers 624a, 624b, and 624b.

6, if each of the network units is composed of three layers of the channel identification layers 612 and 622, the port layers 614 and 624, and the communication layers 616 and 626, the scalability of the module is increased, The reusability and portability are improved, and the convenience of management is enhanced.

7 is a diagram illustrating a sensing data transmission apparatus and a reception apparatus for package processing according to a data type according to a fourth embodiment of the present invention.

Referring to FIG. 7, a sensing data transmission apparatus having three transmission channels is shown on the left side, and a sensing data reception apparatus having three reception channels on the right side.

The sensing data transmission apparatus on the left side of FIG. 7 includes three data input units 710, three first intra-synchronization units 720, one inter-synchronization unit 722, two first codecs 730, and three network units 740.

The three data input units 710 receive sensing data from different sensors.

Each of the first three intra-synchronization units 720 includes a synchronization unit 1, a synchronization unit 2, and a synchronization unit 3 that perform synchronization in different ways among a plurality of synchronization units.

At this time, each of the three first intrasynchronization units 720 performs synchronization among a plurality of sensing data of the transmission channel included therein to generate a plurality of first synchronization sensing data.

The first inter-synchronization unit 722 performs synchronization between the channels of the plurality of first synchronization sensing data generated for each of the three transmission channels.

The two first codecs 730 are located only in the first and second transport channels and not in the third transport channel, the first codec 730 located in the first transport channel is set to the video codec 1 among the plurality of video codecs And the first codec 730 disposed in the second transmission channel is set as the audio codec 1 among the plurality of audio codecs.

In this case, the reason why the first codec 730 is not disposed in the third transmission channel is that the sensing data to be processed in the first and second transmission channels are large-capacity data such as video data and audio data, but the sensing data to be processed in the third transmission channel is compressed This is because data of a low capacity is not needed.

The three first network units 740 communicate with the external network through the TCP protocol, the TCP protocol, and the UDP protocol, respectively.

The sensing data receiving apparatus on the right side of FIG. 7 includes three network units 750, two second codecs 760, three second intra-synchronization units 770, one second inter-synchronization Part 772 and three data output sections 780. [

The three second network units 750 communicate with the external network through the TCP protocol, the TCP protocol, and the UDP protocol, respectively, to receive the sensing data.

The two second codecs 760 decompress the compression applied to the sensing data using codecs of the same type as the codecs disposed in the first and second transport channels.

To this end, the type of compression algorithm applied to the sensing data should be received when the sensing data is received.

Each of the three second intra-synchronization units 770 performs synchronization between a plurality of sensing data of the reception channel included therein to generate a plurality of second synchronization sensing data.

In this case, each of the second intra-synchronization units 770 receives the decompressed sensing data in the second codec 760 through the first and second reception channels and transmits the sensing data not passing through the second codec 760 through the third reception channel .

The second inter-synchronization unit 772 performs synchronization between the channels of the plurality of second synchronization sensing data generated for each of the three reception channels.

8 is a diagram illustrating a configuration of a codec according to an embodiment of the present invention.

FIG. 8 shows a configuration of a codec applied to contents, which includes an audio codec (AudioCodec), a video codec (VideoCodec), and a depth value codec (DepthCodec).

The audio codec also includes an audio encoder and an audio decoder, the video codec includes a video encoder and a video decoder, and the depth value codec includes a depth value encoder and a depth value decoder.

7 corresponds to a first audio codec for compressing audio sensing data, a first video codec for compressing video sensing data, and a first depth-value codec for compressing depth-value sensing data. And the second codec 760 may include at least one of a second audio codec for compressing audio sensing data, a second video codec for compressing video sensing data, and a second depth value codec for compressing depth value sensing data One can be included.

At this time, the codecs included in the first codec 730 and the second codec 760 can be selected based on the channel types of the plurality of transmission channels and the plurality of reception channels.

On the other hand, when developing a sensing data transmission device and a sensing data reception device, a system developer may change a coding method according to the type of data to be processed in each channel included in the device, The data processing package can be easily configured by selecting and adding an instance for a corresponding encoder and decoder among the encoder and the decoder.

9 is a diagram for explaining a method of setting a video codec according to an embodiment of the present invention.

Referring to FIG. 9, a VideoCodecConfig.xml file for setting a video codec is shown.

Referring to FIG. 9, it can be seen that the video encoder uses NVENC 6.0 by NVIDIA, and the video decoder uses NVCUVID 6.0 by NVIDIA. According to an embodiment of the present invention, a user can set a codec type corresponding to a transport channel or a receive channel through a VideoCodecConfig.xml file or the like as shown in FIG.

The present invention has been described with reference to preferred embodiments thereof. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

Claims (16)

A sensing data transmission apparatus for performing packaging processing on sensing data through a plurality of transmission channels and transmitting the sensing data,
A plurality of data input units receiving a plurality of sensing data from a plurality of different sensors and supplying the received plurality of sensing data to the plurality of transmission channels; And
And a plurality of transmission channels configured with different channel types so that different data processing is performed depending on the type of each of the plurality of sensing data supplied through the plurality of data input units,
Each of the plurality of transmission channels
A first network unit for transmitting the plurality of sensing data to the outside, and a first codec for compressing the plurality of sensing data and a first intra-synchronization unit for performing synchronization between the plurality of sensing data, And is selectively included according to the channel type,
When the channel type of each of the plurality of transmission channels is predetermined according to the type of the plurality of sensing data to be input to each of the plurality of transmission channels,
Wherein each of the plurality of different sensors is connected to a corresponding one of the plurality of data input units,
Wherein each of the plurality of data input units is connected to one corresponding transmission channel among the plurality of transmission channels. delete The method according to claim 1,
The plurality of transport channels
A first type transport channel comprising a package including the first network portion, the first codec, and the first intrasynchronization portion;
A second type transmission channel comprising a package including the first network unit and the first intra-synchronization unit;
A third type transport channel comprising a package comprising the first network portion and the first codec; And
And a fourth type transport channel configured by a package including only the first network unit. The method of claim 3,
A network input unit receiving the plurality of sensing data and supplying the sensing data to the first network unit;
A network output unit outputting the plurality of sensing data through the first network unit;
A codec input unit for receiving the plurality of sensing data and supplying the received sensing data to the first codec;
A codec output unit outputting the plurality of sensing data through the first codec;
A synchronization input unit receiving the plurality of sensing data and supplying the sensing data to the first intra-synchronization unit; And
Further comprising at least one pair of an input unit and an output unit among the synchronization output units outputting the plurality of sensing data through the first intra-synchronization unit. 5. The method of claim 4,
The first type transport channel
A COSI relay unit for relaying the sensing data from the codec output unit to the synchronization input unit; And an SOCI relay unit for relaying the sensing data from the synchronization output unit to the codec input unit
An SONI relay unit for relaying the sensing data from the synchronization output unit to the network input unit; And a CONI relay unit for relaying the sensing data from the codec output unit to the network input unit,
The second type transport channel
Further comprising the SONI relaying unit,
The third type transport channel
Further comprising a CONI relaying unit,
The fourth type transport channel
And a DINI relay unit for relaying the plurality of sensing data supplied from the data input unit to the network input unit. The method according to claim 1,
When the first intra-synchronization unit included in each of the plurality of transmission channels performs synchronization between the plurality of sensing data in each of the plurality of transmission channels to generate a plurality of first synchronization sensing data,
Further comprising a first inter-synchronization unit for performing synchronization between channels of the plurality of first synchronization sensing data generated for each of the plurality of transmission channels. The method according to claim 1,
The first network part included in each of the plurality of transmission channels
A first channel identification layer for identifying the channel type of each of the plurality of transmission channels;
A first port layer for setting a communication protocol corresponding to the channel type among a plurality of communication protocols; And
And a first communication layer for communicating with the outside using a communication protocol set in the first port layer. The method according to claim 1,
The first codec included in each of the plurality of transmission channels
A first audio codec for compressing audio sensing data;
A first video codec for compressing video sensing data; And
And a first depth value codec for compressing depth value sensing data,
Wherein the first codec included in each of the plurality of transmission channels is a codec selected based on the channel type of each of the plurality of transmission channels among the plurality of codecs. A plurality of reception channels configured to receive a plurality of sensing data through an external network and configured with different channel types so that different data processing is performed depending on the type of each of the plurality of sensing data; And
And a data output unit for outputting the sensing data, which is transmitted from the plurality of reception channels, to the at least one user device,
Each of the plurality of receive channels
And a second network unit for receiving the plurality of sensing data through the external network, wherein the second codec for decompressing the plurality of sensing data when the plurality of sensing data is compressed data and the second codec for decompressing the plurality of sensing data, The second intra-synchronization unit performing at least one of the second intrasynchronization units according to the channel type,
When the channel type of each of the plurality of reception channels is predetermined according to the type of the plurality of sensing data to be input to each of the plurality of reception channels,
Wherein each of the plurality of data output units is connected to one corresponding transmission channel among the plurality of transmission channels. delete 10. The method of claim 9,
The plurality of receive channels
A first type receive channel comprising a package including the second network portion, the second codec, and the second intra-synchronization portion;
A second type receive channel comprising a package including the second network portion and the second intra-synchronization portion;
A third type receive channel comprising a package comprising the second network portion and the second codec; And
And a fourth type reception channel configured by a package including only the second network unit. 12. The method of claim 11,
A network input unit for supplying a plurality of sensing data received through the external network to the second network unit;
A network output unit for outputting the plurality of sensing data received by the second network unit to the reception channel including the second network unit;
A codec input unit receiving the plurality of sensing data and supplying the received sensing data to the second codec;
A codec output unit outputting the plurality of sensing data through the second codec;
A synchronization input unit for receiving the plurality of sensing data and supplying the sensing data to the second intra-synchronization unit; And
And a synchronization output unit outputting the plurality of sensing data through the second intra-synchronization unit. The apparatus of claim 1, further comprising: 13. The method of claim 12,
The first type receive channel
An NOCI relay unit for relaying the sensing data from the network output unit to the codec input unit; And a NOSI relay unit for relaying the sensing data from the network output unit to the synchronization input unit
A COSI relay unit for relaying the sensing data from the codec output unit to the synchronization input unit; And an SOCI relay unit for relaying the sensing data from the synchronization output unit to the codec input unit
An SODO relay unit for relaying the sensing data from the synchronization output unit to the data output unit; And a CODO relay unit for relaying the sensing data from the codec output unit to the data output unit,
The second type receive channel
The NOSI relaying unit; And the SODO relay unit,
The third type receive channel
The NOCI relaying unit; And a CODO relay unit,
The fourth type receive channel
And a NODO relay unit for relaying the sensing data from the second network unit to the data output unit. 10. The method of claim 9,
When the second intra-synchronization unit included in each of the plurality of reception channels performs synchronization between the plurality of sensing data in each of the plurality of reception channels to generate a plurality of second synchronization sensing data,
Further comprising a second inter-synchronization unit for performing synchronization between channels of the plurality of second synchronization sensing data generated for each of the plurality of reception channels. 10. The method of claim 9,
And the second network unit included in each of the plurality of reception channels
A second channel identification layer for identifying the channel type of each of the plurality of receive channels;
A second port layer for setting a communication protocol corresponding to the channel type among a plurality of communication protocols; And
And a second communication layer for communicating with the outside using a communication protocol set in the second port layer. 10. The method of claim 9,
And the second codec included in each of the plurality of reception channels
A second audio codec for decompressing the audio sensing data if the audio sensing data is compressed data;
A second video codec for decompressing the video sensing data when the video sensing data is compressed data; And
And a second depth value codec for decompressing the depth value sensed data if the sensed data is compressed data,
Wherein the second codec included in each of the plurality of reception channels is a codec selected based on the channel type of each of the plurality of reception channels among the plurality of codecs.

Images