JP2002238050A - Data converter, data coder, and data recorder - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a data converter that converts received coded data at a variable frame rate into coded data at a fixed frame rate, and to provide a data coder and a data recorder. SOLUTION: The data converter 100 is provided with a temporary storage means 101, that temporarily stores received coded data at a variable frame rate, a coded data time stamp read means 102 that reads a coded data time stamp of the received coded data, a time stamp conversion means 104 that converts the coded data time stamp into an MP4 time stamp, and a fixed FPS processing means 104 that converts the coded data at the variable frame rate into the code data at the fixed frame rate.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a data conversion device, a data coding device, and a data recording device for converting coded data at a variable frame rate into coded data at a fixed frame rate.

[0002]

2. Description of the Related Art In recent years, environments for distributing images under a low-bandwidth environment such as the Internet and mobile terminals have become widespread. As a video compression encoding method under these low-bandwidth environments, H.264 standardized by ITU-T is used. 263
For example, MPEG-4 standardized by ISO / IEC is used.

[0003] The above MPEG-4 is different from MPEG-2, which is adopted in DVDs and is widely used, and is capable of encoding at a variable frame rate. Here, the variable frame rate coding is coding in which the display time interval of an arbitrary frame can be set, and the complexity of the video signal in the compression of the video signal and the properties of the video signal (such as presence or absence of motion). This is generally used when performing optimal coding according to the above.

FIG. 10 shows an example of coded data having a variable frame rate. In the figure, a 30 Hz video signal is coded at 15 Hz by skipping every frame in the first half, and is coded at 10 Hz by skipping every two frames in the second half.

The encoding process at a variable frame rate as shown in FIG. 10 will be described below with reference to FIGS. First, a configuration of a conventional data encoding device will be described with reference to FIG. FIG. 11 is a diagram illustrating a configuration of a conventional data encoding device.

In FIG. 11, a conventional data encoding device includes a video capturing means 81 for capturing a video input from a camera, and an encoding determination for determining whether or not to encode a frame signal of the captured video. Means 82, encoding means 83 for encoding the fetched data, and encoding data encoded by the encoding means 83 as M
PEG-4 standard file format standard (hereinafter referred to as PEG-4 standard)
Called “MP4”. ), And a recording medium 86 for recording the MP4 file.

Hereinafter, a series of processing operations of the conventional data encoding apparatus having the above-described configuration will be described. First, the data encoding device converts a video input from a camera into a video frame signal (hereinafter, referred to as a “frame”) by a video capturing unit 81, and converts the frame from the start of video capturing to the camera. Along with the frame number increasing at the frame rate (for example, 30 Hz).

The encoding determining means 82 calculates the time stamp of the input frame from the frame number and the predetermined frame information of the camera, and calculates the time stamp of the input frame. It is determined whether or not to encode the input frame based on the total of the data amounts thus obtained and the output bit rate.

[0009] The conditions for determining whether or not to encode the input frame are as follows: variable / fixed bit rate;
It depends on various conditions and usage purposes of the data encoding device, such as observance / ignorance of the buffer model defined in the regulations, emphasis on frame image quality / frame rate, and the like. Is not shown.

[0010] When the encoding determination means 82 determines that the input frame is to be encoded, the input frame and the time stamp of the frame are output to the encoding means 83. Perform encoding processing. Here, the time stamp of the frame is converted into an MP4 time stamp to be recorded in an MP4 file by performing scale conversion and offset processing.

On the other hand, in the encoding determining means 82,
If it is determined that the frame is not to be encoded, the frame and its time stamp are discarded without being output to the encoding unit 83, and the system waits for the next frame to be input from the video capturing unit 81. .

In general, the encoding process of the data by the encoding unit 83 is time-consuming, and furthermore, depending on the nature of the image of the input frame, the image is acquired by the image capturing unit 81 next. By the time the frame to be captured is output to the encoding determination unit 82,
In some cases, the encoding process cannot be completed. In such a case, the next fetched frame is encoded
, And the discarded frame is not output to the encoding means 83, so that the encoded data is skipped.

The coded data coded by the coding means 83 and the amount of coded data are M
It is output to the P4 file encoding means 85. The encoded data amount is also output to the encoding determining means 82. The amount of encoded data output to the encoding determination unit 82 is determined by the fixed bit rate condition and the buffer model compliance condition among the above-described determination conditions of whether to encode the input frame. Used.

Then, in the MP4 file encoding means 85, the encoded data and the encoded data amount are M
It is converted to a P4 file and recorded on the recording medium 86.

Here, the configuration of the MP4 file will be described with reference to FIG. FIG. 12 is a diagram (FIG. (B)) showing an example of encoded data at a variable frame rate (FIG. (A)) and the configuration of an MP4 file of the encoded data. MP
The four files are Sample that stores the size of the encoded data.
Sample-To-TimeStamp that stores Size Atom and display interval
It is composed of Atom, which is a table of information of each input frame, such as Atom, Movie dataAtom for storing encoded data, and the like.

First, in the Sample-To-TimeStamp Atom,
For each section having a constant frame rate, the number of frames num and the frame interval dur are sequentially determined from the beginning of the encoded data.
Are described, and the number of sections is described before a table including the number of frames and the frame interval.
The Sample Size Atom has a structure in which the size of each frame is described in the order of the frame number, and the number of elements, which is the total number of frames, is described before the frame size table. Then, the data of each sample is continuously stored in the Movie data Atom.

For example, a frame fetched from the video capturing means 81 is
When encoded into variable frame rate encoded data having three different frame rates as shown in FIG. 12A, the MP4 file encoding means 85 sets the Sample Size as shown in FIG. The Atom describes the number of elements and the size of the encoded data of each frame from the first sample to the ninth sample in the order of the frame number. The Movie data Atom describes the ninth element from the first sample. Sample-to-sample data is continuously stored. The Sample-To-TimeStamp Atom contains the above coded data in such a manner that the interval of the first 3 frames is 2, the interval of the next 2 frames is 3, and the next 4 Since the frame interval is 1, the number of elements is 3 and the number of frames num =
3, frame interval dur = 2, num = 2, dur as section 2
= 3, num = 4, and dur = 1 are described as section 3.
Note that, here, for simplicity of description, one sample is equal to one frame. However, for example, even when 1024 samples = 1 frame, such as audio data,
The method of storing data in Atom is the same.

Next, the encoded data is converted to the MP
The MP4 file encoding means 85 for converting into four files will be described with reference to FIGS. FIG.
Is a diagram showing an example of the configuration of a conventional MP4 file encoding unit, and FIG. 14 is a flowchart showing a series of processing operations of a conventional MP4 file encoding unit.

First, the configuration of the MP4 file encoding means 85 will be described with reference to FIG. MP4 file encoding means 85 includes encoded data and encoded data amount,
And an MP4 time stamp for recording the encoded data in an MP4 file.
The coded data temporary storage means 41 for temporarily storing the input coded data and the amount of coded data, and the coded data input from the coded data temporary storage means 41, Atom generation means 4 for temporarily generating Movie Data Atom, which is a data area for recording encoded data, on mdat atom temporary storage means 46
Sample Size Atom 3, which is a data area for recording the encoded data amount in the MP4 file, using the encoded data amount input from the encoded data temporary storage unit 41 and the encoded data temporary storage unit 41.
Is generated on the stsz atom temporary storage means 47.
Sample-To-TimeStamp Atom which is a data area for recording a time interval of a frame in an MP4 file using the creating means 44 and an MP4 time stamp input from outside.
Is created on the stts atom temporary storage means 48.
The generation means 45 and the respective generation means 43 to 45 described above individually generate the respective temporary storage means 46 to 48.
Temporary data linking means 49 for linking the Atom after all the input of the encoded data to be recorded is completed. When the MP4 time stamp is not input from the outside to the MP4 file encoding unit 85, the time stamp of the encoded data is read from the encoded data stored in the encoded data temporary storage unit 41, and the scale conversion and the like are performed. An MP4 time stamp reading unit 42 that performs offset processing and converts the data into an MP4 time stamp to be recorded in an MP4 file is provided.

Here, there are various methods for creating the Movie Data Atom by the mdat atom creating means 43 according to the purpose, but they are not related to the description of the present invention. Make it not exist.
Also, the Sample Size by the stsz atom creation means 44 described above
Regarding the method of creating Atom, the amount of encoded data is arranged from the beginning. Further, a method of creating the Sample-To-Time Stamp Atom by the stts atom generating means 45 will be described later.

After the input of the encoded data to be recorded is completed, a stream end signal is inputted to the MP4 file encoding means 85. When this stream end signal is inputted, each of the atom creation means 43 to 45 is inputted. Performs processing to complete each Atom, such as writing the number of elements in a table. And then, by the temporary data linking means 49,
Each Atom is rearranged at an appropriate position, and the MP4 file created on the recording medium 86 is output.

Hereinafter, according to the flowchart of FIG.
Stts atom generation means 4 of MP4 file coding means 85
5 will be described. First, in the data encoding device, when data processing is started, the MP4 file encoding means 8
At 5, initialization is performed (step S1). Here, in indicates the total number of frames input to the MP4 encoding unit 85, index indicates the section number at a certain point in the Sample-To-TimeStamp atom, and n indicates the number input to the data encoding apparatus. Of the frames, Sample-To-TimeSt
Indicates the number of unprocessed frames that are not described in amp Atom, and Tp is MP4 of the immediately preceding encoded data.
Indicates a time stamp.

Then, the MP4 file encoding means 85
When the encoded data, the encoded data amount, and the MP4 time stamp are input to the
, The number of input frames in is increased by 1, and the number of unprocessed frames n is increased by 1 (step S2).

Next, it is determined whether or not the number of input frames in ≧ 3. If in ≦ 2, the process proceeds to step S6. If in ≧ 3, the process proceeds to step S4. In this branch, since the above-mentioned Sample-To-TimeStamp Atom describes the time interval of a frame, at least two frames are required. This is because the writing of the first element cannot be performed unless there are at least three frames.

If in ≦ 2, the frame interval d is calculated, and the MP4 time stamp Ts of the currently input frame is recorded as the MP4 time stamp Tp of the immediately preceding frame (step S6). Then, the processing of steps S2 to S6 as described above is repeated until a stream end signal indicating the end of input of encoded data is input to the stts atom generation unit 45 (step S2).
7).

In the above repetition, step S
3, if in ≧ 3, the frame interval d (= Ts−Tp) between the current frame and the previous frame is:
It is determined whether the calculated frame interval d matches the calculated frame interval d (step S4).
Based on the definition, the element of the Sample-To-TimeStamp Atom table is added (step S5). That is, Sample-T
o-TimeStamp Atom, the number of frames num = n-2 and the frame interval dur = d are added, and Sample-To-Tim
After the element is added to the eStamp Atom, the section number index is increased by one, and the number of unprocessed frames is set to n = 2. This 2
The first frame (the previous MP4 time stamp Tp) and the second frame (the current MP4 time stamp Tp) of the section having the new frame interval d (= Ts−Tp)
s).

When the stream end signal is input to the stts atom generation means 45 (step S7), stts a
The tom generation unit 45 performs processing for completing the Sample-To-TimeStamp Atom, such as writing the number of elements in the table. That is, as described in step S5,
At the time of step S7, the frame interval information relating to the two frames has been temporarily stored inside the stts atom generation unit 45 and has not been added to the elements of the Sample-To-TimeStamp Atom table. Therefore, if the stream end signal is input, it is necessary to perform processing for the two sheets. Normally, this is not possible, but when the number of input frames in is smaller than 2, an operation different from the normal operation must be performed.

First, the case where the number of input frames in = 0 or 1 when the stream end signal is input, which is normally impossible, will be described. If the number of input frames in = 0, that is, if no frame has been input, the process proceeds to step S9. in this case,
Of course, there is no need to add any elements to the Sample-To-TimeStamp Atom. Then, the section number index = 0 is set (step S9), and the value is set to the Sample-To-TimeStamp Atom.
0 is written as the number of elements (step S12).

When the number of input frames in = 1, an element having a frame number num = 1 and a frame interval dur = du (du; any number) is added.
= 1 (Step S9), and the value is set to Sample-To-Ti
Write 1 as the number of elements of meStamp Atom (Step S
12). Since the frame interval dur is not defined unless there are two frames, the frame interval du added as the frame interval dur is not a meaningful value and may be arbitrarily determined.

When the number of input frames in ≧ 2, this is a normal state. In this case, since n frames remain unprocessed, the sample-to-time
Add this to StampAtom. That is, the number of frames num
= N, an element with a frame interval dur = d, and
After the section number index is also increased by 1 (step S1
1) As the number of elements of the Sample-To-TimeStamp Atom, write the value of the index increased by 1 (step S1)
2). This is the end of the sample creation process of the Sample-To-TimeStamp Atom.

Next, referring to FIG. 17, MPEG is executed by RTP (Real Time Transport Protocol).
A process when the data of −4 is transmitted from the base station to the data recording device will be described. FIG. 17 is a diagram showing a configuration of a data recording device which is a conventional mobile terminal. MPEG-4 data from a transmission unit is transmitted using RTP.

Hereinafter, a conventional data recording apparatus will be described. The data recording device is an RTP receiving device 91,
RTP reception buffer 92, RTP decoding means 93, MP4
The RTP receiving means 91 comprises a file encoding means 95 and a recording medium 96.
When the MPEG-4 encoded data divided into video packets and stored in the RTP packet is received from the TP transmission unit 90, the RTP packet is stored in the reception buffer 92.

Here, the video packet is a unit of data obtained by further dividing a frame. Even if a certain video packet is lost or an error is mixed in a certain video packet, the other video packets are correctly written. It can be decrypted. Also, in the RTP packet,
An RTP time stamp is attached, and a value obtained by adding a random offset to the encoded data time stamp of the encoded data stored in the RTP packet is set. Normally, when one frame of encoded data is divided into a plurality of RTP packets, the same value is assigned to the RTP time stamps of the plurality of divided RTP packets. The RTP packets are assigned consecutive numbers (sequence numbers), and the receiving side, that is, the data recording device, can check the continuity of the sequence numbers to confirm the loss of the packets.

The RTP decoding means 93 receives one or more RTP packets having the same time stamp from the reception buffer 82, and
The MPEG-4 data is restored by, for example, removing the TP header. Things. The information such as the MP4 time stamp and the frame size necessary for the conversion into the MP4 file can be obtained by the RTP decoding means 93 from the RTP time stamp and the size attached to the RTP packet.

When transmitting MPEG-4 data using RTP from the RTP transmitting means 90 as a base station to a data recording apparatus as a mobile terminal, a packet is transmitted from the RTP transmitting means 90 to the data recording apparatus. Does not arrive, for example, when a frame is transmitted from the RTP transmitting means 90 in a state where the frame is divided into a plurality of RTP packets, some of the RTP packets are lost or the RTP packets constituting a certain frame are lost. If all the data has been lost, the data recording device sets the RTP receiving means 9
1 is skipped, and only the data successfully received by the RTP receiving means 91 is recorded in the recording medium 96 in an MP4 file.

[0036]

However, the above-mentioned coded data at a variable frame rate has an advantage that it can be coded according to the compression of a video signal, as compared with coded data at a fixed frame rate. On the other hand, since the frame rate has a degree of freedom, the encoded data is
When converting to a file, the table size of the Sample-To-TimeStamp Atom, which records the frame interval of the MP4 file, depends on the encoded data, and the table size cannot be estimated or there is an error in the device. If this occurs, it is difficult to restore the data.
There is a problem that the amount of data processing when decoding data from a P4 file increases.

More specifically, for example, in the conventional data encoding apparatus shown in FIG. 11, when the encoded data of the variable frame rate is converted into the MP4 file by the MP4 file encoding means 85, Each time the frame interval of the encoded data changes, the sample-to-time stamp
You need to store a new element in Atom. This allows
In MP4 file, Sample Size Atom and Movie
As in the case of the Data Atom, the table size of the Sample-To-TimeStamp Atom also increases, so that the capacity of the recording medium 86 is further required as compared with the case where encoded data at a fixed frame rate is recorded in an MP4 file. This Sample-To-TimeStamp Atom
Increases in the table size of the MP4 file when the fixed frame rate encoded data is converted into the MP4 file (FIG. 12), and the MP4 file structure diagram of the variable frame rate encoded data (FIG. 12). 1
It is clear from comparison with 5). That is, as shown in FIG. 15, when the encoded data has a fixed frame rate, since the frame interval is always dur = 1, the Sample-To-TimeS
The table element of tamp Atom has one element, and the size of the table does not change.

When converting encoded data of a variable frame rate into an MP4 file, the above-mentioned Sample-To-Time
Stamp Atom can be created using Sample Size Atom and Movie
Unlike the method of creating DataAtom, the number of tables is increased according to the result of determining the input frame by the coding determining means 82. It is impossible to estimate the size.

Also, in the above-mentioned conventional data encoding device,
When converting the encoded data of the variable frame rate into the MP4 file by the MP4 file encoding unit 85,
When the above Sample Size Atom and Movie Data Atom are created, the data is encoded and processed in the mdat atom temporary storage means 46 and the stsz atom temporary storage means 47 in units of one frame of encoded data. Even if an error occurs, data recovery is possible, but Sa
When creating a mple-To-TimeStamp Atom, since the elements of the table are determined when the frame rate changes, if an error occurs in the data encoding device, Table data cannot be completely restored.

Also, the Sample-To-Ti of the MP4 file
A description will be given below of the fact that when the table size of the meStamp Atom becomes large, the amount of processing when reproducing data recorded on the recording medium 86 becomes large.

First, a process of interpreting the Sample-To-TimeStamp Atom and calculating a sample number from an MP4 time stamp or calculating an MP4 time stamp from a sample number is performed. Here, referring to FIG.
A process for obtaining a sample number N corresponding to a given MP4 time stamp (T) from the o-TimeStamp Atom will be described. FIG. 16 is a flowchart showing a series of processes of searching for a sample corresponding to a given MP4 time stamp using the Sample-To-TimeStamp Atom.

First, the MP4 time stamp T is set (step S21), and is included up to the section number index, the MP4 time stamp T0 of the first frame of the section indicated by the section number index, and the section indicated by the section number index. The value of the frame number N0 is initialized (step S22). Then, the number num of frames included in the section indicated by the current index and the frame interval dur are acquired from the Sample-To-TimeStamp Atom (step S).
23) Further, the end time Te of the section indicated by the current index is calculated (step S24). In addition, now i
The end time Te of the section indicated by ndex is T0 + num *
dur.

Then, the current i obtained as described above
The end time Te of the section indicated by ndex is compared with the MP4 time stamp T to determine whether the MP4 time stamp T is included in the section (step S2).
5).

If it is determined in step S25 that T <Te, the MP4 time stamp T is set to the current index.
Is determined to be included in the section pointed by, and the sample number of the MP4 time stamp T is determined (step S2).
7). This sample number is determined because the time up to the section indicated by the current index is the MP4 time stamp T0 of the first frame of the section indicated by the section number index. −T0, and the frame interval du of this section
r, the frame of the sample indicated by the MP4 time stamp T is Ｔ (T−T−T) from the beginning of the section.
0) / dur｝ th frame. Therefore, the sample number N of the frame is N0 + (T−T0) / dur.

On the other hand, in step S25, T> Te
If it is, it is determined that the section indicated by the current index does not include the MP4 timestamp T, and the section moves to the next element of the Sample-To-TimeStamp Atom table (step S26). . That is, the end time Te of the section determined in step S24 is set as the start time T0 of the next section, and the number of elements N0 to the section and the number of frames num of the section are set as the number of elements N0 to the next section. Is set, and the section number index is incremented by one. And after that, it returns to step S23 again,
In step S25, the above-described processing is repeated until T <Te. If the index is equal to or greater than the number of elements in step S26, the MP
4 means that the frame indicated by the time stamp T was not found.

From the above, the Sample-To-TimeStamp At
When the number of elements in the table of om increases, the step S2 is performed until a section including the MP4 time stamp T is searched.
It is necessary to repeat the processing from step 3 to step S26, and MP
From the four time stamps T, it can be seen that the labor required to search for the sample number N of the frame indicated by the MP4 time stamp becomes extremely large. In addition, the process of obtaining the MP4 time stamp T from the sample number N, which is the reverse process described above, is similar to the process described above in that the Samp is used.
The processing amount increases in proportion to the number of elements of the le-To-TimeStamp Atom.

In the data transmission using RTP shown in FIG. 17, no packet retransmission processing is performed, so that packet delay does not accumulate and is suitable for real-time transmission. If a severe disconnection or the like occurs, the packet may be lost and the packet may not reach the data recording device on the receiving side. Due to the nature of RTP, in a data recording device that records the MPEG-4 data received from the RTP transmission means 90 of the base station using RTP as an MP4 file, the transmitted encoded data is lost. Since the possibility is large, and if data is lost, the frame rate of the received encoded data will change frequently, so the Sample-To-TimeStamp Atom which stores the display interval of the frame
There is a problem that the number of tables becomes particularly large.

Further, if the above-mentioned data encoding device or data recording device is mounted on a mobile terminal whose physical size, power consumption, or capacity of a recording medium is significantly restricted, the above-described case will be described. Sample-To-TimeStam
p Increasing the data size of Atom, Sample-To-TimeStamp
Problems such as the difficulty of completely restoring Atom data and the large amount of processing required to reproduce the data can cause various problems.

The present invention has been made in view of the above problems, and when converting MPEG-4 encoded data at a variable frame rate into an MP4 file and recording it, the variable frame rate is changed to a fixed frame rate. It is an object to provide a data conversion device, a data encoding device, and a data recording device for performing conversion.

[0050]

According to a first aspect of the present invention, there is provided a data conversion apparatus for temporarily storing encoded data of input video signal data, and for temporarily storing encoded data of input video signal data. From the encoded data, a time stamp reading unit that reads an input time stamp that is time information of the encoded data, and the input time stamp of the encoded data, the encoded data that is externally input as initial information. Time stamp conversion means for converting to a time stamp based on a fixed frame rate at the time of output, and converting the coded data provided with a time stamp based on the fixed frame rate into coded data at the fixed frame rate And a fixed frame rate conversion means.

According to a second aspect of the present invention, in the data conversion apparatus according to the first aspect, the fixed frame rate conversion means generates encoded data having information indicating non-update. A non-updated frame generating means for adding an arbitrary value as the input time stamp to the encoded data indicating the non-update, and an output time stamp of the encoded data output from the fixed frame rate converting means. Compare the output timestamp with the timestamp based on the fixed frame rate,
According to the result, there is provided processing means for controlling which of the temporary storage means and the non-updated frame creation means is selected, and wherein the processing means determines that the output time stamp is based on the fixed frame rate. When the time stamp is equal to or longer than the time stamp, the output time stamp and the encoded data stored in the temporary storage unit are controlled to be output, and the output time stamp is smaller than the time stamp based on the fixed frame rate. , The output time stamp, and the encoded data indicating the non-update from the non-update frame creating means.

The data conversion device according to the present invention (claim 3)
2. The data conversion device according to claim 1, wherein
The fixed frame rate conversion means must have a size of 0
Create coded data that means that the size is 0
The input time stamp is added to the encoded data
Size 0 frame creating means for assigning an arbitrary value as a
Encoding output from the fixed frame rate conversion means
Determine the output time stamp of the data, and
Time stamp based on the fixed frame rate
And a temporary storage means based on the result.
Or the size 0 frame creation means.
Processing means for controlling whether or not
The output time stamp is based on the fixed frame rate.
If the output time is equal to or greater than the
The stamp and the encoded data stored in the temporary storage
Output time stamp
Is a timestamp based on the fixed frame rate
If smaller, the output timestamp and the size
The size from the size 0 frame creation means is 0
That outputs encoded data that means
It is.

According to a fourth aspect of the present invention, in the data conversion apparatus according to the second aspect, the processing means includes a step of adding a value obtained by adding an arbitrary value to the output time stamp to the fixed frame. When the time stamp is based on the rate or more, the output time stamp and the encoded data stored in the temporary storage unit are controlled to be output, and a value obtained by adding an arbitrary value to the output time stamp is: When the time stamp is smaller than the time stamp based on the fixed frame rate, the output time stamp and the encoded data indicating the non-update from the non-update frame creating means are controlled to be output.

According to a fifth aspect of the present invention, in the data conversion apparatus according to the third aspect, the processing means may be configured such that a value obtained by adding an arbitrary value to the output time stamp is the fixed frame. When the time stamp based on the rate is equal to or more than the time stamp, the output time stamp and the encoded data stored in the temporary storage unit are controlled to be output, and a value obtained by adding an arbitrary value to the output time stamp is: When the time stamp is smaller than the time stamp based on the fixed frame rate, the output time stamp and the encoded data indicating that the size is 0 from the size 0 frame creating means are controlled to be output. .

According to a sixth aspect of the present invention, in the data conversion apparatus according to the second aspect, the fixed frame rate conversion means receives the encoded data output from the temporary storage means. A time stamp, and an encoded data time for rewriting the input time stamp of the encoded data output from the non-updated frame creating means, which means the non-update, based on the output time stamp so that the input time stamp is continuous. It has stamp continuation means.

In the data conversion apparatus according to the present invention (claim 7), in the data conversion apparatus according to claim 3, the fixed frame rate conversion means receives the encoded data output from the temporary storage means. The time stamp and the size from the size 0 frame creation means are 0
The coded data time stamp continuity means for rewriting the input time stamp of the encoded data, which means that the input time stamp is continuous, based on the output time stamp.

A data encoding apparatus according to the present invention (claim 8) fetches input video signal data, and converts the input video signal data into an input time stamp which is time information of the video signal data.
It is determined whether or not to encode the video signal data, according to the determination result, the video signal data, a data encoding device for compression encoding to variable frame rate encoded data in the encoding means, Create coded data having information indicating non-update, assign an arbitrary value to the coded data indicating non-update as the input time stamp, and determine a time stamp based on a fixed frame rate at the time of output. When the determination result is that the video signal data is not coded, the non-updated frame creator outputs the non-updated frame data based on the coded data indicating the non-update and the fixed frame rate. And a time stamp.

The data encoding apparatus according to the present invention (claim 9) fetches the input video signal data and converts the input video stamp into the input time stamp which is time information of the video signal data.
It is determined whether or not to encode the video signal data, according to the determination result, the video signal data, a data encoding device for compression encoding to variable frame rate encoded data in the encoding means, Creates coded data meaning that the size is 0, attaches an arbitrary value to the coded data meaning that the size is 0 as the input time stamp, and sets the value based on a fixed frame rate at the time of output. A size 0 frame generating means for determining a time stamp; and when the determination result indicates that the video signal data is not encoded, a code indicating that the size is 0 is output from the size 0 frame generating means. And outputs a time stamp based on the fixed frame rate.

The data recording device according to the present invention (claim 10) comprises: an RTP receiving means for receiving a transmitted RTP packet; an RTP receiving buffer for temporarily storing the received RTP packet; RTP decoding means for decoding an RTP packet having the same RTP time stamp stored in the RTP packet into encoded data, wherein the encoded data is converted into a standard file format and recorded on a recording medium. In the recording device, the RTP time stamp is obtained from the RTP reception buffer, and is converted into a time stamp based on a fixed frame rate at the time of outputting the encoded data, which is input as initial information from outside. Means and a time stamp based on the fixed frame rate. Fixed frame rate conversion means for converting the encoded data thus obtained into encoded data at the fixed frame rate, wherein the fixed frame rate encoded data output from the fixed frame rate conversion means is a standard It is converted into a file format and recorded on the recording medium.

According to the present invention (claim 11), in the data recording device according to claim 10, the fixed frame rate conversion means creates encoded data having information indicating non-update. A non-updated frame generating means for adding an arbitrary value as the input time stamp to the encoded data indicating the non-updated data; a temporary storage means for temporarily storing the encoded data from the RTP decoding means; An output time stamp of the encoded data output from the rate conversion means is determined, and the output time stamp is compared with a time stamp based on the fixed frame rate. Processing means for controlling which of the update frame creating means is selected, wherein the processing means When the stamp is equal to or greater than the time stamp based on the fixed frame rate, the output time stamp and the encoded data stored in the temporary storage unit are controlled to be output, and the output time stamp is When the time stamp is smaller than the time stamp based on the frame rate, the output time stamp and the coded data indicating the non-update from the non-update frame creating means are controlled to be output.

According to a twelfth aspect of the present invention, in the data recording apparatus according to the tenth aspect, the fixed frame rate converting means creates encoded data meaning that the size is 0. A size 0 frame creating means for adding an arbitrary value as the input time stamp to the encoded data meaning that the size is 0, and a temporary storage for temporarily storing the encoded data from the RTP decoding means. Means for determining an output time stamp of the encoded data output from the fixed frame rate conversion means, comparing the output time stamp with a time stamp based on the fixed frame rate, and as a result, A processing means for controlling which of the storage means and the size 0 frame creating means is selected; Is, the output time stamp,
When the time stamp is equal to or more than the time stamp based on the fixed frame rate, the output time stamp and the encoded data stored in the temporary storage unit are controlled to be output, and the output time stamp is set to the fixed frame rate. If the time stamp is smaller than the base time stamp, the output time stamp and the encoded data indicating that the size is 0 from the size 0 frame creating means are controlled to be output.

According to a thirteenth aspect of the present invention, in the data recording apparatus according to the eleventh aspect, the processing means includes a step of adding a value obtained by adding an arbitrary value to the output time stamp to the fixed frame rate. When the output time stamp is equal to or greater than the time stamp based on
Control to output the encoded data stored in the temporary storage means, and when a value obtained by adding an arbitrary value to the output time stamp is smaller than a time stamp based on the fixed frame rate, the output time stamp is output. When,
The non-updated frame creation means is controlled so as to output the non-updated encoded data.

According to a fourteenth aspect of the present invention, in the data recording apparatus according to the twelfth aspect, the processing means is arranged so that a value obtained by adding an arbitrary value to the output time stamp is the fixed frame rate. The output timestamp is greater than or equal to the timestamp based on
Control to output the encoded data stored in the temporary storage means, and when a value obtained by adding an arbitrary value to the output time stamp is smaller than a time stamp based on the fixed frame rate, the output time stamp is output. When,
The size 0 frame generating means is controlled to output encoded data indicating that the size is 0.

According to a fifteenth aspect of the present invention, in the data recording apparatus according to the eleventh aspect, the fixed frame rate conversion means includes an input time of the encoded data output from the temporary storage means. stamp,
And the input time stamp of the encoded data that means the non-update output from the non-update frame creating means,
An encoded data time stamp continuity means for rewriting based on the output time stamp so that the input time stamp is continuous.

According to a sixteenth aspect of the present invention, in the data recording apparatus according to the twelfth aspect, the fixed frame rate conversion means includes an input time of the encoded data output from the temporary storage means. stamp,
And an encoded data time stamp for rewriting the input time stamp of the encoded data from the size 0 frame creating means, which means that the size is 0, based on the output time stamp so that the input time stamp is continuous. It has continuation means.

[0066]

Embodiments of the present invention will be described below. According to the present invention, when input data is recorded in an MP4 file, the input data is recorded at a fixed frame rate. In the first embodiment, the input data is a variable frame rate MPEG-4 video. Encoded data, in the second embodiment, video data that is not encoded, and in the third embodiment, three types of different data, which are RTP data received by the transmission protocol RTP, will be described as an example. I do.

(Embodiment 1) A data conversion apparatus according to Embodiment 1 will be described below with reference to FIGS. The data conversion device according to the first embodiment converts encoded data of MPEG-4 video with a variable frame rate into
The data is converted into encoded data at a fixed frame rate.

First, the configuration of the data conversion device 100 according to the first embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating a configuration of a data conversion device according to the first embodiment. In the figure, a data conversion device 100
Is composed of encoded data temporary storage means 101, encoded data time stamp reading means 102, time stamp conversion means 103, and fixed FPS means 104.

The coded data temporary storage means 101 stores coded data input to the data conversion apparatus 100, and the coded data time stamp reading means 102 stores the coded data time stamp data in the coded data temporary storage means 101. The coded data time stamp is obtained from the stored coded data.

Here, the acquisition of the coded data time stamp from the coded data is based on the first coded data or the V added before the coded data every several frames.
The scale of the encoded data time stamp (vop-time-increment-resolution) is obtained from the OL header, and the increment (modulo-time-base, modulo-time-base, vop-time-
increment) and performing an appropriate calculation.

The time stamp conversion means 103
The coded data time stamp read by the coded data time stamp reading means 102 is converted into an MP4 time stamp having a common expression format between the embodiments of the present invention. The MP4 time stamp in a common expression format between the embodiments is as follows.
Sample-To-Ti of MP4 file, starting from 0
meStamp This is the time stamp recorded in Atom. Also,
The fixed FPS converting means 104 converts the coded data of the variable frame rate into the coded data of the fixed frame rate.

Here, the configuration of the fixed FPS unit 104 will be described in detail with reference to FIGS. FIG. 2 is a diagram showing the configuration of the fixed FPS conversion means.
FIG. 3 is a diagram showing the configuration of a non-updated frame insertion unit (FIG. 3 (a)), a size 0 frame insertion unit (FIG. 3 (b)), and an encoded data time stamp continuation unit (FIG. 3 (c)). .

2 and 3, the fixed FPS conversion means 104 comprises a non-updated frame insertion means 201, a size 0 frame insertion means 202, and an encoded data time stamp continuation means 203. At the variable frame rate, the time stamp in which the input coded data has been skipped in the past, for example, the MP4 time stamps 1, 3, and 5 of the coded data having the variable frame rate shown in FIG.
..., imaginary frames are inserted into the coded data at a fixed frame rate.

The non-updated frame insertion means 201 in the fixed FPS conversion means 104 includes a processing means 311 for outputting a switching signal of the switch 314, a non-updated frame generation means 312 for generating a non-updated frame, A temporary storage unit 313 for storing data held in the data temporary storage unit 101, and a switch 314 for selecting either the non-updated frame generation unit 312 or the temporary storage unit 313. , A non-update frame, which is a special sample meaning non-update, is inserted. Here, the non-updated frame is coded data that does not include the difference information of the video signal from the previous frame, for example, vop_coded in the VOP header.
Is a frame in which is set to 0. Then, the non-updated frame does not include the difference information of the video signal (for example,
Since vop_coded = 0), the data amount is several tens of bytes, which is smaller than the data amount of a normal encoded frame. The non-updated frame also has an encoded data time stamp field as in the case of a normal frame, and the non-updated frame insertion means 201 can add any value to this field. In this non-updated frame, vop_coded = 0 depending on the presence / absence of shape encoding and the presence / absence of a transparency channel.
Does not mean non-update, but in this case, a frame in which all macroblocks are in the MB_not_coded state is output.

Further, in the fixed FPS conversion means 104,
The size 0 frame insertion unit 202 includes a processing unit 321 that outputs a switching signal of the switch 324 and a size 0 frame generation unit 322 that generates a size 0 frame.
And a temporary storage means 323 for storing the encoded data held in the encoded data temporary storage means 101, and a switch 324 for selecting either the size 0 frame generation means 322 or the temporary storage means 323. In addition, a size 0 frame, which is a sample of size 0, is inserted as the imaginary frame described above. Here, the size 0 frame refers to a frame having a data size of 0 and having no meaningful value in the encoded data.

Then, the coded data time stamp continuation means 203 in the fixed FPS conversion means 104 is
The coded data time stamp of the coded data output from the non-updated frame insertion means 201 and the size 0 frame insertion means 202 is changed from the non-updated frame or the size 0 frame MP4 time stamp to a correct code according to the coded data standard. A coded data time stamp rewriting means 331 for converting the data into a coded data time stamp and overwriting it, and a temporary storage means 332 for storing the coded data output from the means 201 and 202 and the coded data amount. Things.

Normally, the MP4 recorded on the recording medium 120
When decoding a file, the decoding is performed with reference to only the MP4 time stamp. Therefore, there is no problem if the value of the encoded data time stamp of the frame is any value. When creating a file or the like, the file cannot be created unless the encoded data timestamp of the encoded data is correct, so the encoded data timestamp must be re-attached. The coded data time stamp continuation unit 203 converts the coded data time stamp attached to the frame in advance into a correct coded data time stamp, assuming that the file described above is created from the MP4 file. Is performed.

The MP4 file encoding means 110,
Since the recording medium 120 has the same configuration as that described in the conventional data encoding device, the description is omitted here.

Hereinafter, the data conversion apparatus 10 according to the first embodiment having the above-described configuration with reference to FIGS.
A series of processing operations of 0 will be described. For the sake of simplicity, in the first embodiment, the coded data input to the device is an I-VOP or a P-VO.
It is assumed that there is only P. FIG. 4 is a flowchart showing a series of operations of the non-updated frame inserting means or the size 0 frame inserting means in the first embodiment.

First, when the processing in the data conversion apparatus 100 is started, the encoded data temporary storage means 101
Holds encoded data. Then, the encoded data time stamp reading unit 102 acquires the encoded data time stamp from the encoded data stored in the encoded data temporary storage unit 101. As described above, the coded data time stamp is obtained from the first coded data or the VOL header added every several frames before the coded data, as described above. time-increment-res
olution), and the VOP of each encoded data
From the header, the increment of the encoded data time stamp (mo
dulo-time-base, vop-time-increment), and calculate by appropriate calculation. Then, the encoded data is converted into an MP4 time stamp by the time stamp converting means 103 and output to the fixed FPS converting means 104 together with the encoded data stored in the encoded data temporary storing means 101 and its data size.

The above encoded data, data size, MP4
The fixed FPS conversion means 104 which has obtained the time stamp,
According to the flowchart shown in FIG. 4, the encoded data at the variable frame rate is converted into encoded data at the fixed frame rate. First, the input encoded data, the encoded data amount, and the MP4 time stamp ITS of the input frame are either the non-updated frame inserting means 201 or the size 0 frame inserting means 202 in the fixed FPS converting means 104. Is entered.

First, the non-updated frame inserting means 201
Next, the case where the encoded data, the encoded data amount, and the MP4 time stamp are input will be described. When the processing is started in the data conversion apparatus 100, the processing unit 311 of the non-updated frame insertion unit 201 sets the MP4 time stamp OTS of the held output frame.
Is initialized and externally input as initial conditions.
Acquire the request time stamp interval DTS (step S
41). Then, the encoded data temporary storage means 101
When the MP4 time stamp is input from the time stamp conversion unit 103, the encoded data and the data size are stored in the temporary storage unit 313, and the MP4 time stamp Is the MP4 timestamp IT of the input frame
S is input to the processing means 311 (step S4
2). Then, in the processing means 311, Step S 4
MP4 time stamp IT of the input frame obtained in step 2
S is compared with the MP4 time stamp OTS of the output frame held in the processing unit 311 (step S
43).

In step S43, ITS ≦ OTS
If it is, the processing unit 311 sends the temporary storage unit 313
A switching signal is output so as to select the encoded data and the MP4 time stamp ITS of the encoded data stored in the temporary storage means 313 and the processing means 3
The output frame 31 is rewritten as the MP4 time stamp OTS of the output frame and output (step S44).
Then, after that, the request time stamp interval DTS is added to the MP4 time stamp of the output frame held by the processing unit 311 and the MP4 time stamp of the next output frame is added.
4 timestamps OTS.

On the other hand, in step S43, ITS ≧
In the case of an OTS, a switching signal is output from the processing unit 311 so as to select the non-updated frame generation unit 312, and the non-updated frame generated by the non-updated frame generation unit 312 and the processing unit 331 hold the non-updated frame. And output the MP4 time stamp OTS of the output frame. Then, as described above, the processing means 311
The request time stamp interval DTS is added to the MP4 time stamp of the output frame held in the step (1) to obtain the MP4 time stamp OTS of the next output frame.

After the above processing, the encoded data output from the non-updated frame insertion means 201 is finally recorded in the MP4 file on the recording medium 120.
After the recording on the recording medium 120, when using the MP4 file such as taking out only the encoded data from the MP4 file and creating a unique file of the encoded data alone, the code recorded in the MP4 file is used. Since all of the encoded data require correct encoded data time stamps, the encoded data time stamp continuation unit 203 is selected, and the encoded data time stamp rewriting unit 331 outputs the encoded data time stamp. The data time stamp is converted into a correct encoded data time stamp by using the MP4 time stamp, and the encoded Created by data time stamp rewriting means 331 It performs a process of overwriting the correct coded data time stamp. If it is not necessary to set the coded data time stamp to a correct value as described above, the non-updated frame insertion unit 2 can be used without selecting the coded data time stamp continuation unit 203.
What is necessary is just to output the encoded data, the encoded data amount, and the MP4 timestamp output from 01.

Then, the encoded data, encoded data amount, and M
The P4 time stamp is output to the MP4 file encoding unit 110, and the MP4 file encoding unit 110
, The encoded data is converted to an MP4 file by performing the same
Record in P4 file.

Here, the structure of the encoded data and the MP4 file obtained by passing through the non-updated frame inserting means 201 will be described with reference to FIGS. 5 and 12. FIG. 5 shows encoded data (FIG. 5) when an MP4 file is recorded via a non-updated frame inserting unit.
(a)) and the data structure of the MP4 file (FIG. (b)).

As shown in FIG. 5, the data converter 1
00, the encoded data converted to the fixed frame rate has a constant time stamp time interval as compared with the conventional variable frame rate shown in FIG. It turns out to be one. However, since a non-updated frame is added as a non-updated frame at the MP4 time stamp which has been skipped in the past, the Movie data Atom
And the Sample Size Atom becomes larger.

As described above, Sample-To-TimeSt
Since the element of amp Atom is always one, it is easy to calculate the frame number from the MP time stamp or the MP time stamp from the frame number.

For example, if the MP4 time stamp is T, the frame number is N, and the frame interval dur is d, then T =
Since the relation d * N holds, the calculation of the frame number from the MP4 time stamp is N = T / d, and the calculation and derivation of the MP4 time stamp from the frame number is T
= D * N, it can be calculated by only one division or multiplication.

In the fixed FPS conversion means 104, the coded data and the data size MP4 time stamp output from the respective means 201 and 202 are transmitted through the coded data time stamp continuation means 203 regardless of whether they pass through the coded data time stamp continuation means 203. This is the same without affecting the data structure of the MP4 file. This is because the MP4 time stamp of the MP4 file is determined irrespective of the encoded data, and there is no problem in the standard.

Next, the size 0 frame inserting means 20
2, the encoded data, the encoded data amount, and MP4
The case where a time stamp is input will be described. In this case as well, the processing is performed according to the flowchart of FIG. The difference from the non-updated frame insertion means 201 is that the non-updated frame insertion means 201 inserts a frame having a size of 0 into the place where the non-updated frame was inserted.

Here, the structure of the encoded data and the MP4 file obtained by passing through the size 0 frame inserting means 202 will be described with reference to FIGS. 6 and 12. FIG. 6 shows encoded data (see FIG. 6) when an MP4 file is recorded via the size 0 frame insertion means.
(a)) and the data structure of the MP4 file (FIG. (b)).

As shown in FIG. 6, the data converter 1
As a result, the encoded data converted to the fixed frame rate has one Sample-To-TimeStamp Atom element compared to the encoded data of the conventional variable frame rate shown in FIG. Also, unlike the above-mentioned non-updated frame inserting means 201, a frame having a size of 0 is inserted and encoded data is not added.
The table size of ta Atom is the same as the conventional variable frame rate encoded data. However, the above Sample Siz
Regarding the table size of e Atom, as shown in the above-mentioned non-updated frame insertion means 201, a table size indicating that the size is 0 is added. Become.

The non-updated frame inserting means 201
Similarly to the above, since the element of the Sample-To-TimeStamp Atom is always one, the calculation of the frame number from the MP time stamp or the calculation of the MP time stamp from the frame number is simplified. Note that the non-updated frame insertion means 2
As in the case of 01, whether or not the fixed FPS conversion unit 104 has passed through the encoded data time stamp continuation unit 203 does not affect the data structure of the MP4 file.

As is clear from the above description, the encoded data, the encoded data amount, and the MP4 time stamp are input to either the non-updated frame rate inserting means 201 or the size 0 frame inserting means 202. However, the same effect of converting encoded data at a variable frame rate into encoded data at a fixed frame rate can be obtained. However, the size 0 frame insertion means 202
, The size 0 frame is inserted, so that decoding may not be possible depending on the decoding device. Therefore, when data portability is important,
What is necessary is just to input to the non-updated frame rate insertion means 201.

As described above, according to the first embodiment,
Conventionally, when the input variable-frame-rate MPEG-4 encoded data is recorded in the MP4 file on the recording medium 120, the variable-frame-rate encoded data is passed through the fixed-FPS conversion unit 104. A non-updated frame or a size 0 frame is inserted at the skipped MP4 time stamp, converted to encoded data at a fixed frame rate, and then converted to an MP4 file by the MP4 file encoding means 110, and the above-described recording is performed. Since the MP4 file is recorded on the medium 120, the Sample-To-TimeStamp Atom is
As in the case of the fixed frame rate, the number can be one. As a result, the table size of the Sample-To-TimeStamp Atom is not affected by the encoded data. , MP
The data of four files can be completely restored.

Since the sample size of the Sample-To-TimeStamp Atom is constant, the recording medium 120
Processing for reproducing data recorded in four files can be reduced. Furthermore, the data conversion device 100 according to the first embodiment has a physical size, power consumption,
Alternatively, even if the recording medium is mounted on a mobile terminal whose storage capacity is extremely limited and an MP4 file is recorded on a recording medium in the mobile terminal, the Sample-To-TimeStamp At
Since the elements of the om table are fixed to one, various problems caused by a shortage of the recording medium in the mobile terminal do not occur.

In the description of the first embodiment, the condition for determining whether to output the input coded data or to insert the non-updated frame or the size 0 frame in step S43 of FIG. Although ITS ≦ OTS, usually, the input time stamp ITS given to the encoded data input to the data encoding device does not exactly match a multiple of the required time stamp interval DTS, and fluctuates back and forth, that is, ITS = n * OTS ± α (n: integer)
Becomes Here, α indicates a fluctuation component.

The cause of the fluctuation is that the frame interval of the TV signal of the NTSC system is 1001/30000 =
0.0333636666 seconds (29.970029 H
z), which is an indivisible number, so that when creating encoded data, rounding is performed for the convenience of each device. The rounding method (rounding, rounding down, rounding up) and the number of digits of the frame interval depend on each device, and the information cannot be known at the time of MP4 recording.

Hereinafter, a case where the fluctuation occurs for the above-described reason will be described with reference to FIG. FIG.
FIG. 4A is a diagram showing a state in which a time stamp ITS given to an input frame fluctuates slightly back and forth. FIG.
This is the case of TS + DTS / 2. Here, it is assumed that the request time stamp interval DTS = 100.

As shown in FIG. 7A, when the judgment condition is IT
When S ≦ OTS, if the ITS fluctuates to a smaller value than the OTS, such as the (n−1) th frame, the (n−1) th frame will have the correct OTS (= 800).
Although it is determined that the ITS does not matter, as in the case of the n-th frame, if the ITS fluctuates slightly larger than the OTS, the n-th frame becomes a frame of the correct OTS (= 900). Therefore, the frame is determined as the next OTS (= 1000) frame.

In such a case, if the determination condition in step S43 of FIG. 4 is ITS ≦ OTS + DTS / 2, as shown in FIG.
The fluctuation which is determined as a frame of TS (= 900) and which occurs for the above-described reason can be eliminated before data conversion and MP4 recording on the recording medium 120. Here, as an example of the determination condition, DTS is added to the OTS.
Compared to the sum of TS / 2, DT
A fixed value other than S / 2 may be added.

(Embodiment 2) A data encoding apparatus according to Embodiment 2 will be described below with reference to FIG. In the first embodiment, the data conversion apparatus for converting the coded data of the variable frame rate MPEG-4 video into the coded data of the fixed frame rate has been described. The following describes a data encoding device that receives an unencoded video signal from the input device, encodes the video signal into encoded data at a fixed frame rate, and records the MP4 file.

First, the configuration of data encoding apparatus 200 according to the second embodiment will be described with reference to FIG.
FIG. 8 is a diagram illustrating a configuration of a data encoding device according to the second embodiment. In FIG. 8, a data encoding device 200 is the same as the conventional data encoding device shown in FIG. , To determine whether to encode, based on the determination result,
It is assumed that a switch selection signal for selecting either the encoding unit 83 or the non-updated frame creating unit 84 is output. In addition,
The other configuration is the same as that of the conventional data encoding device, and the description is omitted here.

The non-updated frame generating means 84 generates the non-updated frame described in the first embodiment,
4 time stamp is inserted. It should be noted that the coded data time stamp of the non-updated frame is given an arbitrary value in the non-updated frame creation means 84 as in the first embodiment.

The processing operation of data encoding apparatus 200 according to the second embodiment will be described below. First, the data encoding device 200 converts a video input from a camera into a frame by the video capturing means 81, and converts the frame with a frame number that increases at the frame rate of the camera from the start of capturing the video. , To the encoding determination means 82.

The encoding determining means 82 calculates the MP4 time stamp of the input frame from the frame number and the predetermined frame information of the camera, and calculates the time stamp and the code It is determined whether or not the input frame is to be encoded based on the totalized data amount and the output bit rate. Up to this point, it is the same as the conventional one.

When the encoding determination means 82 determines that the input frame is to be encoded, the encoding determination means 82 outputs a switch selection signal for selecting the encoding means 83, and outputs a switch selection signal from the camera. The encoded frame and the time stamp of the frame are
Output to After the encoding unit 83 performs the encoding process on the frame, the encoded data, the encoded data amount, and the MP4 time stamp are output to the MP4 file encoding unit 110.

On the other hand, in the encoding judgment means 82,
If it is determined that the frame is not to be encoded, the encoding determination unit 82 outputs a switch selection signal for selecting the non-updated frame creation unit 84, and the non-updated frame creation unit 84 creates a non-updated frame. The MP4 time stamp of the non-updated frame is inserted, and the non-updated frame, the size of the non-updated frame, and the MP4 time stamp are output to the MP4 file encoding unit 110. The non-updated frame is the same as that described in the first embodiment.

Then, the MP4 file encoding means 1
In 10, the encoded data or the non-updated frame output from the encoding means 83 or the non-updated frame creating means 84 is converted into an MP4 file and recorded on the recording medium 120 in an MP4 file (see FIG. 5). .

In the above description, the non-updated frame generation unit 84 converts the non-updated frame to the MP4 time stamp where the data has been skipped in the past, according to the determination by the encoding determination unit 82. However, instead of the non-updated frame creating means 84, a size 0 frame having a size of 0 is created, and M
A size 0 frame creating means for inserting a P4 time stamp may be provided (not shown). in this case,
According to the determination by the encoding determination unit 82, a frame of size 0 is inserted at the MP4 time stamp where data has been skipped in the past, and the same effect as in the case of the non-updated frame rate creation unit 84 described above. Is obtained (see FIG. 6). However, when the encoded data in which the size 0 frame is inserted is converted into an MP4 file by the size 0 frame creating means and recorded on the recording medium 120, the size of the MP4 file obtained by the non-updated frame creating means 84 is smaller than that of the MP4 file. Although it has the advantage of being smaller, it may not be possible to decode the MP4 file depending on the decoding device. Therefore, when the portability of data is emphasized, the above-mentioned non-updated frame creating means 84 is provided.

When a file or the like containing only encoded data is created from the MP4 file recorded on the recording medium 120, the file may be created if the encoded data time stamp of the encoded data is not correct. Since it is not possible to create such a file or the like from an MP4 file, the encoding means 83 or the non-updated frame creation means 84 (or size 0 frame creation means) and the MP4 file encoding means 110
Between the encoding unit 83 and the non-updated frame creation unit 84, the encoded data time stamp continuation unit 203 described in the first embodiment is further provided. It is preferable to perform a process of converting the encoded time stamp into a correct encoded data time stamp using the MP4 time stamp and overwriting the data.

As described above, according to the second embodiment,
When encoding a video signal input from a camera, if the encoding determination unit 82 determines that encoding is to be performed, the input video signal is encoded by the encoding unit 83 and not encoded. The non-updated frame creation means 8
Since the non-updated frame or the size 0 frame is created and inserted by the 4 or size 0 frame creating means (not shown), the data is converted into the MP4 file by the MP4 file
When recording an MP4 file on the recording medium 120, the Sample-T
o-TimeStamp Atom can be one as in fixed frame rate, so that Sample-To-TimeStamp
Since the table size of the amp Atom is not affected by the encoded data, even if an error occurs in the data encoding device 200, the data of the MP4 file can be completely restored.

Since the sample size of the Sample-To-TimeStamp Atom is constant, the recording medium 120
Processing for reproducing data recorded in four files can be reduced. Furthermore, even if the data encoding device 200 according to the second embodiment is mounted on a mobile terminal whose physical size, power consumption, and capacity of a recording medium are extremely limited, the table of the Sample-To-TimeStamp Atom Are fixed to one, so that various problems caused by a shortage of the capacity of the recording medium 120 and the like do not occur.

(Embodiment 3) A data recording apparatus according to Embodiment 3 will be described below with reference to FIG. In the first embodiment, the data conversion apparatus for converting the encoded data of the variable frame rate MPEG-4 video into the encoded data of the fixed frame rate has been described. A description will be given of a data recording apparatus that receives and decodes MPEG-4 data transmitted using RTP (Real Time Transport Protocol), and records the MP4 file on a recording medium.

First, the configuration of the data recording device 300 according to the third embodiment will be described with reference to FIG. FIG. 9 shows a data recording device 300 according to the third embodiment.
FIG. In FIG. 9, a data recording device 300 is different from the conventional data recording device shown in FIG.
P time stamp conversion means 94, fixed FPS conversion means 1
04, and the RTP time stamp conversion means 94 converts the RTP time stamp, which is the time stamp of the RTP packet acquired by the RTP decoding means 83, into an expression format common to the embodiments of the present invention. Is converted to an MP4 time stamp. Here, the MP4 having the common expression format between the embodiments of the present invention is referred to.
The time stamp is a time stamp recorded in the Sample-To-TimeStamp Atom of the MP4 file in a format starting from 0.

The conversion of the RTP time stamp into the MP4 time stamp by the RTP time stamp conversion means 94 is performed by adding a random offset to the RTP time stamp as described in the conventional data recording apparatus. This offset is subtracted from the RTP time stamps of all the RTP packets, so that the time stamp of the head encoded data starts from 0, and the scale of the RTP time stamp becomes the scale of the MP4 time stamp common to the present invention. As described above, the multiplication and division are performed.

The fixed FPS converting means 104 has the same configuration as that described in the first embodiment with reference to FIGS. 2 and 3, and other components of the data recording apparatus. The configuration has the same configuration as that of the conventional data recording apparatus, and thus the description is omitted here.

Hereinafter, a series of processing operations of the data recording apparatus 300 according to the third embodiment having the above-described configuration will be described. In the third embodiment, the data recording device 300 is described as being a mobile terminal. However, the data recording device 300 is not limited to the mobile terminal and receives data from a transmitting station using RTP. , MP
What is necessary is just to record four.

First, from the RTP transmitting means 90 of the base station,
The MPEG-4 encoded data is divided into video packet units, and the RTP packets storing the respective video packets are received by the RTP receiving means 91 of the data recording device. An appropriate number of RTP packets received by the RTP receiving means 91 are stored in the RTP reception buffer 9.
2 is temporarily stored.

In the RTP receiving buffer 92, the RTP packets are eliminated by rearranging the phenomenon that the RTP packets are rearranged during transmission, or one frame of encoded data is divided into a plurality of RTP packets and transmitted. In this case, the packet is held until packets for one frame or more are accumulated. The RTP packet extracted from the RTP reception buffer 92 is decoded into MPEG-4 data by the RTP decoding means 93, and the encoded data and the encoded data amount are output to the fixed FPS conversion means 104. An RTP time stamp is obtained from the RTP packet, and the obtained RTP time stamp is output to the RTP time stamp conversion means 94.

The RTP time stamp output to the RTP time stamp conversion means 94 is converted to an MP4 time stamp as described above, and output to the fixed FPS conversion means 104. After this, the fixed FPS conversion means 10
4 and MP4 file encoding means 110
Is the same as that described in the first embodiment, and a description thereof will not be repeated.

As described above, according to the third embodiment,
RTP transmitted from the RTP transmission means 90 using RTP (Real Time Transport Protocol)
The RTP receiving means 91 receives the MPEG-4 data stored in the packet, and the RTP decoding means 93 decodes the RTP packet into MPEG-4 data and obtains an RTP time stamp. At 94, the RTP time stamp is converted into an MP4 time stamp. Get a stamp,
A non-updated frame or a size 0 frame is inserted at the MP4 time stamp which has been skipped in the related art, and the data is converted into encoded data at a fixed frame rate.
Since the P4 file is converted and the MP4 file is recorded on the recording medium 120, the Sample-To-TimeStamp At
om can be reduced to one as in the case of the fixed frame rate, and as a result, the table size of the Sample-To-TimeStamp Atom is not affected by the encoded data, so that an abnormality occurs in the data recording apparatus 300. Even in this case, the data of the MP4 file can be completely restored.

Further, since the sample size of the Sample-To-TimeStamp Atom is constant, the recording medium 120
Processing for reproducing data recorded in four files can be reduced. Furthermore, the data recording device 300 according to the third embodiment is different from the data recording device 300 in physical size and power consumption.
Even if it is installed in a mobile terminal where the capacity of the recording medium is extremely limited, since the elements of the table of the Sample-To-TimeStamp Atom are fixed to one, various causes caused by a shortage of the capacity of the recording medium 120, etc. Problems do not arise.

In the third embodiment, the conditions for determining whether to output encoded data obtained by decoding the RTP packet transmitted from the transmitting station, or to insert a non-updated frame or a size 0 frame are as follows. ITS ≦ OT
However, as in the first embodiment, the input time stamp ITS given to the RTP packet normally does not exactly match the multiple of the request time stamp interval DTS and fluctuates back and forth, as in the first embodiment. In such a case, the determination condition is set to I
By setting TS ≦ OTS + DTS / 2, it is possible to eliminate the fluctuation that occurs for the above-mentioned reason before MP4 recording on the recording medium 120. Here, as an example of the determination condition, a comparison is made with a value obtained by adding DTS / 2 to OTS, but a fixed value other than DTS / 2 may be added.

[0127]

As described above, according to the data converter of the first aspect of the present invention, the temporary storage means for temporarily storing the encoded data of the input video signal data and the temporary storage means A time stamp reading unit that reads an input time stamp, which is time information of the encoded data, from the stored encoded data; and a code that receives the input time stamp of the encoded data from outside as initial information. Timestamp converting means for converting the encoded data into a timestamp based on a fixed frame rate when outputting the encoded data, and encoding the encoded data with the timestamp based on the fixed frame rate into the fixed frame rate. Fixed frame rate conversion means for converting to data, so input at a variable frame rate Encoded data can be converted to encoded data of a fixed frame rate, as a result,
When the encoded data is recorded in a standard file format, the effect of improving the convenience of the encoded data can be expected, for example, the seek processing of the encoded data is simplified.

According to the data conversion apparatus of the present invention, in the data conversion apparatus of the first aspect, the fixed frame rate conversion means includes a coding unit having information indicating non-update. A non-updated frame generating means for generating data and assigning an arbitrary value as the input time stamp to the encoded data indicating the non-update, and an output time stamp of the encoded data output from the fixed frame rate converting means. Determining, comparing the output timestamp with the timestamp based on the fixed frame rate, and, based on the result, controlling which of the temporary storage means and the non-updated frame creation means is selected Means, wherein the processing means determines that the output time stamp is equal to or greater than a time stamp based on the fixed frame rate. When the output time stamp and the encoded data stored in the temporary storage means are output, the output time stamp is smaller than the time stamp based on the fixed frame rate. Since the stamp and the encoded data indicating the non-update from the non-updated frame creating means are controlled to be output, the encoded data of the variable frame rate is converted into encoded data of the fixed frame rate which is portable. Can be converted.

According to the data converter of the third aspect of the present invention, in the data converter of the first aspect, the fixed frame rate converter has a size of 0.
A size 0 frame generating means for generating encoded data meaning that the size is 0, and adding an arbitrary value as the input time stamp to the encoded data meaning that the size is 0; Determining an output timestamp of the encoded data output from the means, comparing the output timestamp with a timestamp based on the fixed frame rate, and, based on the result, the temporary storage means and the size 0 frame Processing means for controlling which of the creation means to select, the processing means, when the output time stamp is equal to or greater than the time stamp based on the fixed frame rate, the output time stamp, Control to output the encoded data stored in the temporary storage means, and the output time stamp is It is smaller than the time stamp based on a constant frame rate, and the output time stamp,
Since the control is performed so as to output the encoded data meaning that the size is 0 from the size 0 frame creating means, the encoded data of the variable frame rate is converted into the encoded data of the fixed frame rate. Can be. Further, when the encoded data is recorded on a recording medium or the like in a standard file format, the capacity required for the recording can be reduced.

According to the data conversion device of the present invention, in the data conversion device of the present invention, the processing means may include a value obtained by adding an arbitrary value to the output time stamp. When the time stamp is equal to or greater than the time stamp based on the fixed frame rate, the output time stamp and the encoded data stored in the temporary storage unit are controlled to be output, and an arbitrary value is added to the output time stamp. When the calculated value is smaller than the time stamp based on the fixed frame rate, the output time stamp and the coded data indicating the non-update from the non-update frame creating unit are controlled so as to be output. The fluctuation of the time stamp given to the given video data can be eliminated by the processing means.

According to the data converter of claim 5 of the present invention, in the data converter of claim 3, the processing means is configured to add a value obtained by adding an arbitrary value to the output time stamp. When the time stamp is equal to or greater than the time stamp based on the fixed frame rate, the output time stamp and the encoded data stored in the temporary storage unit are controlled to be output, and an arbitrary value is added to the output time stamp. When the calculated value is smaller than the time stamp based on the fixed frame rate, the output time stamp and the coded data indicating that the size is 0 from the size 0 frame generating means are output. Therefore, the fluctuation of the time stamp given to the input video data can be eliminated by the processing means.

According to the data conversion device of the present invention, in the data conversion device of the present invention, the fixed frame rate conversion means may include the code output from the temporary storage means. The input time stamp of the encoded data and the input time stamp of the encoded data output from the non-updated frame creating means, which means the non-update, are rewritten based on the output time stamp so that the input time stamps are continuous. Since the coded data time stamp continuation means is provided, it is possible to compensate for an error in the input time stamp attached to the coded data, and to generate coded data having a continuous input time stamp. As a result, from the data output from the fixed frame rate conversion means, a file containing only encoded data It is possible to create.

According to the data converter of claim 7 of the present invention, in the data converter of claim 3, the fixed frame rate conversion means is configured to output the code output from the temporary storage means. The input time stamp of the encoded data and the input time stamp of the encoded data from the size 0 frame creating means, which means that the size is 0, are set so that the input time stamps are continuous.
The coded data time stamp continuation means for rewriting based on the output time stamp is provided, so that the erroneous input time stamp added to the coded data is compensated, and the coded data having the continuous input time stamp is compensated. Can be created. As a result, a file or the like containing only encoded data can be created from the data output from the fixed frame rate converter.

According to the data encoding device of the present invention, the input video signal data is taken in, and the video signal data is converted from the input time stamp which is the time information of the video signal data. In a data encoding device that determines whether or not to encode and, according to the determination result, compresses and encodes the video signal data into encoded data of a variable frame rate by an encoding unit, this means non-update. Non-updated frame generating means for generating encoded data having information, adding an arbitrary value as the input time stamp to the encoded data indicating non-update, and determining a time stamp based on a fixed frame rate at the time of output. Prepared,
When the determination result indicates that the video signal data is not to be encoded, the non-updated frame generating means outputs encoded data indicating the non-update and a time stamp based on the fixed frame rate. Therefore, due to the processing delay in the encoding means, the data cannot be encoded, and the data is skipped. Can be compressed and encoded into encoded data. As a result, when encoded data is recorded in a standard file format, seeking of encoded data can be simplified. The effect can be expected.

According to the data encoding apparatus of the ninth aspect of the present invention, the input video signal data is fetched, and the video signal data is converted from the input time stamp which is the time information of the video signal data. It is determined whether or not to perform encoding, and according to the determination result, the size is 0 in a data encoding apparatus that compresses and encodes the video signal data into encoded data having a variable frame rate by an encoding unit. Coded data meaning that the size is 0, an arbitrary value is added to the coded data meaning that the size is 0 as the input time stamp, and a time stamp based on a fixed frame rate at the time of output is determined. When the determination result is that the video signal data is not encoded, the size 0 frame generating unit includes: Since the coded data meaning that the size is 0 and the time stamp based on the fixed frame rate are output, the data cannot be coded due to the processing delay in the coding means and the like, and the skip is performed. Video signal data that has been compressed and encoded into variable frame rate encoded data can be compressed and encoded into fixed frame rate encoded data. As a result, the encoded data is recorded in a standard file format. In this case, the effect of improving the convenience of the encoded data can be expected, for example, the seek processing of the encoded data is simplified. Further, when the encoded data is recorded on the recording medium in a standard file format, the capacity required for the recording can be reduced.

According to the data recording apparatus of the present invention, an RTP receiving means for receiving the transmitted RTP packet, an RTP receiving buffer for temporarily storing the received RTP packet, R which decodes RTP packets having the same RTP time stamp stored in the RTP reception buffer into encoded data
A data recording device for converting the encoded data into a standard file format and recording the encoded data on a recording medium, obtaining the RTP time stamp from the RTP reception buffer, The time stamp conversion means for converting the encoded data into a time stamp based on the fixed frame rate when outputting the encoded data, and the encoded data with the time stamp based on the fixed frame rate,
Fixed frame rate conversion means for converting to the fixed frame rate coded data, the fixed frame rate coded data output from the fixed frame rate conversion means, to convert to a standard file format, Since the data is recorded on the recording medium, when the encoded data transmitted in the RTP packet is converted into the standard file format and recorded, the data is skipped because the RTP packet is lost during the transmission. After converting the encoded data of the variable frame rate into encoded data of the fixed frame rate, the encoded data can be recorded in a standard file format, and as a result, the seek processing of the encoded data can be simplified. The effect of improving convenience can be expected.

According to the data recording apparatus of the present invention, in the data recording apparatus of the present invention, the fixed frame rate conversion means may include an encoding unit having information indicating non-update. Non-updated frame creating means for creating data and adding an arbitrary value as the input time stamp to the encoded data indicating the non-update, and temporary storage means for temporarily storing the encoded data from the RTP decoding means And an output time stamp of the encoded data output from the fixed frame rate conversion means, and compares the output time stamp with a time stamp based on the fixed frame rate. Means, and processing means for controlling which of the non-updated frame creating means is selected,
The processing means controls the output time stamp and the encoded data stored in the temporary storage means to be output when the output time stamp is equal to or more than the time stamp based on the fixed frame rate, When the output time stamp is smaller than the time stamp based on the fixed frame rate, control is performed so as to output the output time stamp and the coded data indicating the non-update from the non-update frame creating means. , The encoded data of the variable frame rate can be converted to encoded data of a fixed frame rate that is portable.

According to the data recording apparatus of the twelfth aspect of the present invention, in the data recording apparatus of the tenth aspect, the fixed frame rate converting means has a code meaning that the size is zero. Means for creating encoded data, adding an arbitrary value as the input timestamp to the encoded data meaning that the size is 0, and the encoded data from the RTP decoding means. Temporary storage means for temporarily storing, and determining an output time stamp of the encoded data output from the fixed frame rate conversion means, comparing the output time stamp with a time stamp based on the fixed frame rate, A processing unit that controls which of the temporary storage unit and the size 0 frame creation unit is selected based on the result; The processing means controls the output time stamp and the encoded data stored in the temporary storage means to be output when the output time stamp is equal to or more than the time stamp based on the fixed frame rate, When the output timestamp is smaller than the timestamp based on the fixed frame rate,
Since the output time stamp and the coded data indicating that the size is 0 from the size 0 frame generating means are controlled to be output, the coded data having the variable frame rate is converted to the code having the fixed frame rate. Data. Further, when the encoded data is recorded on the recording medium in a standard file format, the capacity required for the recording can be reduced.

According to a data recording device of the present invention, in the data recording device of the present invention, the processing means may include a value obtained by adding an arbitrary value to the output time stamp. When the time stamp is equal to or greater than the time stamp based on the fixed frame rate, the output time stamp and the encoded data stored in the temporary storage unit are controlled to be output, and an arbitrary value is added to the output time stamp. When the calculated value is smaller than the time stamp based on the fixed frame rate, the output time stamp and the coded data indicating the non-update from the non-updated frame creating means are controlled so as to be transmitted. The fluctuation of the time stamp given to the given RTP packet can be eliminated by the processing means.

According to the data recording device of the present invention, in the data recording device of the twelfth aspect, the processing means may include a value obtained by adding an arbitrary value to the output time stamp. When the time stamp is equal to or greater than the time stamp based on the fixed frame rate, the output time stamp and the encoded data stored in the temporary storage unit are controlled to be output, and an arbitrary value is added to the output time stamp. When the calculated value is smaller than the time stamp based on the fixed frame rate, the output time stamp and the coded data indicating that the size is 0 from the size 0 frame generating means are output. Therefore, the above processing means should eliminate the fluctuation of the time stamp given to the transmitted RTP packet. It can be.

According to the data recording apparatus of the present invention, in the data recording apparatus of the present invention, the fixed frame rate converting means may include the code output from the temporary storing means. The input time stamp of the encoded data and the input time stamp of the encoded data output from the non-updated frame creating means, which means the non-update, are rewritten based on the output time stamp so that the input time stamps are continuous. Since coded data time stamp continuation means is provided,
By compensating for the error of the input time stamp attached to the encoded data, encoded data having a continuous input time stamp can be created, and as a result, a standard file format recorded on the recording medium can be obtained. From the converted data, it is possible to create a file or the like containing only encoded data.

According to the data recording apparatus of the present invention, in the data recording apparatus of the twelfth aspect, the fixed frame rate converting means includes the code output from the temporary storing means. The input time stamp of the encoded data and the input time stamp of the encoded data from the size 0 frame creating means, which means that the size is 0, are based on the output time stamp so that the input time stamps are continuous. Coded data time stamp continuity means for rewriting the data, it is possible to compensate for an error in the input time stamp attached to the coded data and create coded data having a continuous input time stamp. And, as a result, data recorded on the recording medium and converted to a standard file format. Et al., It is possible to create a file, etc. of only the coded data.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a configuration of a data conversion device according to a first embodiment of the present invention.

FIG. 2 is a diagram illustrating a configuration of a fixed FPS conversion unit of the data conversion device according to the first embodiment of the present invention.

FIG. 3 is a diagram showing a configuration of a non-updated frame unit, a size 0 frame insertion unit, and a coded data time stamp continuation unit in a fixed FPS conversion unit of the data conversion device according to the first embodiment of the present invention. is there.

FIG. 4 is a flowchart showing a series of processing operations of a fixed FPS conversion means of the data conversion device according to the first embodiment of the present invention.

FIG. 5 is a diagram illustrating a configuration of encoded data (FIG. (A)) and an MP4 file (FIG. (B)) created by a non-updated frame inserting unit in the data conversion device according to the first embodiment of the present invention;
FIG.

FIG. 6 is a diagram illustrating a configuration of an encoded data (FIG. (A)) and an MP4 file created by a size 0 frame inserting unit in the data conversion device according to the first embodiment of the present invention;
It is a figure showing (b)).

FIG. 7 is a diagram showing a state where an MP4 time stamp ITS of an input frame fluctuates according to the first embodiment of the present invention.

FIG. 8 is a diagram illustrating a configuration of a data encoding device according to a second embodiment of the present invention.

FIG. 9 is a diagram showing a configuration of a data recording device according to a third embodiment of the present invention.

FIG. 10 is a diagram showing a frame interval of encoded data of a conventional variable frame rate.

FIG. 11 is a diagram showing a configuration of a conventional data encoding device.

FIG. 12 shows encoded data of a variable frame rate created by a conventional MP4 file encoding means (FIG.
(a)) and the structure of an MP4 file (FIG. (b)).

FIG. 13 is a diagram showing a configuration of a conventional MP4 file encoding unit.

FIG. 14 is a flowchart showing a series of flow of processing operation of a conventional MP4 file encoding means.

FIG. 15 shows coded data of a fixed frame rate (FIG.
(a)) and the structure of an MP4 file (FIG. (b)).

FIG. 16 is a flowchart showing a conventional flow of a process of searching for a sample corresponding to a given MP4 time stamp using a Sample-To-TimeStamp Atom.

FIG. 17 is a diagram showing a configuration of a conventional data recording device.

[Explanation of symbols]

 42 MP4 time stamp reading means 43 mdat atom creating means 44 stsz atom creating means 45 stts atom creating means 46 mdat atom temporary storing means 47 stsz atom temporary storing means 48 stts atom temporary storing means 49 temporary data linking means 81 video capturing means Conversion determination means 83 encoding means 84 non-updated frame creation means 90 RTP transmission means 91 RTP reception means 92 RTP reception buffer 93 RTP decoding means 94 RTP timestamp conversion means 100 data conversion device 41, 101 coded data temporary storage means 102 Encoded data time stamp reading means 103 Time stamp conversion means 104 Fixed FPS making means 85, 95, 110 MP4 file coding means 86, 96, 1 REFERENCE SIGNS LIST 20 recording medium 200 data encoding device 201 non-updated frame insertion means 202 size 0 frame insertion means 203 encoded data time stamp continuation means 300 data recording apparatus 311,321 processing means 312 non-updated frame generation means 313,323,332 temporary Storage means 314, 324 Switch 331 Encoded data time stamp rewriting means

Continuation of the front page F term (reference) 5C053 GA11 GB21 JA22 KA03 5C059 KK41 MA00 RC04 SS11 UA02 UA05 UA32 5D044 AB07 BC01 BC04 DE11 DE43 GL01

Claims (16)

[Claims] 1. Temporary storage means for temporarily storing encoded data of input video signal data, and from the encoded data stored in the temporary storage means,
Time stamp reading means for reading an input time stamp which is time information of the encoded data; and a fixed frame for outputting the encoded data, wherein the input time stamp of the encoded data is inputted as initial information from outside. Time stamp conversion means for converting a time stamp based on a rate, and fixed frame rate conversion means for converting the encoded data with the time stamp based on the fixed frame rate into encoded data at the fixed frame rate A data conversion device, comprising: 2. The data conversion device according to claim 1, wherein the fixed frame rate conversion means generates encoded data having information indicating non-update,
A non-updated frame generating means for assigning an arbitrary value as the input time stamp to the encoded data indicating the non-update, and an output time stamp of the encoded data output from the fixed frame rate conversion means, A time stamp and a time stamp based on the fixed frame rate, and a processing means for controlling which of the temporary storage means and the non-updated frame creating means is selected based on a result of the comparison. The processing unit controls the output time stamp and the encoded data stored in the temporary storage unit to be output when the output time stamp is equal to or greater than a time stamp based on the fixed frame rate. The output timestamp is smaller than the timestamp based on the fixed frame rate And controlling the output time stamp and the encoded data representing the non-update from the non-update frame creating means to be output. 3. The data conversion device according to claim 1, wherein the fixed frame rate conversion means creates encoded data indicating that the size is 0, and indicates that the size is 0. A size 0 frame creating means for adding an arbitrary value to the encoded data as the input time stamp; and an output time stamp of the encoded data output from the fixed frame rate converting means. A time stamp based on a fixed frame rate, and comparing the result with the temporary storage means and a processing means for controlling which of the size 0 frame creating means is selected, the processing means comprising: When the output time stamp is equal to or greater than the time stamp based on the fixed frame rate, And output the encoded data stored in the temporary storage means, and when the output time stamp is smaller than the time stamp based on the fixed frame rate, the output time stamp and the size 0 A data conversion device, which controls to output encoded data meaning that the size is 0 from the frame creation means. 4. The data conversion device according to claim 2, wherein the processing means is configured to determine that when a value obtained by adding an arbitrary value to the output time stamp is equal to or greater than a time stamp based on the fixed frame rate, When the output time stamp and the encoded data stored in the temporary storage unit are controlled to be output, and a value obtained by adding an arbitrary value to the output time stamp is smaller than the time stamp based on the fixed frame rate. And controlling the output time stamp and the encoded data representing the non-update from the non-update frame creating means to be output. 5. The data conversion device according to claim 3, wherein the processing unit is configured to, when a value obtained by adding an arbitrary value to the output time stamp is equal to or greater than a time stamp based on the fixed frame rate, When the output time stamp and the encoded data stored in the temporary storage unit are controlled to be output, and a value obtained by adding an arbitrary value to the output time stamp is smaller than the time stamp based on the fixed frame rate. And controlling the output time stamp and the encoded data indicating that the size is 0 from the size 0 frame creating means. 6. The data conversion device according to claim 2, wherein the fixed frame rate conversion unit outputs the input time stamp of the encoded data output from the temporary storage unit and the non-updated frame generation unit. The encoded data time stamp continuation means for rewriting the input time stamp of the encoded data, which means the non-update, based on the output time stamp so that the input time stamp is continuous, is provided. Data converter. 7. The data conversion apparatus according to claim 3, wherein the fixed frame rate conversion unit includes an input time stamp of the encoded data output from the temporary storage unit, and an input time stamp of the size 0 frame generation unit. An encoded data time stamp continuity unit that rewrites an input time stamp of encoded data that means that the size is 0, based on the output time stamp so that the input time stamp is continuous, is provided. Data conversion device. 8. A method for capturing input video signal data,
From the input time stamp that is the time information of the video signal data, determine whether to encode the video signal data,
In accordance with the determination result, in the data encoding device that compresses and encodes the video signal data into encoded data of a variable frame rate by encoding means, creates encoded data having information meaning non-update,
A non-updated frame generating means for assigning an arbitrary value as the input time stamp to the encoded data indicating the non-update and determining a time stamp based on a fixed frame rate at the time of output, wherein the determination result is the video signal When the data is not coded, the non-updated frame generating means outputs coded data indicating the non-update and a time stamp based on the fixed frame rate. apparatus. 9. A method for capturing input video signal data,
From the input time stamp that is the time information of the video signal data, determine whether to encode the video signal data,
In accordance with the determination result, a data encoding device for compressing and encoding the video signal data into encoded data of a variable frame rate by an encoding unit creates encoded data indicating that the size is 0. A size 0 frame creating means for assigning an arbitrary value as the input time stamp to the encoded data meaning that the size is 0, and determining a time stamp based on a fixed frame rate at the time of output. If the result is that the video signal data is not coded, the coded data indicating that the size is 0 and the time stamp based on the fixed frame rate are output from the size 0 frame generating means. A data encoding device, comprising: 10. An RTP receiving means for receiving a transmitted RTP packet, an RTP receiving buffer for temporarily storing the received RTP packet, and an identical RTP time stamp stored in the RTP receiving buffer. RT for decoding RTP packets into encoded data
A data recording device for converting the encoded data into a standard file format and recording the encoded data on a recording medium, obtaining the RTP time stamp from the RTP reception buffer, Time stamp conversion means for converting the encoded data into a time stamp based on a fixed frame rate when outputting the encoded data, and the encoded data with a time stamp based on the fixed frame rate, Fixed frame rate conversion means for converting to the fixed frame rate encoded data, comprising: converting the fixed frame rate encoded data output from the fixed frame rate conversion means to a standard file format, A data recording device for recording on the recording medium. 11. The data recording apparatus according to claim 10, wherein said fixed frame rate conversion means creates encoded data having information meaning non-update.
Non-updated frame creating means for giving an arbitrary value as the input time stamp to the encoded data indicating the non-updated; temporary storage means for temporarily storing the encoded data from the RTP decoding means; An output time stamp of the encoded data output from the rate conversion means is determined, and the output time stamp is compared with a time stamp based on the fixed frame rate. Processing means for controlling which of the update frame creation means is selected, the processing means comprising: when the output time stamp is equal to or greater than the time stamp based on the fixed frame rate, the output time stamp And the encoded data stored in the temporary storage means are output. When the stamp is smaller than the time stamp based on the fixed frame rate, control is performed so as to output the output time stamp and the coded data indicating the non-update from the non-updated frame creating means. Data recording device. 12. The data recording apparatus according to claim 10, wherein said fixed frame rate converting means creates encoded data meaning that the size is zero, and means that the size is zero. Size 0 frame generating means for adding an arbitrary value to the coded data as the input time stamp; temporary storage means for temporarily storing the coded data from the RTP decoding means; output from the fixed frame rate converting means The output time stamp of the encoded data to be output is determined, and the output time stamp is compared with the time stamp based on the fixed frame rate. Processing means for controlling which of the above is selected, the processing means comprising: When the time stamp is equal to or greater than the time stamp based on the fixed frame rate, the output time stamp and the encoded data stored in the temporary storage unit are controlled to be output, and the output time stamp is based on the fixed frame rate. When the time stamp is smaller than the time stamp, the output time stamp and the encoded data indicating that the size is 0 from the size 0 frame generating means are controlled to be output. . 13. The data recording apparatus according to claim 11, wherein the processing unit is configured to, when a value obtained by adding an arbitrary value to the output time stamp is equal to or greater than a time stamp based on the fixed frame rate. When the output time stamp and the encoded data stored in the temporary storage unit are controlled to be output, and a value obtained by adding an arbitrary value to the output time stamp is smaller than the time stamp based on the fixed frame rate. A data recording device for outputting the output timestamp and the encoded data indicating the non-update from the non-updated frame creating means. 14. The data recording apparatus according to claim 12, wherein said processing means includes: when a value obtained by adding an arbitrary value to said output time stamp is equal to or greater than a time stamp based on said fixed frame rate. When the output time stamp and the encoded data stored in the temporary storage unit are controlled to be output, and a value obtained by adding an arbitrary value to the output time stamp is smaller than the time stamp based on the fixed frame rate. A data recording apparatus for controlling output of the output time stamp and encoded data indicating that the size is 0 from the size 0 frame creating means. 15. The data recording apparatus according to claim 11, wherein said fixed frame rate conversion means outputs an input time stamp of said encoded data output from said temporary storage means and an output from said non-updated frame creation means. The encoded data time stamp continuation means for rewriting the input time stamp of the encoded data, which means the non-update, based on the output time stamp so that the input time stamp is continuous, is provided. Data recording device. 16. The data recording apparatus according to claim 12, wherein said fixed frame rate conversion means includes an input time stamp of said encoded data output from said temporary storage means, and an input time stamp of said size 0 frame generation means. An encoded data time stamp continuation unit that rewrites an input time stamp of encoded data meaning that the size is 0 based on the output time stamp so that the input time stamp is continuous. Data recording device.