JP2009290790A - Apparatus and method for video image transmission - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve the following problem encountered, when a mechanism for transmission with a bit rate varied according to the state of communication is used to transmit AV data, obtained by picking up an image with a camera for broadcasting service through a network: the image quality becomes degraded, depending on the state of communication and this can degrade the value of data for broadcasting service. <P>SOLUTION: A video image transmission apparatus transmits images to a server through a transmission path. The apparatus includes: a state-of-communication detection unit that detects the state of communication in the transmission path; a transmission unit that converts the bit rate of an image according to the state of communication and transmits the image; a play list generation unit that generates a play list holding information indicating a section in which the bit rate of the image after conversion becomes equal to or lower than a threshold value; a recording medium for recording audio and video data; and a recording unit for recording the play list and the audio and video data. After the completion of recording to the recording unit, the audio and video data and the play list corresponding to the above section in the recording unit are retransmitted. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an apparatus for recording high-quality video / audio data, such as a video camera for broadcasting business, and more particularly to recording video / audio data having the same contents while recording broadcast video data such as news programs that require rapid reporting. The present invention relates to a recording apparatus such as a video camera for broadcasting business that transmits audio data in real time to a remote editing apparatus via a network.

  In recent years, wireless network technologies such as mobile phones and WiMAX are rapidly spreading. A system has been devised that uses such a wireless network to transmit video / audio data captured by a video camera to a remote location in real time.

Meanwhile, when transmission at a low bit rate is forced due to factors such as deterioration in the transmission status of the network, a specific picture of the MPEG moving picture is thinned out and transmitted at a low bit rate, and then the transmission status of the network A technique is disclosed in which video / audio data of a thinned picture that could not be transmitted due to the low bit rate transmission factor is transmitted (for example, Patent Document 1).
JP 2007-274443 A

  However, in the technique described in Patent Document 1, it is necessary to perform a combining process with already transmitted data on the receiving side after transmitting the thinned picture. In addition, when a situation in which data transmission is temporarily impossible due to a sudden deterioration of the transmission state, means for performing re-transmission to recover the section was also received after the already received picture. No means for combining the thinned picture at the receiving side is described.

  Therefore, in view of the above problems, the present invention can reproduce video data without interruption on the receiving side even when transmission of data is interrupted due to a sudden deterioration of the transmission state, and the transmission state is worse than a certain standard. An object of the present invention is to provide a video transmission apparatus and a video transmission method capable of reproducing video data with image quality that satisfies the standards even at times.

  In order to achieve the above object, a video transmission device of the present invention is a video transmission device that records acquired video on a recording medium and transmits the video to a receiving device via a transmission path, and acquires video data. A data acquisition unit, a video data conversion unit for converting the acquired video data into first video data and second video data having higher image quality than the first video data, and transmitting the first video data A first video data transmitting unit for transmitting to the receiving device via a path; a video data recording unit for recording the second video data on a recording medium in parallel with the transmission of the first video data; A specifying unit for specifying one partial section in one video data, and video data of a partial section corresponding to the partial section specified by the specifying unit in the second video data as one file When reproducing the first video data and the second video data transmission unit to be transmitted to the receiving device, the file of the second video data should be reproduced in the partial section specified in the first video data A playback order information generating unit that generates playback order information indicating the above, and a playback order information transmitting unit that transmits the generated playback order information to the receiving device.

  In addition, the video transmission apparatus of the present invention detects a transmission bit rate indicating the communication status of the transmission path, and dynamically determines a threshold for specifying the partial section from the detected transmission bit rate. A detection unit, wherein the specifying unit specifies a time point when a transmission bit rate of the transmission path falls below the threshold value determined by the communication status detection unit as a start point of the partial section, and the transmission bit rate is the threshold value You may specify the time of becoming above as the end point of the said partial area.

  Note that the present invention can be realized not only as an apparatus but also as a method using steps as processing units constituting the apparatus, as a program for causing a computer to execute the steps, or as a computer read recording the program. It can also be realized as a possible recording medium such as a CD-ROM, or as information, data or a signal indicating the program. These programs, information, data, and signals may be distributed via a communication network such as the Internet.

  According to the video transmission apparatus of the present invention, the transmission bit rate of the wireless network that transmits the video / audio data in real time in parallel with the recording on the recording medium can reduce the image quality required for the transmitted video / audio data. In the section below the minimum guaranteeable value, the video / audio data of the section recorded on the recording medium with high image quality is retransmitted in the file format for each section. At the same time, in the section, the playlist is transmitted so that the video / audio data received in real time by the server is switched to the retransmission file corresponding to the section and played back. Therefore, on the server side that receives the video / audio data captured by the video transmission device, the video / audio data received by re-transmission between the video / audio data received in real time in the section where the communication state of the wireless network is bad Since the file to be played is simply switched according to the playlist, the load on the server can be reduced, and high-quality video / audio data can be played without time loss. There is an effect.

  In particular, such as broadcast video cameras that record real-time video and audio data to a remote editing device via a network while recording broadcast video data such as news programs on a recording medium that requires rapid reporting. Such a video transmission apparatus that records high-quality video / audio data can be highly effective and is very useful.

  Furthermore, even if transmission of high-quality video / audio data is completely interrupted due to factors such as deterioration of the network transmission status, the video data received on the receiving side can be retransmitted by retransmitting the predetermined video / audio data. Thus, it is possible to easily browse the video / audio data with an image quality higher than a predetermined reference value without performing special processing such as combining these.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(Embodiment 1)
FIG. 1 is a block diagram showing the configuration and data flow of a video transmission system including a video transmission apparatus according to the present invention. As shown in the figure, the video transmission system includes a camera 101 and a server 102 connected to each other via a network. The camera 101 is a camera 101 that records video data obtained by shooting in a high-quality image on a built-in recording medium and simultaneously transmits the video data to the server 102 in parallel. 1 recording unit 112, first recording medium 113, list creation unit 116, and list interpretation unit 301. The transmitter 103 includes a communication status detection unit 115 and a transmission unit 114. The first recording unit 112 includes a recording encoding unit 117, and the transmission unit 114 includes a transmission encoding unit 118.

  The camera 101 shoots a subject using the imaging unit 111, and records high-quality video / audio data obtained by the shooting on the first recording medium 113 by the first recording unit 112. Note that the recording encoding unit 117 has a function of recording video / audio data obtained by the imaging unit 111 by compressing and encoding the data. Here, the imaging unit 111 is an example of a “video data acquisition unit that acquires video data”. The first recording unit 112 is an example of a “video data recording unit that records the second video data on a recording medium in parallel with the transmission of the first video data”.

  On the other hand, in parallel with this, the camera 101 transfers the video / audio data captured by the imaging unit 111 to the transmission unit 114 and transmits it to the wireless network using the transmission unit 114. The transmission unit 114 includes a transmission encoding unit 118 that performs compression encoding and transmits the result to the wireless network. The recording encoding unit 117 and the transmission encoding unit 118 are “a video data converting unit that converts the acquired video data into first video data and second video data having higher image quality than the first video data”. The transmission unit 114 is “a first video data transmission unit that transmits the first video data to the reception device via a transmission path”, “by the identification unit in the second video data. "Second video data transmission unit for transmitting video data of partial section corresponding to specified partial section as one file to reception apparatus" and "reproduction order for transmitting generated reproduction order information to reception apparatus" It is an example of an “information transmission unit”. Further, the communication status detecting unit 115 and the list creating unit 116 detect “a transmission bit rate indicating the communication status of the transmission path, and dynamically set a threshold for specifying the partial section from the detected transmission bit rate. A communication state detection unit to be determined ”and“ a time point when the transmission bit rate of the transmission path falls below the threshold value determined by the communication state detection unit is specified as a start point of the partial section, and the transmission bit rate is the threshold value It is an example of “the specifying unit that specifies the time point as described above as the end point of the partial section”. Since the transmission unit 114 is required to transmit in real time, the transmission encoding unit 118 has a function of performing compression encoding by changing the bit rate in real time.

  The communication status detection unit 115 detects the communication status (transmission bit rate) of the wireless network, and notifies the detected communication status to, for example, a bit rate to the transmission unit 114 and the list creation unit 116.

  The transmission encoding unit 118 in the transmission unit 114 performs the optimal encoding on the video / audio data transmitted from the imaging unit 111 according to the communication status notified from the communication status detection unit 115. It performs compression coding at the bit rate and transmits it to the wireless network.

  The list creation unit 116 refers to the communication status notified from the communication status detection unit 115 and generates a playlist in a predetermined procedure. Detailed control of the list creation unit 116 will be described later. The list creating unit 116 includes “a specifying unit that specifies one partial section in the first video data” and “the partial section specified in the first video data when reproducing the first video data”. Then, it is an example of “a reproduction order information generating unit that generates reproduction order information indicating that the file of the second video data is to be reproduced”.

  The server 102 is a device for editing video / audio data such as a news program recorded on a recording medium of the camera 101 in a broadcasting station, and includes a receiver 104, a receiving unit 121, a second recording unit 122, a second recording unit 122, and the like. 2 a recording medium 123, a display unit 124, and a playback unit 311. As a result, the operator of the server 102 can quickly determine a scene that can be used for a high-quality broadcast program while watching the video / audio data sent from the camera 101 in real time. After the high-quality video / audio data stored in is obtained, it can be quickly edited to create video / audio data for broadcasting.

The receiver 104 receives encoded video / audio data from the camera 101.
The receiving unit 121 demodulates and decodes the video / audio data received by the receiver 104. The receiving unit 121 includes a decoding unit 119 that decodes encoded video / audio data by changing the bit rate in real time. The receiving unit 121 outputs the video / audio data decoded by the decoding unit 119 to the second recording unit 122 and the display unit 124. The second recording unit 122 records the video / audio data from the receiving unit 121 on the second recording medium 123. At this time, the second recording unit 122 may re-encode the video / audio data in order to record it on the second recording medium 123. In parallel with the recording on the second recording medium 123 by the second recording unit 122, the display unit 124 displays the video / audio data demodulated and decoded by the decoding unit 119 on the monitor.

  The operation of each processing unit when the communication state of the wireless network is in a state where the minimum image quality can be maintained is as described above.

Next, a detailed control method of the list creation unit 116 will be described with reference to FIG.
FIG. 2 is a diagram illustrating an example of a change in the communication status (bit rate) detected by the communication status detection unit 115 and a playlist indicating a video / audio data reproduction method according to the communication status.

  Here, it is assumed that the recording of the video / audio data to the first recording medium 113 is started from the time t1, and the recording is ended at the time t6. That is, the video / audio data in the section from time t1 to time t6 is compression-encoded by the recording / encoding unit 117 at a bit rate at which high-quality playback is possible, and is recorded as a file on the first recording medium 113. At the same time, the video / audio data in this section is compression-coded by the transmission encoding unit 118 at a bit rate corresponding to the communication status, and transmitted to the wireless network.

  At this time, the communication status detection unit 115 acquires the communication status (transmission bit rate) of the wireless network, and notifies the list creation unit 116 of the acquired communication status. The list creation unit 116 monitors the communication status (transmission bit rate) notified by the communication status detection unit 115 and compares the transmission bit rate of the wireless network with a threshold value 211 specified in advance, so that the first play is performed. A list 251 is created.

  The threshold value 211 here is the bit rate when it is desired to ensure the minimum data quality (video / audio quality) when transmitting the compression-coded data of the video / audio data to the server 102 via the wireless network. It is assumed that a lower limit value is set.

  For example, a situation like the graph on the left of FIG. 2 is assumed. In the section from time t1 to time t2, the transmission bit rate is higher than the threshold 211, and in the section from time t2 to time t3, the transmission bit rate is lower than the threshold 211. Similarly, the section from time t3 to time t4 and the section from time t5 to time t6 have a transmission bit rate higher than the threshold 211, and the section from time t4 to time t5 has a transmission bit rate lower than the threshold 211.

  In such a situation, the list creation unit 116 creates the first playlist 251 with each time from time t1 to time t6 as IN / OUT points.

  In the first playlist 251, when the transmission encoding unit 118 performs compression encoding at a bit rate lower than the threshold 211 when transmitting the compression encoded data of the video / audio data from the transmission unit 114 to the wireless network. The video / audio data in the section transmitted by performing compression encoding at a bit rate lower than the threshold 211 is specified, and the video / audio data in the specified section is used later to be retransmitted.

  Therefore, information indicating each section is recorded in the first playlist 251 with each time information from time t1 to time t6 as IN / OUT points, and data retransmission information (retransmission) of each section is recorded. (Information indicating whether or not) is recorded at the same time (see the first play list 251 on the right side of FIG. 2).

  On the other hand, in the server 102, the reception unit 121 of the receiver 104 receives the compressed data of the video / audio data transmitted to the wireless network by the transmission unit 114 of the camera 101. The decoding unit 119 decompresses the compressed video / audio data received by the receiving unit 121 in real time, and the display unit 124 displays the compressed data.

  On the other hand, the video / audio data received by the receiving unit 121 and decoded by the decoding unit 119 is recorded as a file on the second recording medium 123 by the second recording unit 122. At this time, the second recording unit 122 may compress-encode the decoded video / audio data again and record it on the second recording medium 123.

  After a series of processes for recording imaging data from time t1 to time t6, the camera 101 interprets the first playlist 251 and transmits data in a section where compression encoding has been performed at a low bit rate. Retransmit to the wireless network.

  FIG. 3 is a block diagram of the video transmission system showing the flow of data at the time of data retransmission, and control for performing data retransmission will be described using this diagram.

  At the end of recording, the first recording medium 113 is recorded with a compression-encoded data file of video / audio data and a first playlist 251 file in a section from time t1 to time t6. However, when the first recording unit 112 records the compressed encoded data of the video / audio data on the first recording medium 113, the recording / encoding unit 117 does not depend on the communication status (transmission bit rate), and the video / audio is recorded. The data is compression-encoded, and the first recording unit 112 records the encoded video / audio data on the first recording medium 113 at a constant bit rate (assuming a sufficient bit rate for maintaining the data quality here). Shall.

  The list interpreter 301 interprets the first playlist 251 recorded on the first recording medium 113, refers to the retransmission information, and stores the compressed encoded data of the video / audio data in the section that needs to be retransmitted. The data is transmitted to the wireless network via the transmission unit 114 in the form. The control will be described with reference to FIG.

  FIG. 4 shows an example of a playlist indicating changes in the communication status (bit rate) detected by the communication status detection unit 115 and whether video / audio data needs to be retransmitted according to the communication status at the time of data retransmission. FIG.

  In the example of FIG. 4, retransmission is performed by regarding the section from time t2 to time t3 as a retransmission section.

  At this time, since the compressed encoded data of the video / audio data in the section from time t2 to time t3 to be retransmitted does not need to be transmitted in real time, the transmission unit 114 compresses the video / audio data regardless of the communication status. The encoded data is transmitted at the bit rate as it is (the bit rate of the data recorded on the first recording medium 113).

  After the retransmission of the compressed encoded data of the video / audio data in the section from time t2 to time t3 is completed, the list interpretation unit 301 sets the retransmission information of the retransmission target section of the first playlist 251 as, for example, “ Update to “completed”, and this section is excluded from retransmission targets (see the first playlist 251 in FIG. 4).

  Furthermore, the list interpretation unit 301 transmits the updated first playlist 251 to the server 102 via the wireless network by the transmission unit 114.

  Through the same processing as described above, the compressed encoded data of the video / audio data in the section from the time t4 to the time t5 in the first recording medium 113 is retransmitted to the server 102, and further from the time t4 of the first playlist 251. For example, the retransmission information of the section up to time t5 is updated from “not yet” to “completed” and transmitted to the server 102.

  Next, the processing of the server 102 when each data retransmitted by the camera 101 as described above is described.

  As shown in FIG. 3, the server 102 stores the re-transmission data of the compression encoded data of the video / audio data received by the receiving unit 121 of the receiver 104 in the second recording medium 123 by the second recording unit 122. And record. At this time, the receiving unit 121 passes the received retransmission data to the second recording unit 122 without being decoded by the decoding unit 119. Similarly, the first playlist 251 received by the receiver 104 is recorded as a file on the second recording medium 123 by the second recording unit 122. Note that if the retransmission section is divided into two or more in one recording process, the server 102 also receives the first playlist 251 twice or more. In that case, the second recording unit 122 overwrites the received first playlist 251 with the latest first playlist 251 and records it on the second recording medium 123.

  5, as in the example illustrated in FIG. 4, the camera 101 performs compression encoded data of video / audio data in a section from time t2 to time t3, and video / audio in a section from time t4 to time t5. It is a figure which shows an example of the data recording condition of the server side at the time of retransmitting the compression encoding data of data. That is, each file is recorded on the second recording medium 123 in the state shown in FIG.

  That is, as shown in FIG. 5, the file recorded on the second recording medium 123 is the first real-time transmission file 501 received during real-time transmission (see the upper right diagram in FIG. 5), the section from time t2 to time t3. The first retransmission file 502 received at the time of retransmission of data (see the middle right diagram in FIG. 5), and the second retransmission file 503 received at the time of retransmission of data in the section from time t4 to time t5 (see FIG. 5). And the first playlist file 504 (see the lower right diagram in FIG. 5).

  The first playlist file 504 shown in the lower right of FIG. 5 describes three video / audio data file playback methods: a first real-time transmission file 501, a first retransmission file 502, and a second retransmission file 503. ing.

  Specifically, the first playlist file 504 describes contents such as the first playlist 251 on the lower left side of FIG.

  The playback unit 311 refers to the first playlist 251 and, at each time from time t1 to time t6, a section where there is no retransmission information, that is, a section from time t1 to time t2, from time t3 to time t4 And the section from time t5 to time t6, it is determined that retransmission is not performed, and this section is a first playback target section 511 (an arrow in the figure) that is a corresponding section of the first real-time transmission file 501. ).

  On the other hand, referring to the first playlist 251, a section in which retransmission information is “completed” at each time from time t 1 to time t 6, that is, a section from time t 2 to time t 3, and time t 4. In the section from time t5 to time t5, it is determined that the retransmission data has been received, and the second reproduction target section 512, which is the corresponding section of the first retransmission file 502 and the second retransmission file 503, is reproduced.

  FIG. 6 is a diagram showing a bit rate when video / audio data from the camera 101 is reproduced according to the first playlist 251 shown in FIG. In this way, by performing playback processing according to the first playlist file 504, playback at the playback bit rate as shown in FIG. 6 is possible during playback, and the threshold value 211 is applied to all playback target sections from time t1 to time t6. It is possible to perform reproduction at a higher bit rate, that is, a bit rate higher than the lower limit value of the bit rate when it is desired to ensure the minimum data quality (video / audio quality).

  However, in the first playlist file 504, if there is a section in which the retransmission information is “not yet”, the data on the section is data to be retransmitted, but the receiver side does not retransmit it. Indicates that reception of transmission data has not been completed. Therefore, in this case, the same processing as that in the section where there is no retransmission information is performed.

  For example, consider a situation like the first playlist 251 on the right side of FIG. That is, only the former section, that is, the section from time t2 to time t3, is present even though there are two retransmission sections, the section from time t2 to time t3 and the section from time t4 to time t5. Consider a situation in which retransmission is “completed” and retransmission is performed only in this section.

  In the situation of FIG. 4, in the first playlist 251, the retransmission information in the section from time t2 to time t3 is “completed”, but the retransmission information in the section from time t4 to time t5 is “ "Not yet". In this case, since the second retransmission file 503 on the right in the middle of FIG. 5 has not been received, the reproduction target section from the time t4 to the time t5 is the corresponding section of the first real-time transmission file 501.

  By using this mechanism, reproduction (viewing) can be performed even in a situation where all or part of the data of all retransmission candidate sections has not been received. In other words, in order to perform reproduction (browsing) regardless of the retransmission status, it is only necessary to follow the playlist file, and the control on the receiving side (server 102 side) becomes simple.

  The first recording unit 112 has a function of compressing and recording video / audio data, but the compression encoding method is MPEG, DV, DVCPRO, HDV, H. Any compression method such as H.264 may be used.

  The transmission encoding unit 118 of the transmission unit 114 has a function of compressing and encoding video / audio data while changing the bit rate according to the situation. The compression encoding method is MPEG, DV, DVCPRO, HDV. , H .; Any compression method such as H.264 may be used.

  The first recording medium 113 and the second recording medium 123 may be of any type as long as they are randomly accessible media such as HDD, DVD, BD, flash memory, and the like.

  Further, the threshold 211 may be a mechanism that can be arbitrarily set by the user's judgment, or may be a fixed value by the device.

  Further, the information indicating the section from time t1 to time t6 does not necessarily have to be time, and may be a time code or the like, and is used to determine a video frame position such as a video frame offset value, PTS (Presentation Time Stamp), or the like. The type of information is not limited.

  Further, in the present embodiment, the format of the first playlist 251 is as shown in FIGS. 4 to 6, but information that can specify the playback section and confirm the status of retransmission, that is, retransmission. If information such as unnecessary, re-transmission required but not re-transmission, re-transmission completed can be identified, the format is not limited.

(Embodiment 2)
In the first embodiment, in the process of transmitting data from the camera 101 to the server 102, the basic control method when performing real-time transmission and the basic control method when performing retransmission are described. In the present embodiment, a detailed control method of list creation unit 116 will be described in particular. Specifically, a cameraman identifies an important section of video / audio data by pressing an “important button” or the like provided on the camera 101, and the camera 101 detects that an “important button” or the like has been pressed. Get the designation of the important section. The camera 101 increases the minimum bit rate threshold in the important section in accordance with the acquired designation of the important section. A method for controlling the camera 101 will be described. The difference from the first embodiment is that (1) the camera 101 includes an important button, an important release button, a remote button, etc., and (2) the list creation unit 116 stores the threshold value 211 and the important threshold value 711. When the important section is specified by pressing these buttons, the list creation unit 116 divides the IN / OUT section of the first playlist 251 in the important section based on the important threshold value 711.

  In the first embodiment, the list creating unit 116 sets the threshold value 211, that is, the user setting value or the device set by the user as the lower limit value of the bit rate when the minimum data quality (video / audio quality) is to be ensured. The device setting value determined in advance was used.

  In this embodiment, the threshold value 211 is automatically determined by monitoring the communication status (transmission bit rate) of the wireless network.

  For example, the communication status of the wireless network is regularly monitored by the communication status detection unit 115 shown in FIG. When the recording process is started, the threshold 211 is determined according to the communication status (transmission bit rate) of the wireless network.

  By monitoring the communication state (transmission bit rate) for a certain period after the power is turned on to the camera 101, for example, a bit rate of 80% of a steady bit rate (average bit rate) is set as the threshold value 211. . That is, when the bit rate in a steady communication state is 10 [Mbps], 8 [Mbps] of 80% is set as the threshold value 211.

  Alternatively, the minimum bit rate value may be set as the threshold value 211 as it is by monitoring the communication status (transmission bit rate) for a certain period before the start of the recording process, or for safety, 80% of the minimum bit rate. May be set to the threshold value 211.

  In addition, in the first embodiment, the list creating unit 116 divides the IN / OUT section of the first playlist 251 depending on whether the bit rate is lower than the threshold 211, but in this embodiment, in addition to the threshold 211, Then, in consideration of information on the importance of the section of the video / audio data being shot, the IN / OUT section is divided and retransmission information is set. Here, the section importance level information refers to information indicating a time section in which an important button provided in the camera 101 is pressed, for example.

  FIG. 7 is a diagram showing the relationship between the threshold value 211, the important threshold value 711, and the first playlist 251 when an important section is set using the important button and the importance release button. Hereinafter, the control of the list creation unit 116 in consideration of importance information will be described with reference to FIG.

  Here, a particularly important scene is dynamically specified during shooting so that the minimum bit rate of the important scene, that is, the important threshold value 711 is higher than the normal threshold value 211. That is, the IN / OUT section of the first playlist 251 is determined using two types of threshold values. Here, it is assumed that the value of the important threshold value 711 is stored in the list creation unit 116, but it may be a predetermined constant value or the threshold value 211 dynamically determined by the list creation unit 116. A calculation formula may be determined so that a higher value is determined. For example, a count for calculating each threshold value is stored. That is, when the threshold 211 is 80% of the average bit rate and the important threshold 711 is 90% of the average bit rate, values such as (threshold 211) = 80%, (important threshold 711) = 90% are stored. Keep it.

  As shown in FIG. 7, when it is determined that a cameraman has entered an important scene during video / audio data shooting, an important button (not shown) provided in the camera 101 is pressed. Then, the video / audio data after the important button is pressed is determined as an important scene by the list creation unit 116. Thus, the IN / OUT section is set when the transmission bit rate of the data being recorded falls below the preset important threshold value 711, that is, at time t2 ′. That is, the IN / OUT point is not set at the time t2 set based on the threshold value 211 in the sections other than the important section.

  On the other hand, when an important scene is being photographed, for example, when the photographer determines that the important scene has ended, the important release button (not shown) provided in the camera 101 is pressed. Then, the video / audio data after the importance release button is pressed is determined not to be an important scene by the list creation unit 116, and the first time when the transmission bit rate of the data being recorded falls below a preset threshold 211. Control is performed to divide the IN / OUT section of one playlist 251. This is to return to the original control.

  At this time, as shown in FIG. 7, in the important section, when the transmission bit rate of the data being recorded is lower than the important threshold 711 and higher than the threshold 211, that is, in a situation such as time t3 ′, the importance cancellation is performed. When the button is pressed, the important scene is canceled at that moment, so the IN / OUT point is set at time t3 ′. That is, the IN / OUT point is not set at time t3.

  In the above-described example, the important scene is manually determined by the photographer, but the important scene may be automatically determined from predetermined parameters of the video / audio data being shot.

  For example, when zooming in during the shooting process, it may be automatically determined as an important scene, or when the volume of the voice is increased (when cheers are raised), if the camera has a face recognition function When a face recognition is detected, it may be automatically determined as an important scene.

  By performing the above-described control, it is possible to change the retransmission section of the high-quality video / audio data recorded on the first recording medium 113 according to various situations.

  In this embodiment, when determining the threshold value, the threshold value 211 is set to 80% of the steady bit rate (average bit rate) of the communication status (transmission bit rate) or the minimum bit rate. The% value may be arbitrarily determined.

  In this embodiment, it is an example that a cameraman depresses an important button by determining that it is an important scene in the video / audio data being shot. For example, a mechanism may be adopted in which the start / end of the important scene is controlled by using a remote button or the like provided by the camera 101, for example, by infrared or middle-range wireless, etc.

  Further, the important button not shown and the important release button not shown may be operated with the same button as the start / end toggle, or each button may be a separate button.

  In this embodiment, the IN / OUT point is controlled using two types of threshold values 211 and the important threshold value 711. However, three or more types of threshold values are set, and the IN / OUT point is set according to the situation. You may control using the threshold value used as the reference | standard of these. For example, in addition to the important button and the important release button, an important level setting button or the like may be provided, and control may be performed using a different threshold corresponding to the important level for each important section set by the important button.

  In this embodiment, zoom level, volume level, face recognition, and the like are exemplified as parameters for automatic determination of important scenes. However, a mechanism for automatically determining important scenes from other video / audio parameters may be used. . Also in this case, different importance levels may be set according to the parameters for automatic determination, and control may be performed using different threshold values according to the importance levels of the important scenes. Here, the list creation unit 116 includes “an important section determination unit that determines an important section that satisfies a specific condition and an importance level of the important section in the acquired video data” and “the important section of the important section. According to the degree of importance, a threshold value that takes a larger value as the degree of importance is higher and a transmission bit rate of the transmission path are compared, and the transmission bit is more than the threshold value according to the degree of importance in the important section. It is an example of “the specifying unit that specifies a section where the rate is lower” as the partial section.

(Embodiment 3)
In the present embodiment, a description will be given of control when data transmission of a wireless network is temporarily stopped, that is, when the transmission bit rate is temporarily 0 [Mbps]. The present embodiment is different from the first embodiment in that (1) the display unit 124 of the server 102 displays the last received video frame as a still image while the wireless network data transmission is stopped. (2) The second recording unit 122 of the server 102 interpolates the interrupted portion of the real-time transmission file from the camera 101 with dummy data, and records the second real-time transmission file 801 created thereby on the second recording medium 123. That is.

  FIG. 8 is a diagram illustrating the relationship between the bit rate change during real-time transmission when data transmission of the wireless network is temporarily stopped, and the re-transmission file and the first playlist 251 corresponding thereto.

  As shown in the upper left graph of FIG. 8, for example, a case is assumed where the wireless network is temporarily stopped from time t3 ″ and the wireless network resumes data transmission from time t4 ″.

  Since data transmission is impossible in the section from time t3 ″ to time t4 ″, a section in which video / audio data cannot be received on the server 102 side occurs in real-time transmission during shooting.

  In this case, in the display unit 124 in the server 102 shown in FIG. 1, the video / audio data supply from the receiving unit 121 is temporarily stopped, so that the last video frame that has been received so far, that is, the time t3. A STILL (still) image is displayed in the video frame of ''.

  Thereafter, when the wireless network resumes data transmission, the display unit 124 resumes the video / audio data because the video / audio data supply from the receiving unit 121 is resumed.

  On the other hand, similarly, in the second recording unit 122, since the supply of video / audio data from the receiving unit 121 is temporarily stopped, the last video frame data that has been received so far, that is, at the time t3 ″. Dummy data is created using the video frame data (or the last GOP data that could be received), the interrupted portion is interpolated with the created dummy data, and the creation of the second real-time transmission file 801 is continued.

  After that, when the wireless network resumes data transmission, the second recording unit 122 resumes the video / audio data supply from the receiving unit 121, so the interpolation by the dummy data is stopped and the video / audio from the receiving unit 121 is stopped. Recording of the second real-time transmission file 801 containing the data is continued.

  At that time, the list creation unit 116 generates the first playlist 251 in the same manner as in the first embodiment. That is, in the section where the communication status (transmission bit rate) of the wireless network is below the threshold value 211, the second playlist file 804 (FIG. 8) is retransmitted so that the third retransmission file 802 (see the right diagram in the middle of FIG. 8) is retransmitted. 8 (see the lower right figure). Specifically, as the playlist file indicating the IN / OUT points, as indicated by the first playlist 251 in FIG. 8, the section in which data transmission is temporarily stopped, that is, from time t3 ″ to time t4 ″. The IN / OUT points are set with the low bit rate interval lower than the threshold value 211 including the intervals up to, ie, all intervals from time t2 to time t5 as one interval. Therefore, at the time of data retransmission, the second recording unit 122 records a data file such as the third retransmission file 802 in FIG. 8 on the second recording medium 123.

  Therefore, as the playback section in the playback unit 311 of the server 102 after the retransmission, the third playback target section 811 (from time t1 to time t2 and from time t5 to time t6) of the second real-time transmission file 801, the first The third retransmission file 802 becomes the fourth reproduction target section 812 (from time t2 to time t5).

  By the above-described control, even when the data transmission of the wireless network is temporarily stopped, the server 102 side performs high quality by retransmitting the video / audio data in the section where the transmission bit rate of the wireless network is lower than the threshold value 211. It is possible to play back (view) video / audio data.

(Embodiment 4)
In the first to third embodiments, the camera 101 automatically retransmits the video / audio data to be retransmitted to the server 102 after the recording process of the video / audio data is completed. In the embodiment, a case where the user selects data to be retransmitted will be described. The fourth embodiment is different from the first embodiment in that the camera 101 includes (1) a display unit that displays a thumbnail of the first video frame in the IN / OUT section, and (2) the section specified by the thumbnail. A retransmission button for instructing the retransmission of video / audio data is provided. (3) The list interpretation unit 301 retransmits only the retransmission file instructed by the retransmission button.

  For example, as shown in FIG. 2, after the camera 101 finishes recording the video / audio data, there are two retransmission target sections, a section from time t2 to time t3 and a section from time t4 to time t5. To do.

  At this time, by a display unit (not shown) in the camera 101, thumbnails of respective retransmission candidate sections, that is, thumbnails of the first video frame of the scene in the section from time t2 to time t3, and from time t4 to time t5 A thumbnail of the first video frame in the section is displayed on a liquid crystal screen or the like of a display unit (not shown).

  By reproducing the video data of each target section from the thumbnail screen, the user can know what scene has become the retransmission candidate data.

  When the user confirms a scene that is a candidate for retransmission and determines that the data needs to be retransmitted (that is, important data), the video / audio data of a predetermined section can be obtained by pressing a retransmission button (not shown). To the server 102.

  For example, in FIG. 2, when the scene in the section from time t2 to time t3 is an important scene and the scene in the section from time t4 to time t5 is a less important scene, the user intentionally starts from time t2. Only the scenes in the section up to time t3 are retransmitted.

  According to the above-described method, it is possible to transmit only data of retransmission candidates that the user determines to be necessary after video / audio data shooting is completed, and thus it is possible to suppress useless data transmission.

  In the present embodiment, the thumbnail of the scene in the retransmission candidate section is the first video frame. However, the thumbnail is not necessarily the first video frame, and if it is a video frame in the scene of the corresponding section, Optional. In addition, for example, a frame described as being capable of automatically determining the high degree of importance in the second embodiment, such as a zoomed-up frame, a frame whose face has been recognized, and a frame when the volume of sound is increased. It may be used as a thumbnail.

  In the present embodiment, thumbnails are displayed on a liquid crystal screen that does not indicate a thumbnail. However, the thumbnails may be arbitrary as long as the thumbnails can be displayed.

  In the present embodiment, the user re-sends data in a predetermined re-sending section by pressing a non-illustrated re-sending button, but any function that provides a trigger for re-sending can be used. It is optional even if the re-send button is not pressed.

  Further, in this embodiment, when retransmitting data of a retransmission candidate section, data of only one section is retransmitted in one transmission, but there are a plurality of retransmission target sections. Alternatively, a mechanism may be adopted in which data of a plurality of retransmission sections is retransmitted simultaneously.

(Embodiment 5)
In the first to fourth embodiments, the camera 101 retransmits data to the server 102 from the same camera 101 after the video / audio data recording process is completed. From the device to the server 102. The fifth embodiment is different from the first embodiment in that (1) the list creating unit 116 writes retransmission data and a transmission ID indicating the transmission destination address of the playlist in the playlist, and (2) illustrated. The editing machine that does not interpret the transmission ID written in the playlist created by the list creation unit 116, and transmits the retransmission data file and the playlist file to the transmission destination specified by the transmission ID. It is.

  For example, as shown in FIG. 2, after the camera 101 finishes recording the video / audio data, there are two retransmission target sections, a section from time t2 to time t3 and a section from time t4 to time t5. And

  At this time, video / audio data and a play list are recorded on the first recording medium 113.

  FIG. 9 is a diagram illustrating an example of the second playlist 951 when a retransmission data file and a playlist file are transmitted from a device different from the camera 101. Here, for example, as shown in the second playlist 951 in FIG. 9, for example, an IP address “11.22.33.44” is described as the retransmission destination ID (transmission ID). By doing so, it is possible to specify a transmission destination when performing retransmission.

  When the first recording medium 113 is a detachable recording medium, the first recording medium 113 is removed from the camera 101 and the first recording medium 113 is mounted on an editing machine (not shown) before re-transmission.

  When an editing machine (not shown) refers to the retransmission information of the second playlist 951 recorded on the first recording medium 113 and there is a section in which the retransmission is “not yet”, The video / audio data of the section is retransmitted to the server 102.

  If the camera 101 needs to shoot the next scene immediately after video / audio data has been shot by the above-described method, the first recording medium 113 is taken out from the camera 101 and another recording medium is inserted into the camera 101. By mounting, it becomes possible to immediately start shooting the next scene.

  At the same time, the first recording medium 113 taken out from the camera 101 can be mounted on an editing machine (not shown) and predetermined data can be retransmitted.

  In the present embodiment, the IP address is used as the ID for specifying the retransmission destination in the second playlist 951 in which the transmission ID is described, but it is information that can specify the transmission destination. Any address can be used.

  Further, in the present embodiment, the first recording medium 113 removed from the camera 101 is mounted on an editing machine (not shown). However, the first recording medium 113 is not necessarily an editing machine, and is a device having a retransmission function shown in the present invention. Any device may be used.

(Embodiment 6)
In the first to fifth embodiments, when video / audio data in a predetermined section is retransmitted to the server 102, the video / audio data section to be retransmitted is selected on the transmission side. Now, a case where the video / audio data section desired to be retransmitted from the receiving side, that is, the server 102 is designated will be described. In this case, new configurations are required on the server 102 side and the camera 101 side. Specifically, the server 102 side (1) a retransmission request playlist creation unit for creating a playlist for designating a section of video / audio data desired to be retransmitted, and (2) the created retransmission A transmission unit that transmits the requested playlist to the camera 101 is required. On the camera 101 side, (1) a receiving unit that receives a retransmission request playlist from the server 102, and (2) interpreting the retransmission request playlist as a new function of the list interpretation unit 301, A function for reading video / audio data from the first recording medium 113 and transmitting it to the server 102 is required.

  Here, for example, as shown in FIG. 2, after the camera 101 finishes the recording process of the video / audio data, the retransmission target sections are two sections, a section from time t2 to time t3 and a section from time t4 to time t5. Suppose it exists.

  At this time, since the video / audio data of the section from time t2 to time t3 and the section from time t4 to time t5 are not retransmitted, when these sections are viewed on the server 102 side, a predetermined bit rate That is, only video / audio data whose transmission bit rate is lower than the threshold value 211 can be confirmed.

  Here, in the process of editing on the server 102 side, when it is determined that high quality data is necessary for the video / audio data in the section lower than the predetermined bit rate, that is, the predetermined When it is determined that video / audio data in a section lower than the bit rate needs to be retransmitted, a re-transmission request is made to the transmission side, that is, the camera 101. In this case, after viewing the real-time transmission file on the server 102 side, it is determined that high quality data is necessary, and a retransmission request is made. Therefore, on the camera 101 side, the transmission bit rate of the wireless network is a threshold value. It is assumed that retransmission is performed even in a section that exceeds 211 or the important threshold value 711.

  FIG. 10 is a diagram showing a retransmission request playlist 1001 indicating a retransmission section when a retransmission request is made from the server 102 to the camera 101. As shown in FIG. 2, when requesting retransmission of video / audio data in a section from time t2 to time t3, for example, a retransmission request playlist 1001 as shown in FIG. 10 is transmitted from the server 102 to the camera 101. To do.

  The camera 101 receives the retransmission request playlist 1001 transmitted from the server 102 and records it on the first recording medium 113 by the first recording unit 112.

  The list interpretation unit 301 interprets the retransmission request playlist 1001 recorded on the first recording medium 113, identifies the section that needs to be retransmitted, and in the manner described in Embodiments 1 to 5, the video / Audio data is transmitted to the server 102.

  By performing the above-described control, it is possible to make a retransmission request for video / audio data in a predetermined section from the reception side (server 102) to the transmission side (camera 101).

  In this embodiment, the playlist as shown in FIG. 10 is used as the retransmission request playlist 1001, but any format can be used as long as it can indicate the section of the retransmission request. Or the format equivalent to the 1st play list 251 may be sufficient.

(Embodiment 7)
In Embodiments 1 to 6, when video / audio data is retransmitted, retransmission is performed in units of a predetermined section. In this embodiment, video / audio data is transmitted in units of arbitrary sections. Re-send. That is, in the first to sixth embodiments, video / audio data is recorded for the section from time t1 to time t6, and re-transmission is performed on the recorded video / audio data in accordance with the transmission bit rate of the wireless network. In the seventh embodiment, all the video / audio data in the section is retransmitted for the partial section in which the video / audio data is recorded. However, the video / audio data in a section in which the transmission bit rate is lower than the threshold value 211 and the video / audio data in a section in which the transmission bit rate is lower than the threshold value 211 are retransmitted as separate files. Further, in the sections other than the partial section, retransmission is performed according to the transmission bit rate of the wireless network.

  In this case, when an arbitrary section (from time ta to time tb) is set on the camera 101 side, a section start button and a section end button for designating the section (from time ta to time tb) for the camera 101, etc. It is assumed that the list creation unit 116 creates a playlist having the time ta and the time tb as IN / OUT points. This button may perform a toggle operation with one button. Further, when setting an arbitrary section on the server 102 side, the same configuration as in the sixth embodiment is required. Specifically, on the server 102 side, (1) a retransmission request playlist creation unit for creating a playlist for designating an arbitrary section of video / audio data desired to be retransmitted, and (2) the created retransmission A transmission unit that transmits the transmission request playlist to the camera 101 is required. On the camera 101 side, (1) a receiving unit that receives a retransmission request playlist from the server 102, and (2) interpreting the retransmission request playlist as a new function of the list interpretation unit 301, A function for reading video / audio data from the first recording medium 113 and transmitting it to the server 102 is required.

  FIG. 11 is a diagram illustrating an example of a third playlist 1151 indicating a relationship between a set arbitrary section (from time ta to time tb) and a transmission bit rate of the wireless network, and a retransmission file in this case. . For example, suppose that the camera 101 is divided into sections from time t1 to time t6 as shown in FIG.

At this time, as shown in FIG. 11, an arbitrary section (from time ta to time tb) is set.
When re-transmission is to be performed from the transmission side, that is, the camera 101 side (Embodiments 1 to 5), time ta and time tb are set in the camera 101.

  On the other hand, when a retransmission request is made from the receiving side, that is, the server 102 side (sixth embodiment), time ta and time tb are set on the server 102 side.

  At this time, it is assumed that time t2 and time t3 exist between time ta and time tb.

  At this time, the first playlist 251 is rewritten like the third playlist 1151 shown in FIG. 11 in consideration of the time ta and the time tb.

  The section from time ta to time t2, the section from time t2 to time t3, and each section from time t3 to time tb are each handled as a separate file in the manner of the first to sixth embodiments. Attach the list and re-send high-quality video / audio data.

  By performing the above-described control, it is possible to retransmit an arbitrary section of all recorded video / audio data.

  In the seventh embodiment, the section from time ta to time t2, the section from time t2 to time t3, and each section from time t3 to time tb are handled as separate files. The re-transmission file and the third playlist 1151 may be created using the section from time tb to time tb as one file.

  In the above-described example, the designation of an arbitrary section is acquired by detecting the button operation of the cameraman. However, an important scene is automatically detected from predetermined parameters of video / audio data being shot, and You may get a designation.

  For example, automatically when zooming up in the shooting process, when the volume of the sound is increased (when cheering is raised, etc.), when face recognition is detected when the camera has a face recognition function, etc. The designation of an arbitrary section may be acquired. Here, the list creation unit 116 and the list interpretation unit 301 are an example of “the specifying unit that acquires information for specifying a section in which the second video data is to be reproduced and specifies the acquired section as the partial section”. is there.

  Each functional block in the block diagrams (FIG. 1, FIG. 3, etc.) is typically realized as an LSI which is an integrated circuit. These may be individually made into one chip, or may be made into one chip so as to include a part or all of them. For example, the functional blocks other than the memory may be integrated into one chip.

  The name used here is LSI, but it may also be called IC, system LSI, super LSI, or ultra LSI depending on the degree of integration.

  Further, the method of circuit integration is not limited to LSI's, and implementation using dedicated circuitry or general purpose processors is also possible. An FPGA (Field Programmable Gate Array) that can be programmed after manufacturing the LSI or a reconfigurable processor that can reconfigure the connection and setting of circuit cells inside the LSI may be used.

  Further, if integrated circuit technology comes out to replace LSI's as a result of the advancement of semiconductor technology or a derivative other technology, it is naturally also possible to carry out function block integration using this technology. Biotechnology can be applied.

  In addition, among the functional blocks, only the means for storing the data to be encoded or decoded may be configured separately instead of being integrated into one chip.

  The present invention relates to a system that requires real-time transmission via a wireless network at the time of video / audio data shooting, among them, a system that requires high-quality data transmission, specifically broadcasting, particularly quick editing. This is particularly effective for broadcast and commercial camera systems for news programs that require a large amount of information.

It is a block diagram which shows the structure and data flow of a video transmission system including the video transmission apparatus of this invention. It is a figure which shows an example of the play list which shows the change of the communication condition (bit rate) detected by a communication condition detection part, and the reproduction | regeneration method of the video / audio data according to a communication condition. It is a block diagram of the video transmission system which shows the data flow at the time of data resending. It is a figure which shows an example of the playlist which shows the change of the communication condition (bit rate) detected by the communication condition detection part at the time of data retransmission, and the necessity of resending of video / audio data according to a communication condition. As in the example shown in FIG. 4, the camera performs compression encoding of video / audio data in a section from time t2 to time t3 and compression encoding of video / audio data in a section from time t4 to time t5. It is a figure which shows an example of the data recording condition of the server side at the time of retransmitting data. It is a figure which shows the bit rate at the time of reproducing | regenerating the video / audio data from a camera according to the 1st play list shown in FIG. It is a figure which shows the relationship between the threshold value at the time of setting an important area using an important button and an importance cancellation | release button, an important threshold value, and a 1st play list. It is a figure which shows the relationship between the bit rate change at the time of real-time transmission when the data transmission of a wireless network stops temporarily, and the resend file and 1st play list with respect to it. It is a figure which shows an example of the 2nd playlist in the case of transmitting a resending data file and a playlist file from the apparatus different from a camera. It is a figure which shows the resending request | requirement playlist which shows the resending area | region at the time of making a resending request | requirement to a camera from a server. It is a figure which shows the example of the 3rd playlist which shows the relationship between the set arbitrary area (from time ta to time tb) and the transmission bit rate of a wireless network, and the retransmission file in this case.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Camera 102 Server 103 Transmitter 104 Receiver 111 Image pick-up part 112 1st recording part 113 1st recording medium 114 Transmission part 115 Communication condition detection part 116 List preparation part 117 Recording encoding part 118 Transmission encoding part 121 Receiving part 122 2 recording unit 123 second recording medium 211 threshold 251 first playlist 301 list interpretation unit 311 playback unit 501 first real-time transmission file 502 first retransmission file 503 second retransmission file 504 first playlist file 511 first reproduction Target section 512 Second playback target section 711 Important threshold 801 Second real-time transmission file 802 Third retransmission file 804 Second playlist file 811 Third playback target section 812 Fourth playback target section 951 Second playlist 10 01 retransmission request playlist 1151 third playlist

Claims (6)

A video transmission device that records the acquired video on a recording medium and transmits the video to a reception device via a transmission path,
A video data acquisition unit for acquiring video data;
A video data converter that converts the acquired video data into first video data and second video data having higher image quality than the first video data;
A first video data transmission unit that transmits the first video data to the reception device via a transmission path;
In parallel with the transmission of the first video data, a video data recording unit that records the second video data on a recording medium;
A specifying unit for specifying one partial section in the first video data;
A second video data transmitting unit that transmits video data of a partial section corresponding to the partial section specified by the specifying unit in the second video data to the receiving device as one file;
When reproducing the first video data, reproduction order information generation for generating reproduction order information indicating that the file of the second video data should be reproduced in the partial section specified in the first video data. And
A video transmission apparatus comprising: a reproduction order information transmission unit that transmits the generated reproduction order information to the reception apparatus. The video transmission device includes:
A communication status detection unit that detects a transmission bit rate indicating a communication status of the transmission path, and dynamically determines a threshold value for identifying the partial section from the detected transmission bit rate;
The specifying unit specifies a time point when a transmission bit rate of the transmission path is lower than the threshold value determined by the communication status detection unit as a start point of the partial section, and a time point when the transmission bit rate is equal to or higher than the threshold value. The video transmission device according to claim 1, wherein the video transmission device is identified as an end point of the partial section. The video transmission device includes:
In the acquired video data, an important section that satisfies a specific condition, and an important section determination unit that determines the importance of the important section,
The identifying unit compares the threshold value, which is larger as the importance degree is higher, with the transmission bit rate of the transmission path according to the importance degree of the important section, and compares the importance degree in the important section. The video transmission device according to claim 1, wherein a section in which the transmission bit rate is lower than the threshold corresponding to is specified as the partial section. The video transmission device according to claim 1, wherein the specifying unit acquires information for specifying a section in which the second video data is to be reproduced, and specifies the acquired section as the partial section. A video transmission method for recording an acquired video on a recording medium and transmitting the acquired video to a receiving device via a transmission path,
A video data acquisition step for acquiring video data;
A video data conversion step of converting the acquired video data into first video data and second video data having higher image quality than the first video data;
A first video data transmission step of transmitting the first video data to the receiving device via a transmission path;
A video data recording step of recording the second video data on a recording medium in parallel with the transmission of the first video data;
A specifying step of specifying one partial section in the first video data;
A second video data transmission step of transmitting video data of a partial section corresponding to the partial section specified by the specifying unit in the second video data to the receiving device as one file;
When reproducing the first video data, reproduction order information generation for generating reproduction order information indicating that the file of the second video data should be reproduced in the partial section specified in the first video data. Steps,
A video transmission method comprising: a reproduction sequence information transmitting step of transmitting the generated reproduction sequence information to the receiving device. A program for a video transmission device that records the acquired video on a recording medium and transmits the video to a reception device via a transmission path, the computer using a video data acquisition unit that acquires video data, and the acquired video data Is converted to first video data and second video data having higher image quality than the first video data, and the first video data is transmitted to the receiving device via a transmission path. In parallel with the transmission of the first video data, a video data recording unit for recording the second video data on a recording medium, and one partial section in the first video data. The specifying unit to be specified and the video data of the partial section corresponding to the partial section specified by the specifying unit in the second video data are transmitted as one file to the receiving device. A second video data transmission unit that reproduces the file of the second video data in the partial section specified in the first video data when the first video data is reproduced. A program for functioning as a reproduction order information generation unit that generates order information and a reproduction order information transmission unit that transmits the generated reproduction order information to the receiving device.

Images