JP4582112B2 - Data processing apparatus, data processing method, program, and recording medium - Google Patents

Description

The present invention relates to a data processing device, a data processing method, a program, and a recording medium . Specifically, a stream obtained by encoding video data, frame rate information indicating a frame rate set when the video data is generated, and restriction information for restricting a reproduction operation set on the video data presentation side are acquired, and this When playing back video data, if the playable speed range is indicated by the acquired restriction information, the play speed of the video data can be automatically switched to the playable speed range indicated by the restriction information and restricted. It is what you want to do.

  In conventional broadcasting, by inserting commercials, which are promotional content, into program content such as dramas, movies, or sports, it is possible to efficiently advertise to viewers who view the content in real time. Has been made.

  On the other hand, a device for recording and reproducing content, such as a video tape recorder, has a function of automatically detecting and skipping an inserted commercial part when reproducing recorded content as shown in Patent Document 1, for example. Is provided. By using this function, the viewer can view the program content continuously without being interrupted by the promotional content.

JP 2000-115712 A

  By the way, with the advancement of digital technology, the widening of communication networks, and the reduction in communication charges, main data including at least one of digitalized images and audio, for example, content including at least one of content images and audio Distribution of data interactively via a communication network has been put into practical use.

  In the distribution of content data via this communication network, the content data that has been distributed is temporarily stored in a buffer and then played back, so that fluctuations (variations in data arrival) that occur in the communication network are absorbed and content playback continues. To be able to do it. In addition, with the advancement of data compression technology and the widening of communication networks, it has become possible to distribute content with high image quality.

  When reproducing the content distributed in this way, since the content data is stored in the buffer, not only the frame images supplied from the broadcasting station side as in the case of broadcasting, but also the desired image is displayed. A frame can be selected and played back. For example, in a content portion that is not desired to be viewed, playback operations such as fast forward and skip can be performed by thinning out and skipping frames.

  However, if playback operations such as fast-forward and skip are enabled at the time of content distribution, even if content such as commercials is inserted, this commercial can be fast-forwarded or skipped from the beginning, and advertisements by the inserted commercials You won't get any effect.

Therefore, the present invention provides a data processing device, a data processing method, a program, and a recording medium that can easily regulate the reproduction speed of video data .

The data processing device according to the present invention is set from an external device to video data including program content and promotional content, a set frame rate when the video data is generated, and a value smaller than the set frame rate. A reference frame rate that is a frame rate for reproducing the video data, and when reproducing the video data, for identifying whether the video data being reproduced is the program content or the advertising content An identification value calculation unit that calculates an identification value that is a product of a ratio of the reference frame rate to the set frame rate and a magnification of the reproduction speed set by the user, and an acquisition unit that acquires auxiliary information including restriction information If the identification value is greater than 1, in the video data, Reproducing means for reproducing the video data in the magnification of the playback speed the reading frame of the video data for each number corresponding to the integer part of the identification values, on the basis of the restriction information, playing in the magnification of the playback speed Confirming whether the video data is the program content or the promotional content, and confirming that the video data being played back at the playback speed magnification is the promotional content, the playback speed magnification And a control means for changing the value to 1 times.

In the data processing method according to the present invention, the acquisition means has video data including program content and promotional content from an external device, a set frame rate when the video data is generated, and a value smaller than the set frame rate. A reference frame rate that is set and a frame rate for reproducing the video data and whether the video data being reproduced is the program content or the advertising content when the video data is reproduced. The step of obtaining attached information including restriction information for identification, and the identification value calculation means are a product of a ratio of the reference frame rate to the set frame rate and a magnification of the reproduction speed set by the user. A step of calculating an identification value; and a reproducing means, wherein the identification value is greater than 1. Then, in the video data, the step of reading the video data frame by the number corresponding to the integer part of the identification value and reproducing the video data at a magnification of the reproduction speed, and the control means includes the restriction information The video data being played back at the playback speed magnification is checked whether it is program content or the promotional content, and the video data being played back at the playback speed magnification is the promotional content. Confirming that, the step of changing the magnification of the reproduction speed to 1 is included.

The program according to the present invention is set in a computer from an external device, video data including program content and promotional content, a set frame rate when the video data is generated, and a value smaller than the set frame rate And a reference frame rate, which is a frame rate for reproducing the video data, and when the video data is reproduced, the video data being reproduced is identified as the program content or the advertising content. A process of obtaining the attached information including the restriction information, a process of calculating an identification value that is a product of a ratio of the reference frame rate to the set frame rate and a magnification of the reproduction speed set by the user, If the identification value is greater than 1, in the video data, A process of reading the frame of the video data for each number corresponding to an integer part of another value and playing the video data at the playback speed magnification, and based on the restriction information, playing back at the playback speed magnification After confirming whether the video data is program content or the promotional content, and confirming that the video data being reproduced at the reproduction speed magnification is the promotional content, the reproduction speed magnification is set. The process of changing to 1 time is executed.

The recording medium according to the present invention is set in a computer from an external device, video data including program content and promotional content, a set frame rate when the video data is generated, and a value smaller than the set frame rate. In addition, when reproducing the video data, a reference frame rate that is a frame rate for reproducing the video data and whether the video data being reproduced is the program content or the advertising content are identified. A process of obtaining additional information including restriction information for calculating an identification value that is a product of a ratio of the reference frame rate to the set frame rate and a magnification of a playback speed set by a user; If the identification value is greater than 1, in the video data, the identification value. A process of reading the frame of the video data for each number corresponding to the integer part of the value and reproducing the video data at a magnification of the reproduction speed; and based on the restriction information, the reproduction being performed at the reproduction speed magnification When it is confirmed whether the video data is the program content or the promotional content, and it is confirmed that the video data being played back at the playback speed magnification is the promotional content, the playback speed magnification is set to 1. And a program for executing the process of changing to double .

According to this invention, in the video data being played back at the playback speed set by the user, the playback speed is changed from the speed set by the user when the program content is changed to the advertising content. It can be changed to 1 time. Thereby, it is possible to always reproduce the advertising content portion of the video data at a normal reproduction speed instead of fast-forwarding. As a result, during the reproduction of the video data, the quality desired by the video data providing side (external device side) can be maintained for the advertising content portion. Therefore, there is an effect that it is possible to give a desired advertisement effect on the video data providing side to a user who browses the video data.

  Embodiments of the present invention will be described below. FIG. 1 shows a content providing system in which content including at least one of image and sound is generated and distributed through broadcasting, distribution, or recording media, and the content can be viewed.

  In FIG. 1, a signal reproducing device 20 reproduces a recording medium at a speed based on the reproduction instruction signal PC supplied from the editing device 30, and generates reproduction data DTk of an image or sound with less noise to produce the editing device 30. To supply.

  The editing device 30 supplies the reproduction instruction signal PC to the signal reproduction device 20 and performs an editing process using the reproduction data DTk supplied from the signal reproduction device 20. The reproduction data DTk is data of a set frame rate that is the speed indicated by the reproduction instruction signal PC. Also, auxiliary information including frame rate information is generated based on the playback instruction signal PC and is linked to the playback data DTk to perform editing processing, and content data DC for broadcasting or distribution is generated and output. The concatenation referred to here may be any state as long as data and attached information including frame rate information related to the data are linked to each other. For example, even if they are recorded on different recording media or transmitted on different transmission paths, if the frame numbers corresponding to the attached information are included, they will be associated with each other later. Can do. In this embodiment, it is said that the connection includes such a case.

  The editing device 30 generates a video signal Svm related to editing and supplies it to the edited image display device 40, thereby confirming the editing progress of the image, the editing result, and the like by the display image on the edited image display device 40. Similarly, an audio signal Sam related to editing is generated and supplied to the edited audio output device 41, so that the audio editing process and editing results are confirmed by the audio output from the edited audio output device 41.

  The content sending device 50 stores the content data DC supplied from the editing device 30. Also, for example, when content data is requested from the content reproduction device 70, the frame rate (hereinafter referred to as “output frame rate”) for outputting the content data is adjusted according to the bandwidth of the transmission path 60, and this output frame Transmission data DTz is generated based on the rate-adjusted content data, and the transmission data DTz is supplied to the content reproduction device 70 via a wired or wireless transmission path 60.

  The content reproduction device 70 generates a video signal Svz and an audio signal Saz of the content based on the transmission data DTz supplied via the transmission path, and supplies the content video signal Svz and the audio signal Saz to the content presentation device 80. Also, the content reproduction operation is controlled based on the attached information. The content presentation device 80 presents content by performing image display based on the video signal Svz and audio output based on the audio signal Saz.

  FIG. 2 shows a configuration of a signal reproducing device 20 that reproduces a recording medium on which material data used for generating content data is recorded at a reproduction speed corresponding to the reproduction instruction signal PC, for example, at a reproduction speed corresponding to the reproduction instruction signal PC. The configuration of a video tape recorder of the dynamic tracking (trademark of Sony Corporation) system that can reproduce and obtain reproduction data DTk of an image with less noise is shown.

  The input image and / or audio data DRin is supplied to the encoder 201. The encoder 201 uses the supplied data DRin to perform error correction code generation, data shuffling, multiplexing, channel coding, and the like based on an operation control signal CTM supplied from a recording / playback control unit 215 described later. The recording signal SW is generated. Further, the generated recording signal SW is supplied to the changeover switch 202.

  The changeover switch 202 is supplied with a changeover control signal CTW from the recording / reproduction control unit 215, and the operation of the changeover switch 202 is controlled based on the changeover control signal CTW, so that the record signal SW is changed to the record amplification unit 203a or the record amplification. To the unit 203b.

  The recording amplifier 203a amplifies the supplied recording signal SW and supplies it to the magnetic head 204a. The recording amplifier 203b amplifies the supplied recording signal SW and supplies it to the magnetic head 204b. As described above, by supplying the amplified recording signal SW to the magnetic heads 204a and 204b provided on the rotating drum (not shown), an image and / or a magnetic tape (not shown) is supplied. Record audio.

  Further, signals recorded on the magnetic tape are read by the magnetic heads 204a and 204b, and the signals obtained from the magnetic head 204a are supplied to the reproduction amplification unit 205a. The signal obtained from the magnetic head 204b is supplied to the reproduction amplification unit 205b.

  The magnetic heads 204a and 204b have a phase difference of 180 degrees with respect to the rotation direction, and are attached to the rotating drum via bimorphs 211a and 211b which are electromechanical conversion elements. For example, sawtooth drive voltages BMa and BMb are supplied from the bimorph control unit 212 to the bimorphs 211a and 211b, and the magnetic heads 204a and 204b are moved in a direction orthogonal to the rotation direction based on the drive voltages BMa and BMb. Displace.

  The reproduction amplification unit 205a amplifies the signal supplied from the magnetic head 204a and supplies the amplified signal to the terminal a of the changeover switch 206. The reproduction amplifier 205b amplifies the signal supplied from the magnetic head 204b and supplies the amplified signal to the terminal b of the changeover switch 206. A terminal c of the changeover switch 206 is connected to the decoder 207.

  The changeover switch 206 is supplied with a changeover control signal CTR from the recording / reproduction control unit 215. The operation of the changeover switch 206 is controlled based on the changeover control signal CTR, and the signals output from the reproduction amplification units 205a and 205b. Is selected and supplied to the decoder 207 as a reproduction signal SR. The reproduction signal SR is supplied to the bimorph control unit 212. The decoder 207 performs decoding of the reproduction signal SR, data separation, deshuffling, error correction processing, and the like based on the operation control signal CTM supplied from the recording / reproduction control unit 215, and generates image and / or audio reproduction data DTk. Generate and output. The reproduction data DTk includes information such as a time code.

  The bimorph control unit 212 identifies whether the magnetic heads 204a and 204b are correctly tracing on the track of the magnetic tape based on the reproduction signal SR, and drives the drive voltage BMa so that the magnetic heads 204a and 204b correctly trace on the track. , BMb are generated and supplied to the bimorphs 211a and 211b. For this reason, even if the reproduction speed is varied, a dynamic tracking operation capable of correctly tracing the track of the magnetic tape is performed, and a good variable speed reproduction image with little noise can be obtained.

  A user interface unit 216 is connected to the recording / playback control unit 215, and the switching control signal is based on the operation signal PSv supplied from the user interface unit 216 and the operation signal PSw supplied from an external device such as the editing device 30. An operation control signal CTM for controlling the operations of CTW, CTR, encoder 201 and decoder 207 is generated. The recording / reproducing control unit 215 also performs drive control of the magnetic tape and the rotary head. Further, the recording / reproduction control unit 215 performs drive control of the magnetic tape and the rotary head based on the reproduction instruction signal PC supplied from the editing device 30 and sets the frame rate that is the speed indicated by the reproduction instruction signal PC. The reproduction data DTk with less FRs noise is generated and supplied to the editing apparatus 30. In addition, the recording / playback control unit 215 displays information on the operation state and the recording / playback operation on the display unit 217.

  FIG. 2 shows the configuration of a dynamic tracking video tape recorder as the signal reproducing device 20, but disc-like recording using light or magnetism can be used as long as it can obtain a variable speed reproduced image with little noise. It may be a signal reproducing device using a medium or a semiconductor memory.

  Next, the editing device 30 will be described. FIG. 3 shows the configuration of the editing device 30. The reproduction instruction circuit 311 of the material fetching unit 31 generates a reproduction instruction signal PC based on a control signal RS supplied from an editing control unit 33 described later, and supplies the reproduction instruction signal PC to the signal reproduction device 20. The playback speed and playback position are instructed to start the playback operation. Also, the frame rate information DM- is set as the attached information DM including the frame rate information DM-FRs based on the playback instruction signal PC, that is, the set frame rate FRs indicating the speed indicated by the playback instruction signal PC is used as the frame rate information DM-FRs. The attached information DM including FRs is supplied to the database processing circuit 312.

  When the reproduction data DTk having the set frame rate FRs based on the reproduction instruction signal PC is supplied from the signal reproduction device 20, the reproduction data DTk is supplied to the database processing circuit 312.

  The database processing circuit 312 associates the accessory information DM with the video data DV and audio data DA constituting the reproduction data DTk, and stores them as material data in the data storage device 321 of the editing processing unit 32. Further, the database processing circuit 312 generates a database information DB that enables easy confirmation of the content of the material data based on the reproduction data DTk that constitutes the material data stored in the data storage device 321 to generate the editing control unit 33. To supply. For example, the database information DB is composed of information (such as thumbnails) that can identify the content of material data, information such as a set frame rate FRs, a storage position in the data storage device 321, and the like. Furthermore, the database information DB can also be configured using information indicating the length of time during which reproduction has been performed based on the reproduction instruction signal PC, time code information of the reproduction data DTk, and the like. Further, when various information such as a time code is included in the reproduction data DTk, the database processing circuit 312 may include the information included in the reproduction data DTk if this information is included in the auxiliary information DM. Can be used during or after editing.

  The editing control unit 33 generates video data DVg for enabling editing processing in a GUI (Graphical User Interface) environment and video data DVi for displaying the contents of database information, and a video output signal generation circuit 351. To supply. The video output signal generation circuit 351 generates a video signal Svm based on the supplied video data DVg and DVi and outputs it to the edited image display device 40. In this way, by supplying the video signal Svm to the edited image display device 40, what kind of material data is stored can be displayed on the screen of the edited image display device 40.

  The edit control unit 33 controls post-production processing. That is, the user interface unit 34 connected to the editing control unit 33 is supplied with the operation signal PSe using display in the GUI environment, and indicates that any material data is selected by the operation signal PSe. Sometimes, a read control signal RC corresponding to the operation signal PSe is generated and supplied to the writing / reading processing circuit 322 of the editing processing unit 32. When the operation signal PSe relates to editing operations such as processing and combining of the read material data, an edit control signal ET corresponding to the operation signal PSe is generated and supplied to the signal editing circuit 323 of the edit processing unit 32. . Further, when the editing of the material data is completed and the content data is completed, when the operation signal PSe indicates an operation for storing the content data in the data storage device 321, the write control signal WC corresponding to the operation signal PSe is displayed. Is supplied to the writing / reading processing circuit 322. When the operation signal PSe indicates the output of content data, an output control signal RP corresponding to the operation signal PSe is generated and supplied to the writing / reading processing circuit 322. When the operation signal PSe defines the playback speed range of the content data, a speed range setting signal LP corresponding to the operation signal PSe is generated and supplied to the signal editing circuit 323.

  Based on the read control signal RC, the write / read processing circuit 322 reads the requested material data from the data storage device 321 and supplies it to the signal editing circuit 323. Further, the completed content data DC is stored in the data storage device 321 based on the write control signal WC. Further, based on the output control signal RP, the requested content data DC is read from the data storage device 321 and output.

  The signal editing circuit 323 uses the video data DV and / or audio data DA included in the material data read from the data storage device 321 to perform editing processing such as image and audio processing, combination, and deletion as an edit control signal. Based on ET. In this editing process, the data is processed and combined without reducing the frame rate of the video data DV and audio data DA, which are the materials, and content data is generated without reducing the image density on the time axis. . Here, the signal editing circuit 323 supplies the video data DVe before, during or after editing to the video output signal generation circuit 351, and the audio data DAe before, during or after editing as an audio output signal generation circuit. 352.

  The signal editing circuit 323 has an identification function, a correction function, and a connection function, performs editing processing according to the operation signal PSe from the user interface unit 34, and changes the frame rate of the video data DV and the audio data DA. When the limitation of the reproduction operation is identified, the attached information DM is also corrected in accordance with the edited video data and audio data. Further, when the speed range setting signal LP corresponding to the operation signal PSe as the instruction information is supplied, the signal editing circuit 323 indicates a speed range indicating the reproducible speed range of the content data DC based on the speed range setting signal LP. The information is identified as restriction information DMc-LM that restricts the content reproduction operation and is included in the attached information DMc.

  The reproducible speed range is set so that a natural reproduced image can be obtained without noise by performing thinning at a constant frame interval or repeating frames. For example, when a multiple of the set frame rate FRs with respect to the reference frame rate FRr is greater than 1, the reproducible speed can be set by obtaining a divisor other than this multiple 1 and calculating the reciprocal of the obtained divisor. That is, when the set frame rate FRs is 10 times the reference frame rate, the divisor other than 1 is “2, 5, 10”, and the reciprocal of this divisor “1/10, 1/5, 1/2”. It becomes. By selecting the reciprocal of this divisor, a reproducible speed less than 1 × speed can be set. Further, by setting the reproducible speed of 1 × speed or more to a natural number multiple, the thinning intervals performed at each playback speed can be made equal. The upper limit of the reproducible speed is limited to a speed at which the content of the material data can be easily grasped, for example.

  When the multiple of the set frame rate FRs with respect to the reference frame rate FRr is smaller than 1, the reproducible speed can be set by calculating the reciprocal of this multiple and calculating the divisor other than 1 or the integral multiple of the reciprocal. . That is, when the set frame rate FRs is (1/6) times the reference frame rate, the divisor other than 1 is “2, 3, 6” and the integral multiple of the reciprocal is “6, 12, 18”. , ... " If the reciprocal number other than 1 or an integral multiple of the reciprocal number is set as the reproducible speed, the thinning interval or the number of repetitions performed at each reproduction speed can be made equal. Further, even when the playback speed is set to (1 / FRs) or less when the multiple of the set frame rate FRs is smaller than 1, the playback image is a frame image repeated a predetermined number of times. 1 / FRs) double speed, or a single speed that is the basic speed, although it is possible to repeat several times.

  When the content title and the recommended playback speed of the content are input from the user interface unit 34 by the operation signal PSe, the signal editing circuit 323 also connects these pieces of information as the attached information DMc. Further, when the reproduction time length information of the content data is obtained by the editing process, this information may be linked as the attached information DMc.

  Further, when a content title or the like is input from the user interface unit 34, the signal editing circuit 323 also links this information as attached information DMc. Further, when the reproduction time length information of the content data is obtained by the editing process, this information may be linked as the attached information DMc.

  Furthermore, the signal editing circuit 323 prohibits fast-forward playback and skip playback, for example, in the restriction information DMc-LM that restricts the playback operation of the content in order to achieve the desired quality of content presentation on the viewer side. Information on speed, information for setting display size and image resolution to desired values, and the like are included.

The signal editing circuit 323 uses the edited video data DV and / or audio data DA as main data, and when the restriction information DMc-LM corresponding to the main data is identified, the signal editing circuit 323 includes the additional information indicating the restriction information DMc-LM. Output content data DC is generated by concatenating DMc with main data. As described above, the attached information DMc includes frame rate information DM-FRs indicating the set frame rate FRs corresponding to the main data.

  The output content data DC generated in this way is output from the writing / reading processing circuit 322. The main data and the attached information DMc may be connected by the write / read processing circuit 322.

  As described above, the video output signal generation circuit 351 of the editing output signal generation unit 35 generates the video signal Svm based on the video data DVg and DVi supplied from the editing control unit 33 and supplies the video signal Svm to the edited image display device 40. . For this reason, information regarding material data can be displayed in the GUI environment. Further, the video output signal generation circuit 351 generates a video signal Svm based on the video data DVe supplied from the signal editing circuit 323. Thereby, the user can confirm the image before editing, during editing, or after editing on the screen of the edited image display device 40.

  The audio output signal generation circuit 352 converts the audio data DAe supplied from the signal editing circuit 323 into an analog audio signal Sam and uses an edited audio output device configured as a desired signal level using, for example, a speaker or headphones. 41. For this reason, the user can confirm the sound before editing, during editing, or after editing by the sound output from the edited sound output device 41.

  In this way, post-production processing using the auxiliary information DM based on the reproduction data DTk and the reproduction instruction signal PC is performed to generate main data including at least one of a desired image or sound, and the reproduction operation at the time of reproduction is limited. When the output content data DC is completed by concatenating the attached information indicating the restriction information, the output content data DC is output from the editing device 30. Here, when supplying the content data DC to the viewer side, the content data DC is transmitted via a transmission path, or the content data DC is recorded on a data recording medium, and the data recording medium is distributed to distribute the content data DC. DC can be supplied. For this reason, as the output of the content data DC, data transmission via a transmission path and data recording on a data recording medium are performed.

  When data transmission is performed, for example, output content data DC is supplied from the writing / reading processing circuit 322 to the content transmission device 50 and supplied from the content transmission device 50 to the content reproduction device 70 on the viewer side. When data recording is performed, the content data DC for output is recorded by a write / read processing circuit 322, for example, on a disk-shaped recording medium using light or magnetism, or a data recording medium such as a magnetic tape or a semiconductor memory. If the content data menu information and special playback information such as a search operation in the reverse time direction are recorded together on the data recording medium, the desired content data recorded on the data recording medium can be easily obtained. Can be played. Also, content data can be efficiently recorded by compressing the data amount by encoding image and / or audio data. Furthermore, if a data recording medium that cannot change the recorded data is used, the attached information is not changed on the viewer side, and the reproduction operation of the main data is surely restricted according to the restriction information. it can.

  FIG. 4 shows the configuration of the content transmission device 50. The distribution content data DC supplied from the editing device 30 is supplied to the writing processing unit 51. The write processing unit 51 is connected to the content storage circuit 521 of the transmission data generation unit 52 and causes the content storage circuit 521 to store the supplied content data for distribution. Note that the content data DC is not limited to that supplied from the editing device 30, and image or audio data supplied from an imaging device or another signal reproduction device may be used. In this case, when restricting the reproduction operation of the supplied image or sound data, a user interface unit (not shown) is provided to input the instruction information. Whether or not the restriction information for restricting the reproduction operation of the main data is indicated is identified, and when the restriction information is identified, the attached information indicating the restriction information is connected to the main data to be the content data DC. .

  The transmission data generation unit 52 generates transmission data DTz based on the content data DC. A read processing circuit 522 is connected to the content storage circuit 521 of the transmission data generation unit 52, and the read processing circuit 522 transmits band information WB and content of a transmission path when transmitting content data for distribution. A content request signal RQ from the playback device side is supplied from a transmission processing unit 53 described later.

  The read processing circuit 522 controls the reading of the requested content data based on the band information WB and the attached information DMc of the requested content data DC stored in the content storage circuit 521, adjusts the output frame rate, The content data DCza after the output frame rate adjustment is supplied to the information correction circuit 523.

  Further, the read processing circuit 522 generates content data DCza by inserting data such as promotional content during the requested content data read processing. Data such as advertising content may be stored in the content storage circuit 521 in advance. The read processing circuit 522 may be supplied from an external device (not shown). In these cases, even when the content data supplied from the editing device 30 does not include promotional content or the like, the promotional content or the like can be inserted when the content is sent to the viewer. Further, when the inserted advertisement content or the like is to be presented with a desired quality, the attached information including the restriction information DMc-LM that restricts the reproduction operation is connected to form the content data such as the advertisement content.

  Next, output frame rate adjustment will be described. The output frame rate adjustment is performed with reference to the restriction information DMc-LM. A content part in which the restriction information DMc-LM is not included in the attached information DMc is a part that can adjust the output frame rate, and a content part in which the restriction information DMc-LM is included can be presented with a desired quality. The output frame rate adjustment is limited so that it can be performed.

  In the output frame rate adjustment, for example, the data amount for one frame when encoding processing is performed by an encoder 524 described later is BDbit, and the set frame rate FRs indicated by the attached information DMc is n (n is the reference frame rate FRr). When the value is (positive value) times, the data amount BT transmitted per unit time is “BT = BD × n × FRr + BH”. The data amount BH collectively indicates header information added when content data is packetized and transmitted.

  Here, when the bandwidth BA indicated as the amount of data that can be transmitted by the bandwidth information WB is not smaller than the data amount BT, the output frame rate adjustment of the content data is not performed, and the content data is transferred from the content storage circuit 521. The data is sequentially read and supplied to the information correction circuit 523. In addition, when the bandwidth BA is smaller than the data amount BT, for the video data of the content data, the data amount is reduced by adjusting the output frame rate, and the playback image is interrupted due to the delay in the transmission of the content data. To prevent. For example, a multiple “m” of the set frame rate FRs with respect to the reference frame rate FRr is identified from the set frame rate FRs indicated by the frame rate information DMc-FRs included in the attached information DMc and the reference frame rate FRr. Further, a divisor of the identified multiple “m” is obtained and multiplied by the maximum value of the divisor excluding “m” and the reference frame rate FRr to obtain an adjusted set frame rate. That is, when “m = 10”, since the maximum value of the divisor is “5”, the output frame rate is adjusted to “m = 5”. In this output frame rate adjustment, content data having a frame rate five times the reference frame rate FRr is generated by reading content data every other frame. Further, when “m = 9”, the content data after adjusting the output frame rate is generated by adjusting to “m = 3” and reading the content data every two frames. Further, when the adjusted data amount BT is larger than the bandwidth BA, the frame rate is further adjusted. In this way, if the adjusted output frame rate is determined using the maximum value of the divisor excluding “m”, the output frame rate can be simply adjusted by thinning out in units of frames when reading the content data. Content data can be generated.

  After that, even when “m = 1”, when the adjusted data amount BT is larger than the bandwidth BA, the data amount BT is further reduced by performing frame thinning so that “m = 1 / k” (k: natural number). Less. When the bandwidth BA changes, the frame rate is varied according to the change in the bandwidth BA.

  Note that the audio data of the content data is subjected to sample thinning according to the output frame rate adjustment for the video data, and the audio data after the output frame rate adjustment is generated. For example, when video data is read every other frame, audio data is read every other sample. When video data is read every two frames, the audio data is read every two samples to generate audio data after adjusting the output frame rate.

  When the output frame rate is adjusted by the read processing circuit 522, the information correction circuit 523 corrects the auxiliary information DMza of the content data DCza so as to correspond to the adjusted output frame rate, and corrects the output frame rate. The attached information DMz is shown. Further, the content data DCz connected to the attached information DMz is supplied to the encoder 524. For example, when “m = 10” is adjusted to “m = 5”, the setting frame rate FRs is changed from “× 10” to “× 5”, and the setting frame rate FRs is “× 10”. The frame rate information DMc-FRs indicating this is changed to the frame rate information DMz-FRs indicating that the set frame rate FRs is “× 5” to be the attached information DMz.

  The encoder 524 encodes the supplied content data DCz, encodes the video data DVz and the audio data DAz into signals suitable for transmission, and generates encoded data DZ. For example, a signal suitable for streaming delivery is encoded using an encoding method standardized as MPEG (Moving Picture Experts Group) 4. The attached information DMz is concatenated with the encoded data DZ obtained by this encoding process, and is supplied to the transmission processing unit 53 as transmission data DTz. In this way, content data can be transmitted efficiently by performing the encoding process. Also, the encoder 524 sets the data compression rate in the encoding process to a low level when the attached information DMz including the restriction information DMc-LM is connected, thereby degrading the image quality of the portion where the output frame rate adjustment is restricted. Can be reduced.

  When the content data is requested by the transmission signal TMrq supplied from the content reproduction device 70, the transmission processing unit 53 supplies the content processing signal RQ indicating the requested content data to the reading processing circuit 522. Further, the transmission processing unit 53 generates band information WB related to the band of the transmission path 60 and supplies it to the read processing circuit 522. Further, based on the request for content data, the transmission processing unit 53 uses the transmission data DTz supplied from the encoder 524 as a transmission signal TMz of a predetermined protocol to request the content data via the transmission path 60. 70.

  Note that, for example, the transmission processing unit 53 is configured using a network device such as a router, and traffic information that can be obtained from a management information base (MIB) possessed by the network device is used as the bandwidth information WB. it can. Further, it is also possible to identify a band by transmitting a measurement packet to the content reproduction apparatus 70 and measure a response time from the content reproduction apparatus 70 and use the identification result as the band information WB.

  In addition to adjusting the frame rate of the portion where the output frame rate adjustment of the read processing circuit 522 is not limited based on the band information WB, the data amount is changed by changing the data compression rate by the encoder 524 based on the band information WB. The BT may be varied according to the bandwidth BA. In this case, since the amount of data can be controlled more finely, it is possible to reduce deterioration in the quality of transmitted images and sounds even when the bandwidth BA is narrowed. Furthermore, during the frame period in which the set frame rate FRs continues to be equal, the adjusted frame rate can be kept constant regardless of the band information WB, and the data amount BT can be adjusted by the encoder 524. In this case, it is possible to prevent the content portion set to a desired frame rate by the editing device 30 from being adjusted to a different output frame rate according to the bandwidth BA. Note that the output frame rate adjustment is not limited to the case of being performed by the content transmission apparatus. For example, when the content data DC is output from the editing device 30 described above, the frame rate and attached information of the content data can be corrected.

  Incidentally, the content transmission processing of the content transmission device 50 described above can also be realized by software processing using a computer. FIG. 5 shows a configuration when content is transmitted by this software processing.

  The computer includes a CPU (Central Processing Unit) 551 as shown in FIG. 5, and a ROM 552, a RAM 553, and a hard disk drive having a large storage capacity are used for the CPU 551 via a bus 560. The data storage unit 554 and the input / output interface 555 configured as described above are connected. Further, a signal input unit 561, a communication unit 562, and a recording medium drive 563 are connected to the input / output interface 555.

  The CPU 551 executes a program stored in the ROM 552, the RAM 553, or the data storage unit 554 to perform content transmission processing. The content data input to the signal input unit 561 is stored in the data storage unit 554 via the input / output interface 555 and the bus 560. Further, when the content request signal RQ is supplied via the communication unit 562, the CPU 551 reads out the requested content data from the content data stored in the data storage unit 554, and controls this reading. The output frame rate is adjusted so that the content data has a data amount corresponding to the transmission path 60. Further, encoding suitable for transmission is performed to generate transmission data DTz. The generated transmission data DTz is output via the communication unit 562.

  Note that the program for performing the content transmission processing is stored in advance in the ROM 552 and the data storage unit 554, or the program for content transmission processing is recorded on the recording medium or recorded on the recording medium by the recording medium drive 563. It is also possible to read and execute the existing program. Furthermore, the program may be transmitted or received by the communication unit 562 via a wired or wireless transmission path, and the received program may be executed by a computer.

  FIG. 6 is a flowchart showing the content transmission processing operation. In step ST11, the CPU 551 takes in the content data DC and stores the content data DC input to the signal input unit 561 in the data storage unit 554. Note that the content data is not limited to data supplied from the editing device 30, but uses playback data output from other signal playback devices, video data output from an imaging device capable of variable speed recording, and the like. Content data may be generated and stored in the data storage unit 554.

  In step ST12, the CPU 551 identifies whether a request for content data has been made. If no content data request is made, the process returns to step ST12. If a content data request is made, for example, via the communication unit 562, the process goes to step ST13.

  In step ST13, the CPU 551 reads out the attached information DMc of the requested content data, and proceeds to step ST14.

  In step ST14, the CPU 551 detects the bandwidth of the transmission path and adjusts the output frame rate of the content with reference to the restriction information based on the detected bandwidth. Further, the CPU 551 reads the content data from the data storage unit 554 so that the adjusted frame rate is obtained, and proceeds to step ST15.

  In step ST15, the CPU 551 corrects the attached information DMza of the read content data DCza so as to correspond to the adjusted output frame rate, and proceeds to step ST16.

  In step ST16, the CPU 551 generates an encoded data DZ by performing an encoding process according to the transmission path using the content data DCz whose attached information is corrected. Further, the transmission data DTz is generated using the generated encoded data DZ and the corrected auxiliary information DMz, and the process proceeds to step ST17.

  In step ST <b> 17, the CPU 551 outputs the generated transmission data DTZ from the communication unit 562 toward the request destination of the content data.

  Next, the content reproduction apparatus will be described. FIG. 7 shows the configuration of the content playback device 70. The transmission signal TMz supplied from the content sending device 50 is supplied to the communication circuit 711 of the input unit 71. The input unit 71 captures content data, and the communication circuit 711 of the input unit 71 generates transmission data DTz from the supplied transmission signal TMz, and encodes data DZ and attached information from the transmission data DTz. DMz is extracted. Further, the communication circuit 711 supplies the extracted attached information DMz to the information storage circuit 712 and supplies the encoded data DZ to the data holding circuit 713. In addition, the communication circuit 711 generates a transmission signal TMrq based on a content request signal RQ from a reproduction control unit 72 described later, and supplies the transmission signal TMrq to the content transmission device 50.

  The information storage circuit 712 stores the supplied accessory information DMz. The data holding circuit 713 stores the supplied encoded data DZ.

  A user interface unit 73 is connected to the playback control unit 72. When the operation signal PSp from the user interface unit 73 requests content data, the playback control unit 72 generates a content request signal RQ based on the operation signal PSp and supplies it to the communication circuit 711. A content data transmission request is sent to the content transmission device 50.

  Further, when the operation signal PSp is an instruction to reproduce the content data, the reproduction control unit 72 supplies the read control signal CN to the data holding circuit 713, and the encoded data of the content instructed to reproduce. DZ is read from the data holding circuit 713 and supplied to the reproduction processing unit 74. Further, the reproduction control unit 72 reads the attached information DMz corresponding to the read encoded data DZ from the information storage circuit 712, and displays the information contained in the attached information DMz as video data DVs, for example, attached information DMz. When time information such as time code is included in the video data indicating the reproducible speed range based on the included restriction information and the accompanying information DMz, the total time indicated by this time information, the time of the playback position, etc. The video data shown is generated and supplied to the reproduction processing unit 74. Thereby, the reproducible speed range, the total time, the time of the reproduction position, and the like are displayed on the screen of the content presentation device 80 such as a television device or a monitor device. When the speed information is not included in the attached information DMz, the reproducible speed range is set as shown in the editing device 30 described above. The set reproducible speed range is displayed on the screen of the content presentation device 80.

  When the operation signal PSp is to change the content playback speed FP, the playback control unit 72 generates a presentation control signal CP for controlling the operation of the playback processing unit 74 based on the attached information DMz and sends it to the playback processing unit 74. Supply.

  When the restriction information DMc-LM is provided in the auxiliary information DMz, the reproduction control unit 72 regulates the reproduction operation of the content provided with the restriction information DMc-LM regardless of the instruction given by the operation signal PSp. . Here, when the restriction information DMc-LM indicates the contents of the restriction, for example, the reproduction speed or the image size, the reproduction control unit 72 presents the presentation control signal so that the reproduction is performed under the conditions indicated by the contents of the restriction. A CP is generated and supplied to the reproduction processing unit 74. In addition, when the restriction information DMc-LM is not connected, the reproduction control unit 72 generates a presentation control signal CP so as to perform reproduction under preset conditions and supplies the presentation control signal CP to the reproduction processing unit 74.

  When the recommended playback speed is indicated by the attached information DMz and the restriction information DMc-LM is not provided, the playback control unit 72 determines the recommended playback speed when the playback speed is not indicated by the operation signal PSp. The presentation control signal CP is generated so as to perform the reproduction operation. In addition, when the content title and time length are indicated by the attached information DMz, the reproduction control unit 72 displays these pieces of information on the screen of the content presentation device 80.

  The reproduction processing unit 74 that performs variable-speed reproduction of content performs decoding processing of the encoded data DZ supplied from the data holding circuit 713, and generates video data DVz and audio data DAz of the content. The reproduction processing unit 74 further performs thinning and repetition processing based on the presentation control signal CP on the generated video data DVz and audio data DAz, and a reproduction speed FP equal to the reproduction speed FP set by the user or the recommended reproduction speed. The content presentation is performed by generating the video signal Svz and the audio signal Saz having a playback frame rate corresponding to the content and supplying the generated signal to the content presentation device 80. Further, when the video data DVs for displaying the information included in the auxiliary information DMz is supplied, the playback processing unit 74 displays a display based on the video data DVs, for example, a reproducible speed range, etc. A video signal Svz to be displayed is generated.

  Further, the content reproduction device 70 may use a recording medium in which the content data DC is recorded. In this case, the attached information and the encoded data of the image and / or sound are separated from the reproduction signal obtained by reproducing the recording medium, the attached information is stored in the information storage circuit 712, and the encoded data is retained as data. By storing the data in the circuit 713, the same processing can be performed.

  By the way, the content reproduction processing of the above-described content reproduction device 70 can also be realized by software processing with a computer. FIG. 8 shows a configuration when content reproduction is performed by this software processing.

  As shown in FIG. 8, the computer includes a CPU 751, and a ROM 752, a RAM 753, a data storage unit 754, and an input / output interface 755 are connected to the CPU 751 via a bus 760. Further, a communication unit 761, a user interface unit 762, a signal output unit 763, and a recording medium drive 764 are connected to the input / output interface 755.

  The CPU 751 executes a program stored in the ROM 752, RAM 753, or data storage unit 754, and performs a content transmission processing operation based on the operation signal PSp from the user interface unit 762. Here, when the transmission data DTz is supplied to the communication unit 761, the communication unit 761 extracts the encoded data DZ and the attached information DMz. The encoded data DZ and the attached information DMz extracted by the communication unit 761 are stored in the data storage unit 754. Further, based on the operation signal PSp from the user interface unit 762, the encoded data DZ stored in the data storage unit 754 is read and decoded, and the video data DVz and the audio data DAz are generated and output as signals. Part 763. The signal output unit 763 generates and outputs a video signal Svz and an audio signal Saz corresponding to the content presentation device 80 based on the video data DVz and the audio data DAz.

  Note that the program for performing the content reproduction processing is stored in advance in the ROM 752 or the data storage unit 754, or the content reproduction processing program is recorded on the recording medium or recorded on the recording medium by the recording medium drive 764. It is also possible to read and execute the existing program. Furthermore, the program may be transmitted or received by the communication unit 761 via a wired or wireless transmission path, and the received program may be executed by a computer.

  FIG. 9 is a flowchart for explaining the content reproduction processing operation. When reproducing the content data, the CPU 751 causes the content presentation device 80 to display an image for configuring the GUI environment. An operation input corresponding to the display image is performed by the user interface unit 762.

  FIG. 10 shows an example of an image constituting the GUI environment displayed on the content presentation device 80. On the screen of the content presentation device 80, a viewer unit 801 that displays an image of content, a speed variable console unit 802 that is an interface for changing the playback speed FP, a playback speed display unit 803 that displays the playback speed FP, and an operation An operation control unit 804 for switching the mode and volume, a title display unit 805 indicating the title of the content, a time display unit 806 displaying the playback time and the current time of the content, and a playback position display indicating the current playback position A portion 807 and the like are provided.

  In step ST21 of FIG. 9, the CPU 751 reads the content attachment information DMz from the data storage unit 754, and is generated from the signal output unit 763 to the content presentation device 80 via the input / output interface 755 based on the attachment information DMz. The video signal Svz and the audio signal Saz are output. As a result, the content presentation device 80 performs display based on the attached information DMz. For example, the title of the content and the time length of the content are displayed on the title display unit 805 and the time display unit 806. The reproducible speed range is displayed on the speed variable console unit 802.

  In step ST22, the CPU 751 uses the operation control unit 804 to identify whether or not a content reproduction start operation has been performed based on the operation signal PSp. Here, when the reproduction start operation is not performed, the CPU 751 returns to step ST22, and when the reproduction start operation is performed, the process proceeds to step ST23.

  In step ST23, the CPU 751 sets the reproduction processing conditions according to the reproduction speed FP and the attached information DMz, that is, the video signal Svz and the audio signal Saz from the video data DVz and the audio data DAz obtained by decoding the encoded data DZ. Is generated, the data thinning interval, the number of data repetitions, and the like performed using the video data DVz and the audio data DAz are determined, and the process proceeds to step ST24.

  In step ST24, the CPU 751 reads out the encoded data DZ from the data storage unit 754 and decodes it to generate the video data DVz and the audio data DAz. At the same time, the CPU 751 thins out the data under the reproduction processing conditions determined in step ST23. It repeats etc. and produces | generates the video signal Svz and audio | voice signal Saz of the reproduction | regeneration frame rate for content presentation. By supplying the generated video signal Svz and audio signal Saz to the content presentation device 80, a reproduction image at the reproduction speed FP indicated by the cursor position (indicated by a bold line) of the speed variable console unit 802 is displayed on the content presentation device 80. It is displayed on the viewer unit 801. Further, the playback speed FP at this time is displayed on the playback speed display unit 803, and the playback time and playback position are displayed on the time display unit 806 and the playback position display unit 807. In addition, the content presentation device 80 outputs playback sound at the playback speed FP indicated by the cursor position of the speed variable console unit 802.

  In step ST25, the CPU 751 identifies whether or not the playback speed FP is changed by moving the cursor position of the speed variable console unit 802. If it is identified that the reproduction speed FP has been changed, the process returns to step ST23. If it is not identified that the reproduction speed FP has been changed, the process proceeds to step ST26.

  In step ST26, the CPU 751 identifies whether or not the reproduction operation is complete. Here, when the operation for stopping the reproduction operation is not performed, or when the reproduction position of the content is not the end position, the process returns to step ST25. When the stop operation is performed or when the reproduction position reaches the end position, the variable speed reproduction operation is terminated.

  FIG. 11 is a flowchart showing the setting operation of the reproduction processing condition for the image. In step ST31, the CPU 751 identifies the playback speed FP based on the cursor position of the speed variable console unit 802, and proceeds to step ST32. Here, the reference frame rate FRr is set to 1 × speed, and the initial position of the cursor in the speed variable console unit 802 is set to, for example, the 1 × speed position, thereby setting the playback speed FP at the start of the playback operation. Further, when the playback speed FP is recommended by the editing device 30, the position of the recommended playback speed FP is set as the initial position of the cursor, and the recommended playback speed FP is set as the playback speed FP at the start of the playback operation. And set. Further, when a user operation for moving the cursor position is performed by the operation signal PSp from the user interface unit 762, a speed corresponding to the cursor position is set as a playback speed FP. Although not shown, an operation unit that moves the cursor position may be provided on the content presentation device 80 side, and an operation signal may be supplied from the operation unit to the CPU 751 to set the playback speed.

  In step ST32, the CPU 751 identifies whether or not the restriction information DMc-LM is included in the attached information DMz. If the restriction information DMc-LM is included here, the process proceeds to step ST33. If not included, the process proceeds to step ST34. In step ST33, the CPU 751 determines the reproduction processing condition based on the restriction information DMc-LM. For example, regardless of the speed instructed by the operation signal PSp, the content presentation is performed with a desired quality as a speed or display size based on the restriction information DMc-LM or a preset speed or display size.

  In step ST34, the CPU 751 identifies the set frame rate FRs and proceeds to step ST35. In step ST35, the CPU 751 multiplies the reproduction speed FP and the set frame rate FRs to calculate an identification value FD for determining the reproduction processing condition.

  In step ST36, the CPU 751 determines a reproduction processing condition based on the identification value FD. Here, when the identification value FD is 1 or more and does not include a value after the decimal point, the reproduction processing condition is determined so that images are thinned out and output at frame intervals corresponding to the identification value FD. When the identification value FD is 1 or more and includes a value after the decimal point, the image is thinned out at a frame interval corresponding to the integer value portion of the identification value FD from a frame that is a multiple of the set frame rate FRs with respect to the reference frame rate FRr. Reproduction processing conditions are determined so as to read out images corresponding to the reproduction speed. When the identification value FD is less than 1, the playback processing condition is determined so that the same image is repeatedly output until the number of frames corresponding to the desired playback speed is reached. By performing the processing of step ST24 based on the playback processing conditions determined in this way, it is possible to correctly display the content image at a desired playback speed. When the restriction information DMc-LM is set on the content presentation side, a reproduction operation based on the restriction information DMc-LM, that is, a reproduction operation for presenting the content with a desired quality is performed.

  FIG. 12 shows an image reproduction operation when the identification value FD is 1 or more and does not include a value after the decimal point. FIG. 12A shows an image based on the video data DVz when the set frame rate FRs is 10 times the reference frame rate FRr. 12B shows frame rate information DMz-FRs indicating the set frame rate FRs of the frame image, FIG. 12C shows restriction information DMc-LM, and FIG. 12D shows absolute frame number AN. Note that the restriction information DMc-LM shown in FIG. 12C uses a flag, for example, and restricts the reproduction operation when the flag is at a high level “H”. In FIGS. 12A to 12H, FIGS. 13A to 13F and FIGS. 14A to 14G, which will be described later, the reproduction operation is restricted at the commercial portion “CM”.

  When the reproduction speed FP is (1/5) times faster, the identification value FD is “10 × (1/5) = 2”. For this reason, as shown in FIGS. 12E and 12F, by generating the video signal Svz of the playback frame rate using every “FD = 2” frame, that is, every other frame of the video data DVz, (1/5) ) A playback image at double speed can be displayed on the content presentation device 80. Further, when the restriction information DMc-LM is set to a high level “H”, the reproduction operation based on the restriction information DMc-LM, for example, the reproduction speed is automatically switched to a preset 1 × speed, and the commercial portion Read frame images sequentially. Further, when the display size or the like is changed based on the operation signal PSp, the display size is automatically switched to a preset display size. By performing such a reproduction operation, a commercial can be presented with a quality desired by the content provider.

  Further, as described above, when the restriction information DMc-LM indicates the contents of the restriction, the reproduction operation is performed under the conditions indicated by the contents of the restriction. 12E shows the absolute frame number AN of the displayed image, and FIG. 12F shows the frame image displayed by the video signal Svz.

  When the reproduction speed FP is double, the identification value FD is “10 × 2 = 20”. For this reason, as shown in FIGS. 12G and 12H, by generating the video signal Svz using every “FD = 20” frame, that is, while skipping the video data DVz by 19 frames, a double-speed playback image is presented as content. It can be displayed on the device 80. Further, when the restriction information DMc-LM is set to the high level “H”, the playback speed is automatically switched to, for example, 1 × speed, and the frame images of the commercial part are sequentially read out, so that the content provider can obtain the commercial with the desired quality. Can be presented. 12G shows the absolute frame number AN of the displayed image, and FIG. 12H shows the frame image displayed by the video signal Svz.

  FIG. 13 shows an image reproduction operation when the identification value FD is 1 or more and includes a value after the decimal point. FIG. 13A shows an image based on the video data DVz when the set frame rate FRs is 7 times the reference frame rate FRr. 13B shows frame rate information DMz-FRs, FIG. 13C shows restriction information DMc-LM, and FIG. 13D shows absolute frame number AN.

  Here, when the reproduction speed FP is (1/3) times faster, the identification value FD is “7 × (1/3) = 2.33. Therefore, as shown in FIGS. 13E and 13F, every second frame, that is, every other frame, from 7 frames, which is a multiple of the set frame rate FRs with respect to the reference frame rate FRr, according to the integer value portion of the identification value FD. By reading out the video data and outputting the video data DVz for three frames, a (1/3) -times playback image can be obtained. Further, when the restriction information DMc-LM is set to the high level “H”, the content provider side automatically reads the frame image of the commercial portion by automatically switching the reproduction speed to, for example, a preset single speed. Commercials can be presented with the desired quality. FIG. 13E shows the absolute frame number AN of the displayed image, and FIG. 13F shows the frame image displayed by the video signal Svz.

  FIG. 14 shows the reproduction operation when the identification value FD is less than 1. FIG. 14A shows an image based on the video data DVz when the set frame rate FRs is (1/4) times the reference frame rate FRr. 14B shows frame rate information DMz-FRs, FIG. 14C shows restriction information DMc-LM, and FIG. 14D shows absolute frame number AN.

  Here, when the reproduction speed FP is set to double speed, the identification value FD is “(1/4) × 2 = 1/2”. For this reason, as shown in FIGS. 14E to 14G, the video signal Svz is generated by repeatedly using the number of frames corresponding to the playback speed, that is, the video data DVz twice for each frame, thereby generating a playback image at double speed. It can be displayed on the presentation device 80. Further, when the restriction information DMc-LM is set to the high level “H”, the content provider side automatically reads the frame image of the commercial portion by automatically switching the reproduction speed to, for example, a preset single speed. Commercials can be presented with the desired quality. 14E shows the restriction information DMc-LM, FIG. 14F shows the absolute frame number AN of the displayed image, and FIG. 14G shows the frame image displayed by the video signal Svz.

  By the way, in FIG. 12, FIG. 13 and FIG. 14, the commercial operation or the like is inserted to restrict the reproduction operation. However, the reproduction operation of a part of the content can also be regulated. FIG. 15 shows a case where the variable speed playback operation of a part of scenes is limited in content in which the set frame rate FRs is 10 times the reference frame rate FRr. FIG. 15A shows an image based on the video data DVz. 15B shows frame rate information DMz-FRs indicating a set frame rate FRs of the frame image, FIG. 15C shows restriction information DMc-LM, and FIG. 15D shows an absolute frame number AN.

  Here, when the reproduction speed FP is (1/5) times faster, the identification value FD is “10 × (1/5) = 2”. For this reason, as shown in FIGS. 15E and 15F, by generating the video signal Svz using the video data DVz every other frame, a playback image at (1/5) times speed can be displayed on the content presentation device 80. . When the restriction information DMc-LM is set to the high level “H”, the frame image is reproduced without being thinned out by automatically switching to 1/10 times speed that is the lowest value of the reproducible speed range. In this way, not only can the content be provided so that the playback speed can be varied, but also the playback speed can be limited only to the portion intended by the content provider. FIG. 15E shows the absolute frame number AN of the displayed image, and FIG. 15F shows the frame image displayed by the video signal Svz which is the reproduction frame rate.

  Next, audio will be described. FIG. 16 is a flowchart showing the setting operation of the reproduction processing condition for the sound. As for the sound, when the sound data DAz is used in units of frames, there is no sound connection between the frames and sound discontinuity occurs. For this reason, the reproduction process is performed on the sound in units of samples.

  In step ST41, the CPU 751 identifies the playback speed in the same manner as in step ST31, and proceeds to step ST42. In step ST42, as in step ST32, it is identified whether or not the restriction information DMc-LM is included in the attached information DMz. If the restriction information DMc-LM is included here, the process proceeds to step ST43. If not included, the process proceeds to step ST44. In step ST43, the CPU 751 determines a reproduction processing condition based on the restriction information DMc-LM. For example, regardless of the speed instructed by the operation signal PSp, content presentation is performed with a desired quality as a playback speed based on the restriction information DMc-LM or a preset playback speed.

  In step ST44, the CPU 751 identifies the set frame rate FRs as in step ST34, and proceeds to step ST45. In Step ST45, the reproduction speed FP and the set frame rate FRs are multiplied to calculate an identification value FD for determining the reproduction processing condition.

  In step ST46, the CPU 751 determines a reproduction processing condition based on the identification value FD. Here, when the identification value FD is 1 or more and does not include a value after the decimal point, the reproduction processing condition is determined so that audio data is thinned out at a sample interval corresponding to the identification value FD. When the identification value FD is greater than or equal to 1 and includes a value after the decimal point, audio data is thinned out at a sampling interval corresponding to the integer value portion of the identification value FD from a frame that is a multiple of the set frame rate FRs with respect to the reference frame rate FRr. The reproduction processing conditions are determined so as to read out audio data corresponding to the reproduction speed. When the identification value FD is less than 1, the playback processing condition is determined so that the audio data is repeatedly used so that the number of samples is equal to the number of frames corresponding to the desired playback speed. By performing the process of step ST24 based on the reproduction processing conditions determined in this way, the audio of the content can be presented correctly at a desired reproduction speed. Also, when restriction information is set on the content presentation side, it is possible to present content audio based on this restriction information.

  FIG. 17 shows an audio reproduction operation when the identification value FD is 1 or more and does not include a value after the decimal point. FIG. 17A shows the absolute frame number AN, FIG. 17B shows the frame rate information DMz-FRs, and FIG. 17C shows the restriction information DMc-LM.

  Here, when the playback speed FP is (1/5) times faster, the set frame rate FRs is 10 times faster than the reference frame rate FRr, so the identification value FD is “10 × (1/5). ) = 2 ”. Therefore, by generating the audio signal Saz using the audio data DAz for every “FD = 2” sample, that is, every other sample, it is possible to output the reproduced audio at 1/5 speed from the content presentation device 80. Further, when the restriction information DMc-LM is set to the high level “H”, the content providing side can read the audio data DAz sequentially by automatically switching the reproduction speed to, for example, 1/10 times the preset speed. Voice can be presented with the desired quality. FIG. 17D shows a frame used for generating the video signal Svz, and FIG. 17E shows audio data used in the audio signal Saz when the audio data DAz is 14 samples / frame.

  FIG. 18 shows an audio reproduction operation in the case where the identification value FD is 1 or more and includes a value after the decimal point. 18A shows the absolute frame number AN, FIG. 18B shows the frame rate information DMz-FRs, and FIG. 18C shows the restriction information DMc-LM.

  Here, when the playback speed FP is (1/3) times faster, the set frame rate FRs is 7 times faster than the reference frame rate FRr, so the identification value FD is “7 × (1/3). ) = 2.3... When the audio data DAz is 14 samples / frame, the number of samples in one frame at (1/3) speed is “14 × 3/7 = 6”. For this reason, when the audio data DAz is output every second sample, that is, every other sample in accordance with the integer value part of the identification value FD, and when 6 samples of audio data DAz corresponding to the number of samples of one frame are output. The audio data DAz is output every other sample by moving to the beginning of the next frame. By selecting and outputting the audio data DAz in this way, (1/3) times faster playback audio can be obtained. Also, when the restriction information DMc-LM is set to the high level “H”, the playback speed is automatically switched to, for example, (1/7) double speed set in advance, and the audio data DAz is sequentially read out, so that The voice can be presented with the quality desired by the provider.

  Further, if the filtering process is performed when outputting the sound based on the sound signal Saz, it is possible to reduce the influence of the thinning of the sound data DAz and output a good reproduced sound. 18D shows a frame used for generating the video signal Svz, and FIG. 18E shows audio data used in the audio signal Saz when the audio data DAz is 14 samples / frame.

  Also, when the audio signal Saz is generated by thinning out the audio data DAz, the audio used for generating the audio signal Saz is prevented so that the interval between the audio data DAz is widened and the reproduced sound is not discontinuous. Thinning may be performed so that the data interval is substantially constant. For example, when the set frame rate FRs is KA times the reference frame rate FRr and the playback speed FP is (1 / KB) times, the KB data is divided into KB samples at substantially equal intervals from the audio data DAz of consecutive KB samples. Is extracted, and an audio signal Saz is generated based on the extracted audio data. Further, when the identification value FD is less than 1, the audio data DAz having a desired reproduction speed can be generated by using each audio data repeatedly and sequentially for the number of image frame repetitions, not shown. By controlling the reading of the audio data DAz according to the information DMc-LM, it is possible to present the audio with the quality desired by the content provider.

  As described above, according to the above-described embodiment, even if variable-speed playback is possible at the time of playback of content, it is possible to present content with a desired quality for a desired portion on the content presentation side. For this reason, for example, if restriction information is provided in commercial content data, the content can be presented at a quality desired by the content providing side for the commercial portion even if a variable speed playback operation is performed.

As described above, the data processing device, the data processing method, the program, and the recording medium according to the present invention are suitable for restricting the video data playback speed on the video data providing side .

It is a figure which shows the whole structure of a content provision system. It is a figure which shows the structure of a video tape recorder. It is a figure which shows the structure of an editing apparatus. It is a figure which shows the structure of a content transmission apparatus. It is a figure which shows the structure in the case of performing content transmission by software. It is a flowchart which shows a content transmission process operation. It is a figure which shows the structure of a content reproduction apparatus. It is a figure which shows the structure in the case of performing content reproduction | regeneration with software. It is a flowchart which shows content reproduction processing operation. It is a figure which shows the display image of a content presentation apparatus. It is a flowchart which shows the setting operation | movement of the reproduction | regeneration processing condition with respect to an image. It is a figure which shows image reproduction operation | movement (the 1). It is a figure which shows image reproduction operation | movement (the 2). It is a figure which shows image reproduction operation | movement (the 3). It is a figure which shows image reproduction operation (the 4). It is a flowchart which shows the setting operation | movement of the reproduction | regeneration processing condition with respect to an audio | voice. It is a figure which shows audio | voice reproduction | regeneration operation | movement (the 1). It is a figure which shows audio | voice reproduction | regeneration operation | movement (the 2).

Explanation of symbols

  DESCRIPTION OF SYMBOLS 20 ... Signal reproduction | regeneration apparatus, 30 ... Editing apparatus, 31 ... Material taking-in part, 32 ... Editing process part, 33 ... Editing control part, 34, 73, 216 ... User interface 35: Editing output signal generating unit, 40 ... Editing image display device, 41 ... Editing audio output device, 50 ... Content sending device, 51 ... Write processing unit, 52 ... Sending data generation unit, 53 ... transmission processing unit, 60 ... transmission path, 70 ... content playback device, 71 ... input unit, 72 ... playback control unit, 74 ... playback processing , 80... Content presentation device, 201... Encoder, 202, 203, 206... Changeover switch, 203a, 203b. ..Reproduction amplification unit, 207 211a, 211b ... bimorph, 212 ... bimorph control unit, 215 ... recording / reproduction control unit, 217 ... display unit, 311 ... reproduction instruction circuit, 312 ... database processing Circuit 321... Data storage device 322... Read / write processing circuit 323... Signal editing circuit 351... Video output signal generation circuit 352. ..Content storage circuit, 522... Read processing circuit, 523... Information correction circuit, 524... Encoder, 554, 754... Data storage unit, 561. Communication circuit 712 ... Information storage circuit 713 ... Data holding circuit 801 ... Viewer part 802 ... Speed variable console part 803 ... Reproduction speed display part 804 ... Operation control unit, 805 ... Title display unit, 806 ... Time display unit, 807 ... Playback position display unit

Claims (4)

Video data including program content and advertising content from an external device, a set frame rate when the video data is generated, a frame that is set to a value smaller than the set frame rate and that reproduces the video data A reference frame rate that is a rate and ancillary information including restriction information for identifying whether the video data being reproduced is the program content or the promotional content when the video data is reproduced Acquisition means to
An identification value calculating means for calculating an identification value that is a product of a ratio of the reference frame rate to the set frame rate and a magnification of the reproduction speed set by the user;
If the identification value is greater than 1, reproduction means for reading the video data at the reproduction speed magnification by reading out the frame of the video data every number corresponding to the integer part of the identification value in the video data When,
Based on the restriction information, it is confirmed whether the video data being played back at the playback speed magnification is program content or advertising content, and the video data being played back at the playback speed magnification is And a control means for changing the reproduction speed magnification to 1 when it is confirmed that the content is advertising content . The acquisition means sets the video data including the program content and the promotional content from the external device, the set frame rate when the video data is generated, and a value smaller than the set frame rate and reproduces the video data. A reference frame rate that is a frame rate at the time of playback and an accessory including restriction information for identifying whether the video data being played is the program content or the promotional content when playing the video data Obtaining information and
An identification value calculating unit calculating an identification value that is a product of a ratio of the reference frame rate to the set frame rate and a reproduction speed magnification set by a user;
If the discriminating value is greater than 1, the reproducing means reads out the video data frame for each number corresponding to the integer part of the discriminating value in the video data, and reads the video data at a magnification of the playback speed. Step to play,
Based on the restriction information, the control means confirms whether the video data being reproduced at the reproduction speed magnification is the program content or the advertising content, and the reproduction at the reproduction speed magnification is performed. And confirming that the video data is the advertising content, and changing the reproduction speed magnification to 1 × . On the computer,
Video data including program content and advertising content from an external device, a set frame rate when the video data is generated, a frame that is set to a value smaller than the set frame rate and that reproduces the video data When reproducing the video data, the reference frame rate, which is a rate, and attached information including restriction information for identifying whether the video data being reproduced is the program content or the advertising content are acquired. Processing to
A process of calculating an identification value that is a product of a ratio of the reference frame rate to the set frame rate and a reproduction speed magnification set by a user;
If the identification value is greater than 1, a process of reading out the video data frame for each number corresponding to the integer part of the identification value in the video data and reproducing the video data at a magnification of the reproduction speed; ,
Based on the restriction information, it is confirmed whether the video data being played back at the playback speed magnification is program content or the advertising content, and the video data being played back at the playback speed magnification is A program for executing a process of changing the reproduction speed magnification to 1 when it is confirmed that the content is advertising content . A recording medium in which the program according to claim 3 is recorded.

Images