JP5161549B2 - VIDEO RECORDING DEVICE, VIDEO REPRODUCTION DEVICE, AND ITS CONTROL METHOD - Google Patents

Description

  The present invention relates to a video recording apparatus that records video data or moving image data on a recording medium, a video playback apparatus that plays back the secondary recording medium, and a control method thereof.

  Various tape media such as VHS and MiniDV, DVD, and the like are used as video recording media used in video cameras and the like. The resolution of moving images recorded on such media is generally D1 size (720 × 480: NTSC). Recently, however, high-definition video cameras have been developed, and HD size recording (1440 to 1920 × 1080) has become possible. As this recording format, methods that do not limit recording media, such as the HDV standard (recording an MPEG-2 standard bit stream on a conventional MiniDV tape), have been put into practical use. This includes H.C. There is an AVCHD standard for recording a stream of the H.264 / MPEG-4 AVC standard. Also, with the spread of digital broadcasting, discs capable of recording high-definition video such as Blu-ray discs and HD-DVDs for a long time are being put into practical use for stationary video recording / playback.

  In the case of a consumer video camera, there is a trade-off relationship between the resolution and image quality of the image to be recorded, the recordable time, the cost of the recording medium, and the portability. Here is a simple example.

  A camera employing an HDD has a relatively large margin in terms of recording time because the storage capacity for recording video is large. However, when distributing the photographed video to a third party, it is necessary to copy it to a medium such as a DVD. When 8 cm DVD is adopted, if recording is performed at a bit rate of about 6 Mbps which is suitable for image quality in the DVD video recording standard corresponding to SD resolution, the recording time which can be recorded on one side is about 30 minutes. In addition, when high-definition recording is performed on a DVD in the AVCHD format, it is necessary to further increase the bit rate. For this reason, the time that can be recorded on the DVD is about the same as that described above, or about 20 minutes shorter in the high image quality mode. Also, in the case of a DVD recorded in the AVCHD format, even if the DVD is distributed to a third party, there is a possibility that the third party cannot play the DVD because the popularity of equipment that can play the DVD is low. .

  Recently, in view of the above situation, video cameras equipped with both HDDs and DVD drives have been put into practical use. In such a camera, video is temporarily recorded on the HDD, and copied from the HDD to the DVD as necessary.

Patent Document 1 shows an example of an application that uses JAVA to replace subtitles recorded on a disc (media) with other language data downloaded from a network. The subtitle data to be downloaded is converted into a transport stream, and is played back in synchronization with the video on the disc by controlling the time stamp in the playback device.
JP 2006-109494 A

  An apparatus equipped with a plurality of types of storage media as described above and capable of copying to a secondary storage medium such as a DVD has the following problems.

  A video recorded at a high-definition resolution has a large data size, so that the time of the video that can be recorded on a DVD is shortened and is not suitable for distribution to a third party. In addition, even if a DVD compliant with the high-definition standard is distributed, there is a case where a playback environment in which the DVD can be played back is not prepared. In order to deal with such a problem, when copying to a DVD, it may be possible to reduce the resolution of the video and perform re-encoding for recording. However, this results in a problem that the original high-definition image quality is lost and block noise is generated due to a re-encoding (re-quantization) effect, and the image quality is further deteriorated.

  As described above, there is a pros and cons to copying and distributing a high-definition video or a standard video with a reduced resolution to a medium such as a DVD.

  An object of the present invention is to solve the conventional problems described above.

  A feature of the present invention is to provide a technique capable of recording video data with reduced original characteristics on a recording medium and displaying and reproducing the video data with the original characteristics in a designated area during the reproduction. is there.

In order to achieve the above object, a video recording apparatus according to an aspect of the present invention has the following arrangement. That is,
Recording means for recording the encoded first video data;
Designating means for designating a data area to be reproduced with characteristics inherent to the first video data among the first video data recorded in the recording means;
An applet including reproduction time information of a data area designated by the designation means and an address of a server holding the first video data corresponding to the data area reproduced based on the reproduction time information is created. Means for recording on a recording medium together with second video data in which the original characteristics of the first video data recorded in the recording means are reduced;
Upload means for uploading the first video data corresponding to at least the data area to the server;
It is characterized by having.

In order to achieve the above object, a video reproduction apparatus according to an aspect of the present invention has the following arrangement. That is,
A video playback device for playing back the second video data and the applet from the recording medium recorded by the video recording device according to any one of claims 1 to 3,
Obtaining means for obtaining the first video data corresponding to the data area from the server based on the applet;
When the reproduction time information in the data area is reached during reproduction of the second video data from the recording medium based on the applet, the first video data is acquired based on the first video data acquired by the acquisition means. Playback means for playing back the first video data with the original characteristics of the video data;
It is characterized by having.

In order to achieve the above object, a video recording apparatus control method according to an aspect of the present invention includes the following steps. That is,
A control method of a video recording apparatus for recording video data,
A recording step of recording the encoded first video data;
A designation step for designating a data area to be reproduced with characteristics inherent to the first video data among the first video data recorded in the recording step;
Creating an applet including reproduction time information of the data area designated in the designation step, and an address of a server holding the first video data corresponding to the data area reproduced based on the reproduction time information; Recording on a recording medium together with the second video data in which the original characteristics of the first video data recorded in the recording step are reduced;
An uploading step of uploading the first video data corresponding to at least the data area to the server;
It is characterized by having.

In order to achieve the above object, a video playback apparatus control method according to an aspect of the present invention includes the following steps. That is,
A control method for a video playback device for playing back second video data and an applet from a recording medium recorded by the control method for a video recording device according to claim 12,
Obtaining the first video data corresponding to the data area from the server based on the applet;
When the reproduction time information of the data area is reached during reproduction of the second video data from the recording medium based on the applet, the first video data is acquired based on the first video data acquired in the acquisition step. A reproduction step of reproducing the first video data with the original characteristics of the video data;
It is characterized by having.

  According to the present invention, video data having a reduced original characteristic is recorded on a recording medium, and during the reproduction, the video data can be displayed and reproduced with the original characteristic in a designated area.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. The following embodiments do not limit the present invention according to the claims, and all combinations of features described in the present embodiments are essential to the solution means of the present invention. Not exclusively.

  Embodiment 1 of the present invention will be described below. The video recording apparatus according to the first embodiment uses video data (first video data) recorded at a high-definition resolution (original characteristics) to reduce the resolution by resolution conversion (or format conversion). Convert to video data. Then, the video data (second video data) is recorded on a secondary medium such as a DVD and distributed to a third party. At this time, the reproduction time information of the highlight scene and the network access applet (or an equivalent application) are written in the secondary medium. The same highlight scene time information is also recorded on the primary medium (recording means) on which the original high-definition video is recorded.

  Thereafter, the photographer of the original video uploads the video of the highlight scene from the primary media to the network server. On the other hand, the video playback device that plays back the secondary media receives the original high-definition video data (first video data) of the highlight scene from the server via the network. Then, the video data (second video data) of the highlight scene with the standard resolution stored in the secondary medium is seamlessly switched and reproduced by the received video data. As a result, the highlight scene designated by the original photographer can be reproduced and viewed with high resolution.

[Embodiment 1]
FIG. 1 is a block diagram showing a configuration example of a video camera which is an example of a video recording apparatus according to Embodiment 1 of the present invention.

  The imaging unit 101 includes an optical lens and an area sensor, and converts the captured video into an electrical signal and outputs the electrical signal. The microphone 102 collects sound. The display unit 806 displays captured video, video captured by the imaging unit 101, and the like. Reference numeral 107 denotes a speaker that reproduces sound. The encoding unit 103 encodes the captured video and audio signal. The recording unit 104 is a first recording unit, such as an HDD (hard disk). The decoding unit 105 decodes the video data encoded by the encoding unit 103. The resolution conversion unit 108 converts the resolution of the video data decoded by the decoding unit 105. The encoding unit 109 performs encoding with a format different from that of the encoding unit 103, or performs re-encoding by changing the bit rate even if the format is the same.

  Thus, for example, when the copied DVD is distributed to a third party, the original video data of the high-definition resolution recorded in the AVCHD standard is decoded by the decoding unit 105, and the standard conversion resolution is obtained by the resolution conversion unit 108. Convert (down-convert). Then, the encoding unit 109 encodes the MPEG-2 main profile again and records it on the DVD. If it is the code data of this MPEG-2 main profile, the DVD can be reproduced by all the DVD reproducing apparatuses, and is suitable for distribution to a third party. Thus, the recording unit 110 is a recording unit that records video data on a secondary medium (DVD) that is distributed to, for example, a third party.

  On the other hand, in a ROM medium such as a Blu-ray disc or an HD-DVD disc, in addition to the conventional simple playback function, a user interaction and a function of an additional service through a network can be added. Hereinafter, an example of a Blu-ray disc will be described.

  In the Blu-ray disc, a JAVA applet is recorded in advance on the disc, and a JAVA VM (Virtual Machine) is operated in the playback device, so that the applet can be activated to perform playback capable of various user interactions. . Specifically, the playback effect is changed by the user's operation, and the network-compatible applet can update the local media content and play the additional content while downloading the additional content from a predetermined server. Specifically, it is possible to change the language of subtitles, distribute director's cuts, and play additional videos using picture-in-picture.

  The time information setting unit 111 sets a time for highlight scene, high-vision display, and the like in the video data. Specifically, the user searches for a scene desired to be displayed in high definition by operating the operation unit 116 while reproducing the original high definition image.

  FIG. 3 is a diagram for explaining an example of setting a section (data area) to be displayed in high definition in a highlight scene.

  In the figure, it is assumed that an IN point is 301 and an OUT point is 302, and a section surrounded by these points is set as a section to be displayed in high vision. Note that the high-vision display setting may be made at a plurality of locations. The reproduction time information of the data area set in this way is set and acquired by the time information setting unit 111.

  When copying to a DVD by the recording unit 110, as in the conventional example, the procedure is to decode the video recorded by the recording unit 104, convert the resolution, and then encode and record again. At this time, the setting of time information to be played back in HD, the locator (location of video data) on the server that holds the original video, and the method that controls the playback of the video (one functional unit of the applet) The applet creation unit 113 creates an applet having Then, along with the encoded video data, the information is written on the DVD. The copied DVD can be distributed.

  The video data of the high-definition display scene is appropriately uploaded to a server at an address specified by a network locator written on the DVD. At this time, the original long-time high-definition video has a problem that the file size is large, and the capacity of the recording unit (HDD) of the server is consumed, and the time required for uploading becomes enormous. Therefore, in the first embodiment, a specified part of the highlight scene is selected from the high-definition video data recorded in the recording unit 104 and uploaded to the server. As a result, the size of the high-definition data file stored in the server is kept small, and uploading is not burdened.

  The server capacity setting unit 112 sets the capacity of the storage device of the server 212 (FIG. 2), accesses the server 212 in advance, and sets the limit of the capacity of video data that can be stored in the server. Thereby, this capacity information can be used as auxiliary data to be referred to when the user sets a display scene compatible with high-definition. A network interface (I / F) unit 114 controls an interface with a network. Through this network interface (I / F) unit 114, capacity information can be received from the server, and original video data can be uploaded to the server. In the following description, the video portion set to be displayed in the high-vision among the highlight scenes will be described simply as the highlight scene.

  FIG. 2 is a block diagram showing the configuration of the playback-side video display device (video playback device) according to the first embodiment.

  It is assumed that the user (playback video display device) to whom the secondary media (DVD) is distributed has a function of playing a DVD with a standard resolution video. When the written applet is activated by the JAVA VM, time management is performed for checking the status of the network connection and reproducing the video. Specifically, when approaching a highlight scene in which a reproduction time is written in advance, the network access unit 202 tries to download a high-definition video from a server 212 designated in advance in the network. If the video data does not exist in the server 212, the reproduction of the standard resolution video is continued as it is.

  On the other hand, when a file exists in the server 212, downloading of the video of the highlight scene is started and stored in the cache memory 213. Immediately before the highlight scene is displayed, the high-definition video data stored in the cache memory 213 is decoded by the decoding unit 203, and the display switching unit 209 switches to high-definition playback. Each of the decoding units 203 and 204 is a decoding unit for high-definition video and a decoding unit for standard resolution.

  At this time, common playback time management information is shared between the video data recorded on the DVD and the original high-definition video distributed via the network. Specifically, by detecting DTS (Decoder Time Stamp) and PTS (Presentation Time Stamp) installed in PES (Packetized Elementary Stream) in MPEG-2 TS (Transport Stream), Will switch.

  FIG. 4 is a diagram for explaining the structure of the TS.

  Specifically, a PES is configured for each access unit (reproduction unit), and a time stamp is added to each PES. A TS having a fixed length (188 bytes) is formed. In the TS, PES of other media such as audio data is multiplexed in addition to the video. In the present embodiment, by comparing the video data stored on the DVD with the time stamp of the video data distributed via the network, seamless synchronized playback at the time of display switching can be realized. .

  In FIG. 2, 201 is a JAVA VM, 204 is a JAVA applet, and 205 is a recording / reproducing unit. During normal playback, the video data of the DVD attached to the recording / playback unit 205 is read out, decoded by the decoding unit 207, and played back / displayed by the display unit 210 and the speaker 211 via the display switching unit 209.

  In this way, by adopting a system configuration using an imaging device (FIG. 1) that can be recorded on a secondary medium (DVD), its playback device (FIG. 2), and the server 212 on the network, each user's Distribution (and distribution) of video data according to the reproduction environment becomes possible. When the applet written on the DVD is activated by the JAVA applet 204 and the JAVA VM 201, the network access unit 202 checks the status of connection to the network, receives video data from the server 212, and stores it. Do. Then, time management related to video playback is performed. When the highlight scene time management unit 206 determines that the time of the highlight scene is reached, the video data of the highlight scene stored in the cache memory 213 is read. Then, the data is decoded by the decoding unit 203 and reproduced by the display unit 210 and the speaker 211 via the display switching unit 209.

  FIG. 5 is a flowchart for explaining video data playback processing in the playback-side video display apparatus according to the first embodiment.

  This process is started when the user gives an instruction to start playback. First, in step S1, the JAVA applet 204 accesses the network. In step S2, it is determined whether the server 212 can be accessed via the network. If the server 212 cannot be accessed, the process proceeds to step S6 to reproduce the video stored on the DVD. On the other hand, if the server 212 is accessible in step S2, the process proceeds to step S3, and it is determined whether or not a highlight scene has been uploaded to the server 212 by the photographer of the original video. If the highlight scene has not been uploaded, the process proceeds to step S6 to reproduce the video stored on the DVD. If the highlight scene is uploaded in step S3, the process proceeds to step S4, and the time information of the highlight scene written on the DVD is monitored. Then, the highlight scene time management unit 206 determines whether or not the set playback time has been reached in the highlight scene. When the playback time of the highlight scene is reached, the process proceeds to step S5, where the display switching unit 209 switches to the video data from the server 212 for playback. At this time, in order to achieve strict synchronization, control is performed using the time stamp. On the other hand, if it is not the time of the highlight scene, the process proceeds to step S6 to reproduce the DVD video.

  FIG. 6 is a diagram for explaining an example in which a highlight scene is displayed / reproduced as video data from a server.

  As described above with reference to FIG. 3, if a highlight scene is set, the highlight scene is displayed as a high-definition video from the server 212. Then, as a video other than the highlight scene, a standard resolution video reproduced from the DVD is displayed.

  As described above, according to the first embodiment, the designated highlight scene can be reproduced and viewed at a high resolution.

  In addition, video data uploaded to the server can be reduced to the video data of the set section of the highlight scene, thereby reducing the amount of data transmitted over the network and reducing the amount of memory occupied by the server. There is an effect that can be done.

[Embodiment 2]
FIG. 7 is a diagram for explaining the second embodiment of the present invention. Note that the configuration of the imaging apparatus, playback apparatus, server, and network according to the second embodiment is the same as that of the first embodiment, and a description thereof will be omitted.

  In the first embodiment described above, since the high-definition video data is distributed from the server 212, the necessary network bandwidth cannot be secured and the video may be interrupted. In addition, in many cases, video data is distributed such as RTP (Real Time Protocol) that accepts lack of data continuity (error) instead of emphasizing real-time characteristics.

  In view of such a case, in FIG. 7, when the video data is interrupted or when an error occurs in the video data, the video recorded on the secondary media (DVD) is reproduced each time. It is characterized by switching.

  In the example of FIG. 7, when an error occurs in the network during playback of a high-definition video and data acquisition from the server fails, the standard-resolution video data stored on the DVD is played back during the error. Yes.

  FIG. 8 is a flowchart for explaining video data playback processing in the playback-side video display apparatus according to Embodiment 2 of the present invention. This process is a control process in which an error process is added to the process according to the first embodiment (FIG. 5). Here, steps that are the same as those in FIG. 5 described above are denoted by the same symbols, and description thereof is omitted.

  In step S11, it is determined whether or not an error has occurred in the network. If an error has occurred, the process proceeds to step S6 to switch to reproduction of video data stored on the DVD.

  Note that this network error is detected by the network access unit 202, and the display switching is performed by the display switching unit 209.

  As described above, according to the second embodiment, when a video of a highlight scene is received from the server 212 and played back as a high-definition video, it can be played back as a standard video when an error occurs in the network. Thus, when a network error occurs, there is an effect that the reproduction of the video (image) can be continued even if the resolution is lowered.

[Embodiment 3]
FIG. 9 is a diagram for explaining the third embodiment of the present invention. Note that the configurations of the imaging device, the playback device, the server, and the network according to the third embodiment are the same as those of the first embodiment, and a description thereof will be omitted.

  In the third embodiment, squeeze recording is performed in which the image size when the resolution is converted and recorded on a secondary medium (DVD) is reduced. This squeeze recording is a method in which video is compressed only in the horizontal direction and recorded as an image having an aspect ratio of 4: 3. At the time of reproduction, if the monitor device is capable of reproducing in high-definition, the video is displayed with the horizontal direction expanded. With this method, an image with a horizontally long high-definition size can always be reproduced, although the resolution is lower than that of the image up-converted by the imaging apparatus. For this reason, since synchronization loss does not occur on the monitor, switching between normal playback and highlight scene playback becomes more natural. In cases where switching is still unnatural, a more natural switching is possible by adding a transient effect such as fade-in / fade-out when switching the display.

[Embodiment 4]
FIG. 10 is a diagram for explaining the fourth embodiment of the present invention. Note that the configuration of the imaging apparatus, playback apparatus, server, and network according to the fourth embodiment is the same as that of the first embodiment, and a description thereof will be omitted.

  A JAVA applet is originally provided with a pop-up display function and a function for controlling a display layout as its specifications. Therefore, various pop-up functions can be included in the applet written to the secondary medium (DVD). Specifically, if the photographer of the original video has not uploaded the video, a display indicating the gist of the original video is displayed when it is confirmed that there is no location by connecting to the network. Alternatively, as shown in FIG. 10, when uploading is completed, display 1001 indicating that the playback time of the highlight scene is approaching during playback is performed before the playback time is reached. Etc. are considered. If the playback device is not connected to the network, the user can check the connection with the network and display a recommendation to download the highlight scene.

  The fourth embodiment has been described on the premise of a JAVA applet and a virtual machine that operates the JAVA applet. Needless to say, the present invention can be realized without using a JAVA environment.

  The capacity of the highlight video uploaded to the server 212 is related to the capacity of the storage device (HDD) of the server. Therefore, if the storage capacity is sufficient, all the video data may be uploaded at a high-definition resolution. In addition, when the capacity of the storage device of the server 212 is limited, it is desirable to store in advance the capacity that can be uploaded to the server 212 in the imaging device according to the present embodiment.

[Embodiment 5]
FIG. 11 is a block diagram showing the configuration of a video camera according to Embodiment 5 of the present invention. The parts common to those in FIG. 1 are shown with the same symbols, and their explanations are omitted.

  In the third embodiment, at the time of copying to a secondary medium (DVD) by the recording unit 110, procedures such as video data decoding, audio downmix, and re-encoding are executed, and the re-encoded audio data is stored on the DVD. Write to. At this time, similarly to the first embodiment described above, the time information of the highlight scene is set. Further, a locator (installation location of acoustic data) on the server is designated, and the applet creation unit 113 creates an applet having a method (single functional unit of applet) that controls sound reproduction. These are written on the DVD together with the encoded sound data.

  As a downmix of sound according to the fifth embodiment, 5.1 channel sound (property characteristic) is converted into 2-channel sound data. In this conversion, equations (1) and (2) used in the description of the downmix unit shown in FIG. 12 are used. As described above, in the fifth embodiment, the highlight scene is displayed as a high-definition video in the first embodiment, whereas the highlight scene is reproduced with 5.1 channels, and the other two channels are displayed. It is characterized by being reproduced with the sound of

Lt = L + 0.707 × C + 0.707 × Ls + 0.707 × Rs Equation (1)
Rt = R + 0.707 x C + 0.707 x Ls + 0.707 x Rs (2)
FIG. 12 is a block diagram illustrating the configuration of the acoustic downmix unit 115 according to the fifth embodiment.

  The 5.1-channel acoustic data reproduced by the acoustic reproduction unit 1201 is decoded by the decoding unit 1202 and converted into 5.1-channel acoustic data. Next, the downmix unit 1203 converts the 5.1-channel acoustic data into 2-channel acoustic data (Lt, Rt). Then, the encoding unit 1204 encodes the 2-channel acoustic data and records it by the recording unit 1205.

  The original acoustic data of the highlight scene is uploaded to the server 212 identified by the network locator written on the DVD. At this time, the original long-time 5.1-channel acoustic data has a large file size and consumes the memory capacity of the HDD of the server 212, and the time required for uploading becomes enormous.

  Therefore, in the fifth embodiment, by setting a highlight scene, the file size of the acoustic data to be uploaded is suppressed, and the upload is not burdened. Similarly to the first embodiment, the server capacity setting unit 112 sets the capacity of data to be uploaded to the server 212. For this, the server 212 is accessed in advance, and the limit of the capacity of acoustic data that can be set in the server 212 is set, and can be used as auxiliary data when the user sets a highlight scene.

  FIG. 13 is a block diagram showing the configuration of the playback apparatus according to the fifth embodiment. In addition, the part which is common in above-mentioned FIG. 2 is shown with the same symbol. Compared to FIG. 2 described above, FIG. 13 is different in that the display switching unit 209 in FIG. 2 is changed to an acoustic switching unit 215.

  If the user who distributes the secondary media (DVD) has a normal two-channel sound (stereo) playback function, the user can play and watch this DVD. In addition, an applet written by JAVA VM 201 is activated to check the connection status with the network and manage time in sound reproduction. Specifically, when the playback time approaches the highlight scene, the network access unit 202 attempts to download 5.1 channel acoustic data from the server 212. If there is no acoustic data in the server 212, the reproduction of the two-channel sound (stereo) is continued as it is. On the other hand, when the acoustic data exists in the server 212, downloading of the acoustic data from the server 212 is started and stored in the cache memory 213. Then, when it is just before the highlight scene, the 5.1 channel acoustic data stored in the cache memory 213 is decoded, and the acoustic switching unit 215 switches to reproduction of the 5.1 channel acoustic data. Reference numerals 203 and 204 denote 5.1-channel audio data decoding units and 2-channel audio decoding units, respectively.

  At this time, common playback time management information is shared between the acoustic data recorded on the DVD and the 5.1-channel acoustic data distributed from the server 212 via the network. Specifically, the DTS and PTS installed in the PES in the MPEG-2 TS are detected and switched. Refer to FIG. 4 for the structure of TS.

  In the fifth embodiment, the standard 2-channel acoustic data stored in the DVD is compared with the time stamp of the acoustic data distributed from the network. And it becomes possible to reproduce sound data seamlessly at the timing of sound switching to switch to the highlight scene.

  FIG. 14 is a diagram illustrating an example of setting a highlight scene according to the fifth embodiment.

  This corresponds to the aforementioned FIG. However, while FIG. 3 is intended for high-definition video (image), in FIG. 14, in the example of setting a highlight scene, a highlight scene (data area) to be reproduced with multi-channel acoustic characteristics is set. Is different.

  FIG. 15 is a diagram illustrating switching between downmix sound data and multichannel sound data in a highlight scene according to the fifth embodiment.

  By adopting a configuration using the imaging device capable of recording on the secondary medium (DVD), its playback device, and the network acoustic data server 212 in this way, the distribution of the acoustic data according to the playback environment of each user ( And distribution).

  In the example of FIG. 15, in a certain section of a highlight scene where multi-channel sound reproduction is set, multi-channel sound data is reproduced, and in other scenes, down-mix (two-channel) sound data is reproduced. ing.

  FIG. 16 is a flowchart for explaining video data playback processing in the playback-side video display apparatus according to Embodiment 5 of the present invention. This process indicates a control process for switching acoustic data in place of video switching in the process according to the first embodiment (FIG. 5). Therefore, the processing in steps S21 to S24 in FIG. 16 is the same as the processing in steps S1 to S4 in FIG.

  This process is started when the user gives an instruction to start playback. First, in step S21, the JAVA applet 204 accesses the network. In step S22, it is determined whether the server 212 is accessible via the network. If the server 212 cannot be accessed, the process proceeds to step S26, where the acoustic data (2 channels) stored in the DVD is reproduced. On the other hand, if the server 212 is accessible in step S22, the process proceeds to step S23, and it is determined whether or not the acoustic data (5.1 channel) of the highlight scene of the original video has been uploaded to the server 212. If the highlight scene has not been uploaded, the process proceeds to step S26 to reproduce the sound data stored on the DVD. If the highlight scene is uploaded in step S23, the process proceeds to step S24, and the time information of the highlight scene written on the DVD is monitored. Then, the highlight scene time management unit 206 determines whether or not the set highlight scene playback time has come. When the playback time of the highlight scene is reached, the process proceeds to step S25, where the sound switching unit 215 switches to the sound data from the server 212 and plays back. At this time, in order to achieve strict synchronization, control is performed using the time stamp. On the other hand, when it is not the time of the highlight scene, the process proceeds to step S26 to reproduce the sound data stored in the DVD.

  As described above, according to the fifth embodiment, multi-chan sound data is reproduced during a set time in a highlight scene, and normal 2-channel sound data is reproduced otherwise. can do.

  In addition, by making the acoustic data uploaded to the server into acoustic data only in the specified section of the highlight scene, the amount of data transmitted over the network can be reduced, and the amount of memory occupied by the server can be reduced. There is an effect.

[Embodiment 6]
FIG. 17 is a diagram for explaining the sixth embodiment of the present invention. Note that the configuration of the imaging device, playback device, server, and network according to the sixth embodiment is the same as that of the fifth embodiment, and a description thereof will be omitted.

  In the above-described fifth embodiment, 5.1 channel acoustic data, which is a multi-channel, is distributed via a network, so that a necessary network band cannot be secured and there is a possibility that sound reproduction is interrupted. In addition, in the distribution of video data and audio data, there are many cases where data distribution such as RTP is performed with emphasis on real-time characteristics and accepting lack of data continuity (error).

  In view of such a case, in FIG. 17, when the sound data is interrupted, or when an error occurs in the sound data, the sound recorded on the secondary medium (DVD) is reproduced each time. It is characterized by switching.

  In the example of FIG. 17, if an error occurs in the network during reproduction of 5.1-channel multi-channel audio data, standard 2-channel audio data stored in the DVD is reproduced during the error.

  FIG. 18 is a flowchart for explaining video data playback processing in the playback-side video display apparatus according to Embodiment 6 of the present invention. This process shows a control process in which an error process is added to the process according to the above-described fifth embodiment (FIG. 16). Here, steps that are the same as those in FIG. 16 described above are denoted by the same symbols, and description thereof is omitted.

  In step S27, it is determined whether or not an error has occurred in the network. If an error has occurred, the process proceeds to step S26 to switch to reproduction of the acoustic data stored in the DVD.

  This network error is detected by the network access unit 202, and the acoustic data is switched by the acoustic switching unit 215.

  As described above, according to the sixth embodiment, when an error occurs in the network when the multi-channel sound data of the highlight scene is received from the server 212 and played back, the standard 2-channel sound is generated. Can be played back with data. As a result, when a network error occurs, there is an effect that the sound reproduction can be continued even if the quality of the sound data is lowered.

[Embodiment 7]
FIG. 19 is a diagram for explaining the seventh embodiment.

  A JAVA applet is originally provided with a pop-up display function and a function for controlling a display layout as its specifications. Therefore, various pop-up functions can be burned into the applet that writes to the secondary media. Specifically, when the photographer of the original data has not uploaded the sound data, information indicating the gist is displayed when it is confirmed that there is no location when connected to the network. Alternatively, as shown in FIG. 19, when uploading is completed, it may be possible to display a message 1901 indicating that a highlight scene is approaching during playback. Also, in a playback environment that is not connected to a network, the user may be prompted to check the connection to the network and display a highlight scene download or the like.

  In the seventh embodiment, a JAVA applet and a virtual machine that operates the JAVA applet have been described. However, the present invention can be realized without using a JAVA environment.

  Further, the capacity of the acoustic data of the highlight scene installed on the server is related to the capacity of a storage device such as the HDD of the server. Therefore, if there is sufficient capacity, all the acoustic data may be uploaded to the server 212. Further, when the capacity is limited, it can be realized by recording the capacity that can be set in the server 212 in advance in the imaging apparatus according to the present embodiment.

[Embodiment 8]
Next, an eighth embodiment of the present invention will be described. In the eighth embodiment, when primary medium (HDD, etc.) moving image data and still image data are recorded, only the moving image data is copied to the secondary medium (DVD), and the DVD is distributed to a third party. To do. In this case, the recording time information of the still image and the network access applet (or an equivalent application) are written on the DVD. In addition, the same still image recording time information is recorded on the primary medium that records both moving image data and still image data. Thereafter, as appropriate, the photographer of the original video uploads the still image data from the primary medium to a server on the network.

  On the other hand, a function for switching and reproducing a distribution image of still image data recorded during recording of a moving image and moving image data on a disc via a network under a reproduction environment of a secondary medium is provided. As a result, the still image data designated by the photographer of the original image can be reproduced, and the secondary distribution problem of the still image recorded in the moving image is solved.

  Since the configuration of the video camera according to the eighth embodiment is the same as the configuration of FIG. 1 according to the above-described first embodiment, description thereof is omitted.

  However, in the eighth embodiment, the time information setting unit 111 searches the time when the still image is recorded while reproducing the moving image data, and sets the searched time as the still image display location. Is different from FIG.

  FIG. 21 is a diagram illustrating an example of designating a still image display location in the eighth embodiment.

  In the figure, the starting point of a still image in a moving image is IN1 point. Note that the start point of the still image display setting may be set at a plurality of locations such as the IN1 point and the IN2 point.

  When copying to a secondary medium (DVD), video data is written to the DVD. At this time, setting of time information for displaying a still image and a locator (location of video data) in the server 212 are designated. In addition, an applet having a method (applet function unit) that controls video playback is created on the spot. Then, the applet is written on the DVD together with the moving image data. The completed DVD can be distributed to a third party.

  Still image data is appropriately uploaded to a location (server 212) identified by a network locator written on a DVD. Here, the server capacity setting unit 112 that sets the capacity of the server accesses the server 212 and acquires the capacity limit of video data that can be loaded into the server 212. This capacity data can be used as auxiliary data when the user sets display of still image data.

  FIG. 20 is a block diagram showing the configuration of the playback-side video display apparatus according to Embodiment 8 of the present invention. Here, parts common to the configuration of FIG. 2 described above are denoted by the same symbols, and description thereof is omitted.

  It is assumed that the user (playback video display device) to whom the secondary media (DVD) is distributed has a function of playing a DVD with a standard resolution video. When the written applet is activated by the JAVA VM, time management is performed for checking the status of the network connection and reproducing the video. Specifically, the still image data display time management unit 214 determines whether or not the reproduction time has approached the recording time of the still image data written in advance. If it is determined that the recording time of the still image data is approaching, the network access unit 202 attempts to download the still image data from the server 212 of the network designated in advance. If the still image data does not exist in the server 212, the reproduction of the moving image data is continued as it is.

  On the other hand, if still image data exists in the server 212, downloading of the still image data is started and stored in the cache memory 213. Then, immediately before the display timing of the still image, the still image data stored in the cache memory 213 is decoded by the decoding unit 203, and the display switching unit 209 switches from moving image to still image reproduction. Each of the decoding units 203 and 204 is a decoding unit for still image data distributed via a network and a decoding unit for moving image data recorded on a DVD.

  At this time, the moving image data recorded on the DVD and the still image data distributed via the network share common reproduction time management information. Specifically, the DTS and PTS installed in the PES in the MPEG-2 TS are detected and switched.

  In this way, by adopting a system configuration using an imaging device having secondary media, its playback device, and a server on the network, video data can be distributed according to the playback environment of each user.

  FIG. 22 is a flowchart for explaining video data playback processing in the playback-side video display apparatus according to the eighth embodiment.

  This process is started when the user gives an instruction to start playback. First, in step S31, the JAVA applet 204 accesses the network. In step S32, it is determined whether the server 212 is accessible via the network. If the server 212 cannot be accessed, the process proceeds to step S36 to reproduce the moving image data stored on the DVD. On the other hand, if the server 212 is accessible in step S32, the process proceeds to step S33, and it is determined whether still image data is uploaded to the server 212 by the photographer of the original video. If the still image data has not been uploaded to the server 212, the process proceeds to step S36 to reproduce the moving image data stored on the DVD. If the still image data is uploaded to the server 212 in step S33, the process proceeds to step S34, and the time information of the still image data written on the DVD is monitored. Then, the still image data display time management unit 214 determines whether or not the set still image display time in the moving image data has come. When the still image display time is reached, the process proceeds to step S25, where the display switching unit 209 switches to the display of the still image data from the server 212 and reproduces it. At this time, in order to achieve strict synchronization, control is performed using the time stamp. On the other hand, when it is not the display time of the still image data, the process proceeds to step S36 to reproduce the moving image data recorded on the DVD.

  With such a processing flow, it is possible to switch display between the moving image data of the DVD and the still image data from the server.

[Embodiment 9]
Next, a ninth embodiment of the present invention will be described.

  When switching between moving image data and still image data, for example, still image data is displayed using effect data such as a camera shutter image as shown in FIG.

  FIG. 23 is a diagram for explaining an example of an image effect of still image display according to Embodiment 9 of the present invention.

  When using such effect data, not only still image data but also this effect data is uploaded to the server 212 in advance. When the playback device switches from moving image data to still image data, this image effect can be displayed to enhance the still image display.

  In addition, when still image data and sound effect data are uploaded together to the server 212 and switched from moving image data to still image data, the sound effect can be reproduced to audibly enhance the still image.

  Further, the still image data, the image effect data, and the sound effect data are uploaded to the server 212 together. Then, when switching from moving image data to still image data, it is possible to enhance the still image both visually and audibly by reproducing these image effects and sound effects.

[Embodiment 10]
Next, an embodiment 10 of the invention will be described. In the tenth embodiment, similar to the fourth embodiment described above, the switching from the moving image to the still image is displayed immediately before the display switching of the still image data.

  The JAVA applet originally has a pop-up display control function and a function for controlling the display layout. Therefore, various pop-up functions can be recorded in the applet written to the secondary medium. Specifically, before the photographer of the original video uploads the still image data, it may be set to display information indicating the presence or absence of a still image by connecting to a network. Alternatively, as shown in FIG. 24, when the upload is completed, a display indicating that the time for displaying the still image data is approaching during the reproduction of the moving image is performed before the predetermined time. I think that. If the playback device is not connected to the network, the user may be prompted to check the connection with the network and recommend downloading of still image data.

  FIG. 24 is a diagram illustrating a display control example according to the tenth embodiment.

  In the figure, during the display of moving image data, if it is N seconds before the display timing of still image data, a message 2400 “display still image after N seconds” is displayed on the display unit 210. In step 2401, the still image data is displayed for a predetermined time. In step 2402, the continuation of the moving image data interrupted by the still image display is displayed.

  The tenth embodiment has been described on the premise of a JAVA applet and a virtual machine that operates the JAVA applet. However, the present invention can be realized without using a JAVA environment.

  Further, since the capacity of the still image data registered in the server is related to the capacity of the HDD of the server, if the HDD has a sufficient capacity, all data of moving images and still images may be uploaded. If the storage capacity of the server is limited, a data capacity that can be registered in the server may be stored in the imaging device in advance.

(Other embodiments)
In the present invention, a software program for realizing the functions of the above-described embodiments is supplied directly or remotely to a system or apparatus, and the computer of the system or apparatus reads and executes the supplied program. Can also be achieved. In that case, as long as it has the function of a program, the form does not need to be a program.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. That is, the claims of the present invention include the computer program itself for realizing the functional processing of the present invention. In this case, the program may be in any form as long as it has a program function, such as an object code, a program executed by an interpreter, or script data supplied to the OS.

  Various recording media for supplying the program can be used. For example, floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, CD-RW, magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD- R).

  As another program supply method, the program can be supplied by connecting to a home page on the Internet using a browser of a client computer and downloading the program from the home page to a recording medium such as a hard disk. In this case, the computer program itself of the present invention or a compressed file including an automatic installation function may be downloaded. It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the claims of the present invention.

  Further, the program of the present invention may be encrypted, stored in a storage medium such as a CD-ROM, and distributed to users. In that case, a user who has cleared a predetermined condition is allowed to download key information to be decrypted from a homepage via the Internet, and using the key information, the encrypted program can be executed on a computer in a format that can be executed. To be installed.

  Further, the present invention can be realized in a form other than the form in which the functions of the above-described embodiments are realized by the computer executing the read program. For example, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments can also be realized by the processing.

  Furthermore, the program read from the recording medium may be written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. In this case, thereafter, based on the instructions of the program, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing. .

  In the above embodiment, the video recording apparatus has been described as a video recording apparatus that records a captured image. However, the present invention is not limited to this, and a video recorder or video recorder that can reproduce and record a video is described. It may be a television receiver that can receive a high-definition broadcast or a 5.1 channel program and record it on an HDD or the like.

It is a block diagram which shows an example of a structure of the video camera which concerns on Embodiment 1 of this invention. 1 is a block diagram illustrating a configuration of a playback-side video display device according to a first embodiment. FIG. It is a figure explaining the example of a setting of the area displayed by the high vision in a highlight scene. It is a figure explaining the structure of TS. 6 is a flowchart for explaining video data playback processing in the video display device on the playback side according to the first embodiment. It is a figure explaining the example which displays and reproduces a highlight scene with video data from a server. It is a figure explaining Embodiment 2 of this invention. It is a flowchart explaining the reproduction | regeneration processing of the video data in the video display apparatus by the side of reproduction concerning Embodiment 2 of the present invention. It is a figure explaining Embodiment 3 of this invention. It is a figure explaining Embodiment 4 of this invention. It is a block diagram which shows the structure of the video camera which concerns on Embodiment 5 of this invention. FIG. 10 is a block diagram illustrating a configuration of an acoustic downmix unit according to a fifth embodiment. FIG. 10 is a block diagram illustrating a configuration of a playback device according to a fifth embodiment. FIG. 10 is a diagram illustrating an example of setting a highlight scene according to a fifth embodiment. FIG. 10 is a diagram illustrating switching between downmix sound data and multichannel sound data in a highlight scene according to the fifth embodiment. It is a flowchart explaining the reproduction | regeneration processing of the video data in the video display apparatus by the side of reproduction based on Embodiment 5 of this invention. It is a figure explaining Embodiment 6 of this invention. It is a flowchart explaining the reproduction | regeneration processing of the video data in the video display apparatus by the side of reproduction based on Embodiment 6 of this invention. FIG. 10 is a diagram illustrating Embodiment 7. It is a block diagram which shows the structure of the video display apparatus by the side of the reproduction | regeneration which concerns on Embodiment 8 of this invention. 218 is a diagram illustrating an example of designating a still image display location in Embodiment 8. [FIG. 29 is a flowchart for describing video data playback processing in the playback-side video display device according to the eighth embodiment. It is a figure explaining an example of the image effect of the still image display which concerns on Embodiment 9 of this invention. FIG. 38 shows a display example according to the tenth embodiment.

Claims (11)

  A designation means for designating a partial section of the first video data;
  Upload means for uploading the first video data of the designated section to a server;
  An application including playback time information based on the designated section and an address of the server to which the first video data of the designated section has been uploaded, the application of the designated section from the server Means for creating an application for acquiring the first video data by a playback device and playing it at a playback time specified by the playback time information;
  A video recording apparatus comprising: recording means for recording the second video data in which the resolution of the first video data is reduced and the created application on a recording medium. The recording means records the second acoustic data in which the number of channels of the first acoustic data corresponding to the first video data is reduced on the recording medium, and the uploading means includes the designated section. The video recording apparatus according to claim 1, wherein the first acoustic data is uploaded to the server. A video playback device for playing back the second video data and the application from the recording medium recorded by the video recording device according to claim 1,
  Obtaining means for obtaining, from the server, first video data of the designated section based on the application reproduced from the recording medium;
  When the designated section is reached during the reproduction of the second video data from the recording medium based on the application reproduced from the recording medium, the acquisition means replaces the second video data And an output means for outputting the first video data to a display device. When the acquisition means cannot acquire the first video data from the server, the output means is reproduced from the recording medium even if the designated section is reached during reproduction of the second video data. 4. The video reproduction apparatus according to claim 3, wherein the second video data is continuously output to the display device. The output means outputs to the display device that during the reproduction of the second video data, the first video data is switched to a predetermined time before the designated section. 5. The video playback device according to 3 or 4. An uploading means for uploading still image data to the server;
  Designating means for designating a reproduction time for reproducing the still image data when reproducing the moving image data;
  An application including reproduction time information indicating a reproduction time designated by the designation unit and an address of the server to which the still image data is uploaded, wherein the reproduction device acquires the still image data from the server. Means for creating an application for reproduction at the reproduction time specified by the reproduction time information;
  A video recording apparatus comprising: recording means for recording the moving image data and the created application on a recording medium. A video reproduction device for reproducing the moving image data and the application from the recording medium recorded by the video recording device according to claim 6,
  Obtaining means for obtaining the still image data from the server based on the application reproduced from the recording medium;
  The still image data acquired by the acquisition means instead of the moving image data when the specified reproduction time is reached during reproduction of the moving image data from the recording medium based on the application reproduced from the recording medium And an output means for outputting to a display device. A designation step for designating a part of the first video data;
  An uploading step of uploading the first video data of the designated section to a server;
  An application including playback time information based on the designated section and an address of the server to which the first video data of the designated section has been uploaded, the application of the designated section from the server Creating an application for acquiring the first video data by a playback device and playing it at a playback time specified by the playback time information;
  A control method for a video recording apparatus, comprising: a recording step of recording the second video data in which the resolution of the first video data is reduced and the created application on a recording medium. A method for controlling a video reproduction device for reproducing the second video data and the application from the recording medium recorded by the method for controlling a video recording device according to claim 8,
  Obtaining the first video data of the designated section from the server based on the application reproduced from the recording medium;
  When the specified section is reached during the reproduction of the second video data from the recording medium based on the application reproduced from the recording medium, the acquisition step is performed instead of the second video data. An output step of outputting the first video data to a display device. An upload process for uploading still image data to the server;
  A designation step for designating a reproduction time for reproducing the still image data when reproducing the video data;
  An application including reproduction time information indicating a reproduction time designated by the designation step and an address of the server to which the still image data has been uploaded, wherein the reproduction device acquires the still image data from the server. Creating an application for playback at the playback time specified by the playback time information;
  A method for controlling a video recording apparatus, comprising: a recording step of recording the moving image data and the created application on a recording medium. A control method for a video reproduction device for reproducing the moving image data and the application from the recording medium recorded by the video recording device control method according to claim 10,
  An acquisition step of acquiring the still image data from the server based on the application reproduced from the recording medium;
  The still image data acquired by the acquisition step instead of the moving image data when the specified reproduction time is reached during the reproduction of the moving image data from the recording medium based on the application reproduced from the recording medium And an output step of outputting the image to a display device.

Images