JP4290062B2 - Recording / playback device - Google Patents

Description

  The present invention relates to a video / audio recording / reproducing apparatus, and more particularly to a recording / reproducing apparatus capable of presenting an operation description of the apparatus to a user.

  In recent years, recording and playback devices such as digital video cameras and digital still cameras have become more and more miniaturized at the same time as multiple functions, and a plurality of functions are assigned to one button or buttons are not exposed on the surface of the device. Also, the user interface operation methods are becoming more complicated, such as using a user interface with a different operation method such as a touch panel, buttons, and jog dial.

  As the number of functions increases, the number of pages of the instruction manual increases, and it is a considerable burden on the user just to read through all the functions and operation methods. Therefore, for some products, a tutorial video that explains the operation method using audio and moving images is attached to the product so that it can be understood more easily than reading the instruction manual, thereby reducing the burden on the user.

  Some of these tutorial videos are taken by simply shooting the situation where the model is actually operating the product, but the description method for synchronously playing back multimedia data such as text, diagrams, video, still images, and audio, For example, using SMIL (Synchronized Multimedia Integration Language), which describes synchronization relationships in XML (eXtensible Markup Language) language, and QuickTime (registered trademark) file format, which synchronizes tracks managed in time by content, audiovisually It is also possible to provide an effective explanation.

  As an example of the description method for synchronously reproducing multimedia data as described above, a method for synchronizing audio and video of an MPEG2 code stream using a QuickTime file format is disclosed in, for example, Patent Document 1. Other display-related controls using the QuickTime file format are described in “Inside QuickTime File Format, March 27, 2001, Apple Computer, Inc.”.

  In this way, although the burden of reading the instruction manual is reduced by using the tutorial video, the relationship between the displayed content of the tutorial video and the operation on the actual product has not been realized, so the user can feel the operation. It was not possible to learn the main body operation. As a technique for allowing a user to recognize the relationship between a tutorial (guidance) display and an actual product (actual machine), for example, Patent Document 2 includes an appearance image of a controller of a game machine in the guidance display of game software. Discloses a method of causing a light-emitting element provided on a corresponding key of an actual controller to blink correspondingly when a predetermined key is blinked.

JP 2001-094933 A (page 15, FIGS. 3 and 4) JP 2000-042249 A (page 11, FIG. 11)

  However, in the recent multi-functional video camera system, the operation method is also diversified, and the user's function cannot be understood and the operation feeling cannot be obtained only by devising the display method as described in Patent Document 1. There is a problem that the functions provided in can not be fully used.

  Furthermore, the display control description of QuickTime and XML is only a description regarding the display method, and it is not assumed to describe a command for operating a device that executes the description and its temporal arrangement. Therefore, as a means for controlling the current video camera system, there is only a degree of control by directly operating an operation button or key provided in the video camera system or by an external command using a digital interface. AV / C protocol that defines the IEEE 1394 digital interface is one of the most popular types of control using a digital interface. The AV / C protocol exchanges commands for operating the camera such as zoom and aperture, and commands for performing storage operations for recording and playing back video data on a recording medium such as a disc, etc., via a digital interface. Realizes control of the other device.

  However, control of a video camera system using commands according to the conventional AV / C protocol is merely used as a means for remote operation, and is not used in combination with other operations such as display control. Also, a description for executing such a command in combination with, for example, display control is not defined.

  In addition, as in the technique described in Patent Document 2, it is easy for the user to find a place to operate by simply blinking the operation system in conjunction with the explanation. You can't get a sense of operation like moving. In Patent Document 2, the above-described control is performed by executing a program that describes a state change, but the program description due to the state change is not familiar to the contents of the timeline to be explained and displayed in the program description. The entire system must also be controlled. Furthermore, it is necessary to secure an internal memory for loading the control program, and it is impossible to realize it in a power-saving resource-saving embedded device such as a digital video camera.

  An object of the present invention is to solve such problems of the prior art.

To achieve the above object, a recording and reproducing apparatus according to the present invention recorded on a recording medium at least image data, also a reproducing apparatus for reproducing from a recording medium, a predetermined operation pre-type recording and reproducing apparatus Time for image data for explaining the image, control data for instructing the recording / reproducing apparatus to execute an operation according to a predetermined operation , an image display timing for the image data, and an operation execution timing according to the control data reproducing means for reproducing the management information indicating a relationship between the recording medium, based on the management information, while displaying the image according to the image data to the display device, it is specified in the control data corresponding to the image data before Symbol displayed Control means for causing the recording / reproducing apparatus to perform the above-described operation.

  According to the recording / reproducing apparatus of the present invention, it is possible to actually execute the described operation and present it to the user while explaining the operation, so that the user can understand the operation while experiencing it. , Learning of more effective operation can be realized.

Hereinafter, the present invention will be described based on preferred embodiments with reference to the drawings.
● (first embodiment)
FIG. 2 shows an example of the overall configuration of a digital video camera recorder (digital camcorder) as an example of a recording / reproducing apparatus according to the first embodiment of the present invention. A digital camcorder is a device that digitizes a video from a camera input unit or the like and records it on a recording medium, reproduces the recorded digital data, and outputs it to a display unit or the like.

  In the figure, 10 is an optical system including an optical component such as a lens and a diaphragm and a control circuit such as an AF control circuit, 11 is an imaging unit represented by a CCD that converts an optical signal obtained through the optical system into an electrical signal, Reference numeral 12 denotes a video processing unit that changes an electric signal from the imaging unit to digital video data, 13 denotes a compression unit that compresses and encodes the video data to improve recording efficiency, and 14 denotes a unit suitable for the compressed video data for the recording medium. A video packet unit 20 is divided into a sound collecting unit 20 such as a microphone that acquires audio information emitted from the periphery including the subject and converts it into an audio signal that is an electrical signal, and 22 an audio that converts the audio signal into digital audio data. A processing unit 23 is a compression unit that compresses and encodes audio data to improve recording efficiency, and 24 is an audio packet unit that divides the compressed data into units suitable for the recording medium. 30 is a control unit which controls and information collection and creation of each block in the digital camcorder, for example, a CPU and a ROM for storing the control program, are realized by a combination of RAM and the like. The operation unit 70 includes, for example, keys, buttons, a touch panel, a jog dial, and the like, and is used by the user to give instructions to the recording / reproducing apparatus. 31 is a metadata packet unit that treats information related to video data and audio data as metadata and divides it into units suitable for the recording medium, and 32 is management information relating to each packet data and recording method of video, audio and metadata. A management information generating unit 40 to generate, a recording processing unit 40 for digitally recording each packet data and management information on a recording medium, and 41 a recording medium represented by a disk-shaped recording medium on which each packet data is recorded.

  42 is a reproduction processing unit that reads out packetized data from the recording medium 41, 15 is a video extracting unit that extracts video data packets from the read digital data and converts them into digital video data strings, and 16 is extracted. A decompression unit 17 that decompresses the digital video data sequence from a state compressed for recording to the original real-time processing data, and 17 performs processing at the time of reproduction such as synthesis on the real-time processing data, A synthesis processing unit for converting into a video signal, 18 a display unit for displaying the video signal, 25 an audio extraction unit for extracting packets related to audio data from the read digital data and converting them into a digital audio data string, and 26 for extraction The decompression unit 27 decompresses the digital audio data that has been compressed from the state compressed for recording into the original real-time processing data. A processing unit that converts the digital audio data into soundable data and audio signals, 28 is a sounding unit represented by a speaker that generates audio signals, and 33 is information (metadata) about video and audio from the reproduced digital data. The metadata extraction unit 34 extracts the packet of the video and converts it into digital metadata, acquires management information regarding video, audio, and metadata via the reproduction processing unit 42, analyzes the management information, and passes it to the control unit 30. It is a management information analysis unit.

(Recording operation)
Next, the recording operation of the digital camcorder of the present embodiment having the configuration of FIG. 2 will be described with reference to FIG. 7 showing an example of the configuration of each digital data and FIG. 8 showing an example of the configuration of management information of each digital data. .

  A subject image is formed through the optical system 10 and converted into an optimal electrical signal by the imaging unit 11. At this time, the control unit 30 controls the focal length (zoom), focusing (focus), aperture (iris), and the like of the lenses included in the optical system 10 so that an appropriate subject image is formed on the imaging unit 11. . The control unit 30 also controls the amplitude (gain), the storage time (electric shutter), and the like so that the electrical signal output from the imaging unit 11 can be processed later. The subject image converted into the electric signal is converted into digital video data by the conversion processing unit 12, and is compressed and encoded while maintaining a predetermined image quality by the compression unit 13, thereby improving the recording efficiency. The compressed digital video data is divided into units suitable for recording by the video packet unit 14 and sent to the recording processing unit 40. Here, description will be made assuming that the compression of digital video data is the international standard MPEG2 system, and image data of one field is assumed to be one packet unit.

  On the other hand, the sound information is collected by the sound collecting unit 20 and converted into an optimal electrical signal (sound signal). The conversion processing unit 22 converts the audio signal into digital audio data, and the compression unit 23 compresses the data while maintaining a predetermined audio quality, thereby improving the recording efficiency. The compressed digital audio data is divided into units suitable for recording by the audio packet unit 24 and sent to the recording processing unit 40.

  Further, camera parameters such as focal length, focus, aperture, amplitude, and storage time used by the optical system 10 and the imaging unit 11 at the time of shooting are acquired from the control unit 30 that controls these camera parameters, and metadata about video data is acquired. Are further divided into units suitable for recording by the metadata packet unit 31. Here, since the packet unit of the video data is one image field, the metadata packet is one packet per video frame as data synchronized with the video frame.

  In this specification, the minimum data unit managed by management information is called a sample. A packet generated by each of the packet units 14, 24 and 31 can be composed of one or more samples. However, when packetized for each sample, the packet may be referred to as a sample.

  The above packet data (sample) is recorded on the recording medium 41. The management information generating means 32 generates the time information and display method of each sample as management information, and the video data, audio data, metadata (these are Associated with the content data) and sent to the recording unit 40. Specifically, when recording a content data file in which video data, audio data, and metadata are combined into one file, management information is sent to the recording unit 40 as its file header or footer. In addition, when video data, audio data, and metadata are recorded as individual files, management information is also sent to the recording unit 40 as individual files. In the latter case, the management information includes information (file path, URI, etc.) that can identify video data, audio data, and metadata.

  The recording unit 40 records content data and management information on the recording medium 41 in a predetermined format in accordance with an instruction from the control unit 30. Here, it is assumed that the recording medium is a DVD-RAM disk and the recording format is a UDF (Universal Disk Format) format system.

  These video / audio / meta content data are arranged in time series in packets (samples) as shown in FIG. The time interval Tv between the video data samples 101 to 108 is one field interval, and is 1.001 / 60 seconds for NTSC television signals. Further, the time interval Ta of the audio data samples 101 to 116 is a sampling interval, which is 1/4441000 seconds when sampled at 44.1 kHz. Further, the time interval Tm of the metadata samples 131 to 134 is 1.001 / 30 seconds in frame intervals.

(Example of management information configuration)
FIG. 8 is a diagram showing a configuration example of content data management information in the present embodiment. In this embodiment, the management information format used in the QuickTime and MPEG4 formats will be described as an example.

  As shown in FIG. 8, the management information is described in a hierarchical structure, and information related to the hierarchy is managed as header information (201, 212, 214, 216, 222, 224, 226, 232, 234, 236) in each hierarchy. Yes. As for each hierarchy, an overall management hierarchy (200) in which a plurality of contents are collected, a track hierarchy (211 221 231) for managing the plurality of contents individually, and a media hierarchy for managing the types of contents (video, audio, meta) (213, 223, 233), a media information hierarchy (215, 225, 235) for managing information common to media, and a sample information hierarchy (217, 227, 237) for individually managing sample data constituting the media. .

  Here, when the video, audio, and meta content data tracks are managed by being divided in units of samples as shown in FIG. 7, in FIG. 8, the video data tracks are stored in the header information 214 of the media management information management layer. “Video” is described, and the sample time interval is described in the time information 219 of the sample information management layer as “8” and “(Tv value)”, respectively. Similarly, the audio data track is described as “audio” in the header information 224 of the media management information management layer, and the time interval of the samples is the time information of the sample information management layer 229, and the number of samples and the time interval are “ 16 ”and“ (Ta value) ”. Further, the metadata track is similarly described as “meta” in the header information 234 of the media management information management layer, and the time interval of the samples is the number of samples and the time interval of “4” in the time information 239 of the sample information management layer. "And" (Tm value) ".

(Reproduction processing)
A reproduction process of the content data recorded as described above will be described. Returning to the block diagram of FIG. 2, upon receiving a reproduction command from the control unit 30, the reproduction processing unit 42 reads the digital data recorded on the recording medium 41. From the read digital data, the video extraction unit 15 extracts video data as a digital video packet and converts it into a digital video data string. Since the digital video data is compressed to improve the recording efficiency, the data decompression unit 16 decompresses the original video data to the original real-time processing data. The expanded digital video data is sent to the composition processing unit 17.

  Further, the metadata extraction unit 33 extracts the metadata from the digital data read by the reproduction processing unit 42 as a metadata packet, and sends the metadata packet to the control unit 30. Further, management information is extracted by the management information analysis unit 34 from the header or footer portion (or management information file) of the content data file read by the reproduction processing unit 42, and video data, audio data, meta data is extracted based on the management information. The packet arrangement and time relationship of each content of data is analyzed, a time schedule for displaying and reproducing a plurality of contents is created, and passed to the control unit 30.

  When displaying the metadata along with the video data, the control unit 30 sends the metadata to the composition processing unit 17 in a predetermined format capable of displaying the metadata. Various information related to reproduction such as a time schedule obtained from the management information is also sent to the composition processing unit 17.

  In the composition processing unit 17, the video data sent from the decompression unit 16 and the metadata sent from the control unit 30 are synthesized in accordance with various information related to playback of the control unit 30, and displayable data and signals (video Signal). Here, the conditions regarding reproduction are the analysis results of the management information described above. In the management information of FIG. 8, a specific example will be described. The number of samples (8) and time interval (Tv) described in the time information 219 related to video data, and the sample described in the time information 239 related to metadata. From the number (4) and the time interval (Tm), the processing schedules of both content data are allocated as metadata 1 sample (eg 131) to the video data 2 samples (eg 101, 102) of FIG. The processing of the synthesis processing unit 17 is executed. The synthesized image data is displayed on the display unit 18.

On the other hand, regarding the reproduction of audio data, the audio extraction unit 25 extracts video data as audio packets from the digital data read by the reproduction processing unit 42 and converts it into a digital data string. Since the audio digital data is compressed for improving the recording efficiency, the data decompression unit 26 decompresses the data to the original real-time processing data. The expanded audio data is converted into data or a signal (audio signal) that can be generated by the processing unit 27 and sent to the sound generation unit 28 to generate sound. The time schedule for the video and audio processing of Kotonoki is performed in accordance with the time schedule analyzed by the management information analysis unit 34, as described in the metadata and video data section. Specifically, in the management information of FIG. 8, the time information regarding the audio data is the number of samples (16) and the time interval (Ta) described in 229, and the audio data 2 samples (eg, 111 to 112) of FIG. ) Is assigned as one sample of video data (for example, 101), and audio data processing is executed and sounded at this timing.
FIG. 9 is a diagram conceptually showing a state in which video data, audio data, and metadata are reproduced in synchronization.

(Use of tutorial content file)
Now, the present embodiment is characterized in that the recording / playback apparatus's own tutorial is presented to the user while experiencing the operation of the actual product using the above-described recording / playback function of the recording / playback apparatus. Such a tutorial can be realized by using a device control data track instead of the metadata track described above and providing a tutorial content playback mode (tutorial mode) in the imaging device.

  The tutorial mode is a mode in which processing for reading and reproducing video data and audio data from a storage medium can be performed independently of the operation of the recording / reproducing apparatus. In other words, the video data / audio data can be read out and played back in parallel with the operation in the camera mode (recording mode) according to the control of the device control data.

  Since a normal recording / reproducing apparatus is not used in this way, a recording / reproducing apparatus having such a mode is new. However, since the processing capability of hardware such as a CPU is currently improved, Such an operation mode can be realized without adding a special configuration. Specifically, in the tutorial mode, the execution of control data in parallel with the reproduction process may be accepted. In this embodiment, the display area of the display unit 18 is divided into a display area corresponding to the camera mode and an area for displaying video data being reproduced. Specifically, the display area corresponding to the camera mode is displayed as a sub-screen.

  The recording / reproducing apparatus of the present embodiment operates in the tutorial mode when reproducing content data including device control data content. Whether or not the content data to be reproduced includes the device control data content can be recognized by referring to the header information included in the management information.

  FIG. 3 is a diagram showing a configuration of content data constituting a tutorial content data file that can be processed by the recording / reproducing apparatus according to the present embodiment. In each sample 141 to 148 of the device control data, a command for operating the recording / reproducing apparatus of the present embodiment is described, and the period Tc of each sample so that the control sample is also processed in synchronization with one video sample. Has been determined. That is, Tv = Tc.

  However, in this example, since one control sample is processed in synchronization with one video sample, the video data sample interval Tv in the tutorial content is set not to one field period but to a longer time. In other words, the next device control data needs to be executed after a sufficient time has passed for the user to confirm that the recording / playback apparatus is controlled by a certain device control data. Then, the control is performed from one to the next, and there is not enough time for the user to understand the operation procedure and the actual operation of the recording / reproducing apparatus.

  Therefore, Tv is set to about 5 to 15 seconds, for example, and a moving image for explaining device control performed by one device control sample is handled as one sample. In FIG. 3, the one-sample interval Ta of voice is Tv / 2. However, for voice, if the voice for one device control is handled as one sample, the processing is further simplified. Therefore, the case where Tv = Ta = Tc is the simplest form. As described above, since the sample is the minimum management unit in the management information, there is no problem even if one sample includes moving images for a plurality of fields. The same applies to audio.

  FIG. 4 illustrates management information for managing sample data of device control data. Since the video data and audio data are the same as those in FIG. 8, description thereof is omitted, but management information (241 to 249) of device control data is included instead of the management information of metadata. As important management information, the media information header 244 describes that the content data corresponding to the management information is device control data, and the time information of the sample information includes the same number of samples (8) as the video data. A time interval (Tc) is described. Furthermore, the track header 242 for managing the contents of the control device data describes the area of the display unit 18 for displaying the result of executing the control device data as the content data. In the case of the present embodiment, it is assumed that the setting is described as a lower right child screen.

  FIG. 5 shows a specific example of each sample 141-148 of the device control data shown in FIG. The basic structure of the device control data sample is as shown in FIG. 5A, and a plurality of commands can be described in one sample. Then, the registration number (number of entries) of the main body operation command described in the sample is described at the top, and information regarding each registration is described next. At the beginning of each registration, a size (size) relating to the registration is described, and then a command group (subunit) for main body operation is described. The entity (operation description) of the main body operation command is described thereafter, and if there are arguments (parameters) related to the command, the necessary number is described after the operation description. The size (size) related to registration is the total number of sizes, subunits, operation descriptions, and parameters for each registration.

  The composition of this subunit, operation description, and parameters is an AV / C (Audio / video Control) command frame in the AV / C protocol that defines a digital interface on the IEEE 1394-1995 bus (for details, see AV / C Digital Interface Command Set General Specification Version 4.1 (see 1394 TRADE ASSOCIATION December 11, 2001)), command transaction format (cts) describing AV / C specific to digital interface, command type code (ctype) indicating the type of operation command, This is equivalent to a configuration excluding a code (subunit_ID) for identifying a plurality of devices. In the digital interface that assumes a plurality of types of connected devices, cts and subunit_ID are necessary. However, when the target of the main body operation is limited to the recording / reproducing apparatus as in this embodiment, these pieces of information can be omitted. is there. In addition, the digital interface assumes a dynamic application such as PC software, and can handle multiple types of commands such as command, status, confirmation, and notification, so it is possible to describe what type of command is in the ctype field. However, in this embodiment, the tutorial content file written in the recording medium 41 is played back, there is no bidirectional exchange, and only the main body operation command that gives a command unilaterally is included. The ctype field describing the type is also omitted.

Hereinafter, specific examples of Samples 1 to 4 (141 to 144) and Samples 5 to 8 (145 to 148) will be further described with reference to FIGS.
In FIG. 5B, in the sample 1 (FIG. 3: 141), three main body operation commands related to the camera mode starting operation are registered. That is, the power of the camera (the optical system 10, the imaging unit 11, the processing unit 12, the sound collecting unit 20, and the processing unit 22 in FIG. 2) is turned on for the first registration, and the display (child screen) is turned on for the second registration. In the (display start), the display of the camera EE, and the third registration, a main device control command for turning on the power of the disk (recording start standby state) is registered.

  Sample 2 (142) has one main body operation command registered. There is no restriction on the recording mode such as overwriting or the like by the recording operation of the disk in the first registration, the camera input, and A01. A setting at the time of shooting to start recording with a file path of mov and a main device control command for instructing to start shooting are registered.

  In the sample 3 (143), one main body operation command is registered, and in the first registration, a main body device control command related to a zoom-in operation of operating to the telephoto side by a zoom operation of the camera is registered.

  In sample 4 (144), one main body operation command is registered, and in the first registration, a main body device control command relating to a zoom-out operation of operating to the wide angle side by a zoom operation of the camera is registered.

  In FIG. 5 (c), two main body operation commands are registered in Sample 5 (145). In the first registration, there is no restriction on the recording mode such as overwriting or the like by the disk recording operation, the camera input. And A01. A command for stopping the recording operation to the file path called mov is registered in the second registration, and a main body device control command relating to the end of photographing for turning off the power of the camera is registered.

  In sample 6 (146), two main body operation commands are registered. In the first registration, the disk list acquisition operation acquires the file list of the file path specified by \ A \ B \, and the second registration. A main device control command related to index display for switching the display on the display to the DISK operation output is registered.

  One sample operation command is registered in sample 7 (147), and A01. A main device control command related to an index selection operation of selecting a file designated by mov is registered.

  In sample 8 (148), one main body operation command is registered, and in the first registration, a disc playback operation, A01. Registered is a main device control command related to the start of playback, ie, the start of a playback operation that is output to the display device from the beginning position of the file mov.

  In the present embodiment, the device control data is extracted by the metadata extraction unit 35, sent to the control unit 30, and executed.

  By scheduling the processing of the main device control data by the management information analysis unit 34 based on the management information, the time alignment as shown in FIG. 3 is achieved, and the playback control display in which the contents are synchronized is realized as shown in FIG. Is done. Note that such synchronized playback (execution) processing of a plurality of contents is performed by, for example, mounting a software component capable of playing back a QuickTime movie file and a software component that interprets and executes an AV / C command on the recording / playback apparatus. It is possible to realize.

  For example, when a DVD-RAM medium on which a tutorial content file is recorded and automatically reproduced is set in a recording / reproducing apparatus, the content file is read and reproduced. At this time, as described above, when it is recognized from the management information that the device data is included in the content data, the recording / reproducing apparatus in the present embodiment shifts to the tutorial mode, and the reproduction and device of the video data and audio data The control data is executed in parallel.

  In FIG. 6, the process progress and result display by the main body control device data are displayed in the display area (lower right child screen) designated by the header 242 of the management information described above. FIGS. 6A to 6H show the display on the display unit 18 and the sound output from the generation unit 28 when the control data samples 141 to 148 (that is, the samples 1 to 8 in FIG. 5) are executed. Is schematically shown.

  First, a moving image (video sample 101 in FIG. 3) representing an operation for switching to the camera mode is played back, and playback of audio samples 1 and 2 (“switch to camera mode”) is played back simultaneously. Also, the device control data sample 1 (FIG. 5) is executed, and the subject image observed through the optical system 10 and the imaging unit 11 is turned on when the cameras (10 to 12, 20, and 22) are turned on and the sub-screen display is started. It is displayed on the sub screen of the display unit 18 (camera through display).

  Similarly, FIG. 6B starts shooting, FIG. 6C zooms in, FIG. 6D zooms out, FIG. 6E ends shooting, FIG. 6F displays an index, A series of operations in which FIG. 6G shows index selection and FIG. 6H shows playback start will be described.

  At this time, while the video (video data) and audio (audio data) explaining the operation of the main body are played back and displayed, the operation explained is actually performed on the main body of the apparatus, and the status and result are displayed on the sub-screen. By doing so, the user can understand the operation explained by the video and the sound while experiencing the actual operation.

  FIG. 1 is a flowchart showing the operation of the part related to device control data processing in the tutorial content data playback processing in the recording / playback apparatus of the present embodiment. FIG. 1 (a) shows the overall flow, and FIG. Shows details of the command execution processing in the device control data sample.

  In FIG. 1A, management information is extracted by the management information analysis unit 34 from the data read by the reproduction processing unit 42, and the management information is analyzed (S110). Then, when it is identified from the management information header 235 that the device control data is included as the content data, the control unit 30 is notified, and the control unit 30 shifts the recording / reproducing apparatus to the tutorial mode (S120).

  Next, the management information analysis unit 34 notifies the control unit 30 of the designation of the position of the child screen described in the management information header 242, and the control unit 30 displays the designated area (lower right child screen) of the display unit 18 in the camera. It is set as an area for displaying the same content as that displayed on the display unit 18 in the mode (S130). Further, the management information analysis unit 34 creates a time schedule regarding the processing time of each sample of the device operation data based on the time information 219, 229 and 249 regarding each content data included in the management information, and passes it to the control unit 30 (S140). ). Then, the control unit 30 sequentially executes the control commands described in FIG. 5 described in each sample while reproducing the video data and the audio data according to the time schedule (S150), and when all the processes are completed. This completes the device operation process.

Next, the process of S150 in FIG. 1A will be described with reference to FIG.
The control unit 30 starts a timer that manages the time (Tc) of the time schedule (S142). For example, the timer may be a counter that counts clock signals used by the control unit 30. In S143, it is determined whether the total processing time (here, Tc × 8) has elapsed (whether the end time has been reached), or whether the counter value has reached a value corresponding to the previously determined time of Tc × 8. Judge by whether or not. If the end time has been reached, the process ends. If not, the process proceeds to S144.

  In S144, whether or not the sample interval Tc has passed is determined based on whether or not the counter value has reached a counter value corresponding to a multiple of Tc. If Tc has not elapsed, the process returns to the previous end determination process (S143). On the other hand, when S144 is first executed and when Tc has elapsed for the sample currently being processed, an operation command described in the device description data sample is acquired (S145) and executed (S146). The process returns to the end time determination step (S143). When the counter exceeds a predetermined value in the end time determination step, the sequential command processing ends.

  As described above, according to the recording / reproducing apparatus according to the present embodiment, the operation explained by executing the control command is performed while reproducing the video and audio explaining the operation of the recording / reproducing apparatus. It is possible for the user to clearly understand the correspondence between the operation explained by voice and voice and the actual operation.

● (Second Embodiment)
Next, a recording / reproducing apparatus according to the second embodiment of the present invention will be described. The configuration of the recording / reproducing apparatus according to the present embodiment is the same as that of the recording / reproducing apparatus according to the first embodiment, and thus the description of the configuration is omitted.

  FIG. 11 is a diagram showing a configuration of content data processed by the recording / reproducing apparatus according to the present embodiment. As in the first embodiment, device control data is defined as content data instead of the metadata in the description format shown in FIG.

  In FIG. 11, device control samples 141 to 144 describe commands for operating the recording / playback apparatus of the present embodiment, and the time at which the control samples are also processed in synchronization with other content data (video, audio). There is a schedule.

  FIG. 12 illustrates management information for managing sample data of device control data. Since the video data track and the audio data track are the same except that the time information (219, 229) of FIG. 8 is omitted, only different portions will be described. First, as in the first embodiment, management information (241 to 248) of device control data is placed instead of the management information of metadata. As important management information, the media information header 244 describes that this data is device control data. Furthermore, the track header 242 for managing the contents of the control device data describes an area for displaying the result of the command executed on the control device data. In the case of this embodiment, it is described with the setting of the lower right child screen.

  In the present embodiment, the time information is managed independently by the division management information. For this reason, division reference information 202 indicating that time information is managed by independent division management information is described under the overall management information in the management information file.

  This point will be further described with reference to FIGS. 11 and 13. In FIG. 11, the device control data is processed in synchronization with other content data to be controlled for reproduction. For example, the control data sample 1 (141) is processed in the time of the length Tc1, while the video data sample 1 (101) and the audio data sample 1 (111) to the audio data sample 2 (112) are reproduced in parallel. It is processed. Similarly, the control data sample 2 (142) is processed in the time of the length Tc2, and in the meantime, the video data sample 2 (102) to the video data sample 4 (104) and the audio data sample 3 (112) to Audio data sample 8 (118) is processed. Thereafter, the control data sample 3 (143) and the control data sample (144) are similarly processed in synchronization with the video data sample and the audio data sample. In this way, each content data sample is processed in synchronization with each other in accordance with a predetermined time schedule.

  In this embodiment, each content data sample is grouped by a predetermined time length. Specifically, the sample time sequence is divided into a plurality of groups in accordance with the control data sample processing time schedule. In FIG. 11, division 1 that is the first group in accordance with control data sample 1 (141) is divided into video data sample 1 (101), audio data sample 1 (111) to audio data sample 2 (112). To do. In accordance with the subsequent control data sample 2 (142), as a second group, division 2, the video data sample 2 (102) to the video data sample 4 (104) are mixed with the audio data sample 3 (113) to the audio data sample 8. Divide into (118). Further, as a third group, division 3, in accordance with the control data sample 3 (143), the audio data sample 9 (119) to the audio data sample 10 (120) are divided into the video data sample 5 (105). In addition, as a division 4 which is a fourth group in accordance with the control data sample 4 (144), the video data sample 6 (106) to the video data sample 8 (108) are mixed with the audio data sample 11 (121) to the audio data sample. 16 (126).

  As described above, the present embodiment is characterized in that the sample data constituting the content information is divided according to the processing schedule of the control data samples. In this embodiment, the device control data sample includes one or more control commands issued to the recording / reproducing apparatus, and one sample constitutes one control event. Accordingly, the division (grouping) here can also be called division (grouping) in units of control events.

  In the present embodiment, the management information is similarly divided (grouped). The management information divided in the same manner as the content data sample division described above will be described with reference to FIG. FIG. 13 is a diagram showing the state of the division management information generated for each control event. The division management information describes the synchronization relationship of each content data sample included in the corresponding sample group. In FIG. 13, the synchronization relationship of the samples divided into four groups is the management information described in FIGS. 13A to 13D, respectively, in a format independent of the overall management information shown in FIG. It is managed. Further, these four division management information are stored in the same file as the whole management information of FIG.

  In FIG. 13A, the division management information 300 includes header information 301, and the division group to be managed is managed as “division 1”. The header 301 stores an ID for identifying a control event corresponding to this division management information, and during reproduction, the division management information is management information related to a different control event by detecting this ID. Can be recognized.

  Further, in this hierarchy, there are track information (311, 321 and 341) for managing a plurality of pieces of content information (video data, audio data and control data), respectively, and each header information (312, 322 and 342) is included in each header information (312, 322 and 342). Track identification information (track 1, track 2, track 3) managed by the overall management information in FIG. 12 is described, and the consistency of the track with the overall management information is maintained.

Further, time information (319, 329, 349) omitted in the overall management information is described below each track information layer.
Specifically, the division 1 group describes that one video sample is present on track 1 and the time interval is Tv. Similarly, it is described that the track 2 has two audio data samples and the time interval is Ta. Further, it is described that the track 3 has one control sample and the time interval is Tc1.

  In this way, the time information of only the sample data in the divided group is managed by the division management information. Similarly, in the group of division 2 to division 4, the description is as shown in FIGS.

  As described above, the time information omitted in the overall management information in FIG. 12 is managed independently by the division management information as described above. For this reason, division reference information 202 indicating that time information is managed by independent division management information is described below the overall management information in the management information file.

  FIG. 14 shows a description example of each sample 141 to 144 of the device control data in the present embodiment. The basic structure is as described with reference to FIG. 5A in the first embodiment. In FIG. 14, in the sample 1 (FIG. 11: 141), three main body operation commands constituting the photographing start operation event are registered. More specifically, the camera registration is described in the third registration, and the camera EE is displayed together with the display power ON in the second registration. Regarding the recording operation of the disc, there is no limitation on the recording mode such as overwriting by camera input, and A01. It is described that recording starts with a file path of mov.

  In sample 2 (142), two main body operation commands constituting the shooting end operation event are registered, and there is no restriction on the recording mode such as disc recording operation, camera input, overwriting, etc. in the first registration. . A device control command for stopping recording of the file path mov and turning off the power of the camera is registered in the second registration.

  In sample 3 (143), one main body operation command constituting the playback start operation event is registered. A device control command for starting a reproduction operation to be output to the display device from the head position of the file mov is registered.

  In sample 4 (144), one main body operation command constituting the reproduction end operation event is registered, and a main body device control command for stopping the disk reproduction operation is registered in the first registration.

  Also in this embodiment, the device control data is extracted by the metadata extraction unit 35, sent to the control unit 30, and executed.

  By scheduling the above-mentioned main device control data processing by the management information analysis unit 34 based on the management information, the time alignment as shown in FIG. 11 is realized, and the reproduction control display in which the respective contents are synchronized is realized as shown in FIG. Is done.

  In FIG. 15, the process progress and result display by the main body control device data are displayed in the display area (lower right child screen) designated by the header 242 of the management information described above. 15A to 15H respectively show the display on the display unit 18 and the sound output from the generation unit 28 when the control data samples 141 to 144 (that is, the samples 1 to 4 in FIG. 11) are executed. Is schematically shown. As described above, the state shown in FIG. 15 is realized when the recording / reproducing apparatus is in the tutorial mode.

  Specifically, FIG. 15A shows the start of shooting (video data sample 1, audio data samples 1 and 2 and control data sample 1), and FIG. 15B shows the video display of the pan operation instruction of the camera (video data sample). 2 and audio data samples 3 and 4), FIG. 15C shows the video display of the tilt operation instruction of the camera (video data sample 3 and audio data samples 5 and 6), and FIG. 4 audio data samples 7 and 8 and control data sample 2), FIG. 15E starts reproduction (video data sample 5, audio data samples 9, 10 and control data sample 3), and FIG. Confirmation of whether or not a reproduced image is displayed Display of video (video data sample 6 and audio data samples 11 and 12), FIG. Confirmation of whether or not a shadow reproduction image is displayed Video display (video data sample 7 and audio data samples 13 and 14), FIG. 15D ends reproduction (video data sample 8, audio data samples 15, 16 and A display screen called control data sample 2) is executed.

  As described above, also in the present embodiment, while the video (video data) and audio (audio data) explaining the operation of the main body are reproduced and displayed, the described operation is actually performed on the apparatus main body, and the situation By displaying the result and the result on the sub-screen, the user can understand the operation explained by the video and the sound while experiencing the actual operation.

Here, description is added regarding the sample transition of the main device control data as an operation characteristic of the present embodiment.
In FIG. 15, the control samples are transitioned from the control sample 1 to the control sample 2 from FIGS. 15 (a) to 15 (b), the control sample 2 to the control sample 3 from FIGS. 15 (d) to 15 (e), Control sample 3 to control sample 4 correspond to FIGS. 15E to 15F, and the end of control sample 4 corresponds to FIG. 15H.

  In the present embodiment, regarding such a transition of a specific control sample, it is assumed that when a user operation is requested and an event is input by the user operation, the transition to the next control sample is made for the first time.

  Specifically, in the case of shooting start (FIG. 15A), the next control data sample is not displayed until the shooting start event such as the user pressing a shooting start trigger button included in the operation unit 70 is input. Transition to (Sample 2). During this time, if there is no event input by the user, the control sample does not transition, and enters a process of waiting for the user's event input on the spot.

  Here, regarding the processing of other content information (video, audio), as shown in FIG. 11, each content is divided into 1 to 4 in a specific control sample that requires event input for such transition. Since it is grouped, it is possible to stop the playback process corresponding to the control sample by preventing other content information from transitioning to the next divided group in synchronization with the control sample not transitioning. Become. Specifically, it is possible to pause the reproduction process (pause state) and wait for an event input for another content.

  Similarly, with respect to sample transition of shooting end, playback start, and playback end, it is possible to wait for event input because other content data is also grouped according to control samples that require event input.

  FIG. 10 is a flowchart showing the operation of the part related to device control data processing in the tutorial content data playback processing in the recording / playback apparatus of the present embodiment. FIG. 10 (a) shows the overall flow, and FIG. Shows details of the command execution processing in the device control data sample. Note that steps denoted by the same reference numerals as those in FIG. 1 are basically the same steps as the corresponding steps in FIG.

  Note that the management information acquired by the management information analysis unit 34 in S110 of FIG. 10A is overall management information. After setting the display area of the child screen in S130, the management information analysis unit 34 acquires the first division management information based on the division reference 202 described in the overall management information (S135). Then, from the time information included in the division management information, a time schedule for processing each content data sample managed by the division management information is generated and notified to the control unit 30 (S140). In S150, the command included in the device control data sample is executed while reproducing the video and audio data sample. When the execution of all control data samples managed by the division management information is completed, the presence / absence of unprocessed division management information is confirmed (S155), and if it remains, the process returns to S135 and the same processing is repeated. When the process is completed for all pieces of division management information, the entire process is terminated.

  FIG. 10B is a flowchart for explaining processing corresponding to the control command execution step (S150) in FIG. As is clear from the comparison with FIG. 1B, after the main body control is performed, the next command reception (that is, the transition to the next control sample) is performed after waiting for an appropriate event input by the user. . In addition, the processes of S142 to S146 are as described in the first embodiment. In the present embodiment, the time measured using the counter is the processing time (Tc1 or Tc2) of the control data sample.

After the command execution process in S146, the event input by the user is waited. If the input event matches the requested event, the process returns to S143 to shift to the next sample, and does not match or there is no event input. In case you wait. Here, it is possible to grasp what kind of event the command described in the control data sample requests from the user is by analyzing the command name or the like. For example, in the case of sample 1, since the Rec Start command, which is a shooting start command, is included, it can be seen that an input of a shooting start event is required. Accordingly, in S147, it may be determined whether or not a shooting start event has been input by pressing a shooting start trigger button or the like. Similarly, it can be seen that in sample 2 a shooting stop event is requested from the Rec Stop command, in sample 3 a playback start event is requested from the Play Start command, and in sample 4 a playback stop event is requested from the Play Stop command.
In this way, the operation command in the control data sample is executed in units of division management information, and the process proceeds to the next division management information on condition that an appropriate event is input.

  As described above, according to the present embodiment, processing synchronization relationships are grouped in a specific playback control description that requests event input, and time information describing the grouped synchronization relationships is managed as division management information. Therefore, it is possible to easily realize the stop / restart processing of the synchronization relationship grouped according to the presence / absence of an event input.

  As a result, only when the operation command of the main unit and the user event match, it is possible to shift to the processing to the next device control data. Transition to video data is possible. The user can feel a realistic operation method by his / her event input action, and can improve the acquisition efficiency of the user's operation method.

  In the present embodiment, the description of the operation regarding the presence / absence of an event has not been specified. However, as in the present embodiment, a description is partially managed that pauses when there is no event and resumes playback when there is an event. You may describe in the header information of the track which manages the control data of information. By explicitly describing this description, operation compatibility between devices can be guaranteed.

  In this embodiment, when an expected event is input, the transition is made to the next sample, but the transition method of the control sample can be changed depending on the type of event input by the user.

  In this case, the header information 342, 442, 542, 642 of the track information 341, 441, 541, 641 for managing the device control data of the partial management information in FIG. Describe it.

  Specifically, device control data is managed when a playback control is described in which a shooting start process is performed when the user presses a shooting input in division 1 and a playback process is performed when a playback input is pressed. If “shooting event = division 2, reproduction event = division 3” is described in the track information header 342 of the partial management information, the process transition destination can be specified by the identification information of the division management information, and this is easy. Operation switching can be handled.

  In this way, by dividing and managing synchronization-related time information with specific control samples that require event input, processing can be easily switched by event input, and the time schedule is reconfigured in units of specific control samples. Therefore, sequential execution of control commands can be realized.

  As a result, the tutorial video that could only explain the same contents in the same order can be made into a tutorial video having contents suitable for the user level and the user's preference. For example, an advanced function can be explained only to a user who wants to know it, or the order of explanation can be changed according to the user's preference.

  In the present embodiment, playback of video, audio, and control commands corresponding to the management information shown in FIG. 12 or FIG. 13 is started from the beginning. For example, when the user gives a tutorial instruction, the control unit 30 reproduces the division management information of FIG. 13 by the reproduction unit 42 based on the whole management information of FIG. 12, and the management information analysis unit 34 shows the contents of the control events of each division management information of FIG. (Reproduction start, end, etc.) is detected and sent to the control unit 30. The control unit 30 controls the composition processing unit 17 so as to create an icon or a headline representing the content for each control event and display the icon or heading on the display unit 18. Thereby, the user can confirm that the tutorial is prepared for each control event of FIG.

  Then, by selecting the control event that the user wants to confirm from among these control events, the management information analysis unit 34 confirms the contents of the division management information corresponding to the selected control event, and controls the video, audio data, and control A time schedule of commands is generated, and the control unit 30 controls the playback unit 42 according to the time schedule, whereby a tutorial regarding the selected control event can be realized.

6 is a flowchart for explaining the operation of the recording / reproducing apparatus according to the first embodiment of the present invention. It is a block diagram which shows the structural example of the recording / reproducing apparatus which concerns on embodiment of this invention. It is a figure which shows the structural example of the tutorial content data which the recording / reproducing apparatus which concerns on 1st Embodiment processes. It is a figure which shows the example of the management information of the tutorial content data which the recording / reproducing apparatus concerning 1st Embodiment processes. It is a figure which shows the example of a description of the apparatus control data sample in 1st Embodiment. It is a figure explaining the tutorial content reproduction | regeneration state in the recording / reproducing apparatus which concerns on 1st Embodiment. It is a figure which shows the structural example of the general content data which the recording / reproducing apparatus concerning 1st Embodiment processes. It is a figure which shows the example of the management information of the general content data which the recording / reproducing apparatus concerning 1st Embodiment processes. It is a figure explaining the reproduction | regeneration state of the general content in the recording / reproducing apparatus which concerns on 1st Embodiment. It is a flowchart explaining operation | movement of the recording / reproducing apparatus which concerns on the 2nd Embodiment of this invention. It is a figure which shows the structural example of the tutorial content data which the recording / reproducing apparatus which concerns on 2nd Embodiment processes. It is a figure which shows the example of the whole management information of the tutorial content data which the recording / reproducing apparatus concerning 2nd Embodiment processes. It is a figure which shows the example of the division | segmentation management information of the tutorial content data which the recording / reproducing apparatus concerning 2nd Embodiment processes. It is a figure which shows the example of a description of the apparatus control data sample in 2nd Embodiment. It is a figure explaining the tutorial content reproduction | regeneration state in the recording / reproducing apparatus which concerns on 2nd Embodiment.

Explanation of symbols

31 Metadata packet unit 32 Management information generation unit 33 Metadata extraction unit 34 Management information analysis units 141 to 148 Control data sample 242 Screen display management data 245 Device control management data 249 Sample and time management data

Claims (8)

A recording / reproducing apparatus for recording at least image data on a recording medium and reproducing from the recording medium,
The image data for explaining a predetermined operation before type recording and reproducing apparatus, the control data for instructing the execution of the operation corresponding to the predetermined operation to the recording and reproducing apparatus, and a display timing of the image according to the image data Reproducing means for reproducing from the recording medium management information indicating a time relationship with the execution timing of the operation according to the control data;
Based on the management information, while displaying the image according to the image data to the display device, and a control means for the pre-Symbol action specified in the control data corresponding to the image data being displayed causes the recording and reproducing apparatus A recording / reproducing apparatus comprising: The recording / reproducing apparatus according to claim 1, further comprising an imaging unit configured to capture the image data, wherein the control data instructs an operation corresponding to an operation related to the imaging unit . 3. The recording / reproducing apparatus according to claim 1 , wherein the control means further displays an image obtained by the recording / reproducing apparatus as a result of executing an operation instructed by the control data on the display apparatus. . 4. The recording apparatus according to claim 1 , further comprising a recording unit that records image data on the recording medium , wherein the control data instructs an operation according to an operation related to the recording unit. The recording / reproducing apparatus as described. The image data and the control data is managed by being divided into a plurality of groups, together with the control means for processing said control data and the image data of the previous Kigu loop units, the I Louis vent input to the user 5. The recording / reproducing apparatus according to claim 1, wherein processing of the image data and the control data of another group is started as a condition.   6. The recording / reproducing apparatus according to claim 5, wherein the control unit selects the group to be processed next in accordance with the type of event input by the user. The recording medium the voice data is further recorded corresponding to the pre-Symbol image data to the display timing of the image and the management information is related to the image data, corresponding to the output timing and the control data of a voice according to the voice data The time relationship between the execution timings of the operations is shown , and the control means further outputs a sound related to the sound data while displaying an image related to the image data on the display device, and further to the image data being displayed. recording and reproducing apparatus according to operation in accordance with said corresponding control data to any one of claims 1 to 6, characterized in that to perform the recording and reproducing apparatus. The image data and the management data are divided into a plurality of groups corresponding to a plurality of different control items, and the control means is designated for the display of the image data and the control data independently for each group. 2. The recording / reproducing apparatus according to claim 1, wherein the recording / reproducing apparatus performs the operation described above.

Images