CN103888662A

CN103888662A - Recording apparatus and recording method

Info

Publication number: CN103888662A
Application number: CN201310706201.9A
Authority: CN
Inventors: 村上尚之
Original assignee: Canon Inc
Current assignee: Canon Inc
Priority date: 2012-12-19
Filing date: 2013-12-19
Publication date: 2014-06-25
Anticipated expiration: 2033-12-19
Also published as: US20140169753A1; US9025931B2; JP2014121049A; CN103888662B; JP6066712B2

Abstract

The invention provides a recording apparatus and a recording method. A recording apparatus codes moving image data on a unit basis of a moving image sample corresponding to a first period, codes the audio data on a unit basis of an audio sample corresponding to a second period, stores the coded moving image data and audio data in a moving image file and records the moving image data and the audio data in a recording medium, determines based on a recording start position of the obtained moving image data, a recording start position of the obtained audio data to be a position preceding the recording start position of the obtained moving image data by at least the audio sample corresponding to the second period, and determines a reproduction start position of the recorded audio data to be a position following a head of the recorded audio data by the unit of the audio data.

Description

Recording equipment and recording method

Technical field

The present invention relates to a kind of recording equipment, and more particularly, relate to and a kind of moving image and sound are encoded and recorded the moving image of having encoded and the recording equipment of sound.

Background technology

Up to now, known a kind of recording equipment that records motion image signal and audio signal on recording medium.Such recording equipment is managed recorded moving image and sound according to predetermined file system as file.Known MP4 file format for example, as the file format for recording moving image and sound (, being shown in TOHKEMY 2008-283232).

The unit interval that the moving image harmony cent recording with MP4 file format is not encoded differs from one another.Therefore, in the end portion of a scene, for moment of the moving image of sampling seldom with for the moment of the sound of sampling consistent.In most of the cases, the sampled point of the sampled point of the end of moving image and the end of sound is different.

Therefore, in the case of carrying out for being undertaken in conjunction with to create the editing and processing of new MP4 file being stored in the moving image of two MP4 files and sound, under the inconsistent state of sampled point in conjunction with moving image and sound.

MP4 file format is not designed to the time period that halfway setting is not reproduced in data mode, therefore from file beginning, reproduces continuously whole bar data.Therefore, under the sampled point of boundary moving image and the inconsistent situation of the sampled point of sound of scene, after the border of combination the now again of moving image and the now again of sound inconsistent, this is undesired.

Summary of the invention

Consider the problems referred to above, an aspect of of the present present invention is to prevent in the case of the file that stores motion image data after coding and voice data is combined with other motion image data and other voice data due to the inconsistent factitious reproduction causing between now again at moving image and sound.

According to one embodiment of present invention, provide a kind of recording equipment, comprising: moving image obtains unit, for obtaining motion image data; Audio frequency obtains unit, for obtaining voice data; Coding unit, for according to the coding units of the moving image sample as corresponding with very first time section, obtained motion image data being encoded, and according to the coding units of the audio sample as corresponding with the second time period, obtained voice data is encoded; Record cell, for motion image data and voice data after coded described coding unit are stored in to motion pictures files, and by this motion image data and this audio data recording in recording medium; And control unit, for the record start position of the motion image data based on obtained, determine the record start position of the voice data obtaining, wherein, the definite record start position with respect to obtained motion image data of described control unit shifts to an earlier date at least position of the audio sample corresponding with described the second time period, as the record start position of obtained voice data, and the reproduction start position of recorded voice data is defined as falling behind with respect to the beginning of recorded voice data the position of the coding units of described voice data.

According to one embodiment of present invention, a kind of recording method is provided, obtain the voice data that unit obtains and be recorded in recording medium as motion pictures files for moving image being obtained to motion image data that unit obtains and audio frequency by record cell, described recording method comprises: coding step, for obtained motion image data being encoded according to the coding units of the moving image sample as corresponding with very first time section, and according to the coding units of the audio sample as corresponding with the second time period, obtained voice data is encoded, recording step, for by described record cell, motion image data and voice data after described coding step coding being stored in described motion pictures files, and by this motion image data and this audio data recording in described recording medium, and control step, for the record start position of the motion image data based on obtained, determine the record start position of the voice data obtaining, wherein, described control step comprises: determine with respect to the record start position of obtained motion image data and shift to an earlier date at least position of the audio sample corresponding with described the second time period, as the record start position of obtained voice data, and the reproduction start position of recorded voice data is defined as falling behind with respect to the beginning of recorded voice data to the position of the coding units of described voice data.

Can prevent in the case of the file that stores motion image data after coding and voice data is combined with other motion image data and other voice data due to the inconsistent factitious reproduction causing between now again at moving image and sound.

By the explanation to exemplary embodiments below with reference to accompanying drawing, it is obvious that further feature of the present invention will become.

Brief description of the drawings

The accompanying drawing that is included in specification and form a part for specification illustrates exemplary embodiments of the present invention, feature and aspect, and is used for explaining principle of the present invention together with specification.

Fig. 1 illustrates the block diagram of the example structure of recording equipment according to an embodiment of the invention.

Fig. 2 A and 2B are the figure that the structure of motion pictures files is shown.

Fig. 3 is the figure that is illustrated in the correlation between management information, motion image data and voice data.

Fig. 4 is the figure that the motion image data of combination and the structure of voice data are shown.

Fig. 5 A, 5B and 5C are the figure that the management information on the motion pictures files shown in Fig. 4 is shown separately.

Fig. 6 is illustrated in the motion image data of combination and the figure of the time difference between the recovery time of voice data.

Fig. 7 illustrates the flow chart of the operation of recording equipment in logging mode according to an embodiment of the invention.

Fig. 8 A and 8B are the figure that the structure of the motion pictures files of the motion image data of being combined with recorded motion pictures files according to an embodiment of the invention and voice data is shown.

Fig. 9 is illustrated according to an embodiment of the invention at the motion image data of combination and the figure of the time difference between the recovery time of voice data.

Figure 10 is the flow chart illustrating according to an embodiment of the invention in conjunction with the operation of motion image data and voice data.

Figure 11 is the figure that the additional structure that writes motion image data in motion pictures files and voice data is shown.

Figure 12 is the figure illustrating about the management information of the motion pictures files shown in Figure 11.

Figure 13 is the figure that the recovery time of the motion image data that additionally writes in motion pictures files and voice data is shown.

Figure 14 illustrates the flow chart of the operation in logging mode at the same time of recording equipment according to an embodiment of the invention.

Figure 15 illustrates according to an embodiment of the invention the figure that determines the operation of the beginning position of voice data in logging mode at the same time.

Figure 16 is the figure that the structure of the motion image data that records in logging mode at the same time and voice data is shown according to an embodiment of the invention.

Figure 17 A, 17B, 17C, 17D, 17E and 17F are the figure that is illustrated in the combination pattern in part deletion action according to an embodiment of the invention.

Figure 18 illustrates the flow chart of the part deletion action of recording equipment according to an embodiment of the invention.

Figure 19 illustrates the flow chart of the operation of recording equipment in additional write mode according to an embodiment of the invention.

Embodiment

Describe various exemplary embodiments of the present invention, feature and aspect in detail below with reference to figure.

Fig. 1 illustrates the block diagram of the example structure of recording equipment 100 according to an embodiment of the invention.Although being a present invention, the present embodiment is applied to the example such as the picture pick-up device of video camera etc., there is camera and microphone or be attached thereto the personal computer (PC) connecing but the present embodiment can be applied to, or be applied to portable unit of all like smart mobile phones etc. can taking moving image equipment.

With reference to figure 1, image unit 101 obtains unit as moving image, comprises known imaging apparatus and AD converter.Image unit 101 is taken image and the output movement view data of subject.Audio frequency obtains unit 102 and comprises microphone and AD converter.Audio frequency obtains unit 102 and obtains the sound around subject, and outputting audio data.

Memory 103 storing moving image data and voice datas.Each block access memory 103 of recording equipment 100 is with processing moving data and voice data.Except motion image data and voice data, memory 103 is also stored the various information such as information and management information etc. about file system.Memory 103 is also used the working storage of the control operation that acts on control unit 106 etc.As described below logging mode is set simultaneously in the situation that, recording in holding state the motion image data of the scheduled time and voice data repeated storage in memory 103.

Display unit 104 shows the moving image that image unit 101 obtains in screening-mode, and in reproduction mode, shows reproduced moving image.Display unit 104 also shows the various information such as menu screen etc.

In the time recording moving image, the voice data that signal processing unit 105 obtains to the motion image data being obtained by image unit 101 with by audio frequency acquisition unit 102 according to known coded format is encoded with the amount of information of packed data.In addition, signal processing unit 105 is implemented as and records motion image data and the required processing of voice data.According to this embodiment, according to advanced video coding (AVC) H.264/, motion image data is encoded, and according to Advanced Audio Coding (AAC), voice data is encoded.Signal processing unit 105 is decoded with the amount of information of expanding data to reproduced motion image data and voice data in reproduction mode.

In the time recording rest image, signal processing unit 105 is also encoded to the frame Still image data being obtained by image unit 101 according to the known coded system of such as JPEG etc.In the time reproducing rest image, signal processing unit 105 is decoded to reproduced Still image data.

Control unit 106 is according to the overall operation of controlling recording equipment 100 from the input of operating unit 107.Control unit 106 comprises microcomputer (CPU) and memory, and controls recording equipment 100 according to the computer program (software) being stored in nonvolatile memory (not shown).Control unit 106 comprises recording medium interface, for and record-playback unit 108 between communication data and order.Operating unit 107 comprises the various switches that can be operated by user.Operating unit 107 receives the various instructions that user provides etc., and the notice such as will indicate to control unit 106.Operating unit 107 comprises mains switch, for providing for the switch of the instruction of start and stop record and for changing the switch of pattern of recording equipment 100.

Record-playback unit 108 is by motion image data and voice data or various information writing recording medium 109 or read motion image data and voice data or various information from recording medium 109.In logging mode, record-playback unit 108 is by the motion image data and voice data writing recording medium 109 that are stored in memory 103.In reproduction mode, record-playback unit 108 reads motion image data and voice data from recording medium 109, and motion image data and voice data are stored in memory 103.According to the present embodiment, recording medium 109 is the arbitrary access recording mediums such as hard disk (HDD) or flash memory card etc.

Record-playback unit 108 is according to the file system of such as file allocation table (FAT) etc., manages as file being recorded in motion image data in recording medium 109 and voice data or various information.Record-playback unit 108 comprise such as the known interface (IF) of AT Attachment (ATA) etc. with and control unit 106 in recording medium IF between communication data and various command.Although recording medium 109 is configured to easily can install or dismantle recording equipment 100 by installation and removal mechanism's (not shown), recording medium 109 can be configured to be built in recording equipment 100.

In the time reading by the motion pictures files writing recording medium 109 that comprises motion image data and voice data or from recording medium 109 motion pictures files that comprises motion image data and voice data, control unit 106 is controlled record-playback unit 108 and is reproduced file system data (management data) and file system data is stored in memory 103 from recording medium 109.File system data for example represents to be recorded in the filename of the data on recording medium 109, the size that is recorded in the file on recording medium 109, recorded address and is the information for management document.Control unit 106 writes and reads according to read file system data control documents.Control unit 106 is according to the file system data updating stored in memory 103 that writes of file in recording medium 109.Control unit 106 makes record-playback unit 108 that upgraded file system data is recorded in recording medium 109.

Usage data bus 110 transmits and receive data and various control commands between the unit of recording equipment 100.

According to the present embodiment, with MP4 file format by motion image data and audio data recording on recording medium 109.Fig. 2 A illustrates the basic structure of MP4 file.MP4 file 200 is made up of the storage cell that is known as box (box).The uppermost box that forms single MP4 file comprises ftyp box201, moovbox202 and mdat box203.The management information of ftyp box201 storage file compatibility information and moov box202 storing moving image data and voice data.The motion image data that mdat box203 storage has been encoded and the real data of voice data.

Fig. 2 B is the figure that the example structure of moov box202 is shown.Trak box defines single motion image data and single sound audio data.In Fig. 2 B, store 2 trak that define respectively motion image data and voice data.In each trak, will be stored in edts about the information that starts the moment of reproducing from track.Judge that by being used for track comprises video (moving image) or the information of audio frequency is stored in stsd.By the duration of a sample about video or voice data, the information of (reproducing the duration) is stored in stts.The information that represents size in each block (chunk) is stored in stsz.To be stored in stco with respect to the skew (size of data) of file beginning about each block.In MP4 file format, be stored in the motion image data in mdat and voice data is each is freely known as the unit management of " block ".Such moov data have been specified the position of each data in storage mdat hereof.

Fig. 3 is illustrated in to be stored in stsz in moov and the represented information of stco and is stored in the correlation between the skew of the data in mdat.Track 1 in moov box301 and track 2 are respectively for the track of video data with for the track of voice data.Each track comprises 3 blocks.Stsz represents quantity and the size of the sample that the video data stored in mdat box302 and voice data comprise.Stco represents the skew 303 of each video block and each audio frequency block.

Then, be described according to the record operation in the normal recordings pattern of the present embodiment.Recording equipment 100 can record motion image data and Still image data in normal recordings pattern.As described below, there is simultaneously logging mode according to the recording equipment 100 of the present embodiment, for recording rest image and so that at least the scheduled time is recorded motion image data and voice data; And additional write mode, for except normal recordings pattern, also motion image data and voice data are additionally written in recorded motion pictures files.Recording equipment 100 also has reproduction mode, the motion pictures files recording for being reproduced in those logging modes.In reproduction mode, can provide motion pictures files is carried out to the instruction of combination and the instruction that part is deleted the motion pictures files recording in logging mode at the same time.

In the case of receiving the instruction for normal recordings pattern from operating unit 107, control unit 106 arrange recording equipment 100 for record holding state and etc. to be instructed to start record.Recording in holding state, control unit 106 shows the moving image being associated with the motion image data of inputting from image unit 101 on display unit 104.In the case of the instruction that starts to record from operating unit 107 inputs, control unit 106 index signal processing units 105 start coding.Signal processing unit 105 is read the motion image data being obtained by image unit 101 and obtains by audio frequency the voice data that unit 102 obtains from memory 103, and starts motion image data and voice data to encode.Signal processing unit 105 is stored in coded data in memory 103.

Coded data is read from memory 103 in record-playback unit 108, and coded data is recorded in recording medium 109.In situation about not opening file at this moment, record-playback unit 108 the has created new record file of coded data, open file and coded data is recorded in wherein as motion pictures files.

Receive the instruction that stops record from operating unit 107 after recording moving image in the case of starting in this manner, control unit 106 makes signal processing unit 105 stop motion image data and voice data to encode, and makes record-playback unit 108 close the just file at record data.Control unit 106 is also indicated record-playback unit 108 to change the content of file system data and file system data is recorded in recording medium 109.

According to the present embodiment, in normal recordings pattern, the motion image data and the voice data that in the time period between the instruction that starts the instruction of record and stop recording, record are stored in the single motion pictures files of MP4 file format.

Next, the record to rest image is described.In the situation that being set to normal recordings pattern, as mentioned above, control unit 106 is set to record holding state by recording equipment 100.In this state, start to record the instruction of rest image from operating unit 107 outputs, in response to the instruction of rest image record, instruction image unit 101 is taken a frame rest image to control unit 106.In response to the instruction from control unit 106, image unit 101 is taken a frame rest image, and exports Still image data to memory 103.In response to the instruction from control unit 106, signal processing unit 105 is read Still image data, Still image data is encoded and sent data to record-playback unit 108 from memory 103.Record-playback unit 108 is recorded in the Still image data of sending from signal processing unit 105 recording medium 109.

Then, describe, according to the recording equipment 100 of the present embodiment, motion pictures files is carried out to the operation of combination.Recording equipment 100 has two functions that motion pictures files carries out combination selecting from be recorded in the multiple motion pictures files recording medium 109.In binding operation, by the combination in encoding state of the motion image data of storing in two motion pictures files by user-selected and voice data.Then, newly-generatedly store the motion image data of combination and the motion pictures files of voice data, and be recorded in recording medium 109.

Fig. 4 illustrates by the motion image data in two motion pictures files and voice data are carried out in conjunction with newly-generated motion pictures files.With reference to figure 4, the motion image data V2 in the motion image data V1 in original motion image file 401 and voice data A1 and motion pictures files 402 and voice data A2 are carried out to combination to generate new motion pictures files 403.Calculate the skew O1 to O4 of the block of the beginning of motion image data and voice data in motion pictures files 403, and be stored in moov.Fig. 5 A be illustrated in conjunction with after motion pictures files 403 in motion image data and the offset information of voice data.

Fig. 6 is illustrated in two motion pictures files to carry out in the situation of combination the figure for the now again of motion image data and voice data.With reference to figure 6, the motion image data V1 in each motion pictures files and motion image data V2 are represented by " 601 " and " 603 " respectively, and voice data A1 and voice data A2 in each motion pictures files represented by " 602 " and " 604 " respectively.In Fig. 6, the time is set to horizontal direction through direction, and time difference when the difference between difference is with reproduction in data is corresponding.

In addition v1 to vn and v1 to vn, ' represents respectively the coding units of each motion image data.According to the present embodiment, in logging mode, according to the coding units of the moving image sample as in a frame motion image data, motion image data is encoded at the same time, by intraframe coding, each frame is encoded thus.The frame frequency of motion image data (quantity of the frame of time per unit, the unit interval is one second in this example) is being set in the situation of 29.97 frame/seconds, and coding units is corresponding with 33.3 milliseconds.

In addition a1 to am and a1 to am, ' represents the coding units of each voice data separately.According to the present embodiment, the voice data of 1024 audio sample is encoded as coding units.Be set to 48kHz in the sample frequency of voice data, the coding units of single sound audio data is corresponding with 21.3 milliseconds.Below a coding units of voice data is called to " Audio Access Unit (AAU) ".

According to recording audio data writing time for motion image data.But, due to as mentioned above, for the length of coding units of motion image data and the length of the coding units for voice data need not, be therefore difficult to become writing time with motion image data the writing time of voice data identical.Therefore, for example carry out in this way the quantity of the coding units of determining the voice data that once will record: the recovery time of voice data is no more than the recovery time of motion image data.

According to the present embodiment, a coding units of coding units of motion image data and voice data is set to respectively to a block of sound in block of moving image in motion pictures files and motion pictures files.

Due to as mentioned above, the time span corresponding with the coding units of motion image data and differing from one another with the corresponding time span of the coding units of voice data, therefore between the end portion moving image of each scene and the end portion of sound, life period is poor.In addition, the time difference of part changes according to the length of the moving image that will record and sound endways, therefore changes along with motion pictures files is different.For example, be g1 in the time difference of the end portion of motion image data 601 and voice data 602, and be g2 in the time difference of the end portion of motion image data 603 and voice data 604.

In the case of by the motion image data V2 in the motion image data V1 and voice data A1 and other motion pictures files that have in one of two motion pictures files of such time difference and the continuous combination of voice data A2, therefore, in conjunction with after motion pictures files data become motion image data 604, and in conjunction with after voice data become voice data 605.

In order to reproduce the motion pictures files of combination of such MP4 file format, start reproducing motion pictures data 604 and voice data 605 continuously from each beginning.Therefore, the coding units a1 of the beginning of voice data A2 than the Zao g1 of beginning frame v1 of motion image data V2 reproduce.This has caused factitious reproduction, makes to hear sound before people's mouth moves.In addition, the reproduction of the last voice data am ' in voice data A2 finishes than the Zao g1+g2 of last motion image data vn ' in motion image data V2.

Therefore, according to the present embodiment, record in such a way original motion view data: before recording voice is engraved in the recording start moment of moving image when making the recording start of sound, to prevent in the situation that motion pictures files is carried out to combination that in the position of combination part place sound subsequently reproduces before moving image.

Fig. 7 is the flow chart that the operation in logging mode according to the recording equipment 100 of the present embodiment is shown.Operation shown in Fig. 7 is controlled the unit of recording equipment 100 by control unit 106 and is carried out.As mentioned above, recording equipment 100 is being switched on power to enter record holding state in the situation that, the processing in Fig. 7 starts.

Control unit 106 starts to store the voice data that obtains unit 102 from audio frequency in memory 103 (S701).Now, control unit 106 is stored in memory 103 with the form of voice data obtain the uncoded voice data of exporting unit 102 from audio frequency.

In the mode according to make wherein to store the voice data of the scheduled time at least by voice data Coutinuous store in memory 103 in the situation that, the oldest data deleted (covering).Particularly, control unit 106 is stored in the voice data of the time period long time period (sample size) than corresponding with AAU in memory 103.

The in the situation that of in by this way voice data being repeatedly stored in to memory 103, control unit 106 is waited for the instruction (S702) that starts record from operating unit 107.The in the situation that of the instruction of output recording start, control unit 106 is determined the record beginning position (S703) that is stored in the voice data in memory 103.Particularly, the location positioning that the time point with respect to the instruction of output recording start that is stored in the voice data in memory 103 is shifted to an earlier date 1024 samples by control unit 106 is beginning position.Then, control unit 106 index signal processing units 105 start motion image data to encode and the voice data that starts being stored in memory 103 from determined beginning position is encoded.Signal processing unit 105 starts motion image data to sending from image unit 101 and encodes and from determined coding starting position, start voice data encode (S704).Then, record-playback unit 108 is by the motion image data of having encoded and audio data recording on recording medium 109 (S705).

In the case of having exported after starting such record the instruction that stops record (S706), control unit 106 stops motion image data and voice data be stored in memory 103 (S707) and stop coding (S708).Because the coding units of sound is different with the coding units of moving image, therefore control unit 106 stops coding in the case of not making the recovery time of sound exceed index signal processing unit 105 recovery time of moving image.Then, control unit 106 indicates record-playback unit 108 to stop record, and therefore record-playback unit 108 stops recording motion image data and voice data (S709).In addition, control unit 106 generates moov, and makes record-playback unit 108 that moov is recorded in to (S710) in recording medium 109.

Now, control unit 106 is stored the offset information of second AAU instead of beginning AAU (being known as below " additional sound ") as the offset information of the beginning block of voice data.Control unit 106 is also stored in the information of the position of the skew of the file beginning of the sound about with respect to additional in the moov of motion pictures files as additional information.

The skew (record start position) of the beginning block using the deviation post of second AAU as audio track carrys out record in this manner, thereby prevent from reproducing the additional sound of corresponding sound in the situation that of reproducing motion pictures files, based on coding units, the now again of motion pictures files is consistent with the now again of sound thus.

Fig. 8 A illustrates motion image data and the voice data of record by this way.With reference to figure 8A, once motion image data V1 and the voice data A1 of record are represented by " 801 " and " 802 " respectively.Be recorded in the moment 803 additional sound 804 of the scheduled time before that output starts the instruction of record.

In motion pictures files 805, the skew O2 of the beginning block of the skew O1 of the beginning block of motion image data and voice data is stored in moov.The skew O21 of additional sound is also stored in moov.The in the situation that of reproducing motion pictures files 805, reproducing audio data from the data of O2, wherein O2 is the deviation post of beginning block.Fig. 5 B illustrates the offset information of the beginning block of motion image data and voice data in motion pictures files 805.

Then, describe the operation of different motion pictures files combinations, wherein motion pictures files has the additional sound of record by this way.Can in reproduction mode, provide instruction so that motion pictures files is carried out to combination by user's operating operation unit 107 according to the recording equipment 100 of the present embodiment.

Fig. 9 be illustrated in to motion pictures files carry out in conjunction with time motion image data and voice data.With reference to figure 9, to 604 similar, the motion image data in two motion pictures files and voice data are respectively by 901 to 904 expressions to 601 in Fig. 6.Note, using beginning AAU a0 as additional SoundRec in voice data 902 and voice data 904.The recovery time of additional sound a0 is ta.In Fig. 9, the time is set to horizontal direction through direction, and time difference when the difference between difference is with reproduction in data is corresponding.

Then, moving image V2 and sound A2 are combined with moving image V1 and sound A1, to make to generate moving image 905 and sound 906.Now, by the deviation post of the beginning AAUa0 of sound A 2 being stored in the sound track after combination, the additional sound a0 of producing sound A2 after the last sound am of sound A 1.This makes to reproduce the sound a1 corresponding with the beginning moving image v1 of moving image V2 than the late ta-g1 of moving image v1, prevents thus producing sound before corresponding moving image.

As a result of, than the last sound am ' of last moving image vn ' the late ground producing sound A2 of moving image V2, therefore, for example, audio track in motion pictures files from combination is deleted the skew of sound am ', and set it as additional information be stored in conjunction with after the moov of motion pictures files in.Note, even be set in effective situation in the reproduction of additional sound, when before the reproduction end time of the sound reproduction end time at moving image, also the skew of last sound is not deleted from audio track.

Figure 10 is the flow chart illustrating according to the binding operation of the recording equipment 100 of the present embodiment.The operation of Figure 10 is controlled unit by control unit 106 and is carried out.

From be recorded in the multiple motion pictures files recording medium 109, select two motion pictures files in the case of user and provide two motion pictures files are carried out the instruction of combination, the processing in Figure 10 starts.User specifies the motion pictures files first reproducing than another in two motion pictures files.The motion pictures files first reproducing is called to " first half scene ", and the motion pictures files of rear reproduction is called to " later half scene ".

The offset information of control unit 106 based on being stored in the track of video in the moov of later half scene, each block skew (S1001) of calculating the motion image data of later half scene in the motion pictures files after combination.Subsequently, the additional information of control unit 106 based on being stored in the moov of later half scene, the skew (S1002) of calculating the adventitious sound sound data in the motion pictures files after combination.Control unit 106 is the offset information based on being stored in the audio track in the moov of later half scene also, calculates each block skew (S1003) of the voice data of the later half scene in the motion pictures files after combination.

Then, control unit 106 indicates record-playback unit 108 first half scene to be combined to (S1004) with later half scene.Particularly, record-playback unit 108 copies to the motion image data of the motion image data of first half scene and voice data and later half scene respectively in the posting field separating of recording medium 109 with voice data.

Then, control unit 106 generates the moov of the motion pictures files after combination, and it includes the offset information about track of video and audio track (S1005) calculating in the above described manner.Now, by conjunction with being front stored in offset information in the moov of first half scene directly as the offset information of first half scene.Then, control unit 106 makes record-playback unit 108 that the motion pictures files after the combination of generated moov and the motion image data that comprises institute's combination and voice data is recorded in to (S1006) in recording medium 109.

Fig. 8 B illustrates the motion pictures files of combination by this way.With reference to figure 8B, in conjunction with after motion pictures files represented by " 806 ", and the offset information of the beginning block of the moving image of first half scene and sound is represented by " O1 " and " O2 " respectively.The skew of the additional sound of first half scene is represented by " O21 ".In conjunction with after motion pictures files in the offset information of the moving image of later half scene and the beginning block of sound represented by " O3 " and " O4 " respectively.In motion pictures files after combination, the skew of the additional sound of later half scene is represented by " O41 ".

With reference to figure 9, in the mode that makes the additional sound that reproduces later half scene, the skew O41 of additional sound is stored in the audio track of the motion pictures files after combination as mentioned above.Fig. 5 C illustrates the offset information of the motion pictures files after combination.

According to the present embodiment, as mentioned above, in the time recording moving image and sound, than the Zao scheduled time recording voice of point of recording start instruction.Record-shifted to make not reproduce the mode of beginning voice data in normal recordings pattern, and two motion pictures files are carried out in conjunction with time, according to the time difference between moving image and the sound of the end portion of the motion pictures files that another motion pictures files is combined, reproduce additional sound.

Therefore, sound does not reproduce before the moving image after the part of combination, has therefore prevented factitious reproduction.Owing to not inserting noiseless data in the part of combination, therefore the reproduction period sound of the motion pictures files after part combination does not interrupt.

Then, logging mode is simultaneously described.Recording equipment 100 is configured to have logging mode simultaneously, it is in the case of providing the instruction of recording rest image, together with rest image, be recorded in n moving image second that records before the instruction of rest image and n second the sound corresponding with moving image.The motion image data recording in logging mode at the same time and voice data are additionally write and are recorded in single motion pictures files.Be assumed to, in logging mode, with intraframe predictive coding, each frame motion image data encoded to it is carried out to record at the same time.

Instructions in operating unit 107 output for logging mode simultaneously, control unit 106 is set to simultaneously logging mode by recording equipment 100 and in recording holding state.Recording in holding state in logging mode at the same time, control unit 106 as described below, by the motion image data of n second of exporting from image unit 101 and corresponding with n second and obtain by audio frequency the voice data that unit 102 obtains and be repeatedly stored in memory 103.Now, as described below, the motion image data of n second is encoded by signal processing unit 105 and is stored in memory 103.In addition, the voice data corresponding with the moving image of n second also encoded by signal processing unit 105 and is stored in memory 103.

In the situation that being set to simultaneously logging mode, control unit 106 is controlled record-playback unit 108 and from recording medium 109, is detected the motion pictures files recording in logging mode at the same time.The motion pictures files recording in logging mode is at the same time present in the situation in recording medium 109, and control unit 106 detects the information about the filename of this motion pictures files, and information is stored in memory 103.

Recording in holding state in logging mode exported for recording in the situation of instruction of rest image at the same time, and control unit 106 stops the motion image data of having encoded and voice data to be stored in memory 103.In addition, control unit 106 is taken the rest image of a picture in response to the instruction of rest image record, instruction, and identical with above-mentioned rest image logging mode, record-playback unit 108 is recorded in the Still image data of having encoded in recording medium 109.

Control unit 106 indicates record-playback unit 108 will the motion image data and the voice data that be stored in the n second in memory 103 be carried out to record.Now, the motion pictures files recording in logging mode is at the same time Already in the situation in recording medium 109, and control unit 106 is indicated and additionally write and record motion image data and the voice data of current record in this motion pictures files.On the other hand, the motion pictures files recording in logging mode at the same time is not present in the situation in recording medium 109, and control unit 106 instruction creates new motion pictures files, and by motion image data and audio data recording therein.In the time creating new motion pictures files, it is the additional information that logging mode records at the same time that control unit 106 adds for identifying this motion pictures files to the motion pictures files that will record.

Figure 11 is illustrated in motion image data and the voice data recording in while logging mode and the figure that stores the motion pictures files of each data.With reference to Figure 11, in each 1101,1102 and 1103 output rest image record instruction times, and each time interocclusal record adjacent moving image and sound V1 and A1, V2 and A2 and V3 and A3 before those times respectively.Those moving images and voice data are additionally write and are recorded in single motion pictures files 1104.In addition, the skew of the beginning block of each motion image data and voice data is stored in moov as shown in Figure 12.As shown in Figure 12, skew O1, the O3 of the beginning block of each motion image data and O5 are stored in the stco of track of video, and skew O2, the O4 of the beginning block of each voice data and O6 are stored in the stco of audio track.

Figure 13 is illustrated in motion image data in three scenes that record in logging mode simultaneously and the outward appearance of voice data.With reference to Figure 13, V1 to V3 represents separately from the motion image data of a scene lighting n second of recording start instruction, and A1 to A3 represents the voice data of a scene separately.In Figure 13, the time is set to horizontal direction through direction, and time difference when the difference between difference is with reproduction in data is corresponding.

In Figure 13, as shown in Figure 6, v1 to v15 represents the coding units of motion image data, and a1 to a23 (a24) represents the coding units of voice data.In Figure 13, for simplified characterization, it is the time period corresponding with 15 frames by the set of time of the motion image data that will record in single record simultaneously.Although according to recording audio data writing time of motion image data, but it is identical to be difficult to become writing time with motion image data the writing time of voice data, this be because as mentioned above, the length of coding units of motion image data is different with the length of the coding units of voice data.In addition, in logging mode, each motion image data and voice data are encoded to be repeatedly stored in memory 103 in turn at the same time.According to the present embodiment, therefore, take the instruction of rest image in the case of existing, as last frame, record the moving image of predetermined amount of time before an adjacent in the end frame, the i.e. moving image of 15 frames at the frame that will take the corresponding moving image of instruction with this rest image.In addition, to make the recovery time of the voice data mode after the last frame of motion image data of not following determine the last AAU of voice data.Then, the AAU that is included in the following sample in the voice data of storing in memory 103 is defined as to the beginning AAU that will record, this sample is corresponding with the beginning frame of the moving image of the predetermined amount of time that will record (15 frame).AAU is the voice data that once will record to the coding audio data of last AAU from the outset.In Figure 13, for example, a23 becomes last AAU to make to be no more than the recovery time of last frame V15.Then, comprise that the a1 of the sample corresponding with V1 becomes the beginning AAU of the voice data that will record.Record each voice data from a1 to a23.

As mentioned above, due to the time span corresponding from the coding units of motion image data and different, therefore poor in end portion life period between moving image and the end portion of sound of each scene with the corresponding time span of the coding units of voice data., in Figure 13, be for example g1 in the time difference of the end portion of moving image V1 and sound A1.At the same time in logging mode, by motion image data with voice data is additional writes and be recorded in single motion pictures files.Therefore, the moving image V2 of next scene and sound A2 are additionally write to moving image V1 and the sound A1 with such time difference.

In the time reproducing the motion pictures files of MP4 file format of Figure 13 of record in the above described manner, reproducing motion pictures data and voice data continuously from motion image data and voice data beginning separately.Therefore, be reproduced in the coding units a1 of the beginning of voice data A2 than Zao g1 before the beginning frame v1 of motion image data V2.

Therefore, according to the present embodiment, even at the same time in logging mode, also at the additional sound of beginning record of voice data.At the same time in logging mode, based in the case of start reproducing motion pictures data and voice data the time difference between moving image and the sound of part endways from the beginning of the motion pictures files that additionally writes other motion pictures files, control whether reproduce additional sound, prevent thus factitious reproduction.Particularly, exceed the recovery time of an AAU in the case of start reproducing motion pictures data and voice data the time difference between moving image and the sound of part endways from the beginning of the motion pictures files that additionally writes other motion pictures files, reproduce additional sound.Otherwise, do not reproduce additional sound.This now again that has prevented sound is significantly prior to now again of moving image.

In addition, the editing and processing that the motion image data recording in logging mode at the same time was partly deleted taking n second as unit, to make reproducing additional sound in the case of reproducing the motion pictures files after editor, prevents that the reproduction of sound is prior to the reproduction of corresponding moving image thus.

Figure 14 illustrates according to the recording equipment 100 of the present embodiment flow chart of the operation in logging mode at the same time.The unit that operation shown in Figure 14 is controlled recording equipment 100 by control unit 106 is carried out.As mentioned above, recording logging mode is set in holding state simultaneously in the situation that, the processing in Figure 14 starts.

Control unit 106 index signal processing units 105 start to obtain the voice data of unit 102 encode (S1401) to the motion image data from image unit 101 with from audio frequency.Signal processing unit 105 is sequentially read motion image data, motion image data is encoded and the motion image data of having encoded is stored in to (S1402) memory 103 again from memory 103.

By the motion image data of having encoded and voice data Coutinuous store in memory 103 to make wherein to store the n motion image data of second, delete (covering) the oldest data.Amount is stored in memory 103 than the voice data of the n large scheduled time of second.Particularly, by than current Zao n second, be stored in memory 103 prior to the voice data of 2 AAU of current voice data.

In the case of in the above described manner the motion image data of having encoded and voice data being repeatedly stored in to memory 103, control unit 106 waits for that instruction from operating unit 107 is to take rest image (S1403).In the situation that output rest image is taken instruction, control unit 106 generates a frame Still image data as mentioned above, and Still image data is recorded in to (S1404) in recording medium 109.

Then, control unit 106 stops motion image data and voice data to encode, and stops newly motion image data and the voice data of coding are stored in (S1405) in memory 103.Then, control unit 106 is determined beginning frame and the last frame that will record in the above described manner from be stored in the motion image data memory 103.Control unit 106 is also determined beginning AAU and the last AAU (S1406) of the voice data that will record in the above described manner.

Control unit 106 indicates record-playback unit 108 that the motion image data of having encoded and voice data are additionally write at the same time and be recorded in the motion pictures files in recording medium 109 in logging mode.Record-playback unit 108 will be stored in motion image data in memory 103 and voice data and additionally writes and be recorded in the motion pictures files of appointment (S1407).

Then, the motion pictures files recording in logging mode at the same time has been recorded in the situation in recording medium 109, and control unit 106 detects in the situation that starting from the outset to reproduce this motion pictures files, time difference (S1408) between moving image and the sound of the end portion of motion image data and voice data.The following acquisition time difference of part (reproduction end position) endways.

(time difference)=(the reproduction end position of track of video)-(the reproduction end position of audio track)

(the reproduction end position of track of video)=(the rabbit zero hour (edts))+(recovery time (stsc) of video sample) x (quantity (stsz) of video sample)

(the reproduction end position of audio track)=(the audio reproducing zero hour (edts))+(recovery time (stsc) of audio sample) x (quantity (stsz) of audio sample)

Obtain by this way in the situation that starting reproducing motion pictures files from the outset the time difference between moving image and sound.

In addition, according to the present embodiment, at every turn at the same time in logging mode when single record end, detect the time difference that record, between motion image data and beginning and end portion moving image and the sound separately of voice data in single record, and set it as additional information and be stored in moov.In single record, the moving image of record and sound are hereinafter referred to as " scene ".According to the present embodiment, by about being stored in the moov of each scene in beginning and the information of end portion time difference separately.Now, the time difference not by the time difference between the additional beginning of sound and the beginning of moving image but between next AAU and the beginning of moving image of additional sound is as the time difference record starting.

According to the present embodiment, the count value of the clock of preset frequency is carried out to record as the information that represents the time difference.For example, in mpeg encoded, the count value of the counter based on for the clock of determined frequency is counted, the output time of management decoding moment and decoded image and sound.Therefore, using the count value of the clock of the preset frequency for decoding as the information recording about the time difference.Note, as long as information table is shown in the time difference between moving image and sound, information can be also other form.

The motion pictures files recording in logging mode at the same time is not present in the situation in recording medium 109, and control unit 106 is considered as not life period and processes poorly.

Then, control unit 106 indicates record-playback unit 108 to upgrade the content (S1409) of the management information moov of the additional motion pictures files writing.Now, control unit 106 judges that whether the time difference between moving image and the sound of end portion of motion pictures files that additionally writes other motion pictures files is longer than the recovery time of an AAU.The time difference of part is equal to or less than in the situation of recovery time of an AAU endways, control unit 106 is not stored in the offset information of the beginning AAU of the voice data of wanted addition record in audio track, but the offset information of second AAU is stored on sound track.Then, control unit 106 is stored in as additional information the offset information that starts AAU (additional sound) in moov.

On the other hand, the time difference of part is greater than in the situation of recovery time of an AAU endways, and control unit 106 is stored in the offset information of the beginning AAU of the voice data of wanted addition record in sound track.In this manner, the information of the motion image data about new record and voice data is added into moov.In addition,, for current recorded scene, control unit 106 is stored in the information of the time difference about between beginning and end portion moving image and sound separately in moov as additional information.

Afterwards, in the situation that being still set to simultaneously logging mode, in S1409 the renewal of moov finish control unit 106 again return to S1401, and start motion image data and voice data to be stored in memory 103.

Figure 15 is illustrated in the motion image data that will record in logging mode simultaneously and the figure of voice data.In Figure 15, v1 to v15 represents the coding units of the motion image data for having encoded, and a0 to a23 represents the coding units of voice data.According to the present embodiment, as mentioned above, in logging mode, by intraframe predictive coding, each frame motion image data is encoded at the same time.Therefore, each coding units v1 to v15 is corresponding with a frame separately.In Figure 15, the time is set to horizontal direction through direction, and time difference when the difference between diverse location is with reproduction in data is corresponding.

As shown in Figure 15, exist and record the instruction of rest image in the time 1501, determine rearmost position (frame), v15 and beginning position (frame), the v1 of motion image data.Then, to make the recovery time determine the rearmost position a23 of voice data unlike the mode in rearmost position evening.In addition, the a0 more previous than a1 is defined as to the coding units of the beginning of voice data, wherein a1 is the AAU that comprises the sample corresponding with the beginning position 1502 of motion image data.

Beginning AAU a0 is recorded as to additional sound.Then, in the time starting from the outset to reproduce the additional motion pictures files that writes other motion pictures files, the time difference between moving image and the sound of part was equal to or less than the recovery time of an AAU endways, block using the offset information of a1 as the beginning of the additional voice data writing is offset and is stored on audio track, and the offset information of a0 is stored in moov as additional information.

On the other hand, the time difference between moving image and the sound of part is greater than in the situation of recovery time of an AAU endways, using as the offset storage of the a0 of the additional sound of beginning in moov.

Figure 16 is illustrated in motion image data and the voice data recording in while logging mode and the motion pictures files that stores each data.Figure 16 illustrates the motion pictures files in the situation of the additional sound of record described above.In Figure 16, the time is set to horizontal direction through direction, and difference between diverse location in the data time difference during with reproduction is corresponding.

With reference to Figure 16, in each 1601,1602 and 1603 instruction of output for recording rest image, and record is respectively as adjacent moving image before above each time and V1 and A1, V2 and A2 and V3 and the A3 of sound times.In addition, the additional sound of an

AAU

1604,1605 and 1606 is recorded to the voice data of each scene.By those motion image datas and voice data addition record in single motion pictures files 1607.In the time adding each scene, time difference of end portion at the motion pictures files that additionally writes other motion pictures files is not more than an AAU, as shown in Figure 12 by the offset storage of the beginning block of each motion image data and voice data in motion pictures files 1607 in moov.As shown in Figure 12, skew O1, the O3 of the beginning block of each motion image data and O5 are stored in the stco of track of video, and skew O2, the O4 of the beginning block of each voice data and O6 are stored in the stco of audio track.In addition, offset information O21, O41 and the O61 of additional sound are stored in moov as additional information.

Therefore,, in the case of being reproduced in the motion pictures files 1607 recording in while logging mode, do not reproduce

adventitious sound sound

1604,1605 and 1606.

Then the processing of, describing part and deleting the motion pictures files recording in logging mode at the same time.Recording equipment 100 has part delete function, and it is for the motion pictures files that logging mode records was at the same time deleted as unit part using n second, and using deletions afterwards remaining data carry out record as Single document.In part is deleted, with the form of encoding, motion image data and voice data before deletion and are afterwards carried out to combination.Poor on recovery time between motion image data and voice data based on before deletion and afterwards, control the additional sound that whether effectively reproduces each scene, adjust thus again now so that must moving image and sound after deletion and deletion can naturally reproduce.

For example, in the case of the moving image V2 and corresponding sound A 2 that delete n second from motion pictures files 1607, moving image V1 before moving image V2 deleted and afterwards and V3 are carried out to combination, and sound A before the sound A deleted 2 and afterwards 1 and A3 are carried out to combination.

Figure 17 A to 17F be illustrated in part delete process in motion image data before institute's deletion and afterwards and voice data with and in conjunction with the figure of pattern.In Figure 17 A, moving image 1 and additional sound 1 are adjacent motion image data and voice datas before institute's deletion, and moving image 2 and additional sound 2 are adjacent motion image data and voice datas after institute's deletion.In addition, x1 is illustrated in time difference, y1 between moving image 1 and the beginning part of sound 1 and is illustrated in time difference and the y2 that time difference, x2 between moving image 1 and the rear end part of sound 1 be illustrated between moving image 2 and the beginning part of sound 2 and is illustrated in the time difference between moving image 2 and the rear end part of sound 2.

Then, after part is deleted by institute's deletion before and moving image afterwards and sound in conjunction with time, be controlled at now again of the voice data in the motion pictures files after combination based on those time differences.

First,, the in the situation that of y1=x2, in statu quo moving image and sound before institute's deletion and are afterwards carried out to combination as shown in Figure 17 B.In this case, the size of deleting institute's deletion by the skew from deleting, the moving image of acquisition after institute's deletion and the block skew of sound.In Figure 17 B, reproduce the corresponding reproduction position that position 1701 and 1702 represents moving image 2 and sound 2.The in the situation that of y1=x2, become identical the now again of reproducing position 1701 and 1702.

Then, in the case of " y1>x2 and (y1-x2)+y2 >=(time of 1 AAU) ", as shown in Figure 17 C, the reproduction of coding units a0 is set to effectively, and wherein a0 is the additional sound of sound 2.That is, in this case, y1 is greater than x2, therefore in statu quo by moving

image

1 and 2 and

sound

1 and 2 combination in the situation that, become the now again of sound 2 more Zao than the reproduction moment of moving image 2.In this, the reproduction of beginning AAU a0 is set to effectively, and wherein a0 is the additional sound of sound 2.Particularly, calculate the skew of a0 and be stored in audio track.This reproduction moment by sound 2 postpones a0, therefore reproduces and can not become not nature.

In " (y1-x2)+y2 >=(time of 1 AAU) ", wherein by the time of the additional sound of reproduction moment delay of sound 2, because the reproduction end time of moving image 2 is more late than the reproduction end time of sound 2, therefore reproducing audio data, until the last coding units of sound 2.

Then, in the case of " y1>x2 and (y1-x2)+y2≤(time of 1 AAU) ", as shown in Figure 17 D, the reproduction of coding units a0 is set to effectively, and wherein a0 is the additional sound of sound 2.Similarly, in this case, y1 is greater than x2, and therefore the reproduction of beginning coding units a0 is set to effectively, and wherein a0 is the additional sound of sound 2.

In the case of " (y1-x2)+y2≤(time of 1 AAU) ", postponed to the time of additional sound the reproduction moment of sound 2, therefore the reproduction end time of sound 2 becomes more late than the reproduction end time of moving image 2.The skew of last coding units am of therefore, deleting sound 2 from moov is to make no longer existing last coding units am.Then, be stored in moov as additional information using the skew of last coding units am and about the information of the time difference between the end portion at moving image 2 in the case of the reproduction of forbidding am and the end portion of sound 2.

Then, " y1<x2 and (x2-y1)-y2>0 " in the situation that, as shown in Figure 17 E, the reproduction of coding units a0 is not set to effectively, wherein a0 is the additional sound of sound 2, and in statu quo in conjunction with moving

image

1 and 2 and sound 1 and 2.That is, in this case, x2 is greater than y1, therefore, by moving

image

1 and 2 and

sound

1 and 2 combinations, makes to have postponed compared with the now again of sound 2 and the now again of moving image 2.Therefore do not need to reproduce additional sound.

" (x2-y1)-y2>0 " in the situation that, it is more late than the reproduction end time of moving image 2 that the reproduction end time of sound 2 becomes.The skew of last coding units am of therefore, deleting sound 2 from moov is to make no longer existing last coding units am.Then, be stored in moov as additional information using the skew of last coding units am and about the information of the time difference between the end portion at moving image 2 in the case of the reproduction of forbidding am and the end portion of sound 2.

Then, " y1<x2 and (x2-y1)-y2≤0 " in the situation that, as shown in Figure 17 F, the reproduction of coding units a0 is not set to effectively, wherein a0 is the additional sound of sound 2, and in statu quo to moving

image

1 and 2 and

sound

1 and 2 carry out combination.

In " (x2-y1)-y2≤0 ", wherein become the now again of sound 2 more late than the reproduction moment of moving image 2, because the reproduction end time of moving image 2 becomes more late than the reproduction end time of sound 2, therefore reproducing audio data, until the last coding units of sound 2.

Control unit 106 in the above described manner operating part is deleted processing, and then for each scene after institute's deletion, calculate in the situation that starting reproducing motion pictures files from the outset in the above described manner, time difference of end portion between motion image data and voice data in each scene.

The time difference of part exceedes in the situation of recovery time of an AAU endways, and control unit 106 is added into moov to make to reproduce the additional sound as the beginning AAU of next scene by the skew of beginning AAU.

Figure 18 illustrates the flow chart for delete the operation of the motion pictures files that logging mode records at the same time according to the part of the present embodiment.Operation in Figure 18 is controlled unit by control unit 106 and is carried out.

In reproduction mode, user's operating operation unit 107 is deleted the part of the motion pictures files being recorded in logging mode at the same time with instruction.In the situation that indicating section is deleted, control unit 106 control unit on display unit 104 from the beginning of motion pictures files of specifying the downscaled images of every n display frame second.Particularly, the offset information that control unit 106 is stored from the moov of the motion pictures files of appointment detects the position of every n motion image data second.Then, control unit 106 indicates record-playback unit 108 and signal processing unit 105 to reproduce the motion image data of detected every n second and the image that generation is dwindled.

Record regenerating unit 108 is read the motion image data of assigned address and motion image data is stored in memory 103.Signal processing unit 105 is decoded, is dwindled each frame of decoded motion image data to read motion image data and on display unit 104, shows the image dwindling.

In the downscaled images of user shown every n second from display unit 104, select the downscaled images corresponding with the part that will delete, and indicate the deletion to the downscaled images of selecting.Now, at least one motion image data of every n second can be selected as the part that will delete.Specify by this way the part that will delete, then the processing in Figure 18 starts.

Control unit 106 detects the time difference (S1801) between moving image and sound before deletion and afterwards from the original motion image file shown in Figure 17 A.As mentioned above, while recording motion pictures files in logging mode at the same time, the information of the time difference about between every n beginning of each scene and the moving image of end portion and the sound of second is stored in moov as additional information.Control unit 106 is poor based on carry out detection time about the information of time difference.Then, the offset information of control unit 106 based on being stored in the moov of original motion image file, calculates moving image after deletion and the skew (S1802) of sound.

Then, control unit 106 judges whether the time difference between moving image and sound before deletion and is afterwards y1=x2 (S1803) as shown in Figure 17 B.The in the situation that of y1=x2, control unit 106 calculates the time difference (S1804) between moving image and the sound of the end portion of each scene after deletion.The time difference of part exceedes in the situation of recovery time of an AAU endways, and control unit 106 is attached to moov to make to reproduce the additional sound (S1805) as the beginning AAU of next scene by the skew of beginning AAU.Then, control unit 106 is stored in the offset information calculating by this way and change in the moov of motion pictures files after part is deleted (S1806).As a result of, by moving image and sound combination before deletion and afterwards.

The in the situation that of not meeting y1=x2 in S1803, control unit 106 judges whether to meet y1>x2 (S1807).The in the situation that of y1>x2, the skew that control unit 106 calculates additional sound, the beginning coding units (S1808) that wherein this additional sound is adjacent voice data after deletion.Then, control unit 106 is by the offset storage (S1809) in moov of additional sound.

In addition, control unit 106 determines whether " (y1-x2)+y2 >=(time of 1 AAU) " (S1810).In the case of " (y1-x2)+y2 >=(time of 1 AAU) ", control unit 106 enters S1804.In the case of not meeting " (y1-x2)+y2 >=(time of 1 AAU) ",, in the case of " (y1-x2)+y2< (time of 1 AAU) ", the skew (S1811) of the last coding units of adjacent n voice data second after deletion is deleted in the skew that control unit 106 calculates from step S1802.In addition, control unit 106 is stored in (S1812) in moov using the offset information of last coding units as additional information, and then enters S1804.

The in the situation that of not meeting y1>x2 in S1807, y1<x2, therefore control unit 106 judges whether to meet (x2-y1)-y2>0 (S1813).The in the situation that of (x2-y1)-y2>0, in the skew that control unit 106 calculates from S1802, delete the skew (S1811) of the last coding units of adjacent n voice data second after deletion.In addition, control unit 106 is stored in (S1812) in moov using the offset information of last coding units as additional information, and then enters S1804.

In the situation that not meeting (x2-y1)-y2>0, that is, the in the situation that of (x2-y1)-y2≤0, control unit 106 enters S1804.

About delete in part process after each remaining moving image and the sound that will record, control unit 106 maintenances are stored in the beginning part of the every n second in moov and the time difference of end portion and about the offset information that adds sound.

In this manner, in the motion pictures files recording from logging mode at the same time, delete the motion image data and corresponding voice data of every n second, can prevent the moving image after deletion and the factitious reproduction of sound.

Next, the operation in the time reproducing according to the recording equipment 100 of the present embodiment is described.In operating unit 107 outputs, for the instruction of reproduction mode, control unit 106 is indicated record-playback unit 108 to read and is recorded in the thumbnail image of each motion pictures files in recording medium 109 and thumbnail image is stored in memory 103.According to the present embodiment, control unit 106 is in the time creating new motion pictures files, create the down scaling image data of the beginning frame of the motion image data of new motion pictures files, and using down scaling image data as thumbnail image data storage and be recorded in motion pictures files.

Signal processing unit 105 utilizes each thumbnail image data of storing in memory 103 to generate the index picture of each motion pictures files, and on display unit 104, shows index picture.User's operating operation unit 107 is from one of shown index picture and selecting thumbnail image, and indicate selected go out the reproduction of motion pictures files.

Reproduce instruction in the situation that in output, control unit 106 indicate record-playback unit 108 reproduce selected go out motion pictures files.Record-playback unit 108 reproduces the motion pictures files of specifying, and motion pictures files is stored in memory 103.Signal processing unit 105 is read motion image data and the voice data of having encoded, motion image data and voice data is decoded from memory 103, and again decoded motion image data and voice data is stored in memory 103.Decoded motion image data is sent to display unit 104 to show on display unit 104.By decoded voice data from outputs such as output unit (not shown).

According to the present embodiment, as mentioned above, in logging mode, moving image and sound are additionally recorded in the situation in single motion pictures files at the same time, with the Zao scheduled time recording voice in beginning position of the voice data than corresponding with the beginning of moving image.Time difference between moving image and the sound of the end portion of scene was equal to or less than the scheduled time, to make the mode of the no longer now beginning of voice data record-shifted, and the in the situation that of moving image and sound being carried out to combination after part is deleted, the time difference between moving image and sound based on before bound fraction and afterwards reproduces and adds sound.Time difference between moving image and the sound of part exceedes in the situation of the scheduled time endways, to make the mode recording audio data of the voice data that reproduces beginning.

Therefore, at the same time in logging mode in the scene of addition record moving image and sound, little amplitude is prior to the reproduction of moving image and producing sound.In the situation that operating part is deleted, before the moving-image reproducing after the bound fraction in scene before deletion and afterwards, not producing sound, prevents factitious reproduction thus.In addition, do not insert dumb data at bound fraction, therefore the motion pictures files after part is deleted carries out reproduction period, and sound does not interrupt.

Although according to the present embodiment, be no more than the mode record data for the recovery time of motion image data so that must be used for the recovery time of voice data, but the present embodiment can be configured to be recorded to the coding units of the voice data corresponding with the ending of motion image data.

Although according to the present embodiment, in logging mode, by intraframe predictive coding, the each frame in motion image data is encoded at the same time, but with in common logging mode, carry out the same, can use intraframe coding and interframe encode to encode to the each frame in motion image data.

In this case, can decode to motion image data with the unit that is known as " GOP ", therefore be determined record beginning and the end position of motion image data by GOP unit.Therefore, in S1405, stop after the coding of moving image and sound, determine as follows the record beginning position of moving image.Control unit 106 detects the GOP of frame comprising than recording n before the point of instruction of rest image second.Then, the frame of the beginning of control unit 106 GOP is set to the record start position of motion image data.In addition, control unit 106 can comprise that the GOP of the frame corresponding with the instruction of rest image record is set to the record end position of motion image data.

In the case of determining in this manner the record start position of motion image data, control unit 106 detects the sampled point of the voice data corresponding with the record start position of motion image data, and the AAU previous AAU that comprises this sample is defined as to the record start position of sound.

Although recorded at the same time before the instruction of rest image record n moving image and the sound of second in logging mode according to the present embodiment, but may not record rest image, and may be by the moving image of n second before the record instruction being provided by user and sound addition record in Single document.As an alternative, in the case of additionally writing new moving image and can carry out similar processing with new sound being recorded in motion pictures files on recording medium 109.

So additional write mode is below described.In additional write mode, moving image and the sound of n second the record instruction that record provides from user, and stop afterwards record.In additional write mode, the single motion pictures files being recorded on recording medium 109 is additionally recorded to n moving image second and sound.

Figure 19 illustrates the flow chart of the operation in additional write mode according to the present embodiment.Operation in Figure 19 is controlled unit by control unit 106 and is carried out.Recording additional write mode is set in holding state in the situation that, as mentioned above, the processing of Figure 19 starts.

First, control unit 106 detects from recording medium 109 motion pictures files recording additional write mode, and detect in the situation that starting reproducing motion pictures files from the outset, time difference (S1901) between moving image and the sound of the end portion of motion image data and voice data.By poor detection time to the similar method using in treatment S 1406.

Then, control unit 106 starts the voice data that obtains unit 102 from audio frequency to be stored in (S1902) in memory 103.Only need the voice data of the quantity of the storage sample corresponding with the coding units of at least two voice datas, and repeatedly the voice data of two coding units is stored in memory 103.

With this understanding, control unit 106 judges whether to export recording start instruction (S1903).In the situation that having exported recording start instruction, control unit 106 will be defined as record start position (S1904) with respect to the sample of indicating corresponding audio sample to shift to an earlier date the time difference detecting in S1901 with recording start based on the detected time difference in S1901.In the case of the record beginning position of determining voice data, control unit 106 calculates the skew at moving image and the sound of scene boundary, and by offset storage (S1905) in memory 103.Particularly, control unit 106 judges whether the time difference calculating in S1901 is equal to or less than the recovery time of an AAU.The recovery time that is equal to or less than an AAU in the time difference, control unit 106 by the offset storage of the next AAU of the AAU of record beginning position in moov to make no longer now to start AAU.Then, will be stored in moov as additional information about the offset information of beginning AAU.On the other hand, the recovery time that is greater than an AAU in the time difference, control unit 106 is stored in moov the AAU of record beginning position to make to reproduce beginning AAU.

Then, control unit 106 starts the motion image data of exporting from image unit 101 to be stored in memory 103, and index signal processing unit 105 starts motion image data and voice data encode (S1906).Now, control unit 106 index signal processing units 105 start from indicating corresponding frame with recording start, motion image data to be encoded, and start voice data to encode from determined beginning position S1904.Then, control unit 106 indicates record-playback unit 108 motion image data of having encoded and voice data to be added and be recorded to the motion pictures files of appointment.Motion image data and the voice data of having encoded are read in record-playback unit 108 from memory 103, and motion image data and voice data are added and be recorded to the motion pictures files (S1907) that has added data.

Starting by this way after record, control unit 106 judges from starting whether passed through n second (s1908) since record.In the situation that starting to have passed through n second since record, control unit 106 stops coding and the record (S1909) to motion image data and voice data.Now, with the reproduction stop position that makes sound, the mode before the reproduction stop position of motion image data is determined the stop position that records of motion image data and voice data.

Then, control unit 106 indicates record-playback unit 108 to upgrade the content (S1910) of the management information moov of the additional motion pictures files writing.As a result of, the information of the motion image data about new record and voice data is added into moov.In addition, by about being stored in the moving image of the scene boundary in memory 103 and the offset information of sound is stored in moov in S1905.In the situation that not reproducing beginning AAU, will be stored in moov as additional information about the offset information of beginning AAU.In addition be stored in moov by the information of the time difference between the moving image of the beginning about in each scene and sound and about the information of the time difference between moving image and the sound of the end portion of each scene.

The part of the motion pictures files recording in above-mentioned additional write mode can be deleted.In this case, based on the offset information about scene boundary being stored in moov, the downscaled images on displayed scene border on display unit 104, and from motion pictures files by with user-selected go out the corresponding scene of downscaled images delete to end portion from the outset.After deletion, according to the operation shown in Figure 17 A to 17F and Figure 18, by moving image before deletion and afterwards and sound combination.

Based on according to the interrecord structure of motion pictures files of the present invention, even in the case of carrying out the combination of motion pictures files after record or the part of motion pictures files is deleted, also can prevent the inconsistent factitious reproduction causing due to the now again of moving image in the reproduction of motion pictures files and the now again of sound.

The present embodiment can be configured such that the beginning of user's instruction record in additional write mode and the user that stops making to record from starting record is indicated to moving image and the sound between the user's instruction that stops record.The present embodiment can be configured such that user, in additional write mode, is additionally written to by moving image and sound the motion pictures files that user selects from be recorded in the motion pictures files recording medium 109.Can be implemented as other structure.For example, be adjacently set to select motion pictures files before additional write mode.

other embodiment

Forming the unit of above-mentioned recording equipment and each step of recording method according to an embodiment of the invention can be used as the program operation in RAM, the ROM etc. that is stored in computer and realizes.This program and stored program computer-readable recording medium are within the scope of the present invention.

The present invention can be implemented as such as system, equipment, method, program, storage medium etc.Particularly, the equipment that the present invention goes for comprising the system of multiple devices or comprises single assembly.

The present invention includes a kind of situation, wherein will realize direct or long-range system or the equipment of being supplied to of software program of function of above-described embodiment.The present invention also comprises a kind of situation, and wherein supplied with program code is read and carried out to the computer of system or equipment.

Therefore, the present invention by installing on computers so that the program code self of computer function treatment of the present invention is realized., the present invention includes the computer program self for realizing function treatment of the present invention.In this case, as long as program has program function, computer program can be taked any form of the program of carrying out such as object identification code, by interpreter or the script data that will be supplied to OS etc.

Comprise floppy disk, hard disk, CD and magneto optical disk for the storage medium of supplying with program.Storage medium also comprises MO, CD-ROM, CD-R, CD-RW, tape, Nonvolatile memory card, ROM and DVD (DVD-ROM, DVD-R).

In addition, supply with the method for program comprise utilize the browser being arranged on client computer by Internet connection to webpage.As an alternative, can by the storage medium from page download computer program self or download file to such as hard disk etc. to supply with according to computer program of the present invention, wherein this file has the computer program having compressed and is provided with Auto-mounting function.

In addition, according to computer program of the present invention can by segmentation procedure code make calling program be divided into multiple files and by the webpage from different respectively download file realize., allow multiple users that the www server that downloads to computer for the program file of realizing function treatment of the present invention is comprised within the scope of the invention.

Method as an alternative, can be encrypted and be stored in such as on the storage medium of CD-ROM etc. and be distributed to user according to program of the present invention, and allow specific user by predetermined condition from the page download key information internet with the program deciphering to after encrypting.Utilize key information, user can move program after encryption to install on computers to realize program of the present invention.

In addition, computer can be carried out read program to realize the function of above-described embodiment.In addition, based on the instruction from program, the OS etc. of operation can some or all of execution actual treatment on computers, realizes thus the function of above-described embodiment.

As other method, first, the program of reading from storage medium is write the expansion board that setting installs on computers or be connected in the memory on the functional expansion unit of computer.Then, be arranged on the instruction based on from program such as CPU on expansion board or functional expansion unit and some or all of execution actual treatment, realize thus the function of above-described embodiment.

Although the present invention has been described with reference to exemplary embodiments, should be appreciated that, the invention is not restricted to disclosed exemplary embodiments.The scope of appended claims meets the widest explanation, to comprise all these class amendments, equivalent structure and function.

Claims

1. a recording equipment, comprising:

Moving image obtains unit, for obtaining motion image data;

Audio frequency obtains unit, for obtaining voice data;

Coding unit, for according to the coding units of the moving image sample as corresponding with very first time section, obtained motion image data being encoded, and according to the coding units of the audio sample as corresponding with the second time period, obtained voice data is encoded;

Record cell, for motion image data and voice data after coded described coding unit are stored in to motion pictures files, and by this motion image data and this audio data recording in recording medium; And

Control unit, for the record start position of the motion image data based on obtained, determines the record start position of the voice data obtaining,

Wherein, the definite record start position with respect to obtained motion image data of described control unit shifts to an earlier date at least position of the audio sample corresponding with described the second time period, as the record start position of obtained voice data, and the reproduction start position of recorded voice data is defined as falling behind with respect to the beginning of recorded voice data the position of the coding units of described voice data.

2. recording equipment according to claim 1, wherein, described recording equipment has the first logging mode, described the first logging mode is for making described record cell generate the new motion pictures files that will record, wherein, in described the first logging mode, described control unit is defined as the record start position of obtained voice data the position of the audio sample in advance corresponding with described the second time period with respect to the record start position of obtained motion image data.

3. recording equipment according to claim 1, wherein, described recording equipment has the second logging mode, described the second logging mode is for being added into new motion image data and voice data in the motion pictures files that is recorded in described recording medium according to starting the instruction of record, wherein, in described the second logging mode, described control unit is defined as the record start position of obtained voice data to shift to an earlier date with respect to the beginning that is recorded in the motion pictures files on described recording medium the position of following time difference: this time difference is in the case of starting reproducing motion pictures data and voice data from the beginning of described motion pictures files, time difference between the reproduction end position of motion image data and the reproduction end position of voice data.

4. recording equipment according to claim 3, wherein, in described the second logging mode, described control unit judges whether the described time difference is greater than described the second time period, in the situation that the described time difference is less than described the second time period, the reproduction start position of obtained voice data is set to fall behind with respect to the beginning of recorded voice data the position of the coding units of described voice data, and the beginning that recorded voice data is set in the situation that the described time difference is greater than described the second time period is as described reproduction start position.

5. recording equipment according to claim 1, wherein, also comprises memory, and described memory is for storing motion image data and the voice data of described coding unit after coded,

Wherein, recording in holding state, obtain voice data that unit obtains encodes in the case of in turn described moving image being obtained to motion image data that unit obtains and described audio frequency, described coding unit is stored in motion image data and voice data after the coding of predetermined amount of time at least in described memory, and

According to indicating at the described record recording in holding state, record cell described in described control unit control, with by the voice data after the coding of the motion image data after the coding of described predetermined amount of time and time period corresponding with motion image data after the coding of described predetermined amount of time, be added in the predetermined motion pictures files being recorded in described recording medium.

6. recording equipment according to claim 5, wherein, the audio sample of the beginning of the previous coding units of the coding units of the following voice data of described control unit is set to the record start position of voice data, wherein, the coding units of this voice data is corresponding to respect to indicating corresponding moving image sample to shift to an earlier date the moving image sample of described predetermined amount of time with described record.

7. recording equipment according to claim 6, wherein, described control unit judges in the case of starting reproducing motion pictures data and voice data from the beginning of described predetermined motion pictures files, whether the time difference between the reproduction end position of motion image data and the reproduction end position of voice data is greater than described the second time period, in the situation that the described time difference is equal to or less than described the second time period, the reproduction start position of recorded voice data is set to fall behind with respect to the beginning of recorded voice data the position of the coding units of described voice data, and the beginning of recorded voice data in the situation that being greater than described the second time period, is set the described time difference as described reproduction start position.

8. recording equipment according to claim 5, wherein, described control unit is determined the record start position of obtained motion image data according to described record instruction, and before described record instruction, control described coding unit, being repeatedly stored in described memory with at least corresponding than described the second time segment length's the 3rd time period audio sample of the voice data after coding.

9. recording equipment according to claim 1, wherein, described control unit generates the management information of the reproduction start position of the voice data after presentation code, and described management information is stored in the motion pictures files that described record cell records, represent that the record start position of the motion image data obtaining is the management information of the reproduction start position of the motion image data after coding but also generate, and generated management information is stored in described motion pictures files.

10. recording equipment according to claim 9, wherein, motion image data and voice data after the coding of storing by motion image data and voice data after the coding of storing in the motion pictures files being recorded on described recording medium and in being recorded in other motion pictures files on described recording medium carry out combination, described control unit according to the reproduction end position of the motion image data after the coding in a described motion pictures files and with a described motion pictures files in coding after voice data carry out combination, time difference between the reproduction start position of the voice data after the coding in described other motion pictures files, change the reproduction start position of the voice data after the coding in described other motion pictures files.

11. recording equipments according to claim 9, wherein, in motion image data after the multiple codings from combination and voice data, delete a voice data after motion image data and the coding after coding, and motion image data and voice data after coding before adjacent motion image data after deleted coding and voice data and are afterwards carried out respectively combination, described control unit is according to the time difference between motion image data and the reproduction end position of voice data after the coding before adjacent motion image data and voice data after deleted coding, and motion image data after coding after adjacent motion image data and voice data after deleted coding and the time difference between the reproduction end position of voice data, voice data after change and the adjacent coding above carries out combination, the reproduction start position of adjacent voice data after coding below.

12. recording equipments according to claim 1, wherein, described control unit generates the view data of the motion image data after the coding of indicating to be stored in the motion pictures files that described record cell will record, and this view data is stored in described motion pictures files, and

Described recording equipment has reproduction mode, and described reproduction mode is for according to record instruction and the view data that is stored in described motion pictures files is presented to display unit, and view data based on shown is reproduced described motion pictures files.

13. 1 kinds of recording methods, obtain the voice data that unit obtains and are recorded in recording medium as motion pictures files for moving image being obtained to motion image data that unit obtains and audio frequency by record cell, and described recording method comprises:

Coding step, for according to the coding units of the moving image sample as corresponding with very first time section, obtained motion image data being encoded, and according to the coding units of the audio sample as corresponding with the second time period, obtained voice data is encoded;

Recording step, for by described record cell, motion image data and voice data after described coding step coding being stored in described motion pictures files, and by this motion image data and this audio data recording in described recording medium; And

Control step, for the record start position of the motion image data based on obtained, determine the record start position of the voice data obtaining,

Wherein, described control step comprises: determine with respect to the record start position of obtained motion image data and shift to an earlier date at least position of the audio sample corresponding with described the second time period, as the record start position of obtained voice data, and the reproduction start position of recorded voice data is defined as falling behind with respect to the beginning of recorded voice data the position of the coding units of described voice data.