JP2019220859A - Image processing apparatus, image processing method, and program - Google Patents

Abstract

To record a video image to be compared with an existing video image so that a time lag after specifying the frame number for later playback until an image of the frame is displayed can be reduced.SOLUTION: The image processing apparatus includes: an audio processing unit 13 and a speaker 11 for reproducing digital music data; a recording systems (14, 28, 35) for compressing and recording video images by inter-frame prediction; and a processor 14 for acquiring information indicating a preset timing for music to be played, waiting for the timing of the acquired information for the music to be played, and causing recording systems (14, 28, 35) to record an independent frame image coded without using the inter-frame prediction.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image processing device, an image processing method, and a program.

  A technique has been proposed in which a captured image and another image are displayed in an easy-to-comparison manner. (For example, Patent Document 1)

JP 2016-126022 A

The technology described in the above patent document does not consider the concept of data compression in moving image data.
Generally, moving image data that has been data-compressed includes a reference frame (I (Intra-coded) frame) encoded without using inter-frame prediction and a differential frame (P ( Predicted frame).

  Therefore, when it is desired to specify and display a frame having a specific frame number from the moving image data, and when the specified frame is a P frame, the immediately preceding I frame corresponding to the specified P frame is further searched. Then, it is necessary to sequentially decode and add frames intervening from the I frame to the designated P frame.

  Therefore, a time lag often occurs between the time when the frame number is specified and the time when the image of the frame of the frame number is actually displayed. This point becomes more remarkable when the data compression ratio is high and the appearance ratio of I frames in a series of frames is low.

  SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and a purpose thereof is to specify a frame number at the time of subsequent reproduction when recording a moving image to be compared with an existing moving image. Another object of the present invention is to provide an image processing apparatus, an image processing method, and a program capable of recording so as to reduce a time lag from when the image of the frame of the number is displayed until the image is displayed.

  One aspect of the present invention includes first recording control means for recording moving image data, and timing detecting means for detecting a preset timing for digital music data, and the first recording control means The means records the moving image data together with information indicating the preset timing detected by the timing detecting means.

  According to another aspect of the present invention, there is provided a second recording control unit that compresses and codes a moving image by inter-frame prediction and records the moving image data, and a moving image different from the moving image data to be compared with the moving image data. Timing information acquisition means for acquiring information indicating a preset timing for the image data, wherein the second recording control means acquires the timing information acquisition means during recording of the moving image data. When the timing of the given information comes, at that timing, the independent frame image data encoded without using the inter-frame prediction is recorded.

  According to the present invention, when recording a moving image that is to be compared with an existing moving image, the time lag from the time when a frame number is specified at the time of subsequent reproduction to the time when the image of the frame of the number is displayed is reduced. It is possible to record as much as possible.

FIG. 2 is a block diagram showing a functional configuration of an electronic circuit of the smartphone according to the embodiment of the present invention. 4 is an exemplary flowchart showing processing content at the time of master video recording by the dance analysis program according to the embodiment. 5 is a flowchart showing processing contents when recording a comparative video by the dance analysis program according to the embodiment.

  Hereinafter, an embodiment in which the present invention is applied to a smartphone in which an application program for dance analysis is installed will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram illustrating a functional configuration of an electronic circuit of smartphone 10. In the smartphone 10, reference numeral 11 denotes a speaker for outputting sound, and reference numeral 12 denotes a microphone for inputting sound, both of which are connected to the sound processing unit 13.

  When performing input and output of sound by the smartphone 10, the sound processing unit 13 digitizes the sound input from the microphone 12, converts the sound into code data, performs predetermined data compression, and outputs the sound to the system bus SB. Digital music data is received via the system bus SB, and after being subjected to decompression processing, an analog audio signal is generated and output to the speaker 11 for sound emission.

  The processor 14 executes the operation control of the entire smartphone 10 using the work memory 15 and the program memory 16 connected via the system bus SB.

  The work memory 15 is composed of, for example, an SDRAM, and expands and holds the application program read from the program memory 16 when the processor 14 executes the program. The program memory 16 is composed of a non-volatile memory, and stores and stores an OS (operating system), various application programs including a dance analysis program 16A described later, and various other fixed data. The data is read into the work memory 15 by the processor 14 as needed.

  The processor 14 converts a series of image data obtained by shooting into a moving image file including data compression accompanied by inter-frame prediction when recording a video, and reads out the video from a recording medium when reproducing the video. The decoded moving image file is sequentially decoded, decompressed, and reproduced and displayed in the reverse order of the recording.

  The system bus SB further includes a display unit 17, a touch input unit 18, an imaging unit 19, a GPS reception unit 20, an acceleration sensor 21, a gyro sensor 22, a geomagnetic sensor 23, an operation unit 24, a vibrator 25, and a wireless communication unit 26. , NFC (Near Field Communication) unit 27, and an external device interface (I / F) 28.

  The display unit 17 is composed of a color liquid crystal panel with a backlight, for example, a diagonal size of about 6 inches, and a driving circuit for them. A touch input unit 18 using a transparent electrode film is integrally formed with the display unit 17. The touch input unit 18 digitizes a time-series coordinate signal corresponding to a user's touch operation including a multi-touch operation, and sends the coordinate signal to the processor 14 as a touch operation signal.

  The imaging unit 19 includes an imaging unit provided on at least one of the front and back sides of the housing of the smartphone 10, an image processing unit that compresses image data obtained by imaging by the imaging unit and creates a file.

  The GPS receiver 20 calculates three-dimensional coordinates (latitude, longitude, altitude) of the current position and the current time based on incoming radio waves from a plurality of GPS satellites (not shown) received by the GPS antenna 29, and It is sent to the processor 14 via SB.

  The acceleration sensor 21 detects accelerations in three axial directions orthogonal to each other, and can detect the attitude of the smartphone 10 based on the direction of the gravitational acceleration.

  The gyro sensor 22 is constituted by a vibrating gyroscope arranged in three axial directions orthogonal to each other, and combined with the outputs of the acceleration sensor 21 and the geomagnetic sensor 23, an operation of a user who owns and wears the smartphone 10 Is analyzed, and even if the absolute current position cannot be recognized by the output from the GPS antenna 29 and the GPS receiving unit 20, the operation of updating the current position by the autonomous navigation in cooperation with the acceleration sensor 21 and the geomagnetic sensor 23 is performed. Can be performed.

  The terrestrial magnetism sensor 23 detects terrestrial magnetism in three axial directions orthogonal to each other, and can detect the direction in which the smartphone 10 is pointing at that time based on the direction of magnetic north.

  The operation unit 24 includes several operation keys including a power key provided on a side surface of the housing of the smartphone 10 and sends a key operation signal corresponding to the key operation to the processor 14 via the system bus SB. I do.

  The vibrator 25 includes a small motor and a weight eccentrically attached to the rotation axis of the motor, and generates vibrations that cover the entire smartphone 10 by rotating the motor.

  The wireless communication unit 26 uses the antennas 30 to 32 to connect to, for example, a fourth-generation mobile phone, a wireless LAN system based on IEEE802.11a / 11b / 11g / 11n, and a short-range wireless communication line using Bluetooth (registered trademark). Data is transmitted and received to and from an external device by wireless communication.

  The NFC unit 27 performs data transmission / reception and power supply operations without contact with an external device at a short distance using, for example, the FeliCa (registered trademark) standard and the MIFARE (registered trademark) standard.

  The external device interface 28 can connect or attach, for example, a headphone, an earphone, a USB device, and a memory card via a headphone jack 33, a micro USB terminal 34, and a memory card slot 35, respectively.

  A moving image data file, a digital music data file, and the like used in a dance analysis program described later are recorded on the memory card inserted into the memory card slot 35, and the recorded data can be read.

Next, the operation of the present embodiment will be described.
In the present embodiment, the dance analysis program 16A installed on the smartphone 10 is activated, and a master video recording mode for recording a dance video by a model person, and a comparison image of a person's dance for comparison with the recorded master video. The recording is executed after selecting one of the comparison video recording modes for recording.

  FIG. 2 is a flowchart showing the contents of processing executed by the processor 14 in a master video recording mode for recording a video of a dance performed by a model person. In the master video recording mode, video recording is started after selecting a music file of a music piece to be reproduced as a preset setting.

  At the beginning of the process, the processor 14 first causes the image capturing unit 19 to start capturing an image (step S101). Here, the processor 14 simultaneously digitizes the audio data collected by the microphone 12 by the audio processing unit 13 and incorporates the digitized audio data into the moving image data obtained by the imaging unit 19, for example, into a memory card attached to the memory card slot 35. Record sequentially.

  At the same time, the processor 14 starts the operation of reading out the selected music file recorded on, for example, a memory card inserted in the memory card slot 35 and reproducing it by the audio processing unit 13 and the speaker 11 (step S102).

Here, when recording the moving image data, the processor 14 detects the reproduction start timing of the music file to be reproduced, and records the frame at the time of the detection as a base frame in a identifiable state.
After that, the processor 14 executes shooting of video by the imaging unit 19, acquisition of audio data by the microphone 12 and the audio processing unit 13, and recording of the moving image data on the memory card (step S103). At the same time, the processor 14 executes the reproduction of the music file by the audio processing unit 13 and the speaker 11 (Step S104).

  At the same time, the processor 14 detects a beat from a strong beat and a weak beat for the music data being reproduced at that time (step S105). The processor 14 determines whether it is a beat (strong beat) timing from the detection result (step S106).

  If it is determined that the timing is a beat timing (Yes in step S106), the processor 14 stores a time value based on the reproduction start timing of the music file as the beat timing (step S107), and records at the same timing. The frame number of the video is stored (step S108).

  In addition, the processor 14 converts the video of the frame number into a video capture by an independent frame image associated with the recorded moving image file, for example, into a JPEG file, and stores the time value of the beat timing and the frame of the video. It is stored in the memory card in association with the number (step S109).

  When it is determined in step S106 that the timing is not the beat timing (No in step S106), the processor 14 does not execute the processing in steps S107 to S109 and omits the processing.

  Thereafter, the processor 14 determines whether or not it is time to end the music file being played (step S110).

  If it is determined that the music file being played has not ended (No in step S110), the processor 14 returns to the process from step S103 again.

  By repeatedly executing the processes of steps S103 to S110 until the timing of ending the music file being reproduced in this way, video shooting in accordance with the reproduction of the music file and independent frame image generation at each beat timing are performed. Save and continue.

  When it is determined in step S110 that the timing of ending the music file being played has come (Yes in step S110), the processor 14 ends the playback of the music file (step S111), and the imaging unit 19 The shooting of the video is also terminated (step S112).

  Further, the processor 14 uses the file name associated with the moving image file of the captured video recorded in the memory at that time, and saves and sets as a separate image file in which a series of independent frame images at each beat timing are collected. (Step S113) Then, the processing in the master video recording mode ends.

  In the master video recording mode shown in FIG. 2, it has been described that the image is recorded as another image file composed of a JPEG file group for each beat timing having a file name associated with a moving image file obtained by shooting. The form is not limited to this.

  For example, a video to be shot is a moving image file format in which data is compressed by inter-frame prediction, for example, H.264. If a beat timing is detected when a H.264 / AVC standard moving image file is recorded, a video frame at that timing is always regarded as an independent frame without using inter-frame prediction, that is, an I (Intra-coded) frame. If it is set to record, it is not necessary to record another image file by the JPEG file group.

  In this case, in the moving image file, information that is a set of a time value when the beat timing is detected and a frame number of a video recorded at the same timing is divided by the number of independent frame images recorded at the beat timing. It will be recorded along with it.

  In addition, after shooting in the master video recording mode, an independent frame image is created at the timing by designating the timing of introduction of a specific turn in a dance, for example, regardless of the beat timing, etc., by editing processing by the user. Then, additional recording may be performed together with the time value of the timing based on the reproduction start timing of the music file and the frame number of the video at the timing.

  FIG. 3 is a flowchart showing processing in a comparative video recording mode for recording a comparative video of a person's dance for comparison with the master video. In the comparative video recording mode, as a pre-setting, select the video file recorded in the master video recording mode to be played, and also select the music file of the music to be played, which is used in the video data, and then record the video. Start.

  At the beginning of the process, the processor 14 first reads out information on the frame number to be compared and stores the information in the work memory 15 by using an image file in which independent frame images are given together with a file name associated with the selected master video moving image file. (Step S201).

  Next, the processor 14 confirms that there is the independent frame image for performing the comparison (step S202). When it is determined that there is the independent frame image for comparison (Yes in step S202), the image file is read from the memory card inserted in the memory card slot 35 and stored in the program memory 16 (step S203). .

  When it is determined in step S202 that there is no independent frame image for comparison (No in step S202), the processor 14 omits the process in step S203.

  After that, the image capturing by the image capturing unit 19 is started again (step S204). Here, the processor 14 simultaneously digitizes the audio data collected by the microphone 12 by the audio processing unit 13 and incorporates the digitized audio data into the moving image data obtained by the imaging unit 19, for example, into a memory card attached to the memory card slot 35. Record sequentially.

  The reproduction of the moving image file serving as the selected master video is started so as to synchronize with the recording of the comparison video (step S205).

  In the display unit 17, for example, the processor 14 controls so that two images are displayed side by side as a monitor image of a master image reproduced on the left half of the screen and a comparative image recorded on the right half of the screen.

  Further, the processor 14 starts an operation of reading out the selected music file recorded on the memory card and reproducing the music file by the audio processing unit 13 and the speaker 11 (step S206).

Here, when recording the moving image data, the processor 14 detects the reproduction start timing of the music file to be reproduced, and records the frame at the time of the detection as a base frame in a identifiable state.
Thereafter, the processor 14 executes shooting of a video by the imaging unit 19, acquisition of audio data by the microphone 12 and the audio processing unit 13, and recording of the moving image data on the memory card (step S207). At the same time, the processor 14 executes the reproduction of the music file by the audio processing unit 13 and the speaker 11 (Step S208).

  At the same time, the processor 14 detects a beat from a strong beat and a weak beat with respect to the music data being reproduced at that time (step S209). The processor 14 determines whether it is a beat (strong beat) timing from the detection result (step S210).

  If it is determined that the timing is a beat timing (Yes in step S210), the processor 14 stores a time value based on the reproduction start timing of the music file as the beat timing (step S211) and records the same timing. It is determined whether the frame number of the video matches one of the frame numbers attached and recorded on the master video side (step S212).

  When it is determined that there is a matching frame number on the master video side (Yes in step S212), the processor 14 stores the frame number (step S213).

  If it is determined in step S212 that there is no matching frame number on the master video side (No in step S212), it is determined that a shift has occurred in the detection of the beat timing based on the reproduction of the same music data, and at that time If there is a difference between the frame number of the recorded video and the frame number of the master video within a certain value, it is determined that the video matches the current beat timing, and the frame number of the corresponding master video is used. Is corrected (step S214).

  After that, the processor 14 converts the video of the frame number into a JPEG file, for example, as a video capture by an independent frame image associated with the recorded moving image file, and stores the time value of the beat timing and the frame of the video. It is stored in the memory card in association with the number (step S215).

  Further, the processor 14 determines whether or not there is an independent frame image, which is recorded as an image capture to the master image and coincides with the current frame number (step S216).

  If it is determined that there is a match (Yes in step S216), the processor 14 compares the captured images of the two corresponding still images in the program memory 16 in parallel for a certain period of time, for example, two seconds, according to the frame number. Is set to be displayed (step S217).

  If it is determined in step S216 that there is no video capture on the master video side that has the same frame number (No in step S216), the processor 14 determines that the difference between the frame numbers is a fixed value as the video capture on the master video side. If there is a frame number within the range, it is determined that the video coincides with the current beat timing, and a video capture on the corresponding master video side is searched (step S218).

  The processor 14 reads out a frame image to be a video capture on the master video side for comparison (step S219), and executes a comparative scoring process with the same video capture image stored in the immediately preceding step S215 (step S219). S220).

  For this comparative scoring process, for example, a person performing a dance is extracted from both images as a main subject, and then the similarity of their movements, specifically, the posture angle and both hands and feet of the person, and the head It can be realized by making a score based on the degree of similarity with the angle of the section and superimposing the obtained score on a screen on the comparison video side displayed on the right side of the display section 17.

  Thereafter, the processor 14 determines whether or not it is time to end the music file being played (step S221).

  If it is determined that the music file being played has not ended (No in step S221), the processor 14 returns to the process from step S207 again.

  By repeatedly executing the processes of steps S207 to S221 until the music file being played ends, the video shooting corresponding to the music file playback on the comparison video side and the beat timing at each beat timing are repeated. And saving of the independent frame image.

  When it is determined in step S221 that the timing of ending the music file being played has come (Yes in step S221), the processor 14 ends the playback of the music file (step S222), and the imaging unit 19 The shooting of the video is also ended (step S223), and the processing in FIG.

  As described in detail above, according to the present embodiment, when recording a moving image to be compared with an existing moving image, recording is performed as an independent frame image that does not require data interpolation by inter-frame prediction. Therefore, it is possible to perform recording so that the time lag from when the frame number is designated at the time of subsequent reproduction until the image of the frame of the number is displayed can be reduced.

  Further, in the above-described embodiment, the calculation at the time of recording is performed by recording an I frame image in moving image data as an independent frame image at the time of moving image recording or by additionally recording as still image data associated with moving image data. The burden on the processing system is not greatly increased.

  Although the above embodiment has been described with reference to the case where the present invention is applied to a smartphone on which an application program for dance analysis is installed, the present invention is not limited to dance as long as the target is to reproduce music using a digital sound source. For example, a device that performs analysis such as figure skating and synchronized swimming is also conceivable.

  Further, in the above embodiment, the case has been described where the beat timing of the music data is set as the timing for acquiring an independent frame image. However, the present invention is not limited to this, and various sensor groups including a three-dimensional acceleration sensor and the like are used. A wearable sensor with built-in wireless communication function is attached to the person to be photographed, and an independent frame image is acquired at a timing according to the movement of the person, for example, using the jumping vertex position as the photographing timing It is also conceivable to adopt such a configuration.

  Furthermore, the device that realizes the functions of the present embodiment is not limited to a smartphone or a mobile type personal computer as in the embodiment, and may be used, for example, in a case where a movie camera that performs moving image shooting is used in combination with a music player. Applicable.

  In addition, the present invention is not limited to the above-described embodiment, and can be variously modified in an implementation stage without departing from the gist thereof. In addition, the embodiments may be implemented in appropriate combinations as much as possible, in which case the combined effects can be obtained. Furthermore, the above embodiments include inventions at various stages, and various inventions can be extracted by appropriate combinations of a plurality of disclosed constituent elements. For example, even if some components are deleted from all the components shown in the embodiment, the problem described in the column of the problem to be solved by the invention can be solved, and the effects described in the column of the effect of the invention can be solved. Is obtained, a configuration from which this configuration requirement is deleted can be extracted as an invention.

Hereinafter, the invention described in the claims of the present application is additionally described.
[Claim 1]
First recording control means for recording moving image data;
Timing detection means for detecting a preset timing for the digital music data,
An image processing apparatus, wherein the first recording control means records the moving image data together with information indicating the preset timing detected by the timing detection means.
[Claim 2]
The first recording control means compresses and encodes a moving image by inter-frame prediction to record the moving image data, and performs the inter-frame prediction at the preset timing detected by the timing detecting means. The image processing apparatus according to claim 1, wherein independent frame image data encoded without being used is recorded.
[Claim 3]
Further comprising music playback means for playing back the digital music data,
The image processing device according to claim 1, wherein the timing detection unit detects a preset timing for the digital music data reproduced by the music reproduction unit.
[Claim 4]
Second recording control means for compressing and encoding a moving image by inter-frame prediction and recording it as moving image data;
Comparing with the moving image data, comprising a timing information obtaining means for obtaining information indicating a preset timing for moving image data different from the moving image data,
When the timing of the information obtained by the timing information obtaining means arrives during the recording of the moving image data, the second recording control means sets an independent frame image encoded without using inter-frame prediction at the timing. An image processing device that records data.
[Claim 5]
Timing detection means for detecting a preset timing for digital music data,
The first moving image data is recorded, and during the recording of the first moving image data, information indicating the preset timing detected by the timing detecting means is added to the first moving image data. First recording control means for recording incidentally;
Second recording control means for compressing and encoding a moving image by inter-frame prediction and recording the moving image as second moving image data different from the first moving image data;
Timing information acquisition means for acquiring information indicating the timing attached to the first moving image data,
When the timing of the information obtained by the timing information obtaining means arrives during the recording of the second moving image data, the second recording control means performs the encoding without using the inter-frame prediction at the timing. An image processing device that records independent frame image data.
[Claim 6]
The image processing apparatus according to claim 2, wherein the independent frame image data is one of an I (Intra-coded) frame image in a moving image and a still image associated with the moving image.
[Claim 7]
Further comprising a music reproducing means for reproducing digital music data,
The image processing apparatus according to claim 4, wherein the timing information acquisition unit acquires information indicating a preset timing for music played by the music playback unit.
[Claim 8]
The image processing apparatus according to claim 4, wherein the timing information acquisition unit acquires information indicating a timing set in advance by a user.
[Claim 9]
An image processing method in an image processing device,
A first recording control step of recording moving image data;
A timing detection step of detecting a preset timing for the digital music data,
The first recording control step is an image processing method for recording the moving image data together with information indicating the preset timing detected in the timing detection step.
[Claim 10]
An image processing method in an image processing device,
A second recording control step of compressing and encoding a moving image by inter-frame prediction and recording as moving image data;
Compared with the moving image data, comprising a timing information obtaining step of obtaining information indicating a preset timing for moving image data different from the moving image data,
In the second recording control step, during the recording of the moving image data, when the timing of the information acquired in the timing information acquiring step comes, at the timing, an independent frame image encoded without using inter-frame prediction An image processing method that records data.
[Claim 11]
A program to be executed by a computer incorporated in the image processing apparatus, the computer comprising:
First recording control means for recording moving image data,
Function as timing detection means for detecting a preset timing for digital music data,
A program, wherein the first recording control means records the moving image data together with information indicating the preset timing detected by the timing detection means.
[Claim 12]
A program to be executed by a computer incorporated in the image processing apparatus, the computer comprising:
Second recording control means for compressing and encoding a moving image by inter-frame prediction and recording it as moving image data;
Compared with the moving image data, timing information obtaining means for obtaining information indicating a preset timing for moving image data different from the moving image data, function as,
When the timing of the information obtained by the timing information obtaining means arrives during the recording of the moving image data, the second recording control means sets the independent frame image data encoded without using inter-frame prediction at the timing. To record the program.

10… Smartphone,
11 ... speaker,
12 ... microphone,
13 ... Sound processing unit,
14. Processor,
15 Work memory,
16. Program memory,
16A… Dance analysis program,
17 ... display part,
18 Touch input section
19 ... Imaging unit,
20 ... GPS receiver,
21 ... acceleration sensor,
22 ... Gyro sensor,
23 ... geomagnetic sensor,
24 ... operation unit,
25 ... vibrator,
26 ... Wireless communication unit,
27 ... NFC part,
28 external device interface (I / F),
29 ... GPS antenna,
30-32 ... antenna,
33… Headphone jack,
34 ... Micro USB terminal,
35 ... Memory card slot,
SB: System bus

Claims (12)

First recording control means for recording moving image data;
Timing detection means for detecting a preset timing for the digital music data,
An image processing apparatus, wherein the first recording control means records the moving image data together with information indicating the preset timing detected by the timing detection means.   The first recording control means compresses and encodes a moving image by inter-frame prediction to record the moving image data, and performs the inter-frame prediction at the preset timing detected by the timing detecting means. The image processing apparatus according to claim 1, wherein independent frame image data encoded without being used is recorded. Further comprising music playback means for playing back the digital music data,
The image processing device according to claim 1, wherein the timing detection unit detects a preset timing for the digital music data reproduced by the music reproduction unit. Second recording control means for compressing and encoding a moving image by inter-frame prediction and recording it as moving image data;
Comparing with the moving image data, comprising a timing information obtaining means for obtaining information indicating a preset timing for moving image data different from the moving image data,
When the timing of the information obtained by the timing information obtaining means arrives during the recording of the moving image data, the second recording control means sets an independent frame image encoded without using inter-frame prediction at the timing. An image processing device that records data. Timing detection means for detecting a preset timing for digital music data,
The first moving image data is recorded, and during the recording of the first moving image data, information indicating the preset timing detected by the timing detecting means is added to the first moving image data. First recording control means for recording incidentally;
Second recording control means for compressing and encoding a moving image by inter-frame prediction and recording the moving image as second moving image data different from the first moving image data;
Timing information acquisition means for acquiring information indicating the timing attached to the first moving image data,
When the timing of the information obtained by the timing information obtaining means arrives during the recording of the second moving image data, the second recording control means performs the encoding without using the inter-frame prediction at the timing. An image processing device that records independent frame image data.   The image processing apparatus according to claim 2, wherein the independent frame image data is one of an I (Intra-coded) frame image in a moving image and a still image associated with the moving image. Further comprising a music reproducing means for reproducing digital music data,
The image processing apparatus according to claim 4, wherein the timing information acquisition unit acquires information indicating a preset timing for music played by the music playback unit.   The image processing apparatus according to claim 4, wherein the timing information acquisition unit acquires information indicating a timing set in advance by a user. An image processing method in an image processing device,
A first recording control step of recording moving image data;
A timing detection step of detecting a preset timing for the digital music data,
The first recording control step is an image processing method for recording the moving image data together with information indicating the preset timing detected in the timing detection step. An image processing method in an image processing device,
A second recording control step of compressing and encoding a moving image by inter-frame prediction and recording as moving image data;
Compared with the moving image data, comprising a timing information obtaining step of obtaining information indicating a preset timing for moving image data different from the moving image data,
In the second recording control step, during the recording of the moving image data, when the timing of the information acquired in the timing information acquiring step comes, at the timing, an independent frame image encoded without using inter-frame prediction An image processing method that records data. A program to be executed by a computer incorporated in the image processing apparatus, the computer comprising:
First recording control means for recording moving image data,
Function as timing detection means for detecting a preset timing for digital music data,
A program, wherein the first recording control means records the moving image data together with information indicating the preset timing detected by the timing detection means. A program to be executed by a computer incorporated in the image processing apparatus, the computer comprising:
Second recording control means for compressing and encoding a moving image by inter-frame prediction and recording it as moving image data;
Compared with the moving image data, timing information acquisition means for acquiring information indicating a preset timing for moving image data different from the moving image data,
When the timing of the information obtained by the timing information obtaining means arrives during the recording of the moving image data, the second recording control means sets the independent frame image data encoded without using inter-frame prediction at the timing. To record the program.