JP4407549B2 - Shooting device, video playback device, video recording / playback program - Google Patents

Description

  The present invention relates to a photographing apparatus equipped with a function for photographing a moving picture, a moving picture reproducing apparatus, and a moving picture recording and reproducing program.

  Conventionally, in a recording / playback type digital camera, the posture (horizontal position, vertical position, etc.) of the camera body relative to the direction of gravity is detected, and the detected posture information of the camera body is recorded together with image data in the recording mode. Sometimes, a playback image is displayed on the monitor in an easy-to-view direction according to the recorded posture information (that is, the vertical position of the monitor is displayed so that the actual vertical position of the playback image substantially matches). .

  In a conventional digital camera having such a display function, when shooting is performed in a state where acceleration other than gravity is applied to the camera body, such as panning, the sensor may erroneously detect the posture of the camera body. If the tilt sensor erroneously detects the camera posture, the wrong posture information is recorded together with the image data, and the reproduced image is displayed on the monitor in a direction that is difficult to see in the reproduction mode.

In contrast, in the past, even when shooting with a non-gravity acceleration applied to the camera body, such as panning, if the acceleration is less than a predetermined value, the camera body posture information detected at the time of imaging is displayed. Recorded together with the captured image data, and by disabling the posture information when the acceleration is greater than or equal to a predetermined value, the reproduced image can always be displayed on the monitor in an easy-to-view orientation without erroneously detecting the posture of the camera body A digital camera that can be used is considered (for example, Patent Document 1).
JP 2001-197420 A

  As described above, in a conventional digital camera, acceleration acting on a camera device other than gravity is detected, and display control is performed using this acceleration so that a reproduced image can be easily viewed.

  However, conventionally, only display control for changing the orientation of a reproduced image with respect to a still image is performed, and acceleration detected at the time of shooting is not used for display control for a moving image.

  An object of the present invention is to provide a photographing device, a moving image reproducing device, and a moving image recording / reproducing program capable of recording / reproducing a moving image using acceleration acting on a device acquired at the time of moving image photographing.

  According to a first aspect of the present invention, there is provided a photographing means for photographing a moving image composed of a plurality of frame images, an acceleration obtaining means for obtaining an acceleration during moving image photographing by the photographing means, and an acceleration obtained by the acceleration obtaining means. And a frame adjusting unit that adjusts the number of frames of the moving image shot by the shooting unit, and a recording unit that records the moving image whose number of frames is adjusted by the frame adjusting unit.

  According to a second aspect of the present invention, in the first aspect of the invention, the frame adjustment unit thins out the frame image according to the acceleration acquired by the acceleration acquisition unit so that the moving image has a fast motion during reproduction. The number of frames is adjusted.

  According to a third aspect of the present invention, in the first aspect of the invention, the frame adjustment unit interpolates a frame image according to the acceleration acquired by the acceleration acquisition unit, so that a moving image with a slow motion is generated during reproduction. The number of frames is adjusted.

  According to a fourth aspect of the present invention, in the first aspect of the invention, when the speed acquisition unit that acquires the speed at the time of moving image shooting by the shooting unit and the speed acquired by the speed acquisition unit become zero, A stopping means for temporarily stopping the recording of the moving image by the recording means, and a moving image by the recording means when the speed acquired by the speed acquiring means changes when the recording of the moving image is temporarily stopped by the stopping means. And resuming means for resuming recording.

  The invention described in claim 5 shows an imaging unit that captures a moving image including a plurality of frame images, an acceleration acquisition unit that acquires an acceleration when the moving image is captured by the imaging unit, and an acceleration acquired by the acceleration acquisition unit. Recording means for recording acceleration data together with a moving picture taken by the photographing means, frame adjusting means for adjusting the number of frames of the moving picture according to the acceleration indicated by the acceleration data recorded in the recording means, and the frame And a moving image reproducing means for reproducing a moving image whose number of frames has been adjusted by the adjusting means.

  A sixth aspect of the invention is characterized in that, in the first or fifth aspect of the invention, the acceleration acquisition means acquires acceleration in the moving image shooting direction by the shooting means.

  According to a seventh aspect of the present invention, there is provided recording means for recording a moving image composed of a plurality of frame images and acceleration data indicating acceleration at the time of shooting the moving image, and acceleration indicated by the acceleration data recorded in the recording means. Accordingly, the apparatus includes a frame adjusting unit that adjusts the number of frames of the moving image and a moving image reproducing unit that reproduces the moving image whose number of frames is adjusted by the frame adjusting unit.

  The invention according to claim 8 is the invention according to claim 7, wherein the frame adjusting means thins out the frame image according to the acceleration indicated by the acceleration data recorded in the recording means, and moves quickly during reproduction. It is characterized by adjusting the number of frames so as to become a moving image.

  According to a ninth aspect of the invention, in the eighth aspect of the invention, the frame adjusting means interpolates a frame image according to the acceleration indicated by the acceleration data recorded in the recording means, and moves slowly during reproduction. It is characterized by adjusting the number of frames so as to become a moving image.

  The invention described in claim 10 is the invention described in claim 8, further comprising speed acquisition means for acquiring a speed at the time of shooting the moving image recorded in the recording means, wherein the reproduction means is controlled by the speed acquisition means. A stop unit for temporarily stopping the reproduction of the moving image when the acquired speed becomes zero, and a restarting unit for restarting the reproduction of the moving image when the speed acquired by the speed acquiring unit is changed. It is characterized by that.

  According to an eleventh aspect of the present invention, there is provided a computer mounted on the photographing apparatus, a photographing unit that photographs a moving image including a plurality of frame images, an acceleration obtaining unit that obtains an acceleration during moving image photographing by the photographing unit, and the acceleration. A frame adjusting unit that adjusts the number of frames of the moving image shot by the shooting unit according to the acceleration acquired by the acquiring unit; and a recording unit that records the moving image whose frame number is adjusted by the frame adjusting unit. It is characterized by that.

  According to a twelfth aspect of the present invention, there is provided a computer mounted on the photographing apparatus, a photographing unit that photographs a moving image including a plurality of frame images, an acceleration obtaining unit that obtains an acceleration during moving image photographing by the photographing unit, and the acceleration Recording means for recording acceleration data indicating the acceleration acquired by the acquisition means together with the moving image shot by the shooting means, and the number of frames of the moving image according to the acceleration indicated by the acceleration data recorded in the recording means. It is characterized by functioning as a frame adjusting means for adjusting and a moving picture reproducing means for reproducing a moving picture whose number of frames has been adjusted by the frame adjusting means.

  According to the first and eleventh aspects of the present invention, when a moving image composed of a plurality of frame images is captured, the moving acceleration of the device during moving image acquisition is acquired, and the number of frames of the moving image is adjusted according to the acceleration Thus, when the acceleration changes abruptly at the time of shooting and recording, the number of frames of the moving image can be changed to add a video effect such that a “fast moving image” or conversely a “slow moving image” is recorded. For example, if the acceleration is constant, the playback speed of the video is set to a constant speed, and if the speed decreases, the video gradually slows, and if the speed information increases, the video gradually increases. You can also

  According to the second aspect of the present invention, in addition to the effect of the first aspect of the invention, a video effect can be added so that a moving image has a fast motion during reproduction by thinning out the frame image according to the acceleration.

  According to the invention of claim 3, in addition to the effect of the invention of claim 1, by interpolating the frame image in accordance with the acceleration, it is possible to add a video effect so that a moving image with slow motion is produced during reproduction. .

  According to the fourth aspect of the present invention, in addition to the effect of the first aspect of the invention, when the moving speed of the apparatus at the time of photographing becomes zero, that is, when the moving state is stopped, the moving image recording is temporarily performed. By stopping and resuming recording when the speed starts to change, it is possible to shoot and record only moving images with changes.

  According to the fifth aspect of the present invention, when a moving image composed of a plurality of frame images is captured, the moving acceleration of the device at the time of capturing the moving image is acquired and recorded together with the moving image, and the moving image frame is recorded according to the acceleration. By adjusting the number, when the acceleration changes suddenly during recording, you can change the number of frames of the movie and add a video effect that makes it “fast movie” or conversely “slow movie” it can. For example, if the acceleration is constant, the playback speed of the video is set to a constant speed (same speed), and if the speed decreases, the video gradually slows, and if the speed information increases, the video gradually It can also be faster.

  According to the sixth aspect of the invention, in addition to the effect of the first or fifth aspect of the invention, the acceleration in the shooting direction of the moving image (that is, the direction in which the lens of the camera device faces directly) is acquired, for example. By capturing a moving image in the direction, it is possible to obtain a moving image in which the frame is adjusted according to the acceleration in the traveling direction.

  According to the seventh aspect of the present invention, by acquiring and recording a moving image composed of a plurality of frame images and acceleration data indicating the acceleration at the time of shooting the moving image, the moving image is recorded according to the recorded acceleration. By adjusting the number of frames, if the acceleration changes abruptly during shooting and recording, the number of frames of the movie is changed to add a video effect that makes it “fast movie” or conversely “slow movie”. Can do.

  According to the eighth aspect of the invention, in addition to the effect of the seventh aspect of the invention, by thinning out the frame image according to the acceleration, it is possible to add a video effect so that a moving image has a fast motion during reproduction.

  According to the ninth aspect of the invention, in addition to the effect of the seventh aspect of the invention, by interpolating the frame image in accordance with the acceleration, it is possible to add a video effect so that a moving image with slow motion is produced during reproduction. .

  According to the invention of claim 10, in addition to the effect of the invention of claim 7, when the speed at which the device at the time of shooting becomes zero, that is, when it is determined that the image was taken in a stopped state. The video playback is paused and resumed when the speed starts to change, so that the video can be played in accordance with the movement / stop change when the video is recorded.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing a functional configuration of a camera apparatus 1 (imaging apparatus) according to an embodiment of the present invention. The camera device 1 according to the present embodiment can be applied to an electronic still camera, a video camera, a mobile phone with a camera, an information communication terminal with a camera, and the like equipped with a function capable of recording and reproducing moving images as well as still images. is there.

  In the camera device 1 shown in FIG. 1, in the still image shooting mode for shooting a still image, the taking lens 11 moves to the lens position corresponding to the aperture position or normal shooting by driving the motor (M) 10 in the lens optical system. Is done. The photographing lens 11 is extended / stored by driving a motor (not shown) in accordance with the zoom operation. A CCD (Charge Coupled Device) 12, which is an image pickup device disposed behind the photographing optical axis of the photographing lens 11, is scanned and driven by a timing generator (TG) 13 and a vertical driver 14, and is formed at regular intervals. A photoelectric conversion output corresponding to is output for one screen.

  The photoelectric conversion output is appropriately gain-adjusted for each primary color component of RGB in the state of an analog value signal, sampled and held by a sample hold (S / H) circuit 15, and digital data by an A / D converter 16. The signal processing unit 17 performs color process processing including pixel interpolation processing and γ correction processing to generate digital luminance signals Y and color difference signals Cb and Cr, and a DMA (Direct Memory Access) controller. 18 is output.

  The DMA controller 18 once uses the luminance signal Y and the color difference signals Cb and Cr output from the signal processing unit 17 by using the composite synchronization signal, the memory write enable signal, and the clock signal from the signal processing unit 17 once. And the DMA transfer to the DRAM 21 used as a buffer memory through the DRAM interface (I / F) 20.

  The control unit 25 includes a CPU, a ROM in which operation programs executed by the CPU, data, and the like are fixedly recorded, a RAM used as a work memory, and the like, and controls the entire camera device 1. .

  After completing the DMA transfer of the luminance and color difference signals to the DRAM 21, the control unit 25 reads the luminance and color difference signals from the DRAM 21 via the DRAM interface 20 and writes them to the VRAM 27 via the VRAM controller 26.

  The digital video encoder 28 periodically reads luminance and color difference signals from the VRAM 27 via the VRAM controller 26, generates a video signal based on these data, and outputs the video signal to the display unit 29.

  The display unit 29 functions as a monitor display unit (electronic finder) in the shooting mode, and performs display based on the video signal from the digital video encoder 28 to display image information captured from the VRAM controller 26 at that time. The base image (through image) is displayed in real time.

  When a through image is displayed in real time on the display unit 29, a trigger signal is generated when the shutter key of the key input unit 37 is operated at the timing of capturing a still image.

  In response to this trigger signal, the control unit 25 stops driving the CCD 12 at that time, and then performs an automatic exposure process to obtain an appropriate exposure value, and controls the aperture of the lens optical system and the exposure time of the CCD 12. Re-capture the image.

  After the newly obtained image data for one frame is DMA-transferred and written in the DRAM 21 in this way, the control unit 25 reads out the image data for one frame written in the DRAM 21 and sends it to the compression / decompression unit 30. Forward. The compression / decompression unit 30 encodes the image data by JPEG (Joint Photographic Experts Group).

  The encoded image data is a non-volatile memory card 32 that is detachably mounted as a recording medium of the camera device 1, or a non-volatile memory that is fixedly built in the case where the memory card 32 is not mounted. It is written in the built-in memory 33.

  Then, with the completion of the writing of the image data to the memory card 32 or the built-in memory 33 for one frame, the control unit 25 resumes the drive for displaying the through image from the CCD 12 via the DRAM 21 on the display unit 29. .

  The control unit 25 is connected to a key input unit 37, an audio processing unit 40, a strobe driving unit 41, and an acceleration detection unit 46.

  The key input unit 37 includes a power key, a shutter key, a mode switch, a menu key, a selection key, a cross key (cursor key), and the like, and signals associated with these key operations are sent directly to the control unit 25. The

  The audio processing unit 40 includes a sound source circuit such as a PCM sound source, and digitizes the audio signal input from the microphone unit (MIC) 42 and inputs it as audio data when recording audio. The audio data input by the audio processing unit 40 is compressed by the compression / decompression unit 30 in accordance with a predetermined data file format, for example, the MP3 (MPEG-1 Audio Layer-3) standard to create an audio data file, and the memory card 32 Alternatively, it is recorded in the built-in memory 33. In addition, the audio data file read from the memory card 32 or the built-in memory 33 during audio reproduction is expanded by the compression / expansion unit 30 and converted into an analog signal by the audio processing unit 40. The sound processing unit 40 drives the speaker unit (SP) 43 to emit loud sounds.

  Furthermore, the sound processing unit 40 generates various operation sounds, for example, a pseudo shutter sound associated with the operation of the shutter key, a beep sound associated with the operation of other keys, and the like based on the control from the control unit 25. The sound is emitted from 43.

  The strobe drive unit 41 charges a large-capacitance capacitor for strobe (not shown) at the time of still image shooting, and then drives the strobe light emitting unit 45 to flash based on the control from the control unit 25.

  In addition, the camera device 1 according to the present embodiment is provided with a moving image shooting function. In the camera apparatus 1, the moving image shooting mode is set by operating a predetermined key provided in the key input unit 37. In the moving image shooting mode, when a shooting instruction is input by operating a release button (not shown), the camera device 1 starts acquiring moving image data (and audio data) at a predetermined cycle (moving image shooting) and moving image shooting. The acceleration detector 46 detects the acceleration acting on the device at the time. As the acceleration detection unit 46, for example, a piezoelectric element type acceleration sensor is used.

  For example, in moving image shooting, the CCD 12 performs sampling at a period (frame rate) of 1/30 sec to sequentially capture frame images, and the acceleration detector 46 acquires acceleration applied to the camera device 1 for every several frame images, for example. Is done.

  Moving image data (audio data) and acceleration data input at the time of moving image shooting are transferred to the compression / decompression unit 30, encoded by the compression / decompression unit 30, and recorded in the memory card 32 or the built-in memory 33. In the present embodiment, it is assumed that acceleration data is stored in synchronization with moving image data (audio data) (details will be described later (see FIG. 3)).

  In the configuration shown in FIG. 1, the acceleration detection unit 46 is provided to obtain acceleration data. However, a speed sensor is provided, and acceleration is obtained by calculation from the speed data detected by this sensor, or a displacement sensor is provided. It is also possible to provide a configuration in which acceleration is obtained by calculation from displacement data.

(First embodiment)
Next, the operation of the camera device 1 in the first embodiment will be described. In the first embodiment, based on the acceleration acquired during moving image shooting, display control (moving image editing) of the moving image shot at that time is executed and recorded / reproduced.

  First, the operation during moving image shooting will be described with reference to the flowchart shown in FIG.

  First, when moving image shooting is started (step A1), detection of acceleration acting on the camera device 1 at the time of moving image shooting is executed by the acceleration detection unit 46 (step A2), together with moving image shooting and sound recording. Input is executed. In shooting a moving image, the frame image is sequentially fetched by sampling by the CCD 12 at a predetermined frame rate (for example, 1/30 sec), and the frame image data is temporarily stored in the DRAM 21 (steps A3 and A4). In addition, when inputting sound, the sound input from the microphone unit 42 is acquired as sound data through the sound processing unit 40 and temporarily stored in the DRAM 21.

  On the other hand, effective vector / scalar detection is performed on the acceleration detected by the acceleration detector 46, and the direction and magnitude (acceleration value) of acceleration are temporarily stored in the DRAM 21 as acceleration data (steps A9 and A10). ). In the first embodiment, the acceleration detection unit 46 detects at least a certain direction in which the photographing lens 11 faces, that is, acceleration applied to the photographing direction. Further, not only the shooting direction but also accelerations in other directions (for example, up / down / left / right directions perpendicular to the shooting direction) may be detected. Which direction of acceleration is acquired and used depends on the purpose of display control (moving image editing) for the captured moving image, and an acceleration detecting unit 46 (displacement sensor) capable of detecting acceleration in a specific direction is provided. Alternatively, a displacement sensor that can detect displacement in multiple directions may be provided so that only the acceleration detected in the required direction is acquired as valid.

  The moving image data and audio data temporarily stored in the DRAM 21 are sent to the compression / decompression unit 30 and encoded (compressed), and the acceleration data temporarily stored in the DRAM 21 is embedded (multiplexed) so as to be synchronized. For example, the data in the stream format is written into the memory card 32 or the built-in memory 33 (step A11). In the configuration shown in FIG. 1, the storage destination of the moving image data is the memory card 32 or the built-in memory 33. However, a storage device with a larger capacity may be mounted to record and reproduce a moving image for a long time.

  The above processing is continuously executed until the end of shooting is instructed by operating a release switch (not shown), for example (step A12).

  FIG. 3 shows an example of a recording format in which acceleration is embedded in synchronization with moving image data. FIG. 3 shows an example in the case of MPEG format data. In MPEG, since video and audio are handled as independent objects, acceleration is also handled as an independent object so that it is recorded together with moving image data.

  That is, as shown in FIG. 3A, a file header (various file information), a video object (video header, actual data string), an audio object (audio header, actual data string), an acceleration object (acceleration header, actual data) Column / delimiter (information for synchronization)).

  FIG. 3B shows an example of a file format in which acceleration data (acceleration object) is embedded in synchronization with a time series of moving images (frame images).

  In the example shown in FIG. 3B, one acceleration data is embedded in the two-frame image. Each acceleration field of 1, 2, 3, 4... Of the acceleration object includes acceleration amount data. In addition, a delimiter code is embedded in “D” (between the fields 8 and 9) to prevent synchronization loss. The “acceleration header” includes information indicating the unit of acceleration / acceleration data per frame.

  Next, an operation for reproducing a file in which acceleration data is recorded together with moving image data will be described with reference to the flowchart shown in FIG.

  First, assume that a playback mode is set by a predetermined key operation of the key input unit 37, a playback target is selected from a file recorded in a recording device (memory card 32 or built-in memory 33), and playback execution is instructed. In response to this reproduction execution instruction, the control unit 25 reads the corresponding file and starts moving image reproduction (step B1).

  The control unit 25 determines whether or not acceleration data is embedded in the file selected as the reproduction target with reference to, for example, information included in the file header. If acceleration data is included (step B2, Yes), the acceleration data is read and temporarily stored prior to the moving image (video) and audio data (steps B3 and B4).

  Then, the encoded moving image data and audio data in the file are respectively decompressed (decoded) by the compression / decompression unit 30 (steps B5 and B9).

  Here, when the acceleration amount indicated by the acceleration data is positive (step B6, positive), that is, when a moving image is being shot while accelerating, the moving image editing is performed in which the frame image is thinned out according to the acceleration value. After that, it is displayed on the display unit 29 (steps B7 and B13).

  On the other hand, when the acceleration amount indicated by the acceleration data is negative (step B6, negative), that is, when a moving image is being shot while decelerating, the moving image editing is performed to interpolate the frame image according to the acceleration value. After that, it is displayed on the display unit 29 (steps B8 and B13).

  When there is no acceleration data and when the acceleration value indicated by the acceleration data is zero, the frame 29 is not subjected to frame thinning / interpolation and the moving image is displayed on the display unit 29 (step B13).

  FIG. 5A shows the change in acceleration indicated by the acceleration data embedded in the moving image data, and FIG. 5B shows the state of image editing (frame thinning, frame interpolation) corresponding to the acceleration. Yes.

  FIG. 5A shows a change in acceleration detected when, for example, moving images are shot while panning or moving closer to the subject at a relatively high speed, and a frame is displayed when the acceleration is positive (beginning of movement). The video editing is performed so that the movement of the subject in the video becomes faster by thinning out, and the motion of the subject in the video is slowed by interpolating the frame when the acceleration is negative (immediately before stopping) Video editing is performed.

  Frame interpolation is not simply copying and interpolating frames, but if frame signals are generated by calculation from inter-frame differences, such as even / odd field interpolation in double-density scanning, it is based on frame interpolation. Unnaturalness of moving images can be reduced.

  It should be noted that the number of frames to be thinned out or interpolated and the interval between them are determined by the acceleration value, the rate of change of acceleration, or what kind of video effect is applied.

  On the other hand, for audio data, the sign of the acceleration amount indicated by the acceleration data is discriminated in the same manner as described above (step B10), and audio modulation is applied to the audio data accordingly, and the speaker is passed through the audio processing unit 40. Output from the unit 43. For example, the length (and pitch) of the sound is adjusted so as to match the length of the moving image that is changed by interpolating / decimating the frame of the moving image data. Note that the voice may not be modulated in accordance with the amount of acceleration, but may be silenced so that it can be understood from the voice that the frame has been thinned out / interpolated.

  Thus, in accordance with the acceleration data embedded in synchronization with the moving image data, the reproduction of the moving image is continuously executed while thinning or interpolating the frame image. Then, when the reproduction stop is instructed by a key operation on the key input unit 37, or when the moving image file has been reproduced to the end (step B14, Yes), the reproduction process is terminated.

  Hereinafter, a specific example in the case of using the above-described processing will be described.

  For example, when shooting a movie while panning at a relatively high speed or moving closer to the subject, when the acceleration is positive, the movie is thinned out and played to make a fast-forward movie, making it dramatic. By adding the effect of exaggerating the movement, and interpolating the frame just before stopping, it is possible to make the moving picture slowly move so that the scene can be seen carefully.

  In the above description, the frame is thinned out when the acceleration acquired at the time of moving image shooting is positive, and the frame is interpolated when the acceleration is negative, but the reverse is also possible.

  In the above description, the acceleration is recorded together with the moving image data, and the display control is performed according to the acceleration at the time of reproduction. However, in the processing at the time of moving image shooting shown in the flowchart of FIG. Before writing to the storage device (step A11), the moving image editing process corresponding to the acceleration detected together with the moving image, that is, the moving image data (frame image) is recorded after frame thinning or frame interpolation as shown in the flowchart of FIG. You may make it do. In this case, the recorded moving image data can be reproduced in the same manner as general moving image data, thereby reproducing and outputting a moving image whose display is controlled according to the acceleration applied to the camera device 1 during moving image shooting. it can. Therefore, even if the acceleration data is not recorded together with the moving image data, the moving image can be reproduced using the acceleration acquired at the time of moving image shooting.

  In the above description, the acceleration data acquired at the time of shooting is recorded so as to be synchronized with the video and audio in time series independently of the video and audio data (FIG. 3B). )), Acceleration data may be recorded in other formats.

  For example, use a method of convolution recording with frequency modulation of audio data, a method of frequency modulation and convolution with an empty frequency region of moving image data, a method of recording with signal processing (digitizing) on an empty audio track, etc. Is also possible. In this case, a function for extracting acceleration data corresponding to each method is provided, and the function can be extracted during reproduction.

  The acceleration data is recorded in synchronization with the moving image data (sound data), but if the association is made with the moving image data (frame image), the acceleration data is recorded independently of the moving image data. You can also

  In the above description, the moving image shot by the camera device 1 is described as being reproduced and displayed on the own device. However, a moving image file in which acceleration data acquired at the time of moving image shooting is embedded is stored in the memory card 32, for example. It may be read by another moving image reproducing device via (or transmitted through a network) and reproduced and displayed by this moving image reproducing device. The moving image playback device reads and stores a moving image file from the memory card 32, and performs processing similar to the flowchart shown in FIG. 4 on the moving image file, thereby displaying the moving image file according to the acceleration acquired at the time of moving image shooting. Controlled (frame thinning, frame interpolation) moving images can be output.

(Second Embodiment)
Next, a second embodiment will be described. In the first embodiment, the acceleration acting on the camera device 1 at the time of moving image shooting is detected and display control (moving image editing) is performed according to the acceleration. However, in the second embodiment, the moving image is moved. The moving speed of the camera device 1 at the time of shooting is acquired, and display control based on this speed value is executed.

  In the configuration shown in FIG. 1, only the acceleration detection unit 46 for detecting acceleration is provided. In this configuration, the velocity value is obtained by calculating the time integration of the acceleration value detected by the acceleration detection unit 46. (The displacement value can be obtained by further time integration). It is also possible to provide a speed sensor by providing a speed value. Also, a displacement sensor can be provided, and the speed can be obtained by calculation based on the displacement value detected from this sensor.

  Next, an operation for reproducing a file in which acceleration data is recorded together with moving image data will be described with reference to the flowchart shown in FIG. Note that the creation of the moving image data file in which the acceleration data is embedded is executed in the same manner as in the first embodiment, and the description thereof is omitted. Further, in the flowchart of FIG. 6, only the reproduction of a moving image is described (the audio reproduction output is omitted).

  First, assume that a playback mode is set by a predetermined key operation of the key input unit 37, a playback target is selected from a file recorded in a recording device (memory card 32 or built-in memory 33), and playback execution is instructed. In response to this playback execution instruction, the control unit 25 reads the corresponding file and starts moving image playback (step C1).

  The control unit 25 determines whether or not acceleration data is embedded in the file selected as the reproduction target with reference to, for example, information included in the file header. Here, if acceleration data is included (step C2, Yes), the acceleration data is read prior to the moving image (video) data, and the speed data is calculated based on the acceleration data, acquired and temporarily stored. (Steps C3, C4, C5).

  Then, the encoded moving image data in the file is decompressed (decoded) by the compression / decompression unit 30 (step C6).

  Here, in accordance with the speed value indicated by the speed data, frame adjustment is performed by interpolating or thinning out the frame image (step C7). For example, when the speed is equal to or higher than a predetermined value, the frame is interpolated as the speed value is higher, and when the speed is lower than the predetermined value, the frame adjustment is executed so that the frame is thinned out as the speed is lower. In this way, the moving image editing by frame interpolation / decimation is executed and displayed on the display unit 29 (step C8).

  When there is no acceleration data and when the acceleration value indicated by the acceleration data is zero, the frame 29 is not thinned out / interpolated and the moving image as it is shot is displayed on the display unit 29 (steps C6 to C8). .

  FIG. 7A shows a change in speed at which the camera apparatus 1 moves during moving image shooting, and FIG. 7B shows a state of image editing (frame thinning, frame interpolation) according to the speed. Yes.

  FIG. 7A shows a change in speed when, for example, the speed is lowered from a relatively high speed state to go through a constant speed state and then further lowered to stop. In this case, the moving image editing is performed so that the motion of the moving image is constant over the entire moving image by interpolating the frame at the stage of the high speed state and thinning out the frame at the stage of the low speed state. Note that frame interpolation is performed in the same manner as in the first embodiment.

  If it is determined from the acceleration (or speed) data acquired from the moving image data that the moving image is shot at a speed of zero, that is, in a stopped state, FIG. 7B. As shown, all frames are thinned out. That is, the reproduction of the moving image is paused. Then, when it is determined that there is a change from the acceleration (or velocity) data acquired from the moving image data, the reproduction of the moving image is resumed. As a result, when the camera apparatus 1 is in a stopped state and is shooting a moving image that does not change, the moving image at the time of the stop can be prevented from being reproduced and output.

  Thus, the reproduction of the moving image is continuously executed while thinning out or interpolating the frame image in accordance with the speed calculated from the acceleration data embedded in synchronization with the moving image data. Then, when the reproduction stop is instructed by a key operation on the key input unit 37, or when the moving image file has been reproduced to the end (Yes in Step C9), the reproduction process is terminated.

  The process shown in the flowchart of FIG. 6 shows the case where the speed data is calculated and obtained based on the acceleration data embedded in the video data, but in the process shown in the flowchart of FIG. The moving speed of the camera device 1 during photographing may be acquired, the speed data may be embedded in the moving image data in the same manner as the acceleration data described above, the speed data may be read out, and the above-described processing may be executed.

  In the above description, the frame is interpolated when the speed at the time of moving image shooting is high, and the frame is thinned out when the speed is low, but the reverse is also possible.

  In the above description, the acceleration is recorded together with the moving image data, and the display control is performed according to the acceleration at the time of reproduction. However, in the processing at the time of moving image shooting shown in the flowchart of FIG. Before writing to the storage device (step A11), the moving image editing process corresponding to the speed acquired at the time of moving image shooting, that is, the frame adjustment (frame thinning / interpolation) described in the flowchart of FIG. ) May be recorded. In this case, the recorded moving image data can be reproduced and output in the same manner as general moving image data, whereby a moving image whose display is controlled according to the moving speed of the camera device 1 during moving image shooting can be reproduced. . Therefore, even if acceleration data (or velocity data) is not recorded together with moving image data, it is possible to reproduce the moving image using the speed acquired at the time of moving image shooting.

  When recording video data after performing video editing processing according to the speed, video recording is paused and video recording is paused when the speed acquired during video recording becomes zero. When the speed changes, the recording of the movie is resumed. As a result, a moving image that is shot when stopped is not recorded, and a moving image that skips that portion can be reproduced during reproduction.

  Further, in the same manner as in the first embodiment, not only the camera device 1 reproduces but also a moving image can be reproduced and output by another moving image reproducing device.

  Hereinafter, a specific example in the case of using the above-described processing will be described.

(1) Virtual route guidance
For example, a moving image file that captures the scenery of the route to the home is passed to another person so that the other person can follow the route to the home while playing the moving image.

  In this case, even if the moving speed at the time of moving image fluctuation varies, as described in the second embodiment, the frame image is interpolated when the speed increases, and the frame image is thinned when the speed decreases. In addition, when the video is paused, the video recording is stopped (or skipped during playback), so that it is possible to provide a video that is captured while proceeding at a constant speed throughout the entire process.

  The other person who receives the video walks along the road while watching the video of the scenery of the route. There may be a difference between the scenery that the other person actually sees and the scenery of the video display. At this time, the function that the other person can correct the deviation of the video (specifically, frame advance / rewind) If this is provided in the video playback device, there is no problem. Eventually, the other person can reach the photographer's home by tracing the exact same route as the photographer of the video, while still tracing.

(2) High speed video
For example, a moving image shot in a total of 2 hours over a drive distance of 100 km is digest-recorded at high speed by thinning out frame images. When 2 hours are compressed into 10 minutes and played back, it can be recorded as a 12 × moving image. However, even if it is a high-speed movie, it stops when waiting for a signal, etc., so the motion on the movie stops and the part becomes redundant, so if the detection speed at the time of shooting reaches zero, record the movie. Instead, pause. In addition, frame images are thinned out (speed adjustment) according to the amount of acceleration / speed change, that is, by increasing the number of frame images to be thinned out at low speed / deceleration, the process is always photographed at a high speed at a constant speed. It becomes possible.

(3) Simple pedometer (registered trademark) / distance meter
For example, it is assumed that a moving image is taken while walking or from the vehicle. At this time, since the displacement amount (total travel distance) can be calculated from the acceleration, the walking distance and travel distance can be easily obtained by embedding and recording the acceleration in the moving image data at the time of moving image shooting as described above. be able to. At this time, if the high-speed recording shown in “(2) High-speed moving image” described above is performed, it is possible to avoid a large-capacity moving image even when recording for a long time, so that it can be used as a memo. And at the time of reproduction | regeneration of a moving image, the displacement amount (walking distance, running distance) calculated from acceleration data can be displayed simultaneously, and a displacement amount can be shown with the change of a moving image.

  In the above description, the video recording / playback is paused when the speed becomes zero, and the video shooting / playback is resumed when the speed changes. An operation means for canceling the state and restarting shooting / playback of the moving image may be provided.

  In the above description, in the movie shooting mode, the acceleration (speed, displacement) at the time of movie shooting is detected and recorded together with the movie data. However, the acceleration (speed, displacement) at the time of movie shooting is described. It may be possible for the operator to arbitrarily set in advance whether or not to perform the operation of detecting and recording.

  In the above description, the frame adjustment such as the thinning / interpolation of the image frame is executed according to the acceleration (or speed, displacement), but the detected acceleration value is set to a predetermined value. If the value does not change more than the threshold value, the moving image playback speed may not be changed without adjusting the frame.

  In addition, a moving image reproduction program that can be executed by a computer mounted on the camera apparatus 1 is written in a recording medium such as a magnetic disk (flexible disk, hard disk, etc.), an optical disk (CD-ROM, DVD, etc.), a semiconductor memory, etc. Or through a communication medium. By controlling the operation of the computer by the moving image reproduction program, the functions in the above-described embodiments can be realized in the camera device 1.

The block diagram which shows the function structure of the camera apparatus 1 (imaging device) in embodiment of this invention. The flowchart for demonstrating the operation | movement at the time of the video recording in 1st Embodiment. The figure which shows an example of the recording format which embeds the acceleration in 1st Embodiment synchronizing with moving image data. The flowchart for demonstrating operation | movement in the case of reproducing | regenerating the file which recorded acceleration data with the image data in 1st Embodiment. The figure which shows the mode of the image change (frame thinning | decimation, frame interpolation) according to the change of the acceleration which the acceleration data embedded in the moving image data in 1st Embodiment show, and acceleration. The flowchart for demonstrating operation | movement in the case of reproducing | regenerating the file which recorded acceleration data with the moving image data in 2nd Embodiment. The figure which shows the mode of the speed change of the camera apparatus 1 at the time of video recording in 2nd Embodiment, and the state of the image edit (a frame thinning | decimation, frame interpolation) according to speed.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Camera apparatus, 10 ... Motor (M), 11 ... Shooting lens, 12 ... CCD, 13 ... Timing generator (TG), 14 ... Vertical driver, 15 ... Sample hold circuit (S / H), 16 ... A / D converter, 17 ... signal processing unit, 18 ... DMA controller, 20 ... DRAM interface (I / F), 21 ... DRAM, 25 ... control unit, 26 ... VRAM controller, 27 ... VRAM, 28 ... digital video encoder, 29 Display unit 30 Compression / decompression unit 32 Memory card 33 Internal memory 37 Key input unit 40 Sound processing unit 41 Strobe drive unit 42 Microphone unit (MIC) 43 Speaker unit (SP), 45 ... Strobe light emitting part, 46 ... Acceleration detecting part.

Claims (12)

Photographing means for photographing a moving image composed of a plurality of frame images;
Acceleration acquisition means for acquiring acceleration during moving image shooting by the shooting means;
A frame adjusting unit that adjusts the number of frames of the moving image shot by the shooting unit according to the acceleration acquired by the acceleration acquiring unit;
An imaging apparatus comprising: a recording unit that records a moving image whose number of frames is adjusted by the frame adjusting unit. The frame adjusting means includes
2. The photographing apparatus according to claim 1, wherein frame images are thinned according to the acceleration acquired by the acceleration acquisition means, and the number of frames is adjusted so that a moving image has a fast motion during reproduction. The frame adjusting means includes
2. The photographing apparatus according to claim 1, wherein a frame image is interpolated according to the acceleration acquired by the acceleration acquisition means, and the number of frames is adjusted so that a moving image having a slow motion is produced during reproduction. Speed acquisition means for acquiring a speed at the time of moving image shooting by the shooting means;
When the speed acquired by the speed acquisition means becomes zero, stop means for temporarily stopping the recording of the moving image by the recording means,
When the recording of the moving image is temporarily stopped by the stopping means, the recording apparatus further comprises a restarting means for resuming recording of the moving image by the recording means when the speed acquired by the speed acquiring means changes. The imaging apparatus according to claim 1. Photographing means for photographing a moving image composed of a plurality of frame images;
Acceleration acquisition means for acquiring acceleration during moving image shooting by the shooting means;
Recording means for recording acceleration data indicating the acceleration obtained by the acceleration obtaining means together with the moving image photographed by the photographing means;
Frame adjusting means for adjusting the number of frames of the moving image according to the acceleration indicated by the acceleration data recorded in the recording means;
An imaging apparatus comprising: a moving image reproducing unit that reproduces a moving image whose number of frames is adjusted by the frame adjusting unit.   6. The photographing apparatus according to claim 1, wherein the acceleration obtaining unit obtains an acceleration with respect to a moving image photographing direction by the photographing unit. Recording means for recording a moving image composed of a plurality of frame images and acceleration data indicating acceleration at the time of shooting the moving image;
Frame adjusting means for adjusting the number of frames of the moving image according to the acceleration indicated by the acceleration data recorded in the recording means;
A moving image reproducing apparatus comprising: a moving image reproducing unit that reproduces a moving image whose number of frames is adjusted by the frame adjusting unit. The frame adjusting means includes
8. The moving image reproduction according to claim 7, wherein the frame image is thinned out in accordance with the acceleration indicated by the acceleration data recorded in the recording means, and the number of frames is adjusted so that the moving image has a fast motion during reproduction. apparatus. The frame adjusting means includes
8. The moving image reproduction according to claim 7, wherein a frame image is interpolated according to the acceleration indicated by the acceleration data recorded in the recording means, and the number of frames is adjusted so that a moving image having a slow motion is produced during reproduction. apparatus. It further comprises speed acquisition means for acquiring the speed at the time of shooting the moving image recorded in the recording means,
The reproducing means includes
Stop means for temporarily stopping playback of the video when the speed acquired by the speed acquisition means becomes zero;
8. The moving image reproducing apparatus according to claim 7, further comprising a restarting unit that restarts reproduction of the moving image when the speed acquired by the speed acquiring unit changes. The computer installed in the imaging device
Photographing means for photographing a moving image composed of a plurality of frame images;
Acceleration acquisition means for acquiring acceleration during moving image shooting by the shooting means;
A frame adjusting unit that adjusts the number of frames of the moving image shot by the shooting unit according to the acceleration acquired by the acceleration acquiring unit;
A moving picture recording / reproducing program that functions as a recording means for recording a moving picture whose number of frames has been adjusted by the frame adjusting means. The computer installed in the imaging device
Photographing means for photographing a moving image composed of a plurality of frame images;
Acceleration acquisition means for acquiring acceleration during moving image shooting by the shooting means;
Recording means for recording acceleration data indicating the acceleration obtained by the acceleration obtaining means together with the moving image photographed by the photographing means;
Frame adjusting means for adjusting the number of frames of the moving image according to the acceleration indicated by the acceleration data recorded in the recording means;
A moving image recording / reproducing program that functions as a moving image reproducing unit that reproduces a moving image whose number of frames is adjusted by the frame adjusting unit.

Images