JP4022688B2 - Electronic camera capable of shooting movies - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an electronic camera, and more particularly to a technique for using GPS (Global Positioning System) in an electronic camera capable of shooting a moving image such as a digital camera or a video camera with a moving image shooting function.
[0002]
[Prior art]
Many camera systems that use GPS have been proposed. For example, Patent Document 1 discloses a system that acquires information on a shooting location using GPS, converts the position information into address data, and prints it together with an image.
[0003]
[Patent Document 1]
JP 20001-61089 A
[0004]
[Problems to be solved by the invention]
However, conventional proposals are mainly for still image shooting systems, and few proposals have been made regarding methods of using GPS information during moving image shooting.
[0005]
The present invention has been made in view of such circumstances, and proposes a new use form of GPS information at the time of moving image shooting, and provides an electronic camera that can realize recording and reproduction of moving images with a sense of reality. Objective.
[0006]
[Means for Solving the Problems]
In order to achieve the above object, an electronic camera capable of shooting a moving image according to the present invention includes an imaging unit that converts an optical image of a subject into an electrical signal, and images obtained by continuously shooting the subject using the imaging unit. An electronic camera having a recording means for recording a moving image as a moving image, and determining at least one of a moving speed and a moving direction from information acquired via a GPS receiver that receives radio waves from a GPS satellite Signal processing means, and synthesis means for synthesizing at least one of the movement speed and the movement direction obtained by the signal processing means with a photographed image are provided.
[0007]
According to the present invention, an information radio wave is received from a GPS satellite during moving image shooting, and position information of a photographer (that is, an electronic camera) is acquired by a GPS receiving device provided in the camera or provided externally. Based on a plurality of pieces of position information acquired at certain time intervals, movement information of at least one of the movement speed and movement direction of the electronic camera is calculated by the signal processing means. The movement information obtained in this way is synthesized in the photographed image by the synthesizing means and recorded on the recording medium, or displayed on the display means. Of course, the recording and display of the captured image may be performed simultaneously.
[0008]
The present invention is particularly effective when shooting a moving image while moving, and at the time of shooting or playback, information such as the moving speed and moving direction at the time of shooting is displayed together with the shot image, so there is a sense of presence. You can watch the video.
[0009]
As a calculation procedure of movement information in the signal processing means, for example, information is read from the GPS at regular time intervals, latitude and longitude are calculated from the obtained data, and the previously obtained latitude / longitude and the currently obtained latitude / The moving direction and moving distance are calculated from the longitude, and the moving speed is calculated from the moving distance and the lead interval.
[0010]
According to one aspect of the present invention, the moving information is combined with the moving image data acquired from the imaging unit, and moving image data including a frame with the moving information combined is recorded on the recording medium. Features.
[0011]
In addition to the above-described configuration, the electronic camera capable of shooting a moving image according to the present invention preferably includes a display unit that displays a moving image synthesized with the movement information.
[0012]
According to still another aspect of the present invention, the GPS receiver is an external unit separable from the camera body.
[0013]
With respect to GPS receivers, technological progress in this field is remarkable, and new products are frequently put on the market. Therefore, in the present invention, the GPS receiver is an external unit, and the signal from the GPS receiver is sent to the camera side. By installing the receiving interface unit, there is an advantage that it is possible to easily cope with version upgrade of the GPS receiver. In addition, for users who do not use GPS, it is possible to select not to purchase a GPS receiver, and the price of the camera body can be reduced.
[0014]
DETAILED DESCRIPTION OF THE INVENTION
A preferred embodiment of an electronic camera capable of shooting a moving image according to the present invention will be described in detail below with reference to the accompanying drawings.
[0015]
FIG. 1 is a block diagram showing a configuration of an electronic camera according to an embodiment of the present invention. The camera 10 is a digital camera having a recording and playback function of a moving image with sound, and the operation of the entire camera 10 is centrally controlled by a central processing unit (CPU) 12. The CPU 12 functions as a control unit that controls the camera system according to a predetermined program, and also functions as a calculation unit that performs various calculations such as automatic exposure (AE) calculation, automatic focus adjustment (AF) calculation, moving speed and moving direction. To do.
[0016]
A ROM 16 connected to the CPU 12 via the bus 14 stores programs executed by the CPU 12, various data necessary for control, and the like. The memory (SDRAM) 18 is used as a program development area and a calculation work area for the CPU 12, and is also used as a temporary storage area for image data and audio data. Note that the ROM 16 which is a nonvolatile storage means may be rewritable or may be rewritable like an EEPROM.
[0017]
The camera 10 is provided with a mode selection switch 20, a shooting button 21, and other operation means 22 such as a menu / OK key, a cross key, and a cancel key. Signals from these various operation units (20 to 22) are input to the CPU 12, and the CPU 12 controls each circuit of the camera 10 based on the input signals. For example, lens drive control, shooting operation control, image processing control, image Data recording / reproduction control, display control of the image display device 24, and the like are performed.
[0018]
The mode selection switch 20 is an operation means for switching between the shooting mode and the playback mode. When the mode selection switch 20 is operated to connect the movable contact piece 20A to the contact a, the signal is input to the CPU 12, and the camera 10 is set to a photographing mode capable of recording an image. On the other hand, when the movable contact piece 20A is connected to the contact b, the camera 10 is set to the “reproduction mode” for reproducing the recorded image.
[0019]
The shooting button 21 is an operation button for inputting an instruction to start shooting. The shooting button 21 functions as a recording start (start) / stop (stop) button in moving image shooting, and functions as a release button in still image shooting. The photographing button 21 is composed of a two-stroke switch having an S1 switch that is turned on when half-pressed and an S2 switch that is turned on when fully pressed.
[0020]
The menu / OK key is an operation having both a function as a menu button for instructing to display a menu on the screen of the image display device 24 and a function as an OK button for instructing confirmation and execution of selection contents. Key. The cross key is an operation unit for inputting instructions in four directions, up, down, left, and right, and functions as a button (cursor moving operation means) for selecting an item from a menu screen or instructing selection of various setting items from each menu. The up / down key of the cross key functions as a zoom switch at the time of shooting or a playback zoom switch at the time of playback, and the left / right key functions as a frame advance (forward / reverse feed) button in the playback mode. The cancel key is used to delete a desired object such as a selection item, cancel an instruction content, or return to the previous operation state.
[0021]
The image display device 24 is composed of a liquid crystal display capable of color display. The image display device 24 can be used as an electronic viewfinder for checking the angle of view at the time of shooting, and is used as a means for reproducing and displaying a recorded image. The image display device 24 is also used as a user interface display screen, and displays information such as menu information, selection items, and setting contents as necessary. Instead of the liquid crystal display, other types of display devices (display means) such as an organic EL can be used.
[0022]
The camera 10 has two media sockets (media mounting portions) 26 and 28, and the same type or different types of recording media 30 can be mounted in the media sockets 26 and 28, respectively. The form of the recording medium 30 is not particularly limited, and various media such as a semiconductor memory card represented by SmartMedia (trademark), a portable small hard disk, a magnetic disk, an optical disk, and a magneto-optical disk can be used.
[0023]
In this example, it is assumed that the recording medium 30 is attached to the first media socket 26 and the GPS device 32 is attached to the second media socket 28. In implementing the present invention, the number of media sockets is not particularly limited. The means for recording the image data is not limited to the removable medium, but may be a recording medium (internal memory) built in the camera 10.
[0024]
The media controller 33 performs necessary signal conversion in order to deliver an input / output signal suitable for the recording medium 30 or the GPS device 32 attached to the media sockets 26 and 28.
[0025]
The GPS device 32 is a portable GPS receiving unit with a built-in GPS receiver, and has a structure that is detachable from the media socket 28 of the camera 10 body. When the GPS device 32 is attached to the media socket 28, the CPU 12 detects this and sends a command to the GPS control circuit 34. The GPS control circuit 34 controls the GPS device 32 in accordance with a command from the CPU 12 and performs processing for receiving radio waves from GPS satellites.
[0026]
The signal obtained from the GPS device 32 is sent to the GPS position conversion circuit 36 where it is converted into position information (latitude and longitude information). The position information generated by the GPS position conversion circuit 36 is sent to the CPU 12 where the moving speed and moving direction are calculated.
[0027]
The camera 10 also includes a USB interface unit 37 as a communication means for connecting to a personal computer or other external device. By connecting the camera 10 and an external device using a USB cable (not shown), it is possible to exchange data with the external device. A mode in which a GPS device connected to the USB interface unit 37 is used instead of the GPS device 32 attached to the media socket 28 shown in FIG. 1 is also possible. Of course, the communication method is not limited to USB, and IEEE1394, Bluetooth, or other communication methods may be applied.
[0028]
Next, the shooting function of the camera 10 will be described.
[0029]
When the shooting mode is selected by the mode selection switch 20, power is supplied to an imaging unit including a CCD solid-state imaging device (hereinafter referred to as a CCD) 38, and a shooting is possible.
[0030]
The lens unit 40 is an optical unit including a photographic lens and a mechanical shutter combined with an aperture. The lens unit 40 is electrically driven by motor drivers 42 and 43 controlled by the CPU 12 to perform zoom control, focus control, and iris control.
[0031]
The light that has passed through the lens unit 40 is imaged on the light receiving surface of the CCD 38. A large number of photodiodes (light receiving elements) are two-dimensionally arranged on the light receiving surface of the CCD 38, and red (R), green (G), and blue (B) primary color filters corresponding to the respective photodiodes. They are arranged in a predetermined arrangement structure (Bayer, G stripe, etc.). The CCD 38 has an electronic shutter function for controlling the charge accumulation time (shutter speed) of each photodiode. The CPU 12 controls the charge accumulation time in the CCD 38 via the timing generator 44. Instead of the CCD 38, another type of image sensor such as a MOS type may be used.
[0032]
The subject image formed on the light receiving surface of the CCD 38 is converted into a signal charge of an amount corresponding to the amount of incident light by each photodiode. The signal charge accumulated in each photodiode is sequentially read out as a voltage signal (image signal) corresponding to the signal charge based on a drive pulse supplied from the timing generator 44 in accordance with a command from the CPU 12.
[0033]
The signal output from the CCD 38 is sent to the analog processing unit 46, where the R, G, B signals for each pixel are sampled and held (correlated double sampling processing), amplified, and then A / D converter 47. Added to. The A / D converter 47 converts R, G, B signals that are sequentially input into digital signals and outputs them to the image input controller 48.
[0034]
The image signal processing circuit 50 processes a digital image signal input via the image input controller 48 in accordance with a command from the CPU 12. That is, the image signal processing circuit 50 is a synchronization circuit (a processing circuit that interpolates a spatial shift of the color signal associated with the color filter arrangement of the single-plate CCD and converts the color signal into a simultaneous expression), and generates a luminance / color difference signal. It functions as an image processing means including a circuit, a gamma correction circuit, a contour correction circuit, a white balance correction circuit, etc., and performs predetermined signal processing using the memory 18 in accordance with commands from the CPU 12.
[0035]
The RGB image data input to the image signal processing circuit 50 is converted into a luminance signal (Y signal) and a color difference signal (Cr, Cb signal) by the image signal processing circuit 50 and subjected to predetermined processing such as gamma correction. Applied. The image data processed by the image signal processing circuit 50 is stored in the memory 18.
[0036]
When a captured image is output to the image display device 24 on a monitor, image data is read from the memory 18 and sent to the video encoder 52 via the bus 14. The video encoder 52 converts the input image data into a predetermined display signal (for example, an NTSC color composite video signal) and outputs the converted signal to the image display device 24.
[0037]
The image data in the memory 18 is periodically rewritten by the image signal output from the CCD 74, and a video signal generated from the image data is supplied to the image display device 24. It is displayed on the display device 24. The photographer can check the shooting angle of view from the video (through movie image) displayed on the image display device.
[0038]
When the shooting button 21 is pressed and the S1 switch is turned on, the camera 10 starts AE and AF processing. That is, the image signal output from the CCD 38 is input to the AF detection circuit 54 and the AE / AWB detection circuit 55 via the image input controller 48 after A / D conversion.
[0039]
The AE / AWB detection circuit 55 includes a circuit that divides one screen into a plurality of areas (for example, 8 × 8) and accumulates RGB signals for each divided area, and provides the accumulated value to the CPU 12. The CPU 12 detects the brightness of the subject (subject brightness) based on the integrated value obtained from the AE / AWB detection circuit 55, and calculates an exposure value (shooting EV value) suitable for shooting. According to the obtained exposure value and a predetermined program diagram, the aperture value and the shutter speed are determined, and the CPU 12 controls the electronic shutter and iris of the CCD 38 according to this to obtain an appropriate exposure amount.
[0040]
The AE / AWB detection circuit 55 calculates an average integrated value for each color of the RGB signals for each divided area and provides the calculation result to the CPU 12. The CPU 12 obtains the integrated value of R, the integrated value of B, and the integrated value of G, obtains the ratio of R / G and B / G, and takes these R / G and B / G values and the shooting EV by AE calculation. Scene discrimination (light source type discrimination) is performed based on the value information, and each ratio value is approximately 1 (that is, the RGB integration ratio is R: G on one screen) according to a predetermined white balance adjustment value suitable for the scene. : The gain of the white balance adjustment circuit is controlled so as to satisfy B≈1: 1: 1), and the signal of each color channel is corrected. In scene discrimination, color temperature information such as RY and BY may be used instead of using the values of R / G and B / G.
[0041]
In the AF control in the camera 10, for example, a contrast AF that moves a focusing lens (a moving lens that contributes to focus adjustment among lens optical systems constituting a photographing lens) so that a high-frequency component of a G signal of a video signal is maximized. Applied. That is, the AF detection circuit 54 cuts out a signal in a focus target area set in advance in a high-pass filter that passes only a high-frequency component of the G signal, an absolute value processing unit, and a screen (for example, the center of the screen). An area extraction unit and an integration unit that integrates absolute value data in the AF area are configured.
[0042]
The integrated value data obtained by the AF detection circuit 54 is notified to the CPU 12. The CPU 12 calculates a focus evaluation value (AF evaluation value) at a plurality of AF detection points while moving the focusing lens by controlling the motor driver 43 for driving the AF motor, and aligns the lens position where the evaluation value becomes the maximum. Determine as the focal position. Then, the motor driver 43 is controlled so as to move the focusing lens to the obtained in-focus position. The calculation of the AF evaluation value is not limited to a mode using the G signal, and a luminance signal (Y signal) may be used.
[0043]
When the shooting button 21 is pressed, AE / AF processing is performed with S1 = ON, and a recording shooting operation starts with S2 = ON. The image data obtained in response to S2 = ON is converted into a luminance / color difference signal (Y / C signal) by the image signal processing circuit 50, and after being subjected to predetermined processing such as gamma correction, it is stored in the memory 18. Is done.
[0044]
The Y / C signal stored in the memory 18 is compressed according to a predetermined format by the compression / decompression circuit 56 and then recorded on the recording medium 30 via the media controller 33. For example, a still image is recorded in JPEG (Joint Photographic Experts Group) format, and a moving image is recorded in motion JPEG format.
[0045]
In the motion JPEG method, the image data acquired from the CCD 38 is temporarily stored in the internal memory 18, and then converted into luminance / color difference signals (Y / C signals) by the image signal processing circuit 50, and JPEG compression is performed within one image. However, still images are continuously stored in the external recording medium 30 at a constant frame rate (for example, 30 frames / second).
[0046]
The file format of the moving image is not limited to motion JPEG, and other file formats such as MPEG may be applied. In the case of the MPEG system, recording is continuously performed on the external recording medium 30 while performing intra-frame compression and inter-frame compression.
[0047]
During moving image shooting, so-called “mountain climbing” continuous AF processing (continuous AF) is performed. That is, the focusing lens is slightly moved back and forth along the optical axis, and the focusing lens is gradually moved to the maximum point of the AF evaluation value while checking the increase / decrease direction of the focus evaluation value.
[0048]
The sound at the time of moving image shooting is detected by the microphone 60, and the detection signal (audio signal) is converted into a digital signal by the A / D converter 62 and sent to the audio signal processing circuit 64. The audio signal processing circuit 64 is connected to the bus 14 and converts audio data into a predetermined signal format in accordance with an instruction from the CPU 12 while using the memory 18. The audio data generated in this way is stored in the memory 18, compressed by the compression / decompression circuit 56 together with the image data, and then recorded on the recording medium 30.
[0049]
When the shooting button 21 is pressed again (S1 = ON) after the start of recording, the recording operation is stopped. In addition, there are a mode in which the recording operation is performed while the shooting button 21 is continuously pressed and the recording is stopped by releasing the pressing, or a mode in which the recording is automatically stopped at a certain time after the recording is started.
[0050]
When the playback mode is selected by the mode selection switch 20, the compressed data of the last image file (last recorded file) recorded on the recording medium 30 is read. When the file related to the last recording is a still image file, the read image compressed data is decompressed to an uncompressed YC signal via the compression / decompression circuit 56, and via the image signal processing circuit 50 and the video encoder 52. After being converted into a display signal, it is output to the image display device 24. As a result, the image content of the file is displayed on the screen of the image display device 24.
[0051]
When the reproduction target file is a moving image file, the first frame of the moving image is displayed as a representative image, and a screen for accepting an instruction to start moving image reproduction is displayed. When a predetermined operation (for example, pressing the down key of the cross key) is performed from the operation unit in a state where the first frame of the moving image is displayed, the moving image file reproduction processing starts and the moving image is displayed on the image display device 24. At the same time, the audio data reproduced by the audio signal processing circuit 64 is output to the speaker 68 via the D / A converter 66, and the audio recorded together with the moving image is also reproduced.
[0052]
During single-frame playback of a still image (including playback of the first frame of a moving image), the file to be played is switched by operating the right or left key of the four-way controller (forward / reverse frame advance). Can do. The image file at the frame-advanced position is read from the recording medium 30, and still images and moving images are reproduced and displayed on the image display device 24 in the same manner as described above.
[0053]
Next, a method of using GPS information in the camera 10 of this example will be described.
[0054]
The camera 10 acquires information from the GPS device 32 at regular time intervals during moving image shooting, and information on the moving speed and moving direction of a moving object such as a photographer moving with the camera 10 or a vehicle on which the camera 10 is mounted. (Hereinafter collectively referred to as movement information) is provided with means for recording together with moving image data.
[0055]
As described above, the signal obtained from the GPS device 32 is converted into position information by the GPS position conversion circuit 36, and the moving speed and moving direction are calculated by the CPU 12 based on this position information. As shown in FIG. 2, the image signal processing circuit 50 generates at least one of a character signal and a graphic signal (hereinafter referred to as a movement information signal) for displaying movement information on the screen of the photographed image. A movement information signal generation circuit 72 and a synthesis processing circuit 76 that combines the movement information signal generated by the movement information signal generation circuit 72 with the captured image signal 74 are included.
[0056]
The movement speed and movement direction data calculated by the CPU 12 are sent to the image signal processing circuit 50, and a movement information signal generation circuit 72 generates a movement information signal based on the data. The generated movement information signal is sent to the synthesis processing circuit 76 and synthesized with the captured image signal 74. At this time, the movement information signal is synthesized at a designated position in the screen. The CPU 12 controls the operation of the synthesis processing circuit 76 by sending a control signal for commanding ON / OFF of the synthesis processing operation in the synthesis processing circuit 76 and a control signal for designating the synthesis position of the movement information signal to the synthesis processing circuit 76. .
[0057]
FIG. 3 shows an example of composition of movement information. In FIG. 3, information 81 indicating the moving direction is added to the lower left corner of the screen of the captured image 80, and information 82 indicating the moving speed is added to the lower right corner of the screen. The moving direction information 81 visually presents the direction in which the center point 84 of the shooting screen is directed, and is displayed as a figure imitating a compass. The moving speed information 82 is numerically displayed by characters.
[0058]
When GPS information is periodically acquired during moving image shooting, the moving direction information 81 and the moving speed information 82 are updated as needed. Of course, the display form of the information is not limited to the example of FIG. 3, an aspect in which the moving direction is displayed in characters, an aspect in which the moving speed is displayed by a figure imitating a speed meter, and a display in which characters and figures are combined Appropriate changes such as aspects can be made.
[0059]
In addition, the display positions of the movement direction information 81 and the movement speed information 82 in the screen can be appropriately specified by the user. As a display position designation method, a configuration in which a desired position is selected from candidates for display positions prepared in advance or a configuration in which an arbitrary position is designated in the screen may be used. Further, it is also preferable to provide a plurality of movement information display patterns (forms) so that the display method can be changed according to the user's selection.
[0060]
For example, a configuration that accepts selection of display contents such as “display only the moving direction” / “display only the moving speed” / “display both” is possible. There is also a configuration that accepts selection of character color and font for speed display, and unit selection such as “hourly speed” / “minute speed” / “second speed” or “km” / “mile”.
[0061]
The camera 10 has a mode ("GPS information mode") in which moving information is added and recorded to the captured moving image data, a mode ("normal moving image mode") in which moving image data is recorded without adding movement information, The user can select a desired mode using a predetermined user interface such as a menu screen. The user can perform moving image shooting by properly using the “GPS information mode” and the “normal moving image mode” as necessary.
[0062]
Next, the operation of the camera 10 configured as described above will be described.
[0063]
FIG. 4 is a flowchart showing an operation sequence at the time of moving image shooting in the camera 10. When the moving image shooting mode starts, the CPU 12 of the camera 10 first determines whether or not the GPS information mode is set to ON (step S110). If the GPS information mode is OFF in step S110, the process proceeds to step S112 to shift to a normal moving image mode that does not use GPS information.
[0064]
On the other hand, if the GPS information mode is ON in step S110, the process proceeds to step S114. In step S114, designation of a position where movement information is to be combined in the shooting screen is accepted.
[0065]
The user operates the cross key or other operation unit to input for specifying the composition location and character color of the movement information (step S116). The CPU 12 determines whether or not the designation of the composition position or the like has been confirmed (step S118)), and if NO (undefined), the process returns to step S116. On the other hand, when the designation of the composition position or the like is confirmed in step S118, the process proceeds to step S120, and the connection determination of the GPS device 32 is performed.
[0066]
The CPU 12 detects whether or not the GPS device 32 is attached to the media socket 28 (step S120). If the GPS device 32 is not attached, the CPU 12 displays an error message on the image display device 24 (step S122) to the user. The user is prompted to attach the GPS device 32.
[0067]
If it is detected in step S120 that the GPS device 32 is correctly connected, the process proceeds to step S124 and waits for input of an instruction to start shooting. In step S124, the state of the S1 switch of the shooting button 21 is determined. If the S1 switch is OFF, the process of step S124 is repeated.
[0068]
When S1 = ON is detected in step S124, AE / AF processing is executed and information is read from the GPS device 32 to determine whether or not the position data has been correctly acquired (step S126). . If acquisition of position data has failed, an error message is displayed on the image display device 24 (step S128).
[0069]
On the other hand, if the position data acquisition is successful in step S126, the obtained position data is stored in the memory 18 and the state of the S2 switch of the photographing button 21 is determined (step S130). If the S2 switch is OFF, the process of step S130 is repeated, and the input of S2 = ON is waited.
[0070]
When S2 = ON is detected in step 130, photographing is performed (step 132). Image data (shooting data) acquired by shooting is converted into a luminance / color difference signal in the image signal processing circuit 50 (step S134). At this time, a process of reading information from the GPS device 32 is performed, and it is determined whether or not the position data has been correctly acquired (step S136). If acquisition of position data fails, an error message is displayed on the image display device 24 (step S138).
[0071]
If the acquisition of the position data is successful in step S136, a process of calculating the speed and the moving direction (traveling direction) from the obtained position data and the position data related to the previous acquisition stored in the memory 18 is performed. This is performed (step S140). Then, a movement information signal is generated based on the calculation result of step S140, and a process of synthesizing it with the captured image data is performed (step S142).
[0072]
The composite image generated in step 142 is displayed and output on the image display device 24, is compressed by the compression / decompression circuit 56, and is written to the recording medium 30 (step S144). Next, the CPU 12 determines whether or not to end the shooting. When the shooting is continued, the process returns to step S132, and the above-described processing steps S132 to S146 are repeated in a certain time cycle reflecting the frame rate.
[0073]
When the photographer performs an operation to stop shooting from the shooting button 21, when a shooting end command is detected in step S 146, the moving image recording is ended.
[0074]
Thus, since the moving information is combined in the frame image with the moving image data recorded by the camera 10 according to the present embodiment, when the moving image data is reproduced, the moving information together with the moving image is displayed as described in FIG. Is displayed. Therefore, it is possible to appreciate a realistic image when taking a picture of a vehicle moving at a high speed such as an automobile, a train, or an airplane.
[0075]
[Modification 1 of Embodiment]
In the flowchart of FIG. 4, the movement information is synthesized for all the frames of the moving image data. However, in the implementation of the present invention, it is not necessary to synthesize the movement information for all the frame images, and the movement information is recorded at a certain rate during the moving image recording. It is also possible to insert the composite frame.
[0076]
For example, it is assumed that movement information is added to odd frames (with an odd frame number) and movement information is not added to even frames (with an even frame number). When moving information is displayed during reproduction, all frames of the moving image data are read out. When reproducing even-numbered frames to which movement information is not added, the moving information display area portion is the frame immediately before or immediately after (odd frame). Process to redisplay information. That is, the display area portion of the movement information is updated at a rate of once every two frames. When such display control is performed, processing is easy if the display area of the movement information is set at the corner of the screen.
[0077]
On the other hand, when selection is made not to display the movement information, only even frames of the moving image data are read and reproduced. Alternatively, when all the frames of the moving image data are read out and an odd frame to which movement information is added is reproduced, processing for redisplaying information of the immediately preceding or subsequent frame (even frame) is performed on the display area portion of the movement information. . That is, the display area portion of the movement information is updated at a rate of once every two frames. Thereby, switching of display / non-display of movement information during reproduction can be realized.
[0078]
By adding an operation means (selection means) for switching between a mode for displaying movement information during reproduction and a mode for not displaying the information to the camera 10, the user can use these modes properly as necessary. The above discussion is also applicable to the case where an image is recorded for each field when one frame is composed of two fields, and the terms “odd frame” and “even frame” are referred to as “odd field”, “ It can be replaced with “even field”.
[0079]
In addition, as a processing sequence for generating movement information, position information is acquired from the GPS device 32 in the first vertical blanking period, a movement speed and a movement direction are calculated in the next vertical blanking period, and There is also an aspect in which a composite image is generated at a rate of once every 3V (1V means the period of the vertical drive signal of the CCD 38), such as performing a composite process with a captured image in the vertical blanking period.
[0080]
The movement information update cycle can be appropriately designed. When updating every frame, it is expected that the numerical display of the moving speed will fluctuate significantly and it will be difficult to observe. Therefore, it is preferable to lengthen the update cycle to some extent to make the response slow. In practice, an update cycle of about once per second is considered sufficient. In this case, a combined image of movement information is generated at a rate of once every 30 frames. As the movement information update cycle becomes longer, the processing load on the CPU 12 is reduced.
[0081]
[Modification 2 of the embodiment]
There is the following method as an aspect in which the movement information is written in all the frames of the moving image and the display / non-display of the movement information can be switched during reproduction. That is, each frame of a moving image is recorded in a high-definition size (aspect ratio = 9 (vertical): 16 (horizontal)), and is converted during normal NTSC display (aspect ratio = 3 (vertical): 4 (horizontal)). It is assumed that the movement information is combined with the left and right screen areas that are cut off. As a result, the movement information is displayed during playback display using the high-vision angle of view, and the movement information is not displayed when switching to the NTSC display.
[0082]
[Modification 3 of the embodiment]
In the above embodiment, the example in which the movement information is combined with the frame image of the moving image is described. However, the mode of adding the movement information to the frame of the moving image is not limited to the above example. For example, when a file format capable of recording additional information as tag data for each frame of a moving image is used, movement information is recorded on the tag at the time of moving image recording. In such a case, tag data is read at the time of reproduction, a character or graphic signal is generated by a character generator or the like, and this is combined with an image for display.
[0083]
In addition, when adopting a file format in which additional information cannot be written for each frame of a moving image, such as motion JPEG, there is a mode in which a moving image frame number and additional information (movement information) are linked and held in a separate file. is there. In this case, the link file is read during reproduction, character information is generated by a character generator or the like, and this is combined with an image for display.
[0084]
As described above, according to the aspect in which the movement information is recorded as data in the same file or in a separate file separately from the image, the display / non-display switching process of the movement information at the time of reproduction is easy.
[0085]
[Modification 4 of the embodiment]
In the example shown in FIG. 1, the external type GPS device 32 is used. However, when the present invention is implemented, a mode in which the GPS device is built in the camera is also possible.
[0086]
[Modification 5 of the embodiment]
In the example shown in FIG. 1, the digital camera that converts the captured moving image data into an electronic file and records it on a recording medium has been described. However, the scope of the present invention is not limited to this, and moving image data is recorded on a magnetic tape. The present invention can also be applied to a video camera. Further, the present invention is not limited to the product name “camera”, and the present invention can be applied to portable information devices such as a mobile phone with camera, a PDA with camera, and a mobile personal computer with camera. In this case, the camera unit may be a detachable (external type) that can be separated from the main body of a mobile phone or the like.
[0087]
【The invention's effect】
As described above, according to the present invention, information is acquired from the GPS during moving image shooting, and at least one of the moving speed and moving direction is combined with the image data. Shooting is possible.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration of an electronic camera according to an embodiment of the present invention.
FIG. 2 is a block diagram showing the main configuration of the image signal processing circuit in FIG.
FIG. 3 is a diagram showing an example of a screen on which movement information is combined
FIG. 4 is a flowchart showing an operation sequence at the time of moving image shooting in the camera of this example.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 10 ... Camera, 12 ... CPU, 18 ... Memory, 20 ... Mode selection switch, 24 ... Image display apparatus, 26, 28 ... Media socket, 30 ... Recording medium, 32 ... GPS apparatus, 33 ... Media controller, 34 ... GPS control Circuit: 36: GPS position conversion circuit, 50: Image signal processing circuit, 72: Movement information signal generation circuit, 76: Composition processing circuit, 81: Information on movement direction, 82: Information on movement speed

Claims (8)

An electronic camera comprising an imaging means, and recording means for recording an image on a recording medium obtained by continuously photographing a subject as moving with the imaging means for converting an optical image of an object into an electrical signal,
A signal processing means for obtaining at least one of a moving speed and a moving direction from information acquired via a GPS receiver that receives radio waves from a GPS satellite;
Synthesizing means for synthesizing at least one of the moving speed and moving direction obtained by the signal processing means with the moving image being shot ;
An electronic camera capable of shooting moving images. The movement information to the video frame obtained from the imaging means are combined, video recording of claim 1, wherein the moving image data including a frame in which the movement information is synthesized, characterized in that it is recorded on the recording medium Possible electronic camera. Claim 1 or 2 video recording an electronic camera, wherein the image of moving the moving information is synthesized with a display means for displaying in a shooting of the video. 4. The electronic camera capable of moving image shooting according to claim 1 , wherein the GPS receiving device is an external unit that is separable from a camera body. 5. The said synthetic | combination means inserts the flame | frame with which the said movement information was synthesize | combined in the fixed ratio in the frame of the moving image acquired from the said imaging means. An electronic camera that can shoot movies. 6. The moving image can be photographed according to claim 1, wherein the synthesizing unit synthesizes the movement information with either an odd frame or an even frame in a frame of the moving image being photographed. Electronic camera. When displaying the movement information together with the moving image, when displaying a frame to which the movement information is not added, the movement information added to the frame immediately before or after the frame is displayed on the display means. An electronic camera capable of shooting a moving image according to claim 6. The position information acquisition from the GPS device, the calculation of the movement information, and the process of combining the movement information with a moving image are performed in a vertical blanking period when reading an image from the imaging unit. 8. An electronic camera capable of shooting a moving image according to any one of 1 to 7.

Images