JP2008054236A - Imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus capable of speedily performing translation processing from a photographed image. <P>SOLUTION: The imaging apparatus is equipped with an imaging device which photographs a subject, a signal processing portion, a buffer memory, a recording portion, a character extracting portion, and a translation processing portion. The signal processing portion generates data of a photographed image based on the output of the imaging device. The buffer memory can temporarily record the data of the photographed image. The recording portion records the data of the photographed image recorded in the buffer memory into a nonvolatile memory. The character extracting portion reads from the buffer memory, the data of the photographed image output from the signal processing portion, and extracts characters included in the photographed image before the data of the photographed image are discarded without being recorded into the nonvolatile memory. The translation processing portion performs the translation processing for translating the characters extracted by the character extracting portion to another language. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an imaging apparatus having a translation function.

A camera with a translation function that extracts characters from a photographed image and translates and displays the extracted characters has been proposed. Patent Document 1 is shown as an example of the camera with a translation function. In the camera with a translation function of Patent Document 1, a translation image is recorded in a memory for storing a recording image (for example, a recording medium incorporating a nonvolatile memory), and the translation image is read from the memory and translated. Is running.
Japanese Patent Laid-Open No. 2000-23012

However, in the camera with a translation function disclosed in Patent Document 1, since it is necessary to write / read a translation image on a recording medium or the like when performing a translation process, there is room for improvement in that the responsiveness of the translation process is lowered. was there.
In addition, in a camera with a translation function that supports translation in a plurality of languages, there is still a demand for means that can switch the language of the translation source without performing complicated setting operations.

The present invention has been made to achieve at least one of the above-described problems of the prior art. One of the objects of the present invention is to provide an imaging apparatus that can quickly perform a translation process from a captured image.
Another object of the present invention is to provide an imaging apparatus that can more easily switch the language of the translation source.

  An image pickup apparatus according to a first aspect includes an image pickup device that picks up a subject, a signal processing unit, a buffer memory, a recording unit, a character extraction unit, and a translation processing unit. The signal processing unit generates captured image data based on the output of the image sensor. The buffer memory can temporarily record captured image data. The recording unit records the captured image data recorded in the buffer memory in the nonvolatile memory. The character extraction unit reads out the captured image data output from the signal processing unit from the buffer memory, and extracts characters included in the captured image before the captured image data is discarded without being recorded in the nonvolatile memory. To do. The translation processing unit executes a translation process for translating the character extracted by the character extraction unit into another language.

In the second invention, in the first invention, the image sensor outputs the captured image by thinning-out readout in a mode in which translation processing is performed.
In the third invention, the imaging apparatus of the first invention further includes a shake detection unit and a control unit. The shake detection unit detects the occurrence of camera shake in the captured image. The control unit stops the operations of the character extraction unit and the translation processing unit when the shake detection unit detects the occurrence of camera shake.

In the fourth invention, the imaging apparatus of the third invention further includes a first display unit. The first display unit performs a translation stop display indicating that the translation process is stopped when the shake detection unit detects the occurrence of camera shake.
According to a fifth aspect, in the first aspect, the imaging device captures a captured image as a moving image, and lowers the frame rate for capturing a moving image in a mode in which translation processing is performed, as compared with non-translated.

In the sixth invention, the imaging apparatus of the first invention further includes a second display unit. The second display unit displays a translation failure when the character cannot be translated by the translation process.
In the seventh invention, the imaging device of the first invention further includes an area designating unit. The region designation unit receives input related to the region designation and sets the language associated with the designated region as the language of the translation source in the translation process.

  In the eighth invention, the imaging device of the seventh invention further comprises a first operation unit and a timer. The first operation unit accepts a time zone designation input related to date / time setting from the user. The timer adjusts the current date and time based on the designation of the time zone. Then, the region designation unit designates a region based on the designation of the time zone, and sets the language of the translation source together with the adjustment of the current date and time.

In the ninth invention, the imaging apparatus of the seventh invention further includes a receiving unit. The receiving unit receives data related to a position transmitted from the outside. Then, the area specifying unit specifies the current position based on the data regarding the position, and specifies the area to which the current position belongs.
In a tenth aspect, the imaging apparatus according to the first aspect further includes a second operation unit. The second operation unit receives a designation input of a translation source language and a translation destination language in translation processing from a user.

In an eleventh aspect, in the first aspect, the translation processing section includes a dictionary management section that reads a dictionary file that records the correspondence between the translation source language and the translation destination language from the outside in an exchangeable manner.
An image pickup apparatus according to a twelfth aspect includes an image pickup device for picking up an image of a subject, a signal processing unit, a character extraction unit, a translation processing unit, and a region specifying unit. The signal processing unit generates captured image data based on the output of the image sensor. The character extraction unit extracts characters included in the captured image. The translation processing unit executes a translation process for translating the character extracted by the character extraction unit into another language. The region designation unit receives input related to the region designation and sets the language associated with the designated region as the language of the translation source in the translation process.

  In a thirteenth aspect, the imaging device according to the twelfth aspect further includes a first operation unit and a timer. The first operation unit accepts a time zone designation input related to date / time setting from the user. The timer adjusts the current date and time based on the designation of the time zone. Then, the region designation unit designates a region based on the designation of the time zone, and sets the language of the translation source together with the adjustment of the current date and time.

  In the fourteenth invention, the imaging device of the twelfth invention further comprises a receiving unit. The receiving unit receives data related to a position transmitted from the outside. Then, the area specifying unit specifies the current position based on the data regarding the position, and specifies the area to which the current position belongs.

According to the present invention, character extraction processing and translation processing are performed on captured image data from the buffer memory, and the captured image can be quickly translated.
Moreover, according to this invention, the language of the translation origin in a translation process can be switched according to designation | designated of an area.

FIG. 1 is a block diagram showing the configuration of the electronic camera of this embodiment.
The electronic camera includes a photographic lens 11, a first lens drive unit 12, a shake correction lens 13, a lens position detection unit 14, a shake detection unit 15, a second lens drive unit 16, an image sensor 17, and a signal. Processing unit 18, timing generator (TG) 19, CPU 20, first memory 21, second memory 22, recording I / F 23, GPS (Global Positioning System) module 24, monitor 25, operation unit 26. In addition, the 1st lens drive part 12, the lens position detection part 14, the blur detection part 15, the 2nd lens drive part 16, the signal processing part 18, TG19, the 1st memory 21, the 2nd memory 22, recording I / F23, GPS The module 24, the monitor 25, and the operation unit 26 are all connected to the CPU 20.

The taking lens 11 is composed of a plurality of lens groups including a focusing lens for adjusting the in-focus position. The photographing lens 11 is configured so that the position in the optical axis direction can be adjusted by the first lens driving unit 12.
The blur correction lens 13 is a lens for correcting camera shake occurring in the electronic camera. The blur correction lens 13 is configured to be swingable in the direction perpendicular to the optical axis.

  The lens position detector 14 detects the vertical position and the horizontal position of the shake correction lens 13 in a plane perpendicular to the optical axis. In addition, the blur detection unit 15 includes a vertical angular velocity sensor that detects the pitch of the electronic camera and a horizontal angular velocity sensor that detects the roll of the electronic camera. As each of the above angular velocity sensors, for example, a piezoelectric vibration type angular velocity sensor that detects Coriolis force due to rotation is used.

The second lens driving unit 16 includes a vertical swing mechanism that swings the shake correction lens 13 in the vertical direction and a horizontal swing mechanism that swings the shake correction lens 13 in the horizontal direction. The second lens driving unit 16 swings the blur correction lens 13 based on the output of the CPU 20. Thereby, the imaging position of the subject image is shifted, and the image blur of the subject on the image sensor 17 is suppressed.
The image sensor 17 photoelectrically converts a subject image by a light beam that has passed through the photographing lens 11 and the like to generate an analog image signal. The image signal of the image sensor 17 is output to the signal processing unit 18. The image sensor 17 captures a recording image (main image) at the time of release. Furthermore, the imaging device 17 can capture through images by thinning-out readout at predetermined intervals during standby for shooting (during non-release). The image signal of the above-described through image is used for various arithmetic processes by the CPU 20, display on the monitor 25, and the like.

  The signal processing unit 18 is an analog front end circuit having a CDS circuit, a gain circuit, an A / D conversion circuit, and the like. Here, the CDS circuit reduces the noise component of the output of the image sensor 17 by correlated double sampling. The gain circuit amplifies the gain of the input signal and outputs it. In this gain circuit, the imaging sensitivity corresponding to the ISO sensitivity can be adjusted. The A / D conversion circuit performs A / D conversion of the output signal of the image sensor 17. The image data after A / D conversion is output to the CPU 20. In FIG. 1, illustration of each circuit of the signal processing unit 18 is omitted.

The TG 19 supplies timing pulses to the image sensor 17 and the signal processing unit 18 based on instructions from the CPU 20. In the electronic camera, the charge accumulation time of the image sensor 17 and the signal reading timing are adjusted by the timing pulse of the TG 19.
The CPU 20 is a processor that performs overall control of each part of the electronic camera. The CPU 20 has a timekeeping function and also functions as a timer for managing the current date and time. Furthermore, the CPU 20 functions as an imaging setting unit 20a, an image processing unit 20b, a character extraction unit 20c, and a translation processing unit 20d by executing the program.

  The shooting setting unit 20a performs control related to shooting of the main image and the through image. For example, the photographing setting unit 20a executes a known contrast detection type autofocus (AF) based on the through image data. Further, the photographing setting unit 20a executes known automatic exposure (AE) calculation, auto white balance (AWB) calculation, and the like based on the data of the through image. Furthermore, the shooting setting unit 20a also adjusts the frame rate of the through image.

The image processing unit 20b performs various types of image processing (defective pixel correction, color interpolation, gradation conversion processing, white balance adjustment, edge enhancement, etc.) on the image data output from the signal processing unit 18. The image processing unit 20b also executes compression / decompression processing of the data of the main image.
The character extraction unit 20c executes a character extraction process for extracting a character region from the captured image. This character extraction processing includes binarization processing of captured image data and character region extraction processing including noise removal. The character extraction unit 20c executes character recognition processing for recognizing characters included in the character area. For the above character recognition processing, a known method such as a stroke analysis method is used.

The translation processing unit 20d executes a translation process for translating the characters extracted by the character extracting unit 20c into another language based on the dictionary file that records the correspondence between the translation source language and the translation destination language. In addition, the translation processing unit 20d manages dictionary file setting data (such as the storage address of the dictionary file) used for translation processing.
The first memory 21 is a buffer memory for temporarily recording captured image data in a pre-process or post-process of image processing by the CPU 20. The first memory 21 is composed of a volatile memory such as a DRAM.

The second memory 22 is a non-volatile memory that can record various data related to the settings of the electronic camera. In the second memory 22, a region table and a translation history file of the electronic camera are recorded. The second memory 22 can also be used as a recording area for recording main image data and dictionary files.
Here, the above regional table is referred to by the CPU 20 when designating the translation source language and the translation destination language. An example of the data structure of the region table is schematically shown in FIG. In this region table, various types of data are registered in association with each city. The data of each city includes data on the city location (latitude, longitude), country name to which the city belongs, language used (official language, etc.), and time zone (standard time). The region table may record the above data group in units of countries and regions.

  Also, translation history data indicating the contents of past translation processing is recorded in the translation history file. An example of the data structure of the translation history file is schematically shown in FIG. The translation history data is generated for each translation process. One translation history data includes original text, translation text, date and time of translation processing, and dictionary file name used in translation processing. Here, the original text indicates the character to be translated (language of the translation source) extracted by the character extraction unit 20c. The translation text indicates a translation result obtained by translating the original text into the translation destination language. Generally, the language of the translation destination is set to a language familiar to the user (for example, the user's native language).

  A connector for connecting the recording medium 27 is formed in the recording I / F 23. The recording I / F 23 executes data writing / reading with respect to the recording medium 27 connected to the connector. The recording medium 27 includes a memory card with a built-in nonvolatile memory, a hard disk, or the like. FIG. 1 illustrates a memory card as an example of the recording medium 27. The recording medium 27 of the present embodiment can store the main image data and the dictionary file data.

The GPS module 24 receives a radio signal emitted from a GPS satellite constituting the GPS by the antenna 24a, and measures the current position of the electronic camera based on the radio signal. Then, the GPS module 24 outputs the coordinate data (latitude, longitude) of the current position to the CPU 20.
The monitor 25 displays a screen instructed by the CPU 20. For example, a display image (view image) based on the through image is displayed as a moving image on the monitor 25 during the above-described shooting standby. At this time, on the view image on the monitor 25, various information necessary for photographing can be superimposed and displayed by an on-screen function. The monitor 25 can also display a menu screen or the like that allows input in GUI (Graphical User Interface) format. Note that the CPU 20 executes all processes related to input and display on the menu screen.

The operation unit 26 includes a plurality of switches that accept user operations. For example, the operation unit 26 includes a release button 26a, a mode dial 26b, a cross key 26c, and a translation mode button 26d.
The release button 26a receives from the user an instruction input for starting an AF operation before shooting and an instruction input for starting an exposure operation during shooting.

The mode dial 26b receives an input for switching the operation mode of the electronic camera from the user. The operation mode includes a plurality of shooting modes such as a standard shooting mode and a portrait mode, and a translation mode for translating characters shot with an electronic camera.
The cross key 26c receives, for example, an item selection input on the menu screen from the user.

The translation mode button 26d receives a translation mode activation instruction input from the user while the electronic camera is operating in the shooting mode. That is, the user can quickly switch from the photographing mode to the translation mode by pressing the translation mode button 26d.
Hereinafter, the operation related to the translation mode in the electronic camera of this embodiment will be described.
First, the user needs to set up a menu screen prior to the translation mode operation, and to make language settings relating to translation in advance for the CPU 20. This language setting will be described with reference to the flowchart of FIG.

Step 101: The CPU 20 determines whether or not the language of the translation destination is not set. When the translation destination language is not set (YES side), the CPU 20 proceeds to S102. On the other hand, when the language of the translation destination is set (NO side), the CPU 20 proceeds to S103.
Step 102: The CPU 20 initializes the language to be translated by one of the following methods.

First, when the user designates a language (notation language) used for notation on the menu screen or the like, the CPU 20 sets the language designated as the notation language as the language to be translated. This is because the notation language is very likely to be the user's native language.
Second, the CPU 20 may set the language of the translation destination based on the home position designated by the user in the date / time setting on the menu screen. In this case, the CPU 20 determines a language corresponding to the position of the home as a translation destination language using the area table.

Third, the CPU 20 automatically sets the language of the translation destination based on the output of the GPS module 24. In this case, it is assumed that the user sets the language of the translation destination near the home.
Specifically, first, the CPU 20 acquires information on the latitude and longitude of the current position from the GPS module 24. Then, the CPU 20 refers to the position data in the area table and selects the city closest to the current position. Then, the CPU 20 refers to the area table and sets the language corresponding to the selected city as the language to be translated. According to the third example, since an appropriate translation destination language can be automatically set from the current position (home position) of the electronic camera, setting of the translation destination language can be remarkably simplified.

Step 103: The CPU 20 determines whether or not an operation for changing the language of the translation destination has been received from the user. When changing the translation destination language (YES side), the CPU 20 proceeds to S104. On the other hand, when the language of the translation destination is not changed (NO side), the CPU 20 proceeds to S105.
Step 104: The CPU 20 changes the language of the translation destination based on the user's operation from the operation unit 26. As an example, the user selects and inputs one icon from icons corresponding to each language on the menu screen. Then, the CPU 20 sets the language corresponding to the designated icon as the translation destination language. Even in this case, the CPU 50 may change the language of the translation destination based on the change of the home position in the date and time setting or the position information by GPS.

Step 105: The CPU 20 determines whether or not the translation source language is not set. When the translation source language is not set (YES side), the CPU 20 proceeds to S107. On the other hand, when the translation source language is set (NO side), the CPU 20 proceeds to S106.
Step 106: The CPU 20 determines whether or not an operation for changing the language of the translation source has been received from the user. When changing the language of the translation source (YES side), the CPU 20 proceeds to S107. On the other hand, when the translation source language is not changed (NO side), the CPU 20 proceeds to S108.

Step 107: The CPU 20 sets the language of the translation source by one of the following methods.
First, the CPU 20 sets a translation source language based on a language selection input by the user. As an example, the user operates the cross key 26c of the operation unit 26 to select and input one icon from the icons corresponding to each language on the menu screen. Then, the CPU 20 sets the language corresponding to the designated icon as the language of the translation source.

  Second, the CPU 20 sets the language of the translation source in conjunction with the adjustment operation of the current date and time by the user. Specifically, when the user changes the time zone of the date / time setting on the menu screen, for example, when traveling abroad, the CPU 20 adjusts the current date / time of the timer based on the changed time zone. At this time, the CPU 20 refers to the area table and acquires the language data of the city (or country) belonging to the changed time zone. Then, the CPU 20 sets the language of the translation source based on the language data. If a plurality of languages are associated with the same time zone, the CPU 20 may present translation source language candidates on the monitor 25 and allow the user to select the translation source language.

  As an example, a case where a time zone of “UTC-7” is selected in the date and time setting on the menu screen will be described. In this case, the CPU 20 refers to the regional table and translates the languages (English, French, Spanish) associated with the United States, Canada, and Mexico belonging to the time zone of “UTC-7” as translation source language candidates. As shown on the monitor 25. Then, the CPU 20 sets any one of English, French, and Spanish as a translation source language based on a user input. According to the second example, the user can set the language of the translation source while adjusting the time difference of the timer of the electronic camera. Therefore, the complexity of the operation of the electronic camera can be greatly reduced as compared with the case where both settings are performed separately.

  Third, the CPU 20 automatically sets the language of the translation source based on the output of the GPS module 24. In this case, it is assumed that the electronic camera is in a country different from the home, such as a situation in which the user wants to set the local official language as the translation source language while traveling. Note that the description of the language setting of the translation source by GPS is the same as the description of the language setting of the translation destination by GPS in S102 described above, and is therefore omitted.

Step 108: The CPU 20 searches for a dictionary file recorded in the second memory 22 or the recording medium 27.
Step 109: The CPU 20 determines whether a dictionary file (corresponding dictionary file) corresponding to the setting of the translation source language and the translation destination language is in the second memory 22 or the recording medium 27 based on the search result in S108. To do. If there is the corresponding dictionary file (YES side), the CPU 20 proceeds to S110. On the other hand, if there is no corresponding dictionary file (NO side), the CPU 20 proceeds to S111.

Step 110: The translation processing unit 20d of the CPU 20 registers the storage destination address of the corresponding dictionary file. Thus, during the translation process, the translation processing unit 20d can access the corresponding dictionary file based on the registered address. Thereafter, the CPU 20 ends the language setting operation.
Step 111: The CPU 20 displays a warning that there is no corresponding dictionary file on the monitor 25. This warning display allows the user to recognize whether or not it is necessary to exchange the dictionary file in the electronic camera. Note that the user can exchange dictionary files in the electronic camera via the recording medium 27 or the like. Above, description of the flowchart of FIG. 4 is complete | finished.

Next, the operation of the electronic camera in the translation mode will be described with reference to the flowchart of FIG. This translation mode is activated in response to the mode switching operation of the mode dial 26b by the user or the pressing of the translation mode button 26d. In the description of the translation mode, the description will be made on the assumption that the camera shake correction function is set to ON.
Step 201: The shooting setting unit 20a of the CPU 20 changes the frame rate of the through image by the image sensor 17 to a lower value than in the shooting mode (when not translated). As an example, when the frame rate of the through image in the shooting mode is 60 fps, the shooting setting unit 20a reduces the frame rate of the through image in the translation mode to about 15 fps. This is because in the translation mode, the translation process takes time, so it is preferable to reduce the frame rate to reduce the image data to be processed. Moreover, in the translation mode, it is considered that there is no problem even if the moving image display of the view image on the monitor 25 becomes somewhat rough.

Step 202: The CPU 20 starts photographing a through image. Here, the CPU 20 causes the image sensor 17 to output the through image by thinning readout. For this reason, the through image has a lower resolution than the main image read out from all pixels.
In the translation mode, the CPU 20 generates a view image based on the through image and sequentially displays the view image on the monitor 25. Therefore, the user can perform framing for determining the shooting composition based on the view image on the monitor 25.

The through image data is sequentially written in the first memory 21, but is not recorded in the recording medium 27 or the like. This through-image data is discarded by overwriting another through-image data after the view image generation processing and character recognition processing are completed.
Step 203: The CPU 20 determines whether or not to continue the operation in the translation mode. When the operation in the translation mode is continued (YES side), the CPU 20 proceeds to S204. On the other hand, when the operation in the translation mode is not continued (NO side), the CPU 20 ends the operation in the translation mode. In this case, for example, there is a case where there is a power-off operation or a mode switching operation to another operation mode.

Step 204: The photographing setting unit 20a of the CPU 20 adjusts AF, AE, AWB, etc. based on the through image.
Step 205: The CPU 20 determines whether or not the in-focus state. If it is in focus (YES side), the CPU 20 proceeds to S206. On the other hand, if it is not in focus (NO side), the CPU 20 returns to S204 and performs AF again.

  Step 206: The CPU 20 determines whether there is no camera shake. Specifically, when the shake amount detected by the shake detection unit 15 is within a range that can be canceled by the shake correction function, the CPU 20 determines that there is no camera shake. If there is no camera shake (YES side), the CPU 20 proceeds to S208. On the other hand, if the camera is shaken (NO side), the CPU 20 proceeds to S207.

Step 207: The CPU 20 superimposes and displays a translation stop display indicating the stop of translation processing due to camera shake on the view image of the monitor 25. This translation stop display is displayed on the monitor 25 until there is no camera shake. Then, the CPU 20 returns to S203 and repeats the above operation (note that the translation stop display is not shown).
That is, when the camera is shaken, the CPU 20 stops the character extraction process and the translation process. This is because there is a low possibility that characters can be extracted from the through image in the state of camera shake.

Step 208: In this case, the CPU 20 acquires a through image to be subjected to translation processing. Note that the through image in S208 is the same as the through image described in S202 except that it is a target of translation processing. Further, a view image based on the through image of S208 is displayed on the monitor 25.
Step 209: The character extraction unit 20c of the CPU 20 starts character extraction processing for the through image (S208) that is the target of translation processing.

Step 210: The CPU 20 determines whether or not a character area has been extracted from the through image (S208) to be translated. When the character area can be extracted (YES side), the CPU 20 proceeds to S212. On the other hand, if the character area cannot be extracted (NO side), the CPU 20 advances to S211.
Step 211: The CPU 20 determines whether or not a predetermined time has elapsed since the start of the character extraction process (S209). If the predetermined time has elapsed (YES side), the CPU 20 terminates the character extraction process and returns to S203. On the other hand, if the predetermined time has not elapsed (NO side), the CPU 20 continues the character extraction process and returns to S210.

  Step 212: The CPU 20 determines a character area in the through image (S208) to be translated. Thereafter, the CPU 20 displays a character area indicating the character area on the view image of the monitor 25. FIG. 6 shows an example of character area display in the view image. In FIG. 6, the CPU 20 performs character area display by superimposing a frame around the character area of the view image (“Airport” in the figure).

Step 213: The character extraction unit 20c of the CPU 20 executes a character recognition process on the character region of the through image (S208) that is the target of the translation process. And the character extraction part 20c of CPU20 produces | generates an original text from the recognized character.
Step 214: The translation processing unit 20d of the CPU 20 executes translation processing of the original text. Specifically, the translation processing unit 20d translates the original text from the translation source language to the translation destination language based on the dictionary file. The translation processing unit 20d generates a translation text when the original text can be translated.

Step 215: The CPU 20 determines whether the translation process is successful. If the translation process is successful (YES side), the CPU 20 advances to S218. On the other hand, if the translation process has not yet been successful (NO side), the CPU 20 proceeds to S216.
Step 216: The CPU 20 determines whether or not a predetermined time has elapsed from the start of the translation process. If the predetermined time has elapsed (YES side), the CPU 20 terminates the translation process and proceeds to S217. On the other hand, if the predetermined time has not elapsed (NO side), the CPU 20 continues the translation process and returns to S215.

Step 217: The CPU 20 superimposes a translation failure display indicating a translation failure of the original text on the view image of the monitor 25. Thereafter, the CPU 20 returns to S203 and repeats the above operation (note that the translation failure display is not shown).
Here, the case where the translation is failed corresponds to, for example, a case where an appropriate original text is not generated due to a failure of the character recognition process, or a case where a phrase of the original text is not registered in the dictionary file.

Step 218: In this case, the CPU 20 displays the translation result on the monitor 25. FIG. 7 shows an example of a translation result display screen. The translation result display screen shown in FIG. 7 corresponds to the scene of FIG.
In FIG. 7, the image of the monitor 25 is divided into two parts on the left and right. In the left area of the monitor 25, a partial image of the view image (original image) corresponding to FIG. 6 or a reduced image of the entire original image is displayed. On the other hand, in the right area of the monitor 25, a translation result image obtained by processing the image in the left area is displayed. In the translation result image of FIG. 7, the character area (“Airport” portion) of the original image is masked, and the translation text (“Airport”) is superimposed and displayed at the masked portion.

Of course, the layout of the translation result display screen shown in FIG. 7 is merely an example. For example, the CPU 20 may display one original image large on the monitor 25 and superimpose and display the original text and the translated text on the lower side of the original image (illustration of the screen in this case is omitted).
Step 219: The CPU 20 determines whether or not a predetermined time has elapsed from the start of displaying the translation result. When the predetermined time has elapsed (YES side), the CPU 20 ends the display of the translation result and proceeds to S220. On the other hand, if the predetermined time has not elapsed (NO side), the CPU 20 returns to S218 and continues displaying the translation result.

Step 220: The CPU 20 generates translation history data based on the current translation result. Then, the CPU 20 registers the translation history data in the translation history file in the second memory 22. Thereafter, the CPU 20 returns to S203 and repeats the above operation. Above, description of the flowchart of FIG. 5 is complete | finished.
Next, referring to the translation history will be briefly described. In the electronic camera of this embodiment, the translation history can be displayed on the monitor 25 when the translation mode is activated or the menu screen is displayed. When receiving a translation history display operation of the user from the operation unit 26, the CPU 20 reads the translation history file in the second memory 22 and displays the translation history on the monitor 25. In the translation history display screen in this embodiment, the contents shown in the schematic diagram of FIG. 3 are displayed on the monitor 25 in a substantially similar format.

On the translation history display screen, the contents of the translation history data (original text and translation text, translation date and time, dictionary file name) are displayed in a table format. On the translation history display screen, translation history data can be sorted by translation date and dictionary file name. By making it possible to refer to the translation history in this way, the convenience of the electronic camera can be further improved.
Hereinafter, the operational effects of the electronic camera in the present embodiment will be described.

  The electronic camera of the present embodiment performs character extraction processing and translation processing on the captured image data, and displays the translation result on the monitor 25 (S208 to S218). Therefore, the user can perform translation without inputting characters like an electronic dictionary. Further, in this embodiment, since the electronic camera and the electronic dictionary can be used together, it is possible to realize an electronic camera that is excellent in portability and easy to use.

  In particular, in this embodiment, the CPU 20 performs character extraction processing and translation processing on the through image data in the buffer memory. That is, when translating the data of the main image, writing / reading processes to / from a nonvolatile memory or a recording medium are indispensable, but these processes are not necessary in the present embodiment. Therefore, the CPU 20 can quickly perform the translation process almost in real time.

In this embodiment, the language of the translation source can be set according to the current position by GPS (S107). In this embodiment, the translation source language can be set in conjunction with the time difference adjustment operation for the current date and time (S107). Therefore, the user can easily change the translation source language at a travel destination or the like without performing complicated operations.
Furthermore, in this embodiment, the dictionary file used for translation processing can be replaced using the recording medium 27. Therefore, the recording capacity of the second memory 22 can be effectively utilized by exchanging dictionary files as necessary.

(Supplementary items of the embodiment)
(1) The imaging apparatus of the present invention is not limited to the example of the electronic camera of the above embodiment. For example, it may be constituted by a mobile phone or a portable computer having a photographing function.
(2) In the electronic camera of the above embodiment, each configuration of the shooting setting unit 20a, the image processing unit 20b, the character extraction unit 20c, and the translation processing unit 20d may be realized by hardware.

  (3) In the electronic camera of the present invention, the current position detecting means is not limited to positioning by GPS. For example, the electronic camera may detect the current position with a positioning device that measures the current position based on communication results with a plurality of base stations of a mobile communication network (PHS, mobile phone). Alternatively, the electronic camera may directly receive information on the current position from the outside through wireless communication such as the above mobile communication network or wireless LAN.

  (4) In the above embodiment, the example of the electronic camera that performs the blur correction by driving the blur correction lens 13 has been described. However, the blur correction configuration of the electronic camera is not limited to the above embodiment. For example, an electronic camera for electronic camera shake correction that obtains a partial image subjected to shake correction by shifting the cutout position from the entire image according to the amount of shake may be used. Further, an electronic camera provided with a shake correction mechanism that mechanically shifts the image sensor 17 may be used.

  It should be noted that the present invention can be implemented in various other forms without departing from the spirit or main features thereof. For this reason, the above-described embodiment is merely an example in all respects and should not be interpreted in a limited manner. The present invention is defined by the claims, and the present invention is not limited to the text of the specification. Further, all modifications and changes belonging to the equivalent scope of the claims are within the scope of the present invention.

The block diagram which shows the structure of the electronic camera of this embodiment Schematic diagram showing an example of the data structure of the region table Schematic diagram showing an example of the data structure of a translation history file Flow chart explaining the language setting of the electronic camera Flow chart explaining operation in translation mode of electronic camera The figure which shows an example of the character area display in a view image Diagram showing an example of the translation result display screen

Explanation of symbols

DESCRIPTION OF SYMBOLS 15 ... Shake detection part, 17 ... Image pick-up element, 18 ... Signal processing part, 20 ... CPU, 20a ... Shooting setting part, 20c ... Character extraction part, 20d ... Translation processing part, 21 ... 1st memory, 22 ... 2nd memory 22, 23 ... Recording I / F, 24 ... GPS module, 24a ... Antenna, 25 ... Monitor, 26 ... Operation unit, 27 ... Recording medium

Claims (14)

An image sensor for photographing a subject;
A signal processing unit that generates data of a captured image based on the output of the image sensor;
A buffer memory capable of temporarily recording data of the captured image;
A recording unit that records data of the captured image recorded in the buffer memory in a nonvolatile memory;
The photographed image data output from the signal processing unit is read from the buffer memory, and characters included in the photographed image are recorded before the photographed image data is discarded without being recorded in the nonvolatile memory. A character extraction unit to extract;
A translation processing unit that performs a translation process for translating the characters extracted by the character extraction unit into another language;
An imaging apparatus comprising: The imaging device according to claim 1,
The imaging device is characterized in that in the mode for performing the translation process, the captured image is output by thinning out readout. The imaging device according to claim 1,
A shake detection unit that detects occurrence of camera shake in the captured image;
A control unit that stops the operation of the character extraction unit and the translation processing unit when the blur detection unit detects the occurrence of the camera shake;
An image pickup apparatus further comprising: The imaging device according to claim 3.
An imaging apparatus, further comprising: a first display unit that performs a translation stop display indicating that the translation process is stopped when the blur detection unit detects the occurrence of the camera shake. The imaging device according to claim 1,
The imaging device is characterized in that the captured image is captured as a moving image, and the frame rate for capturing the moving image is reduced in the translation processing mode as compared with non-translated mode. The imaging device according to claim 1,
An image pickup apparatus, further comprising: a second display unit that displays a translation failure display when the character cannot be translated by the translation process. The imaging device according to claim 1,
An area designation unit that receives an input related to designation of a region and sets a language associated with the designated region as a language of a translation source in the translation process;
An image pickup apparatus further comprising: The imaging apparatus according to claim 7,
A first operation unit for receiving a time zone designation input related to date and time setting from a user;
A timer for adjusting the current date and time based on the designation of the time zone, and
The region specifying unit specifies the region based on the specification of the time zone, and sets the language of the translation source together with the adjustment of the current date and time. The imaging apparatus according to claim 7,
A receiver that receives data related to a position transmitted from the outside;
The imaging apparatus according to claim 1, wherein the area specifying unit specifies a current position based on data relating to the position and specifies an area to which the current position belongs. The imaging device according to claim 1,
An imaging apparatus, further comprising: a second operation unit that receives designation input of a translation source language and a translation destination language in the translation processing from a user. The imaging device according to claim 1,
The image processing apparatus, wherein the translation processing unit includes a dictionary management unit that reads a dictionary file that records correspondence between a translation source language and a translation destination language from the outside in an exchangeable manner. An image sensor for photographing a subject;
A signal processing unit that generates data of a captured image based on the output of the image sensor;
A character extraction unit for extracting characters included in the photographed image;
A translation processing unit that performs a translation process for translating the characters extracted by the character extraction unit into another language;
An area designation unit that receives an input related to designation of a region and sets a language associated with the designated region as a language of a translation source in the translation process;
An imaging apparatus comprising: The imaging apparatus according to claim 12,
A first operation unit for receiving a time zone designation input related to date and time setting from a user;
A timer for adjusting the current date and time based on the designation of the time zone, and
The region specifying unit specifies the region based on the specification of the time zone, and sets the language of the translation source together with the adjustment of the current date and time. The imaging apparatus according to claim 12,
A receiver that receives data related to a position transmitted from the outside;
The imaging apparatus according to claim 1, wherein the area specifying unit specifies a current position based on data relating to the position and specifies an area to which the current position belongs.

Images