JP3183220B2 - Digital camera image comment input device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a digital camera image comment input device, and more particularly to a voice recognition technology for converting voice data into character string data, and a digital camera image comment for designating a display position of a character string to be converted. Related to input device.

[0002]

2. Description of the Related Art A digital camera has a function of recording an image, a function of arbitrarily erasing a recorded image, a function of holding and reproducing a recorded image, and various functions relating to an image. In terms of miniaturization, too, technical points occupy a large proportion. At present, there is a digital camera system with a voice mail function in which a voice input function is added to a digital camera. However, only image information can be input on the display of the digital camera. There is a voice input to the user's input means to the portable terminal device, and recognition and determination of the input depends on unilateral machine recognition.

According to Japanese Patent Application Laid-Open No. Hei 8-287100, there is a description of providing an information retrieval apparatus that improves operability when a screen is selected by a menu operation, and the contents thereof are summarized as follows. In the search word escape input screen, the screens include "check the meaning of a word" and "view the table of contents". When "view the table of contents" is selected, the table of contents screen is displayed after a predetermined time has elapsed without pressing the YES key for confirmation. If the NO key is pressed before the predetermined time has elapsed, the screen returns to the original screen. Since the selection operation can be performed without pressing the confirmation key, the operability is improved.

[0004] This will be described with reference to the drawings as a conventional comment input device. 18 is an overall block diagram of an example of a device to which the conventional comment input device is applied, FIG. 19 is a plan view used to explain the key arrangement of the conventional comment input device, FIG. 20 is an explanatory diagram of the conventional comment input device, FIG.
Is an initial screen used as an example of a conventional comment input device,
FIG. 22 is a table of contents screen used for an example of a conventional comment input device, and FIG. 23 is a flowchart used for explaining an example of a conventional comment input device.

In FIG. 18, a conventional comment input device includes an optical disk drive 21, a data processing unit 22, an I / O
O23, CPU 24, main ROM 25, main RAM
26, input keyboard 27, display controller 28, V
It comprises a RAM 29, a display 30, and a power supply circuit 31.

[0006] The optical disk drive 21 is a CD-ROM.
It has a function to reproduce the data existing in the. The data processing unit 22 has a function of demodulating data of the CD-ROM. I / O 23 is a data processing unit 22 and a CPU
24 is provided. The main ROM 25 stores a program for executing the initial processing. Main RAM 26 is used to store operands.

As shown in a plan view of FIG. 19, the input keyboard 27 has a power key, a shift key, a function key, an alphabet key, a Roman character table / character enlargement key, a NO key, a YES key, and four keys indicating directions by arrows. It includes a direction key and an input mode key.

The display controller 28 is connected to a VRAM 29 for storing video data to be displayed, and has a function of supplying an output of the display controller to a display 30. The VRAM 29 is a video RAM. The power supply circuit 31 has a function of supplying necessary power to each circuit. The display 30 has a function of displaying contents.

Next, the operation of the conventional device will be described.
2. Description of the Related Art Conventionally, an information retrieval apparatus using a CD-ROM or the like has a menu display screen because it may be used not only by persons having knowledge of computers but also by persons in a wide range of hierarchies and fields having no knowledge of computers. Often. Therefore, since the menu selection is usually based on the menu, after the menu is selected with the direction key or the like as shown in FIG. 20 to determine that the menu has been selected (step S101), it is determined whether or not the enter key is pressed. Is determined (step S102), and when the enter key is pressed, a selection screen is displayed (step S103).

However, since the operability is not good in this case,
In the above-mentioned conventional apparatus, operability is to be improved as follows. For example, in the search input screen of the English-Japanese dictionary as shown in FIG. 21, there are screens of "find the meaning of a word" and "see the table of contents". When the user operates the direction keys on this screen and selects “view the table of contents”, the table of contents as shown in FIG. 22 is displayed after a waiting time of several seconds without pressing the YES key. If the user selects the table of contents menu by mistake, pressing the NO key while waiting for a few seconds causes
You can return to the screen shown in. If the user presses the NO key while viewing the table of contents as shown in FIG.
You can return to the screen shown in.

FIG. 23 is a flowchart showing the operation at this time. It is determined whether or not “view table of contents” is selected on the search word input screen (step S1). When "view the table of contents" is selected, a predetermined waiting time is set (step S2). Before the predetermined waiting time elapses,
It is determined whether the NO key has been pressed (step S
3) If the NO key is pressed, the screen returns to the first screen.
If a predetermined waiting time elapses without selecting the "NO" key after "view table of contents" is selected, a table of contents is displayed (step S4). While the table of contents screen is being displayed, it is monitored whether the NO key has been pressed (step S5).
When it is detected that the O key is pressed, the screen returns to the first search word input screen.

As described above, in the above-described conventional apparatus, when a predetermined selection operation for search is performed, a screen corresponding to the predetermined selection operation is displayed after a predetermined time has elapsed without pressing the enter key. . If the release operation is performed before the predetermined time has elapsed, the display of the screen corresponding to the predetermined selection operation is stopped. Since the selection operation is performed without pressing the confirmation key, the operability is improved.

[0013]

However, in the above-described conventional apparatus, when inputting image information obtained by a digital camera, voice information input by the user cannot be attached as character string information. In this case, the image alone cannot accurately represent what the user feels.

Further, in the above-mentioned conventional apparatus, when voice information is added to each image information of the digital camera as character string information and displayed, the display position of the comment character string specified and input by voice and the comment voice are displayed. After the input, there is a problem that the user always needs to perform an operation of determining whether display is impossible by comparing with the maximum displayable length.

This is because when a comment character string is specified at a display position during photographing by a digital camera and added using voice information, positional information for voice input for positioning and a character string are temporarily displayed. Calculate the display position with the comment voice input to the comment voice, and if it can be displayed,
This is because there is no technology that displays an undetermined character string and takes a non-display configuration when display is not possible.

Further, in the above-mentioned conventional apparatus, even if the comment character string can be displayed in the fender as an undetermined character string, there is no method for coping when the determined undetermined character string does not meet the user's request. The reason is that the comment voice cannot be input again after being determined as the undetermined character string, or the process of determining the undetermined character string once and has already been input cannot be executed again.

The present invention has been made in view of the above points,
Digital camera image comment input that can provide a system that makes use of words arising from the immediate atmosphere in which a user uses a digital camera and can immediately create an image with a character string to be displayed on another system such as the Internet or an electronic album It is intended to provide a device.

Another object of the present invention is to allow a user to easily determine a display position by using a voice on the spot when displaying a word generated on the spot using a digital camera in an image. An object of the present invention is to provide a comment input device for a digital camera image.

Still another object of the present invention is to automatically or arbitrarily determine a comment to be displayed when a user combines a character string with an image using a digital camera, and to additionally input a comment once. It is an object of the present invention to provide a digital camera image comment input device having a function of re-inputting a voice or re-recognizing and converting a comment voice already input and converted to an undetermined character string into a character string. .

[0020]

To achieve the above object, according to the present invention, there is provided a digital camera body for inputting image information and a digital camera body for inputting image information while looking at a fender of the digital camera body. A voice input unit that specifies the position to display a comment by voice for image information, a comment voice input unit that inputs a comment to be displayed at the position specified by the voice input unit by voice, and a comment that is input to the comment voice input unit A recognition character string converting means for recognizing a voice and converting it into a character string in an undetermined state; a response voice input unit for inputting a response voice relating to the determination or indetermination of a comment character string converted into a character string in an undetermined state; While referring to the image information input to the camera body, the position designation voice input from the voice input unit and the comment input from the comment voice input unit Determines whether the comment character string that has been converted into a character string in an undetermined state can be displayed in the fender based on the voice, and if it can be displayed, is undetermined using the response voice input from the response voice input unit to determine the determined / undetermined status of the comment string, and comments created unit that outputs a fixed character string information and the display position information, and the display position information of the comment string comment creation unit is determined and fixed character string information , A display data generating unit for merging image information input by the digital camera body and information stored in the display data storing unit, and an image for outputting information generated by the display data generating unit. And an output unit.

According to the present invention, for the image information input to the digital camera main body while looking at the fender of the digital camera main body, the voice input section and the comment voice input section display the comment and the comment display position for displaying the comment input by voice. Can be used to create a comment character string. In addition, in the present invention, when a comment character string is designated by using a digital camera and a display position is added using voice information during photographing, position information for voice input for the positioning and the character string are temporarily displayed. For this reason, the display position is calculated based on the comment voice input with the comment voice, and if it can be displayed, it is displayed as an undetermined character string, and if it cannot be displayed, it can be hidden.

According to a second aspect of the present invention, a comment creating section is provided based on a position designation voice input from a voice input section and a comment voice input from a comment voice input section.
Determines whether the comment character string that has been converted into a character string in the undetermined state can be displayed in the fender, and if it cannot be displayed, the position designation voice input again from the voice input unit and the comment voice input again from the comment voice input unit Based on the comment voice and
It is configured such that it is determined again whether a comment character string converted into a character string in an undetermined state can be displayed in a fender. According to the present invention, the comment character string can be re-input.

Further, the comment creation unit in the present invention may include:
When determining whether the comment character string in the undecided state is confirmed / unconfirmed using the response sound input from the response sound input unit, if the response sound is a confirmed sound with a positive intention, the comment character string in the unconfirmed state May be determined, and if the reply voice is an uncertain voice intended to re-enter an undetermined character string after voice input, a comment may be input again.

In the present invention, the comment creation unit may include:
When determining whether the comment character string in the undetermined state is confirmed or undetermined using the response voice input from the response voice input unit, if the response voice is an uncertain voice intended to reconvert the undetermined character string, It may be configured to have means for recognizing the comment character string and converting it into a character string.

In the present invention, the comment creation unit
When a comment character string in an undetermined state is determined, data of the determined comment character string may be stored in the display data storage unit.

[0026]

In the present invention, the comment creation unit is
A timer for setting the remaining time and outputting time information; and a timer management means for managing the timer, wherein a position designation voice input from the voice input unit and a comment voice input from the comment voice input unit are used. Based on this, it is determined whether or not the comment character string that has been converted into a character string in an undetermined state can be displayed in the fender. If it can be displayed, it is determined or converted within the time set by the timer. The input is determined.

Further, the comment creating section in the present invention includes:
Judgment is made as to whether the comment character string that has been converted into an undetermined state can be displayed in the fender, and if it can be displayed, the comment character string is automatically determined after the time set by the timer has elapsed. Good.

Further, the present invention may include means for displaying a degree of elapse of a predetermined time until the comment character string in an undetermined state is determined.

Further, the present invention merges image information input from a digital camera main body with comment character strings stored in a display data storage unit, and obtains time information for transition within a predetermined time obtained by a comment creation unit. And a display data creation unit as a means for reflecting the display data.

[0031]

Next, an embodiment of the present invention will be described.

FIG. 1 is a block diagram showing the overall configuration of an embodiment of the present invention. In FIG. 1, a digital camera image comment input device includes a digital camera main body 1 for inputting image information, and a voice input for specifying a position to add a comment with respect to image information input to the digital camera main body 1 while looking at a fender. Unit 2, a comment voice input unit 3 for voicely inputting a comment to be displayed at a position determined by the voice input unit 2, and a recognition for recognizing a comment voice input to the comment voice input unit 3 and forming a character string in an undetermined state. A character string converting means 4, a reply voice input unit 5 for forcibly determining whether the comment character string is displayed in an undetermined state or not, a management table 6, and a comment creating unit 7
Display data storage unit 8, display data creation unit 9,
It comprises an image output unit 10.

The management table 6 specifies the comment display position of the image data input by the digital camera body 1 and the comment character string after the determination. D. Unified management using numbers. The comment creation unit 7 is a digital camera body 1
Each voice is used by using the position specifying voice input from the voice input unit 2 and the comment voice input from the comment voice input unit 3 and, if necessary, the reply voice input by the reply voice input unit 5 while referring to the image information input to the And outputs the display position information of the comment character string in each image, the fixed character string information, and the time information relating to the fixed time.

The display data storage unit 8 stores display position information and fixed character string information of the comment character string to be determined. The display data creation unit 9 merges the image information input by the digital camera body 1 with the information stored in the display data storage unit 8 and updates the interface information that also reflects the timer information obtained by the comment creation unit 7. The image output unit 10 outputs information created by the display data creation unit 9. The digital camera main unit 1, the display data storage unit 8, and the image output unit 10 constitute a digital camera device main unit.

Next, a detailed configuration of the comment creating section 7 will be described. The comment creating section 7 inputs and recognizes a character string described and displayed together with the image by voice while the user takes an image with respect to the image information input by the digital camera main body 1. A means for determining and providing data.

FIG. 2 is a block diagram showing a part of the first embodiment of the comment creating section 7 in the present invention. FIG.
As shown in the figure, the input speech recognition means 7-1, the display position designation means 7-2 and the storage means 7-4. The input voice recognition unit 7-1 recognizes voice information, which is a position designation voice input from the voice input unit 2, in order to define a display position of a comment character string with respect to screen information viewed from a fender of the digital camera. .

The display position specifying means 7-2 does not display the comment character string input by the user as an unconfirmed character string at the position specified by the user, so that the voice input unit 2 signals the input of the position specifying sound again. Or the display position is specified by displaying the comment character string in an undetermined state. The storage unit 7-4 stores the result of voice recognition of the comment voice input from the comment voice input unit 3 via the recognition / character string conversion unit 4.

Next, the operation of the embodiment of the present invention will be described with reference to the flowchart of FIG. 3 for specifying the display position and inputting the comment voice (comment creation unit) in the embodiment. First, when there is a voice input for specifying the display position of a character string to be displayed from the voice input unit 2 (step 101), the input position specifying voice information is recognized using the input voice recognition means 7-1 (step 101). 102). Subsequently, when a comment voice is input from the comment voice input unit 3 (step 103), the input comment voice is recognized,
The character string conversion process is performed by the recognition / character string conversion means 4 (step 104). At that time, font setting is performed as an initial setting.

Next, a digital camera is obtained from the position designation voice information recognized by the input voice recognition means 7-1 in step 102 and the comment voice and its character string recognized in step 104 by the recognition / character string conversion means 4. Determines whether the comment string can be displayed in the fender, and if it cannot be displayed, does not display the comment string input by the user as an undetermined character string at the position specified by the user, and inputs the voice. The part 2 gives a signal to input the position designation voice again (step 105). And again step 1
Returning to 01, a voice input for specifying the position of the character string to be displayed is received from the voice input unit 2.

FIG. 4 is a block diagram showing a first embodiment of the comment creating section 7 according to the present invention. 2, the same components as those in FIG. 2 are denoted by the same reference numerals, and the description thereof will be omitted. The comment creating section 7 shown in FIG.
A response voice recognition means 7-7 to which a response voice is input from
It further has a confirmation processing means 7-8. The operation of the comment creation unit in FIG. 4 will be described with reference to the flowchart of the comment input means and the comment character string determination method in FIG. 5, the same processing steps as those in FIG. 3 are denoted by the same reference numerals.

The position input voice input is performed by the voice input unit 2, and the result of recognition by the input voice recognition unit 7-1 and the comment voice character string input are performed by the comment voice input unit 3.
From the result of recognition and character string conversion by the character string conversion means 4, it is determined whether a character string can be displayed on the fender screen (step 110). If string Display is impossible, comment string to be input is hidden, it starts to locate the voice input the display position to the speech input unit 2 returns to step 101 again again.

On the other hand, when it is determined in step 110 that the character string of the comment voice can be displayed, the process proceeds to step 111, where the reply voice input unit 5 affirms the comment character string displayed by the user as an undetermined character string. The response voice is received by using the response voice, and the response voice recognition means 7-7 in FIG. 4 recognizes the response voice and passes it to the determination processing means 7-8. The determination processing means 7-8 determines whether or not the voice is a confirmed voice (step 112). If it is determined that the voice is a confirmed voice, the comment character string input from the storage means 7-4 is determined as a recognized character string. (Step 113).

In this step 113, the character string determined by the reply voice is stored in the storage unit 7- as shown in FIG.
4 to 4 may be stored in the display data storage unit 8 shown in FIGS. Step 11
The stored information of No. 3 is output by the output means.

Next, a second embodiment of the present invention will be described with reference to the drawings. FIG. 7 is a block diagram showing a comment creation unit according to a second embodiment of the present invention. The comment creator of the second embodiment is different from the comment creator of the first embodiment shown in FIG. 4 in that a comment voice re-input means 7-10 of FIG. 7 is provided.

In the first embodiment, a response voice is input for the confirmation of the unconfirmed comment character string, and it is determined whether or not the response voice is affirmative. In this embodiment, when the response voice to be input is negative, the comment character string is re-entered by the comment voice re-input means 7-10.
In this case, a process for inputting from the user is performed.

Next, a third embodiment of the present invention will be described with reference to the drawings. FIG. 8 is a block diagram showing a comment creating unit according to a third embodiment of the present invention. 4, the same components as those in FIGS. 4 and 7 are denoted by the same reference numerals. The comment creator of the third embodiment has a configuration similar to that of the comment creator of the first embodiment shown in FIG. 4 and, as shown in FIG. And a character string input to the recognition / character string conversion means 4 and stored in the storage means 7-4 again to another voice input. It is characterized by having comment voice re-input means 7-10.

In the first embodiment, a response voice is input for the confirmation of the unconfirmed comment character string, and it is determined whether or not the response voice is affirmative. In this embodiment, when the response voice to be input is negative, the comment character string is re-entered by the comment voice re-input means 7-10.
It is possible to select whether to input from the user or to perform the process of re-recognizing and converting the already input voice information by the recognition character string re-conversion means 7-9.

Next, the operation of this embodiment will be described with reference to FIGS. FIG. 9 is a flowchart in the case where the reply voice of the present invention is an uncertain voice and the comment voice is input again or the input voice is converted again. FIG.
The same reference numerals are given to the same processing steps as those in FIG.

In FIG. 8, input speech recognition means 7-1,
Display position designation means 7-2, storage means 7-4, response voice recognition means 7-7, determination processing means 7-8, voice input unit 2, comment voice input unit 3, recognition / character string conversion means 4, response voice The input unit 5 is the same as the respective processes of the first embodiment of the digital camera image comment voice input device, and the description is omitted.

In the first embodiment, a reply voice is input for the determination of the undecided comment character string, and it is determined whether or not the response voice is affirmative. The columns are fixed. In the present embodiment, when the response voice to be input is negative, the process of inputting the comment character string again is performed, or the voice information already input is
The following processing is performed to select whether or not to perform processing for converting to a character string.

Based on the response voice information in step 111 in FIG. 9, the determination processing means 7-8 in FIG. 6 determines whether the voice is a definite voice or an undetermined voice (step 121). If it is determined that the voice is a confirmed voice, it is determined whether re-input processing of the comment voice or recognition / character string conversion of the comment voice is performed again (step 122). If it is determined that comment voice input is to be performed again, comment voice re-input means 7-1
0 is driven to re-enter the comment voice from the comment voice input unit 3 (step 103). If it is determined that the recognized comment voice is to be recognized and converted into a character string again, the recognized character string re-converting means 7- 9 is driven so that the recognition / character string conversion means 4 performs the recognition / character string of the comment voice again (step 104).

Next, a fourth embodiment of the present invention will be described with reference to the drawings. FIG. 10 shows a block diagram of a fourth embodiment of the comment creation unit of the main part of the present invention. 4, the same components as those in FIGS. 4, 7, and 8 are denoted by the same reference numerals, and description thereof will be omitted. The comment creation unit according to the fourth embodiment has the same structure as the comment creation unit according to the third embodiment shown in FIG.
D. I. linking information with recognized character string information D. This is different in that it has a cooperation means 7-3. I. D. Cooperation means 7-3
Is a means necessary for the management table 6 for associating image information input from the digital camera body 1 with fixed character string information.

Next, a fifth embodiment of the present invention will be described with reference to the drawings. FIG. 11 shows a block diagram of a fifth embodiment of the comment creation unit of the main part of the present invention. 4, the same components as those in FIGS. 4, 7, 8, and 10 are denoted by the same reference numerals, and description thereof will be omitted.

The comment creating section of the fifth embodiment has a timer 7-to set the remaining time as shown in FIG. 11 in addition to the configuration of the comment creating section of the fourth embodiment shown in FIG. 6 and a timer management means 7-5 for managing the timer 7-6, and the determination processing means 7-8 performs the timer 7-6 processing on the undetermined character string determined by the display position specification means 7-2. It is characterized in that the determination, the character string re-recognition conversion, or the character string re-input is determined within the time set in the above. The timer 7-6 stores the time information in the display data creation unit 9
Send to The storage unit 7-4 stores the determined character string data determined over time in the display data storage unit 8.

Next, the operation of this embodiment will be described with reference to FIG.
1 and FIG. FIG. 12 is a flowchart of a timer process related to character string determination according to the present invention. 12, the same processing steps as those in FIG. 9 are denoted by the same reference numerals, and description thereof will be omitted. In FIG. 11, input speech recognition means 7-1, display position designation means 7-2, storage means 7
-4, reply voice recognition means 7-7, confirmation processing means 7-8,
Recognition character string re-conversion means 7-9, comment voice re-input means 7-10, voice input unit 2, comment voice input unit 3, recognition / character string conversion means 4, reply voice input unit 5 are digital camera image comment voice Since the processing of the input device is the same as that of each of the above-described embodiments, the description is omitted.

In this embodiment, a reply voice is input for the determination of the unconfirmed comment character string, and the intention of the reply voice is determined by voice recognition. Confirm the unconfirmed character string, and if it is negative, perform the process of inputting the comment voice again without confirming, or recognize the comment voice that has already been input.
This is a process for converting to a character string.

In this embodiment, an unconfirmed character string is determined according to the timing of the response voice to be input and the initial setting, and time information can always be provided to the user-specified interface before the determination is made. It has a configuration. The processing is as follows.

When it is determined in step 110 of FIG. 12 that the result of characterizing the comment voice can be displayed, the process proceeds to step 131, where the determination processing means 7-8 determines whether or not the time is within a predetermined time by the timer 7-6. If the answer is within a predetermined time, the user inputs a comment character string displayed as an unconfirmed character string by the reply voice input unit 5 through the reply voice recognition means 7-7 using the reply voice and determines whether the voice is a definite voice or not. It is determined whether the voice is a voice (step 121). If it is determined that the voice is uncertain with a negative intention, it is determined whether the comment voice is re-input or the comment voice is recognized / characterized again (step 121). 122).

When it is determined in step 121 that the undetermined character string is to be determined based on the response voice input within the above-mentioned fixed time from the reply voice input unit 5 in FIG. When the column is determined, the determined character string data is stored in the display data storage unit 8 at the time of the determination. The transition time information obtained from the timer 7-6 and the timer management means 7-5 always provides time information to the transition time information of the interface shown in FIG. It should be noted that the transition time information is cleared from the display data creation unit 9 after the lapse of the predetermined time or when the undetermined character string is determined.

Step 113 is a process in which an undetermined character string which is a recognized character string is automatically determined after a certain period of time. By inputting a positive reply voice in steps 131 to 111, the undetermined character string is input. This is the process for determining the character string. The determined result in step 113 is stored in the display data storage unit 8 as determined character string data, and the display data creation unit 9 combines the image data visible from the screen fender with the determined character string to create display data. Then, the image output unit 10 displays and outputs these synthesis results.

The present invention is not limited to the above embodiment. For example, as shown in FIG. 13, a configuration without the management table 6 and the image output unit 10 may be used as compared with the embodiment shown in FIG. Further, as shown in FIG. 14, a configuration having the management table 6 but not having the image output unit 10 may be employed.

[0062]

Next, embodiments of the present invention will be described in detail with reference to the drawings. An example of the embodiment of the comment input device of FIG. 15 having the comment creating section 7 of FIG. 11 will be described with reference to the flowchart of FIG. In the embodiment shown in FIG. 15, the digital camera apparatus main body has a result output unit as compared with the embodiment shown in FIG.

First, a voice input unit 2 configured by a microphone or the like using a position specifying voice such as “left, right, up, down” in a fender of a digital camera to display a comment character string.
(Step 201). Then, the input voice recognition means 7-1 of the comment creating section 7 performs voice recognition of the above-mentioned position specifying voice input to the voice input section 2 (Step 202).

Next, similarly, when a comment voice such as "Bright today" is input from the comment voice input unit 3 such as a microphone (step 203), this input comment voice is recognized and recognized.
The character string conversion means 4 performs voice recognition and comment character string conversion (step 204). The result of the conversion into a character string is stored in the storage unit 7-4 of the comment creation unit 7.

Next, the result of the voice recognition by the input voice recognition means 7-1 is compared with the length of the comment character string stored in the storage means 7-4 of the comment creation section 7, and the comment character is stored in the fender of the digital camera. Whether or not the column can be displayed is determined by the display position specifying means 7-2 in the comment creating section 7 (step 205). If the length of the fender displaying the character string is longer than “comment character string start designation position + comment character string length”, the comment character string can be displayed. In that case, comment character string information to be displayed in the display data storage unit 8 is stored.

When a character string is not displayed over a plurality of lines, the length of the fender displaying the character string is calculated by dividing the length of the fender starting from the left in the fender by “the length up to the designated position of the comment character string + the comment character string”. If the length is shorter than "length," the comment character string is not displayed because the comment character string cannot be displayed.

If the comment character string is not displayed in the processing up to this point, the process returns to the first step 201, and the processing of the position designation voice input and the processing of the comment voice input are performed again (steps 201 to 204). Conversely, when displaying the comment character string, the display position is determined, and the comment character string is displayed in an undetermined character string state, and it is determined whether or not a predetermined time set by the user has elapsed (step 206). This fixed time is managed by the timer 7-6. In addition, timer 7-6
Is managed by a timer management means 7-5 such as a system timer of a personal computer.

The unconfirmed character string state of the comment character string automatically changes to the confirmed state after a lapse of a predetermined time set by the user (steps 206 and 210). If the character string is confirmed within the fixed time set by the timer, or the unconfirmed character string displayed within the time is changed, or if the character string recognition result matches within the time but is converted again, use the microphone. The reply voice is input to the reply voice part 5 composed of the above-mentioned steps (step 207). Then, it is determined whether or not the comment character string is determined based on the response voice input (step 2).
08).

If the reply voice has a positive intention, such as "Yes. OK", the reply voice is determined to be a definite voice in step 208, and the definite character string data is stored in the display data storage unit 8 ( (Step 210), the determined character string is displayed (Step 211). Conversely, if the reply voice has a negative intention, such as "re-conversion, re-input", the reply voice is determined to be an indeterminate voice in step 208, and the recognized character string re-converting means 7-9 in the comment creating section 7 It is determined whether or not the comment voice to be input is recognized and converted into a character string again (step 209). If the comment voice is recognized and converted into a character string again, the process returns to step 204, and the comment voice re-input means 7-10 is executed. When prompting the comment voice input unit 3 to input a voice completely different from the voice currently input, the process returns to step 303.

In this way, the determined character string data is stored and stored in the display data storage unit 8 constituted by a storage medium or the like. The determined character string data stored in the display data storage unit 8 is merged with the image captured by the digital camera in the display data creation unit 9. The merge result is output and displayed by the image output unit 10 as an output device.

[0071]

As described above, according to the present invention,
When a digital camera obtains image information and simultaneously records voice information with a voice recorder, it has a function to convert comment voice information that is input while displaying an image in the fender of the digital camera into a character string. Audio information can be attached as character string information to the obtained image information.

That is, according to the present invention, for the image information input to the digital camera main body while looking at the fender of the digital camera main body, the position and the comment for displaying the comment input by voice by the voice input section and the comment voice input section are displayed. Can be created in a comment character string using the comment creation unit, so that when a user uses a digital camera to display a word generated on the spot as a comment in an image, the display position and the comment are displayed on the spot. , The comment displayed when the user synthesizes the character string with the image using the digital camera can be automatically or arbitrarily determined.

Further, according to the present invention, when a comment character string is designated at a display position at the time of shooting with a current digital camera and added using voice information, voice information for positioning is added; The comment position is calculated with the comment voice input to temporarily display the character string, and the display position is calculated as an unconfirmed character string when it can be displayed and hidden when it cannot be displayed. When voice information is added as character string information to each image information of the digital camera and displayed, the display position of the comment character string specified and input by voice and the comment voice are input and then compared with the maximum displayable length. This eliminates the need for an operation to determine whether display is impossible.

Further, according to the present invention, the process of inputting a comment voice again after being determined as an undetermined character string, and the process of determining an already determined and once undetermined character string can be re-executed arbitrarily by the user. After displaying the comment character string as an undetermined character string in the fender, it is possible to cope with a case where the determined undetermined character string does not meet the user's request.

As described above, according to the present invention, it is possible to provide a system that makes use of words arising from the atmosphere of a user who uses a digital camera, and displays an image with a character string displayed on another system such as the Internet or an electronic album. Can be created instantly.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an embodiment of the present invention.

FIG. 2 is a block diagram showing a part of a first embodiment of a comment creation unit as a main part of the present invention.

FIG. 3 is a flowchart for explaining the operation of FIGS. 1 and 2;

FIG. 4 is a block diagram of a comment creation unit according to a first embodiment of the present invention;

FIG. 5 is a flowchart for explaining the operation of FIGS. 1 and 4;

FIG. 6 is a diagram showing a first embodiment of a comment creation unit as a main part of the present invention, together with a block diagram of a display data storage unit.

FIG. 7 is a block diagram of a comment creation unit according to a second embodiment of the present invention;

FIG. 8 is a block diagram of a comment creation unit according to a third embodiment of the present invention.

FIG. 9 is a flowchart for explaining the operation of FIGS. 1 and 9;

FIG. 10 is a block diagram of a fourth embodiment of a comment creation unit as a main part of the present invention.

FIG. 11 is a block diagram of a fifth embodiment of a comment creation unit according to the present invention;

FIG. 12 is a flowchart for explaining the operation of FIGS. 1 and 11;

FIG. 13 is a block diagram of another embodiment of the present invention.

FIG. 14 is a block diagram of still another embodiment of the present invention.

FIG. 15 is a block diagram of one embodiment of the present invention.

FIG. 16 is a flowchart for explaining the operation of FIG. 15;

FIG. 17 is an example of an execution screen in the interface unit showing a lapse of a predetermined time according to the present invention.

FIG. 18 is a block diagram illustrating an overall configuration of an example of a conventional device.

FIG. 19 is a plan view used to explain a key arrangement of a conventional device.

FIG. 20 is a flowchart for explaining the operation of the conventional apparatus.

FIG. 21 is an initial screen of an example of a conventional device.

FIG. 22 is a table of contents screen of an example of a conventional device.

FIG. 23 is a flowchart for explaining the operation of the conventional apparatus.

[Explanation of symbols]

 Reference Signs List 1 Digital camera body (image input unit) 2 Voice input unit 3 Comment voice input unit 4 Recognition / character string conversion unit 5 Reply voice input unit 6 Management table 7 Comment creation unit 7-1 Input voice recognition unit 7-2 Display position designation Means 7-3 I. D. Cooperation means 7-4 Storage means 7-5 Timer management means 7-6 Timer 7-7 Response voice recognition means 7-8 Confirmation processing means 7-9 Recognition character string reconversion means 7-10 Comment voice reinput means 8 Display data Storage unit 9 display data creation unit 10 image output unit

────────────────────────────────────────────────── ─── Continued on front page (58) Field surveyed (Int. Cl. ⁷ , DB name) H04N 5/222-5/257

Claims (10)

(57) [Claims] 1. A digital camera main body for inputting image information, and a voice input unit for voice-designating a position for displaying a comment for the image information input to the digital camera main body while looking at a fender of the digital camera main body. A comment voice input unit for voicely inputting a comment to be displayed at a position designated by the voice input unit; and a recognized character string for recognizing the comment voice input to the comment voice input unit and converting the comment voice into a character string in an undetermined state. A response voice input unit for inputting a response voice relating to the finalization or indefiniteness of the comment character string converted into a character string in the undetermined state, and referring to the image information input to the digital camera body, Based on the position designation voice input from the voice input unit and the comment voice input from the comment voice input unit, It is determined whether or not the comment character string converted into a character string in the undecided state can be displayed in the fender. When the comment character string can be displayed, the comment in the undecided state is used by using the reply voice input from the reply voice input unit. It determines determined / undetermined character string, accumulation and commenting unit that outputs a fixed character string information and the display position information, and the comment character display position information and confirmed character string information of the column that the comment creating unit is determined A display data storage unit, a display data generation unit for merging the image information input by the digital camera body and information stored in the display data storage unit, and output the information generated by the display data generation unit. A digital camera image comment input device, comprising: 2. The comment creation unit according to claim 1, wherein the comment creation unit is configured to convert the comment into a character string in an undetermined state based on a position designation voice input from the voice input unit and a comment voice input from the comment voice input unit. It is determined whether or not the character string can be displayed in the fender. If the character string cannot be displayed, the character string is determined based on the position designation voice input again from the voice input unit and the comment voice input again from the comment voice input unit. 2. The digital camera image comment input device according to claim 1, wherein it is determined again whether the comment character string converted into a character string in an undetermined state can be displayed in the fender. 3. The comment creating unit determines whether the comment character string in the undecided state is confirmed / unconfirmed by using a reply voice input from the reply voice input unit, wherein the reply voice is affirmative. 2. The comment input device for a digital camera image according to claim 1, wherein the comment character string in an undetermined state is determined if the intention is a confirmed voice. 4. The comment creating section determines whether the comment character string in the undecided state is confirmed / unconfirmed by using a reply voice input from the reply voice input section, wherein the reply voice is input after a voice is input. 2. A digital camera image comment input device according to claim 1, wherein said comment input means is provided for inputting said comment again if the voice is uncertain voice intended to re-enter the undetermined character string. 5. The comment creating unit according to claim 1, wherein said response voice is input from said response voice input unit to determine whether said comment character string in said undetermined state has been determined / undetermined. 2. The digital camera image comment input device according to claim 1, further comprising means for recognizing the comment character string and converting it into a character string when the voice is uncertain voice intended to reconvert the column. 6. The comment creating unit according to claim 1, wherein when the comment character string in the undetermined state is determined, the comment creating unit stores the data of the determined comment character string in a display data storage unit. A comment input device for the described digital camera image. 7. The comment creation unit further includes a timer for setting a remaining time and outputting time information, and timer management means for managing the timer, and a position designation voice input from the voice input unit. Based on the comment voice input from the comment voice input unit and whether or not the comment character string converted into a character string in the undetermined state can be displayed in the fender. 2. The digital camera image according to claim 1, wherein the response voice input from the response voice input unit within the time set in the step (a) is used to determine the confirmation or the character string re-recognition conversion or the character string re-input. Comment input device. 8. The comment creation unit determines whether a comment character string converted into a character string in the undetermined state can be displayed in the fender, and when display is possible, after a time set by the timer has elapsed. 2. The digital camera image comment input device according to claim 1, wherein the comment character string is automatically determined. 9. The digital camera image comment input device according to claim 7, further comprising means for displaying a degree of elapse of a predetermined time until the undetermined comment character string is determined. 10. Time information for merging image information input from the digital camera main body with a comment character string stored in the display data storage unit and changing within a predetermined time obtained by the comment creation unit is also provided. 8. The digital camera image comment input device according to claim 7, further comprising a display data creating section for reflecting the comment.