JP5915053B2 - Information generating apparatus, information generating method and program - Google Patents

Description

  The present invention relates to an information generation device, an information generation method, and a program.

2. Description of the Related Art Conventionally, a printer that prints text information such as a place name and a landmark name in an image based on GPS information related to an imaging location of the image data stored as Exif information in the image data is known (for example, Patent Document 1).
There is also known an apparatus that prints information specifying a destination of a printed material on the back surface of the printed material (for example, see Patent Document 2).

JP 2006-148538 A Japanese Patent Laid-Open No. 2003-77872

  However, the techniques disclosed in Patent Documents 1 and 2 simply print information related to an image, such as text information and information for specifying a destination, at a predetermined position on a printed material, which is useful for the user. Could not provide enough information.

  Therefore, an object of the present invention is to provide an information generation apparatus, an information generation method, and a program that can effectively provide various types of information related to images useful for a user.

In order to solve the above problems, an information generation apparatus according to the present invention includes a first acquisition unit that acquires a captured image, and a second acquisition unit that acquires a plurality of types of related information indicating a situation at the time of capturing the captured image. First specifying means for specifying auxiliary words for assisting combinations of words indicating the contents of each related information in accordance with the type indicating the situation at the time of imaging of each related information acquired by the second acquiring means And a word indicating the content of each type of related information indicating the situation at the time of imaging acquired by the second acquiring unit , and combining the auxiliary word specified by the first specifying unit , a first generating means for generating a description to explain the situation at the time of imaging, description describes a condition at the time of imaging, which is generated by the first generating means, the predetermined position of the recording medium in which the captured image is formed To be placed in It is characterized by comprising: a second generating means for generating output information of a predetermined arrangement manner, a.

  According to the present invention, it is possible to effectively provide various types of information related to images useful for the user.

It is a block diagram which shows schematic structure of the imaging device of one Embodiment to which this invention is applied. FIG. 2 is a diagram schematically illustrating an example of an information table stored in the imaging apparatus in FIG. 1. FIG. 2 is a block diagram illustrating a schematic configuration of a printer connected to the imaging apparatus of FIG. 1. 3 is a flowchart illustrating an example of an operation related to output information generation processing by the imaging apparatus of FIG. 1. 5 is a flowchart showing a continuation of the output information generation process of FIG. It is a figure for demonstrating the output information generation process of FIG. FIG. 5 is a diagram for describing print information generated by the output information generation process of FIG. 4.

  Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.

  The imaging apparatus 100 according to the present embodiment generates a description B describing the captured image P by combining a plurality of related information related to the captured image P in accordance with a predetermined rule. Output information of a predetermined arrangement mode that is arranged at a predetermined position of the recording medium (the printing substrate K) to be formed is generated.

FIG. 1 is a block diagram illustrating a schematic configuration of an imaging apparatus 100 according to an embodiment to which the present invention is applied.
As shown in FIG. 1, specifically, the imaging device 100 includes an imaging unit 1, a memory 2, an image processing unit 3, a GPS processing unit 4, an autonomous navigation processing unit 5, and an information processing unit 6. , An information recording unit 7, a display control unit 8, a display unit 9, a recording medium control unit 10, a communication control unit 11, an operation input unit 12, and a central control unit 13.
In addition, the imaging unit 1, the memory 2, the image processing unit 3, the GPS processing unit 4, the autonomous navigation processing unit 5, the information processing unit 6, the information recording unit 7, the display control unit 8, the recording medium control unit 10, and the communication control unit 11 The central control unit 13 is connected via a bus line 14.

  The imaging unit 1 captures a subject (for example, a human face) as an imaging unit, and generates a frame image. Specifically, the imaging unit 1 includes a lens unit 1a, an electronic imaging unit 1b, an imaging control unit 1c, and an image data generation unit 1d.

The lens unit 1a includes a plurality of lenses such as a zoom lens and a focus lens, for example.
The electronic imaging unit 1b is composed of, for example, an image sensor such as a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS). The electronic imaging unit 1b converts an optical image that has passed through the various lenses of the lens unit 1a into a two-dimensional image signal.

The imaging control unit 1c controls imaging of the subject by the imaging unit 1. That is, the imaging control unit 1c includes a timing generator, a driver, and the like, although not illustrated. Then, the imaging control unit 1c scans and drives the electronic imaging unit 1b with a timing generator and a driver, and converts the optical image into a two-dimensional image signal with the electronic imaging unit 1b every predetermined period. The frame image is read out from the imaging area for each screen and is output to the image data generation unit 1d.
In addition, the imaging control unit 1c controls the driving of a focusing drive unit (not shown) when imaging a subject, and moves the focus lens in the optical axis direction to adjust the focusing position of the lens unit 1a. .
Further, in addition to AF (automatic focusing process), the imaging control unit 1c may perform adjustment control of conditions when imaging a subject such as AE (automatic exposure process) and AWB (automatic white balance).

The image data generation unit 1d appropriately adjusts the gain for each RGB color component with respect to the analog value signal of the frame image transferred from the electronic imaging unit 1b, and then performs sample holding by a sample hold circuit (not shown). The digital signal is converted into digital data by a / D converter (not shown), color processing including pixel interpolation processing and γ correction processing is performed by a color process circuit (not shown), and then a digital luminance signal Y and color difference signal Cb , Cr (YUV data).
The luminance signal Y and the color difference signals Cb and Cr output from the color process circuit are DMA transferred to a memory 2 used as a buffer memory via a DMA controller (not shown).

  Although not shown in the drawing, the imaging unit 1 adjusts the amount of light passing through the lens unit 1a, a zoom drive unit that moves the zoom lens in the optical axis direction, and moves the focus lens in the optical axis direction. A focusing drive unit or the like may be provided.

  The memory 2 is composed of, for example, a DRAM (Dynamic Random Access Memory) or the like, and temporarily stores data processed by the image processing unit 3, the information processing unit 6, the central control unit 13, and the like.

The image processing unit 3 includes, for example, an encoding unit and a decoding unit (both not shown).
The encoding unit compresses and encodes the recording image data acquired from the memory 2 by a predetermined encoding method (for example, Motion-JPEG method, JPEG method, etc.).
The decoding unit decodes the encoded image data read from the recording medium M by the recording medium control unit 10 using a decoding method corresponding to the encoding method.

The GPS processing unit 4 performs positioning (GPS positioning) using GPS (global positioning system).
That is, the GPS processing unit 4 includes a receiving antenna 4a that receives data transmitted from the GPS satellite S.

The receiving antenna 4a is a GPS signal (for example, almanac (rough orbit information)) or ephemeris (detailed orbit) transmitted from a plurality of GPS satellites S (positioning satellites; only one is shown in FIG. 1) launched in low earth orbit Information) and the like) are received at a predetermined timing, and the GPS signal is output to the GPS processing unit 4. The GPS processing unit 4 performs a demodulation process of a GPS signal received via the receiving antenna 4a, and acquires various transmission data of GPS satellites. Then, the GPS processing unit 4 performs a predetermined positioning calculation based on the acquired transmission data, thereby positioning the absolute two-dimensional current position (latitude, longitude) of the terminal main body to the position. Such positional information (for example, coordinate information of latitude and longitude) is acquired as a positioning result.
For example, the GPS processing unit 4 sequentially acquires position information related to the current position of the apparatus main body at predetermined time intervals.

The autonomous navigation processing unit 5 performs positioning (autonomous navigation positioning) using an autonomous navigation sensor.
That is, the autonomous navigation processing unit 5 includes a triaxial geomagnetic sensor 5a, a triaxial acceleration sensor 5b, an atmospheric pressure sensor 5c, and a control processing unit 5d.

  The triaxial geomagnetic sensor 5a is an autonomous navigation sensor and detects the magnitudes of geomagnetism in three axial directions orthogonal to each other. Then, the triaxial geomagnetic sensor 5a outputs a detected signal of each axis to the control processing unit 5d.

  The triaxial acceleration sensor 5b is an autonomous navigation sensor and detects accelerations in three axial directions orthogonal to each other. The triaxial acceleration sensor 5b samples the detected signals of the respective axes at a predetermined frequency and outputs the sampled signals to the control processing unit 5d.

  The atmospheric pressure sensor 5c is a sensor that detects atmospheric pressure in order to obtain a height difference. The atmospheric pressure sensor 5c outputs a detection signal of the detected atmospheric pressure to the control processing unit 5d.

The control processing unit 5d continuously performs autonomous navigation positioning calculation based on the detection data detected by the triaxial geomagnetic sensor 5a and the triaxial acceleration sensor 5b.
That is, the control processing unit 5d acquires the detection data detected by the triaxial geomagnetic sensor 5a and the triaxial acceleration sensor 5b at a predetermined sampling period, and the movement direction and movement of the imaging apparatus 100 main body from these detection data. Calculate the amount. Further, the control processing unit 5d adds the vector data including the calculated moving direction and moving amount to the position data of the current position of the apparatus main body immediately before the detection data is acquired, thereby obtaining the positioning result of the autonomous navigation. The position data which is is calculated. In addition, the control processing unit 5d acquires the relative displacement of the apparatus main body by continuously calculating the position data at predetermined time intervals.
Further, in addition to the calculation of the movement direction and the movement amount, the control processing unit 5d also calculates the movement amount in the height direction from the change in the output value of the detection signal detected by the atmospheric pressure sensor 5c.

The information processing unit 6 includes an image acquisition unit 6a, a related information acquisition unit 6b, an explanation sentence generation unit 6c, a map acquisition unit 6d, and an output information generation unit 6e.
In addition, although each part of the information processing part 6 is comprised from the predetermined logic circuit, for example, the said structure is an example and is not restricted to this.

The image acquisition unit 6a acquires an image used for output information generation processing (described later).
That is, the image acquisition unit 6a acquires image data of a captured image P (see FIG. 7A) captured by the imaging unit 1 as a first acquisition unit. Specifically, the image acquisition unit 6 a sequentially acquires, from the memory 2, image data (YUV data) of the captured image P generated by the image data generation unit 1 d by imaging the subject by the imaging unit 1.

The related information acquisition unit 6b acquires related information used for output information generation processing.
That is, the related information acquisition unit 6b acquires a plurality of related information related to the captured image P as a second acquisition unit. Specifically, the related information acquisition unit 6b includes an information specifying unit b1 that specifies imaging related information and image related information as related information, and the imaging related information and image related information specified by the information specifying unit b1. To get.
The related information may be information including at least one of the imaging related information and the image related information, and does not necessarily include both.

The imaging related information is various information related to the imaging process of the captured image P by the imaging unit 1. Specifically, the imaging related information includes position information related to the imaging position of the apparatus main body at the time of imaging the captured image P, direction information related to the imaging direction by the imaging unit 1, and an image related to the angle of view of the imaging unit 1. It includes angular information, date information related to the date of imaging by the imaging unit 1, time information related to the time of imaging by the imaging unit 1, and the like.
That is, for example, when the image is captured, the information specifying unit b1 is based on the result of the GPS positioning by the GPS processing unit 4 or the autonomous navigation positioning by the autonomous navigation processing unit 5, and the latitude associated with the imaging position of the device main body. Identify location information such as longitude and altitude.
The information specifying unit b1 is, for example, a direction in which the lens unit 1a of the imaging unit 1 is exposed based on detection signals from the triaxial geomagnetic sensor 5a, the triaxial acceleration sensor 5b, and the like when an image is captured. For example, the direction information relating to the direction) is specified.
Further, the information specifying unit b1, for example, at the time of capturing an image, based on the radius and focal length of the image circle of the electronic imaging unit 1b, the nominal diagonal field angle, horizontal field angle, vertical direction of the lens unit 1a The angle of view information related to the angle of view is specified.
In addition, the information specifying unit b1 uses, for example, date information (for example, year / month / day) or time information (for example, current time) based on the time measured by a timing unit (not shown) at the time of capturing an image. Is identified.

  Further, the information specifying unit b1 refers to a map database 7c, an event database 7d (described later), etc. of the information recording unit 7 based on the plurality of acquired related information, and specifically specifies a word indicating the related information. You may specify the name information shown as a name. For example, the information specifying unit b1 may specify the name of an event (for example, a XX festival) related to the captured image P as the name information from the event database 7d based on date information and time information. Further, for example, the information specifying unit b1 may specify a name (for example, XX castle) related to the imaging position of the captured image P as the name information from the map database 7c based on the position information.

Note that the imaging-related information only needs to include at least one of position information, direction information, angle-of-view information, date information, and time information, and does not necessarily include all these information.
Further, the position information, the direction information, the angle of view information, the date information, and the time information exemplified as the imaging related information are examples and are not limited thereto, and can be arbitrarily changed as appropriate. For example, the imaging related information may include movement information related to the movement trajectory of the apparatus main body before and after the imaging timing of the image. The information specifying unit b1 may perform GPS positioning or the like by the GPS processing unit 4 after imaging, for example. Based on the result of the autonomous navigation positioning by the autonomous navigation processing unit 5, the movement information related to the movement locus of the apparatus body is specified from the position where the apparatus body exists.

The image related information is various information related to the content of the captured image P. Specifically, the image related information includes subject information related to the main subject Pa in the captured image P, background information related to the background of the main subject Pa in the captured image P, and the like.
The information specifying unit b1 uses, as second specifying means, subject information related to the main subject Pa in the captured image P based on position information related to the imaging position of the apparatus main body and direction information related to the imaging direction by the imaging unit 1. Identify. Specifically, the information specifying unit b1 uses the acquired positional information, direction information, and distance information related to the imaging distance (focus distance) calculated from the position of the focus lens of the imaging unit 1 at the time of imaging. Based on the position of the main subject Pa in the captured image P and referring to the map database 7c of the information recording unit 7, the name corresponding to the position of the main subject Pa (eg, location, building, object, etc.) Name) is specified as subject information.
The information specifying unit b1 specifies background information related to the background of the main subject Pa in the captured image P based on the position information and the direction information. That is, the information specifying unit b1 specifies the background range of the main subject Pa in the captured image P based on the acquired position information and direction information when the image is captured, and the map database of the information recording unit 7 With reference to 7c, a name (for example, a name related to a place, a building, a region, etc.) corresponding to the background range is specified as background information.
The angle-of-view information may be used when the information specifying unit b1 specifies the position of the main subject Pa and the background range.

Note that the image-related information only needs to include at least one of the subject information and the background information, and does not necessarily need to include both pieces of information.
The subject information and the background information exemplified as the image related information are examples and are not limited to these, and can be arbitrarily changed as appropriate.

  Then, the related information acquisition unit 6b includes at least any two of position information, direction information, angle of view information, date information and time information, subject information, and background information specified as related information by the information specifying unit b1. Get information. Here, the related information acquisition unit 6b acquires name information (for example, an event name) corresponding to each related information specified by the information specifying unit b1 as one of at least two pieces of information. May be.

The explanatory note generation unit 6c generates an explanatory note B that explains the captured image P.
That is, the explanatory note generation unit 6c serves as a first generation unit, which explains the captured image P by combining a plurality of pieces of related information acquired by the related information acquisition unit 6b according to a predetermined rule (FIG. 7B). ))). Specifically, the explanatory note generation unit 6c generates the text data of the explanatory note B including the subject name related to the subject information acquired by the related information acquisition unit 6b and the background name related to each of the background information. For example, the explanatory note generation unit 6c combines the subject name and background name associated with each of the subject information and background information acquired by the related information acquisition unit 6b together with a plurality of related information according to a predetermined rule, and the text of the explanatory note B Generate data.
Here, the predetermined rule is a rule based on a grammar of a language used in a country or region where the apparatus main body is used. For example, 5W1H (When, Where, Who, What, What, How, ) May be considered.

Moreover, the explanatory note production | generation part 6c comprises the auxiliary word specific | specification part c1 which specifies an auxiliary word.
Here, an auxiliary word assists a combination of words indicating the contents of a plurality of related information. Examples of auxiliary words include particles, verbs, phrases composed of predetermined character strings, and the like added to words related to related information. In addition, the auxiliary word may be one in which the expression of the ending is changed according to the position (for example, the end of the sentence) in the entire explanatory sentence B.
The auxiliary word specifying unit c1 specifies an auxiliary word that assists a combination of words indicating the contents of the related information according to the types of the plurality of related information acquired by the related information acquiring unit 6b as the first specifying unit. To do. Specifically, the auxiliary word specifying unit c1 is the central control unit 13 according to a predetermined operation of the operation input unit 12 by the user among the format numbers defined in the format information table 7a (described later) of the information recording unit 7. A format corresponding to the format number designated by the CPU is identified, and the corresponding information type (for example, position information, direction information, subject information, background information, etc.) defined in each item of the format is supported. Identify words.
And the explanatory note production | generation part 6c produces | generates the text data of the explanatory sentence B combining the word which shows the content of several relevant information according to a predetermined rule using the auxiliary word specified by the auxiliary word specific | specification part c1. Here, the order of combining the words indicating the contents of the plurality of related information and the auxiliary words may be the order of items defined in each format number of the format information table 7a, or the order of the items may be appropriately determined. The order may be rearranged.

For example, the explanatory note generation unit 6c generates the text data of the explanatory note B by combining position information (including altitude information), direction information, background information, and subject information according to a predetermined rule. That is, the explanatory note generation unit 6c includes “from the top of the castle castle tower” as the detailed contents of the “location information”, “from the top” as the “auxiliary word”, and “south” as the “direction information”. “Direction” as “auxiliary word”, “Pacific” as the detailed content of “background information”, “Float in” as “auxiliary word”, and “△” as detailed content of “subject information” △ Text data of explanatory text B that combines “island”, “to” as “auxiliary word”, “□□” as detailed content of “subject information”, and “desire” as “auxiliary word” Is generated.
In addition, when combining time information, the explanatory note generating unit 6c, for example, includes “XX” as “position information”, “kara” as “auxiliary word”, and detailed contents of “time information”. Text of description B combining “early morning”, “no” as “auxiliary word”, “△△” as the detailed content of “subject information” and “desiring” as “auxiliary word” Generate data.
When the event content is specified from the date information or the time information, the explanatory note generation unit 6c, for example, “XX” as “position information”, “NO” as “auxiliary word”, “ “Autumn” as “date information”, “no” as “auxiliary words”, “□□” as detailed contents of “date information”, “festival” as “auxiliary words”, and “subject information” The text data of the explanatory sentence B combining “ΔΔ temple” as the detailed contents of “” is generated.
In addition, when the movement information is specified, the explanatory note generation unit 6c, for example, “○○ (start point)” and “□□ (end point)” as “movement information” and “◯” as “auxiliary words”. “On the way from ○ to □□”, “△△” as “location information”, “kara” as “auxiliary word”, “● ● mountain” and “ Text data of an explanatory sentence B is generated by combining “Imaging” as an “auxiliary word”.
In addition, the above-mentioned description B is an example, is not restricted to these, It can change arbitrarily arbitrarily.

The map acquisition unit 6d acquires map information corresponding to the map T within a predetermined range.
That is, the map acquisition unit 6d acquires map information corresponding to the imaging position of the imaging apparatus 100 main body that captures the captured image P as the third acquisition unit. Specifically, the map acquisition unit 6d refers to the map database 7c of the information recording unit 7 based on the position information associated with the captured image P, and map information corresponding to the image capturing position related to the position information. To get.
Here, the map information is, for example, a map corresponding to a map T within a predetermined range that is actually printed (output) in consideration of the display resolution of the display unit 9, the imaging position, the position of the main subject Pa, and the like. Information may be acquired, or map information corresponding to a map T in a wider range than the actually printed range may be acquired.

The output information generation unit 6e generates print information having a predetermined arrangement mode in which the explanatory text B is arranged at a predetermined position of the printing base material K on which the captured image P is formed.
That is, the output information generation unit 6e serves as a second generation unit in which the explanatory text B generated by the explanatory text generation unit 6c is a predetermined position (for example, on the back surface K2) of the printing substrate K on which the captured image P is formed. Print information (output information) having a predetermined arrangement form that is arranged in the center, lower right, etc.) is generated. Specifically, the output information generation unit 6e is arranged in the central control unit 13 according to a predetermined operation of the operation input unit 12 by a user among layout numbers defined in a print information table 7b (described later) of the information recording unit 7. Each of the front surface K1 and the back surface K2 (see FIGS. 7A and 7B) of the printing substrate K according to a predetermined arrangement form defined in association with the layout number specified by the CPU of FIG. Print surface information and print back surface information (print information) are generated.
Here, the predetermined arrangement mode is an arrangement mode in which the explanatory text B is arranged at a predetermined position on the back surface K2 of the printing base material K on which the captured image P is formed on the front surface K1, or the printing base material K. A word indicating the content of at least one related information of the plurality of related information is arranged at a predetermined position on the front surface K1 on which the captured image P is formed, and explained at a predetermined position on the back surface K2 of the printing substrate K. An arrangement mode in which the sentence B is arranged, or an arrangement mode in which the map T and the description B relating to the map information acquired by the map acquisition unit 6d are arranged at a predetermined position on the back surface K2 of the printing substrate K. Etc.
Note that the above-described arrangement modes are examples and are not limited thereto, and can be arbitrarily changed as appropriate.

  The information recording unit 7 stores a format information table 7a (see FIG. 2A), a print information table 7b (see FIG. 2B), a map database 7c, and an event database 7d.

FIG. 2A shows an example of the format information table 7a.
The format information table 7a is a table in which auxiliary words for assisting combinations of words indicating the contents of related information are defined. Specifically, the format information table 7a stores a format number and a format related to a combination of a plurality of auxiliary words in association with each other. Each of the plurality of auxiliary words is divided into items according to, for example, types of imaging related information and image related information. Each item is associated with the type of imaging-related information or image-related information and the content of the auxiliary word, but depending on the type of imaging-related information or image-related information, it is also associated with the content. Yes.

For example, as shown in FIG. 2A, in the format information table 7a, format numbers “1” and “2” define a format in which four items are associated, and format numbers “3” to “5”. "Defines a format in which three items are associated with each other.
Among these, “item 1” in the format of the format number “1” is associated with “position information” as the type of the imaging related information and “kara” as the content of the auxiliary word, and “item 2”. Are associated with “direction information” as a type of imaging related information and “direction” as an auxiliary word, and “item 3” has “background information” as a type of image related information, “Sea” as the content is associated with “Float in” as an auxiliary word, and “Item 4” includes “Subject information” as the type of image related information and “Non-person” as the content ”And“ wanted ”as an auxiliary word are associated with each other.
In addition, the “item 1” in the format of the format number “2” includes “position information” as a type of imaging related information, “high” as the content, and “from the top” as an auxiliary word. “Item 2” is associated with “direction information” as the type of imaging-related information and “direction” as an auxiliary word, and “item 3” is the type of image-related information. "Background information" as the content, "Mountain" as the content, and "Back to back" as the auxiliary word, "Item 4" as "Subject information" as the type of image related information "Person" as the content and "san" as the auxiliary word are associated with each other.
Also, “item 1” in the format of the format number “3” is associated with “position information” as the type of imaging related information and “kara” as an auxiliary word, and “item 2” “Time information” as the type of imaging related information is associated with “no” as an auxiliary word, and “item information” as the type of image related information and “subject information” as an auxiliary word are associated with “item 3”. “Wish” is associated.
Also, “item 1” in the format of the format number “4” is associated with “position information” as the type of imaging related information and “no” as an auxiliary word, and “item 2” “Date information” as the type of imaging related information, “season” as the content thereof, and “no” as an auxiliary word are associated with each other, and “item 3” has “ “Date information” is associated with “festival” as its contents and “festival” as an auxiliary word.
Also, “item 1” in the format of the format number “5” is associated with “movement information” as the type of imaging related information and “on the way from OO to □□” as an auxiliary word. , “Item 2” is associated with “position information” as the type of imaging-related information and “kara” as an auxiliary word, and “item 3” is “subject” as the type of image-related information. "Information" is associated with "Imaging" as an auxiliary word.
The format information table 7a described above is an example and is not limited to this. The type of various information stored in the table can be arbitrarily changed as appropriate.

FIG. 2B is a diagram illustrating an example of the print information table 7b.
The print information table 7b is a table in which the explanatory text B, the related information, and the arrangement mode of the map T in the printing substrate K are defined. Specifically, the print information table 7b includes a layout number, a “surface layout” according to the arrangement mode of the front surface K1 of the printing substrate K, and a “back surface layout” according to the arrangement mode of the back surface K2 of the printing substrate K. Is stored in association with each other. In addition, each of the “front layout” and “back layout” includes a print item related to a print content such as a word indicating related information and a format of an explanatory note B, and a print position related to a print position on the printing substrate K. Are associated with each other.

For example, as shown in FIG. 2B, in the print information table 7b, the layout numbers “1” to “3” and “5” are associated with “front layout” and “back layout”, and the layout number “ “4” is associated with “back layout”.
Of these, “front layout” with layout number “1” is associated with “subject name” as a print item and “lower right” as a print position, and “back layout” has a print item as a print item. Are associated with “format number 1” as a print item and “bottom center” as a print position.
In addition, the “front surface layout” of the layout number “2” is associated with “imaging date and time” as a print item and “bottom center” as the print position, and “back layout” as a print item. “Format number 3” is associated with “bottom center” as the print position.
Also, the “front surface layout” of layout number “3” is associated with “imaging location” as a print item and “lower right” as the print position, and “back surface layout” has a print item as a print item. “Format number 4” is associated with “bottom center” as the print position.
Further, “format number 2” as a print item and “upper center” as a print position are associated with “back layout” of layout number “4”.
Also, the “front surface layout” of the layout number “5” is associated with “subject name” as a print item and “position determination by image analysis” as the print position, and “back surface layout” has a print “Format number 1” as an item is associated with “bottom center” as a print position. “Position identification by image analysis” means that predetermined image analysis processing (for example, high-frequency component identification processing) is performed on the image data of the captured image P, and predetermined related information in the captured image P is obtained. This refers to a process of specifying a position (for example, any one of the four corners of an image) that is considered to have a relatively small effect on visibility even if superimposed (for example, “subject name” or the like).
The above-described print information table 7b is an example and is not limited to this, and the types of various information stored in the table can be arbitrarily changed as appropriate. For example, the print layout of the print information table 7b includes information on the format number that is adopted by default when any format number is not specified based on a predetermined operation of the operation input unit 12 by the user. May be.

Although not shown, the map database 7c stores, for example, names of places, buildings, objects, regions, etc. in association with position coordinates. That is, in the map database 7c, name information such as location, building, object, and area is associated with coordinate information such as latitude, longitude, and altitude.
The map database 7c described above is an example and is not limited to this, and the contents of information stored in the database can be arbitrarily changed as appropriate.

Although not shown in the figure, the event database 7d stores the names of events such as festivals, birthdays and anniversaries in association with the times. That is, the event database 7d associates event name information such as festivals, birthdays, and anniversaries with time information such as dates, times, and time zones.
The event database 7d described above is merely an example, and the present invention is not limited to this. The contents of information stored in the database can be arbitrarily changed as appropriate.

The display control unit 8 performs control for reading display image data temporarily stored in the memory 2 and displaying the read image data on the display unit 9.
Specifically, the display control unit 8 includes a VRAM (Video Random Access Memory), a VRAM controller, a digital video encoder, and the like. The digital video encoder reads the luminance signal Y and the color difference signals Cb and Cr read from the memory 2 and stored in the VRAM (not shown) under the control of the central control unit 13 through the VRAM controller. Are periodically read out, and a video signal is generated based on these data and output to the display unit 9.

  The display unit 9 is, for example, a liquid crystal display panel, and displays an image captured by the electronic imaging unit 1b based on a video signal from the display control unit 8 on a display screen. Specifically, the display unit 9 sequentially updates a plurality of frame images generated by imaging the subject by the imaging unit 1 and the imaging control unit 1c at a predetermined frame rate in the still image capturing mode and the moving image capturing mode. While displaying the live view image. The display unit 9 displays an image (rec view image) recorded as a still image or an image being recorded as a moving image.

The recording medium control unit 10 is configured such that the recording medium M is detachable, and controls reading of data from the loaded recording medium M and writing of data to the recording medium M.
That is, the recording medium control unit 10 causes the recording medium M to record the recording image data encoded in a predetermined compression format (eg, JPEG format) by the encoding unit (not shown) of the image processing unit 3. .
The recording medium M is composed of, for example, a non-volatile memory (flash memory) or the like. However, the recording medium M is an example and is not limited to this, and can be arbitrarily changed as appropriate.

The communication control unit 11 is connected to the external printer 200 so as to be able to communicate information by a predetermined connection method.
That is, for example, the communication control unit 11 communicates with the printer 200 (detailed later; see FIG. 3) and information via a predetermined bus interface (for example, USB (Universal Serial Bus)) or a dedicated connection device. Connect to enable communication. Specifically, the communication control unit 11 transmits print information (print surface information and print back surface information) of the captured image P and a print instruction to the printer 200 in an output information generation process (described later).

  The operation input unit 12 is for performing a predetermined operation of the imaging apparatus 100. Specifically, the operation input unit 12 includes a shutter button related to an imaging instruction of a subject, a selection determination button related to an instruction to select an imaging mode and a function, a zoom button related to an instruction to adjust the zoom amount, and the like (all not shown). And a predetermined operation signal is output to the central control unit 13 in accordance with the operation of each button of the operation unit.

The selection determination button of the operation input unit 12 is associated with a predetermined format of the explanatory text B on a format designation screen (not shown) displayed on the display unit 9 based on a predetermined operation by the user, for example. A setting instruction for one of the plurality of format numbers is input. Then, a predetermined setting signal is output to the central control unit 13 in accordance with the operation of the selection determination button.
In accordance with the input setting signal, the CPU of the central control unit 13 uses the explanatory note generation unit 6c to generate a predetermined format corresponding to the user-desired format number among the plurality of format numbers stored in the format information table 7a. This is specified as the format of the explanation B to be generated.
Here, the operation input unit 12 and the central control unit 13 constitute first specifying means for specifying a predetermined rule relating to generation of the explanatory text B by the explanatory text generating unit 6c.

Note that the predetermined rule relating to the generation of the explanatory note B may be automatically specified by the central control unit (first specifying means) 13 as a predetermined predetermined rule as a default.
Alternatively, two or more types of predetermined rules may be specified, and the user may select any one explanatory text B after generating the corresponding explanatory text B as a candidate.
Further, as will be described later, based on the designation of the print layout by the central control unit 13, the “format number **” included in the print item in the print layout is designated as the format number related to the format of the explanatory note B. Anyway.

In addition, the selection determination button of the operation input unit 12 is based on a predetermined operation by the user, for example, on the front surface K1 or the back surface of the printing substrate K on a print layout designation screen (not shown) displayed on the display unit 9. A setting instruction for any one of the layout numbers associated with the print layout of K2 is input. Then, a predetermined setting signal is output to the central control unit 13 in accordance with the operation of the selection determination button.
The CPU of the central control unit 13 prints the print layout corresponding to the user-desired layout number among the plurality of layout numbers stored in the print information table 7b according to the input setting signal by the output information generation unit 6e. It is designated as a predetermined arrangement mode related to information generation.
Here, the operation input unit 12 and the central control unit 13 constitute second specifying means for specifying a predetermined arrangement mode related to generation of output information by the output information generation unit 6e.

Note that the predetermined arrangement mode relating to the generation of output information (print information) is such that a predetermined arrangement mode predetermined as a default is automatically specified by the central control unit (second specifying means) 13. Also good.
Further, two or more types of predetermined arrangement modes may be designated, and the user may select any one piece of output information after generating output information corresponding to each as a candidate.

  The central control unit 13 controls each unit of the imaging apparatus 100. Specifically, although not shown, the central control unit 13 includes a CPU (Central Processing Unit) and the like, and performs various control operations according to various processing programs (not shown) for the imaging apparatus 100.

Next, the printer 200 will be described with reference to FIG.
FIG. 3 is a block diagram illustrating a schematic configuration of the printer 200.
As shown in FIG. 3, specifically, the printer 200 includes a central control unit 201, a communication control unit 202, a printing unit 203, and the like.

The central control unit 201 controls each unit of the printer 200. Specifically, the central control unit 201 includes a CPU, a RAM, and a ROM (all not shown), and the CPU performs various control operations according to various processing programs (not shown) for the printer 200 stored in the ROM. Do. At that time, the CPU stores various processing results in a storage area in the RAM, and displays the processing results on a display unit (not shown) as necessary.
The RAM includes, for example, a program storage area for expanding a processing program executed by the CPU, a data storage area for storing input data, a processing result generated when the processing program is executed, and the like.
The ROM executes a program stored in the form of computer-readable program code, specifically, a system program that can be executed by the printer 200, various processing programs that can be executed by the system program, and these various processing programs. The data used at the time is stored.

The communication control unit 202 is connected to the imaging apparatus 100 so as to be able to perform information communication using a predetermined connection method.
That is, the communication control unit 202 connects to the imaging apparatus 100 so as to be able to perform information communication via, for example, a predetermined bus interface (for example, USB) or a dedicated connection device.
Specifically, the communication control unit 202 receives print information (print front surface information and print back surface information) and a print instruction of the captured image P transmitted from the image capturing apparatus 100 and outputs them to the print unit 203.

The printing unit 203 prints the captured image P on the front surface K1 of the printing base material K (recording medium) and prints the explanatory text B on the back surface K2 of the printing base material K in a predetermined arrangement manner.
That is, the printing unit 203, based on the printing information (printing surface information and printing back surface information) of the captured image P received by the communication control unit 202 and the printing instruction, print surface information (for example, imaging) corresponding to the printing instruction. The image P, the subject name, etc.) are printed on the front surface K1 of the printing substrate K by a predetermined printing method, and the printed back surface information (for example, the map T and the description B) is printed on the back surface K2 of the printing substrate K. Printing is performed by a predetermined printing method so as to obtain a predetermined arrangement mode (see FIGS. 7A and 7B).
As the predetermined printing method, various known methods can be applied, and examples thereof include an ink jet printing method. The recording method is exemplified as printing, but is not limited to this, and can be arbitrarily changed as long as it is a method capable of forming an image, description B, or the like on the printing substrate K. .

Next, output information generation processing by the imaging apparatus 100 will be described with reference to FIGS.
4 and 5 are flowcharts illustrating an example of an operation related to the output information generation process. FIG. 6 is a diagram for explaining the output information generation processing, and is a diagram schematically illustrating an example of an imaging operation of a subject. FIGS. 7A and 7B are diagrams for explaining the print information generated by the output information generation process, and schematically illustrate an example of the front surface K1 and the back surface K2 of the printing substrate K. FIG.

The output information generation process is performed when the output information generation mode is selected from a plurality of operation modes displayed on the menu screen based on a predetermined operation of the selection determination button of the operation input unit 12 by the user. This process is executed by each unit of the imaging apparatus 100 under the control of the control unit 13.
The following output information generation processing will be described by exemplifying print information relating to information printed on the recording medium M as output information.

As shown in FIG. 4, first, the CPU of the central control unit 13 designates a print layout based on a predetermined operation of the operation input unit 12 by the user (step S1).
Specifically, on the print layout designation screen (not shown) displayed on the display unit 9, the print layouts of the front surface K1 and the back surface K2 are determined based on a predetermined operation of the selection determination button of the operation input unit 12 by the user. When any one layout number (for example, layout number “1”, etc.) is selected and instructed from among the plurality of associated layout numbers, the central control unit 13 is stored in the print information table 7b. Among the plurality of layout numbers, the print layout corresponding to the layout number desired by the user according to the selection instruction is designated as a predetermined arrangement mode related to generation of print information by the output information generation unit 6e. Information relating to the designated print layout is temporarily stored in a predetermined storage means (for example, the memory 2).

Next, the CPU of the central control unit 13 determines whether an imaging instruction has been input based on a predetermined operation of the shutter button of the operation input unit 12 by the user (step S2). The determination as to whether or not the imaging instruction is input in step S2 is repeatedly executed at predetermined time intervals until it is determined that the imaging instruction is input (step S2; YES).
If it is determined in step S2 that an imaging instruction has been input (step S2; YES), the imaging control unit 1c adjusts the imaging condition of the imaging unit 1 to the predetermined imaging condition, and then focuses on the predetermined in the background. An image of the subject (see FIG. 7A) is captured in accordance with the subject (for example, Kinkakuji, etc .; see FIG. 6) (step S3). The image data generation unit 1d converts the image signal of the captured image P of the subject into a digital image signal, and generates YUV data of the captured image P.
The YUV data of the captured image P generated by the image data generation unit 1 d is output to the memory 2 and temporarily stored in the memory 2.

Subsequently, the related information acquisition unit 6b acquires the imaging related information specified by the information specifying unit b1 as basic information (step S4).
Specifically, for example, the related information acquisition unit 6b, based on the results of the GPS positioning by the GPS processing unit 4 and the autonomous navigation positioning by the autonomous navigation processing unit 5, the latitude, longitude, Specify and acquire location information such as altitude. For example, the related information acquisition unit 6b specifies direction information related to the direction in which the lens unit 1a of the imaging unit 1 is exposed based on detection signals from the triaxial geomagnetic sensor 5a, the triaxial acceleration sensor 5b, and the like. Get. Further, for example, the related information acquisition unit 6b specifies and acquires field angle information related to the nominal diagonal field angle of the lens unit 1a based on the radius and focal length of the image circle of the electronic imaging unit 1b. Further, for example, the related information acquisition unit 6b specifies an imaging distance from the position of the focus lens of the imaging unit 1 and acquires distance information related to the imaging distance. For example, the related information acquisition unit 6b specifies and acquires date information and time information based on the time measured by the time measuring unit.
Note that the acquired basic information (imaging related information) is temporarily stored in a predetermined storage unit (for example, the memory 2).

Next, the related information acquisition unit 6b determines in advance whether generation of name information (for example, a subject name or the like) is instructed from the basic information based on a predetermined operation of the operation input unit 12 by a user in advance ( Step S5).
If it is determined that generation of name information is not instructed (step S5; NO), the recording medium control unit 10 uses a coding unit of the image processing unit 3 to perform a predetermined compression format (for example, JPEG format or the like). ) And the image data of the captured image P encoded in step S6) and various types of imaging-related information are associated with each other to generate a file in a predetermined format (for example, Exif format) and record the file on the recording medium M (step S6). ).
Thereby, the output information generation process is terminated.

On the other hand, if it is determined in step S5 that generation of name information is instructed (step S5; YES), the information specifying unit b1 of the related information acquisition unit 6b displays the position information related to the imaging position and the imaging direction. The position of the main subject Pa in the captured image P is specified based on the direction information related to the image, the angle of view information related to the angle of view of the imaging unit 1 and the distance information related to the imaging distance (step S7; see FIG. 6). Information regarding the position of the identified main subject Pa is temporarily stored in a predetermined storage unit (for example, the memory 2).
Subsequently, the information specifying unit b1 determines the background of the main subject Pa in the captured image P based on the position information related to the imaging position, the direction information related to the imaging direction, and the angle of view information related to the angle of view of the imaging unit 1. A range is specified (step S8). Information relating to the specified background range is temporarily stored in a predetermined storage means (for example, the memory 2 or the like).

Next, the information specifying unit b1 refers to the map database 7c of the information recording unit 7 based on the position information related to the imaging position, and names related to the imaging position of the captured image P (for example, the region name and the place name) , Building name, etc.) are specified (step S9). Information relating to the name related to the identified imaging position is temporarily stored in a predetermined storage unit (for example, the memory 2).
Subsequently, the information specifying unit b1 acquires information related to the position of the main subject Pa from a predetermined storage unit, and then refers to the map database 7c of the information recording unit 7 to specify a name corresponding to the position of the main subject Pa. (For example, names related to places, buildings, objects, etc.) are specified as subject information (name information) (step S10). The identified subject information is temporarily stored in a predetermined storage means (for example, the memory 2).
Next, the information specifying unit b1 acquires information related to the background range from a predetermined storage unit, and then refers to the map database 7c of the information recording unit 7 to specify a name (for example, a location) corresponding to the background range. , Names related to buildings, objects, etc.) are specified as background information (name information) (step S11). The identified background information is temporarily stored in a predetermined storage means (for example, the memory 2).
Here, for example, when an image database for image analysis is recorded in the information recording unit 7, the information specifying unit b1 performs image analysis using the image database and performs the name and background of the main subject Pa. The name corresponding to the range may be specified.

Next, the information specifying unit b1 refers to the event database 7d of the information recording unit 7 based on the date information and time information, and names related to the event related to the captured image P (for example, event names and season names). , Time zone classification, etc.) are specified (step S12). Information relating to the name of the event related to the identified captured image P is temporarily stored in a predetermined storage unit (for example, the memory 2).
The order of obtaining the various name information described above is an example and is not limited to this, and can be arbitrarily changed as appropriate.

Subsequently, the explanatory note generation unit 6c determines whether generation of the explanatory note B is instructed based on a predetermined operation of the operation input unit 12 by the user in advance (step S13).
Here, if it is determined that generation of the explanatory text B is not instructed (step S13; NO), the recording medium control unit 10 uses the encoding unit of the image processing unit 3 to perform a predetermined compression format (for example, JPEG format). Etc.), the image data of the captured image P encoded in the above, the various image-related information, and the various name information (for example, subject information, background information, a name related to the image capturing position, an event name, etc.) are associated with each other. Then, a file of a predetermined format (for example, Exif format) is generated and recorded on the recording medium M (step S14).
Thereby, the output information generation process is terminated.

On the other hand, if it is determined in step S13 that the generation of the explanatory note B is instructed (step S13; YES), as shown in FIG. 5, the output information generation unit 6e has been designated from a predetermined storage means. The information related to the print layout is acquired (step S15). Then, the output information generation unit 6e determines whether or not any “format number **” (for example, “format number 1”) is included in the print item specified by the acquired print layout. (Step S16).
If it is determined that any “format number **” is included (step S16; YES), the explanatory note generation unit 6c corresponds to “format number **” included in the print layout. A predetermined format is adopted as the format of the explanatory text B. That is, the explanatory note generation unit 6c refers to the format information table 7a and corresponds to “format number **” included in the print layout among the plurality of format numbers stored in the format information table 7a. The predetermined format is used as the format of the explanatory text B generated by the explanatory text generating unit 6c, and information related to the format of the explanatory text B is acquired (step S17).

On the other hand, if it is determined in step S16 that any “format number **” is not included (step S16; NO), the CPU of the central control unit 13 displays a format designation screen (not shown). It is displayed on the unit 9 (step S18), and designation of the format of the explanatory note B based on a predetermined operation of the operation input unit 12 by the user is accepted.
Then, the CPU of the central control unit 13 designates the format of the explanatory text B based on a predetermined operation of the operation input unit 12 by the user (step S19). Specifically, based on a predetermined operation of the selection determination button of the operation input unit 12 by the user, any one format number from among a plurality of format numbers associated with the predetermined format of the explanatory note B When (for example, format number 1 or the like) is selected and instructed, the central control unit 13 selects a format number desired by the user related to the selection instruction from among the plurality of format numbers stored in the format information table 7a. The corresponding predetermined format is designated as the format of the explanatory note B generated by the explanatory note generating unit 6c.

Subsequently, the explanatory note generating unit 6c acquires information related to the format of the explanatory note B designated by the central control unit 13 (step S20).
In addition, although the format of the explanatory note B is specified based on a predetermined operation of the operation input unit 12 by the user, it is an example, for example, a predetermined rule that the central control unit 13 is predetermined as a default. May be automatically specified.
Further, regardless of whether or not the print layout is designated in step S1, the CPU of the central control unit 13 designates the format of the explanatory note B based on a predetermined operation of the operation input unit 12 by the user at a predetermined timing. Anyway.

After the processing of step S17 and step S20, the explanatory note generating unit 6c includes each item of the format of the acquired explanatory note B among the various imaging-related information and various name information stored in the predetermined storage unit. The information corresponding to the type of related information specified in (1) is acquired (step S21). When the format of the explanatory note B is the format of the format number “1”, for example, “position information” specified by the type of item 1 is acquired.
Subsequently, the auxiliary word specifying unit c1 of the explanatory note generating unit 6c adds auxiliary words (for example, “kara”, etc.) added to the words related to the acquired related information (for example, “location information”, etc.), respectively. Identify and use the specified auxiliary words to combine words indicating the contents of a plurality of related information according to a predetermined rule in the description sentence B (for example, “I want Kinkakuji from XX to △△”) Text data is generated (step S22).

  Subsequently, the output information generation unit 6e generates print surface information for printing the surface K1 of the printing substrate K (step S23). Specifically, the output information generation unit 6e is designated by a print item designated by the surface layout of the print layout in various imaging-related information and various name information stored in a predetermined storage unit. The information corresponding to the type of related information (for example, “Kinkakuji” which is the “subject name”) is acquired, and the acquired information is superimposed on the print position corresponding to the print item of the captured image P Print surface information is generated. When “format number **” (for example, format number 1) is designated as the print item, the text data generated by the explanatory note generating unit 6c is designated as the print position (for example, ”Etc.) is generated.

Next, the map acquisition unit 6d refers to the map database 7c of the information recording unit 7, and acquires map information corresponding to the map T in a range including the imaging position where the apparatus main body exists and the position where the main subject Pa exists ( Step S24).
Thereafter, the output information generation unit 6e generates print back surface information for printing the back surface K2 of the printing substrate K (step S25). Specifically, the output information generation unit 6e arranges the map T at the corresponding print position on the back surface K2 of the printing base material K based on the acquired map information according to the back surface layout of the print layout, and the description. Based on the text data of the explanatory text B generated by the text generating unit 6c, the explanatory text B (for example, “I want Kinkakuji in the direction from OO to ΔΔ” at the corresponding printing position on the back surface K2 of the printing substrate K). Etc.) is generated.
FIG. 7B illustrates the back surface K2 of the printing base material K on which the movement trajectory of the apparatus main body before and after the imaging timing is also printed.

Next, the CPU of the central control unit 13 determines in advance whether or not printing of the captured image P is instructed based on a predetermined operation of the operation input unit 12 by the user (step S26).
Here, if it is determined that the generation of the print of the captured image P is instructed (step S26; YES), the CPU of the central control unit 13 prints the print surface information and the print back surface information of the generated captured image P ( Print information) and a print instruction are associated with each other and transmitted from the communication control unit 11 to the printer 200 (step S27).
After the printer 200 establishes a connection with the communication control unit 11 of the imaging apparatus 100 via the communication control unit 202, the printing unit 203 prints print surface information (for example, corresponding to the print instruction received by the communication control unit 202). , The captured image P, the subject name, etc.) are printed on the front surface K1 of the printing substrate K by a predetermined printing method, and the printed back surface information (for example, the map T and the description B) is printed on the back surface of the printing substrate K. Printing on K2 by a predetermined printing method.

On the other hand, when it is determined in step S26 that generation of printing of the captured image P is not instructed (step S26; NO), the CPU of the central control unit 13 determines the print surface information of the generated captured image P and the print surface information. A file of a predetermined format is generated in association with the print back surface information and recorded on the recording medium M (step S28).
Thereby, the output information generation process is terminated.

  As described above, according to the imaging apparatus 100 of the present embodiment, a plurality of pieces of related information related to the captured image P are predetermined at predetermined positions of the recording medium (the printing substrate K) on which the captured image P is formed. Since the output information (printing information) in a predetermined arrangement mode is generated such that the combined explanatory text B is arranged in accordance with the above-mentioned rules, the image is captured by the user who has visually recognized the explanatory text B arranged at a predetermined position on the recording medium. Various information related to the image P can be grasped. That is, for example, various related information such as imaging related information related to imaging of the captured image P by the imaging unit 1 and image related information related to the content of the captured image P is not simply arranged in a predetermined order. By arranging the explanatory text B in which a plurality of related information is combined according to a predetermined rule, the user can recognize the plurality of related information related to the captured image P as a series of information simply by reading the explanatory text B. it can. Therefore, it is possible to effectively provide various information related to images useful for the user.

  Further, according to the types of the plurality of related information, an auxiliary word that assists the combination of words indicating the contents of the related information is specified, and the explanatory sentence B is generated using the auxiliary word. By using each auxiliary word corresponding to the type of information, it is possible to generate a description B of an appropriate expression, and it is possible to effectively provide various types of information related to images useful for the user.

Further, an arrangement mode in which the explanatory text B is arranged at a predetermined position on the back surface K2 of the printing substrate K on which the captured image P is formed on the front surface K1, or the captured image P of the printing substrate K is formed. A word indicating the content of at least one of the plurality of pieces of related information is arranged at a predetermined position on the front surface K1, and an explanatory note B is arranged at a predetermined position on the back surface K2 of the printing substrate K. Print information in such an arrangement manner that the map T and the description B relating to the map information corresponding to the imaging position of the apparatus main body are arranged at a predetermined position on the back surface K2 of the printing substrate K is generated. Therefore, the arrangement | positioning aspect of the explanatory note B in the base material K for printing can be made various, and the provision of the various information relevant to an image useful for a user can be performed effectively.
In particular, when the explanatory text B is arranged on the surface K1 of the printing substrate K on which the captured image P is formed, the captured image P needs to be reduced or superimposed on the captured image P. By arranging the explanatory text B at a predetermined position on the back surface K2 of the printing substrate K, there is no restriction on the printing mode of the captured image P, and the explanatory text B together with the captured image P is given to the user. Can be provided effectively.

Further, the imaging related information relates to position information related to an imaging position where the apparatus main body exists, direction information related to an imaging direction by the imaging unit 1, angle of view information related to an angle of view of the imaging unit 1, and an imaging date of the imaging unit 1. Since at least one of the date information and the time information related to the image capturing time by the image capturing unit 1 is included, the description B can be made more diverse by combining these various image capturing related information according to a predetermined rule. can do.
The image-related information includes at least one of the subject information related to the main subject Pa in the captured image P and the background information related to the background of the main subject Pa in the captured image P. The description B can be made more diverse by combining related information according to a predetermined rule.
Further, as the related information, at least any two of the position information, the direction information, the angle of view information, the date information and the time information, and the subject information and the background information are acquired, so that these various types of related information are predetermined. The description B can be made more diverse by combining them according to the rules.
In this way, the explanatory text B for explaining the captured image P can be expressed in a variety of expression formats, and various information related to images useful for the user can be provided more effectively. .

Further, based on the position information related to the imaging position of the apparatus main body and the direction information related to the imaging direction by the imaging unit 1, the subject information related to the main subject Pa in the captured image P is specified and acquired, and the subject information is included in the subject information. A description B including the subject name is generated. More specifically, in addition to the position information and the direction information, the subject information related to the main subject Pa in the captured image P is specified based on the imaging distance of the imaging unit 1, and the main subject Pa of the captured image P is specified. The background information related to the background of the subject is specified and acquired, and the subject name and the description B including the background name related to each of the background information are generated, so that the content of the explanation B is more recognized by the user Therefore, it is possible to provide various information related to the image more effectively.
At this time, by acquiring the imaging location name, the subject name, and the background name relating to each of the position information, the subject information, and the background information using the predetermined map database 7c, an accurate description of the imaging location, the subject, and the background is provided. The sentence B can be generated, and various information related to images useful for the user can be provided more effectively.

  In addition, since a predetermined rule relating to generation of the explanatory note B can be specified, an explanatory note B combining a plurality of related information can be generated according to a predetermined rule desired by the user, which is useful for the user. It is possible to more effectively provide various types of information related to simple images.

  Furthermore, since a predetermined arrangement mode related to generation of output information can be specified, output information can be generated according to a predetermined arrangement mode desired by the user, and various types of information related to images useful for the user Can be provided more effectively.

The present invention is not limited to the above-described embodiment, and various improvements and design changes may be made without departing from the spirit of the present invention.
For example, in the above embodiment, the description B is arranged on the back surface K2 of the printing substrate K. However, the description B is not limited to this example, and the position where the description B is arranged is It can be arbitrarily changed as appropriate. That is, when the length of the description B is shorter than a predetermined value, the surface K1 is disposed even at a predetermined position (for example, any one of the four corners) of the surface K1 of the printing substrate K. It is thought that there is little influence on the visibility of the picked-up image formed in the. In this case, print information may be generated such that the explanatory note B is arranged at a predetermined position on the surface K1 of the printing substrate K.

In the above-described embodiment, print information having a predetermined arrangement mode in which the explanatory text B is arranged at a predetermined position of the recording medium on which the captured image P is formed is generated as output information. However, the present invention is not limited to this. For example, image information of a predetermined arrangement mode in which the explanatory text B is arranged at a predetermined position of the captured image P displayed on the display unit 9 may be generated.
Even with such a configuration, it is possible to allow the user who has visually recognized the explanatory note B arranged at a predetermined position of the captured image P displayed on the display unit 9 to grasp various information related to the captured image P. Therefore, it is possible to effectively provide various information related to images useful for the user.

In the above-described embodiment, the related information acquisition unit 6b acquires the imaging place name, the subject name, and the background name when generating the description B. However, this is an example, and the present invention is not limited to this. For example, after the description sentence generation unit 6c acquires the position information, subject information, and background information acquired by the related information acquisition unit 6b, the information recording unit displays the imaging location name, subject name, and background name associated with each of the information. 7 may be obtained with reference to the map database 7c.
Even with such a configuration, it is possible to generate output information of a predetermined arrangement mode in which a description B in which a plurality of pieces of related information related to the captured image P are combined according to a predetermined rule is arranged. It is possible to effectively provide various types of information related to images useful for the user.

  Furthermore, the configuration of the imaging apparatus 100 is merely an example illustrated in the above embodiment, and is not limited thereto. Moreover, although the imaging apparatus 100 is illustrated as an information generation apparatus, it is not limited to this, and any configuration may be used as long as the information generation process according to the present invention can be executed.

In addition, in the above embodiment, the functions of the first acquisition unit, the second acquisition unit, the first generation unit, and the second generation unit are controlled under the control of the central control unit 13, and the image acquisition unit 6a, The related information acquisition unit 6b, the description sentence generation unit 6c, and the output information generation unit 6e are configured to be driven. However, the configuration is not limited thereto, and a predetermined program or the like is executed by the central control unit 13. It is good also as a structure implement | achieved by doing.
In other words, a program including a first acquisition processing routine, a second acquisition processing routine, a first generation processing routine, and a second generation processing routine is stored in a program memory (not shown) that stores the program. Then, the CPU of the central control unit 13 may function as an acquisition unit that acquires the captured image P by the first acquisition processing routine. Further, the CPU of the central control unit 13 may function as a second acquisition unit that acquires a plurality of related information related to the captured image P by the second acquisition processing routine. In addition, the CPU of the central control unit 13 generates a descriptive text B that explains the captured image P by combining the plurality of related information acquired by the second acquisition unit according to a predetermined rule by the first generation processing routine. You may make it function as a production | generation means. In addition, the CPU of the central control unit 13 in the second generation processing routine, the explanatory text B generated by the first generation unit is the recording medium on which the captured image P is formed or the captured image P displayed on the display unit 9. You may make it function as a 2nd production | generation means which produces | generates the output information of the predetermined arrangement | positioning aspect arrange | positioned at a predetermined position.

  Similarly, the first specifying means, the second specifying means, the third obtaining means, the first specifying means, and the second specifying means are also realized by executing a predetermined program or the like by the CPU of the central control unit 13. It is good also as a structure.

  Furthermore, as a computer-readable medium storing a program for executing each of the above processes, a non-volatile memory such as a flash memory or a portable recording medium such as a CD-ROM is applied in addition to a ROM or a hard disk. Is also possible. A carrier wave is also used as a medium for providing program data via a predetermined communication line.

Although several embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and equivalents thereof.
The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as set forth in the claims attached to the application of this application.
[Appendix]
<Claim 1>
First acquisition means for acquiring a captured image;
Second acquisition means for acquiring a plurality of related information related to the captured image;
A first generation unit configured to combine the plurality of related information acquired by the second acquisition unit according to a predetermined rule to generate an explanatory text for explaining the captured image;
The explanatory text generated by the first generation unit generates output information of a predetermined arrangement form such that the explanatory text is arranged at a predetermined position of the captured image displayed on the recording medium or the display unit on which the captured image is formed. Second generating means for
An information generation device comprising:
<Claim 2>
The first generation means includes
According to the type of the plurality of related information acquired by the second acquisition means, the first specifying means for specifying an auxiliary word that assists a combination of words indicating the contents of the related information is provided. The information generation apparatus according to claim 1, wherein the explanatory text is generated using the auxiliary word specified by the specifying unit.
<Claim 3>
The said predetermined arrangement | positioning aspect includes the arrangement | positioning aspect that the said explanatory note is arrange | positioned in the predetermined position of the back surface of the said recording medium in which the said captured image is formed in the surface. The information generating device described.
<Claim 4>
In the predetermined arrangement mode, a word indicating the content of at least one related information of the plurality of related information is further arranged at a predetermined position on the surface of the recording medium on which the captured image is formed. The information generating apparatus according to claim 3, further comprising an arrangement form in which the explanatory text is arranged at a predetermined position on the back surface of the recording medium.
<Claim 5>
A third acquisition means for acquiring map information corresponding to an imaging position of an imaging apparatus main body that captures the captured image;
The predetermined arrangement mode further includes an arrangement mode in which a map related to the map information acquired by the third acquisition unit and the explanatory text are arranged at a predetermined position on the back surface of the recording medium. The information generation device according to claim 3.
<Claim 6>
The related information includes at least one of imaging related information related to imaging of the captured image by an imaging unit of an imaging device and image related information related to the content of the captured image. The information generation device according to any one of 5.
<Claim 7>
The imaging related information includes position information relating to an imaging position where the imaging apparatus main body exists, direction information relating to an imaging direction by the imaging unit, angle of view information relating to an angle of view of the imaging unit, and a date of imaging by the imaging unit. The information generation apparatus according to claim 6, wherein the information generation apparatus includes at least one of the date information and the time information related to the image capturing time by the image capturing unit.
<Claim 8>
The image-related information includes at least one of subject information relating to a main subject in the captured image and background information relating to a background of the main subject in the captured image. The information generation device described in 1.
<Claim 9>
The imaging related information includes position information relating to an imaging position where the imaging apparatus main body exists, direction information relating to an imaging direction by the imaging unit, angle of view information relating to an angle of view of the imaging unit, and a date of imaging by the imaging unit. Including at least one of the date information and the time information related to the time of imaging by the imaging unit,
The image-related information includes at least one of information of subject information related to a main subject in the captured image and background information related to a background of the main subject of the captured image,
The second acquisition means includes
As the related information, at least any two of the position information, the direction information, the angle of view information, the date information and the time information, and the subject information and the background information are acquired. The information generation apparatus according to claim 6.
<Claim 10>
The second acquisition means includes
A second specifying unit configured to specify subject information relating to a main subject in the captured image based on position information relating to an imaging position of the imaging device body and direction information relating to an imaging direction by an imaging unit of the imaging device; And acquiring the subject information specified by the second specifying means,
The first generation means includes
The information generation apparatus according to claim 1, wherein the explanatory text including a subject name related to the subject information acquired by the second acquisition unit is generated.
<Claim 11>
The second specifying means further includes:
Based on the imaging distance of the imaging unit in addition to the position information and the direction information, the subject information related to the main subject in the captured image is specified, and the background related to the background of the main subject of the captured image Identify information,
The second acquisition means includes
Obtaining the subject information and the background information specified by the second specifying means;
The first generation means includes
The information generation apparatus according to claim 10, wherein the explanatory text including the subject name and the background name related to each of the subject information and the background information acquired by the second acquisition unit is generated.
<Claim 12>
The first generation means includes
The location information acquired by the second acquisition means, the subject information and the background name of the subject, the subject name and the background name are acquired using predetermined map information, and the explanatory text is obtained. The information generation apparatus according to claim 11, wherein the information generation apparatus generates the information.
<Claim 13>
Further comprising first specifying means for specifying a predetermined rule relating to generation of the explanatory text by the first generating means;
The first generation means includes
The information generation apparatus according to claim 1, wherein the explanatory text is generated by combining the plurality of pieces of related information according to a predetermined rule specified by the first specifying unit.
<Claim 14>
A second designating unit for designating a predetermined arrangement related to the generation of the output information by the second generating unit;
The second generation means includes
The information generation device according to any one of claims 1 to 12, wherein the output information is generated according to a predetermined arrangement mode specified by the second specifying means.
<Claim 15>
An information generation method using an information generation device,
Processing to acquire a captured image;
A process of acquiring a plurality of related information related to the captured image;
A process of generating a descriptive text describing the captured image by combining the plurality of acquired related information according to a predetermined rule;
Processing for generating output information of a predetermined arrangement mode such that the generated explanatory text is arranged at a predetermined position of the captured image displayed on the recording medium or display unit on which the captured image is formed;
An information generation method comprising:
<Claim 16>
The computer of the information generation device
First acquisition means for acquiring a captured image;
Second acquisition means for acquiring a plurality of related information related to the captured image;
A first generation unit configured to combine the plurality of related information acquired by the second acquisition unit according to a predetermined rule to generate an explanatory text for explaining the captured image;
The explanatory text generated by the first generation unit generates output information of a predetermined arrangement form such that the explanatory text is arranged at a predetermined position of the captured image displayed on the recording medium or the display unit on which the captured image is formed. Second generating means for
A program characterized by functioning as

DESCRIPTION OF SYMBOLS 100 Imaging device 1 Imaging part 6 Information processing part 6a Image acquisition part 6b Related information acquisition part b1 Information specification part 6c Description sentence generation part c1 Auxiliary word specification part 6d Map acquisition part 6e Output information generation part 13 Central control part 200 Printer

Claims (12)

First acquisition means for acquiring a captured image;
Second acquisition means for acquiring a plurality of types of related information indicating a situation at the time of capturing the captured image;
First specifying means for specifying auxiliary words for assisting combinations of words indicating the contents of each related information according to the type indicating the situation at the time of imaging of each related information acquired by the second acquiring means; ,
When the captured image is captured by combining the auxiliary word identified by the first identifying unit with the word indicating the content of each type of related information indicating the situation at the time of capturing acquired by the second acquiring unit. First generation means for generating an explanatory text explaining the situation of
A second description for generating output information of a predetermined arrangement mode such that the explanatory text explaining the situation at the time of imaging generated by the first generation means is arranged at a predetermined position of the recording medium on which the captured image is formed. Generating means;
An information generation device comprising:   The second acquisition means includes, as a plurality of types of related information indicating the situation at the time of imaging, position information relating to an imaging position, direction information relating to an imaging direction, angle of view information relating to an angle of view of an imaging unit, and an imaging date. A plurality of pieces of information are acquired from the date information, the time information related to the imaging time, the subject information related to the captured main subject, and the background information related to the background of the captured main subject. 1. The information generation device according to 1.   The said predetermined arrangement | positioning aspect includes the arrangement | positioning aspect that the said explanatory note is arrange | positioned in the predetermined position of the back surface of the said recording medium in which the said captured image is formed in the surface. The information generating device described.   The predetermined arrangement mode further indicates the content of at least one related information of a plurality of types of related information indicating the situation at the time of imaging at a predetermined position on the surface of the recording medium on which the captured image is formed. 4. The information generating apparatus according to claim 3, further comprising an arrangement form in which words are arranged and the explanatory text is arranged at a predetermined position on the back surface of the recording medium. A third acquisition means for acquiring map information corresponding to an imaging position of an imaging apparatus main body that captures the captured image;
The predetermined arrangement mode further includes an arrangement mode in which a map related to the map information acquired by the third acquisition unit and the explanatory text are arranged at a predetermined position on the back surface of the recording medium. The information generation device according to claim 3. The second acquisition means includes
A second specifying unit configured to specify subject information relating to a main subject in the captured image based on position information relating to an imaging position of the imaging apparatus main body and direction information relating to an imaging direction by an imaging unit of the imaging apparatus; , Acquiring the subject information specified by the second specifying means,
The first generation means includes
The information generation apparatus according to claim 1, wherein the description including the subject name related to the subject information acquired by the second acquisition unit is generated. The second specifying means further includes:
Based on the imaging distance of the imaging unit in addition to the position information and the direction information, the subject information related to the main subject in the captured image is specified, and the background related to the background of the main subject of the captured image Identify information,
The second acquisition means includes
Obtaining the subject information and the background information specified by the second specifying means;
The first generation means includes
The information generation apparatus according to claim 6, wherein the description including the subject name and the background name related to each of the subject information and the background information acquired by the second acquisition unit is generated. The first generation means includes
The location information acquired by the second acquisition means, the subject information and the background name of the subject, the subject name and the background name are acquired using predetermined map information, and the explanatory text is obtained. The information generation apparatus according to claim 7, wherein the information generation apparatus generates the information. Further comprising first specifying means for specifying a predetermined rule relating to generation of the explanatory text by the first generating means;
The first generation means further includes:
9. The information generating apparatus according to claim 1, wherein the explanatory text is generated by combining the plurality of related information according to a predetermined rule specified by the first specifying means. A second designating unit for designating a predetermined arrangement related to the generation of the output information by the second generating unit;
The second generation means includes
The information generation apparatus according to claim 1, wherein the output information is generated according to a predetermined arrangement mode specified by the second specifying unit. An information generation method using an information generation device,
Processing to acquire a captured image;
A process of acquiring a plurality of types of related information indicating a situation at the time of capturing the captured image;
A process of identifying an auxiliary word that assists a combination of words indicating the contents of each related information according to a type indicating a situation at the time of imaging of each acquired related information,
Relative term indicating the contents of the associated information of each type of indicating the status at the time of the obtained captured, generates a legend describing the situation at the time of imaging of the captured image by combining said auxiliary word that is specific Processing,
Processing for generating output information of a predetermined arrangement mode such that the explanatory text explaining the generated situation at the time of imaging is arranged at a predetermined position of the recording medium on which the captured image is formed;
An information generation method comprising: The computer of the information generation device
First acquisition means for acquiring a captured image;
Second acquisition means for acquiring a plurality of types of related information indicating a situation at the time of capturing the captured image;
First identifying means for identifying an auxiliary word that assists a combination of words indicating the contents of each related information according to a type indicating a situation at the time of imaging of each related information acquired by the second acquiring means;
When the captured image is captured by combining the auxiliary word identified by the first identifying unit with the word indicating the content of each type of related information indicating the situation at the time of capturing acquired by the second acquiring unit. First generation means for generating an explanatory note explaining the situation of
A second description for generating output information of a predetermined arrangement mode such that the explanatory text explaining the situation at the time of imaging generated by the first generation means is arranged at a predetermined position of the recording medium on which the captured image is formed. Generating means,
A program characterized by functioning as