JP6918306B2 - Photo management equipment, photo management methods, and programs - Google Patents

Description

The present invention relates to a photo management device or the like that manages drawing information in association with a photo.

For example, the usefulness of using drawings and photographs in places such as areas, buildings, and construction sites is widely known. Since drawings have an overall picture of the place and photographs have detailed information about a specific part of the place, it is possible to obtain information about the place more quickly and accurately by associating and organizing the two. As a method of associating and organizing the two, methods such as assigning a reference number to the photographs and categorizing them into a hierarchical structure are often used.

Further, conventionally, there has been an electronic album creation server capable of generating screen information for displaying an image related to a photograph on a map after appropriately estimating a shooting position (see, for example, Patent Document 1).

JP-A-2002-19374

However, in the conventional method, since the work of associating the drawing with the photograph is performed after the photograph is taken, it is necessary to redetermine the position and direction of the photograph from the photograph. This work has to rely on human power, which is a waste of time and labor, and carries the risk of misorganizing.

In addition, there was no technique for associating photographs with specific points in drawing information other than maps.

That is, with the conventional method and the conventional technique, it is difficult to organize the photographs taken by associating them with the points of the drawing information.

In view of such a problem, the present invention provides an apparatus capable of managing a photograph, including information on the position where the photograph was taken, or information on the position and direction when the photograph is taken. With the goal.

The photo management device of the first invention has a drawing information storage unit for storing drawing information, a photo storage unit for storing one or more photographs, a drawing information output unit for outputting drawing information, and a drawing information output. The instruction information reception unit that receives the instruction information, which is the information related to the instruction to specify the point on the drawing information output by the department and includes the point information to specify the point, and the instruction information reception unit that receives the instruction information, and then the photograph. A shooting instruction receiving unit that receives a shooting instruction, a shooting unit that shoots and acquires a photo in response to a shooting instruction, and a photo storage unit that stores a photo in a photo storage unit in association with the point information possessed by the instruction information. It is a photo management device provided with.

With such a configuration, it is possible to easily manage the photograph taken in association with the point of the drawing information.

Further, in the photo management device of the second invention, with respect to the first invention, the instruction information includes the point information and the direction information indicating the shooting direction, and the photo storage unit includes the point information and the direction information. It is a photo management device that stores photos in a photo storage unit in association with.

With such a configuration, it is possible to easily manage the photographed photograph by associating the point of the drawing information with the photographing direction.

Further, the photo management device of the third invention includes an incidental information acquisition unit for acquiring incidental information which is contextual information at the time of taking a photograph, and a photo storage unit for the first or second invention. It is a photo management device that stores incidental information in the photo storage unit in association with the point information.

With such a configuration, it is possible to easily manage the photograph taken by associating the point of the drawing information with the incidental information.

Further, the photo management device of the fourth invention is a photo management device in which the incidental information is time information related to the time of shooting, as opposed to the third invention.

With such a configuration, it is possible to easily manage the photograph taken by associating the point of the drawing information with the time information.

Further, in the photo management device of the fifth invention, for any one of the first to fourth inventions, the photo storage unit can store two or more photographs in the same manner in association with the point information. It is a management device.

With such a configuration, two or more photographs taken from the same point can be easily managed in association with the points in the drawing information.

Further, the photo management device of the sixth invention uses one or more point information corresponding to one or more photographs of the photo storage unit for any one of the first to fifth inventions. A drawing information configuration unit with a symbol that constitutes drawing information with a symbol by adding a symbol to a point corresponding to one or more point information to the drawing information, an output instruction receiving unit that receives an output instruction of the drawing information, and a drawing information output. The unit is a photo management device that outputs drawing information with a pattern in response to acceptance of an output instruction.

With such a configuration, the points to which the photographed photographs correspond can be easily confirmed on the drawing information.

Further, the photo management device of the seventh invention has a symbol instruction receiving unit for receiving a symbol instruction for a symbol of drawing information with a symbol output by the drawing information output unit and a symbol instruction receiving unit for the sixth invention. In response to the reception, the instruction photo acquisition unit that acquires two or more photographs that are paired with the point information corresponding to the symbol for the symbol instruction from the photo storage unit, and one or more photographs acquired by the instruction photo acquisition unit. It is a photo management device further provided with an instruction photo output unit that outputs side by side based on the information of.

With such a configuration, it is possible to easily confirm two or more photographs taken at one point and two or more photographs arranged appropriately.

Further, in the photo management device of the eighth invention, with respect to the seventh invention, the instruction photo output unit has two or more photographs acquired by the instruction photo acquisition unit based on the time information corresponding to the photo. It is a photo management device that sorts and outputs.

With such a configuration, two or more photographs taken at one point, and two or more photographs arranged based on time information can be easily confirmed.

Further, in the photo management device of the ninth invention, when the photography instruction receiving unit receives the photography instruction for the seventh invention after receiving the design instruction, the photography unit takes a picture. The photo storage unit is a photo management device that acquires a photo and stores the photo in the photo storage unit in association with the point information corresponding to the symbol corresponding to the symbol instruction.

With such a configuration, it is possible to easily manage the second or more photographs taken from the same point in association with the points in the drawing information.

Further, the photo management device of the tenth invention has a search instruction receiving unit that receives a search instruction including period information indicating a shooting period, and a search instruction receiving unit for any one of the first to ninth inventions. A photo search unit that acquires one or more photos paired with the time information corresponding to the period information from the photo storage unit, and a search photo output unit that outputs one or more photos acquired by the photo search unit. Furthermore, it is a photo management device provided.

With such a configuration, it is possible to easily output a photograph for a desired period.

Further, the photo management device of the eleventh invention has a photo instruction receiving unit that receives a photo instruction, which is an instruction for an output photo, and a photo instruction for the invention described in any one of the first to tenth aspects. In response to the acceptance of, the point information acquisition unit that acquires the point information corresponding to the photo instruction and the design of the point corresponding to the point information acquired by the point information acquisition unit are output on the output drawing information. It is a photo management device further including a symbol output unit.

With such a configuration, the point where the photograph was taken can be easily confirmed.

Further, in the photo management device of the twelfth invention, for the invention described in any one of the first to eleventh, three or more photographs associated with the position information are stored in the photo storage unit. A photo position instruction receiving unit that accepts two or more photo position instructions including a photo identifier and location information for identifying one photo, and position information corresponding to the photo identifiers of each of the two or more photo position instructions. A correspondence information acquisition unit that acquires two or more correspondence information, which is a set of information with the point information possessed by each of the two or more photo position indications, two or more correspondence information acquired by the correspondence information acquisition unit, and a photo storage unit. Photo management further including an attribute information calculation unit that calculates the point information of another photo using the position information of another photo, and an attribute information storage unit that stores the point information in association with the other photo. It is a device.

With such a configuration, it is possible to automatically acquire a point on the drawing information in which the photograph was taken.

Further, in the photo management device of the thirteenth invention, with respect to the twelfth invention, the photograph of the photo storage unit is also associated with the direction information indicating the direction, and the corresponding information acquisition unit is 2 Attribute information is calculated by acquiring two or more correspondence information, which is a set of information of the position information and direction information corresponding to the photo identifier of each of the above photo position indications and the point information of two or more photo position indications. The department acquires the point information and direction information of other photos by using the two or more correspondence information acquired by the correspondence information acquisition department and the position information and direction information of other photos in the photo storage unit, and attributes. The information storage unit is a photo management device that stores point information and direction information in association with other photographs.

With such a configuration, the direction on the drawing information in which the photograph was taken can be automatically acquired.

In addition, the corresponding information of the fourteenth invention is acquired, and for the thirteenth invention, the photo position instruction reception unit includes a photo identifier, a point information, and a direction information for identifying one photo. Upon receiving two or more photo position instructions, the corresponding information acquisition unit receives position information and direction information corresponding to the photo identifiers of each of the two or more photo position instructions, and point information and direction information of each of the two or more photo position instructions. It is a photo management device that acquires two or more correspondence information which is the information of the set with.

With such a configuration, the direction on the drawing information in which the photograph was taken can be automatically acquired.

According to the photo management device according to the present invention, the photograph taken can be easily managed in association with the point of the drawing information.

The figure explaining the photography procedure which is one invention of Embodiment 1, and the display method of a marker which is a second invention. The figure explaining the photograph search procedure and the display method which is the 4th invention, and the time-series recording and display method of a photograph which is a 3rd invention. The figure explaining the search procedure and the display method of the photography position and direction on the drawing which is the 5th invention. The figure explaining the procedure for automatically displaying the photography position of Embodiment 2 on a drawing. Block diagram of the photo management device A according to the third embodiment A flowchart illustrating an example of the operation of the photo management device A. A flowchart illustrating an example of the operation of the photo management device A. A flowchart illustrating an example of configuration processing of drawing information with the same symbol. The figure which shows the example of the drawing information The figure which shows the example of the photograph of the photograph storage part 12. Diagram showing an example of the same attribute information management table The figure explaining the example of the operation with respect to the drawing information The figure explaining the example of the operation with respect to the drawing information Diagram showing the same output example Diagram showing the same output example Diagram showing the same output example Diagram showing the same output example Overview of the computer system according to the above embodiment Block diagram of the computer system

Hereinafter, embodiments of the photo management device and the like will be described with reference to the drawings. In addition, since the components with the same reference numerals perform the same operation in the embodiment, the description may be omitted again.

(Embodiment 1)

The photo management device according to the present embodiment is a method for recording and organizing drawings and photographs in association with each other, and a system for realizing the method.

In addition, the photo management device specifies the position and direction for taking a picture in advance by touching and swiping on the drawing displayed on the electronic terminal, and together with the pictures taken continuously, the shooting position, direction, and shooting on the drawing. It has a function to embed the information of the photograph.

Further, in the photo management device, in the above shooting procedure, it is possible to display a photo or an image on an electronic terminal instead of the drawing.

Further, in the above shooting procedure, it is possible to perform an operation other than touch swipe from touching on the drawing to activating the camera of the electronic terminal without requiring an operation.

Further, in the above shooting procedure, in the case of mouse operation, touch can be replaced with click and swipe can be replaced with drag.

Further, in the above-mentioned shooting procedure, it is possible to embed a photograph or an image that has been taken in the drawing instead of the photograph taken continuously.

In addition, the photo management device has a function of displaying incidental information such as the position and direction in which the photograph was taken and the date and time as markers on the drawing.

In addition, the photo management device has a function of searching for a corresponding photo from the above markers displayed on the drawing.

Further, the photo management device has a function of recording photographs taken in the same direction from the same position on one marker in chronological order.

In addition, the photo management device has a function of searching for a marker corresponding to the photo from the photo.

In addition, the photo management device has a function of arranging and displaying the recorded photographs in an arbitrary order.

Further, the photo management device has a function of extracting and aligning only the photographs taken within an arbitrary designated period from the photographs embedded in the drawing.

Further, in the present embodiment, in the first invention, by touch-swipe on the drawing displayed on the electronic terminal, the position and direction in which the photograph is taken are specified in advance, and the photograph is continuously taken together with the drawing. It is a photography procedure that embeds information on the shooting position, shooting direction, and shot photo in.

Further, the second invention in the present embodiment is a marker for displaying the shooting position and the shooting direction of the photograph embedded in the drawing by the first invention on the drawing.

Further, in the third invention of the present embodiment, by designating the marker displayed by the second invention and then taking a picture again, a plurality of pictures taken in the same direction from the same point are taken in chronological order. It is a recording method that can be recorded.

Further, the fourth invention in the present embodiment is a photo search method capable of displaying a photograph recorded on the designated marker by designating the marker displayed by the second invention. ..

Further, the fifth invention in the present embodiment states that by designating a photograph taken by the first invention, it is possible to display a marker corresponding to the designated photograph, which is the second invention. This is a photo information retrieval method.

Further, FIG. 1 is a diagram illustrating a photography procedure according to the first invention and a marker display method according to the second invention.

FIG. 1 is drawing information showing an image of a drawing of a building to be constructed. In FIG. 1A, when the user "touches on the drawing", the photo management device displays a marker at the touched position and records it as a shooting position. Next, when the user swipes after touching an arbitrary position (see FIG. 1B), the photo management device points the arrow in the swiping direction and records it as the shooting direction (FIG. 1C). reference). Next, the user activates the camera following the swipe operation, and takes a picture using the photo management device (see FIG. 1 (c)). Then, when the photography is completed, the photography management device completes the embedding of the photographing position and the photographing direction in the drawing (see FIG. 1D).

FIG. 2 is also drawing information showing an image of a drawing of the building to be constructed. Then, when the user points to a marker displayed on the drawing, the user searches for and displays a photo corresponding to the marker (see 202 in FIG. 2). In the window 202 of FIG. 2, the photo management device displays photographs taken in the same direction from the same position in chronological order. The marker instruction has the same meaning as the imaging position and direction instruction.

In FIG. 3, the photo management device arranges and displays a list of photographs embedded in the drawing (see 301). Then, when the user specifies one photo, the photo management device searches for the corresponding shooting position and direction on the drawing. Then, the photo management device highlights the shooting position and direction corresponding to the designated photo (see 303). That is, the marker 303 is highlighted as compared to the other markers.

As described above, according to the first invention in the present embodiment, the drawing and the photograph are arranged and recorded at the same time as the photograph is taken, and it is not necessary to perform the arrangement work after the photograph photograph which was conventionally required.

Further, according to the second invention and the fourth invention in the present embodiment, the position and direction in which the photograph is taken are clearly displayed on the drawing, and the photograph can be searched from the drawing.

Further, according to the third invention in the present embodiment, it is possible to record photographs taken in the same direction from the same shooting position at different times in chronological order.

Further, according to the fifth invention in the present embodiment, contrary to the second invention, it is possible to search the position and direction on the drawing in which the photograph is taken from the photograph.

The processing in this embodiment may be realized by software. Then, this software may be distributed by software download or the like. Further, this software may be recorded on a recording medium such as a CD-ROM and disseminated. This also applies to other embodiments herein.

(Embodiment 2)

The photo management device according to the present embodiment has a function of automatically displaying a shooting position and a shooting direction of a photo on a drawing.

Conventionally, a photograph taken with a terminal having a GPS function and a direction measurement function can hold the latitude / longitude and the shooting direction at the time of shooting as metadata.

However, in order to associate the shooting position and the shooting direction of a photograph with the position on the drawing, it is necessary to determine the shooting position of the photograph from the photographer's memory or what is reflected. However, the accuracy varies greatly depending on the human memory ability and the ease of identifying the subject. The present embodiment reduces the dependence on subjective and ambiguous information such as memory and ease of identification, and automatically associates a shooting position and a shooting direction of a photograph with a position and an orientation on a drawing. The purpose of the photo management device in.

In order to achieve the above object and to solve the problem, the photo management device in the present embodiment has the following features.

Here, it is assumed that the drawing output by the photo management device is limited to the ground surface range where the curvature can be ignored. When the latitude of the surface range is near a real number α, the surface range can be regarded as a two-dimensional Euclidean space whose orthogonal coordinate system is the longitude obtained by multiplying the latitude by the cosine of α. Therefore, in the surface range, it is possible to convert three points having arbitrary different latitudes and longitudes as coordinates on the drawing while maintaining the similarity of the positions of each other. That is, by assuming that the correspondence between the latitude and longitude of two different points and the coordinates on the drawing is known, it is possible to obtain a point having an arbitrary latitude and longitude as the coordinates on the drawing.

Further, by obtaining the coordinates on the drawing of the points having the same longitude and different latitudes from either of the two known points assumed above, it is possible to determine which direction the latitude axis faces on the drawing. Therefore, it is possible to obtain the orientation on the drawing.

Also, assuming that the latitude and longitude of any three or more different points on the drawing are known, all pairs of two different points extracted from the set of known points so as not to be the same combination. , It is possible to obtain the coordinates on the drawing by the above conversion. By taking the weighted average of the coordinates obtained in this way, it is possible to improve the accuracy of the coordinate transformation.

FIG. 4 is a drawing showing a procedure for automatically displaying a photography position on a drawing. In FIG. 4A, it is assumed that there are photographs A and B taken at point A on the ground plane. Then, it is assumed that the user gives an instruction on the drawing, where α is the position on the drawing (drawing information) of Photo A and β is the position on Photo B (drawing information) (FIG. 4B).

Then, for the photograph P taken at the point P on the ground plane, as shown in (c) and (d) of FIG. 4, the photography position is the point ρ that creates a figure αβρ similar to ABP for the point P. Ask. That is, by designating the positions α and β of the two different shooting positions A and B on the drawing in advance, the position ρ on the drawing can be calculated for any P.

As described above, in the present embodiment, by designating the latitude and longitude at any two or more different points on the drawing in advance, the shooting position of the photograph saved together with the information indicating the latitude and longitude of the shooting point and the shooting direction can be obtained. The function to automatically display the shooting direction on the drawing was explained.

Further, in the present embodiment, the function of improving the accuracy of the shooting position and the shooting direction of the photograph to be displayed on the drawing has been described by increasing the number of arbitrary different points whose latitude and longitude are specified in advance.

As described above, according to the present embodiment, by designating the latitude and longitude of two different points on the drawing in advance, the shooting position of the photograph in which the latitude and longitude of the shooting point and the shooting direction are held as metadata The shooting direction can be automatically displayed on the drawing. Further, by increasing the number of arbitrary different points where the latitude and longitude are specified in advance on the drawing, it is possible to improve the accuracy of the shooting position and the shooting direction of the photograph displayed on the drawing.

(Embodiment 3)

In the present embodiment, when the stored drawing information is output, the designation of a point on the image is accepted, and when the shooting instruction is received, the photograph taken is associated with the point of the point. The photo management device for accumulating will be described.

Further, in the present embodiment, the photo management device will be described in which the instruction includes information indicating the shooting direction and stores the direction information in association with the photo.

Further, in the present embodiment, a photo management device that acquires incidental information such as time information and stores the incidental information in association with a photograph will be described.

Further, in the present embodiment, a photo management device capable of linking two or more photographs to the same point will be described.

Further, in the present embodiment, a photo management device will be described in which the points to which the photos are linked are graphically clearly indicated when the drawing information is output.

Further, in the present embodiment, a photo management device that receives an instruction of one point and outputs two or more photographs corresponding to the point side by side based on one or more information will be described. The information of one or more is, for example, time information.

Further, in the present embodiment, when a photograph is taken after the marker is instructed, a photo management device in which the photograph corresponds to the point of the marker will be described.

Further, in the present embodiment, a photo management device that receives drawing information identifiers and period information, corresponds to the drawing information, and outputs one or more photographs taken during the period indicated by the period information will be described.

Further, in the present embodiment, a photo management device that receives an instruction for a photo and outputs a marker corresponding to the photo on drawing information will be described.

Further, in the present embodiment, the designation of the position on the image of each of two or more photographs having the position information is accepted, the position on the image of the other photograph is calculated, and the position is associated with the image.

Further, in the present embodiment, a photo management device that can automatically acquire the direction on the drawing information in which the photo was taken will be described.

FIG. 5 is a block diagram of the photo management device A according to the present embodiment. The photo management device A includes a storage unit 1, a reception unit 2, a processing unit 3, and an output unit 4.

The storage unit 1 includes a drawing information storage unit 11, a photo storage unit 12, and an attribute information storage unit 13.

The reception unit 2 includes an output instruction reception unit 21, an instruction information reception unit 22, a shooting instruction reception unit 23, a design instruction reception unit 24, a photo instruction reception unit 25, a search instruction reception unit 26, and a photo position instruction reception unit 27. ..

The processing unit 3 includes a shooting unit 31, ancillary information acquisition unit 32, a photo storage unit 33, a drawing information configuration unit 34 with a pattern, an instruction photo acquisition unit 35, a photo search unit 36, a point information acquisition unit 37, and a corresponding information acquisition unit 38. , Attribute information calculation unit 39, and attribute information storage unit 40.

The output unit 4 includes a drawing information output unit 41, an instruction photo output unit 42, a search photo output unit 43, and a design output unit 44.

Various types of information are stored in the storage unit 1. The various types of information are, for example, drawing information and photographs described later, and attribute information described later.

The drawing information storage unit 11 stores one or more drawing information. Usually, the drawing information is stored in the drawing information storage unit 11 in association with the drawing information identifier that identifies the drawing information. It is preferable that the drawing information does not have the position information. The drawing information does not include map information having location information. Drawing information is drawing information. The drawings are, for example, a drawing of a building, a drawing of a construction site, and a drawing of an area. The drawing information may be vector data, raster data, or the like. The drawing information is, for example, jpeg, gif, etc., but the data structure of the drawing information does not matter. The position information is usually (latitude, longitude). The location information may include altitude. Further, the drawing information may be considered to include image information having no position information.

The photo storage unit 12 stores one or more photos. It is preferable that the photograph is associated with the point information. It is preferable that the photograph is associated with the direction information. It may be considered that the photograph is associated with attribute information including point information. Attribute information is information corresponding to a symbol and is information that is a source of the symbol. Attribute information may be considered to include direction information. The photograph may be associated with the position information. The point information is information that identifies a position (point) above the drawing information. The point information is usually a relative coordinate value (x, y) in the drawing information. The point information is, for example, coordinate information (x, y) indicating a position relative to a reference point (for example, a point in the upper left corner of the drawing information) of the drawing information. The location information is usually the location where the photo was taken. However, the point information may be information that identifies the position of the subject in the photograph on the drawing information. The picture is usually a picture taken by the user. A photograph may be called a photographed image. The captured image is usually a still image. However, the captured image may be a moving image. The direction information is information indicating the direction in the drawing information. The direction information is represented by, for example, an angle from a reference line on the drawing information. The direction information is, for example, a two-dimensional vector. The symbol may be considered to have the same meaning as the above marker. The shape, color, data structure, etc. of the design do not matter. The design may be anything that can be visually recognized. That is, the design is composed of, for example, images, characters, and the like.

The photo storage unit 12 can store two or more photographs in the same manner in association with the point information. Further, the photo storage unit 12 can store two or more photographs in association with the same point information and the same direction information. The photo storage unit 12 may store two or more photographs having the same corresponding point information but different direction information.

Further, the photo storage unit 12 may store three or more photos associated with the position information. The photo storage unit 12 may store three or more photographs associated with the position information and the direction information. Direction information is information indicating the direction on the ground surface. The direction information is, for example, information indicating an angle with respect to the north, but its expression format does not matter.

The attribute information storage unit 13 stores one or more attribute information. The attribute information has point information indicating a point on the drawing information to which the photograph is associated. It is preferable that the attribute information has direction information. Further, the attribute information may be associated with an attribute information identifier that identifies the attribute information. Further, the attribute information may include incidental information. It may be said that the incidental information is the information of the context at the time of taking the photograph. Ancillary information is, for example, time, date, weather, and the like. It may be said that the incidental information is, for example, attribute information related to the shooting location.

The reception unit 2 receives various instructions and information. The various instructions and information are, for example, an output instruction described later, an instruction information described later, a shooting instruction described later, a design instruction described later, a photo instruction described later, and a search instruction described later.

The input means for various instructions and information may be any means such as a numeric keypad, a keyboard, a mouse, or a menu screen. The reception unit 2 can be realized by a device driver for input means such as a numeric keypad or a keyboard, control software for a menu screen, or the like.

The output instruction receiving unit 21 receives an output instruction of drawing information. The output instruction usually has a drawing information identifier.

The instruction information receiving unit 22 receives the instruction information. The instruction information is information related to an instruction for specifying a point on the drawing information output by the drawing information output unit 41. The instruction information is information acquired when an instruction for associating a point or the like on the drawing information with a photograph is input. The instruction information is information including point information for specifying a point on the drawing information. The instruction information is, for example, information having point information and direction information. Here, the point information and the direction information are usually based on instructions and information input by the user.

Here, the instructions and the like input by the user for accepting the output instructions are, for example, touching the touch panel, pressing with the mouse, and the like. The instruction or the like input by the user for accepting the output instruction may be a series of operations such as a point instruction and a direction input. Any method of inputting the instruction input for receiving the output instruction may be used.

The shooting instruction receiving unit 23 receives a shooting instruction for a photograph after the instruction information is received. It is preferable that the shooting instruction receiving unit 23 receives the shooting instruction of the photograph following the reception of the instruction information. Shooting instructions include pressing a shooting button and selecting a shooting menu item. Any method of inputting shooting instructions may be used. After receiving the shooting instruction, it is preferable that the shooting instruction receiving unit 23 receives the shutter pressing instruction for taking a picture. The shooting instruction may be an instruction to shift to the shooting mode, or may be an instruction to take a picture and acquire a picture.

The symbol instruction receiving unit 24 receives the symbol instruction. The symbol instruction is an instruction for a symbol of drawing information with a symbol output by the drawing information output unit 41. The input method of the symbol instruction is, for example, touching the symbol using the touch panel, pressing the symbol with the mouse, or the like. Needless to say, the input method of the design instruction does not matter.

The photo instruction receiving unit 25 receives a photo instruction which is an instruction for the output photo.

The search instruction receiving unit 26 receives a search instruction which is an instruction to search a photo. The search instruction includes, for example, period information indicating a period of shooting. The period information includes, for example, period start point information indicating the start point of the period and period end point information indicating the end point of the period. In such a case, the search instruction is, for example, "search 2017/1/1 <= period <= 2017/3/25", "search 2017/1/1 <period <2017/3/25", and the like. The period information has, for example, only the period start point information indicating the start point of the period. In such a case, the search instruction is, for example, "search 2017/1/1 <= period" and "search 2017/1/1 <period". The period information has, for example, only the period end point information indicating the end point of the period. In such a case, the search instruction is, for example, "search period <= 2017/3/25", "search period <2017/3/25", or the like.

The photo position instruction reception unit 27 receives two or more photo position instructions. The photo position instruction is usually accepted by an operation of identifying a photo corresponding to the position information and an operation of specifying a point on the drawing information of the photo. The photo position instruction is an instruction of a point on the drawing information of the photograph corresponding to the position information. The photo position indication usually has a photo identifier and location information.

The processing unit 3 performs various processes. The various processes include, for example, a shooting unit 31, ancillary information acquisition unit 32, a photo storage unit 33, a drawing information configuration unit with a pattern 34, an instruction photo acquisition unit 35, a photo search unit 36, a point information acquisition unit 37, and corresponding information. This is a process performed by the acquisition unit 38, the attribute information calculation unit 39, and the attribute information storage unit 40.

The photographing unit 31 photographs and acquires a photograph in response to a photographing instruction. The photographing unit 31 can be realized by a camera, an MPU, a memory, or the like.

The incidental information acquisition unit 32 acquires incidental information at the time of taking a photograph. The incidental information acquisition unit 32 acquires incidental information from, for example, a clock (not shown) or an external server.

The photo storage unit 33 stores the photo acquired by the photography unit 31 in the photo storage unit 12 in association with the point information contained in the instruction information. For example, the photo storage unit 33 pairs the point information and the photo and stores them in the photo storage unit 12.

The photo storage unit 33 may store photos in the photo storage unit 12 in association with the point information contained in the instruction information and the direction information possessed by the instruction information. The photo storage unit 33 stores, for example, a pair of point information, direction information, and a photo in the photo storage unit 12.

It is preferable that the photo storage unit 33 also stores the incidental information acquired by the incidental information acquisition unit 32 in the photo storage unit 12 in association with the point information. The photo storage unit 33 stores, for example, ancillary information, point information, and a photo in a pair in the photo storage unit 12.

The photo storage unit 33 has, for example, the point information possessed by the instruction information, constitutes the attribute information having the attribute information identifier, stores the attribute information in the attribute information storage unit 13, and associates the attribute information with the attribute information identifier. , Photos are stored in the photo storage unit 12. In such a case, the attribute information may have the direction information possessed by the instruction information, or may have the incidental information acquired by the incidental information acquisition unit 32.

It is preferable that the photo storage unit 33 stores the photo in the photo storage unit 12 in association with the point information corresponding to the symbol corresponding to the received symbol instruction. The photo storage unit 33 acquires, for example, point information or the like corresponding to the symbol corresponding to the received symbol instruction from the storage unit 1. Then, the photo storage unit 33 stores the photo in the photo storage unit 12, for example, in association with the acquired point information or the like. The point information and the like are only point information, point information and direction information, point information and incidental information, and point information and direction information and incidental information.

For example, the photo storage unit 33 may acquire the attribute information identifier corresponding to the symbol corresponding to the received symbol instruction, associate it with the attribute information identifier, and store the photo in the photo storage unit 12. In such a case, the symbol is associated with the attribute information identifier.

The drawing information composition unit 34 with a symbol constitutes the drawing information with a symbol. The drawing information configuration unit 34 with a pattern uses, for example, one or more point information corresponding to one or more photographs of the photo storage unit 12 to make the drawing information a point corresponding to one or more point information. It constitutes drawing information with a symbol to which a symbol is added. The drawing information configuration unit 34 with a symbol arranges a symbol at a point indicated by the point information of each attribute information of the attribute information storage unit 13, and configures the drawing information with a symbol.

More specifically, for example, the drawing information configuration unit 34 with a pattern acquires one or more point information corresponding to each one or more photographs of the photo storage unit 12. Then, the drawing information component 34 with a symbol is a position indicated by one or more point information, and the symbol is arranged at a position on the drawing information. It is assumed that the symbol is stored in the storage unit 1.

The drawing information configuration unit 34 with a symbol, for example, uses the direction information possessed by one or more attribute information to add information indicating the direction (for example, an arrow) to the symbol (for example, a circle) and configures a symbol to be output. Then, the constructed symbol is a point indicated by the point information paired with the direction information, and is arranged at a point on the drawing information to form the drawing information with the symbol.

The timing at which the drawing information configuration unit 34 with a symbol configures the drawing information with a symbol does not matter. The drawing information composition unit 34 with a symbol may configure the drawing information with a symbol every time a photograph of the point information of a new point is accumulated, for example. The drawing information composition unit 34 with a symbol may configure the drawing information with a symbol in response to the reception of the output instruction of the drawing information.

In response to the reception of the symbol instruction, the instruction photo acquisition unit 35 acquires two or more photographs paired with the point information corresponding to the symbol for the symbol instruction from the photo storage unit 12. The instruction photo acquisition unit 35 may acquire, for example, a photo paired with the attribute information identifier paired with the symbol for the symbol instruction from the photo storage unit 12. The photo paired with the attribute information identifier is also the photo paired with the point information.

In response to the reception of the search instruction, the photo search unit 36 acquires one or more photographs paired with the time information corresponding to the period information of the search instruction from the photo storage unit 12. For example, the photo search unit 36 acquires one or more photos paired with the attribute information identifier paired with the time information corresponding to the period information included in the search instruction from the photo storage unit 12.

In response to the reception of the photo instruction, the point information acquisition unit 37 acquires the point information paired with the photo corresponding to the photo instruction from the storage unit 1. The point information acquisition unit 37 acquires, for example, the point information paired with the attribute information identifier paired with the photo corresponding to the photo instruction from the attribute information storage unit 13.

The correspondence information acquisition unit 38 acquires two or more correspondence information which is a set of information of the position information corresponding to the photo identifier of each of the two or more photo position indications and the point information of each of the two or more photo position indications. do. The corresponding information is usually a set of position information (latitude, longitude) and point information (coordinate values (x, y)). Further, the correspondence information may be stored in the storage unit 1. The timing at which the correspondence information acquisition unit 38 acquires the correspondence information does not matter.

The attribute information calculation unit 39 calculates the location information of the other photo by using the two or more correspondence information acquired by the correspondence information acquisition unit 38 and the position information of the other photo of the photo storage unit 12. The other photographs are photographs that are not instructed by the photograph position indication. In addition, other photographs are photographs with location information. The two correspondence information is "position information (latitude = X1, longitude = Y1), point information (coordinate value (x1, y1))", "position information (latitude = X2, longitude = Y2), point information (coordinate value (x2)). , Y2)) ”, and when the position information of the other photo is (latitude = X3, longitude = Y3), the attribute information calculation unit 39 uses the location information (x3, y3) of the other photo. Is calculated by the following formula 1.

The attribute information calculation unit 39 uses the two or more correspondence information acquired by the correspondence information acquisition unit 38 and the position information and direction information of the other photo of the photo storage unit 12, and the location information and direction of the other photo. You may get information. The two correspondence information is "position information (latitude = X1, longitude = Y1), direction information (Θ1), point information (coordinate value (x1, y1)), direction information (θ1)" and "position information (latitude = X2). Longitude = Y2)), direction information (Θ2), point information (coordinate value (x2, y2)), direction information (θ2) ”, and the position information of the other photo is (latitude = X3, longitude = Y3). ), The direction information (Θ3), the attribute information calculation unit 39 calculates the point information (x3, y3) of the other photo by the equation 1, and the direction information (θ3) by the following equation 2. do.

When there are three or more correspondence information acquired by the correspondence information acquisition unit 38, it is preferable that the attribute information calculation unit 39 performs the following processing to improve the accuracy of the point information of the other photograph. be. That is, the attribute information calculation unit 39 acquires two correspondence information of two or more different combinations from the three or more correspondence information acquired by the correspondence information acquisition unit 38. Then, the attribute information calculation unit 39 calculates the point information of the other one photo by using each set of the two or more sets of correspondence information (two correspondence information), and acquires the candidate values of the two or more point information. do. Then, the attribute information calculation unit 39 calculates the average of the candidate values of two or more point information, and acquires the final point information.

Further, it is preferable that the attribute information calculation unit 39 acquires the point information of two or more other photographs.

The attribute information storage unit 40 stores the point information calculated by the attribute information calculation unit 39 in association with other photographs. The attribute information storage unit 40 may store the point information and the direction information acquired by the attribute information calculation unit 39 in association with other photographs.

The output unit 4 outputs various information. The various types of information include, for example, drawing information, drawing information with a symbol, a photograph, a symbol, and the like. Here, the output is usually a display on a display, but projection using a projector, printing by a printer, transmission to an external device, storage on a recording medium, other processing devices, other programs, etc. It may be a concept including delivery of the processing result to.

The drawing information output unit 41 outputs drawing information. It is preferable that the drawing information output unit 41 outputs the drawing information in response to the reception of the output instruction. The drawing information output unit 41 outputs drawing information with a symbol, for example, in response to acceptance of an output instruction.

The instruction photo output unit 42 outputs one or more photographs acquired by the instruction photo acquisition unit 35. It is preferable that the instruction photo output unit 42 outputs two or more photographs acquired by the instruction photo acquisition unit 35 side by side based on one or more information. Here, the information of one or more is usually incidental information. The information of one or more is, for example, time information. That is, it is preferable that the instruction photo output unit 42 sorts and outputs two or more photographs acquired by the instruction photo acquisition unit 35 based on the time information corresponding to the photographs.

The search photo output unit 43 outputs one or more photos acquired by the photo search unit 36. It is preferable that the search photo output unit 43 outputs photos side by side based on one or more pieces of information.

The symbol output unit 44 outputs the symbol of the point corresponding to the point information acquired by the point information acquisition unit 37 on the output drawing information. It is preferable that the symbol output unit 44 outputs a symbol of a point corresponding to the point information acquired by the point information acquisition unit 37 in a manner visually different from other symbols. The visually different aspect includes emphasizing and outputting the symbol of the point corresponding to the point information acquired by the point information acquisition unit 37 as compared with other symbols.

The storage unit 1, the drawing information storage unit 11, the photo storage unit 12, and the attribute information storage unit 13 are preferably non-volatile recording media, but can also be realized by volatile recording media.

The process of storing information in the storage unit 1 or the like does not matter. For example, the information may be stored in the storage unit 1 or the like via the recording medium, or the information transmitted via the communication line or the like may be stored in the storage unit 1 or the like. Alternatively, the information input via the input device may be stored in the storage unit 1 or the like.

Processing unit 3, shooting unit 31, incidental information acquisition unit 32, photo storage unit 33, drawing information configuration unit with pattern 34, instruction photo acquisition unit 35, photo search unit 36, point information acquisition unit 37, corresponding information acquisition unit 38, The attribute information calculation unit 39 and the attribute information storage unit 40 can usually be realized from an MPU, a memory, or the like. The processing procedure of the processing unit 3 is usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

The output unit 4, the drawing information output unit 41, the instruction photo output unit 42, the search photo output unit 43, and the design output unit 44 may or may not be considered to include an output device such as a display or a speaker. The output unit 4 can be realized by the driver software of the output device, the driver software of the output device, the output device, or the like.

Next, an example of the operation of the photo management device A will be described with reference to the flowcharts of FIGS. 6 and 7.

(Step S601) The output instruction receiving unit 21 determines whether or not the output instruction of the drawing information has been received. If the output instruction is accepted, the process goes to step S602, and if the output instruction is not accepted, the process goes to step S606. The output instruction has, for example, a drawing information identifier.

(Step S602) The processing unit 3 reads the drawing information corresponding to the output instruction from the drawing information storage unit 11. For example, the processing unit 3 reads the drawing information identified by the drawing information identifier of the output instruction from the drawing information storage unit 11.

(Step S603) The drawing information configuration unit 34 with a symbol determines whether or not there is point information corresponding to the drawing information read in step S602. If the point information exists, the process goes to step S604, and if the point information does not exist, the process goes to step S605. The drawing information configuration unit 34 with a symbol determines whether or not the point information exists, for example, depending on whether or not the attribute information exists in the attribute information storage unit 13.

(Step S604) The drawing information composition unit 34 with a symbol performs the composition processing of the drawing information with a symbol. The configuration process of the drawing information with a symbol will be described with reference to the flowchart of FIG.

(Step S605) The drawing information output unit 41 outputs the drawing information with a symbol configured in step S604 or the drawing information read in step S602. Return to step S601.

(Step S606) The instruction information receiving unit 22 determines whether or not the instruction information has been received. If the instruction information is accepted, the process goes to step S607, and if the instruction information is not accepted, the process goes to step S613.

(Step S607) The processing unit 3 temporarily stores the point information and the like included in the instruction information in a buffer (not shown).

(Step S608) The output unit 4 outputs a user interface (UI) that prompts shooting. The UI for prompting shooting is a button of a camera design, a menu item for shifting to a shooting mode, and the like. Further, it is assumed that the UI information for forming such a UI is stored in the storage unit 1. The UI that prompts shooting is a UI that accepts shooting instructions. Further, it is preferable to output a UI for prompting shooting by receiving the instruction information of the instruction information reception unit 22.

(Step S609) The shooting instruction receiving unit 23 determines whether or not the shooting instruction has been received. If the shooting instruction is accepted, the process proceeds to step S610, and if the shooting instruction is not accepted, the process returns to step S609. Although the shooting instruction is an instruction to shift to the camera mode here, it may be an instruction to perform shooting.

(Step S610) The processing unit 3 sets the mode of the photo management device A to the camera mode. The camera mode is a mode for shooting.

(Step S611) The reception unit 2 determines whether or not the shutter pressing instruction has been received. If the shutter pressing instruction is accepted, the process proceeds to step S612, and if the shutter pressing instruction is not accepted, the process returns to step S611. The shutter pressing instruction is an instruction to take a picture.

(Step S612) The photographing unit 31 photographs and acquires a photograph. Then, the photo storage unit 33 stores the acquired photo in the photo storage unit 12 in association with the point information or the like temporarily stored in a buffer (not shown). Return to step S601. Here, the point information and the like are point information, or point information and direction information. Further, the incidental information acquisition unit 32 may acquire the incidental information. In such a case, the photo storage unit 33 stores the acquired photo in the photo storage unit 12 in association with the point information and the incidental information.

(Step S613) The symbol instruction receiving unit 24 determines whether or not the symbol instruction has been accepted. If the symbol instruction is accepted, the process goes to step S614, and if the output instruction is not accepted, the process goes to step S618.

(Step S614) The instruction photograph acquisition unit 35 acquires the point information in which the symbol corresponding to the symbol instruction is arranged. Here, the direction information may also be acquired in pairs with the point information on which the symbol is arranged. The instruction photograph acquisition unit 35 may acquire an attribute information identifier paired with the symbol corresponding to the symbol instruction.

(Step S615) The instruction photo acquisition unit 35 acquires one or more photographs paired with the point information or the like acquired in step S614 from the photo storage unit 12. The instruction photo acquisition unit 35 may acquire one or more photographs paired with the attribute information identifier from the photo storage unit 12.

(Step S616) The instruction photograph acquisition unit 35 acquires incidental information paired with one or more photographs acquired in step S615. Then, the instruction photo acquisition unit 35 sorts one or more photos using the incidental information as a key.

(Step S617) The instruction photo output unit 42 outputs one or more photos sorted in step S616. Return to step S601.

(Step S618) The photo instruction receiving unit 25 determines whether or not the photo instruction has been accepted. If the photo instruction is accepted, the process goes to step S619, and if the photo instruction is not accepted, the process goes to step S622.

(Step S619) The point information acquisition unit 37 acquires point information or the like paired with the photo corresponding to the photo instruction in response to the reception of the photo instruction.

(Step S620) The processing unit 3 acquires a symbol that has been changed to a conspicuous mode with respect to the standard symbol. The process of this step may be performed by the drawing information configuration unit 34 with a symbol.

(Step S621) The symbol output unit 44 outputs the changed symbol to a point on the drawing information, which is a point indicated by the point information acquired in step S619. Return to step S601. The symbol output unit 44 is a symbol that has been output.

(Step S622) The search instruction receiving unit 26 determines whether or not the search instruction has been accepted. If the search instruction is accepted, the process goes to step S623, and if the search instruction is not accepted, the process goes to step S628.

(Step S623) The photo search unit 36 searches the photo storage unit 12 according to the search instruction.

(Step S624) The photo search unit 36 determines whether or not the photo could be acquired in step S623. If it can be acquired, it goes to step S625, and if it cannot be acquired, it returns to step S601.

(Step S625) The photo search unit 36 acquires one or more searched photos and the like. Photographs and the like are photographs and incidental information.

(Step S626) The photo search unit 36 sorts the acquired one or more photos using the incidental information paired with each photo as a key. Needless to say, the photo sorting process is not essential.

(Step S627) The search photo output unit 43 outputs one or more photos sorted in step S626. Return to step S601.

(Step S628) The photo position instruction reception unit 27 determines whether or not the photo position instruction has been received. If the photo position instruction is accepted, the process goes to step S629, and if the photo position instruction is not accepted, the process goes to step S631.

(Step S629) The correspondence information acquisition unit 38 acquires the correspondence information from the photo position instruction and stores it in the storage unit 1.

(Step S630) The processing unit 3 associates the photo corresponding to the photo position instruction with the point information and the like included in the photo position instruction. Return to step S601.

(Step S631) The processing unit 3 determines whether or not to perform the association processing of other photographs. When performing the association processing, the process goes to step S632, and when performing the association processing, the process returns to step S601. The timing of the association processing of other photographs does not matter. It is preferable to perform the associative processing of other photographs by instructing the user.

(Step S632) The attribute information calculation unit 39 substitutes 1 for the counter i.

(Step S633) The attribute information calculation unit 39 determines whether or not the i-th photograph exists. If the i-th photograph exists, the process goes to step S634, and if it does not exist, the process returns to step S601. The i-th photograph is an i-th photograph that is not associated with the point information.

(Step S634) The attribute information calculation unit 39 acquires the position information paired with the i-th photograph.

(Step S635) The attribute information calculation unit 39 applies the position information acquired in step S634 to the two or more correspondence information accumulated in step S629, and calculates the point information and the like corresponding to the i-th photograph.

(Step S636) The attribute information storage unit 40 stores the point information and the like calculated in step S635 in the storage unit 1 in association with the i-th photograph.

(Step S637) The attribute information calculation unit 39 increments the counter i by 1. Return to step S633.

In the flowcharts of FIGS. 6 and 7, the process ends when the power is turned off or an interrupt for the end of the process occurs.

Further, in the flowchart of FIG. 7, it is preferable to calculate and store the direction information.

Next, an example of the configuration process of the drawing information with a symbol in step S604 will be described with reference to the flowchart of FIG.

(Step S801) The drawing information configuration unit 34 with a symbol reads out the symbol stored in the storage unit 1.

(Step S802) The drawing information configuration unit 34 with a symbol substitutes 1 for the counter i.

(Step S803) The drawing information configuration unit 34 with a pattern is a photograph corresponding to the drawing information corresponding to the output instruction, and determines whether or not the i-th photograph is stored in the photo storage unit 12. If it is stored, it goes to step S804, and if it is not stored, it returns to the higher-level processing.

(Step S804) The drawing information component unit 34 with a pattern acquires the point information and the like corresponding to the i-th photograph.

(Step S805) The drawing information component unit 34 with a symbol determines whether or not the point information or the like acquired in step S804 is new point information or the like. If it is new point information or the like, it goes to step S806, and if it is point information or the like already stored in a buffer (not shown), it goes to step S809.

(Step S806) The drawing information configuration unit 34 with a symbol configures a symbol to be output by using the symbol read in step S801. The drawing information configuration unit 34 with a symbol configures a symbol to be output by using, for example, the symbol read in step S801 and the direction information.

(Step S807) The drawing information component unit 34 with a symbol is a point indicated by the point information acquired in step S804, and the symbol configured in step S806 is arranged at a point on the drawing information.

(Step S808) The drawing information configuration unit 34 with a symbol temporarily stores the point information and the like acquired in step S804 in a buffer (not shown).

(Step S809) The drawing information configuration unit 34 with a symbol increments the counter i by 1. Return to step S803.

Hereinafter, the specific operation of the photo management device A in the present embodiment will be described.

Now, the drawing information storage unit 11 of the photo management device A stores the drawing information shown in FIG. It is assumed that the drawing information identifier of the drawing information shown in FIG. 9 is "fig1". Further, the drawing information shown in FIG. 9 is, here, drawing information with a symbol to which eight symbols are added. Further, it is assumed that the drawing information storage unit 11 also stores the drawing information corresponding to the drawing information identifier "fig2" (not shown). Here, it is assumed that no symbol is added to this drawing information.

Further, it is assumed that the photo storage unit 12 stores a large number of photographs including the four photographs shown in FIG. The photo identifier of the photo in (a) is "P11", the photo identifier of the photo in (b) is "P12", the photo identifier of the photo in (c) is "P13", and the photo identifier of the photo in (d) is It is assumed that it is "P21".

Further, the attribute information storage unit 13 stores the attribute information management table shown in FIG. The attribute information management table is a table that manages attribute information. The attribute information management table may store one or more records having "ID", "drawing information identifier", "point information", "direction information", "photo identifier", and "incidental information". The "incidental information" has "date and time" and "weather" here. The "ID" is information that identifies a record. The "drawing information identifier" is an identifier of drawing information corresponding to the attribute information. The "point information" is information possessed by the attribute information, is information indicating a point on the drawing in which the photograph is taken, and here, is a coordinate value on a plane (on the drawing). "Direction information" is information indicating the direction on the drawing in which the photograph is taken. The "photo identifier" is a photo identifier. The "date and time" is information indicating the date and time when the photograph was taken, and is information obtained from a clock (not shown). The "weather" is information indicating the weather at the date and time when the photograph was taken, and is information acquired at the time of taking the photograph from a server (not shown).

In such a situation, it is assumed that the user has input the output instruction of "fig1" to the photo management device A. Then, the output instruction receiving unit 21 receives the output instruction of the drawing information. Then, the processing unit 3 reads the drawing information of "fig1" corresponding to the output instruction from the drawing information storage unit 11.

Next, the drawing information output unit 41 outputs the read drawing information with a symbol.

When the drawing information storage unit 11 does not store the drawing information to which the design is not added, the operation is as follows. That is, for example, the drawing information configuration unit 34 with a symbol detects that the attribute information management table of FIG. 11 contains attribute information paired with the drawing information identifier “fig1”. That is, the drawing information configuration unit 34 with a symbol determines that there is point information corresponding to the read drawing information. Next, the drawing information composition unit 34 with a symbol performs the composition processing of the drawing information with a symbol by the process described in the flowchart of FIG. 8 and acquires the drawing information with a symbol. Then, the drawing information output unit 41 outputs the constructed drawing information with a symbol.

Next, it is assumed that the user has instructed the photo management device A of the point 1201 shown in FIG. 12 with respect to the output drawing information of FIG. 9. Then, the reception unit 2 receives the instruction of the point including the point information of the point. Then, the output unit 4 outputs the menu shown in 1202. The menu is an operation target. Further, it is assumed that the user presses the 103 button in the menu. Then, the reception unit 2 accepts the pressing of the button 103. Then, the output unit 4 outputs an operation target such as a circle in the area of 1303. It is assumed that the arrow 1302 in the area of 1301 is an operation target for changing the direction, and if the arrow 1303 is dragged and moved, the arrow 1303 indicating the direction is changed. Then, when the arrow 1303 is confirmed, the reception unit 2 receives the direction information which is the information of the direction indicated by the arrow 1303. Further, it is assumed that FIG. 1304 composed of a cross arrow and a circle is a diagram for moving point information. The user can change the point information by dragging and moving the FIG. 1304. Then, after the point information and the direction information are confirmed, the instruction information receiving unit 22 receives the instruction information having the confirmed point information and the direction information.

Next, the processing unit 3 configures attribute information having fixed point information and direction information, and temporarily stores the attribute information in a buffer (not shown).

Next, the output unit 4 outputs the user interface 1305 that prompts shooting. The UI 1305 has a shooting button 1306 and a symbol editing button 1307. The shooting button 1306 is a button for taking a picture. The symbol edit button 1307 is a button for changing and inputting the attributes (color and character string) of the symbol displayed on the drawing information.

Next, it is assumed that the user presses the shooting button 1306. Then, the shooting instruction receiving unit 23 receives the shooting instruction. Then, the processing unit 3 sets the mode of the photo management device A to the camera mode.

Next, it is assumed that the user has input the shutter pressing instruction. Then, the reception unit 2 receives the shutter pressing instruction.

Next, the photographing unit 31 photographs and acquires a photograph. In addition, the incidental information acquisition unit 32 acquires the date and time and the weather, which are incidental information. Since the technique for acquiring the date and time and the weather is a known technique, detailed description thereof will be omitted. Then, the processing unit 3 acquires the drawing information identifier "fig1". Further, the processing unit 3 acquires attribute information having point information and direction information temporarily stored in a buffer (not shown). In addition, the processing unit 3 generates a unique photo identifier. Then, the processing unit 3 adds a record having the drawing information identifier "fig1", point information, direction information, photo identifier, date and time, weather, etc. to the attribute information management table of FIG.

As a result, the information corresponding to one symbol has been accumulated. Then, the output drawing information with a symbol is as shown in FIG. In FIG. 14, 1401 symbols have been added.

In FIG. 13, when the user presses the button 1307, the symbol editing screen 1501 shown in FIG. 15 is displayed, and the color of the circle constituting the symbol, the color of the arrow, the line type, and the size can be changed.

Further, it is assumed that the user presses the symbol 1601 in the displayed drawing information as shown in FIG. Then, the symbol instruction receiving unit 24 receives the symbol instruction for the symbol 1601.

Next, the instruction photograph acquisition unit 35 acquires the point information in which the symbol corresponding to the symbol instruction is arranged.

Next, it is assumed that the instruction photo acquisition unit 35 has acquired three photographs paired with the acquired point information from the photo storage unit 12.

Next, the instruction photo acquisition unit 35 acquires the date and time paired with the three acquired photos. Then, the instruction photo acquisition unit 35 sorts the three photos in chronological order using the date and time as a key.

Next, the instruction photo output unit 42 outputs one or more sorted photos. An example of such an output is 1602 in FIG. It is assumed that a memo can be written on the photograph by means (not shown).

Further, it is assumed that the user selects one photo in the situation where one or more photos are displayed. Then, the photo instruction receiving unit 25 receives the photo instruction.

Next, the point information acquisition unit 37 acquires point information or the like that is paired with the photo corresponding to the photo instruction in response to the reception of the photo instruction.

Next, the processing unit 3 acquires a symbol that has been changed to a conspicuous mode with respect to the standard symbol. Then, the symbol output unit 44 outputs the changed symbol to a point on the drawing information, which is a point indicated by the acquired point information. An example of such an output is shown in FIG. In FIG. 17, the color of the symbol 1701 is different from the color of the other symbols.

Next, it is assumed that the user has entered a search instruction having period information. Then, the search instruction receiving unit 26 receives the search instruction.

Next, the photo search unit 36 acquires one or more photo identifiers of the photo paired with the date corresponding to the period indicated by the period information from the attribute information management table of FIG. 11 according to the search instruction. Next, the photo identified by each of the one or more photo identifiers is read from the photo storage unit 12. Then, the search photo output unit 43 outputs one or more acquired photos.

As described above, according to the present embodiment, the photograph taken can be easily managed in association with the point of the drawing information.

Further, according to the present embodiment, it is possible to easily manage the photographed photograph by associating the point of the drawing information with the photographing direction.

Further, according to the present embodiment, it is possible to easily manage the photograph taken by associating the point of the drawing information with the incidental information.

Further, according to the present embodiment, there are two or more photographs taken at one point, and two or more photographs arranged appropriately can be easily confirmed.

Further, according to the present embodiment, two or more photographs taken from the same point can be easily managed in association with the points in the drawing information.

Further, according to the present embodiment, the points to which the photographed photographs correspond can be easily confirmed on the drawing information.

Further, according to the present embodiment, a photograph of a desired period can be easily output.

Further, according to the present embodiment, it is possible to automatically acquire a point on the drawing information in which the photograph was taken.

Further, according to the present embodiment, the direction on the drawing information in which the photograph is taken can be automatically acquired.

In the present embodiment, the photo management device A has been described as a stand-alone device, but it goes without saying that the photo management device A may be a server device that communicates with the terminal device used by the user. In such a case, the reception unit 2, the output instruction reception unit 21, the instruction information reception unit 22, the shooting instruction reception unit 23, the design instruction reception unit 24, the photo instruction reception unit 25, the search instruction reception unit 26, and the photo position instruction reception unit 27. Receives instructions and information from the terminal device. Further, the output unit 4, the drawing information output unit 41, the instruction photo output unit 42, the search photo output unit 43, and the design output unit 44 transmit information to the terminal device.

Further, the processing in the present embodiment may be realized by software. Then, this software may be distributed by software download or the like. Further, this software may be recorded on a recording medium such as a CD-ROM and disseminated. This also applies to other embodiments herein. The software that realizes the photo management device A in the present embodiment is, for example, the following program. That is, in this program, the recording medium accessible to the computer includes a drawing information storage unit for storing drawing information and a photo storage unit for storing one or more photographs, and the computer is used to store the drawing information. Instruction information for receiving instruction information that is information related to an output drawing information output unit and an instruction for specifying a point on the drawing information output by the drawing information output unit, and is information including point information for specifying the point. The reception unit, the shooting instruction reception unit that receives the shooting instruction of the photograph after receiving the instruction information, the shooting unit that shoots and acquires the photograph in response to the shooting instruction, and the point information possessed by the instruction information. This is a program for making the photograph function as a photo storage unit that stores the photo in the photo storage unit in association with each other.

In addition, FIG. 18 shows the appearance of a computer that executes the program described in the present specification to realize the photo management apparatus and the like of the various embodiments described above. The embodiments described above may be implemented in computer hardware and computer programs running on it. FIG. 18 is an overview view of the computer system 300, and FIG. 19 is a block diagram of the system 300.

In FIG. 18, the computer system 300 includes a computer 301 including a CD-ROM drive, a keyboard 302, a mouse 303, and a monitor 304.

In FIG. 19, in addition to the CD-ROM drive 3012, the computer 301 includes the MPU 3013, the MPU 3013, the bus 3014 connected to the CD-ROM drive 3012, the ROM 3015 for storing a program such as a boot-up program, and the MPU 3013. Includes a RAM 3016 for temporarily storing application program instructions and providing a temporary storage space, and a hard disk 3017 for storing application programs, system programs, and data. Although not shown here, the computer 301 may further include a network card that provides a connection to the LAN.

The program for causing the computer system 300 to execute the functions of the photo management device and the like according to the above-described embodiment may be stored in the CD-ROM 3101, inserted into the CD-ROM drive 3012, and further transferred to the hard disk 3017. Alternatively, the program may be transmitted to the computer 301 via a network (not shown) and stored on the hard disk 3017. The program is loaded into RAM 3016 at run time. The program may be loaded directly from the CD-ROM3101 or network.

The program does not necessarily include an operating system (OS) that causes the computer 301 to execute functions such as the photo management device of the above-described embodiment, or a third-party program or the like. The program need only include a portion of the instruction that calls the appropriate function (module) in a controlled manner to obtain the desired result. It is well known how the computer system 300 works, and detailed description thereof will be omitted.

In the above program, in the step of transmitting information and the step of receiving information, processing performed by hardware, for example, processing performed by a modem or interface card in the transmission step (performed only by hardware). Processing) is not included.

Further, the number of computers that execute the above program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.

Further, in each of the above embodiments, it goes without saying that the two or more communication means (terminal information transmitting unit, terminal information receiving unit, etc.) existing in one device may be physically realized by one medium. ..

Further, in each of the above embodiments, each process (each function) may be realized by centralized processing by a single device (system), or by distributed processing by a plurality of devices. May be done.

It goes without saying that the present invention is not limited to the above embodiments, and various modifications can be made, and these are also included in the scope of the present invention.

As described above, the photo management device according to the present invention has an effect that the photographed photograph can be easily managed in association with the point of the drawing information, and is useful as a photo management device or the like.

1 Storage 2 Reception 3 Processing 4 Output 11 Drawing information storage 12 Photo storage 13 Attribute information storage 21 Output instruction reception 22 Instruction information reception 23 Shooting instruction reception 24 Design instruction reception 25 Photo instruction reception Department 26 Search instruction reception department 27 Photo position instruction reception department 31 Photographing department 32 Ancillary information acquisition department 33 Photo storage department 34 Drawing information composition department 35 Instruction photo acquisition department 36 Photo search department 37 Point information acquisition department 38 Corresponding information acquisition department 39 Attributes Information calculation unit 40 Attribute information storage unit 41 Drawing information output unit 42 Instructed photo output unit 43 Search photo output unit 44 Design output unit

Claims (14)

A drawing information storage unit that stores drawing information and
A photo storage unit that stores three or more photos associated with location information and direction information,
A drawing information output unit that outputs the drawing information and
An instruction information receiving unit that receives instruction information that is information related to an instruction for specifying a point on the drawing information output by the drawing information output unit and includes point information for specifying the point.
After receiving the instruction information, the shooting instruction reception unit that receives the shooting instruction of the photograph and
In response to the shooting instruction, a shooting unit that shoots and acquires a photo,
A photo storage unit that stores the photo in the photo storage unit in association with the point information of the instruction information, and a photo storage unit .
A photo position instruction reception unit that accepts two or more photo position instructions including a photo identifier that identifies one photo and location information,
Correspondence to acquire two or more correspondence information which is the set information of the position information and direction information corresponding to the photograph identifier which each photograph position instruction has two or more, and the point information which each photograph position instruction has two or more. Information acquisition department and
Attribute information that calculates the point information and direction information of the other photo using the two or more correspondence information acquired by the correspondence information acquisition unit and the position information and direction information of the other photo of the photo storage unit. Calculation part and
A photo management device including an attribute information storage unit that stores the point information and the direction information in association with the other photo. The photo position instruction reception section
Accepts two or more photo position instructions, including a photo identifier that identifies one photo, location information, and direction information.
The corresponding information acquisition unit
The position information and the direction information corresponding to the photo identifiers of the two or more photo position indications, and the two or more correspondence information which is the set information of the point information and the direction information of each of the two or more photo position indications. photo management apparatus according to claim 1, wherein the acquiring. The instruction information includes point information and direction information indicating a shooting direction.
The photo storage unit is
The photo management device according to claim 1 or 2 , wherein the photo is stored in the photo storage unit in association with the point information and the direction information. Ancillary information acquisition unit that acquires ancillary information that is contextual information at the time of taking a picture,
The photo storage unit is
The photo management device according to any one of claims 1 to 3 , wherein the incidental information is also associated with the photo and stored in the photo storage unit. The photo management device according to claim 4 , wherein the incidental information is time information related to the time of shooting. The photo storage unit
The photo management device according to any one of claims 1 to 5, which can store two or more photographs in the same manner in association with point information. Using one or more point information corresponding to one or more photographs of the photo storage unit, drawing information with a symbol is configured by adding a symbol to the points corresponding to one or more point information to the drawing information. Drawing information component with design and
An output instruction reception unit that accepts output instructions for drawing information,
The drawing information output unit
The photo management device according to any one of claims 1 to 6, which outputs the drawing information with a symbol in response to the reception of the output instruction. A symbol instruction receiving unit that receives a symbol instruction for a symbol of drawing information with a symbol output by the drawing information output unit, and a symbol instruction receiving unit.
An instruction photo acquisition unit that acquires two or more photographs paired with the point information corresponding to the symbol for the symbol instruction from the photo storage unit in response to the reception of the symbol instruction.
The photo management device according to claim 7 , further comprising an instruction photo output unit that outputs two or more photographs acquired by the instruction photo acquisition unit side by side based on one or more information. The instruction photo output unit is
The photo management device according to claim 8 , wherein two or more photographs acquired by the instruction photograph acquisition unit are sorted and output based on the time information corresponding to the photographs. When the shooting instruction receiving unit receives a shooting instruction for a photograph after receiving the symbol instruction, the shooting unit takes a picture, acquires a picture, and obtains a photograph.
The photo storage unit is
The photo management device according to claim 8 , wherein the photograph is stored in the photo storage unit in association with the point information corresponding to the symbol corresponding to the symbol instruction. A search instruction reception unit that accepts search instructions including period information indicating the shooting period,
A photo search unit that acquires one or more photos paired with the time information corresponding to the period information from the photo storage unit in response to the acceptance of the search instruction.
The photo management device according to any one of claims 1 to 10 , further comprising a search photo output unit that outputs one or more photographs acquired by the photo search unit. A photo instruction reception unit that accepts photo instructions, which are instructions for the output photos,
In response to the acceptance of the photo instruction, the point information acquisition unit that acquires the point information corresponding to the photo instruction, and
The design of the point corresponding to the point information, wherein the point information acquisition unit has acquired, claim 1 1 have shifted one of claims 1, further comprising a symbol output unit for outputting on the drawing information being output The photo management device described in. Drawing information storage unit Drawing information is stored, photo storage section 3 or more photos associated with the position information and direction information is stored, the drawing information output unit, the instruction information receiving unit, an imaging instruction accepting section, shooting It is a photo management method realized by a unit , a photo storage unit , a photo position instruction reception unit, a corresponding information acquisition unit, an attribute information calculation unit, and an attribute information storage unit.
A drawing information output step in which the drawing information output unit outputs the drawing information,
The instruction information receiving unit receives instruction information that is information related to an instruction for specifying a point on the drawing information output in the drawing information output step and includes point information for specifying the point. When,
After the shooting instruction receiving unit receives the instruction information, the shooting instruction receiving step of receiving the shooting instruction of the photograph and the shooting instruction receiving step.
A shooting step in which the shooting unit shoots and acquires a photo in response to the shooting instruction.
A photo storage step in which the photo storage unit stores the photo in the photo storage unit in association with the point information of the instruction information.
A photo position instruction reception step in which the photo position instruction reception unit receives two or more photo position instructions including a photo identifier and location information for identifying one photo, and a photo position instruction reception step.
The corresponding information acquisition unit is two or more pieces of information, which is a set of position information and direction information corresponding to a photo identifier possessed by each of the two or more photo position instructions and point information possessed by each of the two or more photo position instructions. Correspondence information acquisition step to acquire correspondence information of
The attribute information calculation unit uses the two or more correspondence information acquired in the correspondence information acquisition step and the position information and direction information of the other photo of the photo storage unit to obtain the location information of the other photo. Attribute information calculation step to calculate direction information and
A photo management method comprising an attribute information storage step in which the attribute information storage unit stores the point information and the direction information in association with the other photo. A drawing information storage unit that stores drawing information and
A computer that can access a photo storage unit that stores three or more photos associated with location information and direction information.
A drawing information output unit that outputs the drawing information and
An instruction information receiving unit that receives instruction information that is information related to an instruction for specifying a point on the drawing information output by the drawing information output unit and includes point information for specifying the point.
After receiving the instruction information, the shooting instruction reception unit that receives the shooting instruction of the photograph and
In response to the shooting instruction, a shooting unit that shoots and acquires a photo,
A photo storage unit that stores the photo in the photo storage unit in association with the point information of the instruction information, and a photo storage unit .
A photo position instruction reception unit that accepts two or more photo position instructions including a photo identifier that identifies one photo and location information,
Correspondence to acquire two or more correspondence information which is the set information of the position information and direction information corresponding to the photograph identifier which each photograph position instruction has two or more, and the point information which each photograph position instruction has two or more. Information acquisition department and
Attribute information that calculates the point information and direction information of the other photo using the two or more correspondence information acquired by the correspondence information acquisition unit and the position information and direction information of the other photo of the photo storage unit. Calculation part and
The location information and the direction information, a program to function as an attribute information storage section for storing in association with the other pictures.

Images