JP5789982B2 - Imaging direction determining program and display device - Google Patents

Description

The present invention relates to a shooting direction determination program and a display device .

  The following photo display methods are known. In this photograph display method, a photograph is displayed on a map according to a photographing point and a photographing direction (for example, Patent Document 1).

JP 2010-39583 A

  However, in the conventional photo display method, the photographing direction of the photographed image cannot be calculated.

The shooting direction determining program according to the present invention includes a selection process for selecting a target from a shot image, and an angle calculation process for calculating an angle formed by the shooting direction of the shot image and the direction toward the selected target from the shot image. , A display process for displaying a map including a shooting position of the captured image, a guideline passing through the shooting position in the map, and a direction of the guideline displayed on the display section on the map And a shooting direction determining process for determining a shooting direction on the map based on the changed guideline, the shooting position, and the angle .
The display device according to the present invention includes a selection unit that selects a target from a captured image, an angle calculation unit that calculates an angle formed by a shooting direction of the captured image and a direction toward the selected target from the captured image, A map that includes the shooting position of the shot image, a guideline that passes through the shooting position in the map, a display unit that displays, a change unit that changes the direction of the guideline displayed on the display unit in the map, A shooting direction determining unit that determines a shooting direction in the map based on the changed guideline, the shooting position, and the angle ;

  According to the present invention, it is possible to calculate the shooting direction of a shot image.

It is a block diagram which shows the structure of one Embodiment of a personal computer. It is a figure which shows an example of an application screen. It is a flowchart figure which shows the flow of an azimuth | direction information edit process. It is a figure which shows the specific example at the time of displaying the pin 4a which shows an imaging | photography point, and the arrow 4b which shows imaging | photography direction on a map. It is the figure which showed the example of designation | designated of the landmark on a picked-up image. It is the figure which showed the example of a display of a guideline. It is the figure which showed the other use of the guideline typically.

  FIG. 1 is a block diagram illustrating a configuration of an image editing apparatus according to an embodiment of the present invention. As the image editing apparatus, for example, a personal computer (personal computer) 100 is used. The personal computer 100 includes an operation member 101, a connection IF (interface) 102, a control device 103, an HDD (hard disk drive) 104, a monitor. 105.

  The operation member 101 includes various devices operated by the user, such as a keyboard and a mouse. The connection IF 102 is an interface for connecting the personal computer 100 and an external device. In the present embodiment, the personal computer 100 is connected to the digital camera via the connection IF 102, and an image file obtained by photographing is taken from the digital camera. As the connection IF 102, a USB interface for connecting the personal computer 100 and the digital camera by wire, a wireless LAN module for wireless connection, or the like is used.

  In this embodiment, the image file captured via the connection IF 102 includes, as header information, information indicating a shooting location, for example, GPS position information (latitude / longitude information indicating a shooting location) acquired from a GPS satellite, Information indicating the direction, for example, direction information measured by an electronic compass can be recorded. For this reason, when the digital camera used for photographing has a function of acquiring GPS position information and direction information, GPS position information and direction information are recorded as header information of the image file. When the digital camera used for shooting has a function of acquiring either GPS position information or azimuth information, the acquired information is recorded as header information. In the present embodiment, it is assumed that at least GPS position information is recorded in the image file.

  The control device 103 includes a CPU, a memory, and other peripheral circuits, and controls the entire personal computer 100. The memory constituting the control device 103 is a volatile memory such as SDRAM, for example. This memory includes a work memory for the CPU to expand the program when the program is executed, and a buffer memory for temporarily recording data.

  The HDD 104 is a recording device for recording image file data fetched via the connection IF 102 and data of various programs executed by the control device 103. The program data recorded in the HDD 104 is provided by being recorded on a storage medium such as a CD-ROM or DVD-ROM, and the user installs the program data in the HDD 104 using the storage medium. The control device 103 can execute the program. In the present embodiment, the HDD 104 is installed with an image editing application for editing an image. The monitor 105 is a liquid crystal monitor, for example, and displays various display data output from the control device 103.

  In personal computer 100 according to the present embodiment, a user can start an image editing application and correct orientation information recorded as header information in an image file. In addition, when the direction information is not recorded in the image file, the direction information can be newly recorded. In the present embodiment, processing for correcting the orientation information recorded in the image file and processing for adding the orientation information to the image file are referred to as orientation information editing processing.

  For example, when the user instructs execution of the image editing application, the control device 103 displays the application screen shown in FIG. On this application screen, a list of thumbnail images of image files recorded in the HDD 104 is displayed. Further, in each thumbnail image, together with the file name of the corresponding image file, an icon 2a indicating that the GPS position information described above is recorded in the image file, and an icon 2b indicating that the direction information is recorded Are displayed in association with each other.

  That is, the GPS position information is recorded in the image file in which the icon 2a is displayed, and the GPS position information is not recorded in the image file in which the icon 2a is not displayed. In addition, the orientation information is recorded in the image file in which the icon 2b is displayed, and the orientation information is not recorded in the image file in which the icon 2b is not displayed. In the example shown in FIG. 2, it can be seen that GPS position information is recorded in all three image files. It can also be seen that the azimuth information is recorded in one image file displayed on the rightmost side, but the azimuth information is not recorded in the other two image files.

  The user can select one of the thumbnail images displayed in a list and instruct editing of an image file corresponding to the thumbnail image. When the user gives an instruction to edit an image file on the application screen, the control device 103 executes the image editing process shown in FIG.

  In step S10, the control device 103 reads GPS position information and azimuth information from the header information of the image file. At this time, if only GPS position information is recorded in the header information of the image file, only the GPS position information is read out.

  Thereafter, the process proceeds to step S20, and the control device 103 displays a map on the application screen, and clearly indicates a shooting point and a shooting direction on the map. For example, when the GPS position information and the direction information are read in step S10, the control device 103, as shown in FIG. 4, the pin 4a indicating the shooting point on the map and a straight line indicating the shooting direction, for example, an arrow 4b is displayed. On the other hand, when only the GPS position information is read in step S10, the control device 103 displays only the pin 4a indicating the shooting location on the map. Then, it progresses to step S30.

  In step S30, the control device 103 determines whether or not the user has instructed editing of the shooting direction. For example, the user confirms the direction of the arrow 4b displayed on the map for the image file in which the azimuth information is recorded, and corrects the azimuth information when there is a deviation in the azimuth. Can be directed. On the other hand, for an image file in which no orientation information is recorded, it can be instructed to newly record the orientation information in the image file. If a positive determination is made in step S30, the process proceeds to step S40.

  In step S <b> 40, the control device 103 instructs the user to specify a landmark that serves as a reference for calculating the shooting direction on the shot image. For example, the user can designate one of the landmarks shown as a subject in the captured image by clicking on the captured image with the mouse. For example, in the example illustrated in FIG. 5, it is assumed that any point on the straight line 5 a indicating the horizontal position of a mountain that is a landmark in the captured image is designated. Note that a dotted line 5b in the captured image shown in FIG. 5 indicates the center position in the horizontal direction of the captured image.

Thereafter, the process proceeds to step S50, and the control device 103 determines whether or not a landmark has been designated by the user on the captured image. If a positive determination is made in step S50, the process proceeds to step S60. In step S60, the control device 103 calculates a horizontal angle in the captured image between the horizontal center position of the captured image and the landmark position specified in step S50. Here, the method for calculating the horizontal angle between the horizontal center position of an arbitrary point (landmark position) and the captured image in the captured image, using the method disclosed in, for example, JP 2006-20334 7 JP Therefore, detailed description is omitted here. Thereafter, the process proceeds to step S70.

  In step S70, the control apparatus 103 displays the guideline used for the user to correct the shooting direction on the map based on the horizontal angle calculated in step S60. Specifically, as shown in FIG. 6A, the control device 103 corresponds to the center position in the horizontal direction of the captured image so that the intersection of the arrow 6a and the guideline 6b is the position indicated by the GPS position information. An arrow 6a indicating the azimuth, that is, a shooting azimuth, and an arrow 6a and a guideline 6b forming the horizontal angle θ calculated in step S60 are displayed. The guideline 6b displayed here is a straight line indicating the landmark position on the map. At this time, if the control device 103 reads the azimuth information in step S10, the control device 103 identifies the shooting direction based on the azimuth information, and the arrow 6a and the guideline so that the arrow 6a faces the specified shooting direction on the map. 6b is displayed. On the other hand, when the direction information is not read in step S10, the control device 103 displays the arrow 6a and the guideline 6b so that the arrow 6a faces a predetermined direction on the map, for example, north.

  In FIG. 6A, a landmark 6c on the map corresponds to a landmark in the captured image designated by the user in step S50. That is, in FIG. 6A, since the guideline 6b does not accurately indicate the direction of the landmark 6c on the map, it can be seen that there is a deviation in the azimuth information recorded in the image file. In the present embodiment, the user can edit the azimuth information recorded in the image file by correcting the guideline 6b so that the direction of the guideline 6b faces the direction of the landmark 6c on the map. For this purpose, the control device 103 performs the following process.

  In step S80, the control device 103 determines whether or not the movement of the guideline has been instructed in order to change the direction of the guideline 6b by the user. In the present embodiment, for example, the user can change the orientation of the guideline 6b by dragging the guideline 6b on the map. When an affirmative determination is made in step S80, the process proceeds to step S90, and the control device 103 moves the guideline 6b in accordance with the mouse drag operation by the user. In the present embodiment, as shown in FIG. 6B, the user moves the guide line 6b so that the guide line 6b faces the landmark 6c. At this time, the control device 103 rotates the arrow 6a and the guideline 6b around the intersection point of the arrow 6a and the guideline 6b while keeping the angle formed by the guideline 6b and the arrow 6a at the angle θ described above.

  Thereafter, the process proceeds to step S100, and the control device 103 determines whether or not the movement of the guideline 6b has been completed and an instruction to confirm the shooting direction has been issued. For example, the control device 103 determines that the determination of the shooting direction has been instructed when the mouse drag operation by the user is completed. If a positive determination is made in step S100, the process proceeds to step S110.

  In step S110, the direction of the arrow 6a when the shooting direction is determined is calculated as the shooting direction of the shot image, and the direction information of the image file is updated with the information indicating the direction. At this time, if the orientation information is recorded in the image file, the orientation information already recorded is overwritten with the orientation information calculated here. On the other hand, when no orientation information is recorded in the image file, the orientation information calculated here is newly recorded as header information of the image file. Thereafter, the processing is completed. If the GPS position information is not recorded in the image, the shooting position information is recorded by clicking the shooting position on the map before editing the direction.

According to the present embodiment described above, the following operational effects can be obtained.
(1) When a landmark serving as a reference for calculating a shooting direction on a captured image is specified by the user, the control device 103 determines the horizontal center position of the captured image and the specified landmark position. The horizontal angle θ in the captured image is calculated. The control device 103 calculates the shooting direction of the shot image based on the position of the landmark on the map and the horizontal angle θ. Thereby, the shooting direction of the shot image can be calculated.

(2) The control device 103 displays a straight line indicating the landmark position on the map as a guideline for the user to edit the shooting direction, and sets the shooting direction of the shot image based on the operation of the guideline by the user. Calculated. As a result, the user can easily edit the shooting direction only by operating the guideline displayed on the map.

(3) The control device 103 displays an arrow indicating the shooting direction along with the guideline on the map, and when the user operates the guideline so that the direction of the guideline is directed to the landmark position on the map, The guideline and the arrow are rotated while maintaining the angle formed by the arrow, and the direction in which the rotated arrow points on the map is calculated as the shooting direction of the shot image. Thus, the user can easily edit the shooting direction only by aligning the direction of the guideline with the landmark position.

(4) The control device 103 accepts an operation of dragging the guideline on the map by the user, and directs the guideline to the landmark position based on the operation. Thus, the user can easily edit the shooting direction simply by dragging the guideline on the map.

(5) The control device 103 updates the azimuth information of the image file based on the calculated shooting direction so as to associate the shot image with the direction information. This makes it possible to specify the shooting direction of the shot image later.

-Modification-
The image editing apparatus according to the above-described embodiment can be modified as follows.
(1) In embodiment mentioned above, the user demonstrated the example which can change the direction of the guideline 6b by dragging the guideline 6b on a map. However, the method of changing the orientation of the guideline 6b is not limited to this, and for example, the user instructs to point the tip of the guideline 6b to the clicked position by clicking and specifying an arbitrary position on the map. can do. In this case, the control device 103 keeps the angle between the guideline 6b and the arrow 6a at the angle θ, and the arrow 6a and the guideline 6b so that the tip of the guideline 6b faces the position on the map clicked by the user. And rotate.

(2) In the above-described embodiment, the example in which the control device 103 can edit the orientation information recorded in the image file based on an instruction from the user has been described. However, the control device 103 may edit the GPS position information recorded in the image file based on an instruction from the user. For example, the user can change the shooting point by dragging the pin 4a to a position different from the initially displayed position on the map shown in FIG. Alternatively, the user may be able to change the shooting point by clicking the correct shooting point on the map shown in FIG.

  When the shooting location is changed by the user, the control device 103 may overwrite the GPS location information recorded in the image file with the location information indicating the changed shooting location. In this case, the user can edit each of the shooting point and the shooting direction, and the control device 103 records in the image file when both the shooting point and the shooting direction are edited. Both the GPS position information and the azimuth information are updated.

(3) In the above-described embodiment, when the shooting direction is edited by the user, the control device 103 updates the direction information recorded in the image file based on the editing result. . At this time, as shown in FIG. 6, the control device 103 records the position information (latitude / longitude information) and azimuth information of the landmark 6c designated by the user in the map as header information of the image file. May be. Thus, by referring to the position information and the direction information of the landmark 6c recorded in the image file, it is possible to grasp which landmark the user has edited the direction information of the captured image. It becomes.

  At this time, when the personal computer 100 is connected to the Internet or the like through a communication line, the control device 103 acquires information related to the landmark 6c, for example, the name of the landmark 6c, based on the position information of the landmark 6c. In addition, information regarding the landmark 6c may be recorded as header information of the image file.

(4) In the above-described embodiment, when the shooting direction is edited by the user, the control apparatus 103 updates the direction information recorded in the image file based on the editing result. . At this time, if the azimuth information recorded in the image file is a magnetic azimuth, it is necessary to convert it to a true azimuth, display it on a map, and accept editing of the photographic orientation. Therefore, in this case, a database for converting the magnetic orientation and the true orientation to each other is prepared in advance in the HDD 104, and the control device 103 reads the orientation information in step S10 in FIG. Referring to, the magnetic direction is converted to the true direction. Further, when updating the orientation information of the image file in step S110, information indicating the true orientation is recorded in the header.

(5) In the above-described embodiment, the horizontal angle between the landmark position designated on the photographed image by the user and the center position in the horizontal direction of the photographed image is calculated, and based on this, the arrow 6a is displayed on the map. The guideline 6b is displayed. Then, the user can edit the shooting direction by changing the direction of the guideline 6b. However, the arrow 6a and the guideline 6b displayed on the map can be used for other purposes. For example, the user may be able to check the name of a landmark when a landmark whose name is unknown is shown in the captured image.

  Specifically, the user designates a first landmark whose name is known and a second landmark whose name is to be checked on the captured image shown in FIG. When these two landmarks are designated, the control device 103 calculates horizontal angles between the designated two landmarks and the center position in the horizontal direction of the captured image. Based on the calculation result, the control device 103 indicates the shooting direction so that the intersection of the first guideline 7a and the second guideline 7b is the position indicated by the GPS position information, as shown in FIG. An arrow 6a, a first guideline 7a indicating the orientation of the A mountain as the first landmark, and a second guideline 7b indicating the orientation of the B mountain as the second landmark are displayed. The user confirms the name of the landmark existing in the direction indicated by the displayed second guideline 7b on the map, so that the second landmark that does not know the name shown in the photographed image is B You can see that it was a mountain.

  In this case as well, when there is a deviation in the azimuth information recorded in the image file, the first guideline 7a and the second guideline 7b indicate a deviation from the actual landmark position. . In this case, since the user knows the name of the first landmark, the user changes the orientation of the first guideline 7a so that the first guideline 7a faces the first landmark A mountain. be able to. When the orientation of the first guideline 7a is changed, the control device 103 maintains the angle formed by the arrow 6a and the first guideline 7a and the angle formed by the arrow 6a and the second guideline 7b, respectively. The arrow 6a, the first guideline 7a, and the second guideline 7b are rotated with the intersection of the first guideline 7a and the second guideline 7b as the center of rotation. As a result, the second guideline 7b also faces the direction of mountain B where the user wants to know the name, and the user can grasp that the second landmark is mountain B. Here, an example has been described in which the landmark whose name is to be known is only the second landmark, that is, one, but even when there are a plurality of landmarks whose names are to be known, the same processing is possible.

(6) In the above-described embodiment, the example in which the personal computer 100 is used as the image editing apparatus has been described. However, the present invention can also be applied to other devices that can read image files and perform image editing processing, such as mobile terminals and digital cameras.

  Note that the present invention is not limited to the configurations in the above-described embodiments as long as the characteristic functions of the present invention are not impaired. Moreover, it is good also as a structure which combined the above-mentioned embodiment and a some modification.

100 PC, 101 operation member, 102 connection IF, 103 control device, 104 HDD, 105 monitor

Claims (9)

A selection process for selecting a target from the captured image;
An angle calculation process for calculating an angle formed by a shooting direction of the captured image and a direction toward the selected target from the captured image;
A display process for displaying a map including a shooting position of the shot image, a guideline passing through the shooting position in the map, and a display unit;
A change process for changing the direction of the guideline displayed on the display unit in the map;
A shooting direction determination process for determining a shooting direction in the map based on the changed guideline, the shooting position, and the angle;
Shooting direction determination program for causing a computer to execute. The shooting direction determination program according to claim 1, wherein the shooting direction determination processing uses the shooting position as an intersection and sets the direction that forms the angle with the changed guideline as a shooting direction in the map . The imaging direction determination program according to claim 1, wherein the display process displays the guide line with a line on the display unit . The said display process is an imaging | photography direction determination program as described in any one of Claims 1-3 which displays the direction line which makes the said guide line and the said angle on the said display part by making the said imaging | photography position into an intersection . The shooting direction determination program according to any one of claims 1 to 4, which causes a computer to execute association processing for associating a shooting direction in the map determined by the shooting direction determination process with the shot image . The shooting direction determination program according to any one of claims 1 to 5, wherein the change process changes the guideline based on a user operation . The shooting direction determination program according to any one of claims 1 to 6, wherein the display process displays the position of the object on the map on the display unit . The shooting direction determination program according to any one of claims 1 to 6, wherein the display process displays information on the target on the display unit . A selection unit for selecting a target from the captured image;
An angle calculation unit that calculates an angle formed by a shooting direction of the captured image and a direction toward the selected target from the captured image;
A display unit for displaying a map including a shooting position of the shot image, and a guideline passing through the shooting position in the map;
A changing unit that changes a direction of the guideline displayed on the display unit in the map;
A display device comprising: a shooting direction determining unit that determines a shooting direction in the map based on the changed guideline, the shooting position, and the angle.

Images