JP2006203872A - Imaging system, imaging method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To guide a user to a desirable position where an image is captured by an imaging apparatus. <P>SOLUTION: The imaging system includes: a fixed imaging unit fixedly installed at a predetermined position; a three-dimensional image information storage section for storing a three-dimensional image of the region including the fixed imaging unit; an image comparison section for comparing a portable captured image captured by the imaging section held by a user with the three-dimensional image stored by the three-dimensional image information storage unit; a position determination section for determining the position and the orientation of the user holding the portable imaging section based on the comparison result by the image comparison section; and a guiding information presentation section for presenting information for guiding the user to set the user in the frame of a fixed captured image captured by the fixed imaging unit. The guiding information presentation section transmits the information for guiding the user to a portable unit having the portable imaging section to cause the portable unit to output the information. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an imaging system, an imaging method, and a program. In particular, the present invention relates to an imaging system for guiding a user, an imaging method, and a program for the imaging system.

Conventionally, as a system for imaging a user using a camera installed in a theme park facility or the like, there is a system in which a camera captures an image according to an instruction from a shutter device possessed by the user. (For example, refer to Patent Document 1). In this system, for example, when a user arrives near a snap spot of a camera installed on a flower bed or the like, an alarm sound is emitted from a shutter device owned by the user. The user confirms the alarm sound and then presses the shutter button of the shutter device to capture an image using the camera, so that the user can capture an image with a desirable photo opportunity for the user.
JP 2003-78804 A

  In such a system, the location of the snap spot cannot be easily known until the user arrives in the vicinity of the snap spot. In addition, for example, when the user wants to take a picture of the user himself against the background of a famous building in a theme park facility etc., the user can take an image of an optimal composition within the snap point. It is not possible to accurately determine whether or not. For this reason, depending on the position where the user stands, for example, a famous building to be copied in the background may be hidden by the user himself / herself. Therefore, there is a problem that the user cannot easily capture an image with a desirable composition.

  Therefore, an object of the present invention is to provide an imaging system, an imaging method, and a program that can solve the above-described problems. This object is achieved by a combination of features described in the independent claims. The dependent claims define further advantageous specific examples of the present invention.

  An imaging system according to a first aspect of the present invention includes a fixed imaging unit fixedly installed at a predetermined position, a 3D image information storage unit that stores 3D image information of an area including the fixed imaging unit, and a user The portable imaging unit possessed by the portable imaging unit based on the comparison result by the image comparison unit that compares the portable imaging image captured by the portable imaging unit possessed by the three-dimensional image information stored by the three-dimensional image information storage unit. A position specifying unit that specifies the position and orientation of the user, and a guidance information presentation unit that presents information for guiding the user so that the user is reflected in the fixed captured image captured by the fixed imaging unit.

  The guidance information presentation unit may transmit and output information for guiding the user to the portable terminal having the portable imaging unit. The mobile terminal further includes a display unit that displays a mobile captured image captured by the mobile image capturing unit, and the guidance information presenting unit has a direction and position of the fixed image capturing unit on the mobile captured image displayed by the display unit. Information indicating at least one of them may be superimposed and displayed.

  A GPS information acquisition unit that acquires GPS information indicating the position of the portable imaging unit is further provided, and the image comparison unit is viewed from a predetermined range including the position of the portable imaging unit indicated by the GPS information acquired by the GPS information acquisition unit. The three-dimensional image information stored in the three-dimensional image information storage unit corresponding to the area where the image can be captured may be compared with the portable captured image captured by the portable imaging unit.

  In the imaging method according to the second aspect of the present invention, a portable captured image captured by a portable imaging unit possessed by a user is fixedly installed at a predetermined position in which a three-dimensional image information storage unit stores in advance. An image comparison stage for comparing with the three-dimensional image information of the area including the fixed imaging unit, a position specifying stage for specifying the position and orientation of the user who owns the portable imaging unit based on the comparison result in the image comparison stage, and fixed imaging A guidance information presentation step of presenting information for guiding the user so that the user is reflected in a fixed captured image captured by the unit, and a step of capturing the user by the fixed imaging unit.

  According to the third aspect of the present invention, there is provided a program for an imaging system that guides a user, wherein the imaging system stores three-dimensional image information including a fixed imaging unit that is fixedly installed at a predetermined position. Based on the comparison result by the image comparison unit and the image comparison unit that compares the original image information storage unit, the portable image captured by the portable imaging unit possessed by the user with the three-dimensional image information stored by the three-dimensional image information storage unit A position specifying unit that specifies the position and orientation of the user who owns the portable imaging unit, and a guidance information presentation unit that presents information for guiding the user so that the user is reflected in a fixed captured image captured by the fixed imaging unit. .

  Note that the above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.

  ADVANTAGE OF THE INVENTION According to this invention, a user can be guide | induced to the desired position imaged with an imaging device.

  Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the claimed invention, and all combinations of features described in the embodiments are inventions. It is not always essential to the solution.

  FIG. 1 shows an example of a use environment of an imaging system according to an embodiment of the present invention. The imaging system, for example, captures a picture of a user who is visiting an amusement park and provides it to the user. The fixed imaging unit 110 is installed at a position where a user's image can be taken against the background of the famous copper image 190 of the amusement park. The user captures a landscape image around the user using the mobile terminal 140 possessed by the user. The portable terminal 140 transmits the landscape image to the user guidance device 180. The user guidance device 180 compares the landscape image received from the mobile terminal 140 with the three-dimensional map information including the amusement park stored in the user guidance device 180, so that the landscape image is captured in the amusement park. Determine the user's location.

  The user guidance device 180 obtains information that guides the user from the determined position of the user in the amusement park to a location where the user is imaged by the fixed imaging unit 110, for example, the position of the fixed imaging unit 110, and the user image with the copper image 190 as a background. A position where the user should stand to take an image is transmitted to the portable terminal 140. The mobile terminal 140 displays the guidance information received from the user guidance device 180 and guides the user to a place where the image is captured by the fixed imaging unit 110. The user moves while viewing the guidance information displayed on the mobile terminal 140. In the vicinity of the copper image 190, an imaging position mark 192 is drawn at a location where the user is located in order to obtain an image against the background of the copper image 190. The user stands on the imaging position mark 192 and takes an image of the user against the background of the copper image 190 using the fixed imaging unit 110.

  The server 120 acquires an image captured by the fixed imaging unit 110 and stores the acquired image in a directory provided for each user, for example, a directory associated with the mobile terminal 140. When the user leaves the amusement park, the user receives an image stored in the server 120 for each user. Further, the server 120 may provide the user with an image stored in the server 120 by transmitting the image to the mobile terminal 140. The mobile terminal 140 may be a mobile information terminal such as a camera-equipped mobile phone owned by the user, or may be a mobile information terminal lent to a user who enters the amusement park.

  According to the imaging system of the present embodiment, the user can be guided to a place where the fixed imaging unit 110 captures an image. Therefore, the user can capture an image with an appropriate composition using the fixed imaging unit 110.

  FIG. 2 shows an example of a block configuration of the imaging system. The imaging system includes a fixed imaging unit 110, a server 120, a user guidance device 180, and a mobile terminal 140. The server 120 includes an imaging control unit 212 and a captured image acquisition unit 214. The user guidance device 180 includes a three-dimensional image information storage unit 222, an image comparison unit 224, a position specification unit 226, and a guidance information presentation unit 228. The portable terminal 140 includes an imaging instruction unit 242, a portable imaging unit 244, a position acquisition unit 248, and a display unit 246.

  The portable terminal 140 is carried by the user. The imaging instruction unit 242 instructs the fixed imaging unit 110 to perform imaging. The imaging control unit 212 captures an image using the fixed imaging unit 110 when a signal that instructs the fixed imaging unit 110 to perform imaging is received from the imaging instruction unit 242.

  For example, the imaging control unit 212 receives the imaging instruction from the imaging instruction unit 242 by the antenna unit 130 by wireless communication. In addition, the imaging control unit 212 may receive an imaging instruction from the imaging instruction unit 242 by infrared communication.

  The fixed imaging unit 110 is fixedly installed at a predetermined position. The fixed imaging unit 110 receives light from the subject with an imaging device such as a CCD and images the subject. The captured image acquisition unit 214 acquires and stores the captured image captured by the fixed imaging unit 110.

  Further, the fixed imaging unit 110 may continuously image a subject at a predetermined time interval. The fixed imaging unit 110 may hold a predetermined number of images obtained by continuously imaging. The captured image acquisition unit 214 may acquire a captured image captured at a timing closest to the time when the fixed imaging unit 110 is instructed to capture among the captured images held by the fixed imaging unit 110. .

  Note that the server 120 may transmit the captured image acquired by the captured image acquisition unit 214 to the mobile terminal 140. Then, the mobile terminal 140 may display the captured image received from the server 120 on the display unit 246 and present it to the user.

  The portable imaging unit 244 captures images based on user operations and generates a portable captured image. The mobile imaging unit 244 may be, for example, a camera owned by the user, a camera-equipped mobile phone, and the like, and captures a mobile captured image around the user based on the user's operation.

  The 3D image information storage unit 222 stores 3D image information of an area including the fixed imaging unit 110. Specifically, the three-dimensional image information is three-dimensional map image information that includes an area that can be imaged by the mobile terminal 140 and is wider than an area that can be imaged by the mobile terminal 140.

  The image comparison unit 224 compares the mobile captured image captured by the mobile image capturing unit 244 with the 3D image information stored in advance in the 3D image information storage unit 222. The position specifying unit 226 specifies the position and orientation of the user who owns the portable imaging unit 244 based on the comparison result by the image comparison unit 224. The guidance information presentation unit 228 presents information for guiding the user so that the user appears in the fixed captured image captured by the fixed imaging unit 110. Specifically, the guidance information presentation unit 228 transmits information for guiding the user to the mobile terminal 140 to be output. For this reason, the user can move toward the fixed imaging unit 110 while confirming the position of the fixed imaging unit 110 using the mobile terminal 140 as needed.

  The display unit 246 displays the mobile captured image captured by the mobile image capturing unit 244. And the guidance information presentation part 228 superimposes and displays the information which shows at least one of the direction and position where the fixed imaging part 110 exists on the portable captured image which the display part 246 displays. Since the guidance information presentation unit 228 presents information for guiding the user on the mobile captured image captured by the mobile imaging unit 244, the user can display the current user position and the position of the fixed imaging unit 110 on a map or the like. As compared with the case of moving toward the fixed imaging unit 110 while comparing the two, it is possible to move to the position of the fixed imaging unit 110 more easily.

  Note that the position acquisition unit 248 acquires the position of the portable imaging unit 244. Specifically, the position acquisition unit 248 is an example of the GPS information acquisition unit of the present invention, receives GPS information from GPS satellites, and acquires the latitude and longitude of the mobile terminal 140 based on the received GPS information. . Then, the image comparison unit 224 stores three-dimensional image information corresponding to a region that can be seen from a predetermined range including the position of the portable imaging unit 244 indicated by the position of the portable imaging unit 244 acquired by the position acquisition unit 248. The three-dimensional image information stored in the unit 222 and the mobile captured image captured by the mobile image capturing unit 244 are compared. For this reason, the position specifying unit 226 can limit the range of the 3D image information to be compared to the range in the vicinity of the mobile terminal 140 when comparing the 3D image information and the mobile captured image. It is possible to determine the position of the portable imaging unit 244 at a higher speed than in the case of not limiting.

  FIG. 3 shows an example of a procedure in which the user guidance device 180 presents information for guiding the user. The portable terminal 140 captures an image around the user by a user operation. For example, the mobile terminal 140 captures mobile captured images (322, 332) as images around the user at the user position 302 in the amusement park. Then, the mobile terminal 140 transmits the mobile captured image to the image comparison unit 224. At this time, the image comparison unit 224 compares the mobile captured image received from the mobile image capturing unit 244 with the 3D image information stored in the 3D image information storage unit 222. Then, the position specifying unit 226 specifies the position and orientation of the mobile terminal 140 that captured the mobile captured image based on the comparison result by the image comparison unit 224.

  Specifically, the image comparison unit 224 selects the position of the range included in the 3D map image stored by the 3D image information storage unit 222 as the imaging position. Then, the image comparison unit 224 selects an imaging direction in which images are captured from the selected imaging position, for example, in increments of 1 degree. Further, the image comparison unit 224 selects the angle of view captured in the selected imaging direction, for example, in increments of 1 degree. And the image comparison part 224 calculates the pixel value of each image obtained when it image | photographs on the conditions of several imaging directions and several angle of view from several imaging positions using three-dimensional image information. Thus, a plurality of comparison images are generated. Note that the image comparison unit 224 may acquire a zoom value when a mobile captured image is captured from the mobile image capturing unit 244 and generate a comparison image to be obtained when the captured image is captured with the acquired zoom value. The image comparison unit 224 may generate a comparison image having the same resolution as the acquired mobile captured image. Then, the image comparison unit 224 obtains a difference between the plurality of comparison images and the portable captured image received from the portable imaging unit 244. And the position specific | specification part 226 uses the imaging position and imaging direction which produced | generated the comparison image from which a difference with a portable captured image becomes the minimum among several comparative images as a position and direction of the user who respectively possesses the portable terminal 140. Identify.

  The guidance information presentation unit 228 stores in advance the position of the fixed imaging unit 110 in the 3D image information stored in the 3D image information storage unit 222. Then, the guidance information presentation unit 228 displays information for guiding the user holding the mobile terminal 140 based on the position and orientation of the user specified by the position specifying unit 226 and the position of the fixed imaging unit 110 stored in advance. 140. For example, the guidance information presentation unit 228 transmits the position where the fixed imaging unit 110 exists or the direction where the fixed imaging unit 110 is located to the mobile terminal 140 in the mobile captured image.

  Further, the guidance information presentation unit 228 may store in advance the imaging region of the fixed imaging unit 110 in the 3D image information stored in the 3D image information storage unit 222. Then, the guidance information presentation unit 228 determines the imaging area of the fixed imaging unit 110 in the mobile captured image based on the position and orientation of the user specified by the position specifying unit 226 and the imaging area of the fixed imaging unit 110 stored in advance. The position or direction in which the imaging region of the fixed imaging unit 110 is located is specified, and the position or direction is transmitted to the mobile terminal 140.

  In addition, the guidance information presentation unit 228 stores in advance a position where the user should be present in order to capture an image with the most appropriate composition in the 3D image information stored in the 3D image information storage unit 222 by the fixed imaging unit 110. You may keep it. Then, the guidance information presentation unit 228 determines the position or user in the mobile captured image based on the position and orientation of the user specified by the position specifying unit 226 and the position where the user should be stored in advance. The direction to the position to be present is specified, and the position or direction is transmitted to the mobile terminal 140.

  The display unit 246 receives the direction from the guidance information presenting unit 228 indicating the direction in which the fixed imaging unit 110 is located, the direction in which the imaging region by the fixed imaging unit 110 is located, or the direction where the user should be. The mark 326 is displayed superimposed on the mobile captured image 322 (guide image 324). The user can take an image using the fixed imaging unit 110 by moving in the direction of the direction mark 326 in the guidance image 324.

  The guidance information presentation unit 228 is a distance from the user position specified by the position specifying unit 226 to the position of the fixed imaging unit 110, the imaging region imaged by the fixed imaging unit 110, or the position where the user should be present. And the information indicating the distance may be transmitted to the mobile terminal 140. The display unit 246 may further superimpose and display information indicating the distance received from the guidance information presentation unit 228 on the guidance image.

  In addition, the display unit 246 displays the imaging device mark 336 indicating the position of the fixed imaging unit 110 received from the guidance information presentation unit 228 so as to be superimposed on the mobile captured image 332 (guidance image 334). In addition, the display unit 246 displays the user position mark 338 that is received from the guidance information presentation unit 228 and indicates the position where the user should be present, superimposed on the mobile captured image 332. In addition, the display unit 246 may display a mark that is received from the guidance information presentation unit 228 and that indicates an imaging area of the fixed imaging unit 110 in the mobile captured image, superimposed on the mobile captured image.

  Further, the user guidance device 180 may transmit a map image that guides the user to the imaging region by the fixed imaging unit 110 to the mobile terminal 140 based on the position and orientation of the user specified by the position specifying unit 226. For example, the position specifying unit 226 generates a map image including the position of the user specified by the position specifying unit 226. At this time, the position specifying unit 226 may generate the map image from the 3D image stored in the 3D image information storage unit 222. Then, the guidance information presentation unit 228 superimposes the user current position mark 344 on the position of the user specified by the position specification unit 226 on the map image (guidance map image 342).

  In addition, the guidance information presentation unit 228 may generate a guidance map image 342 including a display indicating the orientation of the user specified by the position specifying unit 226. For example, the guidance information presentation unit 228 generates a guidance map image 342 including a user current position mark 344 that imitates a person who faces the direction of the user specified by the position specification unit 226. Accordingly, the user can easily confirm the direction in which the imaging region of the fixed imaging unit 110 is located from the current position of the user and the direction in which the user is currently facing, so the user should move more quickly. The direction can be determined.

  In addition, the guidance information presentation unit 228 may generate a guidance map image 342 including a user position mark 348 indicating a position where the user imaged by the fixed imaging unit 110 should be present on the map image. In addition, the guidance information presentation unit 228 may generate a guidance map image 342 further including an imaging device mark 352 that indicates the position of the fixed imaging unit 110. In addition, the guidance information presentation unit 228 may generate a guidance map image 342 further including a user orientation mark 350 that indicates a direction in which the fixed imaging unit 110 is located from a position where the user should be present. In addition, the guidance information presentation unit 228 may store the imaging direction of the fixed imaging unit 110 in advance and generate a guidance map image 342 further including an imaging direction mark 354 indicating the imaging direction. In addition, the guidance information presentation unit 228 may generate a guidance map image that further includes a mark indicating an imaging region by the fixed imaging unit 110.

  In addition, the guidance information presentation unit 228 further includes a user movement direction mark 346 that indicates a direction from the current position of the user to the position of the fixed imaging unit 110, the imaging region by the fixed imaging unit 110, or the position where the user should be. The guidance map image 342 including may be generated. In addition, the guidance information presentation unit 228 may generate a guidance map image 342 including a user current position mark 344 indicating the current position of the user and the direction to the position where the user should move. For example, the guide information presenting unit 228 includes a guide map image 342 including a user current position mark 344 that imitates a person facing the direction to the position where the user should move at the user position specified by the position specifying unit 226. Is generated.

  The guidance information presentation unit 228 may generate a guidance map image of an area including the plurality of fixed imaging units 110. In addition, the guidance information presentation unit 228 may generate a guidance map image of an area including the fixed imaging unit 110 that is closest to the current position of the user. In addition, the guide information presentation unit 228 stores the fixed imaging unit 110 selected in advance by the user in association with the mobile terminal 140 possessed by the user, and is stored in association with the mobile terminal 140. A guide map image in a range including the fixed imaging unit 110 may be generated and presented to the mobile terminal 140.

  The guidance information presentation unit 228 may guide the user by voice so that the user is reflected in the fixed captured image captured by the fixed imaging unit 110. Specifically, the guidance information presentation unit 228 generates a guidance voice for guiding the user and transmits it to the user's mobile terminal 140. Then, the user's mobile terminal 140 guides the user by reproducing the guidance voice transmitted from the guidance information presentation unit 228. For example, the guidance information presenting unit 228 is directed to the position where the fixed imaging unit 110 exists with respect to the position and orientation of the user specified by the position specifying unit 226 or the position of the fixed imaging unit 110 from the specified user position. A guidance voice indicating at least one of the distance to the imaging region from the specified user position or the direction to the imaging region by the fixed imaging unit 110 with respect to the specified user position and orientation . For example, the guidance information presentation unit 228 generates a guidance voice such as “Please move 400 m toward the left front”. Needless to say, the mobile terminal 140 may receive the direction or distance from the guidance information presentation unit 228 and generate a guidance voice from the received direction or distance.

  In addition, the guide information presenting unit 228 includes the fixed imaging unit 110 from the position of the user specified by the position specifying unit 226 based on the 3D image information stored in the 3D image information storage unit 222. A user's movement route to the imaging region by the position or the fixed imaging unit 110 may be specified, and a guidance voice indicating the specified movement route may be generated. For example, the guidance information presentation unit 228 may generate a guidance voice such as “Go left 100 m, then turn right, and continue 300 m”. Note that the 3D image information storage unit 222 may store information indicating an area that the user can enter in the 3D image information. The area where the user can enter may be an area such as a road or a plaza in an amusement park, for example. Then, the guidance information presenting unit 228 is based on the information indicating the area that can be entered by the user stored in the 3D image information storage unit 222 and the position of the user specified by the position specifying unit 226. The movement path to the position where 110 is present or the imaging area by the fixed imaging unit 110 may be specified.

  Note that when the image comparison unit 224 selects an imaging position for generating a comparison image, an area in the 3D image information stored in the 3D image information storage unit 222 that the user can enter, for example, an amusement park A position in an area such as a road or a square in the ground may be selected. As a result, the position specifying unit 226 can specify a comparative image that matches the mobile captured image in a shorter time compared to the case of generating a comparative image from a captured position over a wider area in the amusement park.

  Note that the server 120 may receive a wireless signal transmitted from the mobile terminal 140 using the plurality of antenna units 130. And the image comparison part 224 may further specify the area | region where the portable terminal 140 exists in three-dimensional image information based on the receiving strength which received the radio signal from the portable terminal 140 with the some antenna part 130. FIG.

  For example, when selecting an imaging position for generating a comparison image, the image comparison unit 224 selects a position within a predetermined region including the antenna unit 130 that has received the wireless signal from the mobile terminal 140 with the strongest intensity. To do. In addition, the image comparison unit 224 may determine whether the mobile terminal is based on the reception strength of the radio signal from the mobile terminal 140 received by the three or more antenna units 130 that are not in a straight line position and the position of the antenna unit 130. The area where 140 exists may be specified. Then, the image comparison unit 224 selects a position in a predetermined area including the identified area as an imaging position for generating a comparison image.

  The mobile terminal 140 may store GPS information received from GPS satellites in a predetermined time range including the time when the mobile captured image is captured in association with the mobile captured image. When transmitting the mobile captured image, the mobile terminal 140 transmits the GPS information stored in association with the mobile captured image to the image comparison unit 224. Specifically, the portable imaging unit 244 attaches the GPS information acquired by the position acquisition unit 248 to the portable captured image and transmits it to the image comparison unit 224. Then, when selecting an imaging position for generating a comparison image, the image comparison unit 224 identifies an area where the mobile terminal 140 exists based on GPS information received from the mobile terminal 140, and includes the identified area. A position in a predetermined area is selected as an imaging position. For this reason, the position specifying unit 226 only has to compare the three-dimensional image information in the range that the user can see from the position indicated by the GPS information and the mobile captured image, and thus specify the direction of the user at a higher speed. Can do. Even if the position indicated by the GPS information includes an error, the position specifying unit 226 compares the three-dimensional image information in a range that can be viewed by the user from a position near the position with the mobile captured image, so that the position specifying unit 226 An error in the position of the user to be identified can be reduced.

  Note that the image comparison unit 224 determines that an image region having a frequency component equal to or lower than a predetermined frequency at a predetermined intensity or higher in the portable captured image received from the portable imaging unit 244 is an image region where the sky is captured. Thus, the portable captured image and the comparative image may be compared in an area excluding the image area. Thereby, the image comparison unit 224 can appropriately compare the mobile captured image and the comparative image even when the sky is reflected in the mobile captured image. In addition, the image comparison unit 224 extracts a subject captured in the mobile captured image by, for example, edge extraction, and compares the subject with a comparison image obtained from the three-dimensional map information by pattern matching or the like. Good.

  FIG. 4 shows an example of division of the mobile captured image when the mobile captured image is weighted for each partial region and compared with the comparative image. When comparing the mobile captured image 322 and the three-dimensional image information, the image comparison unit 224 displays the comparison result with the three-dimensional image information in a partial region of the mobile captured image 322 as the three-dimensional image in another partial region. A comparison result weighted from the comparison result with the image information is generated. Specifically, the image comparison unit 224 generates a comparison result in which the comparison result with the three-dimensional image information in the central partial region of the mobile captured image 322 is more weighted.

  More specifically, the image comparison unit 224 calculates the degree of coincidence for each partial region by comparing the image content of the portable captured image 400 with a comparative image for each of a plurality of predetermined partial regions. The image comparison unit 224 predefines a weighting coefficient for the matching degree for each partial region. Specifically, the image comparison unit 224 determines that the weighting coefficient of the central partial region is larger than the surrounding weighting coefficients. In the example of this figure, 4 is set as the weighting coefficient for the partial areas 401 to 414 located outside the image, and 10 is set as the weighting coefficient for the partial areas 415 to 420 inside the image. Then, the image comparison unit 224 calculates the degree of coincidence obtained by summing the values obtained by multiplying the calculated degree of coincidence by the weighting coefficient over the partial areas as a comparison result between the portable captured image and the comparison image. As described above, the image comparison unit 224 evaluates the degree of coincidence of the central image of the mobile captured image higher than the degree of coincidence of the image of the surrounding area. The influence on the result can be reduced.

  Note that the image comparison unit 224 may set a larger weighting coefficient for a partial region having a higher spatial frequency of the image. Further, in the above description, an example of the operation in which the image comparison unit 224 compares with the three-dimensional image information for each predetermined partial area has been described. However, the image comparison unit 224 is a portion set by the portable imaging unit 244. You may compare with three-dimensional image information for every area | region. For example, the portable imaging unit 244 calculates the importance of the image for each partial region based on the imaging performance or imaging conditions of the portable imaging unit 244, and the importance that the calculated importance is associated with each partial region. Information is recorded along with the mobile captured image. For example, the portable imaging unit 244 records importance information indicating a weighting coefficient according to the degree of influence of the aberration along with the portable captured image. Specifically, the portable imaging unit 244 sets a larger weighting coefficient for the partial region at the center of the portable captured image. Then, the image comparison unit 224 calculates the degree of coincidence with the comparison image for each partial region indicated by the importance level information attached to the mobile captured image. Then, the image comparison unit 224 determines the degree of coincidence obtained by summing the values obtained by multiplying the degree of coincidence by the weighting coefficient indicated by the importance degree information attached to the portable captured image over the partial area, the portable captured image, and the comparison image. It may be calculated as a comparison result.

  According to the imaging system described above, the user can be easily guided from the location where the user is currently located to the location where the user should be located in order to capture an image with an appropriate composition using the fixed imaging unit 110. Can do. Therefore, the user can easily capture an image having a desired composition.

  FIG. 5 shows an example of a hardware configuration of the user guidance device 180 according to the present embodiment. The user guidance device 180 includes a CPU peripheral portion having a CPU 1505, a RAM 1520, a graphic controller 1575, and a display device 1580 connected to each other by a host controller 1582, and a communication connected to the host controller 1582 by an input / output controller 1584. An input / output unit having an interface 1530, a hard disk drive 1540, and a CD-ROM drive 1560, and a legacy input / output unit having a ROM 1510, a flexible disk drive 1550, and an input / output chip 1570 connected to the input / output controller 1584. .

  The host controller 1582 connects the RAM 1520, the CPU 1505 that accesses the RAM 1520 at a high transfer rate, and the graphic controller 1575. The CPU 1505 operates based on programs stored in the ROM 1510 and the RAM 1520 and controls each unit. The graphic controller 1575 acquires image data generated by the CPU 1505 and the like on a frame buffer provided in the RAM 1520 and displays the image data on the display device 1580. Alternatively, the graphic controller 1575 may include a frame buffer that stores image data generated by the CPU 1505 or the like.

  The input / output controller 1584 connects the host controller 1582 to the hard disk drive 1540, the communication interface 1530, and the CD-ROM drive 1560, which are relatively high-speed input / output devices. The hard disk drive 1540 stores programs and data used by the CPU 1505. The communication interface 1530 is connected to the network communication device 1598 to transmit / receive programs or data. The CD-ROM drive 1560 reads a program or data from the CD-ROM 1595 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520.

  The input / output controller 1584 is connected to the ROM 1510, the flexible disk drive 1550, and the relatively low-speed input / output device of the input / output chip 1570. The ROM 1510 stores a boot program executed when the user guide device 180 is started, a program depending on the hardware of the user guide device 180, and the like. The flexible disk drive 1550 reads a program or data from the flexible disk 1590 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520. The input / output chip 1570 connects various input / output devices via a flexible disk drive 1550 and, for example, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

  A program executed by the CPU 1505 is stored in a recording medium such as the flexible disk 1590, the CD-ROM 1595, or an IC card and provided by the user. The program stored in the recording medium may be compressed or uncompressed. The program is installed in the hard disk drive 1540 from the recording medium, read into the RAM 1520, and executed by the CPU 1505.

  The program executed by the CPU 1505 causes the user guidance device 180 to function as the three-dimensional image information storage unit 222, the image comparison unit 224, the position specifying unit 226, and the guidance information presentation unit 228.

  The program shown above may be stored in an external storage medium. As the storage medium, in addition to the flexible disk 1590 and the CD-ROM 1595, an optical recording medium such as a DVD or PD, a magneto-optical recording medium such as an MD, a tape medium, a semiconductor memory such as an IC card, or the like can be used. Further, a storage device such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet may be used as a recording medium, and the program may be provided to the user guidance device 180 via the network.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. Various modifications or improvements can be added to the above embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

It is a figure which shows an example of the utilization environment of an imaging system. It is a figure which shows an example of the block configuration of an imaging system. It is a figure which shows an example of the procedure in which the user guidance apparatus 180 presents the information which guides a user. It is a figure which shows the example of a division | segmentation of a portable picked-up image when weighting a portable picked-up image for every partial area, and comparing with a comparative image. It is a figure which shows an example of the hardware constitutions of the user guidance apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 110 Fixed imaging part 120 Server 130 Antenna part 140 User terminal 180 User guidance device 190 Copper image 192 Imaging position mark 212 Imaging control part 214 Captured image acquisition part 222 Three-dimensional image information storage part 224 Image comparison part 226 Position specification part 228 Guidance information presentation Unit 242 imaging instruction unit 244 portable imaging unit 246 display unit 248 position acquisition unit 302 user position 322 portable captured image 324 guidance image 326 direction mark 332 portable imaging image 334 guidance image 336 imaging device mark 338 user location mark 342 guidance map image 344 user Current position mark 346 User movement direction mark 348 User position mark 350 User orientation mark 352 Imaging device mark 354 Imaging direction mark

Claims (6)

A fixed imaging unit fixedly installed at a predetermined position;
A 3D image information storage unit for storing 3D image information of an area including the fixed imaging unit;
An image comparison unit that compares the mobile image captured by the mobile image capture unit possessed by the user with the 3D image information stored in the 3D image information storage unit;
Based on the comparison result by the image comparison unit, a position specifying unit for specifying the position and orientation of the user possessing the portable imaging unit;
An imaging system comprising: a guidance information presentation unit that presents information for guiding the user so that the user is reflected in a fixed captured image captured by the fixed imaging unit. The imaging system according to claim 1, wherein the guidance information presentation unit transmits and outputs information for guiding the user to a portable terminal having the portable imaging unit. The portable terminal is
A display unit for displaying the mobile captured image captured by the mobile image capturing unit;
The imaging system according to claim 2, wherein the guidance information presentation unit superimposes and displays information indicating at least one of a direction and a position where the fixed imaging unit exists on the portable captured image displayed by the display unit. . A GPS information acquisition unit that acquires GPS information indicating a position of the portable imaging unit;
The image comparison unit stores the 3D image information storage unit corresponding to a region that can be seen from a predetermined range including the position of the portable imaging unit indicated by the GPS information acquired by the GPS information acquisition unit. The imaging system according to claim 1, wherein the three-dimensional image information is compared with a portable captured image captured by the portable imaging unit. 3D image information of a region including a fixed imaging unit fixedly installed at a predetermined position, in which a 3D image information storage unit stores in advance a mobile captured image captured by a mobile imaging unit possessed by a user; An image comparison stage to compare;
Based on the comparison result in the image comparison step, a position specifying step for specifying the position and orientation of the user possessing the portable imaging unit;
A guidance information presentation stage for presenting information for guiding the user so that the user is reflected in a fixed captured image captured by the fixed imaging unit;
Imaging the user by the fixed imaging unit. A program for an imaging system for guiding a user, wherein the imaging system is
A 3D image information storage unit for storing 3D image information including a fixed imaging unit fixedly installed at a predetermined position;
An image comparison unit that compares a mobile captured image captured by a mobile image capturing unit possessed by a user with the 3D image information stored in the 3D image information storage unit;
A position specifying unit for specifying the position and orientation of the user possessing the portable imaging unit based on the comparison result by the image comparing unit;
A program that functions as a guidance information presentation unit that presents information for guiding the user so that the user is reflected in a fixed captured image captured by the fixed imaging unit.

Images