JP2013037476A - Observation device, observation method and imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily know an optimal shooting position.SOLUTION: An electronic camera 10 displays a through-image shot by an imaging part 11 on a display part 15. A position measurement part 23 measures a shooting position and a shooting direction. An object information acquisition part 20 acquires information for a CG object corresponding to a real-image object existing in a shooting field of view on the basis of the shooting position and the shooting direction. A display control part 14 generates a CG landscape image on the basis of the acquired information for the CG object, superimposes the generated CG landscape image on the through-image (real-image landscape image) and displays the superimposed image on the display part 15. A control part 24 turns off the display of the through-image after a certain period of time. An object display control part 21, when receiving designation of the CG object not to be displayed from a touch panel 16, puts the designated CG object into a non-display state and displays a CG object behind it.

Description

  The present invention relates to an observation apparatus, an observation method, and an imaging apparatus that display a CG object superimposed on an observed or captured image.

  Conventionally, a real view obtained from a camera with a perspective view of a two-dimensional projection of a landscape viewed from the range of the viewing angle obtained from the shape of the building around the current position of the terminal and the focal length information from the camera A navigation system is disclosed in which various types of information of an object that is displayed overlaid on an image and displayed in a perspective view are displayed on a real landscape image (Patent Document 1).

JP 2003-132068 A

  By the way, when shooting a target object that exists in a real landscape image, for example, a skyscraper, find the best shooting position such as a full view or a beautiful background if the surrounding area is surrounded by a high-rise building. It is difficult. In particular, when asking for the first place, the best shooting position could not be found without walking around.

  The present invention has been made in view of such a point, and an object thereof is to provide an observation apparatus, an observation method, and an imaging apparatus that can easily know the optimum observation position or photographing position.

  One aspect of the observation apparatus exemplifying the present invention acquires information on a CG object corresponding to a real image object existing in an observation field based on a measurement unit that measures an observation position and an observation direction, and the observation position and observation direction. An information acquisition means; a display control means for displaying the CG object on the display means based on the information; a designation means for designating a desired CG object among the CG objects; And object display control means for displaying the CG object behind it without displaying it.

  An aspect of the imaging apparatus exemplifying the present invention includes an imaging unit that images a subject, a display unit that displays an image of the captured subject, a measuring unit that measures a shooting position and a shooting direction, the shooting position, Information acquisition means for acquiring information on a CG object of a subject existing in the shooting visual field range based on the shooting direction, display control means for displaying the acquired CG object on the display means, and a CG object displayed on the display means A designating means for designating a desired CG object, and an object display control unit that displays the CG object behind the designated CG object while making the designated CG object transparent or non-displayed.

  The present invention acquires information on a CG object corresponding to a real image object existing in an observation visual field based on an observation position and an observation direction measured by a measuring unit, and based on the acquired information, a CG landscape including a CG object. Since the image is displayed on the display means, and the CG object designated by the designation means among the CG landscape images displayed on the display means is made transparent or non-displayed and the CG object behind the CG object is displayed, optimal observation The position can be easily known.

It is a block diagram which shows the outline of the electronic camera which is one Embodiment of this invention. It is a flowchart which shows the operation | movement procedure of an electronic camera. It is explanatory drawing which shows the display part which overlapped and displayed the CD landscape image on the real image landscape image. It is explanatory drawing which shows the display part which displayed the CD scenery image only by turning off the display of a real image scenery image. It is explanatory drawing which shows the display part which displayed the CG object which exists in the back of a non-display CG object. It is explanatory drawing which shows the display part which displayed the non-display CG object by the wire frame which has not performed the hidden line process. It is explanatory drawing which displayed on the display part the comment image which represented the optimal imaging | photography position with the arrow and the distance to the position. It is explanatory drawing which displayed on the display part the comment image which represented the optimal imaging | photography position also considering the height direction. It is explanatory drawing of the display part which shows the other example which hides a non-display CG object by designating the distance from a photographing position. It is explanatory drawing of the display part which shows the state which hidden the CG object which exists until the designated distance.

  An electronic camera (imaging device) 10 to which the present invention is applied includes an imaging unit 11, an image processing unit 12, a recording unit 13, a display control unit 14, a display unit 15, a touch panel 16, an operation unit 17, a comment image generation unit 18, and a CG. A landscape image drawing unit 19, a CG object information acquisition unit 20, an object display control unit 21, a communication unit 22, a position measurement unit 23, and the like, which are collectively controlled by a control unit 24.

  A touch panel 16 and an operation unit 17 are connected to the control unit 24. The operation unit 17 has a mode selection operation unit. The mode selection operation unit is an operation unit that selectively selects a normal shooting mode and a shooting position guide mode. The shooting position guide mode is a mode for displaying an optimal shooting position on the display unit 15.

  The imaging unit 11 captures a subject image formed by the photographing lens with an imaging element and outputs an imaging signal to the image processing unit 12. The image processing unit 12 converts the imaging signal into digital image data, generates a recording image and a display image (through image), and outputs them. Further, the image processing unit 12 includes an image composition unit 25 that combines the CG landscape image and the comment image with the actual landscape image (through image) in the shooting position guide mode, and outputs the combined display image. The display control unit 14 controls the display unit 15 to display the display image generated by the image processing unit 12.

  The position measurement unit 23 includes a shooting position measurement unit 26 that acquires a shooting position shot by the imaging unit 11 and a shooting direction acquisition unit 27 that acquires a shooting direction shot by the imaging unit 11.

  The communication unit 22 includes a transmitter 28 and a receiver 29, and performs communication with the information providing server 32 via the base station 30 and the network 31. The information providing server 32 stores map information including CG object data and additional information associated with each object. The data of the CG object is 3D shape data, and the map information is 3D map information in which 3D shape data is associated with its position (global position). The additional information includes information specialized for shooting, such as the name of each object, the optimal position when shooting the object, and its direction.

  The CG object information acquisition unit 20 acquires the data of the CG object corresponding to the real image object existing in the shooting range from the information providing server 32 based on the shooting position and shooting direction measured by the position measurement unit 23 together with the map information.

  The CG landscape image drawing unit 19 draws a plurality of CG object data acquired from the information providing server 32, generates a CG landscape image corresponding to the real image landscape image (through image), and displays the generated CG landscape image as an object. Output to the control unit 21. Further, the CG landscape image drawing unit 19 is input with information on the shooting angle of view from the imaging unit 11 via the control unit 24. The CG landscape image drawing unit 19 sets the viewpoint position according to the acquired shooting angle of view, thereby converting each CG object into a perspective view and drawing the CG landscape image as a three-dimensional perspective view.

  The touch panel 16 is used to input a position on the screen of the display unit 15 and is used when a CG object desired to be hidden is designated in the shooting position guide mode.

  The object display control unit 21 performs hidden surface (hidden line) processing of the CG landscape image. The hidden surface process is a process of hiding a distant CG object when a distant CG object and a nearby CG object overlap. The object display control unit 21 controls display / non-display of each CG object so that the CG object designated by the touch panel 16 is hidden and the CG object behind the CG object is displayed.

  Further, the CG object information acquisition unit 20 acquires additional information added to the acquired CG object from the information providing server 32 and sends the additional information to the comment image generation unit 18. The comment image generation unit 18 generates a comment image based on the additional information and outputs the generated comment image to the image processing unit 12.

  Information on the focal length of the photographic lens, that is, the photographic field angle obtained at the time of photographing is input from the imaging unit 11 to the image processing unit 12 via the control unit 24. The image processing unit 12 clips the CG landscape image to the display range based on the information on the shooting angle of view, and superimposes the clipped CG landscape image and the comment image on the real image landscape image, and displays the synthesized image as a display image. To the display control unit.

  Next, the operation of the above configuration will be described with reference to FIG. After the power switch of the electronic camera 10 is turned on (S-1), the mode selection operation unit is operated to select either the shooting position guide mode or the shooting mode (S-2). The shooting position guide mode is a mode in which a guide for an optimal shooting position is displayed on the display unit 15 by pseudo-erasing an object in front of the shooting range and showing an object to be shot hidden behind it. is there.

  When framing is performed after the shooting position guide mode is selected (S-3), the position measurement unit 23 measures the shooting position and shooting direction (S-4), and the measured information is obtained as a CG object information acquisition unit. Send to 20. The CG object information acquisition unit 20 sends information about the shooting position and the shooting direction to the information providing server 32 via the communication unit 22, and exists in a range determined by the shooting position and the shooting direction from the information providing server 32. Data of a plurality of CG objects and additional information associated with each CG object are acquired (S-5).

  The CG object information acquisition unit 20 sends CG object data to the CG landscape image drawing unit 19 and additional information to the comment image generation unit 18. The CG landscape image drawing unit 19 generates a CG landscape image by arranging data of a plurality of CG objects in a three-dimensional coordinate system of the horizontal direction, the height direction, and the depth (shooting distance) direction (S-6). ).

  At this time, the CG object information acquisition unit 20 converts each CG object into a perspective view by setting a viewpoint position based on the shooting angle of view acquired from the imaging unit 11 via the control unit 24, and generates a CG landscape image. Is drawn as a three-dimensional perspective view. Then, the CG landscape image drawing unit 19 sends the drawn CG landscape image to the object display control unit 21. The object display control unit 21 performs hidden surface processing on the CG landscape image, and sends the hidden surface processed CG landscape image to the image processing unit 12.

  The comment image generation unit 18 generates a comment image specialized for shooting based on the additional information obtained from the CG object information acquisition unit 20 (S-7). For example, if there is a church or the like hidden behind a building in the shooting range, as shown in FIG. 3, a text image 40 such as “There is a church in the back”, an arrow image 41 indicating the position of the church, And output to the image processing unit 12.

  The image processing unit 12 clips the CG landscape image to the display range based on the shooting angle of view information, and assigns the comment image, the clipped CG landscape image, and the real image landscape image to each layer in order from the front of the layer layer. By generating a composite image, a display image (through image) is generated and sent to the display unit 15. As a result, as shown in FIG. 3, the display unit 15 has real images of CG landscape images such that the CG objects 43a, 43b,... Coincide with the real image objects 44a, 44b,. A text image 40 such as “There is a church in the back” and an arrow image 41 indicating the position of the church are displayed in front of the landscape image (S-8).

  In FIG. 3, the CG object 43 is described as a wire frame in order to distinguish it from the real image object 44. However, since it is actually expressed by modeling with texture mapping on the surface of the wire frame, The real image landscape image is hidden by the CG landscape image.

  Thereafter, the control unit 24 controls the image processing unit 12 to turn off the display of the real image landscape image (through image) after a lapse of a certain time after displaying the CG landscape image and the real image landscape image (S-9). ). As a result, only the CG landscape image made up of the CG objects 43a, 43b,... Is displayed on the display unit 15 as shown in FIG. It should be noted that the non-display of the real image landscape image may be performed in response to a manual operation with the button provided with a real landscape image non-display button, for example.

  Thereafter, the control unit 24 monitors input from the touch panel 16 (S-10). Then, the CG object 43a corresponding to the position is hidden by touch input. That is, when the designation is made, the control unit 24 sends the touched position information to the object display control unit 21. The object display control unit 21 identifies the CG object 43a to be hidden based on the position information, and performs hidden surface processing while hiding the identified CG object 43a. As a result, as shown in FIG. 5, the CG object 43c existing behind the hidden CG object 43a is displayed (S-11).

  In FIG. 5, the building which is the CG object 43a described in FIG. 4 is hidden, and the church which is the CG object 43c existing behind the building is displayed. Thereby, it is possible to easily grasp the best position for photographing the church without walking around.

  In the normal shooting mode (S-12), in response to a shooting instruction by shutter release (S-13), a shooting operation is performed (S-14), and a real image landscape image at that time is stored in the recording unit 13. To be recorded. In addition, by executing the shooting instruction in the shooting position guide mode, the image displayed on the display unit 15 at that time, for example, any one of the images described in FIGS. 3 to 5 is recorded in the recording unit 13. Also good.

  By the way, when there are a plurality of CG objects 43 to be hidden, an operation for designating the non-display may be troublesome. Therefore, the plurality of CG objects 43 are grouped and displayed, and when any one of the grouped CG objects 43 is designated, all the grouped CG objects are hidden at once. May be. In this case, adjacent CG objects 43 or CG objects arranged at the same distance from the shooting position may be grouped.

  In each of the above embodiments, the object display control unit 21 performs the process of hiding the designated CG object, but the process may be performed so as to reduce the transmittance of the CG object. Further, as shown in FIG. 6, only the designated CG object may be represented by a wire frame 46 that is not subjected to hidden surface processing, and the CG object behind may be displayed.

  Further, as described with reference to FIGS. 3 and 4, the comment image specialized for photographing may be a comment that represents the position of a tourist attraction such as a church or a landmark, for example, hidden behind an object. As shown in FIG. 6, for example, the image may be composed of an arrow image 50 representing the direction of the optimum photographing position and a numerical image 51 representing the distance to the position. Further, as shown in FIG. 8, by measuring the altitude of the current shooting position with the position measuring unit 23, the optimal position for shooting the temple 43d by climbing up to what floor of the building existing in the shooting range. Something may be displayed in a text image 52 such as “If you climb up to the fifth floor of the building, you can see the temple in the back”. Furthermore, a voice means and a speaker may be provided, and the comment of the comment image may be notified by voice. In addition, the code | symbol 47 of FIG.7 and FIG.8 shows the CG object designated as non-display.

  In the above-described embodiment, the CG object to be hidden from the touch panel is designated. However, the present invention is not limited to this, and the CG object may be designated with a cross key or a pointing key.

  In each of the above embodiments, the CG object 47 to be hidden is designated from the touch panel 16, but not limited to this, as shown in FIG. 9, a shooting distance scale 55 representing the depth from the shooting position is displayed. The distance from the shooting position including the CG object 47 to be displayed and hidden on the unit 15 may be designated from the operation unit 17. In this case, as shown in FIG. 10, the object display control unit 21 hides all the CG objects 47 existing up to that distance based on the distance information input from the operation unit 17 via the control unit 24. To do.

  In the said embodiment, although this invention is used for the electronic camera 10, it can be used also for imaging devices, such as a mobile telephone with a camera, a smart phone, and a portable terminal. The present invention can also be used for an observation apparatus that does not have a function of recording an image.

  Further, in each of the above embodiments, the communication unit 22 is provided and communicates with the information providing server 32 to acquire CG object information and the like. However, the present invention is not limited thereto, and a card memory storing CG object information and the like is used. It may be provided so as to be detachable and obtained from a card memory.

DESCRIPTION OF SYMBOLS 10 Electronic camera 11 Imaging part 12 Image processing part 21 Object display control part

Claims (8)

A measuring means for measuring an observation position and an observation direction;
Information acquisition means for acquiring information of a CG object corresponding to a real image object existing in the observation range based on the observation position and the observation direction;
Display control means for displaying the CG object on a display means based on the information;
Designation means for designating a desired CG object among the CG objects;
Object display control means for displaying the CG object behind the specified CG object transparently or non-displayed;
An observation apparatus comprising: The observation apparatus according to claim 1,
The observation apparatus characterized in that the acquisition means acquires the map information including the CG object from a database in which the map information is registered in advance using a wireless communication means. The observation apparatus according to claim 1 or 2,
The designation means designates a distance from the observation position where the CG object to be hidden is included, and
The object display control means makes all the CG objects existing up to the specified distance transparent or non-display. The observation apparatus according to any one of claims 1 to 3,
The CG objects are grouped by adjacent objects,
The object display control unit is configured to hide each group associated with the designated CG object. In the observation device according to any one of claims 1 to 4,
An observation apparatus comprising: comment information display means for displaying comment information specialized for observation on the display means in response to designating a desired CG object. A measurement step for measuring an observation position and an observation direction;
An information acquisition step of acquiring information of a CG object corresponding to a real image object existing in the observation range based on the observation position and the observation direction;
A display control step of displaying the CG object on a display means based on the information;
A designating step of designating a desired CG object among the CG objects;
An object display control step of displaying the CG object behind the specified CG object transparently or non-displayed;
An observation method comprising: Imaging means for imaging a subject;
Display means for displaying an image of the captured subject;
Measuring means for measuring the shooting position and shooting direction;
Information acquisition means for acquiring information on a CG object of a subject existing in a shooting range based on the shooting position and shooting direction;
Display control means for displaying the acquired CG object on the display means;
Designation means for designating a desired CG object among the CG objects displayed on the display means;
An object display control means for transparently or erasing a specified CG object and displaying a CG object behind the specified CG object;
An imaging apparatus comprising: The imaging device according to claim 7.
The display control means displays the CG object on the image so as to match the position of the real image object appearing in the image,
An image pickup apparatus comprising display stop means for turning off display of the image of the subject.