JP6314427B2 - Imaging apparatus, information processing apparatus, control method, and program - Google Patents

Description

  The present invention relates to an imaging apparatus that combines and displays attribute information in a region being imaged by an imaging apparatus with a captured image.

  In recent years, using location information acquired by the location measurement function of a mobile terminal, information on nearby facilities and symbolic objects is automatically acquired from a server, etc., and combined with a captured image captured by the imaging function of the mobile terminal Thus, a system for displaying on a display unit (display) has become widespread. A typical example is Sekai Camera (registered trademark) provided by Tonchi Dot Co., Ltd. Sekai Camera (registered trademark) displays the scenery in front of it on the screen by the imaging function, and then superimposes additional information called “air tag” related to the place / object (building, signboard, etc.) To display.

  Patent Document 1 discloses a viewer device that can synthesize and display a real image captured through an imaging device or the like and virtual information related to an object reflected in the image in real time. Has been.

JP 2006-59136 A

  However, in the current Sekai Camera (registered trademark) and the viewer device described in Patent Document 1, all additional information and attribute information called “air tag” within a certain distance existing in the imaging range are displayed. When there are a plurality of “air tags” in the imaging direction, a plurality of “air tags” and attribute information are overlapped, and the “air tag” and attribute information in the back are buried and cannot be confirmed.

  In the case of Sekai Camera (registered trademark), in order to confirm the “air tag” in the back, the following operation can be used.

-Swipe the “air tag” in front (for example, flick the “air tag” in front) to the outside of the screen.
・ Narrow down the conditions of information to be displayed (only information related to ramen shops)

  However, since Sekai Camera (registered trademark) technology is considered to display additional information that the user does not notice as an “air tag” and to make the user aware of it, the additional information of the place to be confirmed from the beginning. It is better to display it.

In order to solve the above problems, the present invention automatically eliminates unnecessary additional information, adds additional information at a position of interest to a captured image, and displays additional information in an imaging range. The purpose is to provide a mechanism for adjusting and recognizing existing areas.

In order to solve the above-described problems, the present invention is an imaging apparatus that captures a predetermined imaging range that can communicate with an additional information management server having a storage unit that stores additional information associated with position information. Te, specifying means for specifying the imaging range near Ru target object, an acquisition unit for acquiring a position of the identified target product, peripheral positions of the obtained the object of the imaging range an area setting means for setting a region in an image obtained by imaging the imaging range, the information based on the additional information corresponding to the set region near Ru Target of neighborhood, a peripheral region of the said set there are a first display control means for displaying a note information of the object, the have a second display control means for distinguishably displaying the periphery of the region set by the region setting means, said second display The control means is configured to control the imaging range. Among them, an operation to change the range of the set peripheral region is received, and the peripheral region in which the range has been changed is displayed in an identifiable manner, and the first display control means Information based on the additional information corresponding to the object in the area is displayed as additional information of the object in the surrounding area where the range is changed .

According to the present invention, unnecessary additional information is automatically excluded, the additional information at the position of interest is added to the captured image and displayed, and the region displaying the additional information in the imaging range is adjusted and recognized. It has the effect of being able to.

It is a block diagram which shows the hardware constitutions of the imaging device which concerns on embodiment of this invention. It is a block diagram which shows the hardware constitutions of the additional information management server which concerns on embodiment of this invention. 1 is a system configuration diagram illustrating an overall configuration of a system according to an embodiment of the present invention. 6 is a sequence chart illustrating a flow from when the imaging apparatus receives additional information from the additional information management server to synthesize the additional information in the imaging system of the present invention. It is a schematic diagram which shows an example of the positional relationship of the to-be-photographed object and imaging device in this invention, its imaging result, and a character composition result. It is a schematic diagram which shows an example of the image of the setting screen which sets the additional information extraction range in this invention. It is the schematic diagram which showed the example which displayed the captured image and additional information on the display part.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. First, with reference to FIG. 1, the hardware configuration of the imaging apparatus 100 that implements the present invention will be described. Note that the imaging apparatus 100 is not necessarily dedicated to imaging, and a mobile terminal or a mobile phone may have the following functions.

  The imaging apparatus 100 includes a so-called digital camera, an imaging lens 101, an imaging element (hereinafter referred to as “CCD”) 102, a camera signal processing unit (hereinafter referred to as “ADC”) 103, an image processing unit 104, A system controller 110, a buffer memory 111, a flash ROM 112, an interface circuit (hereinafter referred to as “I / F circuit”) 113, a card holder 114, a memory card 115, a display driver 116, and an operation unit 120 are provided.

  The lens 101 is a lens or the like, and includes an objective lens, a zoom lens, a focus lens, and the like. The zoom lens and the focus lens are driven in the optical axis direction by a driving mechanism (not shown). The imaging element 102 is configured by a CCD image sensor that forms an image of imaging light incident from the lens 101, converts it into an electrical signal (analog signal), and outputs it.

  The camera signal processing unit (ADC) 103 has a function of performing signal processing such as digital conversion and white balance adjustment on the electric signal received from the image sensor 102 and converting it into a digital signal. The system controller 110 is connected to the image processing unit 104, buffer memory 111, flash ROM 112, I / F circuit 113, display driver 116, sound driver 118, LED driver 128, and operation unit 120.

  The image processing unit 104 includes a preprocessing unit 105, a YC processing unit 106, an electronic zoom processing unit 107, a compression unit 108, and an expansion unit 109, and generates image data from a digital signal output from the camera signal processing unit 103. Have a function of performing various image processing.

  The pre-processing unit 105 has a function of performing white balance processing for adjusting the white balance of an image based on input image data and image gamma correction processing. The white balance process is a process of adjusting the color of an image so as to be close to the actual color, or adjusting the color to an appropriate color that matches a light source (such as a fluorescent lamp or sunlight). The gamma correction process is a process for adjusting the contrast of an image. Note that the pre-processing unit 105 can also perform image processing other than white balance processing and gamma correction processing.

  The YC processor 106 separates an image based on input image data into luminance information “Y”, luminance signal and blue color difference information “Cb”, and luminance signal and red color difference information “Cr”. Have The electronic zoom processing unit 107 has a function of trimming a part of an image (for example, a central part) with a predetermined size and enlarging the trimmed image to the size of the original image by signal processing.

  The electronic zoom processing unit 107 can, for example, extract a central 1024 × 768 dot image from a captured 1600 × 1200 dot image and enlarge it to a size of 1600 × 1200 dot while performing data interpolation.

  The compression unit 108 has a function of compressing image data in a compression format such as a JPEG (Joint Photographic Expert Group) method. The decompression unit 109 has a function of decompressing compressed image data. For example, when compressing image data using the JPEG method, first, a discrete cosine transform process is performed (DCT process) that digitizes the ratio of high-frequency components and low-frequency components of image data. Next, a quantization process is performed for expressing the gradation or gradation of the image by a numerical value (quantization bit number). Finally, the image data is compressed by the Huffman encoding process.

  Specifically, the signal character string of the image data is segmented every certain bit, and a shorter code is given to a character string having a high appearance frequency. In the case of a system that records image data without performing compression processing, the compression unit 108 and the expansion unit 109 can be omitted. Further, the image data compression format is not limited to the JPEG format, and the same processing can be performed even in a GIF (Graphical Interchange Format) format.

  The buffer memory 111 temporarily stores image data when image processing is performed by the image processing unit 104. The flash ROM 112 stores various setting information of the imaging apparatus 100, designated composition information described later, and the like. The I / F circuit 113 converts the image data output from the system controller 110 into a data format that can be recorded on the memory card 115. The I / F circuit 113 converts the image data read from the memory card 115 into a data format that can be processed by the system controller 110.

  The card holder 114 includes a mechanism that allows the memory card 115 that is a recording medium to be attached to and detached from the imaging apparatus 100, and includes an electrical contact that enables data communication with the memory card 115. The card holder 114 has a structure corresponding to the type of recording medium used in the imaging apparatus 100. The memory card 115 is a card-type recording medium that incorporates a semiconductor storage element such as a flash memory and is detachable from the card holder 114. The memory card 115 can record image data picked up by the image pickup apparatus 100.

  The display driver 116 converts the image data output from the system controller 110 into a signal that can be displayed on the display 117. Specifically, the display driver 116 performs processing for converting digital image data output from the system controller 110 into an analog image signal, and then sets the image size to a size suitable for the size of the displayable area of the display 117. Perform the conversion process.

  The sound driver 118 performs processing for converting the audio data output from the system controller 110 into a signal that can be sounded by the speaker 219. An LED (Light Emitting Diode) driver 128 controls the lamp 129 in accordance with a command output from the system controller 110.

  The operation unit 120 includes a power switch 121, a mode dial 122, an imaging button 123, a touch panel key 124, a zoom button 125, and a browse (playback) button 126. The operation unit 120 receives an operation input from the user and receives a signal corresponding to the operation content. Is output to the system controller 110. The operation unit 120 includes operation buttons other than the illustrated operation buttons, but a description thereof is omitted.

  The mode dial (select button) 122 is a rotatable dial for switching the mode of the imaging operation. The user can select a plurality of imaging operation modes by operating the mode dial 122. In the embodiment of the present invention, the mode dial is described as a dial type mechanism. However, for example, a slide type button may be used instead of the dial. That is, the mechanism of the mode dial 122 is not limited to the dial, and it is essential to have a mechanism for switching the camera mode.

  In addition, as an example of the imaging operation mode, when imaging is performed using a composition, there is a mode that can accept an instruction input of the composition. Without being limited, a switching method using a touch panel (not shown) on the display 117 may be used.

  The browse button 126 is a button for switching to a browse mode (playback mode) for browsing captured image data. When the browse button 126 is pressed, the imaging mode is changed to the browsing mode. Note that the switching method to the browsing mode is not limited to pressing the browsing button 126 as described above, and may be a transition method using a touch panel on the display 117 or the like.

  In the browsing mode, the system controller 110 reads setting information and image data from the memory card 115 attached to the card holder 114 via the I / F circuit 113. The setting information includes the number of images recorded on the currently installed memory card 115 and the capacity of the recorded image data. The read image data is, for example, image data or thumbnail data for one image. Note that the image data read from the memory card 115 is compressed in a predetermined compression format as described above.

  The image data read from the memory card 115 is input to the display driver 116 via the I / F circuit 113 and the system controller 110. The display driver 116 displays the input image data on the display 117.

  The touch panel key 124 is an operation key displayed on the display, and is a key for the user to perform a predetermined instruction or function selection for the imaging apparatus 100. The user can perform operation inputs such as various setting information and user authentication information on the imaging apparatus 100 with the touch panel key 124.

  In addition, the touch panel key 124 can display a menu screen or a screen for setting various setting information for the imaging apparatus 100 on the display 117, or can select a predetermined function of the imaging apparatus 100.

  Further, the image data captured by the image capturing apparatus 100 can be previewed on the display 117 by the touch panel key 124. The preview display is a function of causing the display 117 to display an image captured by the imaging apparatus 100 immediately after that.

  Note that the preview display is not limited to a configuration in which only one image captured on the display 117 is displayed, and a plurality of images including thumbnail images may be displayed. Further, the switching of the preview display is not limited to the pressing of the touch panel key 124 but may be configured to be switched using a general method such as pressing of another button. Further, the preview display screen may be configured such that the preview display image can be deleted or edited.

  The lens control unit 127 controls the lens 101 such as zoom, focus, and diaphragm. In addition, the imaging apparatus 100 includes an imaging mode in which a subject is imaged to obtain image data and a browsing (reproduction) mode in which image data obtained in the imaging mode is displayed.

  Note that audio can be recorded and reproduced in the same manner as the imaging apparatus 100 by using a microphone or a speaker. Further, when recording video (moving image), normal audio recording is also performed at the same time, and video and audio are multiplexed by the compression unit 108 and the expansion unit 109.

  An imaging operation in the imaging apparatus 100 will be described with reference to FIG. First, the user operates the power switch 121 to turn on the imaging apparatus 100. Then, power is supplied to each circuit from a battery (not shown) built in the imaging apparatus 100, and activation processing of the imaging apparatus 100 (operation control for opening the lens barrier, reset processing of the microcomputer, etc.) is performed.

  The imaging apparatus 100 is configured to turn on the power when the power switch 121 is pressed when the power is turned off and automatically enter the imaging mode. Further, when the viewing button is pressed when the power is turned off, the power is turned on and the viewing mode is automatically set.

  When the imaging apparatus 100 shifts to the imaging mode, an optical image enters the imaging apparatus 100 via the lens 101 and is imaged on the imaging element (CCD) 102. The CCD 102 converts an incident optical image into an electric signal and outputs it to a camera signal processing unit (ADC) 103. The ADC 103 converts an input electric signal (analog signal) into a digital signal. A digital signal output from the ADC 103 is input to the image processing unit 104.

  A preprocessing unit 105 in the image processing unit 104 generates image data based on an input digital signal, and performs white balance processing, gamma correction processing, and the like. In the YC processing unit 106 in the image processing unit 104, the image data is separated into the luminance signal Y and the color difference signals Cr and Cb, and processing for reducing the information amount of the color difference signals Cr and Cb is performed.

  The information amount reduction processing for the color difference signals Cr and Cb is, for example, “4: 2: 2 downsampling processing” for thinning out color information in the main scanning direction of an image, or “4: 1” for thinning out color information in the vertical and horizontal directions of an image. : 1 downsampling process ". When image processing is performed by the pre-processing unit 105 and the YC processing unit 106, image data is temporarily stored in the buffer memory 111, and image processing is performed while reading the image data stored in the buffer memory 111 as needed. Is called.

  Image data (uncompressed) output from the image processing unit 104 is input to the system controller 110. The system controller 110 outputs the image data output from the image processing unit 104 to the display driver 116.

  The display driver 116 converts input image data (digital signal) into an analog image signal, and adjusts the size of the image based on the analog image signal to a size that can be displayed on the display 117.

  Further, the display driver 116 controls the display 117 to display an image. At this time, the image displayed on the display 117 is an image (through image) generated by continuously performing signal processing in the CCD 102, the ADC 103, and the image processing unit 104.

  When the user operates the imaging button 123 at a desired timing while the through image is displayed on the display 117, the system controller 110 outputs a control signal to the image processing unit 104. When a control signal is input to the image processing unit 104, the compression unit 108 stores the image data processed by the preprocessing unit 105 and the YC processing unit 106 in the buffer memory 111 and performs compression processing.

  Specifically, discrete cosine transform processing (DCT processing) that digitizes the ratio of high-frequency components and low-frequency components of image data, and quantization that expresses the gradation and gradation of an image with the number of quantization bits Processing, Huffman coding processing for dividing a signal character string of image data into fixed bits and giving a shorter code to a character string having a high appearance frequency is performed. The compressed image data is displayed on the display 117 via the system controller 110 and the display driver 116. The compressed image data is recorded on the memory card 115 via the card holder 114.

  When the zoom button 125 is operated before the imaging button 123 is operated, the system controller 110 can execute an optical zoom process or an electronic zoom process to enlarge or reduce the size of the image. When the imaging button 123 is operated after the zoom button 125 is operated, the image data of the enlarged or reduced image is recorded in the memory card 115.

  Next, a hardware configuration of the additional information management server 200 used in the present invention will be described with reference to FIG.

  FIG. 2 is a hardware configuration diagram of an information processing apparatus applicable to the additional information management server 200 in the embodiment of the present invention.

  In FIG. 2, reference numeral 201 denotes a CPU that comprehensively controls each device and controller connected to the system bus 204. The ROM 203 or the external memory 211 also has a BIOS (Basic Input / Output System), an operating system program (hereinafter referred to as OS), which is a control program of the CPU 201, and a function necessary for realizing image management, which will be described later. Various programs are stored.

  A RAM 202 functions as a main memory, work area, and the like for the CPU 201. The CPU 201 implements various operations by loading a program necessary for execution of processing from the ROM 203 or the external memory 211 into the RAM 202 and executing the loaded program.

  An input controller 205 controls input from an input device 209 such as a keyboard and a pointing device. A video controller 206 controls display on a display device such as the display device 210. These are used by the operator as needed.

  A memory controller 207 is connected to the hard disk (HD), flexible disk (FD), or PCMCIA card slot for storing a boot program, various applications, font data, user files, editing files, various data, etc. via an adapter. The access to the external memory 211 such as a compact flash (registered trademark) memory is controlled.

  The hard disk (HD) of the external memory 211 has a large-capacity memory area that receives and stores captured images transmitted from the imaging device 100.

  A communication I / F (interface) controller 208 connects and communicates with an external device via a network (for example, a wireless LAN), and executes communication control processing on the network. For example, communication using TCP / IP is possible.

  Note that the CPU 201 enables display on the display device 210 by executing outline font rasterization processing on a display information area in the RAM 202, for example. Further, the CPU 201 enables a user instruction with a mouse cursor (not shown) on the display device 210.

  The processing of each step shown in the flowchart to be described later for realizing the present invention is executed by a program that can be read and executed by a computer, and the program is recorded in the external memory 211. Then, it is executed by the CPU 201 by being loaded into the RAM 202 as necessary. Furthermore, definition files and various information tables used when executing the program are also stored in the external memory 211, and a detailed description thereof will be described later.

  Next, the system configuration of the present invention will be described with reference to the system block diagram of FIG.

  FIG. 3 is an example of a system configuration diagram showing an overall configuration of a system showing an embodiment of the present invention.

  The imaging devices 100a to 100c are examples of devices having the imaging function described with reference to FIG. Note that the imaging devices 100a to 100c have a position information detection function in addition to the functions of the imaging device described with reference to FIG. Note that not all the functions described with reference to FIG.

  The additional information management server 200 is an example of an apparatus having the information processing function described with reference to FIG. The imaging devices 100a to 100c and the additional information management server 200 can communicate with each other via a wireless LAN, Wi-Fi (registered trademark), or the like. The additional information management server 200 is an additional information management server that stores and manages additional information for each position information. The additional information management server 200 receives position information from each of the image capturing apparatuses 100a to 100c, refers to the received position information, and captures each image. Processing for distributing the additional information around the devices 100a to 100c to the imaging device that has transmitted the information is performed.

  Next, a processing procedure in which the imaging apparatus displays additional information and captures an image will be described with reference to the flowchart of FIG.

  FIG. 4 is a sequence chart for explaining the flow from when the imaging apparatus receives additional information from the additional information management server to synthesize the additional information in the imaging system of the present invention, and the imaging apparatus 100 and additional information management server 200. The processing is executed under the control of the respective system controllers (110 in FIG. 1) and the CPU (201 in FIG. 2). S401 to S413 indicate each processing step.

  The flowchart in FIG. 4 starts when the imaging apparatus is activated and the user starts an imaging operation.

  When the user points the imaging device toward the subject to be imaged and starts imaging, the processing in step S401 is started. In step S401, the system controller 110 of the imaging device 100 focuses on the subject, and in step S402, the subject is moved to the subject. The focus adjustment is continued while the subject is out of focus. If it is judged that the subject is in focus, the process proceeds to the next step S403.

  In step S <b> 403, the system controller 110 of the imaging apparatus 100 captures the subject that is in focus together with the background.

  Next, in step S404, the system controller 110 of the imaging apparatus 100 acquires position information of the imaging apparatus 100 by GPS communication or the like (position detection unit). Further, the imaging orientation information of the imaging device is measured by an electronic compass or the like (azimuth detection unit).

  Next, in step S405, the system controller 110 of the imaging apparatus 100 transmits the position information acquired in step S404 to the additional information management server in order to receive additional information around the imaging apparatus 100.

  Next, in step S406, the CPU 201 of the additional information management server extracts additional information around the position information received from the imaging apparatus 100 from the additional information storage unit. Thereafter, in step S407, the additional information extracted in step S406 and the position information of the additional information are transmitted to the imaging apparatus 100.

  In step S408, the system controller 110 of the imaging apparatus 100 receives the transmitted additional information and the position information of the additional information from the additional information management server (additional information acquisition unit).

  Next, in step S409, the system controller 110 of the imaging apparatus 100 acquires the shooting distance (the distance that is in focus) when the image is captured in step S403. For the shooting distance, for example, the subject distance of Exif information acquired at the time of imaging is used.

  Next, in step S410, the system controller 110 of the imaging apparatus 100 calculates a subject position candidate using the shooting distance acquired in step S409, the position information acquired in step S404, and the imaging direction information. An example of the result of calculating the subject position candidate will be described with reference to FIGS.

  FIG. 5 is a schematic diagram showing an example of the positional relationship between the subject and the imaging apparatus, the imaging result, and the character composition result in the present invention. FIG. 5A is a diagram showing the arrangement of the subject on the map in the present invention, and 20 indicates the position of the imaging device. Further, a range indicated by a sector surrounded by a broken line is an imaging range (imaging area specifying unit) of the imaging apparatus. FIG. 5C shows a captured image in which the stars 22 to 25 and the black circles are positions having additional information, and the user has captured the subject of 22 stars.

  In order to display only the additional information around the distance focused by the user in the fan-shaped imaging range surrounded by the broken line, the imaging distance acquired in step S409 is used. When the shooting distance has no range such as “10.43 m”, a screen for inputting a value for giving a width to the distance information as shown in FIG. May be prompted (distance range changing unit). With reference to FIG. 6, the width change screen before and after acquiring additional information will be described.

  FIG. 6 is a schematic diagram showing an example of an image of a setting screen for setting the additional information extraction range in the present invention.

  Reference numeral 600 in FIG. 6 is a screen image for designating a range for extracting additional information before and after the shooting distance. From the shooting distance, a range for extracting additional information by the distance of the front 601 and the distance of the rear 602 can be specified. .

  Note that the range for extracting additional information may be set to several meters before and after the default, or may be set to 1/10 before and after the shooting distance.

  The additional information extraction range set on the setting screen in FIG. 6 is displayed as the gray area 26 in FIG. The drawing of FIG. 5A is displayed in the portion 21 of FIG. 5C displayed on the display unit 117.

  In addition to the setting method of the additional information extraction range shown in FIG. 6, for example, the additional information extraction range can be set by the user operating the portion 21 displayed in FIG. 5C. . An enlarged view of 21 in FIG. 5 (c) corresponds to FIG. 5 (a), but the width 27 of the gray region 26 is manually widened by an input means such as a touch screen as compared with FIG. 5 (a). Thus, the additional information extraction range can be expanded. FIG. 5B shows the result of expanding the additional information extraction range, that is, the gray area 26 by using a touch screen or the like. In FIG. 5B, the gray area 26 that is the additional information extraction range is wider than that in FIG. 5A, and in FIG. 5B, it is not included in the additional information extraction range in FIG. 24 additional information items are also extracted. Returning to the flowchart of FIG.

  When the additional information extraction range is calculated in step S410, in step S411 in FIG. 4, the system controller 110 of the imaging apparatus 100 extracts additional information position information from the additional information acquired in step S408. Extract additional information within the range.

  Subsequently, in step S412, the system controller 110 of the imaging device 100 combines the additional information extracted in step S411 with the captured image. In step S413, the combined captured image is displayed, and the processing of the present invention ends. . An example of the synthesized captured image will be described with reference to FIG.

  FIG. 5C is a captured image to which additional information is added when the additional information extraction range is FIG. 5A, and FIG. 5D is an addition when the additional information extraction range is FIG. 5B. It is a captured image to which information is added. In FIG. 5C and FIG. 5D, which are captured images, additional information is displayed as a balloon beside each subject (position information) 22-24. The difference between FIG. 5 (c) and FIG. 5 (d) is that 24 additional information not displayed in FIG. 5 (c) is displayed in FIG. 5 (d). This is because in step S410, the user expanded the additional information extraction range from FIG. 5A to FIG. 5B, and included the subject (position information) 24.

  As described above, by limiting the additional information to be extracted by using the shooting distance of the imaging apparatus, only the additional information of the region in which the user has focused (focus) can be displayed among a plurality of additional information. It has an effect that can be done.

  As another example, a range (distance range) that is in focus (distance range) is calculated based on the depth of field and shooting distance in an imaging situation, and only additional information on the range in focus within the imaging range is calculated. You may get The front end and the rear end of the depth of field are calculated based on the focal length of the lens, the aperture value of the lens, and the like, and the front end and the rear end of the depth of field may be set as a distance range in focus.

  As another example, when displaying a balloon of additional information on the display unit 117, the subject can be recognized as an object and displayed so that the object and the balloon of additional information do not overlap. The embodiment will be described with reference to FIG.

  FIG. 7 is a schematic diagram showing an example in which the captured image and the additional information are displayed on the display unit 117.

  700 in FIG. 7 is an example in which the object 32 and the balloon 33 overlap. Details of the object 32 cannot be confirmed at the position of the balloon. This is because the balloon is set to be displayed on the right side of the position information included in the additional information.

  In the present invention, the subject captured in the captured image, such as 35 and 36 in 710, is recognized as an object (object detection unit). The object recognition technique uses a known technique, for example, contour extraction or pattern matching.

  The additional information existing at the position of the subject recognized as the object is specified from the imaging position and the imaging direction of the imaging device, and the additional information 33 and 34 is displayed so as not to overlap the objects 35 and 36. As a result, it is possible to display without overlapping with the object like the balloon 710 of 710.

  With this process, it is possible to improve the point that the additional information overlaps with the object and an object having other additional information cannot be confirmed (for example, in the case of 700, 32 is difficult to see).

  With the above processing, it is possible to improve the visibility of the additional information and the background image when receiving the additional information from the additional information management server and displaying the additional information on the imaging apparatus.

  In the above-described embodiment, the case where the present invention is applied to the imaging apparatus and the additional information management server has been described. However, the configuration of the additional information management server can be provided in the imaging apparatus, and the implementation can be performed only by the imaging apparatus.

  Although not specifically illustrated, information for managing a program group stored in the recording medium, for example, version information, creator, etc. is also stored, and information depending on the OS on the program reading side, for example, a program is identified. An icon to be displayed may also be stored.

  Further, data belonging to various programs is also managed in the same directory. In addition, when a program or data to be installed is compressed, a program to be decompressed may be stored.

  The function shown in FIG. 4 in the present embodiment may be performed by an information processing apparatus having an imaging function by a program installed from the outside. In this case, the present invention is applied even when an information group including a program is supplied to the output device from a recording medium such as a CD-ROM, a flash memory, or an FD, or from an external recording medium via a network. Is.

  As described above, a recording medium that records a program code of software that realizes the functions of the above-described embodiments is supplied to a system or apparatus, and the computer (or CPU or MPU) of the system or apparatus records the recording medium. It goes without saying that the object of the present invention can also be achieved by reading and executing the program code stored in the medium.

  In this case, the program code itself read from the recording medium realizes the novel function of the present invention, and the recording medium storing the program code constitutes the present invention.

  Examples of the recording medium for supplying the program code include a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a DVD-ROM, a magnetic tape, and a non-volatile memory card. ROM, EEPROM, silicon disk, etc. can be used.

  Further, by executing the program code read out by the computer, not only the functions of the above-described embodiments are realized, but also the computer is operated on the basis of the instruction of the program code. It goes without saying that the OS (operating system) or the like performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  Furthermore, after the program code read from the recording medium is written to the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the program code is read out. -A case where the CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the instruction of the function and the functions of the above-described embodiments are realized by the processing. Needless to say.

  Further, the present invention may be applied to a system composed of a plurality of devices or an apparatus composed of a single device. Needless to say, the present invention can be applied to a case where the present invention is achieved by supplying a program to a system or apparatus. In this case, by reading a recording medium storing a program represented by software for achieving the present invention into the system or apparatus, the system or apparatus can enjoy the effects of the present invention.

  Furthermore, by downloading and reading a program represented by software for achieving the present invention from a server, database, etc. on a network using a communication program, the system or apparatus can enjoy the effects of the present invention. Is possible.

  In addition, all the structures which combined each embodiment mentioned above and its modification are also included in this invention.

100a-c Imaging device 200 Additional information management server

Claims (6)

An imaging apparatus for imaging a predetermined imaging range, which is communicable with an additional information management server having storage means for storing additional information associated with position information,
Specifying means for specifying the imaging range near Ru Target material,
An acquisition unit for acquiring a position of the identified Target material,
An area setting means for setting a region around the position of the acquired the object of the imaging range,
The display in the image obtained by imaging the imaging range, the information based on the additional information corresponding to the set region near Ru Target of peripheral, as appended information of the object in the area around which is the set 1 display control means;
Have a second display control means for distinguishably displaying the area around the set by the area setting means,
The second display control unit accepts an operation to change the range of the set peripheral region in the imaging range, and displays the peripheral region in which the range is changed in an identifiable manner,
The first display control means displays information based on additional information corresponding to an object in a peripheral area where the range is changed as additional information of the object in a peripheral area where the range is changed. An imaging apparatus characterized by: The second display control means, the image pickup apparatus according to claim 1, characterized in that it is capable of accepting an operation for changing the front and rear boundaries of a peripheral region of the previous SL set. An information processing apparatus that displays an image of a predetermined imaging range that can communicate with an additional information management server having a storage unit that stores additional information associated with position information,
Specifying means for specifying the imaging range near Ru Target material,
An acquisition unit for acquiring a position of the identified Target material,
An area setting means for setting a region around the position of the acquired the object of the imaging range,
The display in the image obtained by imaging the imaging range, the information based on the additional information corresponding to the set region near Ru Target of peripheral, as appended information of the object in the area around which is the set 1 display control means;
Second display control means for displaying the surrounding area set by the area setting means in an identifiable manner,
The second display control unit accepts an operation to change the range of the set peripheral region in the imaging range, and displays the peripheral region in which the range is changed in an identifiable manner,
The first display control means displays information based on additional information corresponding to an object in a peripheral area where the range is changed as additional information of the object in a peripheral area where the range is changed. An information processing apparatus characterized by: A method for controlling an imaging apparatus that images a predetermined imaging range and is communicable with an additional information management server having a storage unit that stores additional information associated with position information,
A specifying step of specifying the imaging range near Ru Target material,
An acquisition step of acquiring a position of the identified Target material,
An area setting step of setting a peripheral region of the position of the acquired the object of the imaging range,
The display in the image obtained by imaging the imaging range, the information based on the additional information corresponding to the set region near Ru Target of peripheral, as appended information of the object in the area around which is the set 1 display control process;
A second display control step for displaying the peripheral region set in the region setting step in an identifiable manner,
The second display control step accepts an operation for changing the range of the set peripheral region in the imaging range, and displays the peripheral region in which the range is changed in an identifiable manner,
In the first display control step, information based on additional information corresponding to an object in a peripheral area where the range is changed is displayed as additional information of the object in a peripheral area where the range is changed. A control method characterized by: A control method for an information processing apparatus that displays an image of a predetermined imaging range that is communicable with an additional information management server having storage means that stores additional information associated with position information,
A specifying step of specifying the imaging range near Ru Target material,
An acquisition step of acquiring a position of the identified Target material,
An area setting step of setting a peripheral region of the position of the acquired the object of the imaging range,
The display in the image obtained by imaging the imaging range, the information based on the additional information corresponding to the set region near Ru Target of peripheral, as appended information of the object in the area around which is the set 1 display control process;
A second display control step for displaying the peripheral region set in the region setting step in an identifiable manner,
The second display control step accepts an operation for changing the range of the set peripheral region in the imaging range, and displays the peripheral region in which the range is changed in an identifiable manner,
In the first display control step, information based on additional information corresponding to an object in a peripheral area where the range is changed is displayed as additional information of the object in a peripheral area where the range is changed. A control method characterized by: The program for making a computer perform each process of the control method described in Claim 4 or 5 .

Images