JP6368560B2 - Display device, display system, display method, and display program - Google Patents

Description

  The present invention relates to a display device, a display system, a display method, and a display program.

2. Description of the Related Art In recent years, a technique for acquiring various types of information from an external server using a communication technique in an imaging apparatus such as a digital camera has been known (see, for example, Patent Document 1).
The technique described in Patent Document 1 is a technique for acquiring a suitable shooting location near the current position from an external server (receiving advice on shooting location) using communication technology.
Specifically, in the technique described in Patent Document 1, the imaging apparatus transmits position information regarding the position of the imaging apparatus to the server. Based on the position information received from the imaging device, the server extracts a suitable shooting location near the current position of the imaging device from the recommended shooting information stored in the database, and transmits information regarding the shooting location to the imaging device. To do. Then, based on the information received from the server, the imaging device notifies the user of the imaging device of the shooting location by voice or the like.

JP-A-2005-45398

  However, the technique described in Patent Document 1 is merely a technique for advising a user of an imaging device about a suitable shooting location, and the user of the imaging device can actually perform what kind of shooting by shooting at the shooting location based on the advice. It is impossible to grasp whether a photographed image can be obtained. Therefore, there is a problem that convenience cannot be improved.

  The present invention has been made in view of the above, and an object thereof is to provide a display device, a display system, a display method, and a display program that can improve convenience.

In order to solve the above-described problems and achieve the object, a display device according to the present invention is provided with a reference image acquisition unit that acquires reference image data, and a reference position that indicates a shooting position of the reference image data. A related image acquisition unit that acquires related image data captured within a distance range, a display unit that displays an image, a reference image corresponding to the reference image data, and a related image corresponding to the related image data; A display control unit to be displayed on the display unit , wherein the related image acquisition unit acquires a plurality of the related image data, and the plurality of related image data is within a range less than a first distance with respect to the reference position. And the second related image data captured within a range that is greater than or equal to the first distance and less than the second distance with respect to the reference position, and the display control unit includes: Said criteria in the area And a display screen in which a first related image corresponding to the first related image data is arranged and a second related image corresponding to the second related image data is arranged in a second area different from the first area Is displayed on the display unit .

  The display system according to the present invention is a display system including the above-described display device and a server that communicates with the display device. The server communicates with the display device. A server-side communication control unit that receives the reference position information from the display device via the server-side communication unit, and a reference in which image data and shooting position information indicating a shooting position of the image data are associated with each other. A plurality of information recording databases, a reference position based on the reference position information received via the server-side communication unit, and a plurality of the shooting position information included in the plurality of reference information recorded in the database. A distance calculating unit that calculates each distance to each shooting position based on the distance, and the distance calculated by the distance calculating unit is recorded in the database. A related image extraction unit that extracts the related image data from the plurality of reference information, and the server-side communication control unit extracts the related image extracted by the related image extraction unit via the server-side communication unit. Image data is transmitted to the display device.

The display method according to the present invention is a display method performed by a display device, wherein the first acquisition step of acquiring reference image data and a reference position indicating a shooting position of the reference image data are within a predetermined distance. in a second acquisition step of acquiring the taken-related image data, the reference image corresponding to the reference image data, and look including a display step of displaying the associated image corresponding to the associated image data in Table radical 113, In the second acquisition step, a plurality of the related image data is acquired, and the plurality of related image data are first related image data captured within a range less than a first distance with respect to the reference position; Second related image data captured within a range that is greater than or equal to the first distance and less than the second distance with respect to a reference position. In the display step, the reference image and the first relation are included in the first area. With placing the first related image corresponding to the image data, and displays the display screen which includes a second related image corresponding to the different second region second related image data from the first area on the display unit It is characterized by that.

  A display program according to the present invention causes a display device to execute the display method described above.

The display device according to the present invention includes reference image data (live view image data in a live view display or the like), and related image data captured within a predetermined distance with respect to a shooting position (reference position) of the reference image data. And a reference image corresponding to the reference image data and a related image corresponding to the related image data are displayed.
Therefore, the user of the display device can clearly grasp what kind of captured image can actually be obtained by photographing around the reference position by checking the related image. Therefore, according to the display device of the present invention, there is an effect that the convenience can be improved.

Since the display system according to the present invention includes the above-described display device, the same effect as the above-described display device can be obtained.
Since the display method according to the present invention is a method performed by the above-described display device, the same effects as those of the above-described display device can be obtained.
Since the display program according to the present invention is a program executed by the above-described display device, the same effect as the above-described display device can be obtained.

FIG. 1 is a diagram schematically showing a configuration of a display system according to Embodiment 1 of the present invention. FIG. 2 is a block diagram showing a configuration of the lens type camera shown in FIG. FIG. 3 is a block diagram illustrating a configuration of the display device main body illustrated in FIG. 1. FIG. 4 is a block diagram showing a configuration of the server shown in FIG. FIG. 5 is a flowchart showing the operation of the lens type camera shown in FIGS. 1 and 2. FIG. 6 is a flowchart showing the operation of the display device main body shown in FIGS. FIG. 7 is a flowchart showing the related image display processing (steps S209, S217, and S229) shown in FIG. FIG. 8 is a flowchart showing the display screen generation process (step S234) shown in FIG. FIG. 9 is a diagram for explaining the display screen generation process (step S234) shown in FIGS. FIG. 10 is a diagram for explaining the display screen generation processing (step S234) shown in FIGS. FIG. 11 is a diagram for explaining step S235 shown in FIG. FIG. 12A is a diagram for explaining steps S236 and S237 shown in FIG. FIG. 12B is a diagram for explaining steps S236 and S237 shown in FIG. FIG. 13 is a flowchart showing the operation of the server shown in FIGS. 1 and 4. FIG. 14 is a block diagram showing a configuration of a display device body according to Embodiment 2 of the present invention. FIG. 15 is a block diagram showing a configuration of a server according to Embodiment 2 of the present invention. FIG. 16 is a flowchart showing related image display processing (steps S209, S217, and S229) according to Embodiment 2 of the present invention. FIG. 17 is a flowchart showing the operation of the server shown in FIG. FIG. 18 is a diagram illustrating an example of a route image corresponding to the route image data generated in step S318 illustrated in FIG. FIG. 19 is a block diagram showing a configuration of a lens-type camera according to Embodiment 3 of the present invention. FIG. 20 is a block diagram showing a configuration of a display device body according to Embodiment 3 of the present invention. FIG. 21 is a flowchart showing the operation of the lens type camera shown in FIG. FIG. 22 is a flowchart showing the operation of the display device body shown in FIG. FIG. 23 is a flowchart showing related image display processing (steps S209B, S217B, and S229B) according to Embodiment 3 of the present invention. FIG. 24 is a block diagram showing a configuration of a lens-type camera according to Embodiment 4 of the present invention. FIG. 25 is a block diagram showing a configuration of a display device body according to Embodiment 4 of the present invention. FIG. 26 is a flowchart showing the operation of the lens type camera shown in FIG. FIG. 27 is a flowchart showing related image display processing (steps S209B, S217B, and S229B) according to Embodiment 4 of the present invention.

  DESCRIPTION OF EMBODIMENTS Hereinafter, modes for carrying out the present invention (hereinafter referred to as embodiments) will be described with reference to the drawings. The present invention is not limited to the embodiments described below. Furthermore, the same code | symbol is attached | subjected to the same part in description of drawing.

(Embodiment 1)
[Schematic configuration of display system]
FIG. 1 is a diagram schematically showing a configuration of a display system 1 according to Embodiment 1 of the present invention.
The display system 1 is a system that, when a camera user captures a subject, displays a captured image by the capturing and a related image captured near the capturing location. As shown in FIG. 1, the display system 1 includes a display device 2 and a server 3.

[Configuration of display device]
As shown in FIG. 1, the display device 2 includes a lens type camera 4, a display device body 5, and an attachment 6.
The attachment 6 is a member that mechanically connects the lens camera 4 and the display device body 5.
More specifically, the attachment 6 is attached to the back surface of the display device body 5 as shown in FIG. The attachment 6 is provided with a mounting hole 6A that has a circular shape in plan view and into which the lens type camera 4 is fitted.
In a state where the lens-type camera 4 and the display device 5 are mechanically connected via the attachment 6, the overall shape of the display device 2 is a shape that images a digital camera.
Note that the display device 2 is not limited to the configuration including the attachment 6, and may be configured to omit the attachment 6.

[Configuration of lens type camera]
In the following, the main part of the present invention will be mainly described as the configuration of the lens-type camera 4.
FIG. 2 is a block diagram showing the configuration of the lens type camera 4.
The lens-type camera 4 has a function as an imaging unit according to the present invention. As shown in FIG. 2, the lens-type camera 4 includes an optical system 41, a drive unit 42, a position detection unit 43, an operation unit 44, a camera-side clock unit 45, a camera-side imaging unit 46, The camera side memory | storage part 47, the camera side recording part 48, the camera side communication part 49, and the camera side control part 50 are provided. These members 41 to 50 are housed inside a lens barrel 40 (FIG. 1) having a generally cylindrical shape as a whole. That is, the overall shape of the lens-type camera 4 has substantially the same shape as the overall shape of a so-called interchangeable lens, as shown in FIG.

The optical system 41 collects light from a predetermined visual field and forms an image of the collected light on an imaging surface of an imaging device (not shown) that constitutes the camera-side imaging unit 46. As shown in FIG. 2, the optical system 41 includes a zoom lens 411 and a focus lens 412.
The zoom lens 411 is configured using one or a plurality of lenses, and changes the zoom magnification of the optical system 41 by moving along the optical axis indicated by the broken line in FIG.
The focus lens 412 is configured using one or a plurality of lenses, and changes the focus position and focal length of the optical system 41 by moving along the optical axis indicated by the broken line in FIG.

The drive unit 42 moves the lenses 411 and 412 constituting the optical system 41 along the optical axis under the control of the camera side control unit 50. As shown in FIG. 2, the drive unit 42 includes a zoom drive unit 421 and a focus drive unit 422.
The zoom drive unit 421 is configured using a stepping motor, a DC motor, or the like, and moves the zoom lens 411 along the optical axis.
The focus driving unit 422 is configured using a stepping motor, a DC motor, or the like, and moves the focus lens 412 along the optical axis.

The position detection unit 43 detects the positions on the optical axis of the lenses 411 and 412 constituting the optical system 41. As shown in FIG. 2, the position detection unit 43 includes a zoom position detection unit 431 and a focus position detection unit 432.
The zoom position detection unit 431 is configured using a photo interrupter or the like, and detects the position on the optical axis of the zoom lens 411 driven by the zoom drive unit 421.
Specifically, the zoom position detection unit 431 converts the rotation amount of the drive motor included in the zoom drive unit 421 into the number of pulses, and based on the converted number of pulses, from the reference position with infinity as a reference. The position on the optical axis of the zoom lens 411 is detected.
The focus position detection unit 432 is configured using a photo interrupter or the like, and detects the position on the optical axis of the focus lens 412 driven by the focus drive unit 422 by the same method as the zoom position detection unit 431.

  The operation unit 44 is an operation ring provided around the lens barrel 40, buttons and switches provided on the outer surface of the lens barrel 40, and is on the optical axis of the zoom lens 411 and the focus lens 412 in the optical system 41. A user operation such as a position change operation is accepted. Then, the operation unit 44 outputs an instruction signal corresponding to the user operation to the camera side control unit 50.

In addition to the timekeeping function, the camera-side clock unit 45 has a function of generating date / time information (hereinafter referred to as a first time stamp) related to the date / time captured by the camera-side imaging unit 46. Then, the first time stamp generated by the camera side clock unit 45 is output to the camera side control unit 50.
Needless to say, the time stamp is not necessarily required to be precisely timed by the device, and can be applied to obtain the time stamp by communicating with another device at the time of shooting. The same applies to the time stamps described below.

  The camera side imaging unit 46 images a subject and generates image data under the control of the camera side control unit 50. The camera side imaging unit 46 receives an object image formed by the optical system 41 and converts it into an electrical signal, such as an image sensor such as a CCD (Charge Coupled Device), and an electrical signal (analog signal) from the image sensor. And a signal processing unit that generates digital image data by performing signal processing (A / D conversion or the like). The image data sequentially generated by the camera-side imaging unit 46 (hereinafter referred to as live view image data) is controlled by the camera-side control unit 50 and is associated with the date and time when the live view image data was generated. One time stamp is added and sequentially stored in the camera-side memory unit 47. In addition, image data (hereinafter referred to as “captured image data”) generated by the camera-side imaging unit 46 in response to a shooting operation on the display device body 5 by the camera user is the first date and time related to the date and time when the captured image data was generated. One time stamp and shooting position information indicating the shooting position received from the display device body 5 are added and recorded in the camera-side recording unit 48.

The camera side memory unit 47 sequentially stores the live view image data (including the first time stamp) generated by the camera side imaging unit 46.
The camera-side recording unit 48, various programs executed by the camera-side control unit 50, characteristic information regarding the characteristics of the optical system 41 such as the magnification, focal length, angle of view, aberration, and F value (brightness) of the optical system 41, etc. Record. In addition, the camera-side recording unit 48 captures captured image data (first image) generated by the camera-side imaging unit 46 under the control of the camera-side control unit 50 in response to a shooting operation on the display device body 5 by the camera user. (Including time stamp and shooting position information).

The camera side communication unit 49 is a communication interface for performing wireless communication of various data including signals necessary for communication with the display device body 5 under the control of the camera side control unit 50.
In the first embodiment, Wi-Fi (Wireless Fidelity) (registered trademark) is adopted as the communication method of the wireless communication. In addition, as a communication method of the wireless communication, other communication methods such as WiMAX (Worldwide Interoperability for Microwave Access) (registered trademark) may be adopted in addition to Wi-Fi (registered trademark).
For example, in the case of Wi-Fi (registered trademark), assuming a local network, there is a relationship between an access point and a station as the role of a device. As a rough connection process, a wireless network constructed by an access point is The station is connected.
As a rough connection sequence, (Step 1) the access point constructs a wireless network and reports its own network identifier (SSID). (Step 2) The station searches for the broadcasted network identifier (SSID). Steps 1 and 2 for connecting to a desired network (access point) are assumed, and a network with many devices is assumed. Therefore, the coverage is wide and a strict identification step is taken while considering the problem of interference. . For this reason, it may take time to establish a connection. However, in data communication, data can be transmitted and received at the timing of each access point and station. Here, the lens type camera 4 may be considered as an access point, and the display device body 5 may be considered as a station. This relationship may be reversed. Since communication can be performed at a speed of 10 megabits / second or more, images can also be transmitted at high speed.

The camera side control unit 50 is configured using a CPU (Central Processing Unit) or the like, and responds to an instruction signal from the operation unit 44 or an instruction signal from the display device body 5 input via the camera side communication unit 49. The overall operation of the lens type camera 4 is controlled. As shown in FIG. 2, the camera side control unit 50 includes a camera side communication control unit 501 and a camera side imaging control unit 502.
The camera-side communication control unit 501 establishes communication connection with the display device body 5 via the camera-side communication unit 49 using a communication method such as Wi-Fi (registered trademark).
The camera-side communication control unit 501 then sends a live view image data transmission request, a shooting instruction (including shooting position information indicating the shooting position), and a plurality of shootings recorded in the camera-side recording unit 48 from the display device body 5. An image list transmission request displaying thumbnail image data and a corresponding image data transmission request corresponding to one captured image in the image list are received. In response to these receptions, the camera-side communication control unit 501 receives the latest live view image data (including the first time stamp) stored in the camera-side memory unit 47 and the latest recorded in the camera-side recording unit 48. The photographed image data (including the first time stamp and the photographing position information), the image list, and the corresponding image data (including the first time stamp and the photographing position information) are transmitted to the display device body 5. Here, “latest” means latest on the date and time based on the time stamp (hereinafter the same).
In addition, the camera-side communication control unit 501 transmits the characteristic information recorded in the camera-side recording unit 48 and the lens position information regarding the positions of the zoom lens 411 and the focus lens 412 detected by the position detection unit 43 to the display device body 5. To do.
Further, the camera side communication control unit 501 receives an instruction to change the imaging parameter from the display device body 5. Here, examples of the shooting parameters include focal length, focal position, aperture value, shutter speed, exposure value, ISO sensitivity, saturation, hue, and the like.

  The camera side imaging control unit 502 adds a first time stamp related to the date and time when the live view image data is generated to the live view image data generated by the camera side imaging unit 46, and sequentially, the camera side memory unit 47. To remember. The camera-side imaging control unit 502 causes the camera-side imaging unit 46 to image a subject in response to a shooting operation on the display device main body 5 by the camera user, and uses the captured image data generated by the camera-side imaging unit 46. The first time stamp related to the date and time when the photographed image data was generated and the photographing position information received from the display device body 5 are added and recorded in the camera-side recording unit 48. Further, the camera-side imaging control unit 502 controls the operation of the drive unit 42 and the like to change the imaging parameters in accordance with the imaging parameter change instruction received from the display device body 5 via the camera-side communication unit 49.

[Configuration of display device]
In the following, the main part of the present invention will be mainly described as the configuration of the display device body 5.
FIG. 3 is a block diagram showing a configuration of the display device body 5.
The display device body 5 is configured as, for example, a digital camera, a digital video camera, a mobile phone, a tablet-type mobile device, or the like. As shown in FIG. 3, the display device main body 5 includes an input unit 51, a display unit 52, a main body side clock unit 53, a main body side imaging unit 54, a position acquisition unit 55, and a main body side memory unit 56. A main body side recording unit 57, a main body side communication unit 58, and a main body side control unit 59.

The input unit 51 is configured using a button, a switch, a touch panel, or the like that receives a user operation, and outputs an instruction signal corresponding to the user operation to the main body side control unit 59.
And the input part 51 has a function as an operation reception part which concerns on this invention.
The display unit 52 is configured using a display panel made of liquid crystal, organic EL (Electro Luminescence), or the like, and is provided on the front surface of the display device body 5 (see FIG. 11). The display unit 52 displays a predetermined image under the control of the main body side control unit 59.

The main body side clock unit 53 has a function of generating date and time information (hereinafter referred to as a second time stamp) related to the date and time captured by the main body side imaging unit 54, in addition to a time measuring function. Then, the second time stamp generated by the main body side clock unit 53 is output to the main body side control unit 59.
The main body side imaging unit 54 images a subject under the control of the main body side control unit 59 and generates image data (hereinafter referred to as in-camera image data). The main body side imaging unit 54 includes an optical system (not shown) that forms a subject image, an image sensor (not shown) such as a CCD that receives the subject image formed by the optical system and converts it into an electrical signal, It is configured using a signal processing unit that generates digital image data by performing signal processing (A / D conversion or the like) on an electrical signal (analog signal) from the image sensor. Then, the in-camera image data generated by the main body side imaging unit 54 is added with a second time stamp related to the date and time when the in-camera image data is generated under the control of the main body side control unit 59, and the main body side Recorded in the recording unit 57.

The position acquisition unit 55 receives satellite orbit information transmitted from a plurality of GPS satellites constituting a GPS (Global Positioning System), which is a measuring means for measuring the position of an object on the ground, and receives the received orbit information. Based on this, shooting position information (information on longitude and latitude) regarding the current position (shooting position) of the display device body 5 is acquired. Of course, the present invention is not limited to this technique, and a technique using a position measurement method using various satellites, information from a radio base station, or a position measurement method by determining a radio base station is used. May be. Alternatively, relative position information obtained by detecting movement from a specific position from an acceleration sensor, a geomagnetic sensor, or map information may be used. For applications other than consumer cameras, for example, the value obtained by detecting the movement of the stage may be used in a microscope or the like. In a medical device, a dedicated magnetic field is generated and detected. A position detection method may be used. The movement distance in the organ may be used. Whichever method is used, it is only necessary to know whether or not a related image is obtained nearby.
The main body side memory unit 56 stores information received from the lens-type camera 4 and the server 3 via the main body side communication unit 58 and the first to first recorded in the main body side recording unit 57 under the control of the main body side control unit 59. Among the third extraction range information, one extraction range information read by the main body side control unit 59 is stored.

As shown in FIG. 3, the main body recording unit 57 includes a program recording unit 571 and an image data recording unit 572.
The program recording unit 571 records various programs (including display programs) executed by the main body side control unit 59, various data used during the execution of the programs, and the like.
The image data recording unit 572 includes captured image data (including the first time stamp and shooting position information) generated by the lens-type camera 4 and in-camera image data (second storage) generated by the main body side imaging unit 54. (Including time stamp).

  Further, the main body side recording unit 57 stores the communication specification information of the lens type camera 4 necessary for communicating with the lens type camera 4 and the location information (URL () indicating the location on the Internet 3 in the server 3. (Uniform Resource Locator)) is recorded.

Further, the main body side recording unit 57 records first to third extraction range information used when the server 3 extracts related image data.
Here, each extraction range information has each information which shows the 1st-3rd distance (1st distance is the smallest and 3rd distance is the largest), respectively.
For example, in the first extraction range information, the first distance is set to “125 m”, the second distance is “250 m”, and the third distance is “500 m”. In the second extraction range information, the first distance is set to “250 m”, the second distance is set to “500 m”, and the third distance is set to “1 km”. In the third extraction range information, the first distance is set to “500 m”, the second distance is set to “1 km”, and the third distance is set to “2 km”.

  The main body side communication unit 58 has a function as a display side communication unit according to the present invention. The main body side communication unit 58 performs Wi-Fi (registered trademark) wireless communication of various data including signals necessary for communication with the lens type camera 4 and the server 3 under the control of the main body side control unit 59. It is a communication interface for performing by a communication method such as.

  The main body side control unit 59 is configured by using a CPU or the like, and performs an instruction, data transfer, or the like corresponding to each unit constituting the display device main body 5 in accordance with an instruction signal from the input unit 51 or the like. Overall control of the operation. As shown in FIG. 3, the main body side control unit 59 includes a main body side communication control unit 591, a main body side imaging control unit 592, and a main body side display control unit 593.

The main body side communication control unit 591 executes the following processing when the display device main body 5 is set to the camera communication mode (a mode for photographing a subject using the lens type camera 4).
Specifically, the main body side communication control unit 591 communicates with the display device main body 5 via the main body side communication unit 58 based on the communication specification information of the lens type camera 4 recorded in the main body side recording unit 57. A communication connection by a communication method such as Wi-Fi (registered trademark) is established. Then, the main body side communication control unit 591 makes a transmission request for the live view image data, the image list, and the corresponding image data to the lens-type camera 4, and sends the live view image data, the image list, and the corresponding image data. Receive each one. Further, the main body side communication control unit 591 receives characteristic information, lens position information, and the like from the lens camera 4.
The main body side communication control unit 591 executes the transmission request for the corresponding image data in response to a user operation on the input unit 51 by the camera user (a selection operation for selecting one image in the image list). .

Further, the main body side communication control unit 591 is based on the location information (URL) of the server 3 recorded in the main body side recording unit 57, and the server 3 connected to the Internet network N through the main body side communication unit 58. An access signal (a request for recording corresponding image data or a request for transmitting related image data (including identification information for identifying its own display device body 5)) is transmitted to establish a communication connection with the server 3. Then, the main body side communication control unit 591 corresponds image data (including the first time stamp and shooting position information) to be recorded in the server 3 and shooting position information (reference) for causing the server 3 to extract related image data. (Position information) and extraction range information (any of the first to third extraction range information) are transmitted to the server 3 and related image data is received from the server 3.
That is, the main body side communication control unit 591 has a function as a related image acquisition unit according to the present invention.
The main body side communication control unit 591 executes a request for recording the corresponding image data in response to a user operation on the input unit 51 by the camera user (up operation for causing the server 3 to record the corresponding image data). It is. Further, the related image data transmission request is executed by the main body side communication control unit 591 when the display flag of the related image is on. This display flag is a flag that is turned on or off in response to a user operation on the input unit 51 by the camera user, and is stored in the main body side memory unit 56.

The main body side imaging control unit 592 executes the following processing when the display device main body 5 is set to the camera communication mode.
Specifically, the body-side imaging control unit 592 responds to a shooting operation on the input unit 51 by the camera user, and the shooting instruction to the effect that shooting is to be performed via the body-side communication unit 58 (the shooting operation has been performed). (Including the shooting position information acquired by the position acquisition unit 55 at this time) is transmitted to the lens-type camera 4. When the captured image data (including the first time stamp and the captured position information) is transferred from the lens type camera 4, the main body side imaging control unit 592 records the captured image data in the image data recording unit 572. . Further, the main body side imaging control unit 592 changes the shooting parameter via the main body side communication unit 58 in accordance with a change operation to the input unit 51 by the camera user (a user operation to change the shooting parameter in the lens type camera 4). A change instruction is transmitted to the lens-type camera 4.

On the other hand, the main body side imaging control unit 592 executes the following processing when the display device main body 5 is set to the normal photographing mode (a mode for photographing a subject using the main body side imaging unit 54).
Specifically, the main body side imaging control unit 592 causes the main body side imaging unit 54 to image a subject in response to a photographing operation on the input unit 51 by the user of the display device main body 5, and the main body side imaging unit 54 generates The in-camera image data (including the second time stamp) is recorded in the image data recording unit 572.

The main body side display control unit 593 has a function as a display control unit according to the present invention. The main body side display control unit 593 then displays the live view image corresponding to the live view image data stored in the main body side memory unit 56, the captured image corresponding to the captured image data recorded in the image data recording unit 572, and the main body side. Corresponding images corresponding to the corresponding image data received from the lens-type camera 4 via the communication unit 58 are displayed on the display unit 52.
Further, when the display flag of the related image is on, the main body side display control unit 593 generates a display screen that displays the related image together with the live view image, the captured image, or the corresponding image, and the display screen Is displayed on the display unit 52.

[Server configuration]
The server 3 manages the corresponding image data in a database in response to a recording request for the corresponding image data from the display device body 5. Further, the server 3 extracts the related image data from the database in response to a transmission request for the related image data from the display device body 5, and transmits the related image data to the display device body 5.
In the following, the main part of the present invention will be mainly described as the configuration of the server 3.
FIG. 4 is a block diagram showing the configuration of the server 3.
As illustrated in FIG. 4, the server 3 includes a server-side communication unit 31, a database 32, and a server-side control unit 33.

The server-side communication unit 31 performs wireless communication of various data including signals necessary for communication with the display device body 5 under the control of the server-side control unit 33 using a communication method such as Wi-Fi (registered trademark). It is a communication interface for performing.
The database 32 records corresponding image data (including the first time stamp and shooting position information) received from the display device body 5 via the server side communication unit 31 under the control of the server side control unit 33.

The server-side control unit 33 is configured using a CPU or the like, and comprehensively controls the operation of the server 3. As shown in FIG. 4, the server-side control unit 33 includes a server-side communication control unit 331, a terminal determination unit 332, a database management unit 333, a distance calculation unit 334, and a related image extraction unit 335.
The server-side communication control unit 331 receives an access signal transmitted from the display device body 5 via the server-side communication unit 31 and the Internet network N (corresponding image data recording request or related image data transmission request (the display device body 5). ), The operation of the server-side communication unit 31 is controlled to establish a communication connection with the display device body 5. Then, the server-side communication control unit 331 sends the corresponding image data to be recorded in the database 32 from the display device body 5, shooting position information and extraction range information (first range) used for processing of the distance calculation unit 334 and the related image extraction unit 335. To any one of the third extraction range information) and transmits the related image data extracted by the related image extraction unit 335 to the display device body 5.

Based on an access signal transmitted from the display device body 5 via the Internet network N, the terminal determination unit 332 determines (identifies) the transmission source display device body 5 that has accessed.
The database management unit 333 sequentially records the corresponding image data (including the first time stamp and the shooting position information) received from the display device body 5 via the server side communication unit 31 in the database 32.

The distance calculation unit 334 adds the shooting position information (reference position information) received together with the transmission request for the related image data from the display device body 5 via the server-side communication unit 31 and a plurality of corresponding image data recorded in the database 32. The distance between the shooting positions is calculated based on the included shooting position information.
Specifically, the distance calculation unit 334 sets the shooting position based on the shooting position information (reference position information) received from the display device body 5 as the reference position. Then, the distance calculation unit 334 calculates each distance between the reference position and each shooting position based on each shooting position information included in the plurality of corresponding image data recorded in the database 32.

The related image extraction unit 335 includes the extraction range information (any of the first to third extraction range information) received together with the transmission request for the related image data from the display device body 5 via the server side communication unit 31, and the distance calculation unit. Based on each distance calculated at 334, related image data is extracted from a plurality of corresponding image data recorded in the database 32.
Specifically, the related image extraction unit 335 has a distance that is less than the first distance based on the extraction range information (any one of the first to third extraction range information) received from the display device body 5 by the distance from the reference position. Corresponding image data photographed at the photographing position is extracted as first related image data. In addition, the related image extraction unit 335 outputs the corresponding image data captured at the imaging position where the distance from the reference position is equal to or more than the first distance and less than the second distance based on the extraction range information to the second related image data. Extract as Furthermore, the related image extraction unit 335 outputs third image data corresponding to the corresponding image data shot at a shooting position where the distance from the reference position is the second distance or more and less than the third distance based on the extraction range information. Extract as

[Operation of display system]
Next, the operation of the display system 1 described above will be described.
Hereinafter, as operations of the display system 1, operations of the lens type camera 4, operations of the display device body 5, and operations of the server 3 will be described in this order.

[Operation of lens-type camera]
FIG. 5 is a flowchart showing the operation of the lens type camera 4.
When the power of the lens-type camera 4 is turned on by the operation of the operation unit 44 by the camera user (step S101: Yes), the camera side communication control unit 501 starts from the display device body 5 via the camera side communication unit 49. It is determined whether or not a live view image data transmission request has been received (step S102).
When it is determined that the live view image data transmission request has not been received (step S102: No), the lens type camera 4 proceeds to step S111.

On the other hand, when it is determined that a transmission request for live view image data has been received (step S102: Yes), the camera side imaging control unit 502 causes the camera side imaging unit 46 to start imaging (step S103). Live view image data (including the first time stamp) generated by the camera side imaging unit 46 is sequentially stored in the camera side memory unit 47.
Subsequently, the camera side communication control unit 501 transmits the latest live view image data (including the first time stamp) stored in the camera side memory unit 47 to the display device body 5 via the camera side communication unit 49. (Step S104).

Subsequently, the camera side communication control unit 501 determines whether or not an imaging parameter change instruction has been received from the display device body 5 via the camera side communication unit 49 (step S105).
If it is determined that the imaging parameter change instruction has not been received (step S105: No), the lens-type camera 4 proceeds to step S107.
On the other hand, when it is determined that the imaging parameter change instruction has been received (step S105: Yes), the camera-side imaging control unit 502 controls the operation of the drive unit 42 and the like to change the imaging parameter (step S106). ).

After step S106 or when it is determined in step S105 that an instruction to change the shooting parameter has not been received (step S105: No), the camera side communication control unit 501 passes through the camera side communication unit 49. Then, it is determined whether or not a shooting instruction (including shooting position information) has been received from the display device body 5 (step S107).
If it is determined that the shooting instruction has not been received (step S107: No), the lens-type camera 4 returns to step S101.

On the other hand, when it is determined that the imaging instruction has been received (step S107: Yes), the camera side imaging control unit 502 causes the camera side imaging unit 46 to perform imaging (step S108).
Subsequently, the camera side imaging control unit 502 adds the first time stamp and the imaging position information received in step S107 to the imaging image data generated by imaging in step S108, and the camera side recording unit 48. (Step S109).
Subsequently, the camera side communication control unit 501 displays the latest photographed image data (including the first time stamp and the photographing position information) recorded in the camera side recording unit 48 via the camera side communication unit 49. 5 (step S110). Thereafter, the lens type camera 4 returns to Step S101.

If it is determined in step S <b> 102 that a transmission request for live view image data has not been received (step S <b> 102: No), the camera-side communication control unit 501 transmits from the display device body 5 via the camera-side communication unit 49. It is determined whether an image list transmission request has been received (step S111).
If it is determined that an image list transmission request has not been received (step S111: No), the lens-type camera 4 proceeds to step S115.
On the other hand, when it is determined that the image list transmission request has been received (step S111: Yes), the camera-side communication control unit 501 receives a plurality of information recorded in the camera-side recording unit 48 via the camera-side communication unit 49. A list of images in which the captured image data is displayed as thumbnails is transmitted to the display device body 5 (step S112).

Subsequently, the camera-side communication control unit 501 determines whether a request for transmitting corresponding image data corresponding to one image in the image list has been received via the camera-side communication unit 49 (step S113).
If it is determined that the corresponding image data transmission request has not been received (step S113: No), the lens-type camera 4 returns to step S101.
On the other hand, when it is determined that the corresponding image data transmission request has been received (step S113: Yes), the camera side communication control unit 501 is recorded in the camera side recording unit 48 via the camera side communication unit 49. Corresponding image data (including the first time stamp and shooting position information) is transmitted to the display device body 5 (step S114). Thereafter, the lens type camera 4 returns to Step S101.

If it is determined in step S111 that an image list transmission request has not been received (step S111: No), the lens-type camera 4 executes another process different from the process described above (step S115). Thereafter, the lens type camera 4 returns to Step S101.
For example, in step S115, the lens-type camera 4 sets a communication partner based on a user operation on the operation unit 44 by the camera user, information received from an external device via the camera-side communication unit 49, or the like. Execute processing etc.

[Operation of display unit]
FIG. 6 is a flowchart showing the operation of the display device body 5.
In the following, it is assumed that the display device body 5 is set to the “camera communication mode”.
When the power of the display device main body 5 is turned on by the operation of the input unit 51 by the camera user (step S201: Yes), the main body side control unit 59 causes the display device main body 5 to be in a shooting mode (a mode for taking a still image or the like). ) Is set (step S202).
When it is determined that the shooting mode is not set (step S202: No), the display device body 5 proceeds to step S219.

On the other hand, when it is determined that the shooting mode is set (step S202: Yes), the main body side communication control unit 591 performs a live view image on the lens camera 4 via the main body side communication unit 58. A request for data transmission is made and live view image data (including the first time stamp) is received from the lens-type camera 4 (step S203). Then, the main body side communication control unit 591 stores the received live view image data in the main body side memory unit 56.
The live view image data corresponds to the reference image data according to the present invention. That is, the main body side communication control unit 591 has a function as a reference image acquisition unit according to the present invention. Step S203 corresponds to the first acquisition step according to the present invention.
Subsequently, the main body side display control unit 593 displays a live view image corresponding to the latest live view image data stored in the main body side memory unit 56 on the display unit 52 (live view display) (step S204).

Subsequently, the main body side control unit 59 determines whether or not the camera user has performed an operation for changing the shooting parameter to the input unit 51 (step S205).
When it is determined that there is no operation for changing the shooting parameter (step S205: No), the display device body 5 proceeds to step S207.
On the other hand, if it is determined that there has been an operation for changing the shooting parameter (step S205: Yes), the main body side imaging control unit 592 issues an instruction to change the shooting parameter via the main body side communication unit 58. (Step S206).

After step S206 or when it is determined in step S205 that there is no shooting parameter change operation (step S205: No), the main body side control unit 59 displays the related image stored in the main body side memory unit 56. It is determined whether or not the flag is on (step S207).
When it is determined that the related image display flag is off (step S207: No), the display device body 5 proceeds to step S210.

On the other hand, when it is determined that the display flag of the related image is on (step S207: Yes), the main body side control unit 59 uses the shooting position information acquired by the position acquisition unit 55 as the main body side memory unit 56. (Step S208).
Subsequently, the main body control unit 59 receives the related image data from the server 3 and executes a related image display process for displaying the related image corresponding to the related image data together with the live view image (step S209).
The details of the related image display process (step S209) will be described later.

After step S209 or when it is determined in step S207 that the related image display flag is off (step S207: No), the main body side control unit 59 performs a photographing operation on the input unit 51 by the camera user. It is determined whether or not there is (step S210).
When it is determined that there is no shooting operation (step S210: No), the display device body 5 proceeds to step S218.
On the other hand, when it is determined that there has been a shooting operation (step S210: Yes), the main body side imaging control unit 592 stores the shooting position information acquired by the position acquisition unit 55 in the main body side memory unit 56 ( Step S211).
Subsequently, the main body side imaging control unit 592 transmits a photographing instruction (including the photographing position information stored in the main body side memory unit 56 in step S211) to the lens type camera 4 via the main body side communication unit 58 ( Step S212). Then, the main body side imaging control unit 592 records the captured image data (including the first time stamp and the imaging position information) transferred from the lens type camera 4 in the image data recording unit 572 (step S213).
The photographed image data corresponds to the reference image data according to the present invention. That is, the main body side imaging control unit 592 has a function as a reference image acquisition unit according to the present invention. Step S213 corresponds to the first acquisition step according to the present invention.

Subsequently, the main body side control unit 59 determines whether or not the display flag of the related image stored in the main body side memory unit 56 is on (step S214).
When it is determined that the related image display flag is off (step S214: No), the main body side display control unit 593 performs shooting corresponding to the latest captured image data recorded in the image data recording unit 572. The image is displayed on the display unit 52 (step S215).
Subsequently, the main body side control unit 59 determines whether or not there has been a display end operation (user operation to end display of the captured image) on the input unit 51 by the camera user (step S216).
When it is determined that the display end operation has been performed (step S216: Yes), the display device body 5 proceeds to step S218.
On the other hand, when it is determined that there is no display end operation (step S216: No), the main body side display control unit 593 returns to step S215 and continues displaying the captured image.

If it is determined in step S214 that the related image display flag is on (step S214: Yes), the main body side control unit 59 receives the related image data from the server 3, and the related image data together with the captured image. The related image display processing for displaying the related image corresponding to is executed (step S217).
Details of the related image display process (step S217) will be described later.

If it is determined in step S210 that there is no shooting operation (step S210: No), if it is determined in step S216 that there is a display end operation (step S216: Yes), or after step S217, the main body side control unit 59 Then, it is determined whether or not there has been a mode change operation (a user operation for changing the mode of the display device body 5 (such as a shooting mode or a playback mode)) on the input unit 51 by the camera user (step S218).
When it is determined that the mode change operation has been performed (step S218: Yes), the display device body 5 proceeds to step S201.
On the other hand, when it is determined that there is no mode change operation (step S218: No), the display device body 5 returns to step S203 and continues the photographing mode.

When it is determined in step S202 that the shooting mode is not set (step S202: No), the main body side control unit 59 causes the display device main body 5 to switch to the playback mode (lens type camera 4 (camera side recording unit 48)). It is determined whether or not it is set to a mode for displaying a captured image corresponding to the recorded captured image data (step S219).
If it is determined that the playback mode is not set (step S219: No), the display device body 5 proceeds to step S231.
On the other hand, when it is determined that the playback mode is set (step S219: Yes), the main body side communication control unit 591 sends an image list transmission request to the lens camera 4 via the main body side communication unit 58. And the image list is received from the lens-type camera 4 (step S220).

Subsequently, the main body side display control unit 593 displays the image list received in step S220 on the display unit 52 (step S221), and prompts the camera user to select one image in the image list.
Subsequently, the main body side control unit 59 determines whether or not there has been a selection operation (a user operation for selecting one image in the image list) on the input unit 51 by the camera user (step S222).
If it is determined that there is no image selection operation (step S222: No), the display device body 5 returns to step S221 and continues displaying the image list.
On the other hand, when it is determined that there has been an image selection operation (step S222: Yes), the main body side communication control unit 591 corresponds to the image selected by the selection operation via the main body side communication unit 58. The corresponding image data transmission request is transmitted to the lens-type camera 4, and the corresponding image data (including the first time stamp and the photographing position information) is received from the lens-type camera 4 (step S223). Then, the main body side communication control unit 591 stores the received corresponding image data in the main body side memory unit 56.
Note that the corresponding image data corresponds to the reference image data according to the present invention. That is, step S223 corresponds to the first acquisition step according to the present invention.

Subsequently, the main body side control unit 59 determines whether or not the display flag of the related image stored in the main body side memory unit 56 is on (step S224).
When it is determined that the related image display flag is off (step S224: No), the main body side display control unit 593 corresponds to the latest corresponding image data stored in the main body side memory unit 56. The image is displayed on the display unit 52 (step S225).

Subsequently, the main body control unit 59 determines whether or not the camera user has performed an operation for uploading the corresponding image data to the input unit 51 (step S226).
When it is determined that there is no up operation (step S226: No), the display device body 5 proceeds to step S228.
On the other hand, when it is determined that the up operation has been performed (step S226: Yes), the main body side communication control unit 591 executes the following processing (step S227).
That is, the main body side communication control unit 591 sends an access signal (corresponding image data recording request (identification information of its own display device main body 5) to the server 3 connected to the Internet N via the main body side communication unit 58. )) To establish a communication connection with the server 3. Then, the main body side communication control unit 591 transmits the latest corresponding image data (including the first time stamp and shooting position information) stored in the main body side memory unit 56 to the server 3.

After step S227 or when it is determined in step S226 that there is no corresponding image data up operation (step S226: No), the main body side control unit 59 performs a display end operation on the input unit 51 by the camera user ( It is determined whether or not there has been a user operation to end the display of the corresponding image (step S228).
If it is determined that the display end operation has been performed (step S228: Yes), the display device body 5 proceeds to step S230.
On the other hand, when it is determined that there is no display end operation (step S228: No), the main body side display control unit 593 returns to step S225 and continues displaying the corresponding image.

If it is determined in step S224 that the related image display flag is on (step S224: Yes), the main body control unit 59 receives the related image data from the server 3, and the related image data together with the corresponding image. The related image display processing for displaying the related image corresponding to is executed (step S229).
Details of the related image display process (step S229) will be described later.

When it is determined in step S228 that a display end operation has been performed (step S228: Yes), or after step S229, the main body control unit 59 determines whether or not a mode change operation has been performed on the input unit 51 by the camera user. (Step S230).
If it is determined that there has been a mode change operation (step S230: Yes), the display device body 5 proceeds to step S201.
On the other hand, when it is determined that there is no mode change operation (step S230: No), the display device body 5 returns to step S220 and continues the reproduction mode.

If it is determined in step S219 that the playback mode has not been set (step S219: No), the display device body 5 executes another process different from the process described above (step S231). Thereafter, the display device body 5 returns to Step S201.
For example, in step S231, the display device main body 5 sets a counterpart to perform communication based on a user operation on the input unit 51 by a camera user, information received from an external device via the main body side communication unit 58, or the like. Execute processing etc.

[Related image display processing]
Next, the related image display process (steps S209, S217, S229) described above will be described.
Each related image display process in steps S209, S217, and S229 is different in that the objects to be displayed together with the related image are a live view image, a captured image, and a corresponding image, respectively. Therefore, hereinafter, the live view image, the captured image, and the corresponding image, which are the objects to be displayed, are referred to as a reference image (the live view image data, the captured image data, and the corresponding image data are referred to as reference image data), and step S209. , S217, and S229 will be described together.

FIG. 7 is a flowchart showing related image display processing (steps S209, S217, and S229).
First, the main body side communication control unit 591 executes the following processing (step S232).
That is, the main body side communication control unit 591 sends an access signal (related image data transmission request (identification information of its own display device main body 5) to the server 3 connected to the Internet network N via the main body side communication unit 58. )) To establish a communication connection with the server 3. Then, the main body side communication control unit 591 transmits the shooting position information and the extraction range information to the server 3.

Here, the shooting position information transmitted to the server 3 is the shooting position information stored in the main body memory unit 56 in step S208 in the case of the related image display processing in step S209 (the reference image is a live view image). is there. Further, in the case of related image display processing in step S217 (the reference image is a captured image), the shooting position information includes the shooting position included in the latest captured image data recorded in the image data recording unit 572 in step S213. Information. Further, in the case of the related image display process (the reference image is the corresponding image) in step S229, the shooting position information is the shooting position included in the latest corresponding image data stored in the main body memory unit 56 in step S223. Information.
The extraction range information transmitted to the server 3 is one extraction range information read from the main body side recording unit 57 and stored in the main body side memory unit 56 among the first to third extraction range information.

  After step S232, the main body side communication control unit 591 receives the first to third related image data from the server 3 via the main body side communication unit 58, and stores them in the main body side memory unit 56 (step S233: second). 2 acquisition step).

Subsequently, the main body side display control unit 593 executes display screen generation processing for generating a display screen to be displayed on the display unit 52 as described below (step S234).
FIG. 8 is a flowchart showing the display screen generation process (step S234). 9 and 10 are diagrams for explaining the display screen generation process (step S234).
Specifically, FIG. 9 shows image data photographed around the reference position PS on a map around the photographing position PS (hereinafter referred to as the reference position PS) based on the photographing position information transmitted to the server 3 in step S232. It is the figure which showed the state which each arrange | positioned each imaging | photography image F101-F105 each corresponding to (each corresponding | compatible image data recorded on the database 32 of the server 3) to each imaging | photography position P101-P105 of the said imaging | photography image F101-F105, respectively. . FIG. 10 shows the display screen W100 generated in the display screen generation process (step S234).

  Here, each imaging position P101, P102 is the first distance D1 (first distance D1 based on the extraction range information (any of the first to third extraction range information) transmitted to the server 3) with respect to the reference position PS. It shall be located within the range of less than. That is, the captured images F101 and F102 correspond to the first related image data. In addition, each of the photographing positions P103 to P105 is located within a range that is greater than or equal to the first distance D1 and less than the second distance D2 (second distance D2 based on the extraction range information) with respect to the reference position PS. That is, the captured images F103 to F105 correspond to second related image data. In FIG. 9, for convenience of explanation, the captured image corresponding to the third related image data is not shown, but the captured positions of the captured images F106 to F110 illustrated in FIG. 10 are the second distance D2 with respect to the reference position PS. As described above, the captured image F106 to F110 is an image corresponding to the third related image data, which is located within the range of the third distance (the third distance based on the extraction range information).

  Then, as shown in FIG. 10, a region located below the display screen W100 in the display screen W100 and extending along the horizontal direction (first direction) of the display screen W100 is defined as a first region Ar1. The width (length in the vertical direction) of the first region Ar1 is ½ the length in the vertical direction of the display screen W100. In addition, a region that is located immediately above the first region Ar1 in the display screen W100 and extends in the horizontal direction of the display screen W100 is referred to as a second region Ar2. The width of the second region Ar2 is 1/3 of the vertical length of the display screen W100. Further, in the display screen W100, a region that is located immediately above the second region Ar2 (located above the display screen W100) and extends along the horizontal direction of the display screen W100 is referred to as a third region Ar3. The width (length in the vertical direction) of the third region Ar3 is 1/5 of the length in the vertical direction of the display screen W100.

First, the main body side display control unit 593 generates a reference image (reference image FS in the example of FIG. 10) corresponding to the latest reference image data stored in the main body side memory unit 56 or the image data recording unit 572, and step S233. The first related images corresponding to the first related image data recorded in the main body memory unit 56 (in the examples of FIGS. 9 and 10, the captured images F101 and F102) are arranged in the horizontal direction and arranged in the first area Ar1. (Step S2341).
At this time, the main body side display control unit 593 arranges the reference image in the central portion in the horizontal direction in the first region Ar1, and arranges the first related images with the same size as the reference image on the left and right. In the example of FIG. 10, since the captured images F101 and F102 do not fully fit within the display screen W100, only half of the captured images F101 and F102 are arranged. In addition, the main body side display control unit 593 sets the outer edge of the reference image as a thick frame so that the reference image can be distinguished from other related images.

Subsequently, the main body side display control unit 593 displays the second related image corresponding to the second related image data stored in the main body side memory unit 56 in step S233 (in the example of FIGS. 9 and 10, the captured images F103 to F105). ) Are arranged in the second region Ar2 in the horizontal direction (step S2342).
At this time, the main body side display control unit 593 arranges the second related image in the second area Ar2 with a size 2/3 of the reference image.

Subsequently, the main body side display control unit 593 laterally displays the third related images (in the example of FIG. 10, the captured images F106 to F110) corresponding to the third related image data stored in the main body side memory unit 56 in step S233. Arranged in the direction and arranged in the third region Ar3 (step S2343).
At this time, the main body side display control unit 593 arranges the third related image in the third area Ar3 with a size 2/5 of the reference image.

Subsequently, the main body side display control unit 593 arranges an operation icon for urging the change of the extraction range information in the first area Ar1 (step S2344).
In the example of FIG. 10, the main body side display control unit 593 arranges three operation icons A1 to A3 at the lower left of the first area Ar1.
Specifically, the operation icon A1 is operated by the camera user (touch operation on the input unit (touch panel) 51), and the extraction range information stored in the main body side memory unit 56 is changed to the first extraction range information (first operation). This is an icon for updating the first distance to “125 m”, the second distance to “250 m”, and the third distance to “500 m”. When the operation icon A2 is operated by the camera user, the extraction range information stored in the main body side memory unit 56 is converted into the second extraction range information (the first distance is “250 m”, the second distance is “500 m”, the first This is an icon for updating 3 distances to “1 km”). When the operation icon A3 is operated by the camera user, the extraction range information stored in the main body side memory unit 56 is converted into the third extraction range information (the first distance is “500 m”, the second distance is “1 km”, the first This is an icon for updating 3 distances to “2 km”).

In the example of FIG. 10, the operation icon A3 is operated, and the extraction range information stored in the main body side memory unit 56 is updated to the third extraction range information (the operated operation icon A3 is displayed in black, etc. Operation icons A1 and A2 are displayed in white).
In the example of FIG. 10, character information based on the third extraction range information corresponding to the operated operation icon A3 is arranged above the operation icons A1 to A3.
Here, the character information includes the first distance to the third distance in the balloon together with the numerical value of the third distance (“2 km” in the example of FIG. 10) based on the extraction range information corresponding to the operated operation icons A1 to A3. Are all information (in the example of FIG. 10, “500 m”, “1 km”, “2 km”).
Through the above steps S2341 to S2344, the display screen (display screen W100 in the example of FIG. 10) is generated. Thereafter, the display device body 5 returns to the routine shown in FIG.

  After step S234, the main body side display control unit 593 causes the display unit 52 to gradually display the reference image and the first to third related images from one side of the screen of the display unit 52, and then performs step S234. The display screen generated in the above is displayed on the display unit 52 (step S235: display step).

FIG. 11 is a diagram for explaining step S235. Specifically, FIG. 11 corresponds to FIGS. 9 and 10.
For example, in step S235, the main body side display control unit 593 gradually starts with the first to third regions Ar1 to Ar2 from the right side of the screen in the display unit 52 as shown in FIGS. 11 (a) to 11 (d). Are displayed on the display unit 52 in such a manner that the respective images FS, F101 to F110 arranged in FIG. Then, the main body side display control unit 593 finally causes the display unit 52 to display the display screen W100 generated in step S234, as shown in FIG.

After step S235, the main body control unit 59 determines whether or not there has been a change operation (user operation to change the display screen) on the input unit 51 by the camera user (step S236).
When it is determined that there is no display screen change operation (step S236: No), the display device body 5 proceeds to step S238.
On the other hand, when it is determined that the display screen has been changed (step S236: Yes), the main body side display control unit 593 displays the first to third regions Ar1 to Ar3 on the display screen displayed on the display unit 52. The image arranged in the area corresponding to the change operation in Ar3 is scrolled (display screen is changed) (step S237).

12A and 12B are diagrams for explaining steps S236 and S237. Specifically, FIGS. 12A and 12B are diagrams corresponding to FIGS. 9 to 11, and illustrate screen transitions of the display screen when the display user changes the display screen.
For example, when the camera user swipes the first area Ar1 of the input unit (touch panel) 51 to the right as shown in FIGS. 12A and 12B, the main body side display control unit 593 displays the second and third areas. The captured images F103 to F110 arranged in Ar2 and Ar2 are not moved, and the images FS, F101, and F102 arranged in the first area Ar1 are moved in the right direction. As a result, the entire captured image F101 (FIG. 12A) in which only half is displayed is displayed (FIG. 12B).
When the camera user swipes the first area Ar1 leftward, the entire captured image F102 on which only half is displayed is displayed.

In addition, although not shown in detail, when there are four or more second related image data (there is a captured image that is not arranged in the second area Ar2 (not displayed on the display screen W100)). When the camera user swipes the second area Ar2 to the left and right, only the captured image arranged in the second area Ar2 moves to the left and right, and the image has not been arranged in the second area Ar2. An image will be displayed.
Further, although not specifically shown, when there are six or more third related image data (there is a captured image that is not completely arranged in the third area Ar3 (not fully displayed on the display screen W100)). When the camera user swipes the third area Ar3 to the left and right, only the captured image arranged in the third area Ar3 moves to the left and right, and the image has not been arranged in the third area Ar3. An image will be displayed.

After step S237 or when it is determined in step S236 that there is no display screen change operation (step S236: No), the main body side control unit 59 performs a display end operation (display on the input unit 51 by the camera user). It is determined whether or not there has been a user operation for ending screen display (step S238).
If it is determined that a display end operation has been performed (step S238: Yes), the display device body 5 returns to the main routine shown in FIG.
On the other hand, when it is determined that there is no display end operation (step S238: No), the main body side control unit 59 performs a change operation to the input unit 51 by the camera user (a user operation (FIG. 11 (FIG. 11 d) In the example of FIGS. 12A and 12B, it is determined whether or not there has been an operation to the operation icons A1 to A3) (step S239).
When it is determined that there is no change operation (step S239: No), the display device body 5 proceeds to step S236.

On the other hand, if it is determined that there has been a change operation (step S239: Yes), the main body side control unit 59 uses the extraction range information stored in the main body side memory unit 56 as an operation icon (FIG. In the examples of FIG. 11D, FIG. 12A, and FIG. 12B, the extraction range information corresponding to the operation icons A1 to A3) is updated (extraction range information is changed) (step S240).
After that, the display device body 5 returns to step S232, and again executes a transmission request for related image data (including the shooting position information and the extraction range information changed in step S240).

[Server operation]
FIG. 13 is a flowchart showing the operation of the server 3.
The server-side communication control unit 331 receives an access signal (corresponding image data recording request (including identification information of the display device body 5)) from the display device body 5 via the server-side communication unit 31 and the Internet network N. It is determined whether or not it has been done (step S301).
If it is determined that the corresponding image data recording request has not been received (step S301: No), the server 3 proceeds to step S305.
On the other hand, when it is determined that the recording request for the corresponding image data has been received (step S301: Yes), the terminal determination unit 332 identifies the display device body 5 that has been accessed based on the recording request. (Step S302).

Subsequently, the server side communication control unit 331 receives the corresponding image data (including the first time stamp and the shooting position information) from the display device body 5 via the server side communication unit 31 and the Internet network N (step S303). ).
Subsequently, the database management unit 333 records the corresponding image data received in step S303 in the database 32 (step S304). Thereafter, the server 3 returns to step S301.

When it is determined in step S301 that the corresponding image data recording request has not been received (step S301: No), the server-side communication control unit 331 displays the display device via the server-side communication unit 31 and the Internet network N. It is determined whether or not an access signal (related image data transmission request (including identification information of the display device body 5)) has been received from the body 5 (step S305).
If it is determined that the related image data transmission request has not been received (step S305: No), the server 3 proceeds to step S313.
On the other hand, when it is determined that the transmission request for the related image data has been received (step S305: Yes), the terminal determination unit 332 specifies the display device body 5 of the transmission source that has accessed based on the transmission request. (Step S306).
Subsequently, the server side communication control unit 331 receives the shooting position information and the extraction range information from the display device body 5 via the server side communication unit 31 and the Internet network N (step S307).

Subsequently, the distance calculating unit 334 captures each of the shooting positions included in the reference position (the reference position PS in the example of FIG. 9) based on the shooting position information received in step S307 and the plurality of corresponding image data recorded in the database 32. Each distance between each shooting position (shooting positions P101 to P105 in the example of FIG. 9) based on the position information is calculated (step S308).
In the example of FIG. 9, when the longitude and latitude of the reference position PS are “K0” and “I0”, respectively, and the longitude and latitude of the shooting position P101 are “K1” and “I1”, respectively, distance calculation is performed. The unit 334 calculates the distance DS1 between the reference position PS and the shooting position P101 using the following formula (1).

Subsequently, the related image extraction unit 335 sets the corresponding image data captured at the shooting position where the distance from the reference position is less than the first distance based on the extraction range information received in step S307 as the first related image data. (The captured images F101 and F102 in the examples of FIGS. 9 and 10) are extracted from the database 32 (step S309).
Subsequently, the related image extraction unit 335 captures corresponding image data captured at a shooting position where the distance from the reference position is greater than or equal to the first distance and less than the second distance based on the extraction range information received in step S307. It extracts from the database 32 as 2nd related image data (in the example of FIG.9 and FIG.10, the picked-up image F103-F105) (step S310).

Subsequently, the related image extraction unit 335 captures corresponding image data captured at a shooting position where the distance from the reference position is greater than or equal to the second distance and less than the third distance based on the extraction range information received in step S307. It extracts from the database 32 as 3rd relevant image data (in the example of FIG. 10, taken image F106-F110) (step S311).
The server-side communication control unit 331 then displays the first to third related image data extracted in steps S309 to S310 via the server-side communication unit 31 and the Internet network N, and the display device main body specified in step S306. 5 (step S312). Thereafter, the server 3 returns to step S301.

  If it is determined in step S305 that the related image data transmission request has not been received (step S305: No), the server 3 executes another process different from the process described above (step S313). Thereafter, the server 3 returns to step S301.

The display device 2 according to the first embodiment described above acquires the reference image data and the related image data captured within a predetermined distance from the shooting position (reference position) of the reference image data. The reference image (live view image, captured image, or corresponding image) corresponding to the reference image data and the related image corresponding to the related image data are displayed.
For this reason, the camera user can clearly grasp what kind of captured image can actually be obtained by photographing around the reference position by checking the related image. Therefore, according to the display device 2 according to the first embodiment, there is an effect that convenience can be improved.

The display device 2 uses image data (live view image data or captured image data (including corresponding image data)) generated by the lens-type camera 4 as reference image data. In addition, the display device 2 acquires related image data using the current position of the display device 2 when the reference image data is generated as a reference position.
For this reason, the camera user can compare the reference image photographed by himself and the related images photographed by others in an aligned state. That is, it is possible to increase the degree of interest in shooting (willingness to perform shooting similar to the related image) for the camera user.

Further, the display device 2 arranges the first related image in the related image data in the same first area Ar1 as the reference image for the first related image whose distance from the reference position to the shooting position is relatively short. Then, the display device 2 arranges the second and third related images whose distance is farther than the first related image in the second and third regions Ar2 and Ar3 that are sequentially separated from the first region Ar1.
In particular, the display device 2 sets the first related image having a relatively short distance to a large size together with the reference image, and sequentially decreases the sizes of the second and third related images as the distance increases.
For this reason, the camera user confirms the arrangement position and size of the related image, so that the related image is taken at a glance at a position close to the reference position, or is taken at a far position. Can recognize if there is.

Further, the display device 2 displays the generated display screen (in the example of FIG. 10, the display screen W100) after displaying the reference image and the first to third related images gradually appearing from one side of the screen. To do.
For this reason, by displaying in the above-described manner before displaying the display screen, a related image that cannot be displayed is displayed in any direction (swipe in the examples of FIGS. 12A and 12B). It is possible to make the camera user recognize whether it is possible.

(Embodiment 2)
Next, a second embodiment of the present invention will be described.
In the following description, the same reference numerals are given to the same configurations and steps as those in the above-described first embodiment, and the detailed description thereof is omitted or simplified.
In the display system according to the second embodiment, one of the first to third related images displayed on the display screen is selected by the camera user with respect to the display system 1 described in the first embodiment. In this case, a route from the reference position to the shooting position of the selected related image is guided to the camera user.
Hereinafter, the display system 1A (the display device 2A and the server 3A) according to the second embodiment will be described.
The lens type camera 4 constituting the display device 2A has the same configuration as the lens type camera 4 (FIG. 2) described in the first embodiment. Therefore, hereinafter, only the configuration of the display device main body 5A and the server 3A constituting the display device 2A will be described.

[Configuration of display device body]
FIG. 14 is a block diagram showing the configuration of the display device body 5A.
In the display device main body 5A according to the second embodiment, a part of the function of the main body side control unit 59 is changed with respect to the display device main body 5 (FIG. 3) described in the first embodiment.
As shown in FIG. 14, the main body side control unit 59A according to the second embodiment includes a main body side imaging control unit 592 in addition to the main body side control unit 59 described in the first embodiment. A main body side communication control unit 591A and a main body side display control unit 593A in which some functions of the side communication control unit 591 and the main body side display control unit 593 are changed.

The main body side communication control unit 591A has the following functions added to the main body side communication control unit 591 described in the first embodiment.
That is, the main body side communication control unit 591A is connected to the Internet 3 via the main body side communication unit 58 based on the location information (URL) of the server 3A recorded in the main body side recording unit 57. To the access signal (route image data transmission request (including identification information for identifying its own display device body 5A)) to establish a communication connection with the server 3A.
Then, the main body side communication control unit 591A transmits the shooting position information and the image discrimination information for generating the route image data in the server 3A to the server 3A, and receives the route image data from the server 3A.
As for the route image data transmission request, the main body side communication control unit 591A performs a user operation on the input unit 51 by the camera user (selection operation for selecting one of the first to third related images in the display screen). Depending on the process.
The image discrimination information transmitted to the server 3A is information for discriminating (identifying) the related image selected by the selection operation, and the first to third associations transmitted from the server 3A to the display device body 5A. Each is included in the image data.

  The body-side display control unit 593A displays a route image corresponding to the route image data received from the server 3A via the body-side communication unit 58, with respect to the body-side display control unit 593A described in the first embodiment. A function to be displayed on the unit 52 is added.

[Server configuration]
FIG. 15 is a block diagram showing a configuration of the server 3A.
In the server 3A, a map information recording unit 34 is added to the server 3 (FIG. 4) described in the first embodiment, and some functions of the server-side control unit 33 are changed. .
The map information recording unit 34 records map information including the longitude and latitude of each point.
The server-side control unit 33A according to the second embodiment has a route search unit 336 added to the server-side control unit 33 described in the first embodiment and the server-side communication control unit 331. Some functions have been changed.

The server-side communication control unit 331A according to the second embodiment has the following functions added to the server-side communication control unit 331 described in the first embodiment.
That is, the server-side communication control unit 331A sends the related image data to the display device in response to a transmission request (access signal) of the related image data transmitted from the display device body 5 via the server-side communication unit 31 and the Internet network N. When transmitting to the main body 5, image determination information for determining (identifying) the related image data is added to the related image data and transmitted to the display device main body 5. The image discrimination information is also added to the corresponding image data corresponding to the related image data among the plurality of corresponding image data recorded in the database 32.
The server-side communication control unit 331A also transmits an access signal (route image data transmission request (including identification information of the display device main body 5A) transmitted from the display device main body 5A via the server-side communication unit 31 and the Internet network N. )), A communication connection is established with the display device body 5A. The server-side communication control unit 331A receives the shooting position information and the image discrimination information from the display device main body 5A, and transmits the route image data generated by the route search unit 336 to the display device main body 5A.

  The route search unit 336 selects related image data selected by the camera user from a plurality of corresponding image data recorded in the database 32 based on the image discrimination information received from the display device body 5A via the server side communication unit 31. (Corresponding image data including the image discrimination information) is specified. In addition, the route search unit 336 captures an image capturing position (hereinafter referred to as a target position) based on the image capturing position information included in the identified related image data, and the image capturing position received from the display device body 5A via the server-side communication unit 31. Based on the reference position based on the information and the map information recorded in the map information recording unit 34, a route from the reference position to the target position is searched. Then, the route search unit 336 reads out the map information of a predetermined scale including the reference position and the target position from the map information recording unit 34, and the route related to the route image in which the searched route is superimposed on the map image based on the map information. Generate image data.

[Operation of display system]
Next, operations of the display system 1A described above (operations of the display device 2A and the server 3A) will be described.
The operation of the display device 2A differs from the operation of the display device 2 described in the first embodiment (FIGS. 5 to 8) only in the related image display processing (steps S209, S217, and S229). It is. Therefore, hereinafter, only the related image display processing (steps S209, S217, S229) and the operation of the server 3A according to the second embodiment will be described.

[Related image display processing]
FIG. 16 is a flowchart showing related image display processing (steps S209, S217, and S229) according to Embodiment 2 of the present invention.
As shown in FIG. 16, the related image display process according to the second embodiment is obtained by adding steps S241 to S246 to the related image display process (FIG. 7) described in the first embodiment. Only different. For this reason, only steps S241 to S246 will be described below.

Step S241 is executed after step S237 or when it is determined in step S236 that there is no operation for changing the display screen (step S236: No).
Specifically, in step S241, the main body-side control unit 59A performs a selection operation on the input unit 51 by the camera user (first to third related images in the display screen (FIG. 11 (d), FIG. 12A, and FIG. 12B). In this example, it is determined whether or not there has been a user operation for selecting one of the captured images P101 to P110) (step S241).
If it is determined that there is no selection operation (step S241: No), the display device body 5A proceeds to step S238.

On the other hand, when it is determined that there has been a selection operation (step S241: Yes), the main body side communication control unit 591A executes the following processing (step S242).
That is, the main body side communication control unit 591A sends an access signal (route image data transmission request (identification information of its own display device main body 5A) to the server 3A connected to the Internet N via the main body side communication unit 58. )) To establish a communication connection with the server 3A. Then, the main body side communication control unit 591A transmits the shooting position information and the image discrimination information to the server 3A.

Here, in the case of the related image display processing in step S209 (the reference image is a live view image), the shooting position information transmitted to the server 3A is the position acquisition unit when it is determined in step S241 that the selection operation has been performed. The shooting position information acquired at 55. Further, in the case of related image display processing in step S217 (the reference image is a captured image), the shooting position information includes the shooting position included in the latest captured image data recorded in the image data recording unit 572 in step S213. Information. Further, in the case of the related image display process (the reference image is the corresponding image) in step S229, the shooting position information is the shooting position included in the latest corresponding image data stored in the main body memory unit 56 in step S223. Information.
The image discrimination information transmitted to the server 3 is included in the related image data selected by the selection operation in step S241 among the first to third related image data stored in the main body side memory unit 56 in step S233. Image discrimination information.

After step S242, the main body side communication control unit 591A receives the route image data from the server 3A via the main body side communication unit 58 and stores it in the main body side memory unit 56 (step S243).
Subsequently, the main body side display control unit 593A causes the display unit 52 to display a route image corresponding to the route image data stored in the main body side memory unit 56 in step S243 (step S244).

Subsequently, the main body control unit 59A determines whether or not the camera user has performed a display switching operation on the input unit 51 (a user operation for switching the display on the display unit 52 from the route image to the display screen of the first to third related images). Is determined (step S245).
When it is determined that the display switching operation has been performed (step S245: Yes), the display device body 5A returns to step S235, and displays the display on the display unit 52 from the route image to the display screen of the first to third related images. Switch to.
On the other hand, when it is determined that there is no display switching operation (step S245: No), the process proceeds to step S238.

Step S246 is executed when it is determined in step S239 that there is no change operation (step S239: No).
Specifically, the main body control unit 59A determines in step S246 whether or not the route image is being displayed on the display unit 52 in step S244 (while the route image is being displayed).
When it is determined that the route image is not being displayed (step S246: No), the display device body 5A returns to step S236.
On the other hand, when it is determined that the route image is being displayed (step S246: Yes), the display device body 5A returns to step S245.

[Server operation]
FIG. 17 is a flowchart showing the operation of the server 3A.
As shown in FIG. 17, the operation of the server 3A is the addition of step S312A instead of step S312 to the operation of the server 3 described in the first embodiment (FIG. 13), and steps S314 to S319. The only difference is the addition of. Therefore, only steps S312A and S314 to S319 will be described below.

Step S312A is executed after step S311.
Specifically, in step S312A, the server-side communication control unit 331A determines the first to third related image data for the first to third related image data extracted in steps S309 to S311. Add information. The server-side communication control unit 331A also adds the image determination information to the corresponding image data corresponding to the first to third related image data among the plurality of corresponding image data recorded in the database 32. Then, the server-side communication control unit 331A uses the server-side communication unit 31 and the Internet network N to display the first to third related image data (including the image determination information) in the display device body identified in step S306. Send to 5A. Thereafter, the server 3A returns to Step S301.

Step S314 is executed when it is determined in step S305 that the related image data transmission request has not been received (step S305: No).
Specifically, in step S314, the server-side communication control unit 331A sends an access signal (route image data transmission request (of the display device main body 5A) via the server-side communication unit 31 and the Internet network N. It is determined whether or not identification information is included)).
If it is determined that the route image data transmission request has not been received (step S314: No), the server 3A proceeds to step S313.
On the other hand, when it is determined that the transmission request for the route image data has been received (step S314: Yes), the terminal determination unit 332 identifies the display device body 5A that is the access source that has accessed based on the transmission request. (Step S315).
Subsequently, the server side communication control unit 331 receives the shooting position information and the image determination information from the display device body 5A via the server side communication unit 31 and the Internet network N (step S316).

  Subsequently, the route search unit 336 selects the related image data selected by the camera user in step S241 from the corresponding image data recorded in the database 32 based on the image determination information received in step S316 (the image determination information). (Corresponding image data including information) is specified. The route search unit 336 then sets the target position based on the shooting position information included in the identified related image data, the reference position based on the shooting position information received in step S316, and the map information recorded in the map information recording unit 34. Based on the above, a route from the reference position to the target position is searched (step S317).

FIG. 18 is a diagram illustrating an example of a route image W200 corresponding to the route image data generated in step S318. Specifically, FIG. 18 corresponds to FIGS. 9 to 11, 12A, and 12B.
18 illustrates the case where the captured image F105 (second related image) in the display screen W100 is selected by the selection operation by the camera user in step S241 (when the target position is the captured position P105). Yes.
After step S317, the route search unit 336 records map information of a predetermined scale including the target position (the shooting position P105 in the example of FIG. 18) from the reference position (the reference position PS in the example of FIG. 18) as map information. Read from the unit 34. The route search unit 336 then superimposes the route image (route RT in the example of FIG. 18) superimposed on the map image (map image M in the example of FIG. 18) based on the map information (route RT in the example of FIG. 18). In the example of FIG. 18, route image data relating to the route image W200) is generated (step S318).

  Subsequently, the server side communication control unit 331A transmits the route image data generated in step S318 to the display device main body 5A specified in step S315 via the server side communication unit 31 and the Internet network N. Thereafter, the server 3A returns to Step S301.

According to the second embodiment described above, there are the following effects in addition to the same effects as in the first embodiment.
The display system 1A according to the second embodiment captures the selected related image from the reference position when any of the first to third related images displayed on the display screen is selected by the camera user. The route to the position is guided to the camera user.
Therefore, the camera user can easily reach the shooting position of the related image according to his / her preference by following the guidance. Therefore, the convenience can be further improved.

(Embodiment 3)
Next, a third embodiment of the present invention will be described.
In the following description, the same reference numerals are given to the same configurations and steps as those in the above-described first embodiment, and the detailed description thereof is omitted or simplified.
In the display system according to the third embodiment, the server 3 is omitted from the display system 1 described in the first embodiment, and the display device 2 has some functions of the server 3. It is composed.
Hereinafter, the configuration of the lens type camera 4B and the display device body 5B constituting the display system 1B (display device 2B) according to the third embodiment will be described in order.

[Configuration of lens type camera]
FIG. 19 is a block diagram showing a configuration of the lens type camera 4B.
In the lens type camera 4B according to the third embodiment, a part of the function of the camera side control unit 50 is changed with respect to the lens type camera 4 (FIG. 2) described in the first embodiment.
As shown in FIG. 19, the camera-side control unit 50B according to the third embodiment includes a camera-side imaging control unit 502 and a camera-side communication control unit in which some functions of the camera-side communication control unit 501 are changed. 501B, a distance calculation unit 503, and a related image extraction unit 504.

The camera side communication control unit 501B has the following functions added to the camera side communication control unit 501 described in the first embodiment.
That is, the camera-side communication control unit 501B receives shooting position information and extraction range information used for processing of the distance calculation unit 503 and the related image extraction unit 504 together with a transmission request for related image data from the display device body 5B. Then, the camera-side communication control unit 501B transmits the related image data extracted by the related image extraction unit 504 to the display device body 5B according to the transmission request information.

The distance calculation unit 503 and the related image extraction unit 504 use the captured image data (first time stamp and shooting position information) recorded in the camera-side recording unit 48 to calculate the distance described in the first embodiment. The same processing as that of the unit 334 and the related image extraction unit 335 (FIG. 4) is executed.
Note that the captured image data recorded in the camera-side recording unit 48 corresponds to reference information according to the present invention. That is, the camera side recording unit 48 has a function as an image recording unit according to the present invention. Further, the related image extraction unit 335 has a function as a related image acquisition unit according to the present invention.

[Configuration of display device body]
FIG. 20 is a block diagram illustrating a configuration of the display device body 5B.
In the display device main body 5B according to the third embodiment, a part of the function of the main body side control unit 59 is changed with respect to the display device main body 5 (FIG. 3) described in the first embodiment.
As shown in FIG. 20, the main body side control unit 59B according to the third embodiment includes a main body side imaging control unit 592 and a main body side display control unit 593, and also has some functions of the main body side communication control unit 591. A modified main body side communication control unit 591B is provided.

  The main body side communication control unit 591B does not use the server 3 but the lens type for the transmission request of the related image data and the reception of the related image data to the main body side communication control unit 591 described in the first embodiment. The point of execution differs from the camera 4B.

[Operation of display system]
Next, the operation of the display system 1B described above will be described in the order of the operation of the lens type camera 4B and the operation of the display device body 5B.

[Operation of lens-type camera]
FIG. 21 is a flowchart showing the operation of the lens type camera 4B.
As shown in FIG. 21, the operation of the lens type camera 4B is different from the operation of the lens type camera 4 described in the first embodiment (FIG. 5) only in that steps S116 to S122 are added. is there. Therefore, only steps S116 to S122 will be described below.

Step S116 is executed when it is determined in step S111 that there is no image list transmission request (step S111: No).
Specifically, in step S116, the camera side communication control unit 501B determines whether or not a related image data transmission request is received from the display device main body 5B via the camera side communication unit 49.
If it is determined that the related image data transmission request has not been received (step S116: No), the lens-type camera 4B proceeds to step S115.
On the other hand, if it is determined that the transmission request for the related image data has been received (step S116: Yes), the camera-side communication control unit 501B sends the shooting position information and the extraction range information together with the transmission request from the display device body 5B. Receive (step S117).
Subsequently, the distance calculation unit 503 performs a process similar to that in step S308 described in the above-described first embodiment, the reference position based on the shooting position information received in step S117, and a plurality of information recorded in the camera-side recording unit 48. Each distance from each shooting position based on each shooting position information included in the shot image data is calculated (step S118).
Subsequently, the related image extraction unit 504 performs first to third processing from a plurality of photographed image data recorded in the camera-side recording unit 48 by the same processing as steps S309 to S311 described in the first embodiment. Related image data is extracted (steps S119 to S121).
And the camera side communication control part 501B transmits the 1st-3rd related image data extracted by step S119-S121 to the display apparatus main body 5B via the camera side communication part 49 (step S122). Thereafter, the lens-type camera 4B returns to step S101.

[Operation of display unit]
FIG. 22 is a flowchart showing the operation of the display device body 5B.
As shown in FIG. 22, the operation of the display device main body 5B is different from the operation of the display device main body 5 described in the first embodiment (FIGS. 6 to 8) in connection with the omission of the server 3, step S226. , S227 is omitted (step S228 is executed after step S225), and steps S209B, S217B, and S229B (related image display processing) are added instead of steps S209, S217, and S229. For this reason, only the related image display processing (steps S209B, S217B, and S229B) will be described below.

[Related image display processing]
FIG. 23 is a flowchart showing related image display processing (steps S209B, S217B, and S229B) according to Embodiment 3 of the present invention.
As shown in FIG. 23, the related image display process according to the second embodiment is different from the related image display process described in the first embodiment (FIG. 7) in place of steps S232 and S233. The only difference is that steps S232B and S233B in which the communication destinations in steps S232 and S233 are not the server 3 but the lens type camera 4B are added.

  Even when the server 3 is omitted and the display device 2 is configured to have some functions of the server 3 as in the third embodiment described above, the same as in the first embodiment described above. There is an effect.

(Modification of Embodiment 3)
A configuration in which the functions of the map information recording unit 34 and the route search unit 336 described in the second embodiment are incorporated in the display device 2B described in the third embodiment is used, so that the camera user starts from the reference position. The camera user may be guided to the route to the shooting position of the selected related image.

(Embodiment 4)
Next, a fourth embodiment of the present invention will be described.
In the following description, the same reference numerals are given to the same configurations and steps as those in the third embodiment described above, and detailed description thereof will be omitted or simplified.
In the display system according to the fourth embodiment, when extracting the first to third related image data from the display system 1B described in the first embodiment, in addition to the distance from the reference position, the reference The image capturing date and time and the display count of the captured image corresponding to the captured image data are considered.
Hereinafter, the configurations of the lens type camera 4C and the display device body 5C constituting the display system 1C (display device 2C) according to the fourth embodiment will be described in order.

[Configuration of lens type camera]
FIG. 24 is a block diagram showing a configuration of the lens type camera 4C.
In the lens type camera 4C according to the fourth embodiment, a part of the function of the camera-side control unit 50B is changed with respect to the lens type camera 4B (FIG. 19) described in the third embodiment.
As shown in FIG. 24, the camera-side control unit 50C according to the fourth embodiment includes a camera-side imaging control unit 502 and a distance calculation unit 503, as well as one of the camera-side communication control unit 501B and the related image extraction unit 504. Provided with a camera-side communication control unit 501C and a related image extraction unit 504C.

The camera-side communication control unit 501C has some functions changed or added to the camera-side communication control unit 501B described in the third embodiment as described below.
That is, when the camera-side communication control unit 501C receives a transmission request for related image data from the display device main body 5C via the camera-side communication unit 49, the camera-side communication control unit 501C includes the reference information in addition to the shooting position information and the extraction range information, as well as A first time stamp related to the shooting date and time of the image is received.
Further, the camera side communication control unit 501C receives a transmission request for the corresponding image data from the display device body 5C via the camera side communication unit 49, and responds to the corresponding image data (first time stamp and shooting). (Including position information), and the display count information recorded in the camera-side recording unit 48 in association with the corresponding image data is read out. Then, the camera-side communication control unit 501C increases the number of displays (the number of transmissions of the corresponding image data) based on the read display number information by “1”, and associates the increased display number information with the corresponding image data. Record (update) in the camera-side recording unit 48.

  The related image extraction unit 504C extracts the first to third related image data from the plurality of captured image data recorded in the camera-side recording unit 48 with respect to the related image extraction unit 504 described in the third embodiment. In doing so, in addition to the distance from the reference position calculated by the distance calculation unit 503, the first time stamp indicating the shooting date and time of the reference image and the display count information associated with the captured image data are considered. Has been.

[Configuration of display device body]
FIG. 25 is a block diagram showing a configuration of the display device body 5C.
In the display device main body 5C according to the fourth embodiment, a part of the function of the main body side control unit 59B is changed with respect to the display device main body 5B (FIG. 20) described in the third embodiment.
As shown in FIG. 25, the main body side control unit 59C according to the fourth embodiment includes a main body side imaging control unit 592 and a main body side display control unit 593, and has some functions of the main body side communication control unit 591B. A changed main body side communication control unit 591C is provided.

The main body side communication control unit 591C has some functions changed as described below with respect to the main body side communication control unit 591C described in the third embodiment.
That is, when the main body side communication control unit 591C transmits a transmission request of related image data to the lens type camera 4C via the main body side communication unit 58, in addition to the shooting position information and the extraction range information, the shooting date and time of the reference image Is configured to transmit a first time stamp.

[Operation of display system]
Next, the operation of the display system 1C described above will be described in the order of the operation of the lens type camera 4C and the operation of the display device body 5C.

[Operation of lens-type camera]
FIG. 26 is a flowchart showing the operation of the lens type camera 4C.
As shown in FIG. 26, the operation of the lens type camera 4C is the addition of step S123 to the operation of the lens type camera 4B described in the third embodiment (FIG. 21), and steps S117, S119, The only difference is that steps S117C and S119C to S121C are added instead of S121. Therefore, only steps S123, S117C, and S119C to S121C will be described below.

Step S123 is executed after step S114.
Specifically, in step S123, the camera-side communication control unit 501C reads display number information recorded in the camera-side recording unit 48 in association with the corresponding image data transmitted in step S114. Then, the camera side communication control unit 501C increases the display number based on the read display number information by “1”, and records the increased display number information in the camera side recording unit 48 in association with the corresponding image data ( Update. Thereafter, the lens type camera 4C returns to Step S101.

Step S117C is executed when it is determined in step S116 that a transmission request for related image data has been received (step S116: Yes).
Specifically, in step S117C, the camera side communication control unit 501C receives the shooting position information, the extraction range information, and the first time stamp from the display device body 5C together with the transmission request. Thereafter, the display device body 5C proceeds to Step S118.

Step S119C is executed after step S118.
Specifically, in step S119C, the related image extraction unit 504C extracts from the plurality of captured image data recorded in the camera-side recording unit 48 the distance from the reference position calculated in step S118 received in step S117C. Narrow down the photographed image data photographed at the photographing position within the range less than the first distance based on the information. Further, the related image extraction unit 504C further narrows down the captured image data including the first time stamp having the same season as the first time stamp (reference date and time) received in step S117C, from the narrowed captured image data. Further, the related image extraction unit 504C refers to display number information associated with the photographed image data among the further narrowed photographed image data, and the number of displays based on the display number information is a first threshold value or more. Image data is extracted from the camera-side recording unit 48 as first related image data.

  Subsequently, the related image extraction unit 504C extracts from the plurality of captured image data recorded in the camera-side recording unit 48 the distance from the reference position calculated in step S118 is equal to or more than the first distance and is received in step S117C. Narrow down the photographed image data photographed at the photographing position within the range less than the second distance based on the information. Further, the related image extraction unit 504C further narrows down the captured image data including the first time stamp having the same season as the first time stamp (reference date and time) received in step S117C, from the narrowed captured image data. Further, the related image extraction unit 504C refers to display number information associated with the photographed image data among the further narrowed photographed image data, and the number of displays based on the display number information is a first threshold value or more. Image data is extracted from the camera-side recording unit 48 as second related image data (step S120C).

  Subsequently, the related image extraction unit 504C extracts from the plurality of photographed image data recorded in the camera-side recording unit 48, the extraction range received in step S117C when the distance from the reference position calculated in step S118 is equal to or greater than the second distance. Narrow down the photographed image data photographed at the photographing position within the range less than the third distance based on the information. Further, the related image extraction unit 504C further narrows down the captured image data including the first time stamp having the same season as the first time stamp (reference date and time) received in step S117C, from the narrowed captured image data. Further, the related image extraction unit 504C refers to display number information associated with the photographed image data among the further narrowed photographed image data, and the number of displays based on the display number information is a first threshold value or more. Image data is extracted from the camera-side recording unit 48 as third related image data (step S121C). Thereafter, the lens camera 4C proceeds to step S122.

[Operation of display unit]
The operation of the display device body 5C is different from the operation of the display device body 5B described in the third embodiment (FIGS. 22 and 23) only in the related image display processing (steps S209B, S217B, and S229B). is there. Therefore, hereinafter, only the related image display processing (steps S209B, S217B, and S229B) according to the fourth embodiment will be described.

[Related image display processing]
FIG. 27 is a flowchart showing related image display processing (steps S209B, S217B, and S229B) according to Embodiment 4 of the present invention.
As shown in FIG. 27, the related image display process according to the fourth embodiment is different from the related image display process described in the third embodiment (FIG. 23) in the related image data instead of step S232B. The only difference is that step S232C for transmitting the first time stamp is added in addition to the shooting position information and the extraction range information.
Here, the first time stamp transmitted to the lens type camera 4C is the latest time stored in the main body side memory unit 56 in step S203 in the case of the related image display processing in step S209B (the reference image is a live view image). The first time stamp included in the live view image data. In the case of the related image display process (the reference image is a captured image) in step S217B, the first time stamp is included in the latest captured image data recorded in the image data recording unit 572 in step S213. One time stamp. Further, in the case of the related image display process (the reference image is the corresponding image) in step S229B, the first time stamp is included in the latest corresponding image data stored in the main body memory unit 56 in step S223. One time stamp.

According to the fourth embodiment described above, there are the following effects in addition to the same effects as in the third embodiment.
When extracting the first to third related image data, the display system 1C according to Embodiment 4 captures the shooting date and time of the reference image and the shot image corresponding to the shot image data in addition to the distance from the reference position. It is configured to take into account the number of display times.
For this reason, related images that are not suitable for display as related images (such as related images captured in winter when the reference image was taken in summer or related images that are not of interest to the camera user (the number of display times is small)) are displayed. And only relevant relevant images can be displayed.

(Modification of Embodiment 4)
In the fourth embodiment described above, related image data having the same season as the shooting date and time of the reference image is extracted. However, the present invention is not limited to this. The related image data in the same time zone (daytime or night) may be extracted.

In the above-described fourth embodiment, the following information may be considered when extracting the related image data.
That is, when recording captured image data in the camera-side recording unit 48, a camera (for example, ramen etc.) selected or input by the camera user using the input unit 51 is associated with the captured image data. This is recorded in the side recording unit 48. When extracting related image data from a plurality of captured image data recorded in the camera-side recording unit 48, separately, captured image data associated with a keyword selected or input by the camera user is used as related image data. Extract.

  The display device 2C described in the fourth embodiment described above adopts a configuration in which the functions of the map information recording unit 34 and the route search unit 336 described in the second embodiment are incorporated. The camera user may be guided to the route to the shooting position of the selected related image.

  As described in the above-described fourth embodiment, when extracting related image data, the distance from the reference position, the shooting date and time of the reference image, the number of display times of the shot image corresponding to the shot image data, or the keyword is considered. Such a configuration may be incorporated into the configuration described in the first and second embodiments.

(Other embodiments)
Up to this point, the mode for carrying out the present invention has been described. However, the present invention should not be limited only by the above-described first to fourth embodiments.
In the first to fourth embodiments described above, the configuration (layout) of the display screen that displays the related image is not limited to the configuration described in the first to fourth embodiments (display screen W100 in the example of FIG. 10). Other configurations (layouts) may be adopted. For example, a configuration (layout) in which related images existing in the azimuth are arranged at positions corresponding to the azimuth according to the azimuth (viewing direction) of the lens-type cameras 4, 4 </ b> B, and 4 </ b> C may be adopted.

  In the first to fourth embodiments described above, the first to third extraction range information is provided as the extraction range information, the first to third related image data is acquired, and the first to third areas Ar1 to Ar3 of the display screen are acquired. Although it was comprised so that it may each arrange | position, it is not restricted to this. For example, a configuration in which one or two pieces of extraction range information are provided (a configuration in which one or two pieces of related image data (only the first related image data or only the first and second related image data) are acquired) Alternatively, a configuration in which four or more related images are provided (a configuration in which four or more related image data is acquired (fourth related image data or the like in addition to the first to third related image data)) may be used.

In Embodiments 1 to 4 described above, the lens-type cameras 4, 4 </ b> B, and 4 </ b> C and the display device main bodies 5 and 5 </ b> A to 5 </ b> C are configured separately. You may comprise as a display apparatus which integrated the function of 4C, and the function of the display apparatus main bodies 5 and 5A-5C. Of course, even in industrial and medical equipment, the relative position relationship between the current apparatus position (reference position) such as an observation position and a photographing position and an already photographed image (may be an absolute position difference). Can be used for any shooting, observation, and inspection device, and if the images taken at relatively close positions are organized and displayed, the part to be rechecked, It becomes motivation such as follow-up observation, and various useful information can be provided to the user visually and intuitively. In other words, the present invention includes an invention that can be said to be curation using position. That is, an observation apparatus, an inspection apparatus, an observation system, an inspection system, an observation method, an inspection method, an observation program, and an inspection program that can improve convenience can be provided.
The apparatus according to the present invention acquires reference image data and related image data photographed within a predetermined distance with respect to the observation and display position (reference position) of the reference image data, and includes the reference image data as the reference image data. A corresponding reference image and a related image corresponding to the related image data are displayed.
For this reason, the user of this apparatus can grasp | ascertain clearly what kind of observation and test | inspection can actually be performed by observation and test | inspection around the reference | standard position by confirming a related image. Therefore, according to the device of the present invention, there is an effect that the convenience can be improved.

The processing flow is not limited to the processing order in the flowcharts described in the first to fourth embodiments, and may be changed within a consistent range.
Furthermore, the processing algorithm described using the flowcharts in this specification can be described as a program. Such a program may be recorded on a recording unit inside the computer, or may be recorded on a computer-readable recording medium. Recording of the program in the recording unit or recording medium may be performed when the computer or recording medium is shipped as a product, or may be performed by downloading via a communication network.

  DESCRIPTION OF SYMBOLS 1,1A-1C ... Display system; 2, 2A-2C ... Display apparatus; 3, 3A ... Server; 4, 4B, 4C ... Lens type camera; 5, 5A-5C ... Display device body; 6 ... attachment; 6A ... mounting hole; 31 ... server side communication unit; 32 ... database; 33, 33A ... server side control unit; Recording part; 41 ... Optical system; 42 ... Drive part; 43 ... Position detection part; 44 ... Operation part; 45 ... Camera side clock part; 47 ... Camera side memory unit; 48 ... Camera side recording unit; 49 ... Camera side communication unit; 50, 50B, 50C ... Camera side control unit; 51 ... Input unit; Display unit; 53... Main body side clock unit; 54... Main body side imaging unit; 55. 6 ... Main body side memory unit; 57 ... Main body side recording unit; 58 ... Main unit side communication unit; 59, 59A to 59C ... Main unit side control unit; 331, 331A ... Server side communication control 332... Terminal determination unit 333... Database management unit 334... Distance calculation unit 335... Related image extraction unit 336. 412 ... Focus lens; 421 ... Zoom drive unit; 422 ... Focus drive unit; 431 ... Zoom position detection unit; 432 ... Focus position detection unit; 501, 501B, 501C ... Camera 502: camera side imaging control unit; 503 ... distance calculation unit; 504, 504C ... related image extraction unit; 571 ... program recording unit; 572 ... image data recording 591, 591A to 591C, main body side communication control unit, 592, main body side imaging control unit, 593, 593A, main body side display control unit, A1 to A3, operation icons, Ar1,. First region; Ar2 ... second region; Ar3 ... third region; D1 ... first distance; D2 ... second distance; FS ... reference image; F101-F110 ... Image; N ... Internet network; PS ... Reference position; P101 to P105 ... Shooting position; RT ... Path; W100 ... Display screen; W200 ... Path image

Claims (14)

A reference image acquisition unit for acquiring reference image data;
A related image acquisition unit that acquires related image data captured within a predetermined distance with respect to a reference position indicating a shooting position of the reference image data;
A display for displaying an image;
A display control unit that displays a reference image corresponding to the reference image data and a related image corresponding to the related image data on the display unit ,
The related image acquisition unit
Obtaining a plurality of the related image data;
The plurality of related image data are:
First related image data captured within a range less than a first distance with respect to the reference position;
Second related image data captured within a range of the first distance or more and less than the second distance with respect to the reference position,
The display control unit
The reference image and the first related image corresponding to the first related image data are arranged in the first region, and the second related corresponding to the second related image data in a second region different from the first region. A display device that displays a display screen on which an image is arranged on the display unit. An imaging unit that images a subject and generates image data;
A position acquisition unit that acquires position information related to the position of the display device,
The reference image acquisition unit
Obtaining the image data generated by the imaging unit as the reference image data;
The related image acquisition unit
The related image data is acquired using the position based on the position information acquired by the position acquisition unit when the image data is generated by the imaging unit as the reference position. The display device described in 1. The display control unit
Display device according to claim 1 or 2, characterized in that for displaying the second related image on the display section in a size smaller than the image size of the reference image and the first related image. The related image acquisition unit
Obtaining a plurality of the first related image data and a plurality of the second related image data;
The display control unit
In the first area, the reference image and the first related images corresponding to at least two first related image data among the plurality of first related image data are arranged side by side along a first direction, and The display unit has the display screen in which the second related images corresponding to at least two second related image data among the plurality of second related image data are arranged in the second region along the first direction. The display device according to claim 1, wherein the display device is displayed. The display control unit
The reference image, each of the first related images corresponding to the at least two first related image data, and each of the second related images corresponding to the at least two second related image data are upstream in the first direction. The display device according to claim 4 , wherein the display screen is displayed on the display unit after being displayed on the display unit in a manner that gradually appears. An operation reception unit for receiving user operations;
The display control unit
When the operation receiving unit receives a user operation for instructing to change the display screen, an image arranged in at least one of the first region and the second region is along the first direction. the display device according to claim 4 or 5, characterized in that to change the display screen by moving manner. The related image acquisition unit
The related image data captured at a date and time according to a reference date and time that is captured within a predetermined distance range with respect to the reference position and that indicates a shooting date and time of the reference image data is acquired. The display device according to any one of 1 to 6 . The related image acquisition unit
Obtaining the related image data captured within a predetermined distance range with respect to the reference position and displayed on the display device or another display device different from the display device for a predetermined number of times or more. The display device according to any one of claims 1 to 7 . An image recording unit that records a plurality of pieces of reference information in which image data and shooting position information indicating a shooting position of the image data are associated with each other;
The related image acquisition unit
Of the plurality of image data included in the plurality of reference information recorded in the image recording unit, the image data captured within a predetermined distance with respect to the reference position is acquired as the related image data. display device according to any one of claims 1-8, characterized by. A distance calculation unit that calculates each distance between the reference position and each shooting position based on a plurality of the shooting position information included in the plurality of reference information recorded in the image recording unit;
The related image acquisition unit
The display device according to claim 9 , wherein the related image data is acquired from the plurality of reference information recorded in the image recording unit based on the distances calculated by the distance calculating unit. . It has a display side communication unit that connects to an external server so that it can communicate
The related image acquisition unit
Through the display-side communication unit, any one of claims 1-8, which sends the reference position information indicating the reference position to the server, and acquires the associated image data from the server The display device described in 1. A display system comprising the display device according to claim 11 and a server that communicates with the display device.
The server
A server-side communication unit that communicates with the display device;
A server-side communication control unit that receives the reference position information from the display device via the server-side communication unit;
A database for recording a plurality of pieces of reference information in which image data and shooting position information indicating a shooting position of the image data are associated with each other;
Each distance between the reference position based on the reference position information received via the server-side communication unit and each shooting position based on the plurality of shooting position information included in the plurality of reference information recorded in the database. A distance calculating unit to calculate;
A related image extraction unit that extracts the related image data from the plurality of reference information recorded in the database based on the distances calculated by the distance calculation unit;
The server side communication control unit,
The display system, wherein the related image data extracted by the related image extraction unit is transmitted to the display device via the server side communication unit. In the display method performed by the display device,
A first acquisition step of acquiring reference image data;
A second acquisition step of acquiring related image data photographed within a predetermined distance with respect to a reference position indicating a photographing position of the reference image data;
Reference image corresponding to the reference image data, and look including a display step of displaying the associated image corresponding to the associated image data in Table radical 113,
In the second acquisition step,
Obtaining a plurality of the related image data;
The plurality of related image data are:
First related image data captured within a range less than a first distance with respect to the reference position;
Second related image data captured within a range of the first distance or more and less than the second distance with respect to the reference position,
In the display step,
The reference image and the first related image corresponding to the first related image data are arranged in the first region, and the second related corresponding to the second related image data in a second region different from the first region. A display method comprising: displaying a display screen on which an image is arranged on the display unit . A display program for causing a display device to execute the display method according to claim 13 .

Images