JP6337431B2 - System, server, electronic device and program - Google Patents

Description

  The present invention relates to a system, a server, an electronic device, and a program.

There has been known an image processing apparatus that facilitates shooting under a common shooting position among a plurality of photographers (see, for example, Patent Document 1).
[Prior art documents]
[Patent Literature]
[Patent Document 1] Japanese Patent Laid-Open No. 2001-8089

  For example, when a plurality of users are located at positions apart from each other, it is not easy to capture the same subject as the subject captured by the imaging device used by another user.

  In a first aspect of the present invention, a system includes an imaging device, an electronic device, and a server that communicates with the imaging device and the electronic device. The imaging device generates image data generated by imaging, Imaging information including information indicating an imaging position that is a geographical position and information indicating an imaging direction at the time of imaging is transmitted to the server, and the server satisfies predetermined conditions based on the image data received from the imaging device. A subject determination unit that determines whether or not a suitable subject is captured by the imaging device, and a subject position that is a geographical position where a subject that meets a predetermined condition exists based on imaging information received from the imaging device And a subject information transmitting unit for transmitting subject information including information indicating the subject position specified by the position specifying unit to the electronic device. To guide the user of the electronic device to the object position received from.

  In the second aspect of the present invention, the server includes image data generated by imaging with the imaging device, information indicating the position of the imaging device at the time of imaging, and information indicating the imaging direction of the imaging device at the time of imaging. A data reception unit that receives imaging information from the imaging device, and a subject determination unit that determines whether a subject that meets a predetermined condition is captured based on the image data received by the data reception unit; A position specifying unit that specifies a geographical position where a subject that meets the predetermined condition is present based on the imaging information, and information that indicates the geographical position specified by the position specifying unit, Includes a subject information transmission unit that transmits to different electronic devices.

  In the third aspect of the present invention, the program includes image data generated by imaging with the imaging device, information indicating the position of the imaging device at the time of imaging, and information indicating the imaging direction of the imaging device at the time of imaging. A data receiving step for receiving imaging information including the image capturing device, and a subject for determining whether or not a subject that meets a predetermined condition is captured based on the image data received in the data receiving step A determination step; a position specifying step for specifying a geographical position where a subject that meets the predetermined condition is present based on imaging information; and information indicating the geographical position specified in the position specifying step. Causing the computer to execute a subject information transmission step of transmitting to an electronic device different from the imaging device.

  In the second aspect of the present invention, the electronic device displays the image data generated by imaging with the imaging device, the information indicating the geographical position at the time of imaging of the imaging device, and the imaging direction at the time of imaging of the imaging device. A subject information receiving unit that receives from the server subject information indicating a geographical position where a subject that meets a predetermined condition specified by the server based on the information to be displayed, and the subject information received from the server The guidance control part which guides a user to the geographical position shown by this.

  In the third aspect of the present invention, the program includes image data generated by imaging with an imaging device, information indicating a geographical position at the time of imaging of the imaging device, and an imaging direction at the time of imaging of the imaging device. A subject information receiving step for receiving, from the server, subject information indicating a geographical position where a subject that meets a predetermined condition specified by the server based on the information to be received; and the subject information received from the server And a guidance control step for guiding the user to the geographical location indicated by

  It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

The concept of system 5 in one embodiment is shown. 1 shows an example of a system configuration of a camera 10. An example of a block configuration of the server 20 is schematically shown. An example of the subject selection screen 400 displayed on the display unit 138 is schematically shown. An example of the guide screen displayed on the display part 138 is shown typically. Another example of the guide screen displayed on the display unit 138 is schematically shown. Another example of the guide screen displayed on the display part 138 is typically shown. An example of an operation flow in the camera 10 is shown. An example of a processing flow when a release button is pushed is shown. An example of the processing flow in the server 20 is shown. An example of the process flow performed in the camera 10 by a guide process task is shown.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 illustrates the concept of a system 5 in one embodiment. The system 5 includes a network 15, a camera 10a, a camera 10b, and a camera 10c as an example of an imaging device, a network 15, and a server 20. The camera 10a, the camera 10b, and the camera 10c are used by different users. In the description of the present embodiment, the camera 10a, the camera 10b, and the camera 10c may be collectively referred to as the camera 10. The system 5 provides an opportunity to guide each user of the camera 10 to the position of the subject imaged by the other camera 10 and image the subject.

  The camera 10 and the server 20 can communicate with each other through the network 15. When the camera 10a records the image data generated by photographing the subject 80, the camera 10a stores the position information at the time of image capturing by the camera 10a, the information indicating the image capturing direction at the time of image capturing, and the image capturing information including the image data. 15 to the server 20. Other shooting information includes focal length, shutter speed, aperture value, exposure compensation, flash, flash dimming, white balance, and other imaging conditions, date, time, shooting mode, single / continuous shooting, and continuous shooting frames. May include speed, weather, photographic equipment, etc.

  The server 20 is a computer connected to the network 15. The server 20 may be a cloud server with a plurality of computers. The server 20 analyzes the image data received from the camera 10a and identifies the type of the subject 80. Further, the server 20 analyzes the image data received from the camera 10a and identifies the type of the subject 80. Moreover, the server 20 specifies the geographical position of the specified subject 80 based on the position information received from the camera 10a and the information indicating the imaging direction.

  The server 20 acquires in advance from the user of the camera 10 the type of subject that the user wants to capture. The server 20 selects a user who wants to image the specified type of subject, and transmits subject information including the geographical position of the specified subject 80 to the camera 10b used by the user.

  The camera 10 b guides the user to the geographical position of the subject 80 received from the server 20. For example, the camera 10b guides the user by displaying guide information for guiding the geographical position of the subject 80 and the user. Therefore, the user can find the target subject relatively easily. And possibility that the user of camera 10b will image subject 80 imaged with camera 10a can be raised. In the description of this embodiment, the geographical position of the subject may be simply referred to as the subject position.

  FIG. 2 shows an example of the system configuration of the camera 10. The camera 10 is an interchangeable lens camera as an example. This figure shows a block configuration of the camera 10 with the lens unit 120 mounted.

  The lens unit 120 includes a lens mount having a lens mount contact 121. The camera body 130 includes a camera mount having a camera mount contact 131. When the lens mount and the camera mount are engaged and the lens unit 120 and the camera body 130 are integrated, the lens mount contact 121 and the camera mount contact 131 are connected. The lens MPU 123 is connected to the camera MPU 140 via the lens mount contact 121 and the camera mount contact 131, and controls the lens unit 120 in cooperation with each other while communicating with each other.

  The lens unit 120 includes a lens group 122, a lens driving unit 124, and a lens MPU 123. The subject light passes through the lens group 122 as an optical system of the lens unit 120 along the optical axis and enters the camera body 130. The main mirror 145 can take an oblique state where the main mirror 145 is obliquely provided in the subject light flux centered on the optical axis of the lens group 122 and a retreat state where the main mirror 145 is retracted from the subject light flux.

  When the main mirror 145 is in an oblique state, the main mirror 145 reflects a part of the subject light flux that has passed through the lens group 122. Specifically, the region near the optical axis of the main mirror 145 in the oblique state is formed as a half mirror. Part of the subject luminous flux incident on the region near the optical axis is transmitted and the other part is reflected. The subject luminous flux reflected by the main mirror 145 is presented to the user as a subject image through the focus plate 161, the transmissive display panel 160, the pen prism 147, the eyepiece optical system 162, and the finder window 163. The user can confirm the composition and the like based on the presented subject image. The transmissive display panel 160 presents various information including information indicating the setting state of the imaging operation to the user, along with the subject image based on the subject light flux. The transmissive display panel 160 superimposes on the subject image based on the subject luminous flux and presents various information to the user under the control of the camera MPU 140.

  Part of the subject luminous flux that has passed through the region near the optical axis of the main mirror 145 is reflected by the sub mirror 146 and guided to the AF unit 142. The AF unit 142 includes a plurality of photoelectric conversion element arrays that receive a subject light beam. The photoelectric conversion element array outputs a signal with a phase match when in a focused state, and outputs a signal with a phase shift when in a front pin state or a rear pin state. The amount of phase shift corresponds to the amount of shift from the focus state. The AF unit 142 detects a phase difference by performing a correlation operation on the output of the photoelectric conversion element array, and outputs a phase difference signal indicating the phase difference to the camera MPU 140.

  The focus state of the lens group 122 is adjusted using the phase difference signal from the AF unit 142 under the control of the camera MPU 140 and the like. For example, the target position of the focus lens included in the lens group 122 is determined by the camera MPU 140 based on the focus state detected from the phase difference signal, and the position of the focus lens is controlled by the control of the lens MPU 123 toward the determined target position. Is done. Specifically, the lens MPU 123 controls the lens driving unit 124 including a focus lens motor as an example, and moves the focus lens constituting the lens group 122. As described above, when the main mirror 145 is down and in the inclined state, the focus state of the lens group 122 is detected by the phase difference detection method, and the focus adjustment is performed. The AF unit 142 is provided with photoelectric conversion element arrays at a plurality of positions respectively corresponding to the plurality of regions in order to adjust the focus state in each of the plurality of regions in the subject image.

  The photometric element 144 is an example of a photometric unit that measures subject light. The photometric element 144 has a photoelectric conversion element that receives a part of the light beam guided to the pentaprism 147. The luminance information of the subject detected by the photoelectric conversion element included in the photometric element 144 is output to the camera MPU 140 as a photometric value. The camera MPU 140 controls each unit based on the luminance information acquired from the photometric element 144. For example, the camera MPU 140 calculates an AE evaluation value based on the luminance information, and performs exposure control based on the AE evaluation value.

  When the main mirror 145 retracts from the subject light beam, the sub mirror 146 retracts from the subject light beam in conjunction with the main mirror 145. A focal plane shutter 143 is provided on the lens group 122 side of the image sensor 132. The focal plane shutter 143 is a mechanical shutter as an example. When the main mirror 145 is in the retracted state and the focal plane shutter 143 is in the open state, the subject light flux that has passed through the lens group 122 is incident on the light receiving surface of the image sensor 132. The focal plane shutter 143 controls exposure by opening and closing an optical path of subject light incident on the image sensor 132.

  The imaging element 132 functions as an imaging unit. The image sensor 132 captures an image of the subject using the subject light flux that has passed through the lens group 122. Examples of the image sensor 132 include solid-state image sensors such as CMOS sensors and CCD sensors. The imaging element 132 has a plurality of photoelectric conversion elements that receive the subject light flux, and outputs an analog signal corresponding to the amount of accumulated charge generated by each of the plurality of photoelectric conversion elements to the analog processing unit 133. The analog processing unit 133 performs analog processing such as amplification processing and OB clamping processing on the analog signal output from the image sensor 132 and outputs the analog signal to the A / D converter 134. The A / D converter 134 converts the analog signal output from the analog processing unit 133 into a digital signal representing image data and outputs the digital signal. The image sensor 132, the analog processing unit 133, and the A / D converter 134 are driven by a driving unit 148 that receives an instruction from the camera MPU 140.

  The digital signal output as a digital signal from the A / D converter 134 is input to the ASIC 135 as image data. The ASIC 135 is an integrated circuit in which circuits related to the image processing function are integrated into one. The ASIC 135 uses at least a part of the memory area of the RAM 136 as an example of a volatile memory as a buffer area for temporarily storing image data, and performs various image processing on the image data stored in the RAM 136. Apply. Examples of the image processing by the ASIC 135 include noise reduction processing, defective pixel correction, white balance correction, color interpolation processing, color correction, gamma correction, contour enhancement processing, image data compression processing, and the like.

  When the image sensor 132 continuously captures images, sequentially output image data is sequentially stored in the buffer area. A plurality of image data obtained by continuously capturing images by the image sensor 132 is sequentially stored in the buffer area as image data of continuous still images or image data of each image constituting the moving image. The RAM 136 also functions as a frame memory that temporarily stores frames when the ASIC 135 processes moving image data.

  Examples of image processing in the ASIC 135 include processing for generating image data for recording, processing for generating image data for display, and image data processing for automatic focus adjustment (AF). Further, the image processing in the ASIC 135 includes processing for detecting the contrast amount for AF processing and the like. Specifically, the ASIC 135 detects the contrast amount from the image data and supplies it to the camera MPU 140. For example, the ASIC 135 detects the contrast amount from each of a plurality of image data obtained by imaging with the focus lens positioned at different positions in the optical axis direction. The camera MPU 140 adjusts the focus state of the lens group 122 based on the detected contrast amount and the position of the focus lens. For example, the camera MPU 140 determines the target position of the focus lens so as to increase the amount of contrast, and causes the lens MPU 123 to control the position of the focus lens toward the determined target position. As described above, when the main mirror 145 is up and in the retracted state, the focus state of the lens group 122 is detected by the contrast detection method, and the focus adjustment is performed. As described above, the camera MPU 140 performs the focus adjustment of the lens group 122 in cooperation with the ASIC 135 and the lens MPU 123.

  When recording the image data output from the A / D converter 134, the ASIC 135 converts the image data into a standardized image format. For example, the ASIC 135 performs a compression process for generating still image data obtained by encoding still image data in an encoding format compliant with a standard such as JPEG. Further, the ASIC 135 converts a plurality of frames into QuickTime, H.264, and the like. H.264, MPEG2, Motion JPEG, etc. A compression process for generating moving image data encoded by an encoding method compliant with a standard such as JPEG is performed. The ASIC 135 outputs and records the generated image data such as still image data and moving image data to an external memory 180 as an example of a nonvolatile recording medium. For example, the ASIC 135 records in the external memory 180 as a still image file and a moving image file. An example of the external memory 180 is a semiconductor memory such as a flash memory. Examples of the external memory 180 include various memory cards such as an SD memory card, a CF storage card, and an XQD memory card. The image data stored in the RAM 136 is transferred to the external memory 180 through the recording medium connector 151 to which the recording medium IF 150 and the external memory 180 are attached. The image data recorded in the external memory 180 is transferred to the RAM 136 through the recording medium IF 150 and stored in the RAM 136. Examples of the recording medium IF 150 include a card controller that controls access to the above-described memory card.

  The ASIC 135 generates display image data in parallel with the generation of recording image data. For example, the ASIC 135 generates display image data to be displayed on the display unit 138 during a so-called live view operation. Further, at the time of image reproduction, the ASIC 135 generates image data for display from the image data read from the external memory 180. The generated image data for display is converted into an analog signal under the control of the display control unit 137 and displayed on the display unit 138 such as a liquid crystal display. In addition to the image display based on the image data obtained by imaging, various menu items relating to various settings of the camera 10 are also displayed under the control of the ASIC 135 and the display control unit 137 without displaying the image based on the image data. 138.

  The external device IF 152 is responsible for communication with an external device connected via the external device connector 156. The image data recorded in the external memory 180 is transferred to the external device through the external device IF 152. In addition, image data acquired by communication from an external device through the external device IF 152 is recorded in the external memory 180. The external device IF 152 may communicate with the external device by USB communication.

  The wireless communication unit 170 is responsible for wireless communication. Specifically, the wireless communication unit 170 communicates with the server 20 through the network 15. The wireless communication unit 170 performs wireless communication in accordance with various wireless communication standards such as a wireless LAN. The position detection unit 172 includes, for example, a GPS module. The position detection unit 172 acquires the current position and outputs it to the camera MPU 140. The direction detection unit 174 detects the direction of the camera 10. For example, the direction detection unit 174 may include a geomagnetic sensor. The direction detection unit 174 may further include a posture sensor that detects the direction of the camera 10 with respect to gravity. Examples of the attitude sensor include a three-axis acceleration sensor. The direction detection unit 174 may calculate the direction of the optical axis of the lens unit 120 based on the output of the one or more sensors, and output information indicating the direction of the optical axis to the camera MPU 140. In the present embodiment, the direction of the optical axis of the lens unit 120 may be referred to as the direction of the camera 10. The information indicating the orientation of the camera 10 may include information indicating the azimuth and the elevation angle.

  The operation input unit 141 receives an operation from the user. The operation input unit 141 includes various operation members such as a release button, an imaging mode dial, a playback button, a live view switch, a moving image button, and a power switch. Further, the operation input unit 141 may include an input member that is integrated with the display unit 138 as a touch panel or the like. The camera MPU 140 detects that the operation input unit 141 has been operated, and executes an operation corresponding to the operation. For example, the camera MPU 140 controls each unit of the camera 10 so as to execute an imaging operation when a release button is pressed. In addition, the camera MPU 140 controls each unit of the camera 10 so as to perform an operation according to the menu item displayed on the display unit 138 and the operation content when an input member mounted as a touch panel is operated.

  The voice input / output unit 178 includes a microphone unit that inputs voice and a speaker unit that outputs voice. The camera MPU 140 processes an audio signal input from the microphone unit. The camera MPU 140 outputs sound from the speaker unit. For example, the camera MPU 140 may output the guide information from a speaker unit with sound.

  The camera 10 is controlled directly or indirectly by the camera MPU 140 and the ASIC 135 including the control described above. Constants, parameters such as variables, programs, and the like necessary for the operation of the camera 10 are stored in the system memory 139. The system memory 139 is an electrically erasable / storable nonvolatile memory, and is configured by, for example, a flash ROM, an EEPROM, or the like. The system memory 139 stores parameters, programs, and the like so that they are not lost even when the camera 10 is not operating. Parameters, programs, and the like stored in the system memory 139 are expanded in the RAM 136 and used for controlling the camera 10. The ASIC 135, the RAM 136, the system memory 139, the display control unit 137, the camera MPU 140, and the external device IF 152 in the camera body 130 are connected to each other via a connection interface 149 such as a bus and exchange various data.

  Each part of the camera body 130, each part of the lens unit 120, and the external memory 180 are supplied with power from the power supply 190 via the power supply circuit 192. Examples of the power source 190 include a secondary battery such as a lithium ion battery that can be attached to and detached from the camera body 130, a system power source, and the like. The secondary battery is an example of a battery, and the battery includes a non-rechargeable battery that cannot be substantially charged. The camera MPU 140 controls power supply from the power supply 190 to each unit of the camera 10 by controlling the power supply circuit 192.

  FIG. 3 schematically illustrates an example of a block configuration of the server 20. The server 20 includes a CPU 210, a RAM 220, a system memory 230, a recording medium 240, an operation input unit 250, a communication unit 270, a display unit 280, and a bus 290. The bus 290 is coupled to the CPU 210, the RAM 220, the system memory 230, the recording medium 240, the operation input unit 250, the communication unit 270, and the display unit 280, and transmits various data output from each unit, control signals, and the like.

  The CPU 210 is a central processing unit and governs overall control of the server 20. The system memory 230 is an electrically erasable / storable nonvolatile memory, and is configured by, for example, a flash ROM. The system memory 230 stores control parameters such as constants and variables necessary for the operation of the server 20, programs, and the like so that they are not lost even when the server 20 is not operating. Constants, variables, programs, and the like stored in the system memory 230 are expanded from the system memory 230 to the RAM 220 and used to control each unit of the server 20. As the RAM 220, SDRAM or the like can be applied.

  The recording medium 240 is a non-volatile recording medium. As the recording medium 240, various recording media such as a magnetic recording medium such as a hard disk, a semiconductor memory such as a flash memory, and an optical recording medium such as an optical disk can be applied. The operation input unit 250 receives a user operation. The operation input unit 250 may include operation members such as a mouse and a keyboard. The communication unit 270 is responsible for network communication and transmits / receives various data to / from the camera 10. As the display unit 280, a display device such as a liquid crystal display can be applied.

  The communication unit 270 receives request information and imaging information from the camera 10. The CPU 210 processes the request information received by the communication unit 270 and records it on the recording medium 240. Further, the CPU 210 processes the imaging information transmitted from the camera 10 and records it on the recording medium 240. Additional information such as commentary information is recorded in advance on the recording medium 240 in association with the subject. When the subject is an animal, examples of the commentary information include the form of the subject, the classification of the subject, and the ecology of the subject. When the imaging information is acquired from the camera 10, the CPU 210 adds commentary information as additional information and records it on the recording medium 240.

  When new image information is received from the camera 10, the CPU 210 collates the request information recorded on the recording medium 240 with the image information, and if there is request information that matches the image information, the request information The imaging information added with the additional information is transmitted as subject information to the camera 10 that has transmitted. In addition, when new request information is received from the camera 10, the CPU 210 compares the image information recorded in the recording medium 240 with the request information, and if there is image information that matches the request information, Imaging information with additional information is transmitted as subject information to the camera 10 that has transmitted the request information.

  FIG. 4 schematically shows an example of the subject selection screen 400 displayed on the display unit 138. The subject selection screen 400 is a menu screen for selecting a target subject. The camera MPU 140 displays the subject selection screen 400 on the display unit 138 based on the image data included in the subject information received from the server 20.

  The subject selection screen 400 includes a plurality of image areas 410, a plurality of subject information areas 420 corresponding to the plurality of image areas 410, and a cursor 430, respectively. An image is displayed in the image area 410 based on the image data received from the server 20. In the subject information area 420, additional information such as a subject name included in the subject information received from the server 20 is displayed.

  The user operates the operation input unit 141 such as a multi selector to move the cursor 430 and select one image area 410 from the plurality of image areas 410. The camera MPU 140 determines a position for displaying the cursor 430 in accordance with an operation of the multi-selector or the like, and displays the cursor 430 at the determined position. When the camera MPU 140 determines that the user has performed an operation of selecting the image area 410 based on the operation of the multi-selector or the like, the camera MPU 140 identifies the image area 410 corresponding to the current position of the cursor 430 and corresponds to the identified image area 410. The guide to the position of the subject to be started is started.

  When a predetermined operation for displaying detailed information is detected on the subject selection screen 400, the camera MPU 140 detects various conditions such as an imaging condition included in the subject information corresponding to the current position of the cursor 430. Information may be displayed on the display unit 138.

  FIG. 5 schematically illustrates an example of a guide screen displayed on the display unit 138. FIG. 5 shows a guide screen 500 displayed on the display unit 138. The guide screen 500 is displayed on the display unit 138 when the distance between the current position of the camera 10 and the subject position of the movement target is larger than a predetermined value. In addition, the guide screen 500 may be displayed on the display unit 138 when it is not possible to capture the moving subject position from the current position of the camera 10.

  The guide screen 500 includes an object 510 indicating a direction to be moved and a wide area 550. The object 510 and the wide area 550 are displayed on an image based on image data captured by the image sensor 132.

  The camera MPU 140 may determine the direction from the current position of the camera 10 to the subject position as the direction to be moved. The camera MPU 140 may determine the direction along the movement path from the current position of the camera 10 to the subject position as the direction to be moved. The camera MPU 140 may receive route information regarding the moving route from the current position of the camera 10 to the subject position from the server 20 and display the object 510 based on the route information and the current position of the camera 10.

  The wide area 550 includes an object 560 indicating the current position of the camera 10 and the current user orientation, and an object 570 indicating the target position. The camera MPU 140 may determine the orientation of the user based on the history of the position of the camera 10 detected by the position detection unit 172. The camera MPU 140 may determine the orientation of the user based on the orientation of the camera 10 detected by the direction detection unit 174. The camera MPU 140 may determine the orientation of the camera 10 detected by the direction detection unit 174 as the orientation of the user.

  FIG. 6 schematically shows another example of the guide screen displayed on the display unit 138. FIG. 6 shows a guide screen 600 displayed on the display unit 138. The guide screen 600 is displayed on the display unit 138 when the distance between the current position of the camera 10 and the target position is smaller than a predetermined value. In addition, the guide screen 600 may be displayed on the display unit 138 when the moving subject position can be captured from the current position of the camera 10.

  The guide screen 600 includes an object 610 indicating a direction. The object 610 is displayed on an image based on image data captured by the image sensor 132. The camera MPU 140 may display the object 610 by determining the direction to be indicated by the object 610 based on the direction from the current position of the camera 10 to the subject position. The camera MPU 140 may determine the direction from the current position of the camera 10 to the subject position as the direction to be indicated by the object 610. The camera MPU 140 may determine the direction to be indicated by the object 610 based on the direction from the current position of the camera 10 to the subject position and the current direction of the camera 10. The camera MPU 140 also determines the position of the object 610 and the direction to be indicated by the object 610 based on the direction from the current position of the camera 10 to the subject position, the current direction of the camera 10, and the current angle of view of the camera 10. May be determined.

  Note that a guide screen similar to the guide screen 600 may be presented to the user through the finder window 163. For example, the camera MPU 140 may display an object similar to the object 610 on the transmissive display panel 160 and superimpose it on a subject image based on the subject luminous flux and present the object to the user.

  FIG. 7 schematically shows still another example of the guide screen displayed on the display unit 138. FIG. 7 is an example of a guide screen 700 when the subject position is included in the imaging range of the camera 10.

  The camera MPU 140 determines the position of the object 710 and the direction to be indicated by the object 710 based on the direction from the current position of the camera 10 to the subject position, the current direction of the camera 10, and the current angle of view of the camera 10. Then, the object 710 is displayed on the display unit 138. Note that a guide screen similar to the guide screen 700 may be presented to the user through the finder window 163. For example, the camera MPU 140 may display an object similar to the object 710 on the transmissive display panel 160 and superimpose it on a subject image based on the subject luminous flux and present the object to the user.

  When the above-described guide screen is displayed, at least one of the color, shape, and size of an object such as the object 510, the object 610, and the object 710 according to the distance between the subject position and the current position. May be changed. Further, the display state of the object may be changed by blinking the object. Further, the distance between the subject position and the current position may be further displayed as a number. Further, when the voice of the subject specified by the request information is detected by the microphone unit of the voice input / output unit 178 when the guide screen is displayed, the direction of the sound source is specified and a new arrow or the like is added in the specified direction. Additional objects may be displayed.

  When the subject is an astronomical object, the camera MPU 140 may display a guide screen that presents the user with a predetermined star position such as a north star. When presenting the position of a star moving in the sky according to the time of day to the user, the camera MPU 140 may generate a guide screen further based on the date information. In addition, the camera MPU 140 may generate a guide screen that presents the position of the star moving in the sky and the position of the Arctic star according to the date and time.

  FIG. 8 shows an example of an operation flow in the camera 10. FIG. 8 shows a processing flow from activation to termination of the camera 10. This flow is started, for example, when a power switch as a part of the operation input unit 141 is switched to the ON position. This flow is executed by controlling each part of the camera 10 mainly by the camera MPU 140.

  In step S800, initial setting of the camera 10 is started. For example, the camera MPU 140 expands various parameters for controlling the camera 10 from the system memory 139 to the RAM 136. In addition, the camera MPU 140 sets operating conditions of each unit of the camera 10 based on, for example, the state of an imaging mode dial as a part of the operation input unit 141 and various developed parameters. Examples of the operating conditions include a shooting mode and imaging conditions. Examples of the shooting mode include a continuous shooting mode, a single shooting mode, and a bulb shooting mode. Examples of imaging conditions include exposure time, aperture value, imaging sensitivity, and the like.

  Subsequently, in step S802, the camera MPU 140 causes the display unit 138 and the like to display the content set in the initial setting. For example, the camera MPU 140 causes the display unit 138 to display information such as an imaging mode, imaging conditions, and recording conditions in various formats such as icon display.

  Subsequently, in step S804, the camera MPU 140 identifies the event that has occurred. Specifically, the camera MPU 140 identifies an event based on at least one of an operation on the operation input unit 141 and data received from the wireless communication unit 170.

  When it is determined that an event has occurred in the user operation for executing the setting, the instructed setting process is performed (step S808). Examples of the setting process include a process for selecting the above-described imaging mode, a process for setting an imaging condition, and the like. When the operation setting is changed in this step, the parameter variable is changed according to the changed operation setting.

  Also, a process for setting a subject name indicating a subject desired to be imaged is performed as part of the setting process. The request information is transmitted to the server 20. The subject name may be a name indicating the type of an object such as “Himasei” or “animals and plants” such as “Japanese macaque” or “sunflower”. Further, examples of the subject name include names such as “autumn” and “night view” including the background, the light beam state, the season, the time, and the place. A plurality of subject names may be set.

  If it is determined in step S804 that an event based on a user operation on the release button has occurred, focus adjustment or imaging is performed according to the depression of the release button (step S810). The processing in this step will be described with reference to FIG.

  If it is determined in step S804 that an event has occurred based on reception of subject information, a task for performing guide processing is activated (step S812). The processing executed by this task will be described with reference to FIG.

  If it is determined in step S804 that another event has occurred, processing predetermined according to the event is executed (step S814). An example of this process is a process for reproducing image data.

  When the processes of step S808, step S810, step S812, and step S814 are completed, the process proceeds to step S820. In step S820, it is determined whether to turn off the power. For example, it is determined to turn off the power when the power switch is switched to the OFF position, or when there is no user instruction for a predetermined period after the camera 10 starts operating. If it is determined that the power is to be turned off, this flow is terminated. If it is determined that the power is not to be turned off, the process proceeds to step S804.

  FIG. 9 shows an example of a processing flow when the release button is pressed. This flow can be applied to a part of the processing in step S810. This flow is executed by controlling each part of the camera 10 mainly by the camera MPU 140.

  In step S902, it is determined whether the release button has been pressed halfway or fully. When the release button is pressed halfway, the camera MPU 140 performs focus adjustment on the subject corresponding to the current focus adjustment position (step S904), and ends this flow. In step S904, when the live view operation is not performed, focus adjustment based on the phase difference by the AF unit 142 is performed. When the live view operation is performed, focus adjustment based on the contrast amount is performed from the image data.

  If it is determined in step S902 that the release button has been fully pressed, the image sensor 132 is exposed and imaged (step S906), and the output of the image sensor 132 is read (step S908). Subsequently, image data for recording is generated based on the read output of the photoelectric conversion element (step S910), and the generated image data is recorded in the external memory 180 (step S912). At this time, the camera MPU 140 may record information indicating the in-focus point subjected to the focusing control along with the image data.

  Subsequently, in step S <b> 914, the camera MPU 140 controls the wireless communication unit 170 to transmit the image data recorded in the external memory 180 to the server 20. The server 20 transmits image data to the server 20 together with information indicating the focal point.

  In step S916, it is determined whether the user is being guided. For example, it is determined whether or not it is operating in the operation mode for displaying the guide screen described with reference to FIGS. If the user is not being guided, this flow ends. If the user is being guided, it is determined whether or not to end the guide (step S918).

  For example, the camera MPU 140 determines that the guide is to be ended when the subject at the subject position that is the target of the guide is imaged and the generated image data is recorded. The camera MPU 140 determines to end the guide when the distance between the subject position that is the guide target and the current position of the camera 10 is smaller than a predetermined value. The user may be inquired whether or not to end the guide, and may be determined to end the guide when there is an input indicating that the guide should be ended.

  If it is determined that the guide is to be terminated, a process for terminating the guide is performed (step S920), and this flow is terminated. For example, the operation mode in which the guide screen is not displayed is set. In the operation mode in which the guide screen is not displayed, the object 510, the object 610, the object 710, and the wide area 550 are not displayed on the display unit 138 or the transmissive display panel 160.

  FIG. 10 shows an example of a processing flow in the server 20. FIG. 10 is an example of a processing flow of a part waiting from the camera 10. This flow is started when it is detected that information has been received from the camera 10. This flow is executed by controlling each part of the server 20 with 210 as a main body.

  When this flow starts, the type of received information is determined in step S1002. Specifically, it is determined whether imaging information has been received or request information has been received. If the received information is request information, the request information is recorded on the recording medium 240 (step S1004). The request information includes the subject name of the subject desired to be imaged, camera identification information, and user identification information.

  In step S1006, it is determined whether or not there is information including a subject name that matches the requested subject name among the imaging information that has already been received from the camera 10 and recorded on the recording medium 240. If there is no imaging information including a matching subject name, this flow ends. If there is imaging information including a matching subject name, the imaging information is transmitted as subject information to the camera 10 that has transmitted the request information (step S1008), and this flow ends. At this time, subject information may be transmitted to the camera 10 with a predetermined number as the upper limit. Further, the subject information may be transmitted to the camera 10 only when the elapsed time from when the image data is obtained to the present is shorter than a predetermined threshold. The predetermined number of cases and the elapsed time from when the image data is obtained until the present time may be set in advance for each user and acquired in advance in the server 20.

  If it is determined in step S1004 that the received information is imaging information, the type of subject is specified (step S1010). For example, the type of the subject is specified by recognizing the shape of the subject by image recognition. When the focal point information is included in the imaging information, the image recognition process may be applied to the image data of the partial area including the focal point.

  Subsequently, the subject name and additional information for identifying the recognized subject are added to the imaging information (step S1012), and the imaging information is recorded (step S1014). Examples of the additional information include an explanation of the subject.

  Subsequently, it is determined whether or not there is a user requesting the type of subject specified in step S1010 (step S106). For example, the request information recorded in the recording medium 240 is searched, and it is determined whether or not there is a user who desires to capture the type of subject specified in step S1010. If there is no user who wants to take an image, this flow ends. If there is a user who wishes to image, the imaging information is transmitted as subject information to the camera 10 used by the user (step S1018), and this flow is terminated. In step S1018, the camera 10 to which imaging information should be transmitted as subject information may be determined based on the camera identification information included in the imaging information and the camera identification information included in the request information. For example, when imaging information is received from the camera 10a, subject information may not be transmitted to the camera 10a. Further, the camera 10 to which the imaging information should be transmitted as the subject information may be determined based on the subject position information included in the imaging information. For example, if the combination of the subject position and the subject type included in the newly acquired imaging information matches the combination of the subject position and the subject type included in the previously acquired imaging information, the previously acquired imaging The subject information may not be transmitted to the camera 10 that has transmitted the information. As a result, it is possible to reduce the possibility that imaging information about the same subject that was taken before is transmitted as subject information.

  FIG. 11 shows an example of a processing flow executed in the camera 10 by the guide processing task. This flow is executed by controlling each part of the camera 10 mainly by the camera MPU 140.

  In step S1102, the camera MPU 140 detects the current position and orientation of the camera 10. Subsequently, in step S1104, the camera MPU 140 determines whether or not the target subject position can be imaged.

  When the target subject position is not at a position where the target subject position can be imaged, the camera MPU 140 identifies the direction in which the user should move (step S1106), and causes the display unit 138 to display a guide screen that presents the direction to be moved to the user ( Step S1108). For example, the guide screen illustrated in FIG. 5 is displayed on the display unit 138.

  When the target subject position is in a position where the target subject position can be imaged, the camera MPU 140 specifies the direction in which the camera 10 should be directed based on the geographical range to be imaged and the subject position (step S1110), and a guide for presenting the direction of the camera 10 The screen is displayed on the display unit 138 (step S1112). For example, the guide screen that does not include the wide area guide information illustrated in FIGS. 6 and 7 is displayed on the display unit 138.

  In step S1114, it is determined whether to end the guide processing task. Specifically, in step S920 in FIG. 9, when an event for stopping the guide processing task occurs, it is determined to end the guide processing task. If the guide processing task is not terminated, the process proceeds to step S1102. When ending the guide processing task, the guide processing task is stopped (step S1114), and this flow is ended.

  In the present embodiment, voice guidance may be used instead of the guide screen guide or in addition to the guide screen guide. For example, the left and right directions may be output from the speaker unit included in the audio input / output unit 178 as audio.

  The request information may include information indicating the registered name of the user, the imaging area, the reception timing, the image size, the number of receptions, the reception priority order, and the imaging equipment. Here, the registered name of the user may be a user name registered in the server 20 by another camera 10. For example, the request information may include the name of a user who takes a picture of his / her preference. Thereby, it can suppress that imaging information is transmitted unnecessarily. Further, when a group is formed by a plurality of users, such as when going out in a group, a group name for identifying the group may be included in the request information. Based on these pieces of information, the server 20 determines whether or not subject information should be transmitted. The camera 10 may set these pieces of information through a setting menu.

  The imaging area indicates an area where the user wants to perform imaging. By including the area in the request information, the user can suppress transmission of imaging information about a subject located in an area of no interest. The setting of the imaging area may be selected for each concentric circle distance centered on the current position. Moreover, you may set an imaging area based on an address. The imaging area may be set by drawing a range indicating the imaging area on the map displayed on the display unit 138 having a touch panel function. Moreover, the imaging area may be set according to the concentric distance from the set current position of the user. A plurality of frequently used areas may be presented with different colors on the map in the display unit 138. Based on the imaging area information, the server 20 may not transmit the subject information when the subject position is outside the imaging area.

  The reception timing is information indicating the timing at which the subject information reception operation is started in S301. For example, it may be set as the reception timing that subject information should be transmitted on condition that the current position is within the shooting area. In addition, as the reception timing, the reception time may be directly specified, such as the time when the reception of the subject information is started, the time when the reception of the subject information is ended, and the information indicating the period during which the subject information is received. The server 20 does not have to transmit subject information when the current time does not match the reception timing included in the request information.

  The image size indicates the size of image data included in the subject information. The server 20 generates image data having a requested image size from the image data included in the imaging information, and transmits the image data to the camera 10.

  The number of receptions indicates the maximum number of subject information that can be received by the camera 10. It is possible to prevent transmission to the camera 10 exceeding the number of receptions. The server 20 may transmit to the camera 10 with the maximum number as the upper limit when the imaging information matching the request information is present exceeding the maximum number.

  The reception priority order is information that specifies imaging information that is preferentially received as subject information when the number of imaging information that matches the request information exceeds the set number of receptions. For example, the imaging date may be in the newest order or the oldest order. Moreover, the order may be in the order close to the designated date and time or time, or in the order far away. Further, the subject position or the imaging position may be in the order closer to the current position or in the order farther away. The order may be close to the current position of the user set as the imaging area, or may be in a distant order. In addition, the subject position may be in the order from the specified point to the near or far away. The server 20 selects imaging information to be transmitted with priority over other imaging information based on the reception priority order when imaging information that matches the request information exceeds the maximum number, and the selected number of received information The imaging information is transmitted to the camera 10 as subject information.

  Further, when the guide screen is displayed on the camera 10, the display method of the guide screen may be selected by the setting of the camera 10. For example, when the current position is outside the set imaging area, the user may be guided in a guide mode based on route information such as car navigation. When the current position is outside the imaging area, as illustrated in FIG. 3 to FIG. 7, a guide that displays the current position, the subject position, and the guidance direction to the subject position based on the direction of the camera 10 with arrows or the like. You may make it switch to a mode.

  In addition, when transmitting to the server 20, the camera 10 may add text data or audio data to the imaging information and transmit it to the server 20. The text data may be data input by the user. The voice data may be voice data of voice recorded at the time of imaging, or may be voice data of user voice recorded before and after imaging.

  Further, the server 20 may record a subject recognition program for each subject in the recording medium 240. In the camera 10, the subject program set in the request information may be downloaded from the server 20 and incorporated in the camera 10. Then, after the user is guided to the subject position, the camera 10 detects the position of the subject in the imaging region based on the image data, and performs focus control on the detected position by an autofocus operation. Good.

  For example, when the imaging information transmitted from the camera 10a to the server 20 is transmitted as subject information from the server 20 to the camera 10b, the server 20 is associated with the user of the camera 10a and the user of the camera 10b. 20 may notify the user of the camera 10b by sending a message to that effect to the user of the camera 10b. For example, the server 20 may transmit an e-mail to the camera 10a indicating that the transmission of the shooting information has been completed.

  Further, the route information to the subject position and the like may be specified in the server 20. For this purpose, the camera 10 may transmit information on the current position and orientation to the server 20.

  In the above description, the processing described as the operation of the camera MPU 140 is realized by the camera MPU 140 controlling each hardware of the camera 10 according to a program. In the above description, the processing realized by the ASIC 135 can be realized by a processor. For example, the processing described as the operation of the ASIC 135 is realized by the processor controlling each hardware included in the camera 10 according to the program. Further, the processing described as the operation of the 210 CPU 210 in the server 20 is realized by the CPU 210 controlling each hardware of the server 20 according to the program. In other words, the processing described in connection with the camera 10 and the server 20 of the present embodiment is performed by the processor operating in accordance with the program to control each hardware, so that each hardware including the processor, memory, etc. and the program cooperate. It can be realized by working and operating. That is, the process can be realized by a so-called computer device. The computer device may load a program for controlling the execution of the above-described process, operate according to the read program, and execute the process. The computer device can load the program from a computer-readable recording medium storing the program.

  In the present embodiment, the camera 10 with the lens unit 120 attached is taken as an example of an imaging apparatus. However, the imaging device is a concept including the camera body 130 to which the lens unit 120 is not attached. As an imaging device, in addition to a single-lens reflex camera that is an example of an interchangeable lens camera, a compact digital camera that is an example of a non-interchangeable camera, a mirrorless camera, a video camera, a mobile phone with an imaging function, imaging Various electronic devices having an imaging function, such as a portable information terminal with a function and an entertainment device such as a game machine with an imaging function, can be applied.

  The device that receives subject information from the server 20 may be an electronic device that does not have an imaging function. For example, the user uses the electronic device to request the server 20 for the name of an object to be viewed. When the object is imaged as a subject by the camera in the system 5, the user moves to the position of the subject according to the guide screen described in relation to FIG. 4, FIG. Can be increased.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior to”. It should be noted that the output can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.

5 system, 10 camera, 15 network, 20 server, 80 subject, 120 lens unit, 121 lens mount contact, 122 lens group, 123 lens MPU, 124 lens drive unit, 130 camera body, 131 camera mount contact, 132 image sensor, 133 Analog processing unit, 134 A / D converter, 135 ASIC, 136 RAM, 137 display control unit, 138 display unit, 139 system memory, 140 camera MPU, 141 operation input unit, 142 AF unit, 143 focal plane shutter, 144 Photometric element, 145 main mirror, 146 sub mirror, 147 pentaprism, 148 drive unit, 149 connection interface, 150 recording medium IF, 152 external device IF, 156 external device connection 160, transmissive display panel, 161 focusing plate, 162 eyepiece optical system, 163 finder window, 170 wireless communication unit, 172 position detection unit, 174 direction detection unit, 178 voice input / output unit, 180 external memory, 190 power supply, 192 Power supply circuit, 210 CPU, 220 RAM, 230 system memory, 240 recording medium, 250 operation input unit, 270 communication unit, 280 display unit, 290 bus, 400 subject selection screen, 410 image area, 420 subject information area, 430 cursor, 500 guide screen, 510, 560, 570, 610, 710 object, 550 wide area, 600 guide screen, 700 guide screen

Claims (14)

An imaging device;
Electronic equipment,
A server that communicates with the imaging device and the electronic device;
The imaging device transmits image data generated by imaging, imaging information including information indicating an imaging position that is a geographical position at the time of imaging, and information indicating an imaging direction at the time of imaging to the server,
The server
When there is image data including a subject that matches the subject condition received from the electronic device among the image data received from the imaging device, information indicating a geographical position where the subject exists is transmitted to the electronic device. Having a transmitter to
The electronic device is a system for guiding to a geographical position where the subject received from the server is present . The system according to claim 1, wherein the subject condition received from the electronic device includes a condition related to a subject type designated by a user of the electronic device. The imaging information further includes information indicating a focal length,
The server
3. The system according to claim 1, wherein a position of a subject that is a geographical position of a subject that satisfies the condition of the subject is specified based on information indicating the imaging position, the imaging direction, and the focal length. The electronic device has an imaging unit,
The system according to any one of claims 1 to 3, wherein the electronic device guides a user to a position where the electronic device can capture an image of the subject based on the position of the subject. The system according to claim 4, wherein the electronic device includes a display unit that displays information indicating a positional relationship between the subject and the position of the electronic device according to the position of the electronic device and the position of the subject. The electronic device is
A display control unit for sequentially displaying images based on image data sequentially generated by sequentially capturing images with the imaging unit on the display unit;
A specifying unit that specifies a position corresponding to the position of the subject within the angle of view by the imaging unit, based on the imaging direction by the imaging unit, the position of the electronic device, and the position of the subject;
The system according to claim 5, wherein the display control unit causes a marker indicating the position specified by the specifying unit to be superimposed on the image and displayed on the display unit. 7. When the electronic device captures an image at a guided position, the electronic device transmits image data and imaging information indicating an imaging position and an imaging direction to the server in association with information for identifying the electronic device. A system according to claim 1. The system according to claim 7, wherein the transmission unit transmits information indicating the position of the subject based on imaging information received from the electronic device to another electronic device. The imaging device further transmits imaging conditions at the time of imaging to the server,
The transmission unit further transmits information indicating the imaging condition received from the imaging device to the electronic device,
The system according to claim 4, wherein the electronic device presents the imaging condition based on information indicating the imaging condition received from the transmission unit to a user. The server
An acquisition unit that acquires information indicating an area designated by a user of the electronic device;
The said transmission part transmits the information which shows the position of the said object to the said electronic device, when the position of the said object is a position in the area | region acquired by the said acquisition part. The described system. The server
A user information acquisition unit that acquires information indicating another user designated by the user of the electronic device;
When the transmission unit has a subject that matches the subject condition received from the electronic device in the image data acquired from the imaging device used by the user acquired by the user information acquisition unit, the position of the subject The system as described in any one of Claim 1 to 10 which transmits the information which shows this to the said electronic device. Imaging information including image data generated by imaging with the imaging device, information indicating the position of the imaging device at the time of imaging, and information indicating the imaging direction of the imaging device at the time of imaging is received from the imaging device. A data receiver;
When there is image data including a subject that meets a subject condition received from an electronic device different from the imaging device among the image data received by the data receiving unit, information indicating a geographical position where the subject exists is displayed. A server comprising: a transmission unit that transmits to an electronic device different from the imaging device. Imaging information including image data generated by imaging with the imaging device, information indicating the position of the imaging device at the time of imaging, and information indicating the imaging direction of the imaging device at the time of imaging is received from the imaging device. Receiving step;
When there is image data including a subject that matches a subject condition received from an electronic device different from the imaging device among the image data received in the reception step, information indicating a geographical position where the subject is present , A program for causing a computer to execute a transmission step of transmitting to an electronic device different from the imaging device. Image data generated by imaging with the imaging device and imaging information indicating the position of the imaging device at the time of imaging and the imaging direction of the imaging device at the time of imaging are received from the imaging device, and are different from the imaging device A receiver that receives information about the subject from the electronic device;
A detection unit that detects a subject related to information about the subject received by the reception unit from the image data;
A server comprising: a transmission unit that transmits information indicating a geographical position where the subject detected by the detection unit exists , identified from the imaging information received by the reception unit, to an electronic device different from the imaging device.

Images