JP2014033392A - Electronic apparatus, method, and program for calculating height of subject - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem associated with a conventional method for measuring a height of a subject from a photographed image in which, when a person is photographed from obliquely above for example, an actual head-top area of the person to be a subject may not be captured in an image due to a thickness of the head, thereby easily causing an error in the measurement, and the height may not be accurately measured due to the subject wearing a cap and a hair style of the subject.SOLUTION: An electronic apparatus is held by a user to photograph a subject, and includes a first imaging unit that photographs the subject, and a calculation unit that calculates a relative height of the subject to the user on the basis of a first image obtained by photographing the subject.

Description

  The present invention relates to an electronic device, a method, and a program for calculating the height of a subject.

  Conventionally, a method for measuring the height of a subject from a captured image has been proposed (for example, Patent Document 1). However, according to Patent Document 1, there is a problem that the head and feet of a person who is a subject must be photographed, and the height of the subject cannot be measured from a photograph in which the feet are not photographed. Furthermore, in Patent Document 1, it is necessary to match the shooting range of the camera to the position of the head of the person who is the subject. For example, when a person is taken from above, the actual person who is the subject depends on the thickness of the head. In some cases, the top of the head could not be included in the image, and the measurement was likely to contain errors. In addition, there is a problem that the height cannot be measured correctly depending on the wearing of the subject hat and the hairstyle.

Patent Document 2 describes a health management device that captures the face of a subject with a camera provided on a washstand and identifies the height of the subject based on the height of the camera. However, according to the device of Patent Document 2, it is not necessary to take a whole body image of a subject, but there is a problem in that the device cannot be carried and used, and convenience is poor.
[Patent Document 1] Japanese Patent No. 4374490 [Patent Document 2] Japanese Patent Laid-Open No. 11-197116

  This application makes it a subject to provide the electronic device, method, and program which solve such a conventional problem.

  In the first aspect of the present invention, an electronic device that is held by a user and images a subject, the first imaging unit that images the subject, and a first image obtained by imaging the subject. And an electronic device including a calculating unit that calculates a relative height of the subject with respect to the user.

  It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

1 is an external perspective view of an electronic device 10 according to a first embodiment. 1 shows a functional configuration of an electronic device 10 of the present embodiment. An outline of a method for calculating the height of a subject according to the present embodiment will be described. The image by the 1st imaging part 110 of this embodiment and the 2nd imaging part 120 is shown. 3 shows an overall flowchart for measuring the height of a subject according to the present embodiment. The flowchart of the detailed process of S200 of FIG. 5 which concerns on this embodiment is shown. The flowchart of the detailed process of S230 of FIG. 5 which concerns on this embodiment is shown. The external appearance perspective view of the electronic device 10 which concerns on 2nd Embodiment is shown. The outline | summary of the calibration which concerns on this embodiment is shown. The image in the calibration which concerns on this embodiment is shown. 6 shows a calibration processing flow for calculating a coefficient f according to the present embodiment. The external appearance perspective view of the electronic device 20 which concerns on 3rd Embodiment is shown. The external appearance perspective view of the electronic device 30 which concerns on 4th Embodiment is shown. The connection on the network of the electronic device 10 and another device is shown.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 is an external perspective view of an electronic device 10 according to the first embodiment. FIG. 1A is a perspective view of the electronic device 10 viewed from the subject side, and FIG. 1B is a perspective view of the electronic device 10 viewed from the user side. The electronic device 10 captures a subject held by the user and displays the captured image. In addition, the electronic device 10 calculates the height of the subject from the captured image.

  The electronic device 10 includes a housing 100, a first imaging unit 110, a second imaging unit 120, a display unit 130, a pair of illumination LEDs 142, a pair of sound collection units 144, and a pair of stereo speakers. 146, an operation switch 150, a grip 160, a battery 162, and a USB connector 164. The housing 100 is a horizontally long, substantially rectangular parallelepiped member that houses various sensors, control circuits, and the like inside the electronic device 10.

  The first imaging unit 110 is provided on one surface of the subject side of the housing 100 and images the subject. The first imaging unit 110 includes a left imaging unit 112, a right imaging unit 114, a left imaging unit 116, and a right imaging unit 118. The left imaging unit 112, the right imaging unit 114, the left imaging unit 116, and the right imaging unit 118 may be imaging units that obtain image data by causing a light beam to enter and form an image on an element such as a CCD or a CMOS. , Pixels having lateral 3000 pixels and lateral 2000 pixels may be provided.

  The left imaging unit 112 and the right imaging unit 114 constitute a pair of stereo cameras and image a subject. As a result, the first imaging unit 110 captures a pair of images from the left imaging unit 112 and the right imaging unit 114 and outputs a left-eye image and a right-eye image to obtain a stereoscopic image with parallax. In addition, the electronic device 10 can measure the distance from the first imaging unit 110 to the subject from the parallax amount of the stereoscopic image.

  Instead, the first imaging unit 110 may output the distance to the subject acquired by the autofocus mechanism or the distance measuring sensor when the subject is imaged. In this case, the first imaging unit 110 may include a single imaging unit instead of the plurality of imaging units.

  The left imaging unit 112 and the right imaging unit 114 are used when shooting a distant subject, for example, when the subject is separated from the first imaging unit 110 by 50 cm or more. The interval between the left imaging unit 112 and the right imaging unit 114 may be a value in the vicinity of 64 mm, which is the eye width distance (interval between the left eye and the right eye) of a human eye, and may be, for example, 50 mm to 70 mm. As a result, when a stereoscopic image captured by the left imaging unit 112 and the right imaging unit 114 is reproduced, it is possible to display a stereoscopic image that is close to the image during observation.

  The left imaging unit 116 and the right imaging unit 118 are arranged inside the left imaging unit 112 and the right imaging unit 114 to form a pair of stereo cameras, and image a subject. The first imaging unit 110 captures a pair of images from the left imaging unit 116 and the right imaging unit 118 and outputs a left-eye image and a right-eye image to obtain a stereoscopic image. The electronic device 10 can measure the distance from the first imaging unit 110 to the subject from the parallax amount of the stereoscopic image. Here, the left imaging unit 116 and the right imaging unit 118 are used when photographing a nearby subject, for example, when the subject is located less than 50 cm from the electronic device 10.

  Here, the interval between the left imaging unit 116 and the right imaging unit 118 is smaller than the interval between the left imaging unit 112 and the right imaging unit 114 and may be 5 mm to 50 mm. Accordingly, when a subject in the vicinity is photographed, it is possible to prevent the parallax of the stereoscopic image from becoming too large and resulting in an unnatural display.

  The second imaging unit 120 is provided on one surface of the housing 100 on the user side, and images the user. The second imaging unit 120 includes a left imaging unit 122 and a right imaging unit 124. The left imaging unit 122 and the right imaging unit 124 may be imaging means for obtaining image data by causing a light beam to enter and form an image on an element such as a CCD or a CMOS. You can do it.

  The left imaging unit 122 and the right imaging unit 124 constitute a pair of stereo cameras and image the user. The second imaging unit 120 simultaneously captures a pair of images from the left imaging unit 122 and the right imaging unit 124 and outputs a left-eye image and a right-eye image to obtain a stereoscopic image with parallax. By observing the image, the user can confirm his / her own image as if he / she looked at the mirror. Further, the electronic device 10 can measure and output the distance from the second imaging unit 120 to the user from the parallax amount of the stereoscopic image.

  As an example, the interval between the left imaging unit 122 and the right imaging unit 124 is set to 32 mm, which is a standard eye width distance and / or half the interval between the left imaging unit 112 and the right imaging unit 114. Thereby, the convergence angle when the user observes the image captured by the left imaging unit 122 and the right imaging unit 124 with the electronic device 10 is made equal to the convergence angle when the user observes his / her face with a mirror. The user can display his / her face on the electronic device 10 in the same manner as when the user looks in the mirror.

  The display unit 130 is a display device such as a liquid crystal display device (LCD) or an organic EL display device, and may be provided on one surface of the housing 100 on the user side. The display unit 130 displays an image for planar view or stereoscopic view. The display unit 130 may have a lenticular lens affixed to the surface, thereby displaying a right-eye image and a left-eye image having parallax with respect to the user's right eye and left eye.

  The display unit 130 may display the stereoscopic image captured by the first imaging unit 110 and the stereoscopic image captured by the second imaging unit 120. In addition, the display unit 130 may be provided with a transparent touch panel 132 on the surface thereof, thereby enabling various operations of the electronic device 10 when the user touches with a finger or the like.

  The illumination LED 142 may be a pair of illuminations that are provided on one surface of the casing 100 on the subject side and irradiate the subject with light. The electronic device 10 may include another illumination light source such as a xenon tube flashlight instead of the illumination LED 142. A single illumination LED 142 may be provided in the housing 100 instead of the pair of illumination LEDs 142.

  The sound collecting unit 144 is a pair of stereo microphones provided on one surface of the subject side of the housing 100 and collects sound of the subject. A single sound collection unit 144 may be provided in the housing 100 instead of the pair of sound collection units 144.

  The stereo speaker 146 may be a pair of speakers provided on one surface of the user side of the housing 100. Instead of the stereo speaker 146, a monaural speaker may be provided in the housing 100.

  The operation switch 150 is provided in any place of the electronic device 10 and inputs various operations of the user. The operation switch 150 is provided on the user side, the subject side, the upper surface, the lower surface, and / or the side surface of the housing 100, for example. The operation switch 150 may be provided on the grip 160. The operation switch 150 inputs an operation including ON / OFF of the power by the user.

  The grip 160 is a member for the user to hold the electronic device 10, and is, for example, a cylindrical member provided at the lower part of the housing 100. The battery 162 is a member that supplies power to the electronic device 10, and may be a rechargeable secondary battery such as a lithium ion battery and a nickel metal hydride battery, or a disposable primary battery. The battery 162 is, for example, a cylindrical member that is mounted inside the grip 160 as indicated by a broken line in FIG. Instead of this, the battery 162 may be mounted inside the housing 100.

  The USB connector 164 is a connection terminal of a USB (Universal Serial Bus) device, and is provided in the grip 160 and / or the housing 100. The USB connector 164 enables communication between the electronic device 10 and other devices. Further, the USB connector 164 may be connected to a power source to charge the battery 162.

  As described above, the electronic apparatus 10 can acquire an image obtained by photographing the subject with the first imaging unit 110 provided on the subject side, and can obtain an image obtained by photographing the user with the second imaging unit 120. Take.

  FIG. 2 shows an example of a functional configuration of the electronic device 10 of the present embodiment. The electronic device 10 includes the first imaging unit 110, the second imaging unit 120, the display unit 130, the touch panel 132, the illumination LED 142, the sound collecting unit 144, the stereo speaker 146, the operation switch 150, the battery 162, and the like described in FIG. In addition to the USB connector 164, the encoder 200, 3G / LTE communication circuit 202, GPS sensor 204, detection unit 208, direction sensor 210, memory 214, power circuit 216, decoder 221, display driver 222, speaker amplifier 224, processing unit 230 may be provided.

  The encoder 200 receives analog image signal outputs from the first imaging unit 110 and the second imaging unit 120, converts them into digital image data, and inputs the digital image data to the processing unit 230. The encoder 200 also converts the analog audio signal from the sound collection unit 144 into digital audio data and inputs the digital audio data to the processing unit 230. Furthermore, the encoder 200 receives a signal indicating the distance to the subject and / or the user from the first imaging unit 110 and / or the second imaging unit 120, converts this into digital data, and inputs the digital data to the processing unit 230. It's okay.

  The 3G / LTE communication circuit 202 is a communication circuit that performs mobile communication with other devices in accordance with 3G and LTE communication standards. The electronic device 10 may include a communication circuit that performs communication according to a communication standard other than 3G and LTE. The 3G / LTE communication circuit 202 receives transmission data to other devices from the processing unit 230 and supplies reception data from other devices to the processing unit 230.

  The GPS sensor 204 performs positioning detection using GPS (Global Positioning System). The GPS sensor 204 supplies information regarding the detected position of the electronic device 10 to the processing unit 230.

  The detection unit 208 is an acceleration sensor, for example, and detects the inclination of the electronic device 10 by measuring the gravity and the acceleration acting on the electronic device 10. In many cases, the detection unit 208 detects the posture of the electronic device 10 by measuring the direction of gravity. The detection unit 208 supplies the detected inclination of the electronic device 10 to the processing unit 230. The orientation sensor 210 detects the orientation (east, west, south, and north) of the electronic device 10 on the horizontal plane by detecting geomagnetism.

  The memory 214 stores image data and audio data, and records an operation program of the processing unit 230 and other necessary information.

  The power supply circuit 216 is connected to the battery 162, supplies necessary power to each circuit of the electronic device 10, and controls ON / OFF of the power supply of the electronic device 10.

  The decoder 221 decodes the input image data, converts it into an analog video signal, and outputs it to the display driver 222. The decoder 221 decodes the input audio data, converts it into an analog audio signal, and outputs the analog audio signal to the speaker amplifier 224.

  The display driver 222 generates a pulse for driving the display unit 130 based on the analog video signal from the decoder 221 and causes the display unit 130 to display an image. The speaker amplifier 224 amplifies the analog audio signal from the decoder 221 and outputs it to the stereo speaker 146.

  The processing unit 230 includes a CPU and the like and controls the electronic device 10. The processing unit 230 receives the image data of the subject and the user, the collected sound data, and the distance data of the subject and / or the user from the encoder 200. The processing unit 230 outputs image data to be displayed on the display unit 130 and audio data to be output to the stereo speaker 146 to the decoder 221. The processing unit 230 receives user operation information from the touch panel 132 and the operation switch 150. The processing unit 230 transmits / receives data to / from the USB connector 164, the 3G / LTE communication circuit 202, and the memory 214. Further, the processing unit 230 receives various data from the GPS sensor 204, the detection unit 208, and the direction sensor 210. Further, the processing unit 230 controls the output of the lighting LED 142 and the supply of power from the power supply circuit 216.

  The processing unit 230 includes a calculation unit 232 that executes a function related to the calculation of the height of the subject, and an adjustment unit 234.

  The calculation unit 232 calculates the relative height of the subject with respect to the user based on the first image and the second image that are obtained by capturing the subject and the user while being held by the user. For example, the calculation unit 232 may determine the relative height of the subject with respect to the height at which the first imaging unit 110 is located and the height at which the second imaging unit 120 is located based on the first image and the second image. The relative height is calculated, and the relative height of the subject with respect to the user is calculated based on the calculated height and the relative height of the second imaging unit 120 with respect to the first imaging unit 110. It's okay.

  As an example, the calculation unit 232 calculates the sum of the relative height of the user with respect to the height at which the second imaging unit 120 is located and the relative height of the second imaging unit 120 with respect to the first imaging unit 110. The relative height of the subject relative to the user can be calculated by subtracting from the relative height of the subject relative to the height at which one imaging unit 110 is located. Furthermore, the calculation unit 232 may calculate the height of the subject based on the physical characteristics of the user. For example, the calculation unit 232 may calculate the height of the subject by adding the relative height of the subject to the user to the height of the user.

  More specifically, the calculation unit 232 analyzes the first image in which a part of the subject is captured, and specifies the position of the specific part of the subject in the first image. The specific part of the subject may be a place that can be specified by analyzing the image of the subject, and may be, for example, one or both eyes of the subject. Next, the calculation unit 232 calculates the distance from the first imaging unit 110 to the specific part by analyzing the parallax amount of the specific part of the subject in the first image. Then, the calculation unit 232 determines the position at which the specific part of the subject in the first image is imaged, the distance from the first imaging unit 110 to the specific part of the subject, and the inclination of the electronic device 10 received from the detection unit 208. Based on this, the relative height of the subject with respect to the height at which the first imaging unit 110 is located is calculated.

  Similarly, the calculation unit 232 analyzes the second image obtained by capturing a part of the user, and specifies the position of the specific part of the user in the second image. The specific part of the user may be a place that can be specified by analyzing the user's image, and may be, for example, one or both eyes of the user. Next, the calculation unit 232 calculates the distance from the second imaging unit 120 to the specific part by analyzing the parallax amount of the specific part of the user in the second image. Then, the calculation unit 232 is based on the position of the specific part of the user in the second image, the distance from the second imaging unit 120 to the specific part of the user, and the inclination of the electronic device 10 received from the detection unit 208. Thus, the height of the user relative to the height at which the second imaging unit 120 is located is calculated.

  Furthermore, the calculation unit 232 may calculate the height of the subject based on a preset adjustment amount α. Thereby, the electronic device 10 can cancel a measurement error or the like and calculate a more accurate subject height.

  The adjustment unit 234 calculates an adjustment amount α of the subject height. The adjustment amount α may be a value for correcting a measurement error or the like unique to the electronic device 10. For example, the adjustment unit 234 may calculate the adjustment amount α based on the third image obtained by imaging the user's appearance reflected in the mirror.

  As described above, according to FIG. 2, the calculation unit 232 acquires the stereoscopic image of the subject and the user from the first imaging unit and the second imaging unit, and acquires the tilt of the electronic device 10 from the detection unit 208. Then, the calculation unit 232 calculates the relative height of the subject with respect to the user from these acquired images and inclination.

  FIG. 3 shows an overview of the subject height calculation method according to the present embodiment. In the figure, the suffix o indicates the subject, y indicates the user, and c indicates the camera. The prefix S is standard, d is a difference value, T is height, and H is height. Ho represents the reference horizontal plane where the first imaging unit 110 is located, and Hy represents the reference horizontal plane where the second imaging unit 120 is located.

As shown in FIG. 3, the relative height dH of the subject 2 with respect to the user 1 is the relative height dHo of the subject 2 with respect to the first imaging unit 110 and the second imaging unit with respect to the first imaging unit 110. Based on the relative height dHc of 120 and the relative height dHy of the user 1 with respect to the second imaging unit 120, the following calculation (1) is performed.
dH = dHy + dHc-dHo (1)

Further, the height of the subject 2 from the ground, that is, the height of the subject 2 is calculated from the following equation (2) based on the height Ty of the known user 1.
To = Ty−dH (2)

The relative height dHo of the subject 2 with respect to the first imaging unit 110 is the height sHo of the subject 2 with respect to the specific part of the subject 2 and the height of the first imaging unit 110 with respect to the specific part (for example, the eye) of the subject 2. Based on dIo, it is calculated from the following equation (3).
dHo = sHo−dIo (3)
The height sHo of the subject 2 with respect to a specific part of the subject 2 can be obtained, for example, by previously recording statistical data values in the memory 214 or the like.

The height dIo of the first imaging unit 110 with respect to the specific part of the subject 2 connects the specific part of the subject 2 and the first imaging unit 110 from the distance Do from the first imaging unit 110 to the specific part and the reference horizontal plane Ho. Based on the angle θo to the straight line Io, it is calculated from the following mathematical formula (4).
dIo = Do × sin θo (4)

  The distance Do from the first imaging unit 110 to the specific part can be calculated from the parallax amount of the specific part of the subject 2 in the first image, which is a stereoscopic image, based on a principle such as triangulation.

The angle θo is calculated from the following equation (5) based on the inclination θc of the electronic device 10 and the angle θco between the bisector Co and the straight line Io of the vertical field angle of the first imaging unit 110.
θo = θc−θco (5)

  A value detected by the detection unit 208 is used as the inclination angle θc. In FIG. 3, the electronic device 10 is tilted so that the back side is low as viewed from the user 1, and the angle θc is positive. Note that when the electronic device 10 is tilted so that the front side is low as viewed from the user 1, the tilt angle θc is a negative value.

  The angle θco is calculated from the position where the specific part of the subject 2 in the first image is imaged. For example, in FIG. 4A, the angle θco is obtained by measuring the number of pixels Pio from the display bisector that overlaps the bisector Co and equally divides the first image in the vertical direction to the specific part of the subject 2. . In addition, when the specific part of the subject 2 is located below the display bisector of the first image, the pixel number Pio is a negative value.

For example, the angle θco is calculated from the following equation (6) based on the number of pixels Pz1 in the vertical direction of the first image and the vertical field angle θv1 of the first imaging unit 110.
θco = θv1 × Pio / Pz1 (6)

  The angle θco may be calculated from one of the left image and the right image constituting the first image, or may be an average of values calculated from both the left image and the right image. As described above, the electronic device 10 can calculate dHo by the equations (3) to (6).

The relative height dHy of the user 1 with respect to the second imaging unit 120 is the height sHy of the user 1 with respect to the specific part of the user 1 and the specific part of the user 1 with respect to the height of the second imaging part 120 ( For example, it is calculated from the following formula (7) based on the eye height dIy.
dHy = sHy + dIy (7)
Statistical data can be used for the height sHy of the user 1 with respect to the specific part of the user 1 as in the case of sHo.

The height dIy of the specific part of the user 1 with respect to the second imaging unit 120 is the distance Dy from the second imaging part 120 to the specific part and the specific part of the second imaging unit 120 and the user 1 from the reference horizontal plane Hy. Is calculated from the following formula (8) based on the angle θy to the straight line Iy that connects.
dIy = Dy × sin θy (8)

  Similar to the distance Do, the distance Dy from the second imaging unit 120 to the specific part can be calculated from the parallax amount of the specific part of the user 1 in the second image that is a stereoscopic image.

The angle θy from the reference horizontal plane Hy to the straight line Iy is based on the inclination θc of the electronic device 10 and the angle θcy from the bisector Cy of the vertical direction angle of view of the second imaging unit 120 to the straight line Iy. Calculated from (9).
θy = θc + θcy (9)

  The angle θcy is calculated from the position where the specific part of the user 1 in the second image is imaged. For example, in the second image shown in FIG. 4B, the number of pixels Piy from the display bisector that overlaps the bisector Cy and equally divides the second image in the vertical direction to the specific part of the user 1 is measured. Thus, the angle θcy is obtained in the same manner as the angle θco. In addition, when the specific part of the user 1 is located below the display bisector of the second image, the pixel number Piy is a negative value.

For example, the angle θcy is calculated from the following equation (10) based on the number of pixels Pz2 in the vertical direction of the second image and the vertical field angle θv2 of the second imaging unit 120.
θcy = θv2 × Piy / Pz2 (10)

  The angle θcy may be calculated from one of the left image and the right image constituting the second image, or may be an average of values calculated from both the left image and the right image. In this way, dHy can be calculated by the equations (7) to (10).

The relative height dHc of the second imaging unit 120 with respect to the first imaging unit 110 is calculated from the height Zc of the second imaging unit 120 with respect to the first imaging unit 110 and the inclination θc of the electronic device 10 by the following formula ( 11).
dHc = Zc × cos θc (11)

When considering the thickness of the electronic device 10, the following equation (11) is used instead of the equation (11) from the distance Xc between the first imaging unit 110 and the second imaging unit 120 in the thickness direction of the electronic device 10. DHc can be calculated based on ').
dHc = Zc × cos θc + Xc × sin θc (11 ′)

  Thus, according to the present embodiment, from the first image in which the specific part of the subject 2 is imaged, the second image in which the specific part of the user 1 is imaged, and the inclination of the electronic device, the equations (1) to (1) to Based on (11), the height of the subject 2 can be calculated. Thereby, the electronic device 10 can calculate the height of the subject 2 without imaging the whole body from the top of the subject 2 to the feet.

  In addition, according to the present embodiment, the electronic device 10 can calculate the height of the subject 2 without being affected by the hairstyle, the hat, etc. of the subject 2. Furthermore, according to the present embodiment, the electronic device 10 estimates the height of the subject using the height of the user 1 who is the photographer as a reference value, and thus the user 1 needs to bring other reference mechanical elements. The height of the subject 2 can be measured by a very lightweight system.

  5 to 7 show flowcharts for measuring the height of the subject according to the present embodiment. FIG. 5 shows an overall flowchart. When calculating the height of the subject, the electronic device 10 executes the processing from steps S100 to S230 in FIG.

  First, in S100, the processing unit 230 causes the display unit 130 to display a message that prompts the user 1 to input height Ty, nationality, age, and gender. The electronic device 10 may execute this process at the initial setting stage when the user 1 uses it for the first time, but it is not necessary to execute it every time. Data input from the user is stored in the memory 214.

  Next, in S110, the electronic device 10 advances the process to S140 if the height Ty of the user 1 is input (Y), and advances the process to S120 if there is no input of the height Ty. .

  In S <b> 120, the electronic device 10 photographs the user 1 with the second imaging unit 120. Next, in S <b> 130, the electronic device 10 extracts the facial features of the user 1 from the photographed image, and if the gender, age and / or race information of the user 1 is not acquired in S <b> 100, The gender, age, and / or race of the user 1 are estimated by a known technique. Then, the electronic device 10 estimates the height Ty of the user 1 based on the gender, age and / or race information of the user 1 input or estimated by the user 1.

  In S140, the electronic device 10 displays a confirmation message on the display unit 130 as to whether or not to execute calibration. When the electronic device 10 receives an instruction to execute calibration from the user 1 via the touch panel 132 or the like, the electronic device 10 proceeds to S230. If the user 1 does not want calibration in S140, the electronic device 10 proceeds to S160.

  The electronic device 10 may perform this calibration once, and may execute S160 without executing S140 when the flow is executed after the second time. In this case, in the setting mode or the like, the electronic device 10 may proceed to S230 in order to execute calibration when receiving a separate instruction from the user 1.

  In step S <b> 160, the electronic device 10 does not perform processing until the user 1 inputs an instruction to shoot the subject 2 via the touch panel 132 or the operation switch 150. When the electronic device 10 receives a shooting instruction from the user 1, the process proceeds to S170.

  In S <b> 170, the electronic device 10 images the subject 2 using the left imaging unit 112 and the right imaging unit 114 of the first imaging unit 110. When the distance between the subject 2 and the first imaging unit 110 is determined to be approximately 50 cm or less by an autofocus mechanism or the like, the interval is further increased for the purpose of obtaining a stereoscopic image having an appropriate stereoscopic effect. The subject 2 is imaged by the narrow left imaging unit 116 and right imaging unit 118. In the present embodiment, the case where the subject 2 is imaged by the left imaging unit 112 and the right imaging unit 114 will be described. Data of the captured stereoscopic image of the subject 2 is transmitted from the first imaging unit 110 to the processing unit 230 via the encoder 200.

  Next, in S <b> 180, the electronic device 10 images the user 1 with the second imaging unit 120. Since the user 1 is observing the subject 2 displayed on the display unit 130, the second imaging unit 120 can capture the user 1 in the shooting range. Data of the captured stereoscopic image of the user 1 is transferred from the second imaging unit 120 to the processing unit 230 via the encoder 200. Note that S170 and S180 may be executed simultaneously.

  Next, in S190, the processing unit 230 determines whether or not the subject 2 imaged by the first imaging unit 110 is a person. If the subject 2 is not a person, there is no meaning for measuring the height, and the series of sequences is terminated. If the subject 2 is a person, the process proceeds to S200. Note that the processing unit 230 captures the specific part of the subject 2 when the subject 2 is a person but the captured image of the subject 2 does not include a predetermined specific part such as an eye. A message prompting the user may be displayed on the display unit 130, and the process may return to S160.

  Next, in S <b> 200, the electronic device 10 calculates the height To of the subject 2 by the calculation unit 232. In step S <b> 210, the electronic device 10 displays the calculated height To of the subject 2 and the shooting date on the display unit 130. For example, as shown in FIG. 4A, the display unit 130 may display the height To and the shooting date of the subject 2 together with the first image of the taken subject 2.

  Next, in S <b> 220, the electronic device 10 may record the calculated height To of the subject 2, the shooting date and the image of the shot subject 2 in the memory 214.

  When the user 1 desires the calibration mode in S140, in S230, the electronic device 10 calibrates the adjustment amount α, and proceeds to S160 after the calibration is completed. The electronic device 10 does not have to display the calibration mode confirmation screen after the calibration is executed unless the user instructs the execution of the calibration through a menu operation of the electronic device 10 or the like.

  FIG. 6 shows a flowchart of detailed processing in S200 of FIG. In S200, the electronic device 10 executes the processes from Steps S2002 to S2022 in FIG.

  First, in S2002, the detection unit 208 measures the tilt angle θc of the electronic device 10 and inputs information on the measured tilt angle θc to the processing unit 230.

  Next, in S2004, the calculation unit 232 of the processing unit 230 calculates the parallax amount of the specific part of the subject 2 from the first image that is the received stereoscopic image of the subject 2, and performs the first imaging from the parallax amount. A distance Do from the unit 110 to the eye that is the specific part is calculated. For example, the calculation unit 232 can calculate the distance Do from the parallax amount of the eye of the subject 2 based on the principle of triangulation. Instead of this, the calculation unit 232 may calculate the distance Do from the parallax amount of the eye by using a lookup table or the like that records the parallax amount of the object in the stereoscopic image and the distance to the object in association with each other.

  The electronic device 10 measures the distance Do to the subject 2 by detecting the lens movement position when the first imaging unit 110 performs autofocusing instead of using the parallax of the stereoscopic image. Alternatively, the distance Do to the subject 2 may be measured by a separately provided distance measuring sensor. In this case, instead of omitting S2004, the processing unit 230 may receive information regarding the distance Do of the subject 2 together with the image data of the subject 2 from the autofocus mechanism or the distance measuring sensor in S170.

  Next, in S2006, the calculation unit 232 measures the number of pixels Pio in the vertical direction from the display bisector that equally divides the first image obtained by photographing the subject 2 to the specific part of the subject 2. The calculation unit 232 calculates the number of pixels Pio by calculating the number of pixels between the eye that is a specific part of the subject 2 and the display bisector, as shown in FIG. For example, in FIG. 4A, if the number of pixels between the display bisector and the eye of the subject 2 is 100, the number of pixels Pio = 100.

  The number of pixels Pio may be calculated from one of the left image and the right image constituting the first image, or may be an average of values calculated from both the left image and the right image. Further, for example, when the left and right eyes are at different pixel positions from the display bisector, the calculation unit 232 may determine one or the average of the left and right eyes as the pixel number Pio.

  Next, in S2008, the calculation unit 232 estimates the height sHo from the eye of the subject 2 to the top of the head. The height sHo from the eye of the subject 2 to the top of the head is obtained from the statistical data. For example, the height to the top of the head with respect to the human eye is an average value of 110 mm for men and an average value of 106 mm for women. This dimension is a numerical value that does not vary greatly with growth, although there are some individual differences. For example, the average of boys 7 years old is 111.6 mm, the average of 40-49 years old is 110.9 mm, and the average of 80-99 years old is 109 mm.

  Here, the calculation unit 232 determines the gender of the person of the subject 2 from the first image including the face of the subject 2 by a known image recognition technique. Then, the calculation unit 232 estimates the height sHo from the eye of the subject 2 to the top of the head based on this determination and statistical data. For example, the calculation unit 232 sets sHo = 110 mm when it is determined that the person of the subject 2 is a male, sets sHo = 106 mm when it is determined that the person is a female, and sets sHo as an intermediate value when the gender is unknown. = 108 mm.

  Here, in the first image, the calculation unit 232 may calculate sHo from the first image including the head of the subject 2 instead of using statistical data or the like. For example, when the contrast between the head of the subject 2 and the background is clear, the contour of the top of the subject 2 can be clearly detected, the back of the head of the subject 2 is not reflected, and the inclination θc is determined to be substantially zero. Alternatively, the calculation unit 232 may measure the number of pixels corresponding to sHo, as shown in FIG.

  For example, the calculation unit 232 divides the number of pixels by the number of pixels in the vertical direction of the first image (for example, 2000 pixels), and divides this by the vertical angle of view θv1 (for example, 60 degrees) of the first imaging unit 110. By multiplying, the angle formed by the first imaging unit 110, the top of the subject 2 and the specific part of the subject 2 may be calculated, and sHo may be calculated by multiplying the sine of the angle and the distance Do.

  Next, in S2010, the calculation unit 232 calculates the relative height dHo of the subject 2 with respect to the first imaging unit 110. Specifically, based on the number of pixels Pio, the calculation unit 232 changes from the equidivision line Co of the vertical field angle of the first imaging unit 110 to the straight line Io connecting the specific part of the subject 2 and the first imaging unit 110. The angle θco is calculated. For example, the calculation unit 232 divides the number of pixels Pio by the number of pixels in the vertical direction of the first image (for example, 2000 pixels) according to Equation (6), and divides this into the vertical field angle θv1 ( For example, a value obtained by multiplying by 60 degrees is obtained, and this is set as an angle θco.

  Next, the calculation unit 232 calculates the angle θo from the reference horizontal plane Ho including the first imaging unit 110 to the straight line Io by subtracting the angle θco from the inclination θc of the electronic device 10 according to Equation (5). . Next, the calculation unit 232 calculates the height dIo of the first imaging unit 110 with respect to the specific part of the subject 2 by multiplying the distance Do by sin θo according to Equation (4). Further, the calculation unit 232 calculates the relative height dHo of the subject 2 with respect to the first imaging unit 110 by subtracting dIo from the height sHo of the top of the subject 2 from the eye according to Equation (3). .

  Next, in S2012, the calculation unit 232 calculates the parallax amount of the specific part of the user 1 from the received second image that is the stereoscopic image of the user 1, and uses the second imaging unit 120 based on the parallax amount. The distance Dy from the eye to the eye as the specific part is calculated. The calculation unit 232 may obtain the distance Dy from the amount of parallax of the eyes, etc., by the same method as the calculation of the distance Do described in S2004.

  Next, in S2014, the calculation unit 232 measures the number of pixels Piy in the vertical direction from the display bisector that equally divides the second image obtained by capturing the user 1 to the specific part of the user 1. The calculation unit 232 calculates the number of pixels Piy by calculating the number of pixels between the eye that is the specific part of the user 1 and the display bisector, as shown in FIG. 4B.

  The pixel number Piy may be calculated from one of the left image and the right image constituting the second image, or may be an average of values calculated from both the left image and the right image. Further, for example, when the left and right eyes are at different pixel positions from the display bisector, one or the average value of the left and right eyes may be used as the pixel number Piy.

  Next, in S2016, the calculation unit 232 estimates the height sHy from the user's 1 eye to the top of the head. The calculation unit 232 estimates the height sHy based on the gender, age, and / or race data of the user 1 acquired in S100 or S130, and the statistical data.

  Next, in S2018, the calculation unit 232 calculates the relative height dHy of the user 1 with respect to the second imaging unit 120. Specifically, based on the number of pixels Piy, the calculation unit 232 defines a straight line Iy that connects the specific part of the user 1 and the second imaging unit 120 from the equal line Cy of the vertical field angle of the second imaging unit 120. The angle θcy to is calculated. For example, the calculation unit 232 divides the number of pixels Piy (for example, 120 pixels) by the number of pixels in the vertical direction of the second image (for example, 2000 pixels) as shown in Expression (10), and divides this by the vertical length of the second imaging unit 120. A value obtained by multiplying the directional angle of view θv2 (for example, 60 degrees) is obtained, and this value is set as an angle θcy.

  Next, the calculation unit 232 calculates the angle θy from the reference horizontal plane Hy including the second imaging unit 120 to the straight line Iy by adding the inclination θc and the angle θcy of the electronic device 10 according to Expression (9). To do. Next, the calculation unit 232 calculates the height dIy of the second imaging unit 120 with respect to the specific part of the user 1 by multiplying the distance Dy by sin θy according to Expression (8). Further, the calculating unit 232 adds the heights sHy and dIy of the crown from the user's 1 eye according to the equation (7), so that the relative height dHy of the user 1 with respect to the second imaging unit 120 is calculated. Is calculated.

  Next, in S2020, the height difference dH between the user 1 and the subject 2 is calculated. First, the calculation unit 232 multiplies cos θc by the height Zc of the second imaging unit 120 with respect to the first imaging unit 110 according to Equation (11), so that the relative height of the second imaging unit 120 with respect to the first imaging unit 110 is increased. DHc is calculated. When the thickness of the electronic device 10 is further taken into consideration, the calculation unit 232 multiplies the distance Xc in the thickness direction of the electronic device 10 between the first imaging unit 110 and the second imaging unit 120 by sin θc according to the equation (11 ′). The obtained value is added to calculate the height dHc.

  The calculation unit 232 obtains the relative height dH of the subject 2 with respect to the user 1 by adding dHy obtained in S2018 to this dHc and subtracting dHo obtained in S2010 from here according to the equation (1). The calculation unit 232 may add the adjustment amount α to dH obtained in this way. The adjustment amount α is 0 at the time of factory shipment, and may be adjusted in the calibration of S230.

  Next, in S2022, the calculation unit 232 calculates the height To of the subject by subtracting dH from the height Ty of the user 1 obtained in S100 or S130 according to Expression (2).

  FIG. 7 shows a flowchart of detailed processing in S230 of FIG. In S230, the electronic device 10 executes calibration by the processes from Steps S2302 to S2326 in FIG.

  In S2302, the display unit 130 displays the guidance so that the user 1 takes a picture of himself / herself reflected in the mirror.

  In step S <b> 2304, the electronic device 10 stands by until the user 1 instructs to perform shooting using the operation switch 150. Thereby, the electronic device 10 can prevent the first imaging unit 110 from capturing and calibrating an image of a third party other than the user reflected in the mirror, and more reliably by the image of the user 1 reflected in the mirror. Calibration can be performed. Upon receiving a shooting instruction from the user 1, the electronic device 10 advances the process to step S2306. If no instruction is received from the user 1 for a certain period of time, the electronic device 10 ends the process of S230 in FIG. 5 and advances the process to S160.

  In step S <b> 2306, the electronic device 10 captures the user 1 reflected in the mirror as the subject 2 by the left imaging unit 112 and the right imaging unit 114 of the first imaging unit 110 or the left imaging unit 116 and the right imaging unit 118. To do. Data of the captured stereoscopic image of the subject 2 is transmitted to the processing unit 230 via the encoder 200.

  Next, in S <b> 2308, the electronic device 10 directly images the user 1 by the second imaging unit 120. Data of the captured stereoscopic image of the user 1 meets the encoder 200 and is passed to the processing unit 230. Note that S2306 and S2308 may be executed simultaneously.

  In step S <b> 2310, the detection unit 208 measures the tilt angle θc of the electronic device 10 and inputs information on the measured tilt angle θc to the processing unit 230.

  Next, in S2312, the calculation unit 232 of the processing unit 230 calculates the parallax amount of the specific part of the subject 2 from the first image that is the received stereoscopic image, and from the first imaging unit 110 based on the parallax amount. A distance Do to the eye which is the specific part is calculated. The calculation unit 232 may calculate the distance Do by the same method as in S2004. The calculated distance Do is a distance from the first imaging unit 110 to the image of the specific part of the user 1 reflected in the mirror.

  Next, in S2314, the calculation unit 232 counts the number of pixels in the vertical direction from the display bisector that equally divides the first image obtained by photographing the subject 2 to the specific part of the subject 2 that is a mirror image of the user 1. Pio is measured. The calculation unit 232 may measure the number of pixels Pio using the same method as in S2006.

  Next, in S <b> 2316, the calculation unit 232 calculates the relative height dHo of the subject 2 with respect to the first imaging unit 110. The calculation unit 232 may calculate sHo by a method similar to S2008 or S2016, and then calculate dHo by a method similar to S2010.

  Next, in S2318, the calculation unit 232 detects the distance Dy between the user 1 and the second imaging unit 120. The calculation unit 232 may detect the distance Dy by the same method as in S2012.

  Next, in S2320, the calculation unit 232 measures the number of pixels Piy in the vertical direction from the display bisector to the specific part of the user 1. The calculation unit 232 may measure the pixel number Piy by the same method as in S2014.

  Next, in S2322, the calculation unit 232 calculates the relative height dHy of the user 1 with respect to the second imaging unit 120. The calculating unit 232 may use the same value as sHo obtained in S2316 as sHy and calculate the height dHy in the same manner as in S2018.

Next, in S2324, the adjustment unit 234 calculates dHc by the same method as in S2020, and calculates the adjustment amount α according to Expression (13) so that the height difference dH is 0 in Expression (12) below.
dH = dHy + dHc−dHo + α (12)
α = dHo−dHy−dHc (13)

  Since the target imaged by the first imaging unit 110 as the subject 2 is the user 1 himself / herself reflected in the mirror, the height difference dH between the user 1 and the subject 2 should be 0 when α = 0 originally. It is. When α does not become 0, it may be due to a measurement error of the distance Do / Dy by the first imaging unit 110 and / or the second imaging unit 120 and / or a measurement error of the inclination θc by the detection unit 208, or the like. Next, in S2326, the adjustment unit 234 records the calculated adjustment amount α in the memory 214 or the like.

  Thus, the electronic device 10 executes the calibration mode in S230 and measures the height of the user 1 himself / herself reflected in the mirror. Then, the adjustment amount α is determined so that the height difference dH between the user 1 and the user 1 who has moved to the mirror becomes zero. Thereby, the electronic device 10 can reduce a measurement error by a simple method using a mirror.

  FIG. 8 is an external perspective view of the electronic device 10 according to the second embodiment. In the electronic apparatus 10 according to the present embodiment, the second imaging unit 120 is configured from a single imaging unit. For example, the electronic device 10 may be a smartphone or the like provided with a single second imaging unit 120 on the back surface, and the distance from the user 1 is measured by the single second imaging unit 120. Here, the imaging unit provided on the back surface of the smartphone or the like is set to so-called pan focus, and it may be difficult to directly measure the distance to the user 1.

  Therefore, the calculation unit 232 according to the present embodiment images a part of the body of the user 1 with the single second imaging unit 120, and performs the second imaging based on the size of the part of the body in the captured image. The distance between the unit 120 and the user 1 is calculated. A part of the body is a part of a face of a certain size whose position can be specified from the image of the user 1, for example, two eyes of the user 1, a nostril, both ends of the mouth, and the like.

  Based on the distance to the user 1 calculated in this way, the position of the specific part of the user 1 in the second image, the inclination of the electronic device 10, and the like, the calculation unit 232, as in the first embodiment, The relative height of the user 1 with respect to the height at which the second imaging unit 120 is located is calculated.

  Here, since the size of the part of the body may differ depending on the person, it may not be possible to measure the distance to the user 1 from the image of the part of the body of the user 1. Therefore, the electronic device 10 of the present embodiment captures an object whose height is known in the calibration mode (for example, a mark on the floor having a height of 0) and the body of the user 1 in the captured image data. A coefficient f indicating the relationship between the partial size and the distance between the user and the second imaging unit 120 is calculated.

  Specifically, the adjustment unit 234 captures the fourth image captured by the first image capturing unit 110 and the second image capturing unit 120, in which an object located at a known height is captured, and the fifth image in which the user is captured. Based on the image, the coefficient f for calculating the distance from the size of the user 1 imaged by the second imaging unit to the user 1 is adjusted.

  After calibration, the calculation unit 232 determines the distance to the user 1 based on the adjusted coefficient f and the size of a part of the body of the user 1 in the second image captured by the second imaging unit 120. Is calculated.

FIG. 9 shows an outline of calibration according to the present embodiment. As shown in FIG. 9, the distance Dy between the second imaging unit 120 and the eye of the user 1 is the height dIy of the specific part of the user 1 with respect to the second imaging unit 120 and the second imaging unit 120. Based on the angle θy from the included reference horizontal plane Hy to the straight line Iy connecting the second imaging unit 120 and the specific part of the user 1, it is calculated from the following equation (14).
Dy = dIy / sin θy (14)
Here, the angle θy is calculated from the following equation (15) based on the inclination θc of the electronic device 10 and the angle θcy from the bisector Cy of the vertical field angle of the second imaging unit 120 to the straight line Iy. The
θy = θc + θcy (15)

  A value detected by the detection unit 208 is used as the inclination angle θc. In FIG. 9, the electronic device 10 is tilted so that the back side is lower as viewed from the user 1, and the angle θc is positive. Note that when the electronic device 10 is tilted so that the front side is low as viewed from the user 1, the tilt angle θc is a negative value.

  The angle θcy is calculated from the position where the specific part of the user 1 in the fifth image is imaged. For example, in the fifth image shown in FIG. 10B, the number of pixels Piy from the display bisector that overlaps the bisector Cy and equally divides the fifth image in the vertical direction to the specific part of the user 1 is measured. Thus, the angle θcy is obtained. In the case shown in FIG. 10 (b), the specific part of the user 1 is located below the display bisector of the fifth image, so the number of pixels Piy has a negative value.

For example, the angle θcy is calculated from the following equation (16) based on the number of pixels Pz2 in the vertical direction of the fifth image and the vertical field angle θv2 of the second imaging unit 120.
θcy = θv2 × Pyy / Pz2 (16)

The height dIy of the specific part of the user 1 with respect to the second imaging unit 120 is the eye height Tiy of the user 1, the relative height dHc of the second imaging unit 120 with respect to the first imaging unit 110, and the first Based on the height Tc of one imaging unit 110, it is calculated from the following equation (17).
dIy = Tiy−dHc−Tc (17)

  The relative height dHc of the second imaging unit 120 with respect to the first imaging unit 110 can be calculated from Expression (10), Expression (11), and Expression (11 ′).

  Further, the eye height Tiy of the user 1 is calculated based on the distance sHy between the top of the user 1 and the eye obtained by the same method as in S2016 and the height Ty of the user 1.

Further, the height Tc of the first imaging unit 110 is calculated from the following equation (18) based on the distance Dm between the first imaging unit 110 and the mark 3 on the floor.
Tc = Dm × sin θc (18)

  The distance Dm between the first imaging unit 110 and the mark 3 on the floor can be calculated from the parallax amount of the mark 3 in the fourth image, which is a stereoscopic image, based on a principle such as triangulation. As shown in FIG. 10A, the display unit 130 displays guidance so as to photograph the mark 3 on the display 4 portion in the center of the fourth image. As described above, the distance Dy between the second imaging unit 120 and the eye of the user 1 is calculated from the equations (14) to (18).

A coefficient f between the eye distance Wy and the distance Dy of the user 1 in the fifth image shown in FIG. 10B is calculated from the following equation (19).
f = Dy / Wy (19)
The coefficient f is recorded in the memory 214 or the like.

The interval Wy is proportional to the distance Dy to the user 1 and decreases as the distance between the user 1 and the second imaging unit 120 increases. Accordingly, the distance Dy can be calculated as needed based on the following equation (20) based on the measured eye distance Wy of the user 1 and the recorded coefficient f.
Dy = f × Wy (20)

  Thus, according to the present embodiment, the distance between the second imaging unit 120 and the user 1 can be accurately determined even when the second imaging unit 120 of the electronic device 10 is configured by a single imaging unit. Can be calculated. Thereby, according to this embodiment, the highly convenient electronic device 10 can be provided similarly to the first embodiment.

  Here, a processing flow of the electronic apparatus 10 of the present embodiment will be described. In the present embodiment, the electronic device 10 can calculate the height of the subject 2 by executing the same processing as the processing flow of the first embodiment according to FIGS. Here, in S2012 in S200 related to the calculation of the height Ho of the subject 2, instead of the method of calculating the distance Dy from the user 1 based on the parallax or the like of the stereoscopic image, the calculation unit 232 of the present embodiment The distance Dy is calculated using the recorded coefficient f and the eye interval Wy in the second image.

  The electronic device 10 executes a processing flow related to calibration for calculating the coefficient f in this embodiment instead of or in addition to the processing of S230 related to the calibration of the first embodiment.

  FIG. 11 shows a processing flow of calibration according to the present embodiment for calculating the coefficient f. In S230, the electronic device 10 executes the processing from Steps S2352 to S2376 in FIG.

  In S2352, the display unit 130 displays an instruction to photograph a target such as a mark at the same height as the floor on which the user is standing at the center of the screen. The mark on the floor may be, for example, a flooring floor pattern, a tatami edge, or an exit indication. In the example shown in FIG. 10A, the user 1 is photographing the “Exit” mark on the floor.

  Here, when the user 1 selects a distant index, and the second imaging unit 120 and the eye have the same height, the value of sin (θc + θcy) approaches zero, and the calculation accuracy of Expression (14) decreases. . Therefore, in such a case, the electronic device 10 may display an announcement stating “Please select an index that is a little closer to your feet” on the display unit 130.

  In step S <b> 2354, the electronic device 10 stands by until the user 1 instructs to perform shooting using the operation switch 150. When the electronic device 10 receives a shooting instruction from the user 1, the processing proceeds to S2356. If the electronic device 10 does not receive an instruction from the user 1 for a certain period of time, the electronic device 10 may end the process of S230 of FIG. 5 and advance the process to S160.

  Next, in S2356, the electronic device 10 images the mark 3 on the floor by the left imaging unit 112 and the right imaging unit 114 or the left imaging unit 116 and the right imaging unit 118 of the first imaging unit 110. The captured stereoscopic image data of the mark 3 is transmitted to the processing unit 230 via the encoder 200.

  Next, in S <b> 2358, the electronic device 10 images the user 1 by the second imaging unit 120. Since the user 1 is observing the mark 3 displayed on the display unit 130, the second imaging unit 120 can capture the user 1 in the shooting range. The captured image data of the user 1 meets the encoder 200 and is transferred to the processing unit 230. Note that S2356 and S2358 may be executed simultaneously.

  Next, in S <b> 2360, the detection unit 208 measures the tilt angle θc of the electronic device 10 and inputs information on the measured tilt angle θc to the processing unit 230.

  Next, in S2362, the calculation unit 232 of the processing unit 230 calculates the parallax amount of the specific part of the mark from the received fourth image that is the stereoscopic image, and the mark from the first imaging unit 110 is calculated from the parallax amount. A distance Dm up to 3 is calculated. The calculation unit 232 may calculate the distance Dm by the same method as in S2004.

  Next, in S <b> 2364, the calculation unit 232 calculates the relative height Tc of the mark 3 with respect to the first imaging unit 110. The calculation unit 232 may calculate the height Tc by multiplying the distance Dm by sin θc according to the equation (18).

  Next, in S2366, the eye height dIy of the user 1 with respect to the second imaging unit 120 is calculated. Specifically, the calculation unit 232 first estimates the height sHy by the same method as in S2016, and subtracts the sHy from the acquired height 1 Ty of the user 1 acquired in S100 or S130, thereby obtaining the height Tiy. Is calculated. Next, the calculation unit 232 calculates dHc by the same method as in S2020.

  Here, the calculation unit 232 calculates the relative height dHc of the second imaging unit 120 with respect to the first imaging unit 110 and the height of the first imaging unit 110 from the eye height Tiy of the user 1 according to Expression (17). By reducing the length Tc, the eye height dIy of the user 1 relative to the second imaging unit 120 is calculated.

  Next, in S2368, the calculation unit 232 performs vertical pixels from the display bisector that equally divides the fifth image obtained by capturing the user 1 in the vertical direction to the eyes of the user 1 in the same manner as in S2014. The number Piy is measured.

  Next, in S <b> 2370, the calculation unit 232 calculates a distance Dy between the second imaging unit 120 and the eyes of the user 1. Specifically, the calculation unit 232 firstly follows a straight line Iy connecting the eye of the user 1 and the second imaging unit 120 from the equal line Cy of the vertical angle of view of the second imaging unit 120 according to Expression (16). The angle θcy to is calculated. Next, the calculation unit 232 adds the inclination angles θc and θcy according to the equation (15), and a straight line connecting the second imaging unit 120 and the eye of the user 1 from the reference horizontal plane Hy including the second imaging unit 120. An angle θy to Iy is calculated. Further, the calculation unit 232 calculates the distance Dy between the second imaging unit 120 and the user 1 eye by dividing dIy by sin θy according to the equation (14).

  Next, in S2372, the calculation unit 232 calculates the eye interval Wy of the user 1 in the fifth image. The interval Wy may be the number of pixels corresponding to the interval between the eyes of the user 1 in the fifth image, or may be an angle of view corresponding to the interval between the eyes of the user 1 in the fifth image instead. .

  Next, in S2374, the adjustment unit 234 calculates the relationship between the eye interval Wy and the distance Dy of the user 1. For example, the adjustment unit 234 may adjust the coefficient f of both by dividing the distance Dy by the interval Wy according to the equation (19).

  Next, in S2376, the adjustment unit 234 records and stores the coefficient f obtained in S2374 in the memory 214 or the like. Thereby, the electronic device 10 can measure the distance Wy between the eyes of the user 1 in S2012, and can obtain the distance Dy by multiplying the distance Wy by the coefficient f according to the equation (20).

  As described above, according to the present embodiment, the electronic device 10 performs calibration in advance using an object whose height is already known, such as a mark on the floor, and the distance between the eye 1 of the user 1 and the distance Dy. Record the coefficient f. Then, the electronic device 10 calculates the distance Dy between the eye of the user 1 and the electronic device 10 using the coefficient f. Thereby, the electronic device 10 can estimate the height of the subject 2 even when the electronic camera 10 is not provided.

  The electronic device 10 may be set with a coefficient f having a predetermined value at the time of shipment from the factory, and when the user 1 selects not to execute calibration in S140, the height of the subject 2 is measured using the value. You can do it.

  FIG. 12 is an external perspective view of the electronic device 20 according to the third embodiment. The electronic device 20 may have the same configuration as the electronic device 10 of the second embodiment except that the electronic device 20 includes the first imaging unit 110 and the output unit 170 that are configured by a single imaging unit. The output unit 170 is, for example, an optical finder or an electronic finder, and outputs a subject image that the user 1 observes while approaching the eyes during the imaging operation of the subject 2.

  The electronic device 20 can detect that the user is looking into the output unit 170 with a proximity sensor or the like provided in the vicinity of the output unit 170. The electronic device 20 can measure the height of the subject 2 by a process similar to the process flow described in FIGS. In the present embodiment, when the electronic device 20 determines that the user is looking into the output unit 170, the height of the second imaging unit with respect to the eyes of the user 1 can be set to zero.

  Therefore, the calculation unit 232 can measure the height of the subject 2 by calculating the relative height of the subject 2 with respect to the eye height of the user 1. For example, the calculation unit 232 can calculate the height of the subject 2 by omitting S2012, S2014, and S2018 in S200 of the processing flow and assuming Dy = 0, dIy = 0, and dHy = sHy.

  In addition, since the electronic device 20 may set Dy = 0, step S140 for shifting to the calibration mode and S230 that is a calibration sequence may be omitted.

  FIGS. 13A and 13B are external perspective views of the electronic device 30 according to the fourth embodiment. The electronic device 30 is a head mounted display (hereinafter referred to as HMD). FIG. 13A is an overall perspective view. FIG.13 (b) is the perspective view which looked at Fig.13 (a) from the opposite.

  Similar to the electronic device 20 of the third embodiment, the electronic device 30 of the present embodiment includes a first imaging unit 110, a second imaging unit 120, a display unit 130, a sound collecting unit 144, a stereo speaker 146, and an operation switch 150. Is provided. The electronic device 30 further includes a headband 180 for wearing on the user's 1 head. FIG. 13B shows a state in which the headband 180 is removed for explanation.

  In the present embodiment, the display unit 130 is disposed very close to the eyes of the user 1. Therefore, in order to make the user 1 observe the display unit 130 with certainty, the electronic device 30 may include a magnifying lens on the upper surface of the display unit 130.

  As in the third embodiment, the electronic device 30 omits S2012, S2014, and S2018, assuming that Dy = 0, dIy = 0, and dHy = sHy, and shifts to the calibration mode S140, and the calibration sequence S230 may be omitted.

  FIG. 14 shows connections on the network between the electronic device 10 and other devices. The electronic device 10 or the like is connected to the server 50, the server 60, and the personal computer 70 via a communication network 80 such as a local area network or the Internet. The electronic device 10 or the like may be connectable to the communication network 80 via the 3G / LTE communication circuit 202. The electronic device 10 or the like may transmit the measured height To of the subject 2, the shooting date, the subject image, and the like to the server 50 and / or 60 via the communication network 80. The electronic device 10 or the like may transmit the adjustment amount α and / or the coefficient f to the servers 50 and / or 60.

  The server 50 provides a cloud service and the like, and includes a storage device 52, a processing unit 54, and a communication interface 56. The server 50 receives the height To or the like of the subject 2 from the electronic device 10 or the like via the communication network 80 and the communication interface 56 and records this in the storage device 52. Further, the server 50 may receive the adjustment amount α and / or the coefficient f from the electronic device 10 or the like and record this in the storage device 52. The server 60 may have a configuration similar to that of the server 50.

  The server 50 accumulates the transition of the height of the subject 2 over time along with the image of the subject. As an example, the server 50 may identify the person of the subject by recognizing the face of the subject 2 and record the identified person and height data in association with each other. Accordingly, height data can be recorded in association with each person without the user selecting the person who is the subject. The data recorded in the server 50 may be viewable from the personal computer 70 via the communication network 80 by inputting a name that is a unique ID for the subject 2. The electronic device 10 or the like or the personal computer 70 has a function of comparing progress information such as the height of a subject recorded in the server 50 with progress information such as the height of another subject recorded in another server 60. It's okay.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior to”. It should be noted that the output can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.

  1 user, 2 subject, 3 mark, 4 display, 10 electronic device, 20 electronic device, 30 electronic device, 50 server, 60 server, 70 personal computer, 80 communication network, 100 housing, 110 first imaging unit, 112 Left imaging unit, 114 Right imaging unit, 116 Left imaging unit, 118 Right imaging unit, 120 Second imaging unit, 122 Left imaging unit, 124 Right imaging unit, 130 Display unit, 132 Touch panel, 142 LED for illumination, 144 Sound collection Part, 146 stereo speaker, 150 operation switch, 160 grip, 162 battery, 164 USB connector, 170 output part, 180 headband, 200 encoder, 202 3G / LTE communication circuit, 204 GPS sensor, 208 detection part, 210 direction sensor, 214 memories, 16 power supply circuit, 221 a decoder, 222 a display driver, 224 a speaker amplifier, 230 processing unit, 232 calculation unit, 234 adjustment section

Claims (14)

An electronic device that is held by a user and images a subject,
A first imaging unit that images a subject;
A calculation unit that calculates a relative height of the subject with respect to the user based on a first image obtained by imaging the subject;
Electronic equipment comprising.   The electronic device according to claim 1, wherein the calculation unit calculates the height of the subject based on the physical characteristics of the user.   The calculation unit is configured to determine a relative height of the subject with respect to a height at which the first imaging unit is located based on a position of a specific part of the subject in the first image in which a part of the subject is captured. The electronic device according to claim 1, wherein the electronic device is calculated.   The calculation unit calculates a relative height of the subject with respect to a height at which the first imaging unit is located based on a position where the eye of the subject is captured in the first image. The electronic device described. A detector that detects the inclination of the electronic device;
The calculation unit calculates a relative height of the subject with respect to a height at which the first imaging unit is located based on a position of the specific part of the subject in the first image and the inclination. The electronic device as described in. The first imaging unit images the subject and outputs a distance to the subject;
The calculation unit is configured to determine a relative position of the subject with respect to a height at which the first imaging unit is located based on a distance to the subject, a position where the specific part of the subject is captured in the first image, and the inclination. The electronic device according to claim 5, wherein the height is calculated. A second imaging unit for imaging the user;
The calculation unit is configured to determine a relative height of the subject with respect to the user based on the first image and the second image obtained by capturing the subject and the user by being held by the user. The electronic apparatus according to any one of claims 1 to 6.   The calculation unit is configured to determine a relative position of the user with respect to a height at which the second imaging unit is located based on a position of the specific part of the user in the second image in which a part of the user is captured. The electronic device according to claim 7, wherein a height is calculated.   The electronic device according to claim 7, further comprising an adjustment unit that calculates an adjustment amount of the height of the subject based on a third image obtained by imaging the user's appearance reflected in a mirror. The calculation unit includes:
Based on the size of a part of the user's body in the second image captured by the second imaging unit, a distance to the user is calculated,
Based on the distance to the user, the position of the specific part of the user in the second image, and the inclination of the electronic device, the relative of the user to the height at which the second imaging unit is located The electronic device according to claim 7 or 8, wherein a height is calculated.   The second imaging based on the fourth image captured by the first imaging unit and the second imaging unit, and the fifth image captured by the user and the fifth image captured by the user. The electronic apparatus according to claim 10, further comprising: an adjustment unit that adjusts a coefficient for calculating a distance from the size of the user imaged by the unit to the user. An output unit for outputting a subject image that the user observes close to an eye during an imaging operation of the subject;
The electronic apparatus according to claim 1, wherein the calculation unit calculates a relative height of the subject with respect to a height of the user's eyes. A first imaging step of imaging a subject with an electronic device held by a user;
A calculation step of calculating a relative height of the subject with respect to the user based on a first image obtained by imaging the subject.
A method for calculating the height of the subject. Computer
A first imaging unit that images a subject;
A calculation unit that calculates a relative height of the subject with respect to a user based on a first image obtained by imaging the subject;
A program that is held by the user and functions as an electronic device that images the subject.

Images