JP6851337B2 - Imaging device, control method and control program - Google Patents

Description

The present disclosure relates to an image pickup apparatus, a control method and a control program, and more particularly to an image pickup apparatus, a control method and a control program for detecting a predetermined detection target from an input image.

An imaging device is used that captures a magazine with a barcode, a meter that displays the amount of electricity used, etc. with an image generator such as a camera, and detects the detection target such as the barcode and the numerical value of the meter from the captured image. There is. In such an imaging device, when detecting a detection target, the imaging device is often brought close to the detection target for imaging.

As an example of such an imaging device, a mobile terminal device that displays an image obtained by an imaging means and recognizes a barcode of the captured image is disclosed (see Patent Document 1). When the camera reads an image for one frame and displays the image, this mobile terminal device displays a mark indicating the camera position on the LCD display unit directly behind the camera (the place directly opposite the camera opening) on the back of the main body. To do. For the user of the mobile terminal device, the mark serves as a guide when the camera is aligned with the code to be read, which is the subject, and the shooting becomes easy.

JP-A-2007-318775

When the position of the image generation unit as seen from the display unit side is located at a position other than the center of the display unit, the user can display the image generation unit simply by displaying the mark indicating the position of the image generation unit on the display unit. It may be difficult to find the detection target because it is not possible to determine which direction to point.

An object of the present invention is to make it easier for a user to find a detection target in an imaging device in which the position of the image generation unit as seen from the display unit side is located at a position other than the center of the display unit.

The image pickup apparatus according to one aspect of the present invention is arranged on one surface side of the main body and the main body, and is arranged on the other surface side of the main body and the image generation unit for generating the input image, and displays the input image. The position of the display unit, the detection unit that detects a predetermined detection target from the input image, and the image generation unit as seen from the display unit side when the detection unit does not detect the detection target even after the first predetermined time has elapsed. It has a display control unit to be displayed on the display unit, and the position of the image generation unit viewed from the display unit side is arranged at a position other than the center of the display unit, and the display control unit is a second unit longer than the first predetermined time. If the detection unit still does not detect the detection target even after the lapse of a predetermined time, the display unit displays the assumed position or direction of the detection target.

Further, the control method according to one aspect of the present invention is arranged on one surface side of the main body and the main body, and is arranged on the other surface side of the image generating unit for generating the input image and the input image. An image pickup device having a display unit for displaying a display unit and a detection unit for detecting a predetermined detection target from an input image, and the position of the image generation unit viewed from the display unit side is arranged at a position other than the center of the display unit. When the detection unit does not detect the detection target even after the first predetermined time elapses, the position of the image generation unit as seen from the display unit side is displayed on the display unit, which is longer than the first predetermined time. If the detection unit still does not detect the detection target even after the second predetermined time has elapsed, the display unit may display the assumed position or direction of the detection target.

Further, the control program according to one aspect of the present invention is arranged on one surface side of the main body and the main body, and is arranged on the other surface side of the image generation unit that generates the input image and the input image. An image pickup device having a display unit for displaying a display unit and a detection unit for detecting a predetermined detection target from an input image, and the position of the image generation unit viewed from the display unit side is arranged at a position other than the center of the display unit. If the detection unit does not detect the detection target even after the first predetermined time has elapsed, the position of the image generation unit as seen from the display unit side is displayed on the display unit, which is longer than the first predetermined time. If the detection unit still does not detect the detection target even after the second predetermined time has elapsed, the image pickup apparatus is made to display the assumed position or the assumed direction of the detection target on the display unit.

According to the present invention, the image pickup device, the control method, and the control program detect the user in the image pickup device in which the position of the image generation unit as seen from the display unit side is located at a position other than the center of the display unit. It can make it easier to find the target.

It is the schematic which shows an example of the scene assumed in the embodiment. It is a figure which shows an example of the schematic structure of the image pickup apparatus 1 according to an embodiment. It is a figure which shows the schematic structure of the storage part 16 and the CPU 17. It is a flowchart which shows the example of the operation of the whole processing. It is a figure which shows an example of the display screen for confirmation. It is a flowchart which shows the example of the operation of the display control processing. It is a figure which shows an example of the screen which includes the display image which emphasized the area detected by the detection part. It is a figure which shows an example of the position of the image generation part displayed on the display part. It is a figure which shows an example of the assumed position of a detection target. It is a figure which shows an example of the assumed direction of a detection target. It is a figure which shows an example of the display screen before enlargement. It is a figure which shows an example of the display screen after enlargement. It is a figure which shows an example of the display screen for warning. It is a figure which shows the schematic structure of the image pickup apparatus which concerns on other embodiment.

Hereinafter, the image processing apparatus according to one aspect of the present disclosure will be described with reference to the drawings. However, it should be noted that the technical scope of the present disclosure is not limited to those embodiments, but extends to the inventions described in the claims and their equivalents.

FIG. 1 is a schematic view showing an example of a scene assumed in the embodiment.

As shown in FIG. 1, the user of the image pickup device 1 is holding the image pickup device 1 and trying to take an image of the meter 2. The image pickup device 1 is a portable information processing device such as a tablet PC (Personal Computer), a multifunctional mobile phone (so-called smartphone), a personal digital assistant, or a notebook PC. The image pickup apparatus 1 includes a main body 10, an image generation unit 13, and a display unit 14.

The image generation unit 13 is arranged on one surface side of the main body 10 to generate an input image. The input image is digital image data captured and output by the meter 2 by the image generation unit 13. The image generation unit 13 includes an imaging optical system having a lens, an imaging sensor, and an A / D converter, as will be described later. The lens of the image generation unit 13 is arranged at a position other than the center a of the display unit 14 when viewed from the display unit 14, for example, a position diagonally above the center a (upper left side of the main body 10). In the following, the position of the image generation unit 13 means the position of the lens of the image generation unit 13. The display unit 14 is arranged on the other surface side of the main body 10 and displays an input image.

The meter 2 has a black housing 21, a white plate 22, and a meter portion 23. The plate 22 is arranged in the housing 21. The meter portion 23 is arranged on the plate 22 and displays a numerical value such as an electric energy measured by the meter 2.

Normally, the user aligns the image pickup apparatus 1 so that the second region 42 centered on the meter portion 23 is imaged in the input image. At this time, the user tends to align the image pickup apparatus 1 so that the center a of the display unit 14 of the image pickup apparatus 1 is aligned with the front surface of the meter portion 23.

However, the image generation unit 13 is arranged on the upper left side of the main body 10, and the center of the angle of view of the image generation unit 13 is on the upper left side of the meter portion 23. Therefore, the first region 41 deviated from the meter portion 23 is imaged, and in the input image, the meter portion 23 is not imaged in the center, and a part or all of the meter portion 23 may not be included. In particular, when the image pickup apparatus 1 and the meter portion 23 are close to each other, the meter portion 23 deviates from the angle of view of the image generation unit 13 and is not imaged as in the image displayed on the display unit 14 shown in FIG. There is. The point b is a point indicating a position corresponding to the center a of the display unit 14 in the coordinate system of the image generated by the image generation unit 13.

In such a scene, the image pickup apparatus according to the present embodiment can be used by the user in the image pickup apparatus 1 in which the position of the image generation unit 13 as seen from the display unit 14 side is arranged at a position other than the center of the display unit 14. On the other hand, it is intended to make it easier to find the meter portion 23 to be detected.

FIG. 2 is a diagram showing an example of a schematic configuration of the image pickup apparatus 1 according to the embodiment.

In addition to the image generation unit 13 and the display unit 14, the image pickup device 1 includes a communication unit 11, an input unit 12, an orientation detection unit 15, a storage unit 16, and a CPU (Central Processing Unit) 17. Hereinafter, each part of the image pickup apparatus 1 will be described in detail.

The communication unit 11 is a device having a communication interface circuit including an antenna whose sensitive band is mainly a 2.4 GHz band, a 5 GHz band, or the like. The communication unit 11 performs wireless communication with the access point or the like based on the wireless communication method of the IEEE (The Institute of Electrical and Electronics Engineers) 802.11 standard. Then, the communication unit 11 transmits / receives data to / from an external server device (not shown) via the access point. The communication unit 11 supplies the data received from the server device via the access point to the CPU 17, and transmits the data supplied from the CPU 17 to the server device via the access point. The communication unit 11 may be any device as long as it can communicate with an external device. For example, the communication unit 11 may communicate with the server device via a base station device (not shown) according to the mobile phone communication method, or may communicate with the server device according to the wired LAN communication method.

The input unit 12 is a device having a touch panel type input unit, an input device such as a keyboard and a mouse, and an interface circuit for acquiring a signal from the input device. The input unit 12 receives the input of the user and outputs a signal corresponding to the input of the user to the CPU 17.

The image generation unit 13 includes a reduction optical system type image sensor including an image pickup optical system having a lens, an image pickup element composed of CCDs (Charge Coupled Devices) arranged in one or two dimensions, and an A / D converter. It is a device having and. The image generation unit 13 sequentially shoots an image pickup target (meter) according to an instruction from the CPU 17 (for example, 30 frames / sec). The imaging optical system forms an image of an image to be imaged on an image sensor. The image pickup sensor generates an analog image signal from the imaged image and outputs it to the A / D converter. The A / D converter converts the output analog image signal into analog-digital, sequentially generates digital image data, and outputs the digital image data to the CPU 17. Instead of the CCD, a CIS (Contact Image Sensor) of the same magnification optical system type including an image sensor made of CMOS (Complementary Metal Oxide Semiconductor) may be used.

The display unit 14 is a display composed of a liquid crystal, organic EL (Electro-Luminescence), or the like, and a device having an interface circuit for outputting image data or various information to the display. The display unit 14 is connected to the CPU 17 and displays the image data output from the CPU 17 on the display. A touch panel display may be used to integrally configure the input unit 12 and the display unit 14, and in the present embodiment, a touch panel display in which the input unit 12 and the display unit 14 are integrally configured is used. ..

The orientation detection unit 15 has an acceleration sensor, detects the acceleration applied to the image pickup device 1 in each of the three axial directions in response to a request from the CPU 17, and detects the direction of the image pickup device 1 using the detected acceleration. It is a device that outputs to the CPU 17. The acceleration sensor can be, for example, a piezoresistive 3-axis acceleration sensor utilizing the piezoresistive effect, or a capacitance-type 3-axis acceleration sensor utilizing a change in capacitance.

The storage unit 16 is a device having a memory device such as a RAM (Random Access Memory) and a ROM (Read Only Memory), a fixed disk device such as a hard disk, or a portable storage unit such as a flexible disk and an optical disk. Further, the storage unit 16 stores computer programs, databases, tables, etc. used for various processes of the image pickup apparatus 1. The computer program may be installed from a computer-readable portable recording medium such as a CD-ROM (compact disk read only memory) or a DVD-ROM (digital versatile disk read only memory). The computer program is installed in the storage unit 16 using a known setup program or the like.

The CPU 17 operates based on a program stored in the storage unit 16 in advance. The CPU 17 may be a general-purpose processor. Instead of the CPU 17, a DSP (digital signal processor), an LSI (large scale integration), or the like may be used. Further, instead of the CPU 17, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array) or the like may be used.

The CPU 17 is connected to a communication unit 11, an input unit 12, an image generation unit 13, a display unit 14, an orientation detection unit 15, and a storage unit 16 and controls each of these units. The CPU 17 controls data transmission / reception via the communication unit 11, input control of the input unit 12, imaging control of the image generation unit 13, display control of the display unit 14, orientation detection control of the orientation detection unit 15, control of the storage unit 16, and the like. I do.

FIG. 3 is a diagram showing a schematic configuration of the storage unit 16 and the CPU 17.

As shown in FIG. 3, each program such as the image generation control program 161, the detection program 162, the display control program 163, and the input detection program 164 is stored in the storage unit 16. Each of these programs is a functional module implemented by software running on the processor. The CPU 17 reads each program stored in the storage unit 16 and operates according to each read program, thereby functioning as an image generation control unit 171, a detection unit 172, a display control unit 173, an input detection unit 174, and the like.

FIG. 4 is a flowchart showing an example of the operation of the entire processing by the image pickup apparatus 1.

Hereinafter, an example of the operation of the entire processing by the image pickup apparatus 1 will be described with reference to the flowchart shown in FIG. The operation flow described below is mainly executed by the CPU 17 in cooperation with each element of the image pickup apparatus 1 based on the program stored in the storage unit 16 in advance.

First, the input detection unit 174 receives a shooting start instruction when the user inputs a shooting start instruction instructing the start of shooting of the meter using the input unit 12, and receives a shooting start instruction signal from the input unit 12. (Step S11).

Next, when the input detection unit 174 receives the shooting start instruction, the display control unit 173 starts the measurement of the time t (step S12). The time t is an elapsed time from the start of the detection process of the predetermined detection target, and is used when executing the display control process described later.

Next, the image generation control unit 171 causes the image generation unit 13 to take a picture of the meter 2 and generate an input image for one frame (step S13).

Next, the detection unit 172 executes a meter portion detection process for detecting the meter portion from the input image (step S14).

First, the detection unit 172 detects the plate 22. The detection unit 172 is the difference between the brightness values or color values (R value, B value, G value) of the pixels on both sides of the pixels in the input image in the horizontal and vertical directions or a plurality of pixels separated from the pixels by a predetermined distance. When the absolute value exceeds the first threshold value, the pixel is extracted as an edge pixel. The detection unit 172 extracts straight lines passing in the vicinity of each extracted edge pixel by using a Hough transform, a least squares method, or the like, and consists of four straight lines in which two of the extracted straight lines are substantially orthogonal to each other. The largest rectangle among the rectangles to be formed is detected as the plate 22. Approximately orthogonal means that they intersect at an angle within ± 45 ° (45 ° or more and 135 ° or less) with respect to the right angle. Alternatively, the detection unit 172 determines whether or not each extracted edge pixel is connected to another edge pixel, and labels the connected edge pixels as one group. The detection unit 172 may detect the region surrounded by the group having the largest area among the extracted groups as the plate 22.

Next, the detection unit 172 detects the meter portion 23 from the detected area in the plate 22. The detection unit 172 detects the meter portion 23 by a discriminator pre-learned to output the position information of the meter portion 23 when an image showing the plate 22 including the meter portion 23 is input. This classifier is pre-learned using a plurality of images taken by the meter by, for example, deep learning, and is stored in the storage unit 16 in advance. The detection unit 172 detects the meter portion 23 by inputting an image including the detected plate 22 into the classifier and acquiring the position information output from the classifier. The detection unit 172 stores the coordinates of the position information in the storage unit 16.

The detection unit 172 may detect the meter portion 23 based on the edge pixels in the input image, as in the case of detecting the plate 22. The detection unit 172 extracts edge pixels from the region including the plate frame of the input image, extracts straight lines passing in the vicinity of each of the extracted edge pixels, and two of the extracted straight lines are substantially orthogonal to each other. Among the rectangles composed of the straight lines of the above, the largest rectangular area is detected as the meter portion 23. Alternatively, the detection unit 172 detects a rectangular region surrounded by the group having the largest area among the groups in which the extracted edge pixels are connected to each other as the meter portion 23.

Next, the detection unit 172 determines whether or not the meter portion 23 is detected in the input image (step S15). When the meter portion 23 is not detected, the display control unit 173 executes the display control process described later (step S21), and the CPU 17 returns the process to step S13.

On the other hand, when the meter portion 23 is detected, the detection unit 172 executes a character recognition process using a known OCR (Optical Character Recognition) technique in the region of the meter portion 23 (step S16), and is the recognition result. The number is temporarily stored in the storage unit 16. Next, the detection unit 172 determines whether or not the recognition result is appropriate, for example, whether or not the number has a preset number of digits (for example, 5 digits) (step S17). If the recognition result is not appropriate, the display control unit 173 executes the display control process described later (step S21), and the CPU 17 returns the process to step S13.

On the other hand, when the recognition result is appropriate, the display control unit 173 causes the display unit 14 to display a confirmation display screen including a confirmation display character string for confirming whether or not to register the recognition result ( Step S18).

FIG. 5 is a diagram showing an example of a confirmation display screen.

The display control unit 173 is composed of a five-digit number "35712" temporarily stored in the storage unit 16 by the detection unit 172 and a character string "Can I register?" Stored in the storage unit 16 in advance. Generates the constituent confirmation display character string 141 "Can I register 35712?". The display control unit 173 generates the confirmation display screen shown in FIG. 5 by superimposing the generated confirmation display character string 141 on the input image, and displays it on the display unit 14. Instead of superimposing the confirmation display character string 141 on the input image, the display control unit 173 displays the confirmation display screen in the area A for displaying the input image and the area B for displaying the confirmation display character string 141. The input image and the confirmation display character string 141 may be displayed on the display unit 14.

Next, the input detection unit 174 waits until a registration instruction instructing whether or not to register the recognition result is input by the user using the input unit 12. When the input detection unit 174 receives a registration instruction signal from the input unit 12 instructing the user to register the recognition result when the “yes” figure displayed on the display unit 14 is touched by the user (step S19). Y), the detection unit 172 stores the temporarily stored recognition result in the storage unit 16 as the final recognition result (step S20), and ends a series of processes. When the input detection unit 174 receives a registration instruction signal from the input unit 12 instructing that the recognition result is not registered because the “No” figure displayed on the display unit 14 is touched by the user (step S19). N), the CPU 17 returns the process to step S12. This completes the description of the operation using the flowchart.

FIG. 6 is a flowchart showing an example of the operation of the display control process. The display control process shown in FIG. 6 is executed in step S21 of FIG.

First, the display control unit 173 determines whether or not only a part of the meter portion 23 to be detected is detected based on the recognition result temporarily stored by the detection unit 172 in step S16 of FIG. (Step S31). When the number of digits of the number temporarily stored by the detection unit 172 in step S16 of FIG. 4 is less than the preset number of digits, the display control unit 173 determines that only a part of the meter portion 23 has been detected. ..

When at least a part of the meter part 23 is detected, that is, when only a part of the meter part 23 is detected, the display control unit 173 emphasizes the area specified by the coordinates stored by the detection unit 172 in step S14. The displayed display image is displayed on the display unit 14 (step S32), and a series of processes is completed.

FIG. 7 is a diagram showing an example of a screen including a display image in which a region detected by the detection unit is emphasized.

As shown in FIG. 7, the display control unit 173 determines the emphasized area so as to correspond to the area detected by the detection unit 172, and superimposes the rectangular frame 145 on the boundary between the emphasized area and the other area in the input image. By doing so, a display image in which the detected area is emphasized is generated. The display control unit 173 causes the display unit 14 to display the generated display image. The display control unit 173 may generate a display image by superimposing a semi-transparent colored rectangle instead of the rectangular frame 145 in the input image. The emphasized region may be the same region as the detected region or a region larger than the detected region.

On the other hand, when the meter portion 23 is not detected at all, the display control unit 173 executes a determination process for determining whether or not the time t satisfies a predetermined condition (step S33).

When the time t is less than the first predetermined time, the display control unit 173 causes the display unit 14 to display the input image (step S34), and ends a series of processes.

On the other hand, when the time t is equal to or longer than the first predetermined time and less than the second predetermined time, the display control unit 173 causes the display unit 14 to display the position of the image generation unit 13 as seen from the display unit 14 side (step S35). Ends a series of processes.

FIG. 8 is a diagram showing an example of the position of the image generation unit displayed on the display unit 14.

As shown in FIG. 8, the display control unit 173 controls the display unit 14 to display the first mark 142 in the vicinity of the image generation unit 13. For example, when the orientation of the display image displayed on the display unit 14 is determined according to the orientation of the imaging device 1, the imaging device 1 is in the display screen corresponding to the position of the image generation unit 13 for each orientation of the imaging device 1. The coordinates are stored in the storage unit 16 in advance. The display control unit 173 acquires the orientation of the image pickup apparatus 1 from the orientation detection unit 15, acquires the coordinates corresponding to the acquired orientation from the storage unit 16, and superimposes the first mark 142 on the acquired coordinates in the display image. Generates a display image indicating the position of the image generation unit 13. The display control unit 173 causes the display unit 14 to display the generated display image.

On the other hand, when the time t is equal to or longer than the second predetermined time and less than the third predetermined time, the display control unit 173 causes the display unit 14 to display the assumed position or the assumed direction in which the meter portion 23 to be detected exists (step S36). ), Ends a series of processes.

FIG. 9 is a diagram showing an example of an assumed position of a detection target displayed on the display unit 14.

As shown in FIG. 9, the display control unit 173 causes the display unit 14 to display the second mark 143 indicating the assumed position of the meter portion 23 to be detected. For example, the display control unit 173 acquires the coordinates corresponding to the position of the image generation unit 13 in the same manner as in the case of displaying the first mark 142. The display control unit 173 specifies a predetermined range centered on the corner portion located diagonally to the corner portion closest to the acquired coordinates in the display image as the assumed position.

When the image generation unit 13 is arranged diagonally upward to the left of the center a of the display unit 14, when the user aligns the center a of the display unit 14 with the front of the meter portion 23 to be detected, the meter portion 23 is the center. It is displayed on the display unit 14 with a deviation from a diagonally downward to the right. Therefore, the display control unit 173 displays the second mark 143 diagonally downward to the right when viewed from the center a of the display unit 14, where the meter portion 23 is assumed to exist, so that the user's attention is given diagonally downward to the right. Try to attract. This makes it easier for the user to find the meter portion 23.

FIG. 10 is a diagram showing an example of the assumed direction of the detection target displayed on the display unit 14.

As shown in FIG. 10, the display control unit 173 displays the first mark 142 indicating the position of the image generation unit 13 and the third mark 144 indicating the assumed direction of the meter portion 23 to be detected on the display unit 14. Let me. For example, the display control unit 173 acquires the coordinates corresponding to the position of the image generation unit 13 in the same manner as in the case of displaying the first mark 142. The display control unit 173 specifies a direction from the corner portion closest to the coordinates acquired in the display image to the corner portion diagonal to the corner portion as the assumed direction.

The display control unit 173 causes the display unit 14 to display a third mark 144 indicating diagonally downward to the right when viewed from the center a of the display unit 14, which is assumed to have the meter portion 23, so that the user can display the third mark 144 diagonally downward to the right. To attract the attention of. This makes it easier for the user to find the meter portion 23.

The display control unit 173 may display the third mark 144 on the display unit 14 without displaying the first mark 142.

On the other hand, when the time t is equal to or longer than the third predetermined time, the display control unit 173 causes the display unit 14 to display an enlarged display screen of the portion corresponding to the assumed position or the assumed direction of the meter portion 23 (step S37). Ends the processing of.

FIG. 11 is a diagram showing an example of a display screen before enlargement, and FIG. 12 is a diagram showing an example of a display screen after enlargement.

The display control unit 173 determines the enlargement target area 146 so as to include the corner portion on the assumed direction side on the assumed position of the meter portion 23 or the display image, and enlarges the enlargement target area 146 to the size of the entire display unit 14. The image 146a is generated and displayed on the display unit 14. The display control unit 173 expands the expansion target area 146 by using known techniques such as the nearest neighbor method and the bilinear method. By enlarging the portion corresponding to the assumed position or the assumed direction of the meter portion 23 by the display control unit 173, the user can easily find the meter portion 23.

As described in detail above, in the image pickup apparatus 1, the camera position viewed from the display unit side is arranged at a position other than the center of the display unit. The image pickup apparatus 1 displays the position of the image generation unit when the detection target is not detected even after the first predetermined time has elapsed, and when the detection target is still not detected even after the second predetermined time has elapsed, the detection target is displayed. Display the assumed position or assumed direction. As a result, the image pickup apparatus 1 can make it easier for the user of the image pickup apparatus 1 to find the detection target.

When the imaging device 1 detects a plurality of meter portions 23 in step S14 of FIG. 4, the image recognition device 1 may execute the character recognition process of step S16 for each region. When a plurality of recognition results are acquired as a result of executing the character recognition process, the display control unit 173 generates a confirmation display screen in step S18 using any one of the recognition results and displays it on the display unit 14. You may let me. Further, the display control unit 173 may display a warning display screen including an image for prompting the user to confirm the detection target on the display unit 14 instead of displaying the confirmation screen in step S18.

FIG. 13 is a diagram showing an example of a warning display screen.

As shown in FIG. 13, when the second meter portion 33 of the second meter 3 is detected separately from the meter portion 23 of the meter 2, the image pickup apparatus 1 cannot determine which meter portion should be stored as the recognition result. .. Therefore, the display control unit 173 generates a warning display screen by superimposing the character string 147 "Please make one" stored in the storage unit 16 in advance on the input image, and displays the warning display screen on the display unit 14. ..

Generally, when a plurality of meters are arranged adjacent to each other in the horizontal direction, the meter portions of the meters are arranged close to each other, and there is a high possibility that the detection unit 172 detects the plurality of meter portions. As shown in FIG. 1, when the center of the angle of view of the image generation unit 13 is on the upper left side of the meter portion, the meter portion that the user wants to photograph may be on the right side instead of the center of the display unit 14. In that case, there is a high possibility that the meter portion to be photographed by the user is reflected on the opposite side of the position of the image generation unit 13 in the displayed image. Therefore, the display control unit 173 displays a semi-transparent figure 148 on the opposite side of the position of the image generation unit 13 in the display image so that the user pays attention to the opposite side of the position of the image generation unit 13 in the display image. The superimposed warning display screen may be generated and displayed on the display unit 14.

When the warning display screen is displayed, the CPU 17 returns the process to step S12 without executing the process of step S19.

Further, the display control unit 173 may display the input image on the display unit 14 before starting the measurement of the elapsed time t in step S12 of FIG. For example, the display control unit 173 displays the input image only within a predetermined range from the corner portion on the image generation unit 13 side, and displays a black image in the other area. The display control unit 173 expands the range in which the input image is displayed with the passage of time toward the corners located diagonally of the image generation unit 13. As a result, the user can easily recall the position of the image generation unit 13.

Further, the detection unit 172 stores the recognition result in the storage unit 16 in step S20 without asking the user whether or not the display control unit 173 registers the numbers detected in steps S18 to S19 of FIG. You may. In this case, the display control unit 173 may display the recognition result on the display unit 14.

Further, the display control unit 173 may simultaneously execute the partial highlighting in step S32 of FIG. 6 and the respective displays of steps S34 to S37.

Further, in the present embodiment, the image pickup device is used to detect the numerical value of the meter, but the detection target is not limited to this, and a bar code, a two-dimensional code, or the like may be used.

FIG. 14 is a block diagram showing a schematic configuration of an image pickup apparatus according to another embodiment.

The processing circuit 18 of the imaging device 1a executes the entire processing instead of the CPU 17 of the imaging device 1. The processing circuit 18 includes an image generation control circuit 181, a detection circuit 182, a display control circuit 183, an input detection circuit 184, and the like.

The image generation control circuit 181 is an example of the image generation control unit, and has the same function as the image generation control unit 171. The image generation control circuit 181 sequentially acquires the input images captured by the meter from the image generation unit 13, and outputs them to the detection circuit 182 and the display control circuit 183.

The detection circuit 182 is an example of a detection unit, and has the same function as the detection unit 172. The detection circuit 182 detects the numerical value in the meter shown in the input image and stores the recognition result in the storage unit 16. The detection circuit 182 detects the coordinates of the region of the meter portion 23 in the meter, and outputs the detected coordinates to the display control circuit 183.

The display control circuit 183 is an example of the display control unit, and has the same function as the display control unit 173. The display control circuit 183 generates a display image based on the input image, the detection coordinates, and the orientation signal, and displays the display image on the display unit 14.

The input detection circuit 184 is an example of an input detection unit, and has the same function as the input detection unit 174. The input detection circuit 184 acquires an input signal from the input unit 12 and outputs the input information to the image generation control circuit 181, the detection circuit 182, the display control circuit 183, and the like.

As described in detail above, the image pickup apparatus can make it easier for the user to find the detection target even when the processing circuit 18 is used.

1, 1a Imaging device 10 Main unit 13 Image generation unit 14 Display unit 172 Detection unit 173 Display control unit

Claims (6)

With the main body
An image generation unit arranged on one surface side of the main body and generating an input image,
A display unit arranged on the other surface side of the main body and displaying the input image,
A detection unit that detects a predetermined detection target from the input image,
When the detection unit does not detect the detection target even after the lapse of the first predetermined time, the display control unit has a display control unit that displays the position of the image generation unit as seen from the display unit side on the display unit.
The position of the image generation unit as seen from the display unit side is arranged at a position other than the center of the display unit.
When the detection unit still does not detect the detection target even after the second predetermined time longer than the first predetermined time elapses, the display control unit displays the assumed position or the assumed direction of the detection target on the display unit. Let me
An imaging device characterized by this. The imaging device according to claim 1, wherein when the detection unit detects a plurality of the detection targets, the display control unit causes the display unit to display an image for prompting the user to confirm the detection target. The imaging device according to claim 1 or 2, wherein when the detection unit detects only a part of the detection target, the display control unit displays an image in which the part is emphasized on the display unit. When the detection unit still does not detect the detection target even after the lapse of a third predetermined time longer than the second predetermined time, the display control unit indicates the assumed position of the detection target or the assumption of the detection target in the input image. The imaging device according to any one of claims 1 to 3, wherein a portion corresponding to a direction is enlarged and displayed on the display unit. A main body, an image generation unit arranged on one surface side of the main body and generating an input image, a display unit arranged on the other surface side of the main body and displaying the input image, and the input image. It is a control method of an image pickup apparatus which has a detection unit for detecting a predetermined detection target from the image, and the position of the image generation unit viewed from the display unit side is arranged at a position other than the center of the display unit. ,
When the detection unit does not detect the detection target even after the lapse of the first predetermined time, the position of the image generation unit as seen from the display unit side is displayed on the display unit.
If the detection unit still does not detect the detection target even after the second predetermined time longer than the first predetermined time elapses, the display unit displays the assumed position or direction of the detection target.
A control method characterized by including. A main body, an image generation unit arranged on one surface side of the main body and generating an input image, a display unit arranged on the other surface side of the main body and displaying the input image, and the input image. It is a control program of an image pickup apparatus having a detection unit for detecting a predetermined detection target from the above, and the position of the image generation unit viewed from the display unit side is arranged at a position other than the center of the display unit. ,
When the detection unit does not detect the detection target even after the lapse of the first predetermined time, the position of the image generation unit as seen from the display unit side is displayed on the display unit.
If the detection unit still does not detect the detection target even after the second predetermined time longer than the first predetermined time elapses, the display unit displays the assumed position or direction of the detection target.
A control program characterized by causing the image pickup apparatus to execute the above.

Images