JPWO2020174911A1 - Image display device, image display method, and program - Google Patents

Abstract

Provided are an image display device, an image display method, and a program for stably displaying a target frame without impairing the followability to a detected target. The image display device 11 has an image acquisition unit 101 that acquires continuous images, a target detection unit 103 that detects an object from an image, and a target frame determination that determines a target frame that is a target range from the latest image in the image. It corresponds to the unit 105, the dead zone determining unit for determining the dead zone with respect to the position of the target frame, the previous target frame corresponding to the target frame determined from the image one image before, and the dead zone determined from the image one image before. When the storage unit 260 for storing the previous dead zone and the position of the target are outside the range of the previous dead zone, the target frame is displayed, and when the position is within the range of the previous dead zone, the previous target frame is displayed. The display control unit 109 is provided.

Description

The present invention relates to an image display device, an image display method, and a program, and more particularly to an image display device, an image display method, and a program that display a target frame indicating a range of detected objects.

Conventionally, when shooting with a digital camera, face detection is performed when the subject is a person, and the face frame (target frame) is displayed based on the information on the position and size of the detected face. It has been.

A technique has been proposed for stably displaying a target frame when the target frame displayed on a display unit composed of an LCD (Liquid Crystal Display) of a digital camera is continuously displayed.

For example, in the shooting standby state, the detection and non-detection of the face area are repeated, and the target frame (square frame) for showing the face area is displayed or disappears on the live view image (through image). There is. The technique described in Patent Document 1 aims to suppress repeated display and non-display of the target frame. In the technique described in Patent Document 1, when the subject area is not detected, the target frame is continuously displayed as the detected subject area set immediately before.

Japanese Unexamined Patent Publication No. 2007-2213112

Here, the target frame to be displayed may be unstable depending on the movement of the target to be detected. For example, when the detection target is a face, the target frame moves following even a minute movement of the face, and the display of the target frame becomes unstable. On the other hand, in order to suppress the fluctuation range of the target frame, a technique of displaying the target frame by halving the movement amount has been proposed, but in this case, the followability of the target frame to the target is impaired.

The technique described in Patent Document 1 is a technique for suppressing repeated display and non-display of the target frame, and mentions the unstable display of the target frame due to the movement of the target. Not.

The present invention has been made in view of such circumstances, and an object thereof is an image display device, an image display method, and a program for stably displaying a target frame without impairing the ability to follow a detected target. Is to provide.

The image display device according to one aspect of the present invention for achieving the above object is an image acquisition unit that acquires continuous images, a target detection unit that detects an object from an image, and an object from the latest image in the image. The target frame determination unit that determines the target frame within the range of, the dead zone determination unit that determines the dead zone for the position of the target frame, the previous target frame corresponding to the target frame determined from the image one image before, and one. If the storage unit that stores the previous dead zone corresponding to the dead zone determined from the image before the image and the target position are outside the range of the previous dead zone, the target frame is displayed and within the range of the previous dead zone. In this case, a display control unit for displaying the previous target frame is provided.

According to this aspect, when the position of the target is within the range of the dead zone of the previous time, the target frame displayed last time is displayed. Therefore, the position information for displaying the target frame is changed for a small change (change in position). The target frame can be displayed stably without any need. In addition, when the position of the target is outside the range of the previous dead zone, the target frame corresponding to the target detected this time is displayed, so that the target has excellent followability (position followability) to the detected target. The frame can be displayed.

Preferably, the target detection unit detects the position information of the target, and the dead zone determination unit changes the dead zone based on the position information.

Preferably, the dead zone determination unit determines the motion of the target based on the position information and the previous dead zone, and changes the previous dead zone based on the result of the motion determination.

The image display device according to another aspect of the present invention has an image acquisition unit that acquires continuous images, a target detection unit that detects an object from an image, and a target frame that is a range of objects from the latest image in the image. Determined from the target frame determination unit to be determined, the dead zone determination unit to determine the dead zone for the size of the target frame, the previous target frame corresponding to the target frame determined from the image one image before, and the image one image before. A storage unit that stores the previous dead zone corresponding to the dead dead zone, and if the size of the target is outside the range of the previous dead zone, the target frame is displayed, and if it is within the range of the previous dead zone, the previous time. It is provided with a display control unit for displaying the target frame of.

According to this aspect, when the size of the target is within the range of the previous dead zone, the target frame displayed last time is displayed, so that the size for displaying the target frame is small (variation in size). The target frame can be displayed stably without changing the information. In addition, when the position of the target is outside the range of the previous dead zone, the target frame corresponding to the target detected this time is displayed, so that the followability (size followability) to the detected target is excellent. The target frame can be displayed.

Preferably, the target detection unit detects the size information of the target, and the dead zone determination unit changes the dead zone based on the size information.

Preferably, the dead zone determination unit determines the motion of the target based on the size information and the previous dead zone, and changes the previous dead zone based on the result of the motion determination.

Preferably, the dead zone determination unit reduces the dead zone in the first direction when the result of the motion determination indicates the first direction.

Preferably, the dead zone determination unit increases the dead zone in the first direction when the result of the motion determination does not indicate the first direction.

Preferably, the change of the dead zone changes the position or size of the dead zone according to the target detected by the target detection unit.

The image display device according to another aspect of the present invention includes an image acquisition unit that acquires an image that is a continuous image and has information on the detected position of the target and the position of the target frame that is the range of the target. The dead zone determination unit that determines the dead zone for the position of the target frame, the previous target frame corresponding to the target frame determined from the image one image before, and the previous dead zone corresponding to the dead zone determined from the image one image before. A storage unit to be stored, and a display control unit that displays the target frame when the position of the target is outside the range of the previous dead zone, and displays the previous target frame when the position is within the range of the previous dead zone. , Equipped with.

The image display device according to another aspect of the present invention is an image acquisition unit that acquires an image that is a continuous image and has information on the detected size of the target and the size of the target frame that is the range of the target. The dead zone determination unit that determines the dead zone for the size of the target frame, the previous target frame corresponding to the target frame determined from the image one image before, and the previous time corresponding to the dead zone determined from the image one image before. If the storage unit that stores the dead zone and the size of the target are outside the range of the previous dead zone, the target frame is displayed, and if it is within the range of the previous dead zone, the previous target frame is displayed. It is equipped with a display control unit.

Preferably, the display control unit includes an information addition unit that records the position information of the displayed target frame in the image.

Preferably, the dead zone is the dead zone width with respect to the target frame, and the initial value of the dead zone is constant.

Preferably, the target detected by the target detection unit is an object.

Preferably, the object is a face or pupil.

Preferably, the target frame is rectangular.

Preferably, the target frame is an ellipse.

The image display method according to another aspect of the present invention includes a step of acquiring a continuous image, a step of detecting a target from the image, and a step of determining a target frame which is a range of the target from the latest image in the image. , The step of determining the dead zone for the position of the target frame, the previous target frame corresponding to the target frame determined from the image one image before, and the previous dead zone corresponding to the dead zone determined from the image one image before are stored. When the position of the target is outside the range of the previous dead zone, the target frame is displayed, and when the position of the target is within the range of the previous dead zone, the step of displaying the previous target frame is included.

The image display method according to another aspect of the present invention includes a step of acquiring a continuous image, a step of detecting a target from the image, and a step of determining a target frame which is a range of the target from the latest image in the image. , The step of determining the dead zone for the size of the target frame, the previous target frame corresponding to the target frame determined from the image one image before, and the previous dead zone corresponding to the dead zone determined from the image one image before. A step to memorize and a step to display the target frame when the size of the target is outside the range of the previous dead zone, and a step to display the previous target frame when the size of the target is within the range of the previous dead zone. include.

A program according to another aspect of the present invention includes a step of acquiring a continuous image, a step of detecting a target from an image, a step of determining a target frame which is a range of the target from the latest image in the image, and a target. A step of determining a dead zone with respect to the position of the frame, a previous target frame corresponding to the target frame determined from the image one image before, and a step of storing the previous dead zone corresponding to the dead zone determined from the image one image before. An image display process including a step of displaying the target frame when the target position is outside the range of the previous dead zone and displaying the previous target frame when the target position is within the range of the previous dead zone. Let the computer run.

A program according to another aspect of the present invention includes a step of acquiring a continuous image, a step of detecting a target from an image, a step of determining a target frame which is a range of the target from the latest image in the image, and a target. The step of determining the dead zone for the size of the frame, the previous target frame corresponding to the target frame determined from the image one image before, and the previous dead zone corresponding to the dead zone determined from the image one image before are stored. An image including a step and a step of displaying the target frame when the size of the target is outside the range of the previous dead zone and displaying the previous target frame when the size of the target is within the range of the previous dead zone. Have the computer perform the display process.

According to the present invention, when the position of the target is within the range of the dead zone of the previous time, the target frame displayed last time is displayed. In addition, when the position of the target is outside the range of the previous dead zone, the target frame corresponding to the target detected this time is displayed, so the followability to the detected target is excellent. It is possible to display the target frame.

FIG. 1 is a perspective view showing an example of an image pickup apparatus. FIG. 2 is a rear view showing an example of an image pickup apparatus. FIG. 3 is a diagram showing a configuration of an image pickup apparatus. FIG. 4 is a block diagram showing a main functional configuration example of the image display device. FIG. 5 is a diagram illustrating a dead zone. FIG. 6 is a diagram illustrating a dead zone. FIG. 7 is a diagram showing a specific example of determining the dead zone. FIG. 8 is a flowchart showing an image display method. FIG. 9 is a flowchart showing an image display method. FIG. 10 is a diagram showing a specific example of the dead zone processing. FIG. 11 is a diagram illustrating a dead zone of the size of the target frame. FIG. 12 is a flowchart showing an image display method. FIG. 13 is a flowchart showing an image display method. FIG. 14 is a diagram showing the appearance of a smartphone. FIG. 15 is a block diagram showing the configuration of a smartphone.

Hereinafter, preferred embodiments of the image display device, the image display method, and the program according to the present invention will be described with reference to the accompanying drawings.

[Image pickup device]

1 and 2 are a perspective view and a rear view showing an example (digital camera) of an image pickup apparatus equipped with the image display device of the present invention, respectively.

The image display device 11 (see FIG. 4) is mounted on the image pickup device 10 and displays a live view image (through image) captured by the image pickup device 10. The image display device 11 can also display the recorded moving image.

The image pickup device 10 is a digital camera that receives light that has passed through a lens by an image pickup element, converts it into a digital signal, and records it on a recording medium as image data of a still image or a moving image.

As shown in FIG. 1, the image pickup apparatus 10 is provided with a photographing lens 12, a strobe 1, and the like in front of the image pickup device 10, and a shutter button 2, a power supply / mode switch 3, a mode dial 4, and the like are arranged on the upper surface thereof. On the other hand, as shown in FIG. 2, a monitor (LCD) 30, a zoom button 5, a cross button 6, a MENU / OK button 7, a play button 8, a BACK button 9, and the like are arranged on the back surface of the camera.

The photographing lens 12 is composed of a retractable zoom lens, and is extended from the camera body by setting the operation mode of the camera to the photographing mode by the power supply / mode switch 3. The strobe 1 irradiates the main subject with strobe light.

The shutter button 2 is composed of a two-step stroke type switch consisting of a so-called "half-press" and "full-press", and functions as a shooting preparation instruction unit and an image recording instruction unit.

When the still image shooting mode is selected as the shooting mode and the shutter button 2 is "half-pressed", the image pickup device 10 performs a shooting preparation operation for AF (Autofocus) / AE (Auto Exposure) control, and the shutter button 2 is performed. Is "fully pressed" to capture and record a still image.

Further, the image pickup device 10 starts recording a moving image when the moving image shooting mode is selected as the shooting mode and the shutter button 2 is "fully pressed", and when the shutter button 2 is "fully pressed" again, the recording is started. Stops and goes into a standby state.

The power / mode switch 3 has both a function as a power switch for turning on / off the power of the image pickup device 10 and a function as a mode switch for setting the mode of the image pickup device 10, and has an “OFF position” and a “playback”. It is slidably arranged between the "position" and the "shooting position". The image pickup device 10 is turned on by sliding the power / mode switch 3 to match the "reproduction position" or "shooting position", and is turned off by adjusting to the "OFF position". Then, by sliding the power / mode switch 3 to match the "playback position", the "playback mode" is set, and by adjusting to the "shooting position", the "shooting mode" is set.

The mode dial 4 functions as a mode switching unit for setting the shooting mode of the image pickup device 10, and the shooting mode of the image pickup device 10 is set to various modes depending on the setting position of the mode dial 4. For example, there are a "still image shooting mode" for shooting a still image, a "moving image shooting mode" for shooting a moving image, and the like.

The monitor 30 functions as a display unit, displays a live view image in the shooting mode, displays a still image or a moving image in the playback mode, and displays a menu screen, etc., as a part of the graphical user interface. Function.

The zoom button 5 functions as a zoom instructing means for instructing zooming, and includes a telebutton 5T instructing zooming to the telephoto side and a wide button 5W instructing zooming to the wide-angle side. In the image pickup device 10, the focal length of the photographing lens 12 changes by operating the telebutton 5T and the wide button 5W in the photographing mode. Further, in the reproduction mode, the telebutton 5T and the wide button 5W are operated to enlarge or reduce the image being reproduced.

The cross-shaped button 6 is an operation unit for inputting instructions in four directions of up, down, left, and right, and is used as a button (cursor movement operation means) for selecting an item from the menu screen or instructing selection of various setting items from each menu. Function. The left / right key functions as a frame advance (forward / reverse) button in the playback mode.

The MENU / OK button 7 is an operation button having both a function as a menu button for issuing a command to display a menu on the screen of the monitor 30 and a function as an OK button for instructing confirmation and execution of selection contents. Is.

The play button 8 is a button for switching to a play mode in which the captured and recorded still image or moving image is displayed on the monitor 30.

The BACK button 9 functions as a button instructing to cancel the input operation or return to the previous operation state.

In the image pickup apparatus 10 according to the present embodiment, instead of providing a member unique to the buttons / switches, a touch panel is provided and the functions of the buttons / switches are realized by operating the touch panel. May be good.

[Internal configuration of image pickup device]

FIG. 3 is a diagram showing the configuration of the image pickup apparatus 10. The image pickup device 10 forms a subject image (optical image) on the image pickup element 210 by the photographing lens 12.

The photographing lens 12 is composed of a zoom lens 110 and a focus lens 150. Further, the image pickup apparatus 10 includes a diaphragm 130 and a lens driving unit 140. The lens drive unit 140 drives the zoom lens 110 and the focus lens 150 forward and backward in response to a command from the CPU 240 as a control unit to perform zoom (optical zoom) adjustment and focus adjustment. The zoom adjustment and the focus adjustment may be performed according to a command from the CPU 240, or may be performed according to a zoom operation or a focus operation performed by the user. Further, the lens driving unit 140 controls the aperture 130 in response to a command from the CPU 240 to adjust the exposure. On the other hand, information such as the positions of the zoom lens 110 and the focus lens 150 and the degree of opening of the aperture 130 is input to the CPU 240.

The image pickup device 10 includes an image pickup element 210, an AFE 220 (AFE: Analog Front End), an A / D converter 230 (A / D: Analog to Digital), a CPU 240, an operation unit 250, a storage unit 260, and a monitor 30. The image pickup device 10 may have a mechanical shutter (not shown) for blocking light transmitted through the image pickup element 210. The image pickup element 210 includes a light receiving surface in which a large number of light receiving elements are arranged in a matrix, and subject light transmitted through the zoom lens 110, the focus lens 150, and the aperture 130 is imaged on the light receiving surface of the image pickup element 210. It is converted into an electric signal by each light receiving element. An R (red), G (green), or B (blue) color filter is provided on the light receiving surface of the image sensor 210, and a color image of the subject can be acquired based on the signals of each color. As the image pickup device 210, various photoelectric conversion elements such as CMOS (Complementary Metal-Oxide Semiconductor) and CCD (Charge-Coupled Device) can be used. The AFE 220 performs noise removal, amplification, and the like of the analog image signal output from the image sensor 210, and the A / D converter 230 converts the captured analog image signal into a digital image signal having a gradation width. The shutter may be a mechanical shutter or an electronic shutter. In the case of an electronic shutter, the exposure time (shutter speed) can be adjusted by controlling the charge accumulation period of the image pickup device 210 by the CPU 240.

The storage unit 260 is composed of various optical magnetic recording media, a non-temporary recording medium such as a semiconductor memory, and a control circuit thereof, and stores moving images (including live view images) and still images. As the recording medium, a type that can be attached to and detached from the image pickup apparatus 10 can be used. Further, the storage unit 260 stores the program and information used for various controls of the CPU 240.

The monitor 30 can display moving images (live view images, recorded moving images) and still images. The image pickup apparatus 10 may include a finder, and the finder functions as a monitor 30. The finder is composed of, for example, a liquid crystal display panel, a prism, a lens, or the like, and the user can visually recognize a moving image or a still image through an eyepiece (not shown). The finder includes "Optical View Finder (OVF)", "Electronic View Finder (EVF)", or a combination of these, "Hybrid View Finder (HVF)". Can be used.

The CPU 240 reads necessary programs and information used for various controls from the storage unit 260, and performs various processes and various controls performed by the CPU 240.

The CPU 240 executes various controls. The hardware-like structure is various processors as shown below. For various processors, the circuit configuration can be changed after manufacturing CPU (Central Processing Unit), FPGA (Field Programmable Gate Array), etc., which are general-purpose processors that execute software (programs) and act as various functional units. Programmable Logic Device (PLD), which is a processor, and a dedicated electric circuit, which is a processor having a circuit configuration specially designed to execute a specific process such as ASIC (Application Specific Integrated Circuit). Is done.

One processing unit may be composed of one of these various processors, or may be composed of two or more processors of the same type or different types (for example, a plurality of FPGAs or a combination of a CPU and an FPGA). You may. Further, a plurality of functional units may be configured by one processor. As an example of configuring a plurality of functional units with one processor, first, one processor is configured by a combination of one or more CPUs and software, as represented by a computer such as a client or a server. There is a form in which the processor acts as a plurality of functional parts. Second, as typified by System On Chip (SoC), there is a form that uses a processor that realizes the functions of the entire system including multiple functional parts with one IC (Integrated Circuit) chip. be. As described above, the various functional units are configured by using one or more of the above-mentioned various processors as a hardware-like structure.

<First Embodiment>

Next, the first embodiment will be described. In this example, a dead zone is set for the position of the target frame.

FIG. 4 is a block diagram showing a main functional configuration example of the image display device 11 mounted on the image pickup device 10. The image display device 11 includes an image acquisition unit 101, a target detection unit 103, a target frame determination unit 105, a dead zone determination unit 107, a display control unit 109, an information addition unit 111, a storage unit 260, and a monitor 30. The image acquisition unit 101, the target detection unit 103, the target frame determination unit 105, the dead zone determination unit 107, the display control unit 109, and the information addition unit 111 are realized by the CPU 240.

The image acquisition unit 101 acquires continuous images. Specifically, the image acquisition unit 101 acquires continuous images output from the A / D converter 230. For example, the image acquisition unit 101 acquires a live view image composed of a plurality of frame images captured by the image pickup apparatus 10.

The target detection unit 103 detects a target from the acquired image. For example, the target detection unit 103 detects a human face using a known technique. The target detection unit 103 detects a human face in an image and acquires position information composed of, for example, position coordinates. In addition, the target detection unit 103 can also detect an object other than the face. For example, the target detection unit 103 can detect the pupil.

The target frame determination unit 105 determines a target frame, which is a range of the target, from the latest image in the image.

The target frame determination unit 105 determines the target frame for the target detected in each of the plurality of images acquired by the image acquisition unit 101. The target frame is for notifying the user of the detected target, and various shapes can be adopted. The target frame is, for example, a rectangle including a square, and the target frame is, for example, an ellipse including a perfect circle.

The dead zone determination unit 107 determines the dead zone regarding the display of the target frame. The dead zone determination unit 107 determines, for example, a dead zone with respect to the position of the target frame. Here, the dead zone related to the display of the target frame is that when the target frame (or target) moves within the range of the dead zone, the target frame to be displayed is constant without following the target, and the target frame (or target) is the dead zone. When moving outside the range of, the target frame to be displayed follows the target (the target frame corresponding to the target).

5 and 6 are diagrams illustrating the dead zone determined by the dead zone determination unit 107.

5 and 6 show the face 125 detected by the target detection unit 103 in the nth frame, the target frame 121 determined by the target frame determination unit 105 according to the face 125, and the dead zone determination unit 107. The dead zone 120 is shown. Further, the face 127 detected by the target detection unit 103 in the n + 1st frame, and the target frame 123 determined by the target frame determination unit 105 according to the face 127 are shown. In the case of this example, the target frame 121 and the target frame 123 are determined for the face 125 and the face 127, respectively, in the same positional relationship. Further, in the case of this example, the reference points of the target position or the position of the target frame are the reference point B1 (target frame 121) and the reference point B2 (target frame 123) in the upper left corner of the target frame.

In the case shown in FIG. 5, the face 127 detected in the n + 1st frame is located within the range of the dead zone 120 set in the nth frame. That is, the n + 1th reference point B2 is within the range of the dead zone 120. Therefore, the target frame 121 is displayed even in the n + 1th frame.

In the case shown in FIG. 6, the face 127 detected in the n + 1st frame is located outside the range of the dead zone 122 set in the nth frame. That is, the n + 1th reference point B2 is outside the range of the dead zone 122. Therefore, in the n + 1th frame, the target frame 121 corresponding to the face 127 is displayed.

By setting the dead zone for the position of the detected target in this way, stable display can be performed without moving the display of the target frame to the minute movement of the target, and the dead zone is exceeded. The target frame can be displayed with good followability to the movement of the target.

Further, the dead zone determination unit 107 can change the position and / or size of the dead zone depending on the detected target. That is, the dead zone determination unit 107 can change the position and size of the dead zone according to the position of the detected target. Further, the dead zone determination unit 107 can change the width of the dead zone according to the movement of the target. The dead zone determination unit 107 determines the movement of the target based on the position information and the previous dead zone, and changes the dead zone (previous dead zone) based on the result of the motion determination. For example, when the result of the motion determination indicates the first direction, the dead zone determination unit 107 reduces the dead zone in the first direction. That is, the width of the dead zone is set small in the direction in which the detected target is moving to improve the followability of the target frame to the target. Further, when the result of the motion determination does not indicate the first direction, the dead zone determination unit 107 increases the dead zone in the first direction. That is, the width of the dead zone is set large in the direction in which the detected target is not moving, and the stability of the display of the target frame is improved.

FIG. 7 is a diagram showing a specific example of the dead zone determined by the dead zone determination unit 107. In the case shown in FIG. 7, the dead zone is determined in the positive direction and the negative direction of the X axis in the figure.

In the case shown in FIG. 7A, the width of the dead zone in the positive direction and the negative direction is the same as the display position P of the previous target frame. In this way, when it is unclear in which direction the target moves, the width of the dead zone is set to be the same in the positive direction and the negative direction, so that an appropriate target frame can be displayed. For example, the initial value of the dead zone may be constant, and the dead zone having the same width in the positive direction and the negative direction from the center of the angle of view may be provided. The case shown in FIG. 7B is a case where the width of the dead zone is increased as a whole.

The case shown in FIG. 7C is a case where the width of the dead zone is reduced as a whole. As shown in FIG. 7 (B), increasing the width of the dead zone as a whole improves the stability of the display of the target frame, and as shown in FIG. 7 (C), reducing the width of the dead zone as a whole improves the target. The followability of the frame display is improved.

In the case shown in FIG. 7D, in the motion determination of the dead zone determination unit 107, it is determined that the target has moved in the positive direction, and the width of the dead zone in the positive direction is reduced. Further, in the case shown in FIG. 7D, it is determined that the target is not moving in the negative direction, and the width of the dead zone in the negative direction is increased. In the case shown in FIG. 7 (E), in the motion determination of the dead zone determination unit 107, it is determined that the target has moved in the negative direction, and the width of the dead zone in the negative direction is reduced. Further, in the case shown in FIG. 7 (E), it is determined that the target is not moving in the positive direction, and the width of the dead zone in the positive direction is increased.

As described above, the dead zone determination unit 107 can display the target frame stably and with good followability by changing the position and size of the dead zone according to the movement of the target.

Returning to FIG. 4, the storage unit 260 stores the previous target frame corresponding to the target frame determined from the image one image before, and the previous dead zone corresponding to the dead zone determined from the image one image before.

Specifically, the target frame 121 and the dead zone 120 (dead zone 122) in the nth frame described with reference to FIGS. 5 and 6 are stored. The previous target frame and the previous dead zone stored in the storage unit 260 are used for controlling the display control unit 109. The information stored in the storage unit 260 may be updated for each image, or the information of each image may be accumulated.

The display control unit 109 controls the display on the monitor 30. The monitor 30 displays a live view image, a recorded moving image, and a still image. Further, the display control unit 109 displays the target frame by superimposing it on the live view image or the recorded moving image. The display control unit 109 displays the target frame when the position of the target is outside the range of the previous dead zone, and displays the previous target when it is within the range of the previous dead zone.

The information addition unit 111 records the position information of the displayed target frame in the image by the display control unit 109. Specifically, the coordinate value of the displayed target frame is added for each frame. Information addition by the information addition unit 111 is performed by a known method.

Next, an image display method (image display step) using the image display device 11 will be described.

8 and 9 are flowcharts showing an image display method using the image display device 11. This example is an example in which a face is detected as a target and a face frame corresponding to the detected face is displayed.

First, the image acquisition unit 101 acquires a continuous frame image in which the face is photographed (step S10). After that, the target detection unit 103 detects a face in each of the acquired frames and acquires the position information of the detected face (step S11).

The dead zone determination unit 107 determines whether or not the previous “positive (positive direction)” movement determination is “1” (step S12). When the previous "positive" motion determination is "1", the dead zone determination unit 107 sets a small dead zone width in the positive direction (step S13). On the other hand, when the previous "positive" motion determination is "0" (not "1"), the dead zone determination unit 107 sets a large dead zone width in the positive direction (step S14).

Next, the dead zone determination unit 107 determines whether or not the previous “negative (negative direction)” motion determination is “1” (step S15). When the previous "negative" motion determination is "1", the dead zone determination unit 107 sets a small dead zone width in the negative direction (step S16). On the other hand, when the previous "negative" motion determination is "0" (not "1"), the dead zone determination unit 107 sets a large dead zone width in the negative direction (step S17).

Next, the dead zone determination unit 107 sets the dead zone based on the coordinates after the previous dead zone processing by using the dead zone width set by the above processing (step S18).

Moving to FIG. 9, the dead zone determination unit 107 determines whether or not the acquired face position this time exceeds the dead zone set as described above (step S19). When the acquired position of the face this time exceeds the set dead zone, the dead zone determination unit 107 determines whether or not the face has exceeded the set dead zone (step S20). Then, when the position of the face this time exceeds the positive direction, the dead zone determination unit 107 sets the motion determination to "positive: 1" and "negative: 0" (step S21).

.. On the other hand, when the position of the face this time exceeds the negative direction, the target detection unit 103 sets the motion determination to "positive: 0" and "negative: 1" (step S22). After that, the display control unit 109 displays the face frame using the position information detected this time for displaying the face frame (step S23).

..

On the other hand, when it is determined that the position of the face this time does not exceed the dead zone, the movement determination this time is set to "positive: 0" and "negative: 0" (step S24). Then, the current position information is overwritten with the previous position information (step S25). After that, the display control unit 109 uses the previous position information for displaying the face frame (step S26).

Each of the above configurations and functions can be appropriately realized by any hardware, software, or a combination of both. For example, for a program that causes a computer to perform the above-mentioned processing steps (processing procedure), a computer-readable recording medium (non-temporary recording medium) that records such a program, or a computer on which such a program can be installed. However, it is possible to apply the present invention.

FIG. 10 is a diagram showing a specific example of the dead zone processing. The graph shown in FIG. 10 shows a live view image in which the detection target is a face and the face frame is displayed according to the detected face. In FIG. 10, the horizontal axis shows the number of times the face is detected for each frame, and the vertical axis shows the X coordinate in the display unit. The line represented by the square mark on the graph indicates the upper limit of the dead zone, the line represented by the diamond mark indicates the position of the detected face (X coordinate), and the line represented by the cross mark indicates the processed The position (X coordinate) for displaying the face frame is shown, and the line represented by the triangle mark shows the lower limit of the dead zone. The display position of the face frame indicates the X coordinate of the position of the center of the frame. Further, the following description will be given with the direction in which the X coordinate increases as the positive direction and the direction in which the X coordinate decreases as the negative direction.

From the number of detections 170 to the timing indicated by the arrow T1, the face position is detected between the upper limit of the dead zone and the lower limit of the dead zone (within the dead zone). Therefore, the display of the face frame does not change, and the face frame is displayed at a fixed position.

At the timing indicated by the arrow T2, the position of the face is detected beyond the upper limit of the dead zone, so that the display position of the face frame is a position corresponding to the position of the detected face. Further, at the timing indicated by the arrow T2, the same dead zone as the dead zone at the timing indicated by the arrow T1 is set. This is because the position of the face is detected in the dead zone at the timing indicated by the arrow T1.

At the timing indicated by the arrow T3, the position of the face is detected beyond the upper limit of the dead zone, so that the display position of the face frame is a position corresponding to the position of the detected face. Further, the dead zone moves at the timing of the arrow T3, and the width of the dead zone is also changed. Specifically, at the timing of arrow T3, the face frame is displayed at a position exceeding the upper limit of the dead zone at the timing of arrow T2, based on the display position of the face frame at the timing of arrow T2. At the timing of T3, the dead zone width in the positive direction is changed small.

In this way, by providing a dead zone for the display of the face frame, the stable display of the face frame and the followability to the detected face position are not impaired. Further, in the above-described embodiment, the width of the dead zone is adjusted based on the display position of the previous face frame, and the position of the dead zone and the width of the dead zone are adjusted. It can be carried out.

<Second embodiment>

In the first embodiment, the insensitivity zone with respect to the position has been described, but in the second embodiment, an example of setting the insensitivity zone with respect to the size of the target frame will be described. Each part described with reference to FIG. 4 has the following functions in the present embodiment. In the following description, characteristic points in the second embodiment will be described.

The target detection unit 103 detects the target and detects the size information of the target. For example, the target detection unit 103 detects a target face and detects the size information (area, length) of the face.

The target frame determination unit 105 determines a target frame, which is a range of the target, from the latest image. The size of the target frame is determined according to the size of the detected target. For example, when a face is detected, the size of the target frame is determined so as to surround the range of the detected face.

The dead zone determination unit 107 can determine the movement of the target based on the size information and the previous dead zone, and can change the previous dead zone based on the result of the motion determination. When the result of the motion determination indicates the first direction, the dead zone determination unit 107 reduces the dead zone in the first direction. Here, the dead zone determination unit 107 can quantify the length of one side of the square face frame, and can perform motion determination with the direction in which the number increases as the positive direction and the direction in which the number decreases as the negative direction.

The display control unit 109 displays the target frame when the size of the target is outside the range of the previous dead zone, and displays the previous target frame when the size of the target is within the range of the previous dead zone.

The information addition unit 111 records the size information of the displayed target frame in the image by the display control unit 109. Specifically, the size (area or length of one side) of the displayed target frame is added for each frame. Information addition by the information addition unit 111 is performed by a known method.

FIG. 11 is a diagram illustrating a dead zone of the size of the target frame. In FIG. 11, the target frame 131 indicates the lower limit value of the dead zone, the target frame 133 indicates the upper limit value of the dead zone, and the target frame 139 indicates the target frame for display. For example, when a target corresponding to the target frame 137 within the range of the lower limit value of the dead zone indicated by the target frame 131 and the upper limit value of the dead zone indicated by the target frame 133 is detected, the display control unit 109 displays the target frame 139. Is displayed. On the other hand, when a target corresponding to the target frame 135 outside the range of the lower limit value of the dead zone indicated by the target frame 131 and the upper limit value of the dead zone indicated by the target frame 133 is detected, the display control unit 109 is the target. The frame 135 is displayed as a target frame for display.

Next, an image display method (image display step) using the image display device 11 will be described.

The image display method continuously displays a face frame that detects a face in a continuous frame and notifies the user of the position of the detected face.

12 and 13 are flowcharts showing an image display method (image display step) using the image display device 11.

First, the image acquisition unit 101 acquires a continuous frame image in which the face is photographed (step S30). After that, the target detection unit 103 detects a face in each of the acquired frames and acquires the size information of the detected face (step S31).

The dead zone determination unit 107 determines whether or not the previous “positive (positive direction)” movement determination is “1” (step S32). When the previous "positive" motion determination is "1", the dead zone determination unit 107 sets a small dead zone width in the positive direction (step S33). On the other hand, when the previous "positive" motion determination is "0" (not "1"), the dead zone determination unit 107 sets a large dead zone width in the positive direction (step S34). The positive direction indicates the direction in which the frame becomes larger, and the negative direction indicates the direction in which the frame becomes smaller.

Next, the dead zone determination unit 107 determines whether or not the previous “negative” movement determination is “1” (step S35). When the previous "negative (negative direction)" motion determination is "1", the dead zone determination unit 107 sets a small dead zone width in the negative direction (step S36). On the other hand, when the previous "negative" motion determination is "0" (not "1"), the dead zone determination unit 107 sets a large dead zone width in the negative direction (step S37).

Next, the dead zone determination unit 107 sets the dead zone based on the size after the previous dead zone treatment using the dead zone width set by the above processing (step S38).

Moving on to FIG. 13, the dead zone determination unit 107 then determines whether or not the acquired face size this time exceeds the dead zone set this time (step S39). When the acquired face size this time exceeds the dead zone set this time, the dead zone determination unit 107 determines whether or not it exceeds the dead zone in the positive direction (step S40). Then, when the size of the face this time exceeds the positive direction, the dead zone determination unit 107 sets the motion determination to "positive: 1" and "negative: 0" (step S41).

.. On the other hand, when the size of the face this time exceeds the negative direction, the target detection unit 103 sets the motion determination to "positive: 0" and "negative: 1" (step S42). After that, the display control unit 109 displays the face frame using the size information detected this time for displaying the face frame (step S43).

On the other hand, when it is determined that the size of the face this time does not exceed the dead zone, the movement determination this time is set to "positive: 0" and "negative: 0" (step S44). Then, the current size information is overwritten with the previous size information (step S45). After that, the display control unit 109 uses the previous size information for displaying the face frame (step S46).

As explained above, if the size of the target is within the range of the previous dead zone, the target frame displayed last time is displayed, so for small fluctuations (variations in size), the size for displaying the target frame is displayed. The target frame can be displayed stably without changing the information. In addition, when the size of the target is outside the range of the previous dead zone, the target frame corresponding to the target detected this time is displayed, so that the followability to the detected target (size followability) is improved. It is possible to display an excellent target frame.

<Others>

[Insensitive zone for position and size]

In the above description, the dead zone for the position of the target frame has been described in the first embodiment, and the dead zone for the size of the target frame has been described in the second embodiment.

In the present invention, the dead zone can also be determined with respect to the position and size of the target frame. That is, the dead zone is set at the same time with respect to the position and size of the target frame. In this way, by setting the dead zone with respect to the position and size of the target frame, it is possible to display the target frame more stably with good followability to the target.

[Continuous image]

In the above description, the target is detected by the target detection unit 103 and the target frame is determined by the target frame determination unit 105 for the image acquired by the image acquisition unit 101. However, the present invention is not limited to this aspect. For example, the continuous image acquired by the image acquisition unit 101 may have information regarding the position of the detected target and the position of the target frame which is the range of the target. Further, for example, the continuous image acquired by the image acquisition unit 101 may have information on the size of the detected target and the size of the target frame which is the range of the target. In this case, the image display device 11 does not need to detect the target (target detection unit 103) and determine the target frame (target frame determination unit 105) from the acquired image.

<Smartphone configuration>

In the above description, a camera has been used as an example of the image pickup apparatus 10 in FIG. 1, but the application of the present invention is not limited to this. Other embodiments to which the present invention can be applied include, for example, mobile phones and smartphones having a camera function, PDAs (Personal Digital Assistants), and portable game machines. Hereinafter, an example of a smartphone to which the present invention can be applied will be described. The CPU 240 in FIG. 4 corresponds to the main control unit 501, the storage unit 260 corresponds to the storage unit 550, and the monitor 30 corresponds to the display panel 521.

FIG. 14 is a diagram showing the appearance of the smartphone 500. The smartphone 500 shown in FIG. 14 has a flat plate-shaped housing 502, and a display input in which a display panel 521 as a display unit and an operation panel 522 as an input unit are integrated on one surface of the housing 502. The unit 520 is provided. Further, the housing 502 includes a speaker 531, a microphone 532, an operation unit 540, and a camera unit 541. The configuration of the housing 502 is not limited to this, and for example, a configuration in which the display unit and the input unit are independent can be adopted, or a configuration having a folding structure or a slide mechanism can be adopted.

FIG. 15 is a block diagram showing the configuration of the smartphone 500 shown in FIG. As shown in FIG. 15, as the main components of the smartphone, a wireless communication unit 510 that performs mobile wireless communication via a base station and a mobile communication network, a display input unit 520, a call unit 530, and an operation unit 540. A camera unit 541, a storage unit 550, an external input / output unit 560, a GPS (Global Positioning System) receiving unit 570, a motion sensor unit 580, a power supply unit 590, and a main control unit 501 are provided.

The wireless communication unit 510 performs wireless communication with the base station accommodated in the mobile communication network in accordance with the instruction of the main control unit 501. Using this wireless communication, various file data such as voice data and image data, transmission / reception of e-mail data, and reception of Web data and streaming data are performed.

The display input unit 520 displays images (still images and moving images), character information, and the like under the control of the main control unit 501, visually conveys information to the user, and detects user operations for the displayed information. It is a touch panel and includes a display panel 521 and an operation panel 522.

The display panel 521 uses an LCD (Liquid Crystal Display), an OLED (Organic Electro-Luminescence Display), or the like as a display device. The operation panel 522 is a device on which an image displayed on the display surface of the display panel 521 is visibly placed and detects one or a plurality of coordinates operated by a user's finger or a stylus. When such a device is operated with a user's finger or a stylus, a detection signal generated due to the operation is output to the main control unit 501. Next, the main control unit 501 detects the operation position (coordinates) on the display panel 521 based on the received detection signal.

As shown in FIG. 14, the display panel 521 and the operation panel 522 of the smartphone 500 exemplified as an embodiment of the image pickup apparatus 10 of the present invention integrally constitute a display input unit 520, but the operation is performed. The panel 522 is arranged so as to completely cover the display panel 521. When such an arrangement is adopted, the operation panel 522 may have a function of detecting a user operation even in an area outside the display panel 521. In other words, the operation panel 522 has a detection area (hereinafter referred to as a display area) for the overlapping portion overlapping the display panel 521 and a detection area (hereinafter, non-display area) for the outer edge portion not overlapping the other display panel 521. ) And may be provided.

The size of the display area and the size of the display panel 521 may be completely matched, but it is not always necessary to match the two. Further, the operation panel 522 may be provided with two sensitive regions, an outer edge portion and an inner portion other than the outer edge portion. Further, the width of the outer edge portion is appropriately designed according to the size of the housing 502 and the like. Further, examples of the position detection method adopted in the operation panel 522 include a matrix switch method, a resistance film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, a capacitance method, and the like, and any of these methods is adopted. You can also do it.

The call unit 530 includes a speaker 531 and a microphone 532, converts the user's voice input through the microphone 532 into voice data that can be processed by the main control unit 501, and outputs the data to the main control unit 501, or a wireless communication unit. The voice data received by the 510 or the external input / output unit 560 is decoded and output from the speaker 531. Further, as shown in FIG. 14, for example, the speaker 531 and the microphone 532 can be mounted on the same surface as the surface on which the display input unit 520 is provided.

The operation unit 540 is a hardware key using a key switch or the like, and receives an instruction from the user. For example, as shown in FIG. 14, the operation unit 540 is mounted on the side surface of the housing 502 of the smartphone 500, and is turned on when pressed with a finger or the like, and turned off by a restoring force such as a spring when the finger is released. It is a push button type switch.

The storage unit 550 includes the control program of the main control unit 501, control data, application software, address data associated with the name and telephone number of the communication partner, e-mail data sent / received, Web data downloaded by Web browsing, and Web data downloaded by Web browsing. It stores downloaded content data and temporarily stores streaming data and the like. Further, the storage unit 550 is composed of an internal storage unit 551 built in the smartphone and an external storage unit 552 having a detachable external memory slot. The internal storage unit 551 and the external storage unit 552 constituting the storage unit 550 include a flash memory type, a hard disk type, and a multimedia card micro type. It is realized by using a recording medium such as a card type memory (for example, Micro SD (registered trademark) memory), RAM (Random Access Memory), ROM (Read Only Memory), and the like.

The external input / output unit 560 serves as an interface with all external devices connected to the smartphone 500, and communicates with other external devices (for example, universal serial bus (USB), IEEE 1394, etc.) or Network (for example, Internet, wireless LAN (Local Area Network), Bluetooth (Bluetooth) (registered trademark), RFID (Radio Frequency Identification), Infrared Data Association (IrDA) (registered trademark), UWB (Ultra Wideband) ( It is for direct or indirect connection by (registered trademark), ZigBee (registered trademark), etc.).

Examples of the external device connected to the smartphone 500 include a presence / wireless headset, a presence / wireless external charger, a presence / wireless data port, a memory card connected via a card socket, and a SIM (Subscriber). External audio / video device connected via Identity Module Card) / UIM (User Identity Module Card) card or audio / video I / O (Input / Output) terminal, external audio / video device wirelessly connected, Yes / wireless connection There are smartphones, personal computers that are connected / wirelessly connected, PDAs that are connected / wirelessly connected, and earphones. The external input / output unit 560 can transmit the data transmitted from such an external device to each component inside the smartphone 500, or can transmit the data inside the smartphone 500 to the external device.

The GPS receiving unit 570 receives GPS signals transmitted from the GPS satellites ST1 to STn according to the instruction of the main control unit 501, executes positioning calculation processing based on the received plurality of GPS signals, and determines the latitude of the smartphone 500. Detects a position consisting of longitude and altitude. When the GPS receiving unit 570 can acquire the position information from the wireless communication unit 510 or the external input / output unit 560 (for example, wireless LAN), the GPS receiving unit 570 can also detect the position using the position information.

The motion sensor unit 580 includes, for example, a three-axis acceleration sensor and a gyro sensor, and detects the physical movement of the smartphone 500 according to the instruction of the main control unit 501. By detecting the physical movement of the smartphone 500, the moving direction and acceleration of the smartphone 500 are detected. This detection result is output to the main control unit 501.

The power supply unit 590 supplies electric power stored in a battery (not shown) to each unit of the smartphone 500 according to the instruction of the main control unit 501.

The main control unit 501 includes a microprocessor, operates according to the control program and control data stored in the storage unit 550, and controls each unit of the smartphone 500 in an integrated manner. Further, the main control unit 501 includes a mobile communication control function and an application processing function that control each unit of the communication system in order to perform voice communication and data communication through the wireless communication unit 510.

The application processing function is realized by operating the main control unit 501 according to the application software stored in the storage unit 550. Examples of the application processing function include an infrared communication function that controls an external input / output unit 560 to perform data communication with an opposite device, an e-mail function that sends and receives e-mail, a web browsing function that browses a web page, and the present invention. There is an image processing function that performs compression processing related to.

Further, the main control unit 501 has an image processing function such as displaying an image on the display input unit 520 based on image data (still image or moving image data) such as received data or downloaded streaming data. The image processing function refers to a function in which the main control unit 501 decodes the image data, performs image processing on the decoded result, and displays the image on the display input unit 520.

Further, the main control unit 501 executes display control for the display panel 521 and operation detection control for detecting a user operation through the operation unit 540 and the operation panel 522.

By executing the display control, the main control unit 501 displays a software key such as an icon and a scroll bar for starting the application software, or displays a window for composing an e-mail. The scroll bar is a software key for receiving an instruction to move a display portion of an image for a large image or the like that cannot fit in the display area of the display panel 521.

Further, by executing the operation detection control, the main control unit 501 detects the user operation through the operation unit 540, accepts the operation for the icon through the operation panel 522, and receives the input of the character string in the input field of the window, or scrolls. Accepts scrolling requests for displayed images through the bar.

Further, by executing the operation detection control, the main control unit 501 has an overlapping portion (display area) in which the operation position with respect to the operation panel 522 overlaps the display panel 521, or an outer edge portion (non-display area) in which the operation position does not overlap the other display panel 521. ), And has a touch panel control function to control the sensitive area of the operation panel 522 and the display position of the software key.

Further, the main control unit 501 can detect a gesture operation on the operation panel 522 and execute a preset function according to the detected gesture operation. Gesture operation is not a conventional simple touch operation, but an operation of drawing a locus with a finger or the like, specifying multiple positions at the same time, or combining these to draw a locus of at least one from multiple positions. means.

The camera unit 541 is a CMOS (Complementary Metal Oxide Semiconductor) or a CCD.

It is a digital camera that electronically photographs using an image pickup device such as a (Charge-Coupled Device), and corresponds to the image pickup device 10 shown in FIG. Further, the camera unit 541 compresses the image data of the still image obtained by shooting under the control of the main control unit 501 by, for example, JPEG (Joint Photographic coding Experts Group), or compresses the image data of the moving image, for example, H. It can be compressed by 264 / AVC and recorded in the storage unit 550, or output through the external input / output unit 560 or the wireless communication unit 510. As shown in FIG. 14, in the smartphone 500, the camera unit 541 is mounted on the same surface as the display input unit 520, but the mounting position of the camera unit 541 is not limited to this, and is mounted on the back surface of the display input unit 520. Alternatively, a plurality of camera units 541 may be mounted. When a plurality of camera units 541 are mounted, the camera units 541 used for shooting can be switched for shooting independently, or the plurality of camera units 541 can be used at the same time for shooting.

Further, the camera unit 541 can be used for various functions of the smartphone 500. For example, the image acquired by the camera unit 541 can be displayed on the display panel 521, or the image of the camera unit 541 can be used as one of the operation inputs of the operation panel 522. Further, when the GPS receiving unit 570 detects the position, the position can be detected by referring to the image from the camera unit 541. Further, referring to the image from the camera unit 541, the optical axis direction of the camera unit 541 of the smartphone 500 is not used or is used in combination with the 3-axis accelerometer (gyro sensor). It is also possible to judge the current usage environment. Of course, the image from the camera unit 541 can also be used in the application software.

In addition, position information acquired by the GPS receiving unit 570, audio information acquired by the microphone 532 (may be converted into text information by voice text conversion by the main control unit or the like), still image or moving image data. It is also possible to add posture information or the like acquired by the motion sensor unit 580 and record it in the storage unit 550, or output it through the external input / output unit 560 or the wireless communication unit 510.

Although the example of the present invention has been described above, it is needless to say that the present invention is not limited to the above-described embodiment and various modifications can be made without departing from the spirit of the present invention.

1: Strobe

2: Shutter button

3: Power / mode switch

4: Mode dial

5: Zoom button

6: Cross button

7: MENU / OK button

8: Play button

9: BACK button

10: Imaging device

11: Image display device

12: Shooting lens

30: Monitor

101: Image acquisition unit

103: Target detection unit

105: Target frame determination unit

107: Insensitive zone determination unit

109: Display control unit

110: Zoom lens

111: Information addition part

140: Lens drive unit

150: Focus lens

210: Image sensor

230: A / D converter

240: CPU

250: Operation unit

260: Storage unit

Claims (21)

It is an image display device

An image acquisition unit that acquires continuous images, and

A target detection unit that detects a target from the image,

A target frame determination unit that determines a target frame within the range of the target from the latest image in the image, and a target frame determination unit.

A dead zone determination unit that determines a dead zone with respect to the position of the target frame,

A storage unit that stores the previous target frame corresponding to the target frame determined from the image one image before, and the previous dead zone corresponding to the dead zone determined from the image one image before.

A display control unit that displays the target frame when the position of the target is outside the range of the previous dead zone, and displays the previous target frame when the position is within the range of the previous dead zone.

An image display device.

The target detection unit detects the position information of the target and

The image display device according to claim 1, wherein the dead zone determination unit changes the dead zone based on the position information.

The image display according to claim 2, wherein the dead zone determination unit performs motion determination of the target based on the position information and the previous dead zone, and changes the previous dead zone based on the result of the motion determination. Device.

It is an image display device

An image acquisition unit that acquires continuous images, and

A target detection unit that detects a target from the image,

A target frame determination unit that determines a target frame within the range of the target from the latest image in the image, and a target frame determination unit.

A dead zone determination unit that determines a dead zone with respect to the size of the target frame,

A storage unit that stores the previous target frame corresponding to the target frame determined from the image one image before, and the previous dead zone corresponding to the dead zone determined from the image one image before.

When the size of the target is outside the range of the previous dead zone, the target frame is displayed, and when the size is within the range of the previous dead zone, the display control unit displays the previous target frame. ,

An image display device.

The target detection unit detects the size information of the target and

The image display device according to claim 4, wherein the dead zone determination unit changes the dead zone based on the size information.

The image according to claim 5, wherein the dead zone determination unit performs motion determination of the target based on the size information and the previous dead zone, and changes the previous dead zone based on the result of the motion determination. Display device.

The image display device according to claim 3 or 6, wherein the dead zone determining unit reduces the dead zone in the first direction when the result of the motion determination indicates a first direction.

The image display device according to claim 7, wherein the dead zone determining unit increases the dead zone in the first direction when the result of the motion determination does not indicate the first direction.

The image display device according to any one of claims 2, 3, and 5 to 8, wherein the change of the dead zone changes the position or size of the dead zone by the target detected by the target detection unit.

It is an image display device

An image acquisition unit that acquires an image that is a continuous image and has information on the detected position of the target and the position of the target frame that is the range of the target.

A dead zone determination unit that determines a dead zone with respect to the position of the target frame,

A storage unit that stores the previous target frame corresponding to the target frame determined from the image one image before, and the previous dead zone corresponding to the dead zone determined from the image one image before.

A display control unit that displays the target frame when the position of the target is outside the range of the previous dead zone, and displays the previous target frame when the position is within the range of the previous dead zone.

An image display device.

It is an image display device

An image acquisition unit that acquires an image that is a continuous image and has information on the size of the detected target and the size of the target frame that is the range of the target.

A dead zone determination unit that determines a dead zone with respect to the size of the target frame,

A storage unit that stores the previous target frame corresponding to the target frame determined from the image one image before, and the previous dead zone corresponding to the dead zone determined from the image one image before.

When the size of the target is outside the range of the previous dead zone, the target frame is displayed, and when the size is within the range of the previous dead zone, the display control unit displays the previous target frame. ,

An image display device.

The image display device according to any one of claims 1 to 11, further comprising an information addition unit for recording the position information or size information of the target frame displayed by the display control unit on an image.

The image display device according to any one of claims 1 to 12, wherein the dead zone is the width of the dead zone with respect to the target frame, and the initial value of the dead zone is constant.

The image display device according to any one of claims 1 to 13, wherein the target detected by the target detection unit is an object.

The image display device according to claim 14, wherein the object is a face or eyes.

The image display device according to any one of claims 1 to 15, wherein the target frame is rectangular.

The image display device according to any one of claims 1 to 16, wherein the target frame is an ellipse.

It is an image display method

Steps to get continuous images and

The step of detecting an object from the image and

A step of determining a target frame within the range of the target from the latest image in the image, and

The step of determining the dead zone for the position of the target frame and

A step of storing the previous target frame corresponding to the target frame determined from the image one image before, and the previous dead zone corresponding to the dead zone determined from the image one image before.

When the position of the target is outside the range of the previous dead zone, the target frame is displayed, and when the position is within the range of the previous dead zone, the previous target frame is displayed.

Image display method including.

It is an image display method

Steps to get continuous images and

The step of detecting an object from the image and

A step of determining a target frame within the range of the target from the latest image in the image, and

The step of determining the dead zone for the size of the target frame and

A step of storing the previous target frame corresponding to the target frame determined from the image one image before, and the previous dead zone corresponding to the dead zone determined from the image one image before.

If the size of the target is outside the range of the previous dead zone, the target frame is displayed, and if it is within the range of the previous dead zone, the previous target frame is displayed.

Image display method including.

A program that causes a computer to execute the image display process.

Steps to get continuous images and

The step of detecting an object from the image and

A step of determining a target frame within the range of the target from the latest image in the image, and

The step of determining the dead zone for the position of the target frame and

A step of storing the previous target frame corresponding to the target frame determined from the image one image before, and the previous dead zone corresponding to the dead zone determined from the image one image before.

When the position of the target is outside the range of the previous dead zone, the target frame is displayed, and when the position is within the range of the previous dead zone, the previous target frame is displayed.

A program that causes a computer to execute an image display process including.

A program that causes a computer to execute the image display process.

Steps to get continuous images and

The step of detecting an object from the image and

A step of determining a target frame within the range of the target from the latest image in the image, and

The step of determining the dead zone for the size of the target frame and

A step of storing the previous target frame corresponding to the target frame determined from the image one image before, and the previous dead zone corresponding to the dead zone determined from the image one image before.

If the size of the target is outside the range of the previous dead zone, the target frame is displayed, and if it is within the range of the previous dead zone, the previous target frame is displayed.

A program that causes a computer to execute an image display process including.

Images