JP2023024485A - Image display device, image display method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display device, an image display method, and a program for stably displaying an object frame without damaging followability with respect to a detected object.

SOLUTION: An image display device 11 is provided with: an image acquisition unit 101 that acquires successive images; an object detection unit 103 that detects an object from the images; an object frame determination unit 105 that determines an object frame which is a range of the object from the latest image among the images; an insensitive zone determination unit that determines an insensitive zone with respect to the position of the object frame; a storage unit 260 that stores a preceding object frame which corresponds to an object frame determined from an immediately preceding image and a preceding insensitive zone which corresponds to an insensitive zone determined from the immediately preceding image; and a display control unit 109 that displays the object frame when the position of the object is outside the range of the preceding insensitive zone, and displays the preceding object frame when the position of the object is within the range of the preceding insensitive zone.

SELECTED DRAWING: Figure 4

COPYRIGHT: (C)2023,JPO&INPIT

Description

The present invention relates to an image display device, an image display method, and a program, and more particularly to an image display device, an image display method, and a program for displaying an object frame indicating the range of a detected object.

Conventionally, when photographing with a digital camera, if the subject is a person, face detection is performed, and a face frame (target frame) is displayed based on information on the position and size of the detected face. It is

2. Description of the Related Art Techniques have been proposed for stably displaying target frames when successively displaying target frames on a display unit configured by an LCD (Liquid Crystal Display) of a digital camera.

For example, when the detection and non-detection of the face area are repeated in the shooting standby state, and the target frame (square frame) for indicating the face area is displayed or not displayed on the live view image (through image). There is The technique described in Patent Literature 1 aims to suppress the repetition of display and non-display of the target frame. In the technique described in Patent Document 1, when the subject area is not detected, the previously set detected subject area is continued and the target frame is displayed as the detected subject area.

JP 2007-221312 A

Here, the target frame to be displayed becomes an unstable display depending on the movement of the target to be detected. For example, when the detection target is a face, the target frame moves to follow even a minute movement of the face, resulting in unstable display of the target frame. On the other hand, in order to suppress the fluctuation range of the target frame, a technique has been proposed in which the target frame is displayed by halving the amount of movement.

The technology described in Patent Literature 1 is a technology intended to suppress repeated display and non-display of the target frame, and mentions the unstable display of the target frame due to the movement of the target. not

The present invention has been made in view of such circumstances, and an object of the present invention is to provide an image display device, an image display method, and a program for stably displaying an object frame without impairing the followability to a detected object. is to provide

An image display device, which is one aspect of the present invention for achieving the above object, comprises an image acquisition unit that acquires successive images, a target detection unit that detects a target from the images, and a target from the latest image among the images. a target frame determination unit that determines a target frame within the range of the target frame, a dead band determination unit that determines a dead band with respect to the position of the target frame, a previous target frame corresponding to the target frame determined from the image one image before, and one A storage unit for storing the previous dead zone corresponding to the dead zone determined from the image before the image, and if the position of the object is outside the range of the previous dead zone, the object frame is displayed and the range of the previous dead zone is displayed. In the case, a display control unit for displaying the previous target frame.

According to this aspect, when the target position is within the range of the previous dead zone, the previously displayed target frame is displayed. It is possible to stably display the target frame without Also, if the position of the target is outside the range of the previous dead zone, the target frame corresponding to the target detected this time is displayed. A frame can be displayed.

Preferably, the target detection section detects position information of the target, and the dead zone determination section changes the dead zone based on the position information.

Preferably, the dead zone determination unit performs motion determination of the object based on the position information and the previous dead zone, and changes the previous dead zone based on the motion determination result.

An image display device according to another aspect of the present invention includes an image acquisition unit that acquires continuous images, a target detection unit that detects a target from the images, and a target frame that is the range of the target from the latest image in the image. A target frame determination unit to determine, a dead band determination unit to determine a dead band for the size of the target frame, a previous target frame corresponding to the target frame determined from the image one image before, and the image one image before If the size of the object is outside the range of the previous dead zone, the object frame is displayed, and if it is within the range of the previous dead zone, the previous dead zone is stored. and a display control unit that displays the target frame of.

According to this aspect, when the size of the target is within the range of the previous dead zone, the previously displayed target frame is displayed. The target frame can be stably displayed without changing the information. In addition, when the position of the target is outside the range of the previous dead zone, the target frame corresponding to the target detected this time is displayed. A target frame can be displayed.

Preferably, the object detection unit detects size information of the object, and the dead zone determination unit changes the dead zone based on the size information.

Preferably, the dead zone determination unit performs motion determination of the object based on the size information and the previous dead zone, and changes the previous dead zone based on the motion determination result.

Preferably, the dead zone determination unit reduces the dead zone in the first direction when the motion determination result indicates the first direction.

Preferably, the dead zone determiner increases the dead zone in the first direction when the motion determination result does not indicate the first direction.

Preferably, the change of the dead zone changes the position or size of the dead zone according to the target detected by the target detection unit.

An image display device according to another aspect of the present invention is an image acquisition unit configured to acquire continuous images having information about the position of a detected target and the position of a target frame that is the range of the target; A dead zone determining unit that determines the dead zone for the position of the target frame, the previous target frame corresponding to the target frame determined from the image one image before, and the previous dead zone corresponding to the dead zone determined from the image one image before. a storage unit for storing, a display control unit for displaying the target frame when the position of the target is outside the range of the previous dead zone, and displaying the previous target frame when the position is within the range of the previous dead zone. , provided.

An image display device according to another aspect of the present invention is an image acquisition unit that acquires images that are continuous images and that have information about the size of a detected object and the size of an object frame that is the range of the object. , a dead zone determination unit that determines a dead zone with respect to the size of the target frame, a previous target frame corresponding to the target frame determined from the image one image before, and a previous target frame corresponding to the dead zone determined from the image one image before When the size of the object is out of the range of the previous dead band, the target frame is displayed, and when it is within the range of the previous dead band, the previous target frame is displayed. and a display control unit.

Preferably, an information addition unit is provided for recording the position information of the displayed target frame in the image by the display control unit.

Preferably, the dead zone is a dead zone width with respect to the target frame, and the initial value of the dead zone is constant.

Preferably, the target detected by the target detection unit is an object.

Preferably the object is a face or an eye.

Preferably, the target frame is rectangular.

Preferably, the target frame is an ellipse.

An image display method, which is another aspect of the present invention, comprises the steps of acquiring successive images, detecting a target from the images, and determining a target frame, which is the range of the target, from the latest image in the images. , a step of determining a dead zone with respect to the position of the object frame, and storing the previous object frame corresponding to the object frame determined from the image one image before and the previous dead zone corresponding to the dead zone determined from the image one image before. and displaying the object frame when the position of the object is outside the range of the previous dead zone, and displaying the previous object frame when the position is within the range of the previous dead zone.

An image display method, which is another aspect of the present invention, comprises the steps of acquiring successive images, detecting a target from the images, and determining a target frame, which is the range of the target, from the latest image in the images. a step of determining a dead zone for the size of the object frame; a step of storing, a step of displaying the object frame when the size of the object is outside the range of the previous dead zone, and displaying the previous object frame when the size is within the range of the previous dead zone. include.

According to another aspect of the present invention, there is provided a program comprising the steps of acquiring successive images, detecting a target from the images, determining a target frame that is the range of the target from the latest image in the images, a step of determining a dead zone with respect to the position of the frame; a step of storing the previous target frame corresponding to the target frame determined from the image one image before and the previous dead zone corresponding to the dead zone determined from the image one image before; and displaying the target frame when the position of the target is outside the range of the previous dead zone, and displaying the previous target frame when the target position is within the range of the previous dead zone. run on the computer.

According to another aspect of the present invention, there is provided a program comprising the steps of acquiring successive images, detecting a target from the images, determining a target frame that is the range of the target from the latest image in the images, A step of determining a dead zone with respect to the size of the frame, and storing the previous target frame corresponding to the target frame determined from the image one image before and the previous dead zone corresponding to the dead zone determined from the image one image before. and displaying the target frame when the size of the target is outside the range of the previous dead band, and displaying the previous target frame when the size of the target is within the range of the previous dead band. A display process is performed by a computer.

According to the present invention, when the target position is within the range of the previous dead zone, the previously displayed target frame is displayed. Also, if the position of the target is outside the range of the previous dead zone, the target frame corresponding to the target detected this time is displayed. It is possible to display the target frame.

FIG. 1 is a perspective view showing an example of an imaging device. FIG. 2 is a rear view showing an example of an imaging device. FIG. 3 is a diagram showing the configuration of the imaging device. FIG. 4 is a block diagram showing a main functional configuration example of the image display device. FIG. 5 is a diagram for explaining the dead zone. FIG. 6 is a diagram for explaining the dead zone. FIG. 7 is a diagram showing a specific example of determination of the dead zone. FIG. 8 is a flow chart showing an image display method. FIG. 9 is a flow chart showing an image display method. FIG. 10 is a diagram showing a specific example of dead zone processing. FIG. 11 is a diagram for explaining the dead zone of the size of the target frame. FIG. 12 is a flow chart showing an image display method. FIG. 13 is a flow chart showing an image display method. FIG. 14 is a diagram showing the appearance of a smartphone. FIG. 15 is a block diagram showing the configuration of a smartphone.

DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of an image display device, an image display method, and a program according to the present invention will be described below with reference to the accompanying drawings.

[Imaging device]
1 and 2 are a perspective view and a rear view, respectively, showing an example of an imaging device (digital camera) equipped with an image display device of the present invention.

The image display device 11 (see FIG. 4) is mounted on the imaging device 10 and displays a live view image (through image) captured by the imaging device 10 . Note that the image display device 11 can also display recorded moving images.

The image capturing apparatus 10 is a digital camera that receives light through a lens with an image sensor, converts the signal into a digital signal, and records the image data of a still image or a moving image on a recording medium.

As shown in FIG. 1, an imaging device 10 has a photographing lens 12, a strobe 1, etc. on its front surface, and a shutter button 2, a power/mode switch 3, a mode dial 4, etc. on its top surface. On the other hand, as shown in FIG. 2, a monitor (LCD) 30, a zoom button 5, a cross button 6, a MENU/OK button 7, a playback button 8, a BACK button 9, etc. are arranged on the back of the camera.

The photographing lens 12 is a collapsible zoom lens, and is extended from the camera body by setting the operation mode of the camera to the photographing mode with the power/mode switch 3 . A strobe 1 irradiates a main subject with strobe light.

The shutter button 2 is composed of a two-stage stroke type switch consisting of a so-called "half-press" and "full-press", and functions as an image recording instruction section as well as a photographing preparation instruction section.

When the still image shooting mode is selected as the shooting mode and the shutter button 2 is "half-pressed", the imaging apparatus 10 performs a shooting preparation operation for performing AF (Autofocus)/AE (Auto Exposure) control. When is "full-pressed", a still image is captured and recorded.

In addition, the imaging device 10 starts recording a moving image when the moving image shooting mode is selected as the shooting mode and the shutter button 2 is fully pressed. stop and wait.

The power/mode switch 3 has both a function as a power switch for turning ON/OFF the power of the imaging device 10 and a function as a mode switch for setting the mode of the imaging device 10. It is disposed so as to be slidable between "position" and "photographing position". The imaging device 10 is powered on by sliding the power/mode switch 3 to the "reproduction position" or "shooting position", and is powered off by sliding it to the "OFF position". Then, by sliding the power/mode switch 3 to the "playback position", the "playback mode" is set, and by setting it to the "shooting position", the "shooting mode" is set.

The mode dial 4 functions as a mode switching section for setting the shooting mode of the imaging device 10 , and the shooting mode of the imaging device 10 is set to various modes depending on the setting position of the mode dial 4 . For example, there are a “still image shooting mode” for shooting still images, a “moving image shooting mode” for shooting moving images, and the like.

The monitor 30 functions as a display unit, displays a live view image in shooting mode, displays a still image or a moving image in playback mode, and displays a menu screen, etc., to serve as a part of the graphical user interface. Function.

The zoom button 5 functions as zoom instruction means for instructing zooming, and includes a tele button 5T for instructing zooming to the telephoto side and a wide button 5W for instructing zooming to the wide angle side. In the image pickup apparatus 10, the focal length of the photographing lens 12 is changed by operating the tele button 5T and the wide button 5W in the photographing mode. Further, when the tele button 5T and the wide button 5W are operated in the reproduction mode, the image being reproduced is enlarged or reduced.

The cross button 6 is an operation unit for inputting instructions in four directions, up, down, left, and right. Function. The left/right keys function as frame advance (forward/reverse) buttons in playback mode.

The MENU/OK button 7 is an operation button having both a function as a menu button for issuing a command to display a menu on the screen of the monitor 30 and a function as an OK button for commanding determination and execution of selected contents. is.

The playback button 8 is a button for switching to a playback mode for displaying a captured and recorded still image or moving image on the monitor 30 .

The BACK button 9 functions as a button for instructing cancellation of an input operation or returning to the previous operation state.

In the imaging apparatus 10 according to the present embodiment, instead of providing specific members for the buttons/switches, a touch panel is provided and operated to realize the functions of the buttons/switches. good too.

[Internal configuration of imaging device]
FIG. 3 is a diagram showing the configuration of the imaging device 10. As shown in FIG. The imaging apparatus 10 forms a subject image (optical image) on the imaging device 210 through the imaging lens 12 .

The photographing lens 12 is composed of a zoom lens 110 and a focus lens 150 . The imaging device 10 also includes an aperture 130 and a lens driver 140 . The lens drive unit 140 advances and retreats the zoom lens 110 and the focus lens 150 according to commands from the CPU 240 as a control unit to perform zoom (optical zoom) adjustment and focus adjustment. The zoom adjustment and the focus adjustment may be performed according to a command from the CPU 240, or may be performed according to a zoom operation and a focus operation performed by the user. In addition, the lens driving section 140 controls the aperture 130 in accordance with instructions from the CPU 240 to adjust the exposure. On the other hand, information such as the positions of the zoom lens 110 and the focus lens 150 and the opening degree of the diaphragm 130 is input to the CPU 240 .

The imaging device 10 includes an imaging element 210 , an AFE 220 (AFE: Analog Front End), an A/D converter 230 (A/D: Analog to Digital), a CPU 240 , an operation section 250 , a storage section 260 and a monitor 30 . The imaging device 10 may have a mechanical shutter (not shown) for blocking light to be transmitted through the imaging element 210 . The imaging element 210 has a light receiving surface in which a large number of light receiving elements are arranged in a matrix, and subject light transmitted through the zoom lens 110, the focus lens 150, and the diaphragm 130 forms an image on the light receiving surface of the imaging element 210, It is converted into an electric signal by each light receiving element. A color filter of R (red), G (green), or B (blue) is provided on the light receiving surface of the imaging device 210, and a color image of the subject can be acquired based on the signals of each color. As the imaging element 210, various photoelectric conversion elements such as CMOS (Complementary Metal-Oxide Semiconductor) and CCD (Charge-Coupled Device) can be used. The AFE 220 removes noise and amplifies the analog image signal output from the imaging device 210, and the A/D converter 230 converts the captured analog image signal into a digital image signal having a gradation range. The shutter may be either a mechanical shutter or an electronic shutter. In the case of an electronic shutter, the exposure time (shutter speed) can be adjusted by controlling the charge accumulation period of the imaging device 210 with the CPU 240 .

The storage unit 260 is composed of various magneto-optical recording media, non-temporary recording media such as semiconductor memory, and their control circuits, and stores moving images (including live view images) and still images. A recording medium of a detachable type with respect to the imaging device 10 can be used. In addition, the storage unit 260 stores programs, information used for various controls of the CPU 240, and the like.

The monitor 30 can display moving images (live view images, recorded moving images) and still images. The imaging device 10 may have a viewfinder, and the viewfinder functions as the monitor 30 . The finder is composed of, for example, a liquid crystal display panel, a prism, a lens, etc., and the user can view moving images and still images through an eyepiece (not shown). As a finder, an "optical view finder (OVF)", an "electronic view finder (EVF)", or a combination of these, a "hybrid view finder (HVF)" is used. can be used.

The CPU 240 reads necessary programs and information used for various controls from the storage unit 260 and performs various processes and controls performed by the CPU 240 .

The CPU 240 executes various controls. The hardware structure is various processors as shown below. For various processors, the circuit configuration can be changed after manufacturing such as CPU (Central Processing Unit), FPGA (Field Programmable Gate Array), which is a general-purpose processor that executes software (program) and acts as various functional units. Programmable Logic Device (PLD), which is a processor, ASIC (Application Specific Integrated Circuit), etc. be

One processing unit may be composed of one of these various processors, or composed of two or more processors of the same type or different types (for example, a plurality of FPGAs, or a combination of a CPU and an FPGA). may Also, a plurality of functional units may be configured by one processor. As an example of configuring a plurality of functional units in a single processor, first, as represented by computers such as clients and servers, a single processor is configured by combining one or more CPUs and software. There is a form in which a processor acts as a plurality of functional units. Secondly, as typified by System On Chip (SoC), etc., there is a form of using a processor that implements the functions of the entire system including multiple functional units with a single IC (Integrated Circuit) chip. be. In this way, various functional units are configured using one or more of the above various processors as a hardware structure.

<First embodiment>
Next, the first embodiment will be described. In this example, a dead zone is set for the position of the target frame.

FIG. 4 is a block diagram showing a main functional configuration example of the image display device 11 mounted on the imaging device 10. As shown in FIG. The image display device 11 includes an image acquisition unit 101 , an object detection unit 103 , an object frame determination unit 105 , a dead zone determination unit 107 , a display control unit 109 , an information addition unit 111 , a storage unit 260 and a monitor 30 . The image acquisition unit 101 , the object detection unit 103 , the object frame determination unit 105 , the dead zone determination unit 107 , the display control unit 109 and the information addition unit 111 are realized by the CPU 240 .

The image acquisition unit 101 acquires continuous images. Specifically, the image acquisition unit 101 acquires continuous images output from the A/D converter 230 . For example, the image acquisition unit 101 acquires a live view image composed of a plurality of frame images captured by the imaging device 10 .

A target detection unit 103 detects a target from the acquired image. For example, the object detection unit 103 detects a person's face using a known technique. The object detection unit 103 detects a person's face in the image, and acquires position information including position coordinates, for example. The object detection unit 103 can also detect objects other than faces. For example, the object detection unit 103 can detect the pupil.

The target frame determination unit 105 determines a target frame, which is the target range, from the latest image among the images. The object frame determination unit 105 determines object frames for objects detected in each of the plurality of images acquired by the image acquisition unit 101 . The target frame is for notifying the user of the detected target, and can adopt various shapes. The object frame is, for example, a rectangle containing a square, and the object frame is, for example, an ellipse containing a perfect circle.

The dead zone determining unit 107 determines a dead zone for displaying the target frame. The dead zone determination unit 107 determines, for example, a dead zone with respect to the position of the target frame. Here, the dead zone related to the display of the target frame means that when the target frame (or target) moves within the range of the dead zone, the target frame to be displayed is fixed without following the target, and the target frame (or target) is the dead zone. , the target frame to be displayed follows the target (the target frame corresponding to the target).

5 and 6 are diagrams for explaining the dead zone determined by the dead zone determination unit 107. FIG. 5 and 6 show the face 125 detected by the object detection unit 103 in the n-th frame, the object frame 121 determined by the object frame determination unit 105 according to the face 125, and the target frame 121 determined by the dead zone determination unit 107. A dead band 120 is shown. A face 127 detected by the object detection unit 103 in the (n+1)th frame and a target frame 123 determined by the target frame determination unit 105 according to the face 127 are also shown. In this example, the target frame 121 and the target frame 123 are determined with the same positional relationship for the face 125 and the face 127, respectively. In this example, the reference points for the position of the object or the position of the object frame are the reference point B1 (object frame 121) and the reference point B2 (object frame 123) at the upper left corner of the object frame.

In the case shown in FIG. 5, the face 127 detected in the (n+1)th frame is positioned within the range of the dead zone 120 set in the nth frame. That is, the (n+1)th reference point B2 is within the dead zone 120 . Therefore, the target frame 121 is also displayed in the (n+1)th frame.

In the case shown in FIG. 6, the face 127 detected in the (n+1)th frame is positioned outside the range of the dead zone 122 set in the nth frame. That is, the (n+1)th reference point B2 is outside the dead zone 122 . Therefore, the target frame 121 corresponding to the face 127 is displayed in the (n+1)th frame.

By setting a dead zone with respect to the position of the target to be detected in this way, it is possible to perform stable display without moving the display of the target frame in response to minute movements of the target, and to exceed the dead zone. The target frame can be displayed with good followability for the movement of the target.

In addition, the dead zone determining unit 107 can change the position and/or size of the dead zone according to the detected object. That is, the dead zone determination unit 107 can change the position and size of the dead zone according to the detected position of the target. Furthermore, the dead zone determination unit 107 can change the width of the dead zone according to the movement of the object. The dead zone determination unit 107 determines the motion of the object based on the position information and the previous dead zone, and changes the dead zone (previous dead zone) based on the motion determination result. For example, when the motion determination result indicates the first direction, the dead zone determination unit 107 reduces the dead zone in the first direction. That is, the width of the dead zone is set small in the direction in which the detected object is moving, thereby improving the followability of the object frame to the object. Further, when the motion determination result does not indicate the first direction, the dead zone determination unit 107 increases the dead zone in the first direction. That is, the width of the dead zone is set large in the direction in which the detected target is not moving, thereby improving the stability of the display of the target frame.

FIG. 7 is a diagram showing a specific example of the dead zone determined by the dead zone determination unit 107. As shown in FIG. In the case shown in FIG. 7, dead zones are determined in the positive and negative directions of the X-axis in the figure.

In the case shown in FIG. 7A, the widths of the dead zones in the positive and negative directions are the same as the previous display position P of the target frame. In this way, when it is unknown in which direction the object will move, by setting the width of the dead zone to be the same in the positive direction and the negative direction, it is possible to appropriately display the object frame. For example, the initial value of the dead zone may be constant, and dead zones having the same width in the positive and negative directions from the center of the angle of view may be provided. The case shown in FIG. 7B is a case in which the width of the dead zone is increased as a whole. In the case shown in FIG. 7C, the width of the dead zone is reduced as a whole. As shown in FIG. 7B, when the width of the dead zone is widened, the stability of the display of the target frame is improved. As shown in FIG. The followability of the display of the frame is improved. In the case shown in FIG. 7D, the motion determination by the dead zone determining unit 107 determines that the object has moved in the positive direction, and the width of the dead zone in the positive direction is reduced. In the case shown in FIG. 7D, it is determined that the object is not moving in the negative direction, and the width of the dead zone in the negative direction is increased. In the case shown in FIG. 7(E), it is determined that the object has moved in the negative direction in the motion determination of the dead zone determination unit 107, and the width of the dead zone in the negative direction is reduced. In the case shown in FIG. 7E, it is determined that the object is not moving in the positive direction, and the width of the dead zone in the positive direction is increased.

In this way, the dead zone determination unit 107 can stably display the target frame with good followability by changing the position and size of the dead zone according to the movement of the target.

Returning to FIG. 4, the storage unit 260 stores the previous target frame corresponding to the target frame determined from the image one image before and the previous dead zone corresponding to the dead zone determined from the image one image before. Specifically, the object frame 121 and dead zone 120 (dead zone 122) in the n-th frame described with reference to FIGS. 5 and 6 are stored. The previous target frame and the previous dead zone stored in the storage unit 260 are used for control of the display control unit 109 . The information stored in the storage unit 260 may be updated for each image, or information of each image may be accumulated.

The display control unit 109 controls display on the monitor 30 . The monitor 30 displays live view images, recorded moving images, and still images. In addition, the display control unit 109 displays the target frame superimposed on the live view image or the recorded moving image. The display control unit 109 displays the target frame when the position of the target is outside the range of the previous dead zone, and displays the previous target when it is within the range of the previous dead zone.

The information addition unit 111 records the position information of the displayed target frame in the image by the display control unit 109 . Specifically, the coordinate values of the displayed target frame are added to each frame. Information addition by the information addition unit 111 is performed by a known method.

Next, an image display method (image display process) using the image display device 11 will be described.

8 and 9 are flowcharts showing an image display method using the image display device 11. FIG. In this example, a face is detected as an object and a face frame corresponding to the detected face is displayed.

First, the image acquisition unit 101 acquires continuous frame images in which the face is captured (step S10). After that, the object detection unit 103 detects a face in each of the acquired frames and acquires position information of the detected face (step S11).

The dead zone determination unit 107 determines whether or not the previous "positive (positive direction)" motion determination was "1" (step S12). When the previous "positive" motion determination is "1", the dead zone determining unit 107 sets a dead zone width that is small in the positive direction (step S13). On the other hand, if the previous "positive" motion determination was "0" (not "1"), the dead zone determination unit 107 sets a dead zone width that is large in the positive direction (step S14).

Next, the dead zone determination unit 107 determines whether or not the previous "negative (negative direction)" motion determination was "1" (step S15). When the previous "negative" motion determination is "1", the dead zone determining unit 107 sets a narrow dead zone width in the negative direction (step S16). On the other hand, if the previous "negative" motion determination was "0" (not "1"), the dead zone determination unit 107 sets a large dead zone width in the negative direction (step S17).

Next, the dead zone determination unit 107 uses the dead zone width set by the above process to set the dead zone based on the coordinates after the previous dead zone process (step S18).

Moving to FIG. 9, the dead zone determining unit 107 determines whether or not the acquired face position this time exceeds the dead zone set as described above (step S19). When the current acquired face position exceeds the set dead zone, the dead zone determining unit 107 determines whether or not it exceeds in the positive direction (step S20). Then, when the current position of the face exceeds the positive direction, the dead zone determining unit 107 sets the motion determination to "positive: 1" and "negative: 0" (step S21). On the other hand, when the current position of the face exceeds in the negative direction, the object detection unit 103 sets the motion determination to "positive: 0" and "negative: 1" (step S22). After that, the display control unit 109 displays the face frame using the currently detected position information for displaying the face frame (step S23).

On the other hand, if it is determined that the current face position does not exceed the dead zone, the current motion determination is set to "positive: 0" and "negative: 0" (step S24). Then, the current position information is overwritten with the previous position information (step S25). After that, the display control unit 109 uses the previous position information for displaying the face frame (step S26).

Each configuration and function described above can be appropriately realized by arbitrary hardware, software, or a combination of both. For example, a program that causes a computer to execute the above-described processing steps (procedures), a computer-readable recording medium (non-temporary recording medium) recording such a program, or a computer capable of installing such a program However, it is possible to apply the present invention.

FIG. 10 is a diagram showing a specific example of dead zone processing. The graph shown in FIG. 10 shows a live view image in which a detection target is a face and a face frame is displayed according to the detected face. In FIG. 10, the horizontal axis indicates the number of face detections performed for each frame, and the vertical axis indicates the X coordinate on the display unit. The square line on the graph indicates the upper limit of the dead zone, the diamond line indicates the position (X coordinate) of the detected face, and the cross line indicates the post-processed face position (X coordinate). A line that indicates the position (X coordinate) for displaying the face frame and that is indicated by a triangle mark indicates the lower limit value of the dead zone. The display position of the face frame indicates the X coordinate of the center position of the frame. In the following description, the direction in which the X coordinate increases is defined as the positive direction, and the direction in which the X coordinate decreases as the negative direction.

From the detection count 170 to the timing indicated by the arrow T1, the face position is detected between the upper limit value of the dead band and the lower limit value of the dead band (within the dead band). Therefore, the display of the face frame does not change, and the face frame is displayed at a fixed position.

At the timing indicated by the arrow T2, the position of the face is detected beyond the upper limit of the dead zone, so the display position of the face frame is a position corresponding to the position of the detected face. Also, at the timing indicated by the arrow T2, the same dead band as the dead band at the timing indicated by the arrow T1 is set. This is because the face position is detected within the dead zone at the timing indicated by the arrow T1.

At the timing indicated by the arrow T3, the position of the face is detected beyond the upper limit of the dead zone, so the display position of the face frame is a position corresponding to the position of the detected face. At the timing of arrow T3, the dead zone is moved and the width of the dead zone is also changed. Specifically, at the timing of arrow T3, the face frame is displayed at a position exceeding the upper limit value of the dead zone at the timing of arrow T2, based on the display position of the face frame at the timing of arrow T2. At timing T3, the dead band width in the positive direction is reduced.

In this way, by providing a dead zone for display of the face frame, stable display of the face frame and followability to the position of the detected face are not impaired. Further, in the above-described mode, the width of the dead zone is adjusted based on the previous display position of the face frame, so that the position of the dead zone and the width of the dead zone are adjusted. It can be carried out.

<Second embodiment>
In the first embodiment, the dead zone with respect to the position was explained, but in the second embodiment, an example of setting the dead zone with respect to the size of the object frame will be explained. Each unit described with reference to FIG. 4 has the following functions in this embodiment. Note that, in the following description, features that are characteristic of the second embodiment will be described.

The object detection unit 103 detects an object and detects size information of the object. For example, the target detection unit 103 detects a target face and detects size information (area, length) of the face.

A target frame determination unit 105 determines a target frame, which is a target range, from the latest image. The size of the target frame is determined according to the size of the detected target. For example, when a face is detected, the size of the target frame is determined so as to enclose the range of the detected face.

The dead zone determination unit 107 can determine the motion of the object based on the size information and the previous dead zone, and change the previous dead zone based on the motion determination result. The dead zone determination unit 107 reduces the dead zone in the first direction when the motion determination result indicates the first direction. Here, the dead zone determining unit 107 can quantify the length of one side of the square face frame, and determine the movement by regarding the direction in which the number increases as the positive direction and the direction in which the number decreases as the negative direction.

The display control unit 109 displays the target frame when the size of the target is outside the range of the previous dead band, and displays the previous target frame when the size is within the range of the previous dead band.

The information addition unit 111 records the size information of the displayed target frame in the image by the display control unit 109 . Specifically, the size (area or length of one side) of the displayed target frame is added to each frame. Information addition by the information addition unit 111 is performed by a known method.

FIG. 11 is a diagram for explaining the dead zone of the size of the target frame. In FIG. 11, a target frame 131 indicates the lower limit of the dead band, a target frame 133 indicates the upper limit of the dead band, and a target frame 139 indicates a display target frame. For example, when a target corresponding to the target frame 137 within the range of the lower limit value of the dead band indicated by the target frame 131 and the upper limit value of the dead band indicated by the target frame 133 is detected, the display control unit 109 controls the target frame 139 display. On the other hand, when a target corresponding to the target frame 135 outside the range of the lower limit of the dead band indicated by the target frame 131 and the upper limit of the dead band indicated by the target frame 133 is detected, the display control unit 109 detects the target Frame 135 is displayed as a target frame for display.

Next, an image display method (image display process) using the image display device 11 will be described. In the image display method, faces are detected in successive frames, and face frames are successively displayed to inform the user of the positions of the detected faces.

12 and 13 are flowcharts showing an image display method (image display process) using the image display device 11. FIG.

First, the image acquisition unit 101 acquires continuous frame images in which the face is captured (step S30). After that, the object detection unit 103 detects a face in each of the acquired frames and acquires size information of the detected face (step S31).

The dead zone determining unit 107 determines whether or not the previous "positive (positive direction)" motion determination was "1" (step S32). When the previous "positive" motion determination is "1", the dead zone determining unit 107 sets a dead zone width that is small in the positive direction (step S33). On the other hand, if the previous "positive" motion determination was "0" (not "1"), the dead zone determination unit 107 sets a large dead zone width in the positive direction (step S34). The positive direction indicates the direction in which the frame becomes larger, and the negative direction indicates the direction in which the frame becomes smaller.

Next, the dead zone determination unit 107 determines whether or not the previous "negative" motion determination was "1" (step S35). When the previous "negative (negative direction)" motion determination is "1", the dead zone determination unit 107 sets a small dead zone width in the negative direction (step S36). On the other hand, if the previous "negative" motion determination was "0" (not "1"), the dead zone determination unit 107 sets a large dead zone width in the negative direction (step S37).

Next, the dead zone determination unit 107 uses the dead zone width set by the above process to set the dead zone based on the size after the previous dead zone process (step S38).

Moving to FIG. 13, next, the dead zone determination unit 107 determines whether or not the acquired face size this time exceeds the dead zone set this time (step S39). When the acquired face size this time exceeds the currently set dead zone, the dead zone determining unit 107 determines whether or not it exceeds in the positive direction (step S40). Then, when the size of the face this time exceeds in the positive direction, the dead zone determination unit 107 sets the motion determination to "positive: 1" and "negative: 0" (step S41). On the other hand, when the size of the current face exceeds the negative direction, the object detection unit 103 sets the motion determination to "positive: 0" and "negative: 1" (step S42). Thereafter, the display control unit 109 displays the face frame using the size information detected this time for displaying the face frame (step S43).

On the other hand, if it is determined that the current face size does not exceed the dead zone, the current motion determination is set to "positive: 0" and "negative: 0" (step S44). Then, the current size information is overwritten with the previous size information (step S45). After that, the display control unit 109 uses the previous size information for displaying the face frame (step S46).

As explained above, if the target size is within the previous dead zone, the previously displayed target frame is displayed. It is possible to stably display the target frame without changing the information. In addition, when the size of the object is outside the range of the previous dead zone, the object frame corresponding to the object detected this time is displayed, so the followability (followability of size) to the detected object is improved. An excellent object frame can be displayed.

<Others>
[Dead zone for position and size]
In the above description, the dead zone with respect to the position of the target frame has been described in the first embodiment, and the dead zone with respect to the size of the target frame has been described in the second embodiment. In the present invention, a dead zone can also be determined with respect to the position and size of the object frame. That is, a dead zone is simultaneously set with respect to the position and size of the target frame. By setting the dead zone with respect to the position and size of the target frame in this manner, the target frame can be displayed more stably with good followability to the target.

[Consecutive images]
In the above description, the object detection unit 103 detects the object and the object frame determination unit 105 determines the object frame in the image acquired by the image acquisition unit 101 . However, the invention is not limited to this aspect. For example, consecutive images acquired by the image acquisition unit 101 may have information about the position of the detected target and the position of the target frame, which is the range of the target. Further, for example, consecutive images acquired by the image acquisition unit 101 may have information about the size of the detected target and the size of the target frame, which is the range of the target. In this case, the image display device 11 does not need to detect a target (target detection unit 103) and determine a target frame (target frame determination unit 105) from the acquired image.

<Smartphone configuration>
In the above description, a camera is used as an example of the imaging device 10 in FIG. 1, but application of the present invention is not limited to this. Other aspects to which the present invention can be applied include, for example, mobile phones and smart phones with camera functions, PDAs (Personal Digital Assistants), and portable game machines. An example of a smart phone to which the present invention can be applied will be described below. Note that the CPU 240 in FIG. 4 corresponds to the main control unit 501 , the storage unit 260 corresponds to the storage unit 550 , and the monitor 30 corresponds to the display panel 521 .

FIG. 14 is a diagram showing the appearance of smartphone 500 . A smartphone 500 shown in FIG. 14 has a flat housing 502, and a display panel 521 as a display unit and an operation panel 522 as an input unit are integrated on one surface of the housing 502 for display input. A portion 520 is provided. Further, the housing 502 includes a speaker 531 , a microphone 532 , an operation section 540 and a camera section 541 . Note that the configuration of the housing 502 is not limited to this, and for example, a configuration in which the display unit and the input unit are independent may be adopted, or a configuration having a folding structure or a slide mechanism may be adopted.

FIG. 15 is a block diagram showing the configuration of smartphone 500 shown in FIG. As shown in FIG. 15, the main components of a smart phone are a wireless communication unit 510 that performs mobile wireless communication via a base station and a mobile communication network, a display input unit 520, a call unit 530, and an operation unit 540. , a camera unit 541 , a storage unit 550 , an external input/output unit 560 , a GPS (Global Positioning System) receiving unit 570 , a motion sensor unit 580 , a power supply unit 590 , and a main control unit 501 .

Radio communication section 510 performs radio communication with a base station accommodated in a mobile communication network according to instructions from main control section 501 . This wireless communication is used to transmit and receive various file data such as audio data and image data, e-mail data and the like, and to receive Web data and streaming data.

Under the control of the main control unit 501, the display input unit 520 displays images (still images and moving images), character information, etc. to visually transmit information to the user, and detects user operations on the displayed information. The touch panel includes a display panel 521 and an operation panel 522 .

The display panel 521 uses an LCD (Liquid Crystal Display), an OELD (Organic Electro-Luminescence Display), or the like as a display device. The operation panel 522 is a device that is placed so that an image displayed on the display surface of the display panel 521 can be visually recognized, and that detects one or more coordinates operated by the user's finger or stylus. When such a device is operated by a user's finger or a stylus, a detection signal generated due to the operation is output to the main control unit 501 . Next, the main controller 501 detects the operating position (coordinates) on the display panel 521 based on the received detection signal.

As shown in FIG. 14, a display panel 521 and an operation panel 522 of a smartphone 500 illustrated as an embodiment of the imaging device 10 of the present invention are integrated to form a display input unit 520. The arrangement is such that the panel 522 completely covers the display panel 521 . When such an arrangement is adopted, the operation panel 522 may have a function of detecting user operations in areas outside the display panel 521 as well. In other words, the operation panel 522 has a detection area (hereinafter referred to as a display area) for the overlapping portion overlapping the display panel 521 and a detection area (hereinafter referred to as a non-display area) for the outer edge portion not overlapping the display panel 521. ) may be provided.

The size of the display area and the size of the display panel 521 may be completely matched, but they do not necessarily have to be matched. Also, the operation panel 522 may have two sensitive areas, an outer edge portion and an inner portion other than the outer edge portion. Furthermore, the width of the outer edge portion is appropriately designed according to the size of the housing 502 and the like. Position detection methods employed in the operation panel 522 include a matrix switch method, a resistive film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, and a capacitance method. can also

The call unit 530 includes a speaker 531 and a microphone 532, converts the user's voice input through the microphone 532 into voice data that can be processed by the main control unit 501, and outputs the data to the main control unit 501, or a wireless communication unit. 510 or the external input/output unit 560 decodes the audio data and outputs it from the speaker 531 . Further, as shown in FIG. 14, for example, a speaker 531 and a microphone 532 can be mounted on the same surface as the display input unit 520 is provided.

The operation unit 540 is a hardware key using a key switch or the like, and receives instructions from the user. For example, as shown in FIG. 14, the operation unit 540 is mounted on the side surface of the housing 502 of the smartphone 500, is turned on when pressed with a finger or the like, and is turned off by the restoring force of a spring or the like when the finger is released. It is a push button type switch.

The storage unit 550 stores the control program of the main control unit 501, control data, application software, address data associated with the name and telephone number of the communication partner, data of sent and received e-mails, web data downloaded by web browsing, and It stores downloaded content data and temporarily stores streaming data. The storage unit 550 is configured by an internal storage unit 551 built into the smartphone and an external storage unit 552 having a detachable external memory slot. The internal storage unit 551 and the external storage unit 552 constituting the storage unit 550 are of the flash memory type, hard disk type, multimedia card micro type, It is implemented using a recording medium such as a card-type memory (for example, Micro SD (registered trademark) memory), RAM (Random Access Memory), ROM (Read Only Memory), or the like.

The external input/output unit 560 serves as an interface with all external devices connected to the smartphone 500, and communicates with other external devices (e.g., universal serial bus (USB), IEEE 1394, etc.) or Network (e.g., Internet, wireless LAN (Local Area Network), Bluetooth (registered trademark), RFID (Radio Frequency Identification), infrared communication (Infrared Data Association: IrDA) (registered trademark), UWB (Ultra Wideband) ( (registered trademark), ZigBee (registered trademark), etc.).

External devices connected to the smart phone 500 may include, for example, a wired/wireless headset, a wired/wireless external charger, a wired/wireless data port, a memory card connected through a card socket, a SIM (subscriber), and so on. Identity Module Card)/UIM (User Identity Module Card) card, external audio-video equipment connected via audio/video I/O (Input/Output) terminals, external audio-video equipment wirelessly connected, wired/wireless connection connected smart phones, wired/wireless personal computers, wired/wireless PDA, and earphones. The external input/output unit 560 can transmit data received from such an external device to each component inside the smartphone 500 or transmit data inside the smartphone 500 to an external device.

GPS receiving unit 570 receives GPS signals transmitted from GPS satellites ST1 to STn according to instructions from main control unit 501, performs positioning calculation processing based on a plurality of received GPS signals, and obtains the latitude of smartphone 500, Detects a position consisting of longitude and altitude. When the GPS receiving unit 570 can acquire position information from the wireless communication unit 510 or the external input/output unit 560 (for example, wireless LAN), it can also detect the position using the position information.

The motion sensor unit 580 includes, for example, a triaxial acceleration sensor and a gyro sensor, and detects physical movements of the smartphone 500 according to instructions from the main control unit 501 . By detecting the physical movement of smartphone 500, the moving direction and acceleration of smartphone 500 are detected. This detection result is output to the main control unit 501 .

The power supply unit 590 supplies power stored in a battery (not shown) to each unit of the smartphone 500 according to instructions from the main control unit 501 .

The main control unit 501 includes a microprocessor, operates according to control programs and control data stored in the storage unit 550 , and controls each unit of the smartphone 500 in an integrated manner. Also, the main control unit 501 has a mobile communication control function and an application processing function for controlling each unit of the communication system in order to perform voice communication and data communication through the wireless communication unit 510 .

The application processing function is realized by main control section 501 operating according to application software stored in storage section 550 . Application processing functions include, for example, an infrared communication function for controlling the external input/output unit 560 to perform data communication with a counterpart device, an e-mail function for sending and receiving e-mails, a web browsing function for browsing web pages, and the present invention. There is an image processing function that performs compression processing related to

The main control unit 501 also has an image processing function such as displaying an image on the display input unit 520 based on image data (still image or moving image data) such as received data or downloaded streaming data. The image processing function is a function in which the main control unit 501 decodes the image data, applies image processing to the decoded result, and displays the image on the display input unit 520 .

Furthermore, the main control unit 501 executes display control for the display panel 521 and operation detection control for detecting user operations through the operation unit 540 and the operation panel 522 .

By executing display control, the main control unit 501 displays software keys such as icons and scroll bars for starting application software, or displays a window for creating an e-mail. Note that the scroll bar is a software key for accepting an instruction to move the display portion of an image that is too large to fit in the display area of the display panel 521 .

Further, by executing the operation detection control, the main control unit 501 detects user operations through the operation unit 540, accepts operations on icons through the operation panel 522 and input of character strings in input fields of windows, or scrolls. Accepts a request to scroll the display image through the bar.

Furthermore, by executing the operation detection control, the main control unit 501 determines whether the operation position on the operation panel 522 is an overlapping portion (display area) overlapping the display panel 521 or an outer edge portion (non-display area) not overlapping the display panel 521. ) and controls the display position of the sensitive area of the operation panel 522 and the software keys.

The main control unit 501 can also detect a gesture operation on the operation panel 522 and execute a preset function according to the detected gesture operation. A gesture operation is not a conventional simple touch operation, but an operation of drawing a locus with a finger or the like, specifying a plurality of positions simultaneously, or combining these to draw a locus from at least one of a plurality of positions. means.

The camera unit 541 is a digital camera that performs electronic imaging using an imaging element such as a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge-Coupled Device), and corresponds to the imaging apparatus 10 shown in FIG. In addition, under the control of the main control unit 501, the camera unit 541 compresses the image data of a still image obtained by shooting with, for example, JPEG (Joint Photographic coding Experts Group), or compresses the image data of a moving image into, for example, H.264. 264/AVC and recorded in the storage unit 550 , or output through the external input/output unit 560 or the wireless communication unit 510 . As shown in FIG. 14 , in the smartphone 500 , the camera unit 541 is mounted on the same surface as the display input unit 520 , but the mounting position of the camera unit 541 is not limited to this. Alternatively, a plurality of camera units 541 may be mounted. Note that when a plurality of camera units 541 are mounted, the camera unit 541 used for photographing can be switched and photographed independently, or the plurality of camera units 541 can be used simultaneously for photographing.

Also, the camera unit 541 can be used for various functions of the smartphone 500 . For example, an image acquired by the camera unit 541 can be displayed on the display panel 521, or an image of the camera unit 541 can be used as one of the operation inputs of the operation panel 522. Further, when the GPS receiving section 570 detects the position, it is also possible to refer to the image from the camera section 541 and detect the position. Furthermore, by referring to the image from the camera unit 541, the optical axis direction of the camera unit 541 of the smartphone 500 can be detected without using a triaxial acceleration sensor or in combination with a triaxial acceleration sensor (gyro sensor). can be determined, and the current usage environment can also be determined. Of course, the image from the camera unit 541 can also be used within the application software.

In addition, positional information acquired by the GPS receiving unit 570 in image data of still images or moving images, audio information acquired by the microphone 532 (which may be converted into text information by performing audio-to-text conversion by the main control unit, etc.), Posture information and the like acquired by the motion sensor unit 580 can be added and recorded in the storage unit 550 or output through the external input/output unit 560 and the wireless communication unit 510 .

Although examples of the present invention have been described above, it goes without saying that the present invention is not limited to the above-described embodiments, and that various modifications are possible without departing from the spirit of the present invention.

1 : Strobe 2 : Shutter button 3 : Power/mode switch 4 : Mode dial 5 : Zoom button 6 : Cross button 7 : MENU/OK button 8 : Playback button 9 : BACK button 10 : Imaging device 11 : Image display device 12 : Shooting lens 30 : Monitor 101 : Image acquisition unit 103 : Object detection unit 105 : Object frame determination unit 107 : Dead zone determination unit 109 : Display control unit 110 : Zoom lens 111 : Information addition unit 140 : Lens drive unit 150 : Focus lens 210 : Image sensor 230 : A/D converter 240 : CPU
250: Operation unit 260: Storage unit

Claims (23)

an image acquisition unit that receives input of a plurality of images;
a target detection unit that detects a target from a first image and a second image among the plurality of images;
a target frame determination unit that determines a first target frame that is the range of the target in the first image and a second target frame that is the range of the target in the second image;
a dead zone determination unit that determines a dead zone for the object extracted from the first image;
The position of the object detected from the second image is
when outside the range of the dead zone determined from the first image, the second object frame in the second image,
If it is within the range of the dead zone determined from the first image, the first object frame is placed in the second image,
a display control unit that controls display;
An image display device comprising: 2. The image display apparatus according to claim 1, wherein said dead zone determination unit determines said dead zone from the position of said first object frame with respect to said object. The target detection unit detects position information of the target,
3. The image display device according to claim 1, wherein the dead zone determining section changes the dead zone based on the position information. 4. The image display device according to claim 3, wherein the dead zone determining section performs motion determination of the target based on the position information and the dead zone, and changes the dead zone based on the result of the motion determination. an image acquisition unit that receives input of a plurality of images;
a target detection unit that detects a target from a first image and a second image among the plurality of images;
a target frame determination unit that determines a first target frame that is the range of the target in the first image and a second target frame that is the range of the target in the second image;
a dead zone determination unit that determines a dead zone for the object extracted from the first image;
the size of the object detected from the second image is
when outside the range of the dead zone determined from the first image, the second object frame in the second image,
If it is within the range of the dead zone determined from the first image, the first object frame is placed in the second image,
a display control unit that controls display;
An image display device comprising: 6. The image display apparatus according to claim 5, wherein said dead zone determination unit determines said dead zone from the size of said first object frame for said object. The target detection unit detects size information of the target,
7. The image display device according to claim 5, wherein the dead zone determining section changes the dead zone based on the size information. 8. The dead zone determination unit according to any one of claims 5 to 7, wherein the dead zone determining unit performs motion determination of the target based on the size information and the dead zone, and changes the dead zone based on the result of the motion determination. The image display device described. 9. The image display device according to claim 4, wherein the dead zone determination unit reduces the dead zone in the first direction when the motion determination result indicates the first direction. 10. The image display device according to claim 9, wherein the dead zone determination unit enlarges the dead zone in the first direction when the result of the motion determination does not indicate the first direction. 11. The image display device according to claim 1, wherein said second image and said first image are images of different frames forming a moving image. 12. The image display device according to any one of claims 1 to 11, wherein the acquisition time of the second image is newer than that of the first image. 11. The image display device according to any one of claims 3, 4, and 7 to 10, wherein the change of the dead zone changes the position or size of the dead zone according to the object detected by the object detection unit. 14. The method according to any one of claims 1 to 13, further comprising an information adding unit that records position information or size information of the first target frame and the second target frame displayed by the display control unit in an image. The image display device described. The image display device according to any one of claims 1 to 14, wherein the dead zone is a dead zone width with respect to the first object frame and the second object frame, and an initial value of the dead zone is constant. 16. The image display device according to any one of claims 1 to 15, wherein the target detected by the target detection unit is an object. 17. The image display device according to claim 16, wherein said object is a face or an eye. The image display device according to any one of claims 1 to 17, wherein the first object frame and the second object frame are rectangles. The image display device according to any one of claims 1 to 18, wherein the first object frame and the second object frame are ellipses. an image acquisition step for accepting input of a plurality of images;
a target detection step of detecting a target from a first image and a second image among the plurality of images;
a target frame determination step of determining a first target frame that is the range of the target in the first image and a second target frame that is the range of the target in the second image;
a dead zone determination step of determining a dead zone for the object extracted from the first image;
The position of the object detected from the second image is
when outside the range of the dead zone determined from the first image, the second object frame in the second image,
If it is within the range of the dead zone determined from the first image, the first object frame is placed in the second image,
a display control step for performing display control;
Image display method including. an image acquisition step for accepting input of a plurality of images;
a target detection step of detecting a target from a first image and a second image among the plurality of images;
a target frame determination step of determining a first target frame that is the range of the target in the first image and a second target frame that is the range of the target in the second image;
a dead zone determination step of determining a dead zone for the object extracted from the first image;
the size of the object detected from the second image is
when outside the range of the dead zone determined from the first image, the second object frame in the second image,
If it is within the range of the dead zone determined from the first image, the first object frame is placed in the second image,
a display control step for performing display control;
Image display method including. an image acquisition step for accepting input of a plurality of images;
a target detection step of detecting a target from a first image and a second image among the plurality of images;
a target frame determination step of determining a first target frame that is the range of the target in the first image and a second target frame that is the range of the target in the second image;
a dead zone determination step of determining a dead zone for the object extracted from the first image;
The position of the object detected from the second image is
when outside the range of the dead zone determined from the first image, the second object frame in the second image,
If it is within the range of the dead zone determined from the first image, the first object frame is placed in the second image,
a display control step for performing display control;
A program that causes a computer to execute an image display process including an image acquisition step for accepting input of a plurality of images;
a target detection step of detecting a target from a first image and a second image among the plurality of images;
a target frame determination step of determining a first target frame that is the range of the target in the first image and a second target frame that is the range of the target in the second image;
a dead zone determination step of determining a dead zone for the object extracted from the first image;
the size of the object detected from the second image is
when outside the range of the dead zone determined from the first image, the second object frame in the second image,
If it is within the range of the dead zone determined from the first image, the first object frame is placed in the second image,
a display control step for performing display control;
A program that causes a computer to execute an image display process including

Images