JP2006115289A - Imaging apparatus for displaying candidate image to be deleted - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To display a group of images where it is assumed that the difference is small when detecting an insufficient memory capacity in an imaging apparatus, to quickly and easily search a photographed image that a user may not need, and to enable the image to be deleted. <P>SOLUTION: The imaging apparatus comprises a display means for displaying the image, and attribute information on the image and photographing, a management means for managing in which photographing mode the image is photographed and to which group of images the image belongs, a calculation means for calculating the number of images and moving image time to be recorded, a detection means for detecting shortage in capacity in a recording means, and a control means for performing control so that each group of images for each photographing mode is displayed as a deletion candidate when the shortage in capacity is detected by the detection means. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention can shoot a plurality of images by one shooting operation at a certain shooting opportunity, for example, a plurality of images such as continuous shooting (hereinafter referred to as continuous shooting), AEB (Auto Exposure Bracketing), interval shooting mode, etc. The present invention relates to an imaging device such as a digital camera having a photographing function, a control method for the imaging device, and an image display method for the imaging device.

  2. Description of the Related Art In recent years, an imaging apparatus that converts an image optically obtained through a lens into an electrical signal through an imaging element, performs image processing, and records the image on an external storage medium has become widespread. In addition, as an external recording medium for recording images and moving image files taken by an imaging device, a medium such as CompactFlash (registered trademark) has been put into practical use and has become widespread. The recording capacity of the external recording medium tends to increase year by year, and more images and moving image files can be recorded.

  In addition, the above-described imaging apparatus generally has a feature that a taken image and a moving image file can be deleted from an external recording medium. The user can delete an arbitrary image when the captured image does not have a desired result or when it is desired to secure the capacity of the external recording medium in order to capture and record more images.

In such an image pickup apparatus, when deleting an image, a method of searching for an image to be deleted by displaying captured images one by one on a full screen and frame-by-frame, or a plurality of thumbnail images once on the screen. There is known an imaging apparatus that includes a method of performing so-called multi-image display, and searching for a desired deleted image while referring to the multi-image (for example, Patent Document 1).
JP 2002-369125 A

  However, in the imaging apparatus as described above, more images and moving image files can be recorded on an external recording medium. On the other hand, when referring to a captured image, a desired image can be selected from many images. It has become more difficult to search for images. In particular, when the recording capacity of the external recording medium is full, it is not necessary for the conventional display method that frame-by-frames one image to eliminate the need to delete unnecessary images in order to eliminate the capacity shortage. It takes a long time to search for an image and misses a photo opportunity. In addition, in the multi-image display method of thumbnail images, the number of images displayed at one time on a screen is limited, and there is a situation in which the display panel has been downsized along with the downsizing of the imaging device in recent years. Taking this into account, it cannot be said that the display method is sufficient.

  The present invention has been made in view of the above situation, displays a group of images that are assumed to have a small difference, and easily searches for captured images that are considered unnecessary for the user in a short time. An imaging apparatus provided with a control means and a display means that can be deleted is provided.

In order to achieve the above object, the present invention is configured as follows.
(1) Recording means for recording an image, display means for displaying the image and image attribute information, management means for managing in which shooting mode the image belongs to the image group, and recording means A calculating unit that calculates a recordable image amount; a detecting unit that detects an insufficient capacity of the recording unit by the calculating unit; and the management unit manages when the detecting unit detects an insufficient capacity. An image pickup apparatus having control means for controlling to display deletion candidates for each image group.
(2) In the imaging device according to (1), the shooting mode is a mode in which a plurality of images can be shot by one shooting operation, such as continuous shooting, AEB (Auto Exposure Bracketing), and interval shooting. Of these, at least one photographing mode is provided.
(3) The imaging apparatus according to (1) or (2), further including a control unit configured to set and manage a user-desirable recordable image amount as the capacity shortage.
(4) In the imaging device according to (1) to (3), each image includes an image evaluation unit that assigns an evaluation on a predetermined evaluation item to each image. An image pickup apparatus comprising control means for controlling to display based on image evaluation by the image evaluation means.
(5) The image evaluation means according to (4) is characterized in that each image is evaluated according to the degree of focusing.
(6) The image evaluation means described in (4) is characterized in that each image is evaluated according to the appropriate degree of exposure.
(7) The image evaluation means according to (4) is characterized in that each image is evaluated according to the degree of camera shake.
(8) In the imaging device according to (1) to (4), the step 1 for managing each captured image group, and the step of calculating the recordable image amount after recording the captured image in the recording means 2, step 3 for determining whether or not the capacity is insufficient by the detecting means for detecting the capacity shortage, and step 4 for displaying each image group when it is determined that the capacity is insufficient in step 3. A display method and a deletion candidate image characterized by having a step 5 for displaying the image group selected and determined in the display of 4 in multiple images and a step 6 for deleting the image selected and determined in the display of step 5 Method.
(9) In the display method and the deletion method described in (8), the step 1 also manages a captured moving image group, the step 2 calculates a recordable moving image amount, and the step 4 determines the moving image group. A deletion candidate image display method and a deletion method, further comprising the step 6 of deleting a moving image when a moving image is selected and determined in the display of the step 4.

  According to the above configuration, the lack of capacity of the external recording medium is set at a user's desired timing, and when the lack of capacity is detected, an image group that is assumed to have a small difference or a movie that is assumed to have a large data size is displayed. In addition, by giving an evaluation to each image, it is possible to easily search for and delete a captured image that is considered unnecessary for the user in a short time and delete the image.

  As described above in detail, according to the present invention, at a user-desired timing, an image group assumed to have a small difference, a moving image assumed to have a large data size are displayed, and evaluation of each image is also given. This makes it possible to easily search and delete deletion candidate images that are considered unnecessary for the user in a short time.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<Embodiment 1>
First, a first embodiment of the present invention will be described with reference to FIGS.

  FIG. 2 is a block diagram illustrating an example of a basic configuration of the imaging apparatus according to the present embodiment. In the figure, the subject image formed on the image sensor 202 composed of a CCD or the like by the photographing lens 200 is subjected to noise removal and gain adjustment by the image sensor control unit 204, and then A / D converted. Get an electrical signal. The image processing unit 206 performs white balance, exposure adjustment, color conversion processing, and the like of the image data digitized by the image sensor control unit 204, and converts the data into a data format such as YUV or JPEG. The display control unit 212 performs control such that image data in YUV format is displayed or not displayed on the display device 210 such as an LCD.

  Reference numeral 208 denotes a CPU that controls the entire imaging apparatus according to a program stored in the ROM 218. The RAM 220 is used as a working area for the CPU 208 and the image processing unit 206. The memory 216 is an area for recording and storing image data, and includes an external recording medium. Reference numeral 214 denotes an input device that transmits an operation state to the CPU 208 based on a user operation, and the CPU 208 performs control according to the operation state. Reference numeral 222 denotes a power supply unit such as a battery that supplies power to each drive system such as a lens, a CCD, and a display device, and each IC.

  Next, in the imaging measure according to the present embodiment, an operation flow when an insufficient capacity of the external recording medium is detected will be described based on the flowchart of FIG.

  When it is detected that the capacity of the external recording medium is insufficient, first, a capacity shortage notification screen is displayed in step S100 to notify the user that no more image data can be recorded. Subsequently, in step S102, a display for selecting whether or not to display a deletion candidate image is performed, and the user is asked whether or not he / she wants to delete the image from the captured images to solve the shortage of capacity.

  In step S104, it waits for the user to select and decide whether or not to delete the captured image. If it is determined not to delete the photographed image, the process returns to step S100 to display a capacity shortage notification screen and prompt the user to replace the external recording medium. When it is determined to delete the captured image, the process proceeds to step S106.

  In step S106, a deletion candidate image group selection screen as shown in FIG. 3 is displayed. FIG. 3 shows an example of the deletion candidate image group selection screen display in the present embodiment. Reference numeral 300 denotes a display panel such as an LCD, which indicates a display device 210 in FIG.

  In part 314, a group of images recorded and stored in an external recording medium and captured in a mode in which there are a plurality of images captured at a certain shooting opportunity, such as continuous shooting, AEB (Auto Exposure Bracketing), and interval shooting. Mode number, a mode-specific index number for distinguishing image groups shot in the same mode, and the number of images belonging to each image group are displayed. Reference numeral 312 denotes a photographing mode and an index number, and 304 denotes the number of images belonging to the image group. Reference numeral 302 denotes a mark indicating which image group is currently selected, and the frame may be surrounded or highlighted as shown. Reference numeral 310 denotes a single image representative of the currently selected image group. The representative image may be the first image in the image group, or may be the first candidate image for deletion based on the image evaluation criteria. Reference numeral 306 denotes the shooting date and time of the representative image 310, and reference numeral 308 denotes the remaining number of images that can be shot. The 306 and 308 display units may display other shooting information such as shutter speed and exposure correction amount and information about the camera.

  In step S108, the process waits for the user to select which image group to select or cancel image deletion. If it is determined not to delete the captured image, the process returns to step S102. When the image group is selected and determined, the process proceeds to step S110.

  In step S110, as shown in FIG. 4, each image of the selected image group is displayed as a thumbnail. Reference numeral 400 denotes the mode, index number, and number of images being displayed. Reference numeral 402 denotes a mark indicating the currently selected image. The image may be surrounded or highlighted as shown in the figure.

  In step S112, the process waits for the user to select which image to select or to return to the deletion candidate image group selection screen. When it is determined to return to the deletion candidate image group selection screen, the process returns to step S106. When one image is determined, the process proceeds to step S114.

  In step S114, one selected image is displayed on the full screen. In the subsequent step S116, a determination is made as to whether or not to delete the displayed image. When the deletion is determined, the process proceeds to step S118, the selected image is deleted, the process returns to step S110, and the selected image group is displayed. If it is determined to return in S116, the process returns to step S110, and the selected image group is displayed.

  As described above, according to the present embodiment, captured images that are considered unnecessary for the user can be displayed easily and quickly so that the next photo opportunity is not missed, and the image that the user wants to delete can be displayed. Searching can be easily performed, and operability and convenience are improved.

<Embodiment 2>
Next, a second embodiment of the present invention will be described with reference to FIG. Note that the basic configuration of the imaging apparatus according to the present embodiment is the same as that in FIG. 2 of the first embodiment.

  In the above-described first embodiment, the deletion candidate image is exemplified as the case where the lack of capacity of the external recording medium is detected. However, in this embodiment, the timing of displaying the deletion candidate image can be captured. This is when the number of sheets becomes equal to or less than the number specified by the user.

  FIG. 5 is a flowchart showing display control indicating the characteristics of the imaging apparatus according to the present embodiment, and corresponds to FIG. 1 in the first embodiment.

  In FIG. 5, in step S500 that is executed each time shooting is completed, the remaining number of shootable images is compared with the remaining number of shootable images that indicate the timing for displaying the deletion candidate images set in advance by the user. When the remaining number of images that can be shot is larger than the user-set number, a normal shooting screen such as EVF display is displayed. When the number of shootable images is equal to or less than the user-set number, the process proceeds to step S106 in FIG. 1, and thereafter, the operation is performed according to the flowchart in FIG.

  In addition, since the other structure and operation | movement in this Embodiment are the same as that of Embodiment 1 mentioned above, the description is abbreviate | omitted.

  As described above, according to the present embodiment, in addition to the deletion candidate image display and search operability and convenience obtained in the first embodiment, display and search can be performed at any timing of the user. It is possible to further improve convenience.

<Embodiment 3>
Next, a third embodiment of the present invention will be described with reference to FIGS. The basic configuration of the imaging apparatus according to the present embodiment is the same as that in FIG. 2 of the first embodiment.

  In the first embodiment and the second embodiment described above, when one of the deletion candidate image groups is selected and determined, the images included in the image group are displayed as thumbnails. However, in the present embodiment, When displaying thumbnails, the user can easily recognize and select images that can be candidates for deletion, such as blurring, underexposure, overexposure, camera shake, and the like.

  FIG. 6 is a flowchart showing an example of the operation showing the characteristics of the imaging apparatus according to the present embodiment. In a state where a certain shooting mode is selected, in step S600, EVF display is performed on a display device such as an LCD. However, this step also includes the case where the user wants to shoot in the EVF non-display state.

  In step S602, an instruction from the user such as a release or a change to the reproduction mode is awaited. The EVF display continues while waiting for instructions. When a change to the playback mode is instructed, the shooting mode is terminated, the playback mode is entered, and this control is terminated. If the release button is pressed and shooting is performed, the process proceeds to step S604.

  In step S604, image processing such as white balance and exposure adjustment of the digitized image data, color conversion processing, and the like is performed in the image sensor control unit.

  Next, in step S606, the shooting mode of the shot image data is determined. If it is in the continuous shooting mode, the appropriateness of focus is detected in step S608 and the process proceeds to step S612. If it is in the AEB mode, the appropriateness of exposure is detected in step S610 and the process proceeds to step S612. If the image was taken in another mode, the process proceeds to step S612. In the post-processing in step S612, a process of converting the image data into a data format such as YUV or JPEG is performed.

  Here, the image processing 620 including steps S604 to S612 is processing in the 206 image processing unit of FIG. 2 showing the configuration of the present embodiment. Next, details of the processing for evaluating the images in step S608 and step S610 will be described.

  In step S608, in order to extract a defocused image that is assumed to be abundant in continuously shot images, focus appropriateness detection is performed, and the image is evaluated. In step S610, since it is assumed that the exposure adjustment that the user does not want is performed on the image shot in the AEB mode, the exposure appropriateness is detected, the underexposed or overexposed image is extracted, and the image is extracted. Evaluate.

  Here, as a method for detecting the appropriateness of focus, the main subject is determined from the distance measurement frame position in the image attribute information, and the edge amount near the main subject region is calculated to determine whether the focus is appropriate. it can.

  As a method for detecting the appropriateness of exposure, a cumulative histogram of an image is calculated, and in the histogram, for example, the gradation corresponding to 1% from the brighter side is smaller than the gradation of 10% from the highlight of 256 gradations, for example. For example, it may be determined as underexposed, and if the gradation corresponding to 1% from the dark side is higher than 10% from the shadow, it is determined as overexposed.

  In this embodiment, the degree of focus appropriateness and the degree of exposure appropriateness are employed as image evaluation indices, but other indices such as the degree of camera shake may naturally be used. As a method for detecting camera shake, there is a method in which a main subject is determined from a distance measurement frame position in image attribute information, and an edge amount in the vicinity of the main subject region is calculated.

  In this embodiment, the appropriateness of focus detection is performed in the continuous shooting mode, and the appropriateness of exposure detection is performed in the AEB mode. However, the shooting mode, the evaluation index to be detected, and the combination thereof are merely examples. Without being limited to the embodiment, for example, when shooting with Tv priority, the camera shake degree is used as an index, and when shooting with Av priority, exposure appropriateness is used as an index. Possible and preferred.

  In subsequent step S614, image recording to the outside or a recording medium is performed. In step S616, when the image is evaluated in 620, the evaluation is held.

  In the subsequent step S618, the remaining number of shootable images is calculated. If the remaining number of shootable images is zero or equal to the number set in advance by the user, it is determined that the recording capacity is insufficient, and thereafter, the operation is performed according to the flowchart of FIG. On the other hand, if the recording capacity is still sufficient, the process returns to step S700.

  FIG. 7 is an example of a display screen showing the characteristics of the imaging apparatus according to the present embodiment, and is a diagram corresponding to FIG. 4 of the first embodiment and the second embodiment described above. The present invention relates to multi-image display of a deletion candidate image group.

  In FIG. 7, reference numeral 700 denotes a defocused image or an underexposed or overexposed image that has been detected in advance, that is, an image that can be cited as a deletion candidate in the image group, and surrounds the periphery of the image for the purpose of notifying the user. Is displayed. The user may be notified by blinking highlight or blinking the image itself.

  In addition, since the other structure and operation | movement in this Embodiment are the same as that of Embodiment 1 or 2 mentioned above, the description is abbreviate | omitted.

  As described above, according to the present embodiment, in addition to the deletion candidate image display, search operability, and convenience obtained by the first and second embodiments described above, the user decides the superiority or inferiority of the image and the user can select the deletion candidate. It is possible to realize display and search that make it easier to narrow down, and further operability and convenience can be expected.

<Embodiment 4>
Next, a fourth embodiment of the present invention will be described with reference to FIGS. Note that * / 741, the basic configuration of the imaging apparatus according to the present embodiment is the same as that of FIG.

  In Embodiments 1 to 3 described above, still images are taken up as targets to be deleted by the user, but in this example, moving images are also displayed as deletion candidates. Generally, by deleting a moving image having a data size larger than that of a still image, more free space is secured by a single deletion operation.

  FIG. 8 is an operation flowchart showing the characteristics of the imaging apparatus according to the present embodiment, and corresponds to FIG. 1 in the first embodiment.

  If the capacity shortage of the external recording medium is detected, first, a capacity shortage notification screen is displayed in step S800 to notify the user that no more image data can be recorded. Subsequently, in step S802, a display for selecting whether or not to display a deletion candidate image is performed, and the user asks whether or not he / she wants to delete the image from the captured images to solve the lack of capacity.

  In step S804, it waits for the user to select and decide whether or not to delete the captured image. If it is determined not to delete the captured image, the process returns to step S800 to display a capacity shortage notification screen and prompt the user to replace the external recording medium. If it is determined to delete the captured image, the process proceeds to step S806.

  In step S806, a deletion candidate image group selection screen as shown in FIG. 9 is displayed. FIG. 9 is an example of a display screen showing the characteristics of the imaging apparatus according to the present embodiment, and corresponds to FIG. 3 in the first embodiment. Reference numeral 900 denotes a display panel such as an LCD, which indicates a display device 210 in FIG. 914 copies are shot in a shooting mode that includes multiple videos recorded and stored on an external recording medium and images shot at a shooting opportunity, such as continuous shooting, AEB (Auto Exposure Bracketing), and interval shooting. The mode number of the selected image group, the index number by mode for distinguishing the image group photographed in the same mode, and the number of images belonging to each image group are displayed. However, as shown in the drawing, the number of images does not need to be displayed for the moving image. Reference numeral 912 denotes a shooting mode including a moving image and an index number, and reference numeral 904 denotes the number of images belonging to the image group. Reference numeral 902 denotes a mark indicating which moving image or image group is currently selected. The frame may be surrounded or highlighted as shown in the figure. 910 displays the first scene or the scene that best represents the characteristics of the video when a video is selected, and one image representing the image group when an image group is selected. Is displayed. The image may be a first image in an image group or a deletion candidate first image based on an image evaluation criterion. Reference numeral 906 denotes the shooting date and time of the moving image or image being displayed, and 908 denotes the remaining number of shots that can be taken. Here, since it is possible to shoot a plurality of still images by deleting a movie whose data size is assumed to be larger than that of a still image, when a movie is selected, as shown in the figure It is preferable to display the current number of shootable images and the number of shootable images after the selected moving image is deleted. In 906 and 908, other shooting information such as a shutter speed and an exposure correction amount and information on the camera may be displayed.

  In step S808, the process waits for the user to decide which image group to select or cancel image deletion. If it is determined not to delete the captured image, the process returns to step S802. When the image group is selected and determined, the process proceeds to step S810.

  In step S810, the image type of the selected image group is determined. If it is a moving image, the process proceeds to step S812. If it is a still image, the process proceeds to step S820.

  In step S812 when the image type is a moving image, the first scene or the like of the selected moving image is displayed as shown in FIG. Reference numeral 1000 denotes a display panel such as an LCD, which indicates a display device 210 in FIG.

  Reference numeral 1002 denotes the first scene of the selected moving image. Reference numeral 1004 displays a list of operation menus that can be selected and determined by the user. FIG. 10 illustrates operations of playback, stop, edit, delete, and return, but other operations such as pause, fast forward, rewind, and display of other moving images may be added. Reference numeral 1006 denotes a mark indicating which operation is currently selected, and the frame may be enclosed or highlighted as shown in the figure. Reference numeral 1008 indicates the current remaining number of shootable images and the remaining number of shootable images when the displayed movie is deleted. Reference numeral 1010 denotes the index number of the moving image being displayed.

  In step S814, it waits for an instruction to delete the selected moving image or to perform operations such as reproduction and editing on the moving image. If deletion is selected, the process proceeds to step S816, the moving image file is deleted, and the process returns to step S806. If the operation for the moving image is selected and determined in step S814, the process proceeds to step S818 to perform processing for the moving image, and the process returns to step S812.

  On the other hand, in step S820 when the image type is a still image, as in the first embodiment, each image of the selected image group is displayed as a thumbnail, as shown in FIG.

  In step S822, the process waits for the user to select which image to select or to return to the deletion candidate image group selection screen. If it is determined to return to the deletion candidate image group selection screen, the process returns to step S806. When one image is determined, the process proceeds to step S824.

  In step S824, the selected image is displayed on the full screen. In the subsequent step S826, a determination is made as to whether or not to delete the displayed image. If deletion is determined, the process proceeds to step S828, the selected image is deleted, the process returns to step S820, and the selected image group is displayed. If it is determined to return in S826, the process returns to step S820, and the selected image group is displayed.

  In addition, since the other structure and operation | movement in this Embodiment are the same as that of Embodiment 1 mentioned above, the description is abbreviate | omitted.

As described above, according to the present embodiment, in addition to the deletion candidate image display and search operability and convenience obtained by the above-described first embodiment, a larger recording capacity can be secured by a single deletion operation. And the deletion efficiency can be improved.
Further, the present invention is not limited to the above embodiments, and can be appropriately modified and implemented within the scope of the gist of the invention.

3 is a flowchart showing the operation of the imaging apparatus according to the first embodiment of the present invention. 1 is a block diagram illustrating a configuration example of an imaging device according to a first embodiment of the present invention. FIG. 3 is a diagram showing a display example of the imaging apparatus according to the first embodiment of the present invention. FIG. 3 is a diagram showing a display example of the imaging apparatus according to the first embodiment of the present invention. 6 is a flowchart showing the operation of the imaging apparatus according to the second embodiment of the present invention. 10 is a flowchart showing the operation of the imaging apparatus according to the third embodiment of the present invention. FIG. 10 is a diagram showing a display example of the imaging apparatus according to the third embodiment of the present invention. 10 is a flowchart showing the operation of the imaging apparatus according to the fourth embodiment of the present invention. FIG. 10 is a diagram showing a display example of the imaging apparatus according to the fourth embodiment of the present invention. FIG. 10 is a diagram showing a display example of the imaging apparatus according to the fourth embodiment of the present invention.

Explanation of symbols

200 lenses
202 Image sensor
204 Image sensor controller
206 Image processor
208 CPU
210 Display device
212 Display controller
214 Input device
216 memory
218 ROM
220 RAM
222 Power supply

Claims (9)

  Recording means for recording an image, display means for displaying an image and attribute information of the image, management means for managing in which shooting mode the image belongs to an image group, and recording to the recording means A calculating means for calculating a possible image amount; a detecting means for detecting an insufficient capacity of the recording means by the calculating means; and each image managed by the managing means when the detecting means detects an insufficient capacity An image pickup apparatus having control means for controlling to display deletion candidates for each group.   2. The imaging device according to claim 1, wherein the imaging mode is at least one of a mode in which a plurality of images can be captured by one imaging operation, such as continuous imaging, AEB (Auto Exposure Bracketing), and interval imaging. An imaging apparatus characterized by being in one imaging mode.   3. The imaging apparatus according to claim 1, further comprising a control unit configured to set and manage a user-desired recordable image amount as the capacity shortage.   4. The image pickup apparatus according to claim 1, further comprising image evaluation means for assigning each image with an evaluation in a predetermined evaluation item, and displaying each image group by an image evaluation means. An imaging apparatus comprising control means for controlling to display based on evaluation.   The image evaluation means evaluates each image according to the degree of focus.   The image evaluation means evaluates each image according to the appropriate degree of exposure.   The image evaluation means evaluates each image according to the degree of camera shake.   5. The imaging apparatus according to claim 1, wherein step 1 for managing each captured image group, step 2 for calculating the recordable image amount after recording the captured image in the recording unit, and the lack of capacity Step 3 for determining whether or not the capacity is insufficient by the detection means for detecting, and when determining that the capacity is insufficient in Step 3, Step 4 for displaying each image group, and selection determination in the display of Step 4 A deletion candidate image display method and deletion method, comprising: a step 5 for displaying the group of images displayed in multiple images; and a step 6 for deleting the image selected and determined in the display of step 5.   The display method and the deletion method according to claim 8, wherein the step 1 also manages a captured video group, the step 2 also calculates a recordable video amount, the step 4 also displays the video group, A deletion candidate image display method and deletion method comprising the step of deleting a moving image when a moving image is selected and determined in the display of the step 4.

Images