JP2017175400A - Image processing device, imaging apparatus, control method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing device which enables a user to easily use the distance information of the subject of a photographed image for image processing, without depending on the display medium of a display destination.SOLUTION: An imaging apparatus 100 acquires the photographed image and the distance information relating to the photographed image and divides a distance range from the distance information, to generate a plurality of division images whose distance ranges are different from the photographed image. The imaging apparatus 100 determines the distance ranges corresponding to the division images on the basis of the information of the display medium. The imaging apparatus 100 displays a display image in which the plurality of division images are arranged on the screen of the display medium, to make the division images selectable.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image processing device, an imaging device, a control method, and a program.

  There is an imaging device that can acquire distance information of a subject in a captured image. Japanese Patent Application Laid-Open No. 2004-228561 discloses a technique for presenting an overhead map that represents the positional relationship in the depth direction of a subject in a shooting scene and the current in-focus distance using distance information of each subject. The photographer can easily grasp which subject is currently focused. In addition, there is an imaging apparatus that can be connected to an external display medium as well as a display unit such as a liquid crystal display provided in the camera body. In addition, a technique has been proposed in which a digital camera converts the resolution of image data in accordance with a display medium.

JP 2010-177741 A JP 2015-146500 A

  However, the distance information of the subject in the conventional apparatus is exclusively used for image processing performed in the apparatus at the time of shooting, and is not assumed to be used by the user after shooting. For example, when a user performs image editing on a captured image, a technique for easily performing image processing using distance information of a subject has not been proposed. An object of the present invention is to provide an image processing apparatus that allows a user to easily use distance information related to an image for image processing regardless of an output destination display medium.

  An image processing apparatus according to an embodiment of the present invention includes a captured image and distance information related to the captured image, and a plurality of divided images having different distance ranges by dividing the distance range from the distance information. Generating from the captured image, and display control means for displaying a display image on which the plurality of divided images are arranged on a screen of a display medium so that the divided images can be selected. The generation unit determines a distance range corresponding to the divided image based on information on the display medium.

  According to the image processing apparatus of the present invention, it becomes possible for the user to easily use the distance information of the subject of the photographed image for image processing regardless of the display medium of the display destination.

It is a block diagram which shows the structural example of an imaging device. It is a block diagram which shows the structural example of a divided image generation part. It is a flowchart explaining the flow of the whole process. It is a flowchart explaining a divided image generation process. It is a figure which shows an example of picked-up image data and divided image data. It is a figure explaining the production | generation of display image data. It is a figure which shows the histogram classified by distance of a to-be-photographed object, and a depth division image. 6 is a diagram showing a depth-divided image corresponding to display medium B. FIG. It is a figure which shows the example of a display on the display medium of display image data. It is a figure explaining the modification regarding the display of display image data.

[Example 1]
A first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a block diagram illustrating a configuration example of an imaging apparatus. FIG. 2 is a block diagram illustrating a configuration example of the divided image generation unit 108.
In the imaging apparatus 100, the imaging unit 101 includes a lens, a shutter, a diaphragm, and an imaging element. The imaging unit 101 performs a shooting operation according to an instruction from the system control unit 103, acquires captured image data, and stores the acquired image data in the memory 105. A bus 102 connects each block and transmits and receives data and control signals.

  The system control unit 103 controls the entire imaging apparatus 100. The system control unit 103 includes a CPU (Central Processing Unit), and realizes processing to be described later by reading and executing a program stored in the nonvolatile memory 106. In addition, the system control unit 103 performs display control on a display medium connected to the imaging apparatus 100. For example, the system control unit 103 performs display switching processing for the display unit 110 and the communication unit 111 described later, and instructs the image processing unit 107 to generate display image data in accordance with the resolution of the display medium.

  The distance information acquisition unit 104 acquires subject distance information corresponding to the captured image data obtained by the imaging unit 101. The distance information corresponding to the captured image data is stored in the memory 105. For example, the distance information acquisition unit 104 acquires a plurality of captured image data captured by changing the in-focus position from the imaging unit 101. And the process which acquires distance information from the focusing area | region of each picked-up image data and the focusing position information of picked-up image data is performed.

  In addition to this, when the imaging element of the imaging unit 101 is configured by a pixel unit obtained by pupil division, distance information for each pixel can be acquired from a phase difference between signals of a pair of subject images (see Patent Document 2). ).

The present invention can be applied in various embodiments as information corresponding to the depth of a subject in an image. That is, the information (depth information) indicated by the data corresponding to the depth of the subject directly represents the subject distance from the imaging device to the subject in the image, or the subject distance and depth of the subject in the image. Any information indicating a relative relationship may be used.
Specifically, the imaging device can output a pair of light beams that pass through different pupil regions of the imaging optical system as optical images, as a pair of image data, from a plurality of photoelectric conversion units. . An image shift amount of each region is calculated by a correlation calculation between the paired images, and an image shift map representing a distribution of the image shift amounts is calculated. Alternatively, the image shift amount is further converted into a defocus amount, and a defocus map representing the distribution of the defocus amount (distribution on the two-dimensional plane of the captured image) is generated. When this defocus amount is converted into the subject distance based on the conditions of the optical system and the image sensor, distance map data representing the distribution of the subject distance is obtained. As described above, in this embodiment, the imaging apparatus 100 may acquire image shift map data, defocus map data, or distance map data of a subject distance converted from the defocus amount. Note that each piece of map data may be stored in units of blocks or in units of pixels. At this time, as in normal image data, the number of bits of about 8 bits may be assigned for each minimum unit, and image processing, display, recording, and the like may be performed as a distance image in the same manner as image processing. In the present embodiment, the distance information has a format of a distance image in which the value of each pixel represents a distance, but the format is not limited. For example, the distance information may be information indicating the position and distance of a region of a specific subject (for example, a person) existing in the shooting scene. In addition, there is no restriction | limiting in particular about the method of producing | generating distance information by the distance information acquisition part 104, For example, the various methods disclosed by patent document 1 etc. can be used.

  The memory 105 stores various data such as captured image data obtained by the imaging unit 101 and distance information related to the captured image data acquired by the distance information acquisition unit 104. The memory 105 has a storage capacity sufficient to store a predetermined number of photographed image data. The nonvolatile memory 106 is an electrically erasable and recordable memory. For example, an EEPROM (Electrically Erasable Programmable Read-Only Memory) is used. The nonvolatile memory 106 stores constants, setting values, programs, and the like for operation of the system control unit 103. The program here is a program for executing each flowchart described later.

  In accordance with an instruction from the system control unit 103, the image processing unit 107 performs predetermined resizing processing such as pixel interpolation and reduction, and color conversion processing on the captured image data read from the imaging unit 101 and the memory 105. Do. The image processing unit 107 performs image processing such as blurring processing, sharpness processing, and color conversion processing on each distance range calculated using the distance information.

  The divided image generation unit 108 acquires captured image data, distance information, and display medium information read from the memory 105, generates data of a predetermined image (depth divided image), and stores the data in the memory 105. A depth division image is an image obtained by extracting a subject image included in a predetermined distance range in captured image data. The data of the depth division image is hereinafter referred to as “division image data”.

  For example, it is assumed that the distance range is divided into three distance ranges in the depth direction (the direction along the shooting direction). The first distance range is the distance range closest to the imaging device, and the third distance range is the distance range farthest from the imaging device. The first divided image data is data of an image (an image of a foreground subject) including a subject image within the first distance range. The second divided image data is data of an image including a subject image within the second distance range (subject image at an intermediate distance). The third divided image data is data of an image including a subject image within the third distance range (an image of a distant subject). As described above, the divided image data is image data when the entire captured image is divided according to the distance range of the subject.

  With reference to FIG. 2, an internal configuration of the divided image generation unit 108 will be described. The divided image generation unit 108 includes a distance range division processing unit 201, a divided image generation mask data generation processing unit 202, and a divided image data generation processing unit 203. A distance range division processing unit (hereinafter referred to as a division processing unit) 201 divides the distance range of the subject into a plurality of pieces using the distance information acquired from the memory 105. By dividing the subject distance range, subject distance range division information is generated.

  A divided image generation mask data generation processing unit (hereinafter referred to as a mask generation processing unit) 202 acquires distance range division information of a subject from the division processing unit 201 and generates mask image data for generating a divided image. A divided image data generation processing unit (hereinafter referred to as a data generation processing unit) 203 generates a plurality of pieces of divided image data using captured image data acquired from the memory 105 and mask image data for generating divided images. The generated divided image data is stored in the memory 105 in association with the captured image data.

  Returning to the description of FIG. The operation unit 109 is a user interface unit that converts user operation information into control information of the imaging apparatus 100 and notifies the system control unit 103 of the control information. The display unit 110 displays the image data acquired from the memory 105 on a display medium such as an LCD (liquid crystal display).

  The communication unit 111 is a communication interface unit for transmitting / receiving control commands and data to / from an external device including a display medium. For example, the communication unit 111 communicates with an external device through a wired connection based on a standard such as USB (Universal Serial Bus) or HDMI (registered trademark) (High-Definition Multimedia Interface). Alternatively, communication with an external apparatus may be performed by wireless connection based on a standard such as a wireless local area network (LAN) or BlueTooth (registered trademark). Further, the imaging apparatus 100 and the external apparatus may be directly connected, or may be connected via a network such as a server or the Internet. In the present embodiment, it is assumed that display medium information can be received and display image data related to a captured image can be transmitted to at least a display medium of an external device to which the communication unit 111 is connected.

  The recording medium I / F unit 112 is an interface unit with the recording medium 113. The recording medium 113 is a medium for recording captured image data and distance information related to the captured image data, and includes a memory card using a semiconductor memory, a magnetic disk, or the like. The configuration shown in FIGS. 1 and 2 is an example. Therefore, the configuration of the imaging apparatus 100 according to the present invention is not limited to the configurations illustrated in FIGS. 1 and 2 as long as the operations described below can be performed.

  The operation of this embodiment will be described below with reference to FIGS. FIG. 3 is a flowchart for explaining the overall processing flow. FIG. 4 is a flowchart for explaining the divided image generation processing.

  In this embodiment, image processing such as refocus processing using color information and color space conversion is performed on captured image data. The refocus processing is processing for generating image data in which the focus position is readjusted after recording the image data. Using the imaging device 100, the user can perform desired image processing on a subject at a specific distance, and perform image editing on a captured image.

  Moreover, the imaging device 100 shall be connected to the display medium A and the display medium B, for example. The display medium A is a display medium such as a PC display that can ensure a sufficient display resolution for performing detailed image editing. The display medium B is a display medium, such as a display panel of the imaging apparatus main body, which cannot secure a sufficient display resolution for performing detailed image editing.

The overall processing at the time of image editing will be described using the flowchart of FIG.
In step S <b> 301, the system control unit 103 acquires captured image data and distance information for the captured image data from the memory 105. Further, the system control unit 103 acquires the maximum number of divided images N from the nonvolatile memory 106 and stores it in the memory 105. The maximum number of divided images N is the maximum number of divided images, and is a fixed value or a variable value. For example, the maximum number N of divided images is determined by user designation.

  In step S <b> 302, the system control unit 103 acquires display destination display medium information. The display medium information in this embodiment is information such as the display resolution of the display medium and the size (screen size) of the display panel. Further, the display medium information is information related to a display medium that is stored in the nonvolatile memory 106 and is connectable to the imaging device 100, for example. In this case, the system control unit 103 acquires the display medium information of the display medium connected to the imaging device 100 from the nonvolatile memory 106. In addition, the system control unit 103 acquires display medium information from the display medium whose connection is detected via the communication unit 111.

  In step S <b> 303, the divided image generation unit 108 generates divided image data according to an instruction from the system control unit 103. Using the captured image data stored in the memory 105, the distance information, and the maximum number of divided images N, a process of generating N pieces of divided image data is executed, and the generated N pieces of divided image data are stored in the memory. 105 is stored. Details of the divided image generation processing of S303 will be described later with reference to the flowchart of FIG.

FIG. 5 is a diagram illustrating an example of the captured image data and the divided image data.
FIG. 5A shows captured image data when N = 5. FIG. 5B shows divided image data generated from the captured image data of FIG.

  Returning to the description of FIG. In step S <b> 304, the image processing unit 107 generates display image data corresponding to the display medium from the display resolution of the display medium stored in the memory 105 and the N pieces of divided image data according to an instruction from the system control unit 103. . For example, the image processing unit 107 resizes the divided image data shown in FIG. 5B so that the closer the distance, the smaller the image size, and then arranges the divided image data as display image data. Represents the shooting angle of view.

FIG. 6 is a diagram for explaining generation of display image data.
For example, as illustrated in FIG. 6A, the image processing unit 107 sets all the depth division image data with the depth division image 1 corresponding to the short distance in front and the depth division image 5 corresponding to the long distance to the back. The display image data is generated by arranging so that at least a part is visible. The arrangement method of the divided image data is not limited to the arrangement at the time of generating the display image data shown in FIG. All the depth-divided images can be selected and selected by the user, and it is sufficient that they are arranged in a direction in which the subject distance increases or decreases. For example, the depth-divided images may be arranged so that the distance increases from the right to the left instead of from the front to the back.

  The image processing unit 107 stores the generated display image data in the storage unit (memory 105). Further, as shown in FIG. 6B, the image processing unit 107 stores correspondence information between the coordinates on the display image data and the depth division image selected when the coordinates are designated in the memory 105. .

  In S305, the system control unit 103 displays the display image data read from the memory 105 on the screen of the display medium. Specifically, the system control unit 103 displays a depth-division image so that it can be selected. In the present embodiment, when connection with a plurality of display media is detected simultaneously with respect to the imaging apparatus 100, for example, only the display medium with the highest resolution is displayed. In this case, the system control unit 103 performs the process of S303 using display medium information having the highest display resolution among the plurality of display media. Display image data corresponding to each display medium may be generated by repeating the subsequent S304 and S305 as many times as the number of display media to be displayed.

  In step S306, the system control unit 103 determines whether the operation unit 109 has detected a user operation. If a user operation is detected, the process proceeds to S307. If no user operation is detected, the process returns to S305. In step S307, the system control unit 103 determines a user operation. If it is determined that the user operation is an image processing operation on the divided image, the process proceeds to S308. If the user operation is not an image processing operation for the depth-divided image, the process proceeds to S309.

  In the image processing operation for the depth division image, at least the depth division image selection operation is performed by the user operation. This selection operation is performed, for example, by designating in-plane coordinates of display image data when the display medium is a touch panel format. When a touch operation by the user is detected, the system control unit 103, based on the touched coordinates on the display image data and the correspondence information between the coordinates and the divided image data stored in the memory 105 in S304. Select a depth-divided image. In addition, there is a selection operation by key input of the operation unit 109. In this case, the system control unit 103 performs control to highlight and display the depth divided image corresponding to the key input, and the user performs a key operation for selecting a desired depth divided image.

  In step S <b> 308, the image processing unit 107 executes predetermined image processing on the selected depth division image according to an instruction from the system control unit 103. The predetermined image processing is, for example, processing such as image blurring processing, sharpness processing, color conversion processing, or the like for the distance range corresponding to the depth division image selected by the user. These image processes are image processes for depth divided images that can be performed by the user selecting a divided image. Thereafter, the process returns to S303 to continue the processing.

  In step S309, the system control unit 103 determines a user operation. If the user operation is an end operation in the image editing mode, the process proceeds to S310. If the user operation is not an end operation in the image editing mode, the process returns to S305. In step S310, the system control unit 103 performs control to record the image processed data. The image data that has been subjected to image processing is stored in the recording medium 113 via the recording medium I / F unit 112, and a series of processing ends.

FIG. 4 is a flowchart illustrating an example of the divided image generation process.
In the present embodiment, the maximum number of divided images N is N = 5. That is, five depth division images 1 to 5 shown in FIG. 5B are generated from the captured image data of FIG.

  In S401 of FIG. 4, the value of the reference variable (denoted i) of the divided image data is initialized to zero (i = 0). In step S <b> 402, the division processing unit 201 obtains a distribution of distances in which the subject exists in the depth direction (histogram by subject distance) based on the distance information. The distance information is in the form of a distance image in which the pixel value represents the distance of the subject (subject distance) that appears in the captured image. Therefore, the subject distance histogram shows the frequency of pixel values of the distance image, that is, the distribution frequency of the subject distance.

FIG. 7 is a diagram illustrating a distance-by-distance histogram of a subject and a depth-division image.
FIG. 7A shows a histogram by distance of the subject. In FIG. 7A, the horizontal axis represents the distance in the depth direction, and the vertical axis represents the distribution frequency. FIG. 7B shows a depth division image corresponding to the display medium A. FIG. 8 shows a depth-divided image corresponding to the display medium B.

  In S403 of FIG. 4, the division processing unit 201 calculates a threshold value S from the display medium information. The threshold value S is a threshold value related to the subject distance distribution frequency. In the present embodiment, it is assumed that the threshold value S is recorded in advance in the nonvolatile memory 106 in association with the resolution of the display medium. The threshold value S is set to be smaller as the resolution of the display medium is higher. For example, for the display medium A, a threshold value S1 shown in FIG. 7B is set. For the display medium B, a threshold value S2 shown in FIG.

  Further, as described with reference to FIG. 1, the distance information is calculated by changing the in-focus position of the imaging unit 101. Therefore, the closer to the distance, the higher the resolution of the distance, and the appearance frequency of the subject. scatter. Therefore, as shown in FIG. 8B, when the display destination is the display medium B, the threshold S is weighted according to the distance in the depth direction, and the value increases as the distance increases. The threshold value S (i) may be calculated. At least in this process, a threshold value S in consideration of operability and visibility when displaying display image data in which a depth-divided image is arranged may be calculated according to information on the display medium.

  In S403 of FIG. 4, the division processing unit 201 calculates distance range information for the i-th divided section based on the subject distance histogram, the maximum number N of divided images, and the threshold value S. For the distance range divided by the maximum number of divided images N, data is previously stored in the nonvolatile memory 106 as constants. The division processing unit 201 may determine N division ranges (distance ranges) in descending order of the frequency of appearance of the subject using the distance histogram of FIG.

  Next, the division processing unit 201 sets a distance range in which the distribution frequency exceeds the threshold value S for N distances as a distance range corresponding to the i-th depth division image. For example, when N = 5, the division processing unit 201 first divides the subject distance histogram shown in FIG. 7A into five in the horizontal axis direction, thereby dividing from the division 1 shown in FIG. A distance range divided into five, ie, division 5, is determined. For example, the distance sections included in the third (i = 3) distance range are distance section A, distance section B, and distance section C in FIG. Regarding the display medium A, the distance ranges exceeding the threshold S1 are the distance section A, the distance section B, and the distance section C. Therefore, the distance ranges corresponding to the third (i = 3) depth division image are the distance section A, the distance section B, and the distance section C.

  In the example shown in FIG. 8B, the distance range exceeding the threshold S2 is the distance section A. Therefore, the distance range corresponding to the third depth division image is the distance section A. In the example shown in FIG. 8B, the distance ranges exceeding the threshold S (3) are the distance section A and the distance section C. Therefore, the distance range corresponding to the third depth division image is the distance section A and the distance section C.

  Note that when the system control unit 103 displays display images on a plurality of display media at the same time, the image processing unit 107 may execute the following processing. The image processing unit 107 calculates a plurality of threshold values S based on the information of each display medium, and uses the smallest threshold value S among the threshold values S to determine a distance range corresponding to the depth divided image.

  Next, in S404 of FIG. 4, the mask generation processing unit 202 generates divided image generation mask data from the i-th distance range information. Specifically, using the distance range information for the i-th divided image calculated in S403, a process of binarizing the pixel value is executed for the distance image that is the distance information. That is, the process of setting the pixel value within the distance range to 1 and the pixel value outside the distance range to 0 is performed, and divided image generation mask data is generated.

  In step S405, the data generation processing unit 203 generates i-th divided image data using the captured image data and the i-th divided image generation mask data. Specifically, a process of multiplying each pixel of the captured image data by the pixel value of the divided image generation mask data is executed. Thereby, only the area | region where the pixel value of the mask data for division | segmentation image generation is 1 is each extracted from picked-up image data, and the data of the depth division | segmentation image of FIG. 7 (B) are produced | generated.

  Next, in S406, the reference variable i is incremented and the i value is increased by one. In S407, the value of the reference variable i is compared with the maximum number of divided images N, and it is determined whether or not “i> N”. If the value of the reference variable i is larger than the maximum number N of divided images, the divided image generation process ends. If the value of the reference variable i is equal to or less than the maximum number of divided images N, the process returns to S403 and continues. By performing the above processing, the divided image generation unit 108 generates depth divided image data obtained by dividing the captured image data by a distance range of the maximum number of divided images N according to the display medium.

FIG. 9 is a diagram illustrating a display example of display image data on a display medium.
The system control unit 103 causes the display unit 110 to display the display image data in which the depth division images generated by the processing described with reference to FIG. Thereby, on the display medium A, as shown in FIG. 9A, subjects included in all distance ranges in the captured image data are displayed. On the display medium B, display image data in which the depth-divided image generated by the process described with reference to FIG. 8A is arranged is displayed. As a result, as shown in FIG. 9B, only high-frequency subjects in the captured image data are extracted and displayed.

(Modifications related to display)
FIG. 10 is a diagram illustrating a modification example regarding display of display image data.
At the time of the display image data generation process in S304 of FIG. 3, the system control unit 103 detects a subject area in the plane of each depth division image data, thereby determining an area used for final display. That is, when displaying the display image data, the system control unit 103 displays only an area including the subject in each depth division image.

  In this example, it is assumed that a depth division image (FIG. 8A) for the display medium B is generated. The image processing unit 107 determines a subject area for each depth-divided image. Specifically, as shown in FIG. 10A, the subject area is determined by searching the pixel values for the pixels in the horizontal direction for each of the depth divided images.

  As described in the processing of S406 in FIG. 4, the image processing unit 107 uses the fact that the pixels in the non-subject region have 0 values by the mask processing at the time of generating the depth-division image data. Explore. Then, the image processing unit 107 calculates a boundary line between the region including the subject and the region not including the subject with respect to the height direction in the plane of each depth division image using the search result. Eventually, the image processing unit 107 generates display image data with the boundary line having the highest region including the subject in the in-plane height direction as the upper end of the display region. As a result, as shown in FIG. 10B, only the area including the subject is displayed, and the area including the subject is displayed larger than the display example shown in FIG. According to the embodiment described above, it is possible for the user to select a subject existing in a specific distance range and perform image processing regardless of the display medium.

(Other embodiments)
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

DESCRIPTION OF SYMBOLS 100 Imaging device 103 System control part 108 Divided image generation part

Claims (11)

An acquisition means for acquiring a captured image and distance information related to the captured image;
Generating means for generating a plurality of divided images having different distance ranges from the captured image by dividing the distance range from the distance information;
Display control means for displaying a display image in which the plurality of divided images are arranged on a screen of a display medium so that the divided images can be selected;
The image processing apparatus, wherein the generation unit determines a distance range corresponding to the divided image based on information of the display medium. The image processing apparatus according to claim 1, wherein the generation unit obtains a subject distance distribution frequency based on the distance information, and divides the distance range based on the obtained distribution frequency. The generating means includes
Based on the information of the display medium, a threshold relating to the distribution frequency of the subject distance is calculated,
The image processing according to claim 1 or 2, wherein a distance range in which the distribution frequency exceeds the threshold among the distance ranges obtained by the division is determined as a distance range corresponding to the divided image. apparatus. The image processing apparatus according to claim 3, wherein the generation unit calculates a larger value as the threshold corresponding to the distance range as the subject distance is larger. When the display control means simultaneously displays the display image on a plurality of display media, the generation means calculates a plurality of the threshold values based on information of each display medium, and among the calculated threshold values The image processing apparatus according to claim 3, wherein a distance range corresponding to the divided image is determined using a minimum threshold value. 6. The image processing according to claim 1, wherein the display control unit displays only a region including a subject in each of the divided images when displaying the display image. apparatus. The image processing apparatus according to claim 1, wherein the display medium information includes display resolution information or screen size information of the display medium. The image processing apparatus according to claim 1, wherein the display control unit stores correspondence information between the coordinates of the display image and the divided images in a storage unit. The image capturing apparatus according to claim 1, further comprising an acquisition unit configured to acquire the captured image. An acquisition step of acquiring a captured image and distance information related to the captured image;
Generating a plurality of divided images having different distance ranges from the captured image by dividing the distance range from the distance information; and
A display control step of displaying the display image in which the plurality of divided images are arranged on a screen of a display medium so that the divided images can be selected;
In the generation step, a distance range corresponding to the divided image is determined based on information on the display medium.   A program that causes a computer to function as each unit included in the image processing apparatus according to any one of claims 1 to 8.