JP2015103991A - Image processing apparatus, method and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem that, since a conventional digital mirror does not include a device for appropriately determining and displaying a magnification while considering a sight, when a user whose sight is lowered by presbyopia or the like makes up while watching a mirror, the user may not distinctly view images of user's own eyes or eyelashes.SOLUTION: An image processing apparatus includes an interface for capturing a dynamic image of the user, acquiring user sight information that is information about the sight of the user and acquiring user distance information that is information about a distance from a display device to the user. The image processing apparatus further includes: a processor that determines a magnification/reduction method including at least a magnification/reduction rate of the captured dynamic image in such a manner that the user can distinctly view the user image displayed on the display device, on the basis of the user distance information and the user sight information; an image processing circuit for generating a mirror dynamic image of the user from the dynamic image; and an interface for outputting the generated mirror dynamic image to the display device.

Description

  The present disclosure relates to an image processing apparatus, a digital mirror system, and an image processing method that digitize an image of a user and display the image on a display device installed at a position where the user can visually recognize the image.

  Mirrors are indispensable for daily life, such as dressing up and checking health. As one of the application destinations of image processing technology, a so-called digital mirror technology has been proposed in recent years in which a system is configured with a sensor and a display device and used in place of the mirror. Research is being carried out with the advantage that information that cannot be superimposed on an actual mirror can be superimposed and that display modes (viewpoint conversion, etc.) that are impossible with an actual mirror can be realized. In particular, when presenting a user image to a user with a display or projector, it is necessary to appropriately determine the display magnification (reduction) rate of the mirror image, and conventional techniques for realizing this have been proposed.

  Patent Document 1 proposes a digital mirror device that displays a user image captured by a camera on a display in front of the user. At this time, by determining the size (magnification ratio) on the display of the user to be displayed based on the distance from the mirror, a mirror-like display is obtained when the user moves back and forth with respect to the display. It is supposed to be.

  Further, in Patent Document 2, in addition to imitating the display mode of the mirror as in Patent Document 1, it is easier to work by displaying larger / smaller for a user's specific work. A digital mirror is proposed.

Japanese Patent No. 4654905 JP 2008-277783 A Japanese Patent No. 4910212 Japanese Patent No. 4134653 Japanese Patent No. 4878273

Mirror metafine interaction in display system i-mirror using line-of-sight optical system (Keita Ushida (Univ. Of Tokyo) et al .; Interaction 2002) Computer Vision: Technical Review and Future Prospects (New Technology Communications: p37-p53, Chapter 3, written by Naoki Asada)

  However, in the conventional technology described above, it may not always be easy for the user to perform work, and further improvement in usability has been demanded.

  One non-limiting exemplary embodiment of the present application provides an apparatus and method for realizing a digital mirror that is easier for the user to work and easier to use when the user performs a makeup task using the digital mirror. To do.

  In order to solve the above-described problem, an aspect of the present invention is an image processing device used when a user visually recognizes his / her own image, the first interface for acquiring a moving image of the user, and the visual acuity of the user Based on the second interface for acquiring user visual acuity information that is information on the user, the third interface for acquiring user distance information that is information on the distance from the display device to the user, the user distance information and the user visual acuity information, A processor for determining an enlargement / reduction method including at least an enlargement / reduction ratio of the acquired moving image so that the user can clearly view a user image displayed on the display device, and the moving image according to the determined enlargement / reduction method And a fourth interface for outputting the generated mirror moving image to the display device. Including an image processing apparatus and a over scan.

  The general and specific aspects described above can be implemented using systems, methods and computer programs, or can be implemented using combinations of systems, methods and computer programs.

  According to the present disclosure, it is possible to realize a display device (digital mirror) that allows a user to easily perform a work such as makeup and a distance that changes with a mirror when used.

It is explanatory drawing which shows the structure of the digital mirror of illustrative 1st Embodiment by this indication. 1 is a block diagram illustrating a configuration of an image processing apparatus according to a first exemplary embodiment of the present disclosure. It is a block diagram showing the composition by the computer of the image processing device of an exemplary 1st embodiment by this indication. It is a flowchart which shows the flow of a process of the image processing apparatus of illustrative 1st Embodiment by this indication. (A)-(c) is a figure which shows the example of the user interface for making a user input visual acuity information. (A) And (b) is a figure for demonstrating the definition of visual acuity, and the resolution | decomposability of eyes. FIG. 2 is a schematic diagram illustrating an exemplary camera and display device and display target object according to the present disclosure. It is a figure shown about the relationship between the user distance and expansion / contraction rate by this indication. It is explanatory drawing which shows the structure of the digital mirror of illustrative 2nd Embodiment by this indication.

  The knowledge which became the basis of this invention is as follows.

  As mentioned earlier, mirrors are indispensable for daily life, but for many women, the most important use of mirrors is makeup.

  According to the “Fact-finding Survey on Women's Makeup Behavior and Consciousness 2012” published by the Pola Institute, approximately 70% of women from almost teens to 60s answered “make up almost every day / daily” In addition, about 90% of women who answered “sometimes apply makeup” make up daily. Also, in all ages, multiple makeup items are used for each facial part, and makeup is performed.

  At this time, since the fineness of the work varies depending on the parts to be applied such as eye makeup and base makeup, the user unconsciously works while adjusting the distance from the mirror.

  For example, with regard to mascara used to show the length of the eyelashes long, a small brush with a mascara solution is used to perform very detailed work of combing the eyelashes with a diameter of about 0.1 mm. Look carefully at the mirror from a very close distance of 10 cm to 20 cm and work carefully.

  On the other hand, presbyopia makes it difficult to see close distances due to aging. It is said that in early people, symptoms often appear in their 30s, generally in their 40s, and the range that is difficult to see spreads with age.

  As mentioned earlier, women do makeup on a daily basis, regardless of age. Therefore, many users apply makeup while suffering from presbyopia. For such users, “eye makeup” such as mascara, which requires work at a short distance and cannot wear reading glasses during work, is particularly difficult. Reading glasses with a special mechanism are also on the market.

  In the embodiments and drawings of the patent document described above, the size (magnification ratio) when displaying the user's image taken with the camera on the display in front of the user, the distance from the user, and the specific operation of the user There has been proposed a method of deciding in connection with.

  However, it is not considered whether the user can clearly see the work object on the display, so when the user approaches the digital mirror to make eye makeup, it is displayed regardless of whether the user is presbyopia The aspects of are the same. That is, with a conventional digital mirror, when a presbyopic user puts on makeup, it may be used at a distance that cannot be clearly seen. In that case, it makes the user feel difficult to use.

  Through repeated research and examination, the present inventors have found that the above-described problems occur in conventional digital mirrors because the user's visual acuity is not taken into consideration. Then, it was found that a digital mirror that is easier to use for the user can be provided by determining an appropriate magnification factor in consideration of the user's visual acuity and displaying the user image.

  The outline of one embodiment of the present invention is as follows.

  An image processing apparatus according to an aspect of the present invention is an image processing apparatus used when a user visually recognizes his / her own image, and includes a first interface for acquiring a moving image of the user and information regarding the user's visual acuity. Based on the second interface for acquiring certain user visual information, the third interface for acquiring user distance information that is information on the distance from the display device to the user, and the display device based on the user distance information and the user visual information A processor for determining an enlargement / reduction method including at least an enlargement / reduction ratio of the acquired moving image so that the user can clearly view the user image displayed above, and the moving image according to the determined enlargement / reduction method, from the moving image An image processing circuit for generating a mirror moving image of the user and a fourth interface for outputting the generated mirror moving image to a display device It is equipped with a door.

  The user visual acuity information further includes information related to the clear visual area of the user, and the processor is further configured based on the user visual acuity information and a size of an area on the user image displayed on the display device. The image processing apparatus according to claim 1, wherein an enlargement / reduction method is determined when the distance is a near point or a far point of the clear vision area of the user.

  The region on the user image includes a display of the user's eyelashes or hair, and the processor displays the resolution of the user's eyes at the near point distance obtained from the user's visual acuity on a display device. The enlargement / reduction method in the case where the distance is the near point may be determined so as to be smaller than the size of one eyelash or one hair.

  The second interface includes information regarding binocular visual acuity when both eyes of the user are open, information on visual acuity of the open eye when one eye is closed, and the user visual acuity information. You may get as

  The processor determines an enlargement / reduction rate at a distance farther than the near point according to the change in the distance so that a displayed image changes stepwise based on the enlargement / reduction rate when the distance is the near point. May be.

  The processor may preliminarily determine a reference distance point at which the enlargement / reduction ratio is equal to a position far from the near point, and perform interpolation stepwise between the near point and the reference distance.

  The processor sets the enlargement / reduction ratio to the same magnification until the user enters closer to the near point after the user starts use, and when the user is closer to the display device than the near point, the processor The enlargement / reduction method may be determined so as to obtain an enlargement / reduction ratio corresponding to the visual acuity.

  The area on the user image includes a display of the entire face or whole body of the user, and the processor is displayed on the display device when the distance is a far point of the clear vision area of the user. The enlargement / reduction method may be determined so that the entire face or whole body of the user is included in the display area of the display device.

  The processor further acquires target visual acuity information, the processor obtains the resolution of the user's eyes at a predetermined distance based on the user visual acuity information, and the user's eyes at the predetermined distance based on the target visual acuity. And the processor uses the resolution based on the user visual acuity information and the resolution based on the target visual acuity to cause the target visual acuity when the user views the user image from the predetermined distance. The scaling method may be determined so that the same resolution as when the user image is viewed from the predetermined distance is obtained.

  The processor determines the scaling ratio at a distance closer to the far point so that the displayed image changes stepwise based on the scaling ratio when the distance is the far point of the clear vision area of the user. It may be determined according to the change of.

  The processor may preliminarily determine a reference distance point at which the enlargement / reduction ratio is equal to a position far from the far point, and perform interpolation stepwise between the far point and the reference distance.

  When both the near-point scaling factor and the far-point scaling factor of the user's clear vision area have been obtained, the processor determines whether the near-point scaling factor and the far-point scaling factor are between. May be interpolated in a stepwise manner from the distance point of the near point to the distance point of the far point.

  The second interface further obtains information about the corrected visual acuity as the user visual acuity information when the user is wearing a visual acuity correction tool, and information on the naked eye visual acuity when the user is not wearing it. You may acquire as vision information.

  The processor receives a determination result as to whether or not the user is wearing a vision correction tool, and when the vision correction tool worn by the user is removed, the processor scales based on the user's naked eye vision The rate may be adjusted.

  The processor may estimate the clear vision area of the user from the user's action.

  An image processing method according to an aspect of the present invention is an image processing method used when a user visually recognizes his / her own image, and obtains a user's moving image, and user visual acuity information which is information related to the user's visual acuity User distance information, which is distance information from the display device to the user, is acquired, and the user defines a user image displayed on the display device based on the user distance information and user visual acuity information. Determining the enlargement / reduction method including at least the enlargement / reduction ratio of the acquired moving image so as to be visible, and generating the mirror moving image of the user from the moving image according to the determined enlargement / reduction method; The mirror moving image is output to the display device.

  A computer program which is one embodiment of the present invention is a computer program for causing a computer to execute the above-described image processing method.

  Hereinafter, embodiments of an image processing apparatus according to the present disclosure will be described with reference to the accompanying drawings.

  Hereinafter, an image processing apparatus and a digital mirror according to an aspect of the present disclosure will be specifically described with reference to the drawings.

  Note that each of the embodiments described below shows a specific example of the present disclosure. Numerical values, shapes, materials, components, arrangement positions and connection forms of components, steps, order of steps, and the like shown in the following embodiments are merely examples, and are not intended to limit the present disclosure. In addition, among the constituent elements in the following embodiments, constituent elements that are not described in the independent claims indicating the highest concept are described as optional constituent elements.

(Embodiment 1)
FIG. 1 shows a configuration example of a digital mirror system that is a target of the present embodiment.

  In the simplest case, a user is provided with a display and a camera, and the user's moving image captured by the camera is displayed on the display in front of the user, so that the user can check the user's own state as when looking at the mirror.

  Alternatively, as shown in Patent Document 1 and Non-Patent Document 1, the system may be configured by a half mirror, a hologram screen, a projector, and a camera. By installing the camera at a position where the front face of the user can be photographed on the back of the half mirror or the screen, the front face of the user can be photographed from a position that does not directly enter the user's line of sight. Thereby, it is possible to present to the user a user image that looks like a more real mirror.

  In addition, by providing a plurality of cameras or sensors capable of ranging, it is possible to display a user image from an arbitrary angle using image synthesis technology. A composite image may be displayed on the screen, and a user image as when looking at an actual mirror may be presented to the user.

  Further, as disclosed in Patent Document 1, by changing the enlargement ratio at the time of display based on the distance from the display surface to the user, the image becomes larger as it approaches, and the image becomes smaller as it moves away. Can be displayed. (FIG. 1) In the present embodiment, the operation of the present disclosure will be described for a system capable of matching the line of sight, such as a mirror, particularly using the image composition technique.

  In the following description, the term “moving image” refers to moving image data or a moving image indicated by moving image data. Of course, a set of still images (pictures) constituting the moving image is also included in the moving image. In the present disclosure, a moving image displayed on a display device is referred to as a mirror moving image regardless of a mirror image normal image.

  FIG. 2 is a block diagram illustrating a functional configuration of the image processing apparatus 100 according to the present embodiment. As illustrated in FIG. 2, the image processing apparatus 100 includes a moving image acquisition unit 101, a user visual acuity information acquisition unit 102, a user distance acquisition unit 103, an enlargement / reduction method determination unit 104, an image generation unit 105, and an output unit 106.

  The image processing apparatus 100 accepts the moving image 110, the user visual acuity information 111, and the user distance 112 as inputs, performs image processing on the moving image of the user taken from a predetermined direction, and converts the resulting moving image into a mirror moving image. To the display device 120.

  The moving image acquisition unit 101 receives an input of a moving image or a plurality of pictures (also referred to as “images”) constituting the moving image. The moving image acquisition unit 101 may be an interface that reads a moving image from a camera, which is a visual sensor, directly or via a communication path.

  The user eyesight information acquisition unit 102 acquires user eyesight information 111. The user's visual acuity information preferably indicates the spatial resolution of the user's eyes using the apparatus, the user's naked eye acuity, and the distance range from the user's clear (unblurred) eyes. Contains information about the area. Such information may be input in advance by the user by providing an interface that the user can input on the spot, or may be stored in advance in an external storage device, directly or through a communication path. It may be read out via

  The user distance acquisition unit 103 acquires a user distance 112 that is a distance from the display surface of the display device to the user, particularly the user's face. For example, the user distance 112 may be obtained by image processing using moving images from a plurality of cameras, or may be provided with a distance measurement sensor or may be realized by an existing method. In this embodiment, an example in which a distance measuring sensor is used will be described.

  The enlargement / reduction method determination unit 104 determines the display mode of the output mirror moving image as the enlargement / reduction method based on the user visual acuity information 111 received by the user visual acuity information acquisition unit 102 and the user distance 112 received by the user distance acquisition unit 103. To do. The determined enlargement / reduction method includes, for example, an enlargement / reduction ratio at the time of display. Further, the determined enlargement / reduction method may include the position of the enlargement / reduction center in addition to the enlargement / reduction ratio. The determination method will be described later.

  The image generation unit 105 performs image conversion on the moving image 110 based on the user distance 112 and the display mode of the mirror moving image determined by the enlargement / reduction method determination unit 104, and finally displays the mirror on the display device. Generate a moving image.

  The output unit 106 converts the mirror moving image generated by the image generation unit 105 into a form that can be displayed on the display device 120, and outputs it to the display device 120.

  Note that each component constituting the image processing apparatus 100 may be realized by software such as a program executed on a computer, or may be realized by hardware such as an electronic circuit or an integrated circuit. FIG. 3 is a diagram illustrating a hardware configuration of the image processing apparatus 100 according to the present embodiment configured by the computer 200. A computer 200 corresponds to the image processing apparatus 100.

  In FIG. 3, a moving image 110 acquired by a camera 210a is input to a computer 200 which is an image processing apparatus through an I / F (interface) 201a. The user's visual acuity information stored in the storage device 210b is input to the computer 200, which is an image processing device, through the I / F 201b. The user distance 112 acquired by the distance measuring sensor 210c is input to the computer 200, which is an image processing apparatus, through an I / F (interface) 201c. The computer 200 acquires the moving image 110, the user visual acuity information 111, and the user distance 112, and performs image generation processing. The display device 220 displays a mirror moving image generated by the computer 200.

  The computer 200 includes an I / F 201a, an I / F 201b, an I / F 201c, an I / F 201d, a CPU (Central Processing Unit) 202, a ROM 203, a RAM 204, and an HDD 205. A program for operating the computer 200 is stored in advance in the ROM 203 or the HDD 205. The program is read out from the ROM 203 or HDD 205 to the RAM 204 and expanded by the CPU 202 as a processor. The CPU 202 executes each coded instruction in the program expanded in the RAM 204. The I / F 201 a and the I / F 201 b capture the moving image 110 and the user operation 111 into the RAM 204 in accordance with the execution of the program. The I / F 201d has a function of outputting image data in the memory as a video signal. In addition to this function, the I / F 201d may further include an image enlargement / reduction and inversion function. In the case of the latter mode, the I / F 201d generates a mirror moving image and outputs the generated mirror moving image to the display device 220.

  The computer program is not limited to the semiconductor ROM 203 or HDD 205 but may be stored in an external storage device such as a CD-ROM. Alternatively, the data may be transmitted via a wired or wireless network, broadcasting, or the like and taken into the RAM 204 of the computer.

  Next, the operation of the image processing apparatus 100 in the present embodiment will be described with reference to FIG. FIG. 4 is a flowchart showing the operation of the image processing apparatus 100 in the present embodiment. In FIG. 4, six steps S301 to S306 correspond to the respective processing units 101 to 106 in FIG. That is, the moving image acquisition unit 101 has a moving image acquisition step S301, the user visual acuity information acquisition unit 102 has a user visual acuity acquisition step S302, the user distance acquisition unit 103 has a user distance acquisition step S303, the enlargement / reduction method determination unit 104 has an enlargement / reduction method determination step S304, an image The generation unit 105 executes each operation of image generation step S305, and the output unit 106 executes output step S306. Note that these steps can be realized by the above-described computer program.

  First, the moving image acquiring unit 101 executes the moving image acquiring step S301. The moving image acquisition unit 101 acquires the moving image 110.

  The moving image acquisition unit 101 acquires the moving image 110 from one or more cameras via a wired or wireless network. The moving image is 30 frames / second. A moving image of a camera installed at a position that captures the user is acquired. The camera parameters and arrangement are assumed to be known. As described above, by using the plurality of acquired moving images, it is possible to generate a moving image that matches the user's line of sight by image synthesis or the like.

  Next, the user visual acuity acquisition step S302 is executed by the user visual acuity information acquisition unit 102. The user eyesight information acquisition unit 102 acquires user eyesight information 111. The acquired user visual acuity information 111 includes at least information on the visual acuity of the user (naked eye visual acuity).

  Visual acuity (naked eye acuity) is an index indicating the resolution of the user's eyes. It is this visual acuity that is measured by a visual acuity test that is generally performed, and can be measured based on whether or not a Landolt ring (a figure with a 1 ° cut in a circle) placed 5 meters ahead can be recognized. . Since the relationship between the size of the cut of the Landolt ring and the visual acuity is defined not by the length but by the angle (viewing angle), it basically does not depend on the distance. Therefore, if the visual acuity is known, the eye resolution according to the distance from the eyes can be calculated.

  In the present embodiment, in order to realize a digital mirror that is easy to use for presbyopic users and does not blur the field of view, it is assumed that the user visual acuity information 111 also includes information on the user's clear visual field.

  The clear vision area is a distance range from the eye where the human eye can focus. The human eye can focus from near to far by adjusting the thickness of the lens corresponding to the lens in the camera. The power to adjust the focus is called the adjustment force. The point where the eye can focus is called the near point, and the farthest point is called the far point. Peripheral points are generally known to go away with aging, for example, the near point of a normal eye (normal vision) child is about 10 cm, but as the age increases, this near point goes away, It becomes 40 cm or more in the 40s and 50s and later when presbyopia appears. Note that the clear vision area information of each user can be easily measured using an optometer or the like used in ophthalmology or the like.

  The user visual acuity information acquisition unit 102 may use the user visual acuity information 111 input in advance by the user. In this case, the user's input may be performed through the UI provided with a user interface (UI) on a display device that displays the user image generated by the image processing apparatus 100. You may make it accept via wired or wireless from operation performed using UI on apparatuses, such as a typical PC or a portable terminal. Further, information stored as information associated with a user on a storage device such as a server or a PC provided separately may be received via wired or wireless communication. The user may be specified based on, for example, face recognition / biometric authentication or an ID unique to a mobile device such as a smartphone.

  FIGS. 5A to 5C show examples of user interfaces for allowing the user to input visual acuity information. FIG. 5A shows an example of an interface for inputting the user's visual acuity. In this example, the user inputs binocular vision. When inputting the visual acuity of the right eye and the left eye, a field for inputting each may be provided. When the input is completed, the user presses “Next” in the lower right.

  FIG. 5B shows an example of an interface for inputting a user's clear visual field. The user inputs information about his / her near point and far point that has been measured in advance. When the input is completed, the user presses “Next” in the lower right.

  FIG. 5C shows that the image processing apparatus 100 accepts the user's visual acuity and clear vision area information input via the user interfaces of FIGS. 5A and 5B as the user visual acuity information 111. It is a display example. Through the confirmation screen, the user can use the image processing apparatus 100 as a digital mirror.

  Refer to FIG. 4 again.

  Next, the user distance acquisition step S <b> 303 is executed by the user distance acquisition unit 103.

  The user distance 112 is acquired as the distance from the user to the display surface of the display device, more precisely as the distance from the user's eyes to the display surface of the display device.

  As in the case of using a normal mirror, the user may stand facing the display device. As a method for detecting the user's eyes, for example, a method of detecting a region indicating eye characteristics from an image as proposed in Patent Document 3 can be applied. It may be used in combination with face detection. Moreover, as shown in Patent Document 4, a method of obtaining the position of the eye based on the reflected light of the eye with respect to light from a light source such as visible light or infrared light provided separately may be used. If the position of the eye on the image is known, the three-dimensional position of the eye may be obtained by a simple calculation method such as triangulation from moving images acquired from a plurality of cameras, for example. A distance sensor that has a known positional relationship with the camera that has acquired the moving image used to detect the position may be provided, and the detected three-dimensional position of the eye may be obtained using this distance sensor. Since the positional relationship between the camera and the display device can be obtained in advance, if the three-dimensional positional relationship between the camera and the user's eyes is known, the positional relationship between the camera and the display device can be determined based on the previously obtained positional relationship between the camera and the display device. The user distance 112 that is the distance from the display device to the user's eyes can be easily obtained.

  Note that the moving image acquisition step S301, the user visual acuity acquisition step S302, and the user distance acquisition step S303 can be processed independently, and the processing order may be different from the above description, and the processing proceeds in parallel. May be.

  Further, the user visual acuity acquisition step S302 can be omitted after the user inputs once. It may be executed again when the eyesight changes or when another user uses the image processing apparatus 100.

  Next, the enlargement / reduction method determination step S304 is executed by the enlargement / reduction method determination unit 104. The enlargement / reduction method determination step S304 is an enlargement / reduction which is a display mode of a mirror moving image to be finally displayed based on the user visual acuity information 111 received by the user visual acuity information acquisition unit 102 and the user distance 112 received by the user distance acquisition unit 103. Decide how.

  This device is especially useful for presbyopic people who want to see images that are close to the mirror for the purpose of detailed work such as eye makeup. The purpose is to realize a digital mirror that can visually recognize an image.

  That is, in a general digital mirror or mirror, a user image having a size that is obtained when the user approaches the display screen rather than the near point can be displayed even if the user does not approach the display screen than the near point. Just make it visible. By doing in this way, the user can see the user image as when approaching the mirror without blurring.

  In particular, when targeting a user who approaches a mirror for the purpose of eye makeup, as described above, one hair such as eyelashes or hair can be clearly seen at a point closest to the display screen. That is, it is desirable to determine the display magnification ratio of the user image on the screen so that the user can visually recognize an object having at least the user's eyelash = width 0.09 mm displayed on the screen. The minimum size that the user can visually recognize at a specific distance can be obtained based on the user's visual acuity indicating the resolution of the user's eyes.

  How to determine the scaling method based on visual acuity and distance will be described in more detail below.

  The relationship between visual acuity and eye resolution is shown in FIG.

  In general, a visual acuity of 1.0 indicates a direction in which a part of a ring having a diameter of about 7.28 mm and a thickness of about 1.45 mm is cut with a width of about 1.45 mm from 5 m ahead. Yes. In addition, for the sake of simplicity, the following description uses a standard in which the diameter of the ring is 7.5 mm and the width of the ring is 1.5 mm. As shown in FIG. 6A, the visual acuity is defined by the visual angle. For example, a user with visual acuity 1.0 corresponds to a resolution of 1.5 mm at 5 m ahead and 0.9 mm at 3 m ahead.

  Here, as an example, consider that a user who has a near point in the clear vision region of 40 cm and a visual acuity of 1.0 uses this apparatus.

  If a size corresponding to the “width of the Landolt ring” that a user with a certain visual acuity can recognize at a certain distance away is referred to as resolution hereinafter, the user whose visual acuity is 1.0 is 40 cm ahead. The resolution at is 0.12 mm (FIG. 6B).

  Since the visual acuity is inversely proportional to the visual angle that can be visually recognized, the resolution with respect to the distance can be easily obtained as shown in FIG.

  As described above, the enlargement / reduction method determination unit 104 displays the information when the user faces the display device from a distance of 40 cm, which corresponds to the user's near point, with respect to the user whose visual acuity is 1.0 and the near point is 40 cm. The moving image acquisition so that the user's eyelashes displayed on the device are displayed on the display device with a size of 0.12 mm or more, which corresponds to the resolution of the eyes at the near point distance in the user's visual acuity The enlargement ratio at the time of displaying the user image acquired by the copy is determined.

  That is, the enlargement / reduction method determination unit 104 sets 0.09 mm (user hair) as a enlargement / reduction method when the user distance 112 is a distance corresponding to a near point, which is located at a point away from the display device by a distance corresponding to the near point. The user acquired by the moving image acquisition unit so that an object having a size corresponding to the diameter of the user is displayed larger on the display device than the size corresponding to the resolution of the user's eyes at the user distance. The enlargement ratio when displaying the image is determined.

  Here, for the sake of simplicity, a case will be described in which the camera that acquires the user image is integrated with the display device as shown in FIG. Assuming that the camera optical axis and the user's line of sight substantially coincide, the distance from the camera to the user's eyes and eyelashes can be expressed by the user distance.

  The actual size when displaying an image captured by the camera on the display device greatly depends on display parameters (resolution, pixel size, etc.). Therefore, in order to determine the size at which the user's eyelashes are actually displayed on the display device, an object having a specific size in real space located at a specific distance on the camera optical axis is displayed on the display. It is necessary to obtain the displayed size as a table or a conversion formula in advance.

  For example, consider a case where a 0.09 mm object assuming eyelashes is displayed on the display device with the size shown in FIG. At 40 cm, which is near the clear vision area of the assumed user, the resolution of the user's eyes is 0.12 mm, whereas the size at which an 0.09 mm object is displayed is 0.06 mm. In this case, since the eye resolution is coarser than the size of the displayed eyelashes, the user cannot satisfactorily visually recognize the eyelashes. To match the eye resolution with the size of the displayed eyelashes, the displayed image side may be enlarged twice. Therefore, in this case, the enlargement / reduction method determination unit 104 determines that the enlargement method at the near point of the user is to be doubled with the optical axis of the camera as the enlargement center.

  Actually, the captured moving image of the user includes distortion due to the lens of the camera. Since correction is particularly necessary when the user's eyes are not on the camera optical axis, it is desirable to calibrate the camera in advance. Further, even when there is no user's eyes on the camera optical axis, the user distance is known and the user distance acquisition unit previously stores the distance on the display image and (distance from the display device). If the position of the user's eyes in the three-dimensional space (used for calculation) has been detected, the user's eyelashes located at a certain user distance are displayed on the two-dimensional image using the camera parameters obtained by the calibration. Thus, it is possible to easily determine which pixel is displayed, and by multiplying this by the pixel size of the display, it is possible to easily determine the size displayed on the display device. As in the case described above, the enlargement ratio is such that the obtained size is displayed larger than the user's resolution at the user distance, and the enlargement center is the user on the display image. The enlargement / reduction method may be determined so that the position of the eye is located.

  Note that camera calibration and coordinate conversion between 3D coordinates and 2D images can be easily realized by methods well known in the field of computer vision, and are detailed here in non-patent literature (textbooks). Details are omitted.

  Since this apparatus is a digital mirror, it is desirable to display a mirror image of the user's image actually captured by the camera, particularly when the front of the user is being photographed. In this case, it is necessary to incorporate mirror image inversion into the conversion formula when the coordinate conversion between the three-dimensional coordinate and the two-dimensional image is performed.

  As described above, when the enlargement / reduction method is determined so that the user can visually recognize one hair when the user distance is near the clear vision area, the user blurs the desired work. Can be realized.

  In the case of the user distance farther than the near point, it is desirable to determine so that the displayed image changes smoothly according to the change in the user distance. Although the magnification at the near point may be maintained as it is, as shown in FIG. 8, the position that the user faces most naturally in the clear vision region is set as the reference position (in the example of FIG. 8, For example, the enlargement rate may be linearly interpolated so that the enlargement rate is 100%. In this way, when the user approaches the display screen, the user can see the natural mirror moving image that has not been magnified at the standard position while smoothly enlarging like a mirror, and the digital mirror is more comfortable. Can be realized. Note that “smoothly” means that, as described above, an image with an enlargement ratio of P% is not suddenly changed to an image with an enlargement ratio of Q%. It means that the image is changed to an image having an enlargement ratio of Q% while being reduced and / or reduced. Note that “in stages” means that at least an image with an enlargement ratio of R% between P% and Q% is inserted. If there are many images to be inserted, smoother changes are possible.

  Next, the image generation step S305 is executed by the image generation unit 105. The image generation unit 105 generates a user moving image to be finally displayed based on the moving image 110 received by the moving image input unit 101 and the enlargement / reduction method determined by the enlargement / reduction method determination unit 104, and receives the received image to the output unit 105. hand over.

  Finally, an output step S305 is executed by the output unit 105. The output unit 105 converts the moving image received from the image generation unit 104 into a format that can be viewed on a display device such as a display, and outputs the converted image to the display device 120 as a mirror moving image.

  As described above, according to the present embodiment, even a presbyopic user can convert and output an image that is easy to work without blurring during fine work such as eye makeup.

(Another operation example 1 of the first embodiment)
Note that, depending on the arrangement of the cameras, a configuration in which a viewpoint from the rear of the user can also be selected can be employed. In this case as well, it is desirable to deal with fine work similar to mascara, such as gray hair removal. The diameter of one hair is said to be 0.05 mm to 0.15 mm, for example, the average for Japanese is 0.08 mm. Therefore, for example, in the case of Japanese, instead of the eyelash diameter of 0.09 mm, the enlargement / reduction method determination unit 104 may determine the enlargement ratio so that 0.08 mm can be seen at the near point.

  In addition, when applying mascara to eyelashes or applying eye shadow to the eyelashes at the time of eye makeup, the user often closes one eye on the side to be applied. This is because it is finished more beautifully. Therefore, the user eyesight information acquisition unit 102 may also acquire a determination result as to whether the user's eyes are open or one of the eyes is closed. Whether or not the user's eyes are open is determined for in-vehicle use particularly for the purpose of detecting dozing. For example, many methods based on image recognition have been proposed, and any method may be used here. As a determination result, the user visual acuity information acquisition unit 102 acquires the binocular visual acuity when both eyes are open, or the open one-eye visual acuity as user visual acuity information when one eye is closed. In this way, the enlargement / reduction method can be determined so that clear vision is possible even when there is a difference in visual acuity between both eyes.

  Note that if the enlargement / reduction method determination unit 104 always adjusts according to the visual acuity, even if the user needs to move closer to or away from the mirror, the adjustment is performed in the same manner. . That is, even when the user does not approach the position closer to the display device than the near point, an excessively enlarged user image may be displayed at the near point, which may cause a sense of incongruity.

  Therefore, the enlargement / reduction method determination unit 104 uses the image as a normal digital mirror (for example, enlargement / reduction ratio is 100% (equal magnification)) until the user approaches the display device rather than the near point after the start of use. The adjustment of the enlargement / reduction ratio according to the visual acuity may be started as soon as it is detected that the display device is closer to the display device than the near point.

  These general or specific aspects may be realized by a system, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM. The system, method, integrated circuit, computer program And any combination of recording media.

(Embodiment 2)
In the first embodiment, an example in which the present disclosure is realized with the configuration of FIG. 2 will be described, and a display method that is not blurred for a presbyopic user is realized. Can also be realized.

  In this embodiment, when a myopic user confirms the appearance in front of the mirror, in order to confirm the user image from a position far from the clear vision area, to solve the problem that the user image is blurred, A display device and method will be described.

  FIG. 9 is a block diagram showing a functional configuration of the image processing apparatus 800 in the present embodiment. As illustrated in FIG. 9, the image processing apparatus 100 includes a moving image acquisition unit 101, a user visual acuity information acquisition unit 102, a user distance acquisition unit 103, an enlargement / reduction method determination unit 804, an image generation unit 105, and an output unit 106. Since operations other than the enlargement / reduction method determination unit 804 are the same as those in the first embodiment, description thereof is omitted here. FIG. 4 is also used for a flowchart showing a processing procedure of the image processing apparatus 800. The difference is that the process of step S304 in FIG. 4 is changed to the process described below. Other steps are the same.

  The enlargement / reduction method determination unit 804 is an enlargement / reduction mode that is a display mode of the mirror moving image that is finally displayed based on the user visual acuity information 111 received by the user visual acuity information acquisition unit 102 and the user distance 112 received by the user distance acquisition unit 103. Decide how.

  This device is especially useful when a near-sighted user wants to see an image that is temporarily away from the mirror for the purpose of confirming the whole makeup and appearance. An object of the present invention is to realize a digital mirror that can visually recognize a user image without blurring.

  That is, in a general digital mirror or mirror, a user image having a size that can be obtained when the user is further away from the display screen than the far point can be displayed even if the user is not far from the display screen than the far point. Just make it visible. By doing in this way, the user can see the user image as if it is away from the mirror without blurring.

  In particular, when targeting users who are temporarily away from the mirror for the purpose of confirming the overall makeup and appearance as described above, they were farthest from the display screen and within the visible range. In the far point, the entire face and whole body can be seen, i.e., the user's image on the screen can be enlarged so that the whole face or whole body of the user can fit on the screen when displayed on the screen. It is desirable to decide. Whether or not the entire face or whole body of the user fits on the screen when displayed on the screen may be based on, for example, the distance between both eyes of the user. For each user, the height / head size of the user and the distance between both eyes may be registered in advance, or an average value may be used (for example, in the case of a Japanese adult woman, the head length: about 23 cm). Interocular distance: about 6 cm, height: about 158 cm, etc.). As in the first embodiment, the position of the user's eyes located at a certain user distance on the captured user image can be obtained when the user distance calculation unit calculates the distance, and the camera image is displayed on the display device. Since the conversion of the displayed image is also known, if the number of vertical and horizontal pixels of the display screen is known, it can be easily determined whether or not the entire face or whole body of the user will fit on the screen when displayed on the screen. When the image is settled, the enlargement / reduction rate is kept at 100%, and only when the image does not disappear, the enlargement / reduction rate and the enlargement / reduction center are determined so that the digital image can be realized.

  As described above, when the enlargement / reduction method is determined so that the user can visually recognize the entire face or the whole body when the user distance is the far point of the clear vision region, the user blurs the desired work. It can be realized without.

  In the case of the above description, the user's eyesight information does not necessarily require information on the resolution of the user's eyes. Therefore, it is good also as including only the information regarding a user's clear vision area.

  In the case of the user distance closer than the far point, it is desirable to determine so that the displayed image changes smoothly according to the change in the user distance. The enlargement ratio at the far point may be maintained as it is. However, as in the example of FIG. 8, the position where the user faces the most naturally in the clear vision area is set as the reference position, and the enlargement ratio is 100. The enlargement ratio between them may be linearly interpolated so as to be%. In this way, when the user moves away from the display screen, the natural mirror moving image that has not been reduced can be seen at the standard position while being reduced smoothly like a mirror, and the digital mirror is more comfortable. Can be realized.

  Furthermore, although the first embodiment and the second embodiment have been described as different configurations, the enlargement / reduction method determination unit has a function of performing both the processes of the first embodiment and the second embodiment at the same time. May be. By doing in this way, both the expansion / contraction rate at the near point and the expansion / contraction rate at the far point can be obtained. In this case, even in the case of a user distance farther than the near point and closer than the far point, it is determined so that the displayed image changes smoothly according to the change in the user distance, as in the above description. Is desirable. That is, the enlargement / reduction ratio between the near point and the enlargement / reduction ratio at the far point in the clear vision area may be obtained by linearly interpolating between the two enlargement / reduction ratios. In this way, when the user moves away from the display screen, the natural mirror moving image that has not been reduced can be seen at the standard position while being reduced smoothly like a mirror, and the digital mirror is more comfortable. Can be realized.

  In particular, when myopia is very advanced, the clear vision area may be very close to the display screen, and the pixel size of the display device may be coarser than the eye resolution at the near point. There is. In such a case, the pixel size of the display device may be used instead of the eye resolution at the near point.

  In the case where the functions of both the first embodiment and the second embodiment are provided at the same time, the operation corresponding to which embodiment is performed, that is, whether the user is presbyopia or myopia It is not necessary. The reason is that the information is already included in the user eyesight information 111. For example, it is possible to specify whether or not myopia is based on the user's visual acuity, and it is also possible to specify whether or not the user is presbyopia according to the information on the user's clear visual field. In any case, the image processing apparatus may perform the above-described operation.

  Further, when the user distance is out of the clear viewing area, for example, a message indicating that the user is out of the clear viewing area may be displayed on the display device, and the user may be prompted to return to the clear viewing area.

  Alternatively, the enlargement / reduction ratio may be controlled based only on the user's visual acuity so that the user can see as clearly as possible even if it is somewhat blurred. That is, when the user views the user image from a user distance outside the clear visual field, a resolution equivalent to that obtained when the user image is viewed from the user distance with a separately determined target visual acuity (good visual acuity) can be obtained. Thus, the enlargement / reduction method is determined.

  The resolution of the user's eyes at a certain user distance can be obtained from the user's visual acuity as described above. Here, a target visual acuity is determined separately. The target visual acuity may be acquired from the outside by the user visual acuity information acquisition unit 102, or may be held in advance by the image processing apparatus 100. In the latter case, 1.0, which is generally regarded as normal vision, may be used, and if the user usually wears a vision correction tool, the vision after vision correction may be adopted. Information about the target visual acuity may be held in the RAM 203 or the ROM 204, or may be held in the HDD 205 (FIG. 3). Alternatively, it may be held in a register (not shown) of the CPU 202 or the like. In the processing, the CPU 202 may acquire target visual acuity information. Thereby, the eye resolution (target resolution) at the target visual acuity at the same user distance can be obtained in the same manner as the eye resolution of the user.

  Here, by using the ratio obtained by dividing the resolution of the user's eyes by the target resolution as the display magnification rate, the display magnification rate is somewhat blurred, but it can be brought close to the state as seen with the target visual acuity.

  In particular, in the case of myopia, the user often views the mirror while wearing the vision correction tool. In this case, the vision information acquisition unit 103 may acquire a determination result as to whether or not the user is wearing a vision correction tool. Then, it is desirable to obtain the post-correction visual acuity as the user visual acuity information when the visual acuity correction tool is attached, and the naked eye visual acuity as the user visual acuity information when the visual acuity correction tool is not attached.

  For example, in the case of glasses, many methods have been proposed for determining whether or not a vision correction tool is worn, such as a method based on image recognition disclosed in Patent Document 5.

  Further, if the determination result as to whether or not the user wears the vision correction tool can be obtained at regular intervals, the enlargement / reduction method determination unit 104 can be used instead of the switch for starting the adjustment of the enlargement / reduction ratio. The user often removes the vision correction tool at the start of work such as makeup, particularly in the case of glasses. Therefore, until then, if the state that the visual acuity correction tool was put on until a certain point in time but was not put on from a certain point in time was not adjusted, the scaling method determination unit would start from that point. By starting the adjustment of the enlargement / reduction ratio based on visual acuity, a display method that takes the user's work into consideration can be realized.

  Further, the visual acuity information acquisition unit does not necessarily need to acquire clear vision area information from the outside. For example, the CPU 202 may estimate from the user's action. Specifically, calibration may be performed at the first use of the user. Before displaying the mirror image, display a message on the display screen and ask the user to move the message between the nearest position where the message can be clearly seen and the farthest position. Even if there is no information, the user's clear vision area can be easily acquired. Alternatively, it may be assumed that if the usage history, particularly the user distance, is accumulated for each user, an area that can be clearly seen by the user appears as a mountain in the user distance data. Therefore, initially, the display is controlled in the clear vision area determined in advance by the device, and after a certain period / number of times, the display is controlled using the clear vision area estimated based on the accumulated user distance data. You may do it. Furthermore, the clear viewing area may be automatically updated at regular intervals. As described above, the clear visual range changes according to the age, and therefore it is less time-consuming for the user to update the clear visual range automatically on the device side than to acquire it from the outside each time.

  In the description of the above-described embodiment, the camera 210a and the display device 220 are described as devices provided outside the computer 200 (or the image processing apparatuses 100 and 800). However, this is an example. The camera 210a and / or the display device 220 may be a device built in the computer 200 (or the image processing device 100 or 800).

(Embodiment 3)
In the first and second embodiments, the example in which the present disclosure is realized using dedicated hardware as illustrated in FIG. 1 has been described. In the present embodiment, another example of realizing the present disclosure using general-purpose hardware will be described.

  The hardware configuration example of this embodiment is also the same as that using the computer 200 shown in FIG. A program that implements the functions of the present disclosure is stored in the ROM 203 or the HDD 205, and is read into the RAM 204 and executed as necessary.

  As the computer 200, a desktop PC, a notebook PC, a tablet computer, a smartphone, or a mobile phone can be used. These terminals are equipped with a display device 220, a camera 210a for photographing a user from the front, a distance measuring sensor 210c, or an I / F 210a capable of acquiring user visual acuity information through communication or the like.

  In this way, if configured with general-purpose hardware, the digital mirror system of the present disclosure can be easily realized simply by downloading and executing a program that implements the functions of the present disclosure.

  Furthermore, a portable digital mirror system can be realized. For example, when a user picks up the digital mirror system, it is possible to display on the spot according to the visual acuity of each user.

  In addition, a multi-display system can be realized.

  In the first to third embodiments, when a multi-display is used, it is desirable to separately provide a user line-of-sight detection unit and acquire different user distances depending on which display the user is viewing.

  In the first embodiment, the user's visual acuity included in the user visual acuity information 111 is a numerical value measured by a predetermined method using the Landolt ring as an index. However, this description does not limit the index, measurement method, data format, and the like for measuring visual acuity. Any index, measurement method, and data format may be adopted as long as the resolution of the user's eyes can be calculated. For example, in the US and Europe, visual acuity may be measured using a snellen index using an alphabet or an E chart using only an E-shape as an index, and these may be used instead of the visual acuity measured using a Landolt ring. good. The visual acuity measured using a snellen index or an E chart is expressed as a fractional ratio of the distance at which the subject can be discriminated from a healthy person (person with visual acuity of 1.0). For example, it is expressed as a fraction such as “20/40” and “6/60”, the numerator represents the test distance, and the denominator represents the farthest distance that a healthy person can discriminate. If the subject finally discriminates the “20/40” indicator 20 feet away, the subject's visual acuity is “20/40”, which means that the healthy subject can discriminate the same indicator from 40 feet. In this fractional visual acuity, the value directly replaced by a decimal is the same as the decimal visual acuity measured using the Landolt ring as an index. For example, “20/40” corresponds to “0.5”, and “6/60” corresponds to “0.1”. Therefore, even if the visual acuity is fractional notation measured using a snellen index or an E chart as an index, the resolution of the user's eyes can be calculated in the same manner as in the first embodiment by replacing it with a decimal notation.

  In the description of the above-described embodiment, the user visual acuity information includes information on the user's naked eye visual acuity. However, the naked eye visual acuity is only an example, and any visual acuity may be used as long as it is the visual acuity of the user when using the image processing apparatus of the present invention. For example, when the user wears a contact lens, the user visual acuity information may include information on visual acuity after correction by the contact lens. In that case, no information on the naked eye vision is required. In light of the above, “naked eyesight” in the present disclosure may include corrected vision.

  The present disclosure can be used for an image processing technique in an apparatus such as a digital mirror. In addition, the present disclosure can also be used as a device incorporated in an AV device such as a tablet PC, a smartphone, a PC, a car navigation system, a video camera, or a TV capable of acquiring and browsing user images.

DESCRIPTION OF SYMBOLS 100 Image processing apparatus 101 Movie acquisition part 102 User visual information acquisition part 103 User distance acquisition part 104 Enlarging / contracting method determination part 105 Image generation part 106 Output part 110 Moving image 111 User visual acuity information 112 User distance 120 Display apparatus 200 Computer 201a, 201b, 201c, 201d I / F
202 CPU
203 ROM
204 RAM
205 HDD
210a Camera 210b Storage device 210c Distance sensor 210d Display device

Claims (17)

An image processing apparatus used when a user visually recognizes his / her own image,
A first interface for acquiring a moving image of the user;
A second interface for acquiring user eyesight information which is information relating to the user's eyesight;
A third interface for obtaining user distance information, which is information on a distance from the display device to the user;
A processor for determining an enlargement / reduction method including at least an enlargement / reduction ratio of the acquired moving image so that the user can clearly view a user image displayed on the display device based on the user distance information and user visual acuity information; ,
An image processing circuit for generating a mirror moving image of the user from the moving image according to the determined scaling method;
And a fourth interface for outputting the generated mirror moving image to a display device. The user visual acuity information further includes information on the clear visual area of the user,
The processor is configured such that the distance is a near point or a far point of the clear vision area of the user based on the user visual acuity information and a size of an area on the user image displayed on the display device. The image processing apparatus according to claim 1, wherein a scaling method is determined.   The region on the user image includes a display of the user's eyelashes or hair, and the processor displays the resolution of the user's eyes at the near point distance obtained from the user's visual acuity on a display device. The image processing apparatus according to claim 2, wherein an enlargement / reduction method when the distance is the near point is determined so as to be smaller than the size of the one eyelash or hair.   The second interface includes information regarding binocular visual acuity when both eyes of the user are open, information on visual acuity of the open eye when one eye is closed, and the user visual acuity information. The image processing apparatus according to claim 1, acquired as:   The processor determines an enlargement / reduction rate at a distance farther than the near point according to the change in the distance so that a displayed image changes stepwise based on the enlargement / reduction rate when the distance is the near point. The image processing apparatus according to claim 2.   The image according to claim 5, wherein the processor predetermines a reference distance point at which an enlargement / reduction ratio is equal to a position far from the near point, and interpolates stepwise between the near point and the reference distance. Processing equipment.   The processor sets the enlargement / reduction ratio to the same magnification until the user enters closer to the near point after the user starts use, and when the user is closer to the display device than the near point, the processor The image processing apparatus according to claim 2, wherein the enlargement / reduction method is determined so as to obtain an enlargement / reduction ratio corresponding to a visual acuity of the eye.   The area on the user image includes a display of the entire face or whole body of the user, and the processor is displayed on the display device when the distance is a far point of the clear vision area of the user. The image processing device according to claim 1, wherein the enlargement / reduction method is determined so that the entire face or whole body of the user is included in the display area of the display device. The processor further obtains information on target vision,
The processor determines the resolution of the user's eyes at a predetermined distance based on the user visual acuity information; determines the resolution of the user's eyes at the predetermined distance based on the target visual acuity;
The processor uses the resolution based on the user visual acuity information and the resolution based on the target visual acuity to allow the user to view the user image from the predetermined distance from the predetermined distance with the target visual acuity. The image processing apparatus according to claim 2, wherein the enlargement / reduction method is determined so that a resolution equivalent to that when a user image is viewed is obtained.   The processor determines the scaling ratio at a distance closer to the far point so that the displayed image changes stepwise based on the scaling ratio when the distance is the far point of the clear vision area of the user. The image processing device according to claim 8, wherein the image processing device is determined in accordance with a change in the number.   The image according to claim 10, wherein the processor predetermines a reference distance point at which an enlargement / reduction ratio is equal to a position far from the far point, and interpolates stepwise between the far point and the reference distance. Processing equipment.   When both the near-point scaling factor and the far-point scaling factor of the user's clear vision area have been obtained, the processor determines whether the near-point scaling factor and the far-point scaling factor are between. The image processing apparatus according to claim 2, wherein stepwise interpolation is performed between a point at the near point distance and a point at the far point distance.   The second interface further obtains information about the corrected visual acuity as the user visual acuity information when the user is wearing a visual acuity correction tool, and information on the naked eye visual acuity when the user is not wearing it. The image processing apparatus according to claim 1, which is acquired as visual acuity information.   The processor receives a determination result as to whether or not the user is wearing a vision correction tool, and when the vision correction tool worn by the user is removed, the processor scales based on the user's naked eye vision The image processing apparatus according to claim 9 or 13, wherein the rate is adjusted.   The image processing apparatus according to claim 1, wherein the processor estimates the clear vision area of the user from the operation of the user. An image processing method used when a user visually recognizes his / her own image,
Get the user ’s video,
Obtaining user vision information, which is information about the user's vision,
Obtaining user distance information, which is information on the distance from the display device to the user,
Based on the user distance information and user visual acuity information, a scaling method including at least a scaling ratio of the acquired moving image is determined so that the user can clearly view a user image displayed on the display device,
Generating a mirror moving image of the user from the moving image according to the determined scaling method;
An image processing method for outputting the generated mirror moving image to a display device.   A computer program for causing a computer to execute the image processing method according to claim 16.

Images