JP2018194998A - Information processing device and information processing method - Google Patents

Abstract

To provide an information processing device capable of detecting that a display unit is being peeped.SOLUTION: An information processing device comprises: a display unit 13; a line-of-sight detection unit 15 which acquires line-of-sight information representing a line-of-sight direction of a user; and a processing unit 11 which finds the line-of-sight direction of the user on the basis of the line-of-sight information acquired by the light-of-sight detection unit 15, finds a watched position of the user on the basis of the line-of-sight direction, calculates the number of positions watched on a screen of the display unit 13 on the basis of the watched position, and determines whether two or more users are staring into the screen of the display unit 13 on the basis of the calculated number of watched positions.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information processing apparatus and an information processing method including a display unit.

  2. Description of the Related Art Conventionally, an automated transaction machine (ATM) has been used in a financial institution such as a bank or a convenience store.

  A user of an automatic transaction apparatus performs procedures such as depositing, withdrawing or transferring money using the automatic transaction apparatus.

  Personal information such as the user's name, account number, or balance is displayed on the display unit of the automatic transaction apparatus during transaction processing.

  Therefore, to prevent the image of the display unit during the transaction from being peeped, arrange a vertical stand on the left and right of the automatic transaction apparatus, or a light-shielding filter that prevents the display unit from peeping obliquely on the screen of the display unit Wearing is done.

  In addition, taking a picture of a user of an automatic transaction apparatus and acquiring an image of a suspicious user is performed (for example, Patent Document 1).

Japanese Patent Laying-Open No. 2006-170496

  However, since the screen of the display unit of the automatic transaction apparatus is visible to the user, if it is located within the field of view of this display unit, a person other than the user looks into the screen of the display unit. It is possible to see.

  Therefore, an object of the present specification is to provide an information processing apparatus and an information processing method that can detect that the display unit is being looked into.

  According to one form of the information processing device disclosed in the present specification, based on the display unit, the gaze detection unit that acquires gaze information representing the gaze direction of the user, and the gaze information acquired by the gaze detection unit, The gaze direction is obtained, the gaze position of the user is obtained based on the gaze direction, the number of gaze positions directed to the screen of the display unit 13 is obtained based on the gaze position, and the display unit is determined based on the number of gaze positions. And a processing unit that determines whether or not two or more users' eyes are directed on the screen.

  Moreover, according to one form of the information processing method disclosed in the present specification, the user's line-of-sight information representing the user's line-of-sight obtained by the line-of-sight detection unit is used to determine the user's line-of-sight direction, and the line-of-sight direction is used. The processor executes obtaining a user's gaze position and determining whether or not two or more users' gazes are directed to the display unit based on the gaze position.

  According to one aspect of the form disclosed in this specification, it can be detected that the display unit is being looked into.

It is a figure showing a 1st embodiment of an automatic transaction device indicated in this specification. It is a figure which shows the peeper except the screen which the user is operating. It is a figure which shows the screen of a display part. It is a figure which shows the flowchart explaining operation | movement of the automatic transaction apparatus of 1st Embodiment. It is a figure which shows the image which the eyes | visual_axis detection part acquired. It is a figure which shows the display part and line-of-sight detection part of 2nd Embodiment of the automatic transaction apparatus as information processing apparatus disclosed to this specification. It is a figure which shows the flowchart explaining operation | movement of the automatic transaction apparatus of 2nd Embodiment.

  Hereinafter, a preferred first embodiment of an automatic transaction apparatus as an information processing apparatus disclosed in the present specification will be described with reference to the drawings. However, the technical scope of the present invention is not limited to these embodiments, but extends to the invention described in the claims and equivalents thereof.

  FIG. 1 is a diagram illustrating a first embodiment of an automatic transaction apparatus as an information processing apparatus disclosed in this specification. FIG. 2 is a diagram showing a peeper excluding the screen operated by the user. FIG. 3 is a diagram illustrating a screen of the display unit.

  An automatic transaction apparatus 10 (hereinafter also simply referred to as apparatus 10) as an information processing apparatus according to the present embodiment is disposed in a financial institution such as a bank or a convenience store, and is operated by a user to deposit and withdraw cash. Or, perform the transfer and other procedures.

  The apparatus 10 is connected to the financial institution server 30 via the network N so as to be communicable. The apparatus 10 transmits information on transactions performed to the user to the server 30 via the network N for each process or according to a predetermined rule. Based on the information received from the device 10, the server 30 updates the user transaction information stored in the database.

  As shown in FIG. 2, when the user X is operating the apparatus 10, the screen of the display unit 13 displays, for example, the name, account number, or balance of the user X as shown in FIG. Personal information is displayed.

  Even if the device 10 includes a stand for preventing peeping, the screen of the display unit 13 is visible to the user X who is within the field of view of the display unit 13. Therefore, the peeper Y behind the user X can peep at the screen of the display unit 13 as long as it is located within the field of view of the display unit 13.

  When the device 10 determines that the user X who is operating the device 10 is viewing the screen of the display unit 13 except for the screen, the device 10 turns off the display unit 13 and looks into the screen. It has a function to prevent.

  Hereinafter, the device 10 will be further described.

  The processing unit 11 includes one or a plurality of processors and peripheral circuits. The processing unit 11 controls each hardware component of the apparatus 10 according to a predetermined program stored in advance in the storage unit 12 and performs various processes, and temporarily stores data generated during the processing. 12 is used.

  The storage unit 12 may include a semiconductor memory such as a random access memory (RAM) or a read only memory (ROM), or a nonvolatile memory such as a magnetic disk or a flash memory. The storage unit 12 may have a drive (not shown) that can read a program stored in a non-temporary storage medium.

  In addition, the storage unit 12 stores various data used for detecting the user's gaze position. For example, the storage unit 12 stores a reference table that represents the relationship between the relative position of the pupil center of gravity to the center of gravity of the Purkinje image and the user's gaze direction, and a reference table that represents the relationship between the gaze direction and the gaze position. Further, the storage unit 12 obtains the coordinates of the measurement point of the eye gaze position before calibration detected based on the image of the eyes of the user or the like obtained from the line-of-sight detection unit 15 described later. Memorize the order.

  The display unit 13 is controlled by the processing unit 11 and can display various types of information associated with the operation of the apparatus 10 on the screen. For example, a liquid crystal display can be used as the display unit 13.

  The operation unit 14 is operated by a user or the like (user) of the apparatus 10 and can input an operation. The device 10 can use, for example, a keyboard or a touch panel as the operation unit 14.

  The line-of-sight detection unit 15 is arranged around the display unit 13 and acquires an image as measurement data (line-of-sight information) representing the direction of the line of sight of the user or the like every predetermined period (for example, 1 millisecond to 33 milliseconds). To do. Then, the line-of-sight detection unit 15 outputs the acquired image to the processing unit 11.

  For example, the line-of-sight detection unit 15 includes an infrared light emitting diode, an image sensor having sensitivity to infrared rays such as a CCD or a C-MOS, and a camera including an imaging optical system. Then, the line-of-sight detection unit 15 represents the pupil of the eyes of the user and the cornea reflection image (hereinafter referred to as the Purkinje image) in which the light emitted from the infrared light emitting diode is reflected by the cornea as the measurement data. An image is generated by a camera.

  In the present embodiment, the line-of-sight detection unit 15 is disposed below the display unit 13 toward a user or the like facing the display unit 13. The infrared light emitting diode included in the line-of-sight detection unit 15 illuminates the eyes of a user or the like. The camera of the line-of-sight detection unit 15 generates an image including the entire face of the user or a part of the face including at least one eye of the user or the like who views the display unit 13.

  The imaging unit 16 is controlled by the processing unit 11 to capture an image of a user or the like who is operating the device 10. The captured image of the user or the like is stored in the storage unit 12. The imaging unit 16 includes, for example, a camera having a CCD or C-MOS.

  The card processing unit 17 executes processing such as reading of information on a financial card inserted by a user from a card insertion / discharge port (not shown). Further, the card processing unit 17 performs processing such as transporting the financial card, releasing it from the card insertion / discharge port, and returning it to the customer. For example, the card processing unit 17 includes a transport mechanism that transports a financial card, a magnetic head that reads the magnetic recording of the financial card, and a control circuit that controls the magnetic head and the transport mechanism.

  The coin processing unit 18 and the banknote processing unit 19, according to the transaction executed by the apparatus 10, deposit or withdraw coins and banknotes corresponding to the amount of money based on the format of the transaction and a banknote depositing / withdrawing port ( (Not shown). For example, the coin processing unit 18 includes a coin counting mechanism that counts coins and a control circuit that controls the coin counting mechanism. The banknote processing unit 19 includes a banknote counting mechanism that counts banknotes and a control circuit that controls the banknote counting mechanism.

  The printing unit 20 conveys a passbook inserted by a user from a passbook insertion / discharge port (not shown) to a predetermined position, and passes a history of transactions executed in response to a transaction execution instruction from the processing unit 11. Is printed on the page. Further, the printing unit 20 conveys the passbook for which the transaction history and the like have been recorded, releases it from the passbook insertion / discharge port, and returns it to the customer. For example, the printing unit 20 includes a conveyance mechanism that conveys a bankbook, a printing mechanism that prints on the bankbook, and a control circuit that controls the conveyance mechanism and the printing mechanism.

  The communication unit 21 transmits and receives information via the network N. The communication unit 21 may include a communication circuit and a communication line that perform transmission and reception. The apparatus 10 transmits / receives information, such as a program and transaction history, using the communication part 21, for example.

  The sound output unit 22 is controlled by the processing unit 11 to output sound. For example, the sound output unit 22 outputs voice guidance to a user who operates the device 10. For example, the sound output unit 22 includes a speaker.

  Next, the operation of the apparatus 10 described above will be described below with reference to the flowchart shown in FIG.

  First, in step S <b> 401, the processing unit 11 extracts a region of one of the eyes of the user or the like, for example, the right region, from the image acquired by the line-of-sight detection unit 15. The users and the like mean, for example, the user X and the peeper Y shown in FIG.

  The visual field of the line-of-sight detection unit 15 includes the entire region included in the viewing angle of the display unit 13. Therefore, the eyes of the user or the like who are gazing at the screen while being positioned within the range in which the image of the display unit 13 is visible are included in the visual field of the line-of-sight detection unit 15. If the right eye region of the user or the like is not extracted from the image acquired by the line-of-sight detection unit 15, the number of gaze positions on the screen of the display unit 13 is set to zero, and the process proceeds to step S405.

  FIG. 5 is a diagram illustrating an image acquired by the line-of-sight detection unit.

  In the example shown in FIG. 5, faces of two users or the like are shown in the image 40 acquired by the line-of-sight detection unit 15. The processing unit 11 extracts regions 41a, 41b, 42a, and 42b from the image as eye regions.

  Specifically, the processing unit 11 first detects a region where an eye is seen from an image acquired by the line-of-sight detection unit 15. The luminance of the pixel corresponding to the eye is significantly different from the luminance of the pixel corresponding to the periphery of the eye. Therefore, the processing unit 11 performs, for example, a difference calculation between neighboring pixels in the vertical direction using each of the pixels in the image using a Sobel filter to detect an edge pixel whose luminance changes in the vertical direction. Then, the processing unit 11 sets, for example, a region surrounded by two edge lines in which edge pixels are connected in a substantially horizontal direction by a predetermined number or more corresponding to the size of the eye. Alternatively, the processing unit 11 may detect a region that most closely matches the template in the image by template matching between the template representing the image of the eye on the image and the image, and may use the detected region as the eye region.

  Then, when the four eye regions 41a, 41b, 42a, and 42b are extracted, the processing unit 11 determines the right eye of one user based on the number of pixels between the two regions in the image 40. And a pair of eye regions 41a and 41b, 42a and 42b corresponding to the left eye. This is because, based on the positional relationship between the display unit 13 of the device 10 and the user who operates the device 10, it is considered that the area of one eye in the image 40 is located within a predetermined range. .

  The processing unit 11 also includes a pair of eyes corresponding to the right eye and the left eye of a single user having two areas in which a difference in vertical position between the two eye areas is within a predetermined range. The regions 41a and 41b, 42a and 42b may be identified. This is because one person's eyes are considered to be arranged at substantially the same position in the vertical direction in the image 40. Further, the processing unit 11 may identify a pair of eye regions 41a and 41b, 42a and 42b corresponding to the right eye and the left eye of one user based on the size of the iris. This is because the size of one person's eyes is considered to have almost the same size in the image 40. The size of the iris is detected using, for example, template matching. Then, the processing unit 11 selects the region 41a and the region 41b located on the left side on the image 40 as the region corresponding to the right eye among the pair of identified eye regions 41a and 41b and 42a and 42b. .

  Next, in step S403, the processing unit 11 obtains the gaze direction of the right eye of the user or the like, and obtains the gaze position of the user or the like using the obtained gaze direction of the right eye. Then, the processing unit 11 obtains the number of gaze positions directed to the screen of the display unit 13 based on the gaze position of the right eye. The number of gaze positions means the number of people who are looking at the screen of the display unit 13.

  Specifically, the processing unit 11 detects an area where the pupil is reflected in the right eye area. In the present embodiment, the processing unit 11 performs template matching between the template corresponding to the pupil and the eye region, and detects a region having the highest degree of matching with the template in the eye region. When the highest coincidence value is higher than a predetermined coincidence threshold value, the processing unit 11 determines that the pupil is reflected in the detected area.

  The luminance of the region where the pupil is reflected is lower than the luminance of the surrounding region, and the pupil is substantially circular. Therefore, the processing unit 11 sets two rings having different radii concentrically within the region of the right eye. When the difference value obtained by subtracting the average luminance value of the inner pixels from the average luminance value of the pixels corresponding to the outer ring is greater than a predetermined threshold, the processing unit 11 is an area surrounded by the inner ring. May be the pupil region. The processing unit 11 calculates the average value of the horizontal coordinate values and the average value of the vertical coordinate values of each pixel included in the pupil region as the coordinates of the center of gravity of the pupil region.

  Further, the processing unit 11 detects the Purkinje image of the infrared light emitting diode included in the line-of-sight detection unit in the right eye region. The processing unit 11 calculates the average value of the horizontal coordinate values and the average value of the vertical coordinate values of each pixel included in the Purkinje image as coordinates of the center of gravity of the Purkinje image.

  When the center of the pupil and the center of gravity of the Purkinje image are detected, the processing unit 11 detects the line-of-sight direction of the user or the like based on them.

  Since the surface of the cornea is substantially spherical, the position of the Purkinje image of the light source of the line-of-sight detection unit 15 is substantially constant regardless of the line-of-sight direction. On the other hand, the center of gravity of the pupil moves according to the line-of-sight direction of the user or the like. Therefore, the gaze position detection unit 11b can detect the user's line-of-sight direction by obtaining the relative position of the pupil center of gravity with respect to the center of gravity of the Purkinje image.

  In the present embodiment, the processing unit 11 determines the relative position of the pupil center of gravity with respect to the center of gravity of the Purkinje image, for example, the horizontal coordinate and vertical position of the center of gravity of the Purkinje image from the horizontal coordinate and vertical coordinate of the pupil center of gravity. It is obtained by subtracting the direction coordinates. And the process part 11 pinpoints a user's eyes | visual_axis direction by referring the reference table showing the relationship between the relative position of a pupil's gravity center and a user's eyes | visual_axis direction.

  When the processing unit 11 detects the gaze direction of the user or the like, the processing unit 11 displays the gaze direction of the user or the like and the positional relationship between the right eye of the assumed user or the like and the display unit 13 on the screen of the display unit 13. The gaze position of the user or the like is detected.

  In the present embodiment, the processing unit 11 refers to a reference table that represents the relationship between the gaze direction of the user and the gaze position in the assumed positional relationship between the user and the display unit 13 screen. A measurement point of the user's gaze position is obtained. Then, the processing unit 11 determines whether the measurement point of the user's gaze position is located within the screen of the display unit 13. When the processing unit 11 determines that the measurement point of the gaze position of the user is located within the screen of the display unit 13, the processing unit 11 acquires the coordinates on the screen of the display unit 13 of the measurement point of the gaze position of the user or the like. The data is stored in the storage unit 12 together with the order. Further, the processing unit 11 sets the number of gaze position measurement points of the determined user or the like located in the screen of the display unit 13 as the number of gaze positions on the screen of the display unit 13.

  Next, in step S405, the processing unit 11 determines whether or not the number of gaze positions on the screen of the display unit 13 is zero.

  When the number of gaze positions on the screen of the display unit 13 is zero (step S405—Yes), the processing unit 11 turns off the display unit 13 to reduce the use of power (step S407). Thereby, when there is no user who uses the apparatus 10, the power consumption of the apparatus 10 can be reduced. Instead of turning off the display unit 13, an advertisement or the like may be displayed on the display unit 13, and the standby device 10 may be used as an advertising device.

  On the other hand, when the number of gaze positions on the screen of the display unit 13 is not zero (step S405-No), in step S409, the processing unit 11 has one or two or more gaze positions on the screen. Determine whether. Based on the number of gaze positions on the screen of the display unit 13, the processing unit 11 determines whether or not two or more users' lines of sight are directed to the display unit 13.

  When the number of gaze positions on the screen of the display unit 13 is one (step S409-1), the number of users who are looking at the display unit 13 of the apparatus 10 is one, so I don't think yes. When the display unit 13 is turned off, the processing unit 11 turns on the display unit 13 (step S411), and the process returns to the step before step S401. Moreover, the process part 11 displays the operation item selected by a user on the display part 13, and starts the transaction with a user.

  On the other hand, when the number of gaze positions on the screen of the display unit 13 is two or more (step S409-2 or more), the number of users or the like who are looking at the display unit 13 of the apparatus 10 is two or more. It is thought that. Therefore, there is a possibility that another person is peeping at the screen of the display unit 13 of the device 10 operated by the user. Therefore, the processing unit 11 turns off the display unit 13 and stops displaying information including personal information displayed on the display unit 13 in step S413. Thereafter, the processing unit 11 may display on the display unit 13 that there is a possibility of being peeped, and call attention to the user. Furthermore, the apparatus 10 may output an acoustic signal that alerts the user that there is a possibility of being peeped using the acoustic output unit 22.

  According to the apparatus 10 of the present specification described above, it can be detected that the display unit 13 is being looked into. When it is determined that the display unit 13 is being looked into, the display unit 13 is turned off so that the screen of the display unit 13 cannot be seen.

  Next, 2nd Embodiment of the automatic transaction apparatus mentioned above is described below, referring FIG.6 and FIG.7. For points that are not particularly described in the other embodiments, the description in detail regarding the first embodiment is applied as appropriate. Moreover, the same code | symbol is attached | subjected to the same component.

  FIG. 6 is a diagram illustrating a display unit and a line-of-sight detection unit of the second embodiment of the automatic transaction apparatus as the information processing apparatus disclosed in this specification.

  The apparatus 10 of this embodiment includes a first line-of-sight detection unit 15a and a second line-of-sight detection unit 15b. The first line-of-sight detection unit 15 a and the second line-of-sight detection unit 15 b are arranged on both sides below the display unit 13.

  In the device 10, the entire visual field (the region within the chain line in FIG. 6) of the display unit 13 is not covered by one of the first visual line detection unit 15 a and the second visual line detection unit 15 b.

  Therefore, in the apparatus 10, the combined visual field obtained by combining the visual fields of the first visual line detection unit 15a and the second visual line detection unit 15b using the two first visual line detection units 15a and 15b is displayed on the display unit 13. All regions included in the viewing angle are included. Note that the apparatus 10 may include three or more line-of-sight detection units so as to include all the regions included in the viewing angle of the display unit 13. In this case, it is preferable to have a superimposed visual field in which the visual fields of at least two of the three or more visual line detection units overlap.

  The description of the first visual line detection unit of the first embodiment described above is appropriately applied to the first visual line detection unit 15a and the second visual line detection unit 15b.

  The apparatus 10 has a visual field F1 as a superimposed visual field in which the visual fields of the first visual line detection unit 15a and the second visual line detection unit 15b overlap. Each of the first line-of-sight detection unit 15a and the second line-of-sight detection unit 15b can detect line-of-sight information indicating the line-of-sight direction of a user or the like located in the visual field F1. The visual field F <b> 1 is determined so as to include a position where a user who uses the device 10 can operate the device 10.

  The visual field F2 is a region excluding the visual field F1 from the visual field of the first visual line detection unit 15a. The first line-of-sight detection unit 15a can detect line-of-sight information representing the line-of-sight direction of a user or the like located in the visual field F2, but the second line-of-sight detection unit 15b cannot detect it. The processing unit 11 includes line-of-sight information representing the line-of-sight direction of a user or the like located in the field of view F2 based on an image of a part excluding the region corresponding to the field of view F1 in the image acquired by the first line-of-sight detection unit 15a. Is detected.

  The visual field F3 is a region excluding the visual field F1 from the visual field of the second visual line detection unit 15b. The second line-of-sight detection unit 15b can detect line-of-sight information representing the line-of-sight direction of the user or the like located in the visual field F3, but the first line-of-sight detection unit 15a cannot detect it. The processing unit 11 includes line-of-sight information representing the line-of-sight direction of a user or the like located in the field of view F3 based on the image of the portion excluding the region corresponding to the field of view F1 in the image acquired by the second line of sight detection unit 15b. Is detected.

  The fields of view F2 and F3 can be determined to be areas where it is impossible or difficult for a person located within the fields of view F2 and F3 to operate the device 10.

  Next, the operation of the above-described apparatus 10 will be described below with reference to the flowchart shown in FIG.

  First, in step S701, the processing unit 11 extracts a region of the right eye of a user or the like from each of the images in the visual field F1 acquired by the first visual line detection unit 15a and the second visual line detection unit 15b. If the right eye region of the user or the like is not extracted from the image acquired by the line-of-sight detection unit 15, the number of gaze positions on the screen of the display unit 13 is set to zero, and the process proceeds to step S705.

  Next, in step S <b> 702, the processing unit 11 detects the gaze position of the right eye and obtains the number of gaze positions that are directed to the screen of the display unit 13.

  Next, in step S703, the processing unit 11 uses the number of gaze positions obtained based on the image acquired by the first line-of-sight detection unit 15a and the image acquired by the second line-of-sight detection unit 15b. It is determined whether or not the number of gaze positions obtained based on the same is the same. When the number of gaze positions calculated based on the image acquired by the first gaze detection unit 15a is different from the number of gaze positions calculated based on the image acquired by the second gaze detection unit 15b, the processing unit 11 (Step S703-No), the larger number of gaze positions is selected (S704). This is because the direction of the visual field of the first line-of-sight detection unit 15a is different from that of the second line-of-sight detection unit 15b, and thus images of the eyes of the user or the like who are in the visual field F1 may not be acquired in the same way. Then, the process proceeds to step S705.

  On the other hand, when the number of gaze positions calculated based on the image acquired by the first gaze detection unit 15a is the same as the number of gaze positions calculated based on the image acquired by the second gaze detection unit 15b (step S703). -Yes), the process proceeds to step S705.

  Next, in step S705, the processing unit 11 determines whether or not the number of gaze positions on the screen of the display unit 13 is zero.

  When the number of gaze positions on the screen of the display unit 13 is zero (step S705—Yes), the processing unit 11 turns off the display unit 13 and reduces the use of power (step S707). Even if a person is located in the field of view F2 or F3 and gazing at the screen of the display unit 13, it is determined that the user of the device 10 is not based on the positional relationship with the device 10. Thereby, even if a person other than the user who uses the device 10 is gazing at the screen of the display unit 13 of the device 10, the display unit 13 can be turned off to reduce power consumption.

  On the other hand, when the number of gaze positions on the screen of the display unit 13 is not zero (step S705-No), in step S709, the processing unit 11 has one gaze position on the screen of the display unit 13 or Judge whether two or more. In this way, the processing unit 11 obtains the number of lines of sight directed to the display unit 13 by a user or the like located in the visual field F1, based on the images acquired by the respective line-of-sight detection units 15a and 15b, and displays the display unit 13 It is determined whether or not two or more eyes are directed on the screen.

  When the number of gaze positions on the screen of the display unit 13 is one (step S709-1), the number of users who are looking at the display unit 13 of the apparatus 10 is one. I don't think yes. When the display unit 13 is turned off, the processing unit 11 turns on the display unit 13 (step S711), and the process returns to the step before step S701. Moreover, the process part 11 displays the operation item selected by a user on the display part 13, and starts the transaction with a user.

  On the other hand, when the number of gaze positions on the screen of the display unit 13 is two or more (step S709-2 or more), the number of users or the like who are looking at the display unit 13 of the apparatus 10 is two or more. It is thought that. Therefore, there is a possibility that another person is peeping at the screen of the display unit 13 of the device 10 operated by the user. Therefore, in step S713, the processing unit 11 turns off the display unit 13 and stops displaying information including personal information displayed on the display unit 13. Thereafter, the processing unit 11 may display on the display unit 13 that there is a possibility of being peeped, and call attention to the user. Furthermore, the apparatus 10 may output an acoustic signal that alerts the user that there is a possibility of being peeped using the acoustic output unit 22.

  According to the device 10 of the present specification described above, the same effects as those of the first embodiment described above can be obtained.

  In the present invention, the information processing apparatus and the information processing method of the above-described embodiment can be appropriately changed without departing from the gist of the present invention. In addition, the configuration requirements of one embodiment can be applied to other embodiments as appropriate.

  For example, in each of the above-described embodiments, the processing unit 11 extracts the right eye region of the user or the like from the image acquired by the line-of-sight detection unit 15, but the processing unit 11 is configured to extract the left eye of the user or the like. The number of gaze positions directed to the screen of the display unit 13 may be obtained by extracting a region.

  Alternatively, the binocular region of the user or the like may be extracted from the image acquired by the line-of-sight detection unit 15 to obtain the number of users or the like who are directing the line of sight to the screen of the display unit 13.

  All examples and conditional words mentioned herein are intended for educational purposes to help the reader deepen and understand the inventions and concepts contributed by the inventor. All examples and conditional words mentioned herein are to be construed without limitation to such specifically stated examples and conditions. Also, such exemplary mechanisms in the specification are not related to showing the superiority and inferiority of the present invention. While embodiments of the present invention have been described in detail, it should be understood that various changes, substitutions or modifications can be made without departing from the spirit and scope of the invention.

10 Automatic transaction equipment (information processing equipment)
DESCRIPTION OF SYMBOLS 11 Processing part 12 Memory | storage part 13 Display part 14 Operation part 15 Line of sight detection part 15a 1st line of sight detection part 15b 2nd line of sight detection part 16 Imaging | photography part 17 Card processing part 18 Coin processing part 19 Banknote processing part 20 Printing part 21 Communication part 30 Server 40 Image 41 User's right eye 42 Peeper's right eye N Network

Claims (8)

A display unit;
A line-of-sight detection unit that acquires line-of-sight information representing the user's line-of-sight direction;
Based on the line-of-sight information acquired by the line-of-sight detection unit, the user's line-of-sight direction is obtained, the user's gaze position is obtained based on the line-of-sight direction, and the screen is directed to the display unit based on the gaze position. A processing unit that determines the number of gaze positions, and determines whether or not two or more users' lines of sight are directed to the screen of the display unit based on the number of gaze positions;
An information processing apparatus comprising:   The information processing apparatus according to claim 1, wherein the processing unit obtains the gaze direction of a user's right eye or left eye based on the gaze information acquired by the gaze detection unit.   The information processing apparatus according to claim 1, wherein the processing unit turns off the display unit when determining that two or more users' eyes are directed to the display unit. A plurality of the line-of-sight detection units;
The information processing apparatus according to claim 1, wherein a combined visual field obtained by combining the visual fields of the plurality of visual line detection units includes a region included in a viewing angle of the display unit. Having a superimposed visual field in which the visual fields of at least two of the visual line detection units of the multiple visual line detection units overlap,
The processing unit obtains the number of lines of sight directed to the display unit by a user located in the superimposed visual field based on the line-of-sight information acquired by each of the line-of-sight detection units, and two or more persons are displayed on the display unit. The information processing apparatus according to claim 4, wherein it is determined whether or not the line of sight is directed.   When the number of persons whose line of sight is directed to the display unit, which is obtained based on the line-of-sight information acquired by each of the line-of-sight detection units, is different, The information processing apparatus according to claim 5, wherein the number of persons whose line of sight is directed to the display unit.   The information processing apparatus according to claim 5, wherein the processing unit turns off the display unit when it is determined that there is no line of sight directed to the display unit by a user located in the superimposed visual field. Obtaining a user's gaze direction using gaze information representing the user's gaze direction acquired by the gaze detection unit;
Determining a user's gaze position using the line-of-sight direction;
Determining whether or not two or more users' line of sight is directed to the screen of the display unit based on the gaze position;
An information processing method in which a processor executes.

Images