JP2014228949A - Information processing device and processing execution method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To execute predetermined processing using the sight line of a user.SOLUTION: According to an eyeglasses-type communication terminal 100, an own sight line detection unit 102 and an opposite person sight line detection unit 103 detect the sight line of a user, an operation object, and the sight line of an opposite person with whom the user is going to communicate, respectively. A sight line meeting determination unit 104 determines whether the sight line of the user and the sight line of the opposite person met or not, and if it was determined the sight lines met, a processing starting unit 105 executes predetermined processing. In an embodiment, for example, a communication unit 106 executes communication processing with the opposite person whose sight line met with that of the user.

Description

  The present invention relates to an information processing apparatus and a process execution method that execute a predetermined process using a user's line of sight as a trigger.

  A technique for detecting the line of sight and a technique using the same are considered. The technique described in Patent Document 1 relates to a gazing point detection system, and there is a description about detecting a gazing point of a user in a test scene.

Special table 2012-515579

  Generally, when executing some processing, for example, when establishing communication with a communication partner, it is necessary to align the positions of the terminals with the communication terminal facing the partner, or to operate using operation buttons or the like. Moreover, when performing infrared communication etc., the process for the position alignment is required. However, such operations and positioning are very time-consuming.

  Here, it is conceivable to perform some processing using a conventionally known technique for detecting a line of sight. In the above-mentioned Patent Document 1, there is a description of detecting a line of sight, but this is for detecting a human action, and does not execute any processing by using the detected line of sight as a trigger.

  Therefore, an object of the present invention is to provide an information processing apparatus and a process execution method that execute a predetermined process using a user's line of sight.

  In order to solve the above-described problem, an information processing apparatus according to the present invention is an information processing apparatus that is carried by a user and acquires information on the other party through the user's operation, and detects the other party's line of sight detection. A line-of-sight determination means for executing line-of-sight match determination processing based on the line-of-sight of the opponent detected by the line-of-sight eye detection means, and a predetermined process when the line-of-sight determination means determines that the line of sight matches. Processing execution means to execute.

  Also, the processing execution method of the present invention is a processing execution method in an information processing apparatus that is carried by a user and acquires information on the other party by the user's operation, and that detects the line of sight of the user who is the operation target The line of sight is detected by a detection step, a line of sight detection step of detecting the line of sight of the other party, a line of sight determination step for executing a line of sight match determination process based on the line of sight of the partner detected by the line of sight detection of the other party, A process execution step for executing a predetermined process when it is determined that they match.

  According to the present invention, the line of sight of the other party is detected, the line-of-sight matching determination process is performed based on the line of sight of the other party, and when it is determined that the line of sight is met, a predetermined process is executed. Thereby, it is possible to execute the process with a simple and natural operation of detecting the other party's line of sight without performing an operation for the process. Further, since an explicit operation for the processing is not performed, the processing can be executed without informing the surrounding people what is being done.

  The information processing apparatus according to the present invention further includes a self-gaze detection unit that detects the gaze of the user, and the gaze determination unit detects the gaze of the user detected by the self-gaze detection unit and the partner gaze detection A line-of-sight match determination process is performed to determine whether or not the line of sight of the opponent detected by the means matches.

  As a result, it is possible to determine the match of the line of sight between the user and the opponent, and an accurate line-of-sight determination process can be performed. Therefore, it is possible to prevent the predetermined processing from being executed when the image is viewed unilaterally.

  In the information processing apparatus of the present invention, the self gaze detection unit calculates a user gaze vector as the user gaze, and the partner gaze detection unit calculates a partner gaze vector as the partner gaze, The line-of-sight determination means executes a line-of-sight match determination process based on the user's line-of-sight vector and the opponent's line-of-sight vector.

  According to the present invention, the user's line-of-sight vector and the opponent's line-of-sight vector are respectively calculated, and the line-of-sight matching determination process is executed based on these vectors. Thereby, it is possible to determine whether or not the line of sight has been met by calculation.

  The information processing apparatus of the present invention further includes camera means for acquiring a predetermined range of video, and the line-of-sight determination means determines that the partner is not within the predetermined range based on the video acquired by the camera means. If so, it is determined not to perform the line-of-sight match determination process or determine that the line of sight does not match.

  According to the present invention, when a video of a predetermined range is acquired and it is determined that the other party is not within the predetermined range based on the acquired video, the line-of-sight match determination processing is not performed or the line of sight is Judge that does not fit. For example, the lines of sight are in opposition to each other, and if you look at the line of sight itself, the lines of sight may appear to be in alignment. There are cases where it cannot be said. In such a case, since it is unnatural to perform the process that there is a line of sight, it is not determined that there was a line of sight according to the positional relationship of the other party, or the line-of-sight matching determination process is not performed.

  The information processing apparatus according to the present invention further includes a visual range generation unit that generates a visual range based on the line of sight detected by the self-gaze detection unit, and the partner is based on an image captured by the camera unit. When it is determined that the user is within the predetermined range and is within the visual range generated by the visual range generation unit, the visual line determination unit performs a visual line match determination process.

  According to this invention, based on the viewing range generated based on the detected line of sight, it can be determined that the other party is in the range based on the video and is in the predetermined range defined by the camera means. Line-of-sight match determination processing is performed. As a result, when in the predetermined range, the line-of-sight is generally in a relationship where the lines of sight are in contact with each other. By defining, it is possible to perform a line-of-sight match determination process between persons in an appropriate positional relationship. Therefore, processing by a natural operation can be executed.

  In the information processing apparatus according to the present invention, the self gaze detection unit detects a direction in which the user is facing as a gaze, and the partner gaze detection unit detects a direction in which the partner is facing as a gaze.

  According to the present invention, by detecting the direction of the user as a line of sight and detecting the direction of the other party as a line of sight, without performing complicated processing such as detecting eye movements, By setting the direction obtained by a simple method such as detecting the direction in which the face is facing as the line of sight, the processing configuration can be simplified.

  The information processing apparatus according to the present invention further includes: a light emitting unit that emits directional light in a direction corresponding to the line of sight; and a detection unit that detects light emitted from the counterpart device, wherein the partner line of sight detection is performed. The means detects the light emitted from the counterpart device as the line of sight of the counterpart, and the visual line determination means detects the user's line of sight when the counterpart visual line detection means detects the light emitted from the counterpart device. And the line of sight of the opponent match.

  According to the present invention, light having directivity is emitted from each other, and it is possible to easily detect the line of sight without detecting the movements of the partner's eyeball and own eyeball.

  According to the present invention, it is possible to execute a process with a simple and natural operation of adjusting the line of sight without performing an operation for a desired process. Further, since an explicit operation for the processing is not performed, the processing can be executed without informing the surrounding people what is being done.

1 is an external view of a glasses-type communication terminal 100 that is an information processing apparatus of the present embodiment. It is explanatory drawing which showed typically when performing communication using the glasses-type communication terminal 100. FIG. It is a block diagram which shows the function of the glasses-type communication terminal 100 of this embodiment. 2 is a hardware configuration diagram of a glasses-type communication terminal 100. FIG. It is a processing conceptual diagram about a line-of-sight match determination. It is explanatory drawing which shows the modification about a gaze match determination. It is explanatory drawing which shows the 2nd modification in a line-of-sight match determination. 3 is a flowchart showing processing of the glasses-type communication terminal 100.

  Embodiments of the present invention will be described with reference to the accompanying drawings. Where possible, the same parts are denoted by the same reference numerals, and redundant description is omitted.

  FIG. 1 is an external view of a glasses-type communication terminal 100 that is an information processing apparatus of the present embodiment. As shown in FIG. 1, the glasses-type communication terminal 100 includes a camera 101 and can capture a communication partner as an image.

  FIG. 2 schematically shows a time when communication is performed using the glasses-type communication terminal 100. As shown in FIG. 1, user A and user B wear glasses-type communication terminals 100a and 100b, respectively. The camera 101 of the glasses-type communication terminal 100a can detect the user B's line of sight by photographing the user's B eyeball and the like. The glasses-type communication terminal 100a can detect the line of sight of the user A by using a sensor (not shown) provided in the lens to detect the line of sight.

  The glasses-type communication terminal 100a can perform communication when the line of sight is matched by matching the line of sight of the user A and the line of sight of the user B.

  In the present embodiment, the glasses-type communication terminal 100a detects the user B's line of sight and performs matching by matching with the user A's line of sight. The glasses-type communication terminal 100b may detect the user A's line of sight. Further, in both the glasses-type communication terminals 100a and 100b, the other party's line of sight may be detected from each other, and communication may be executed when both are detected.

  Next, a functional configuration of the glasses-type communication terminal 100 is shown. FIG. 3 is a block diagram illustrating functions of the glasses-type communication terminal 100 of the present embodiment. As shown in FIG. 3, the camera 101 (camera unit), the self gaze detection unit 102 (self gaze detection unit), the partner gaze detection unit 103 (partner gaze detection unit, viewing range generation unit), the gaze match determination unit 104 (gaze) A determination unit), a process start unit 105 (process execution unit), a communication unit 106 (process execution unit), a communication content storage unit 107, a communication content selection unit 108, and a display unit 109.

  FIG. 4 is a hardware configuration diagram of the glasses-type communication terminal 100. As shown in FIG. 4, the glasses-type communication terminal 100 shown in FIG. 3 physically includes one or a plurality of CPUs 11, a RAM 12 and a ROM 13 as main storage devices, and input devices such as a keyboard and a mouse as input devices. 14, a computer system including an output device 15 such as a display, a communication module 16 that is a data transmission / reception device such as a network card, an auxiliary storage device 17 such as a semiconductor memory, and the like. Each function in FIG. 3 operates the input device 14, the output device 15, and the communication module 16 under the control of the CPU 11 by reading predetermined computer software on the hardware such as the CPU 11 and the RAM 12 shown in FIG. In addition, it is realized by reading and writing data in the RAM 12 and the auxiliary storage device 17. Hereinafter, each functional block will be described based on the functional blocks shown in FIG.

  The camera 101 is a part that captures the movement of the eyeball of the user B who is a communication partner. In the present embodiment, the camera 101 can shoot a predetermined range in front of the user A, and when the user B is in the predetermined range, the camera 101 can shoot the user B and the eyeball.

  The self gaze detection unit 102 is a part that detects a gaze based on a sensor (not shown) that captures the movement of the eyeball of the user (user A) provided inside the lens, and generates a gaze vector, for example. .

  The partner line-of-sight detection unit 103 is a part that detects the line of sight of the communication partner in accordance with the movement of the eyeball of the user B when the user B is within a predetermined range captured by the camera 101. For example, a line-of-sight vector is generated. . However, the present invention is not limited to this, and a light irradiation unit (not shown) may irradiate the other party with infrared light or light and detect the line of sight with the reflected light.

  The line-of-sight match determination unit 104 is a part that performs a match determination based on one's line of sight detected by the self-line-of-sight detection unit 102 and the line of sight of the other party detected by the partner's line-of-sight detection unit 103. For example, by calculating the inner product between the own line-of-sight vector and the partner's line-of-sight vector, it is determined whether or not the angle formed by these vectors is equal to or smaller than a predetermined angle.

  The processing start unit 105 is a part that starts processing based on the result determined by the line-of-sight match determination unit 104. For example, the communication unit 106 is controlled to execute communication.

  The communication unit 106 is a part that performs communication with a partner whose line of sight matches. The communication unit 106 can perform communication via a network or perform short-range wireless communication. For example, the communication unit 106 starts a connection establishment process with the communication terminal of the other party with the line of sight triggered by the line of sight. Assuming that your glasses-type communication terminal 100a is always connected to another glasses-type communication terminal 100b within a certain range, exchange keys (ID, password, etc.) only with the person whose line of sight matches. By doing so, communication can be executed.

  In addition, the communication unit 106 may notify a predetermined server (not shown) of its own ID, address, and the like for starting communication using a line of sight as a trigger. Assuming that the communication partner has the same processing configuration, the server acquires the IDs of itself and the communication partner. In this case, in the server, it is necessary to determine to which partner the ID is disclosed, and in the server, it is necessary to manage the position of each user and the orientation of the face and eyes (glasses). In the communication terminal, the position and the face / eye orientation are notified together with the ID and the like.

  And the communication part 106 can communicate with a communicating party via a server using such information. In addition to this, it is also possible to specify the communication partner by acquiring the ID of the communication partner from the server and performing close proximity wireless communication using this ID.

  The communication content storage unit 107 is a part that stores communication content for the communication unit 106 to communicate.

  The communication content selection unit 108 is a part that selects one or a plurality of communication content from the communication content stored in the communication content storage unit 107. The communication content selection unit 108 may instruct to select communication content by voice, or may select from a menu screen or the like displayed on the display unit 109. In this case, the operation button or the like may be selected by operating the string portion of the glasses-type communication terminal 100, a remote controller, or the like. In addition, you may specify by gesture using a camera or a center.

  The display unit 109 is a part that displays various types of information. For example, the display unit 109 can display a menu screen for selecting communication contents, or can display an execution status such as when a line of sight is being detected. In addition, options for selecting a communication partner may be displayed. The display unit 109 can realize a display function by projecting various data inside the lens of the glasses-type communication terminal 100. The user can see the data projected inside the lens.

  Here, a gaze detection method by the self gaze detection unit 102 and the partner gaze detection unit 103 will be described.

  As a method for detecting the line of sight, there is a method called corneal reflection light method. In general, the surface of a human cornea has good flatness and reflects light well. This method uses this characteristic to detect the line of sight by applying light from an external light source to the cornea surface and recording the reflected light. This recorded reflected image is called a corneal reflection image or Purkinje image.

  In order to stably measure the line of sight, there is a method of measuring the distance between the center of the pupil and the Purkinje image using the center of the pupil as a reference point. In general, detection of a pupil is performed by performing image processing from an image of a subject's eye taken by a camera.

  Further, there is a method of detecting a line of sight by photographing a part or all of the eyeball with a camera and detecting characteristic parts of the eye such as an iris and a pupil from the photographed image. This is called a camera photographing method. For example, the line of sight can be determined from the shape of the pupil. In general, the shape of the pupil is close to a perfect circle, and the captured shape can be approximated to an ellipse even when the eyeball moves, and the direction of the line of sight can be determined from parameters such as the major axis, minor axis, and axis tilt of the approximated ellipse Can be requested.

  Some focus on the relative distance between the pupil center position and the eye position.

  Furthermore, there is a method using a stereo camera. The head is imaged by a stereo camera, and the face tracking is performed by obtaining six degrees of freedom of the head position and posture by a model fitting process of a three-dimensional face model and a three-dimensional observation value prepared in advance. The face position / posture is measured by face tracking, and the center position of the eyeball is estimated. Since the horizontal and vertical line-of-sight angles are known from the relationship between the center position of the iris obtained from the image and the estimated center position of the eyeball, the line of sight can be obtained as a three-dimensional vector.

  The method of detecting the above line of sight is a known method, and any method can be adopted in the present embodiment. Also, it is not always necessary for you and your opponent to use the same line-of-sight acquisition method. Your line-of-sight uses a high-precision Purkinje image, and the opponent's line-of-sight can be detected using only a camera. Good. This is because, in order to acquire a Purkinje image, it is necessary to irradiate the eyeball with infrared light. Therefore, when the partner's eyes are far from the line-of-sight acquisition device, measurement is difficult.

  Next, processing by the line-of-sight match determination unit 104 will be described. FIG. 5 is a conceptual diagram of processing for line-of-sight matching determination. FIG. 5A is a conceptual diagram when the line of sight is correct. Here, it is assumed that the user A's line of sight matches the user B's line of sight. That is, when the angle formed by the user A's line-of-sight vector and the user B's line-of-sight vector is 180 degrees, it can be determined that the line of sight is in line.

  FIG. 5B is a conceptual diagram when the lines of sight are generally matched. Here, the line of sight of the user A and the line of sight of the user B are slightly deviated from each other, but it is a case where it can be determined that the line of sight is almost the same. That is, the user A's line-of-sight vector and the user B's line-of-sight vector are in the case where the vector directions are opposite but the directions are slightly shifted. In FIG. 5B, when the end points of the user A's line-of-sight vector and the user B's line-of-sight vector are combined, the vectors intersect each other with an angle α. When the angle α is equal to or smaller than the predetermined angle, it can be determined that the user A and the user B are in line of sight.

  FIG. 5C is a conceptual diagram when the line of sight does not match. Here, since the line of sight of user A and the line of sight of user B are at an angle greatly shifted from the example of FIG. 5B, it can be determined that they do not match. In other words, the user A's line-of-sight vector and the user B's line-of-sight vector are in the case where the vector directions are opposite but the directions are greatly deviated. In FIG. 5C, when the end points of the user A's line-of-sight vector and the user B's line-of-sight vector are combined, the vectors intersect each other with an angle β. When the angle β is equal to or larger than the predetermined angle, it can be determined that the user A and the user B are not in line of sight.

  In this way, even if the line-of-sight vector is slightly shifted, it is possible to easily determine the line-of-sight match by regarding the line-of-sight as being in line.

  On the other hand, if it is determined only by the line-of-sight vector, it may be erroneously determined that the line of sight is correct even if the line of sight does not actually match. FIG. 6 is an explanatory diagram showing a modification of the line-of-sight match determination. In FIG. 6A, the line-of-sight vector v1 of user A and the line-of-sight vector v2 of user B are shown. Since the direction of the line-of-sight vector v1 and the line-of-sight vector v2 are opposite to each other, it may be determined that the lines of sight match. However, since the positions of the user A and the user B are greatly shifted, the line of sight is not actually matched.

  Therefore, in such a case, it is natural to determine that the line of sight is not correct. Therefore, as shown in FIG. 6B, when the user B is out of the predetermined range captured by the camera 101, the line of sight is not matched even when the line of sight can be determined based on the line of sight vector. Control to judge.

Specifically, FIG. 6B shows a shooting range S ₁ shot by the camera 101. User B, because this are outside the range of the shooting range S _1, even if it can be determined that the line of sight matches line of sight matches the determination based on the line-of-sight vector, and had a line of sight can be prevented is judged. Therefore, it is possible to make a judgment that is more suitable for the actual situation.

On the other hand, the depending on how definition the photographing range S _1, even though the suit gaze may sometimes become judged not to match the line of sight.

For example, as shown in FIG. 6 (c), outside the photographing range S _1, will enter the user B, the line-of-sight vector v ₂ is facing the user A, on the other hand, the user A The line-of-sight vector v ₁ also faces the user B. In these cases, although it is reasonable to determine that there is line-of-sight, since the user B are outside the scope of the photographing range S _1, will be determined that no match line of sight.

Therefore, as shown in FIG. 7, it is conceivable to take a photographing range S ₂ greater than photographing range S _1. FIG. 7 is an explanatory diagram showing a second modification in the line-of-sight match determination. In FIG. 7A, the shooting range S < _b > ₂ is defined by the partner line-of-sight detection unit 103 in the range shot by the camera 101 of the user A. In the example here, the user B is located in the imaging range S _2.

On the other hand, the user A is looking at the direction indicated by the eye vector v _1, visible range S ₃ is defined on the basis of the line-of-sight vector v _1. The viewable S ₃ are those defined in area formed at a predetermined viewing angle centered line sight vector v _1. In FIG. 7 (a), the user B also while are in the range of photographing range S _2, because you are outside the range of the visible range S _3, there if it can be determined that the matching line of sight on the basis of the line-of-sight vector However, it is determined that the line of sight is not correct.

On the other hand, in FIG. 7B, the user B is in the shooting range S ₂ and in the viewing range S ₃ , so the line of sight is in line with the line-of-sight vector. It can be judged.

  By performing the line-of-sight matching determination process in this way, it is possible to determine whether or not the line of sight has been met with high accuracy.

  Next, a processing execution method of such glasses-type communication terminal 100 will be described. FIG. 8 is a flowchart showing the processing. The communication content selected by the communication content selection unit 108 according to the user operation is designated from the communication content storage unit 107 (S101). Then, the self gaze detection unit 102 detects his gaze (S102). In addition, the other party's gaze detection unit 103 detects the other user's gaze (S103). Note that the processing order of S102 and S103 may be reversed.

  The line-of-sight match determination unit 104 determines whether or not the user's line of sight matches the line of sight of the other user (S104). If it is determined that the data match, the communication unit 106 performs communication establishment processing (S105). Here, since the communication unit 106 performs close proximity wireless communication, the communication content is transmitted and received by the close proximity wireless communication (S106), and in the glasses-type communication terminal 100, the received content is displayed on the display unit 109 (S107).

  Next, a modified example of a method for detecting a line of sight without detecting a specific line of sight will be described. In the above example, the line of sight is detected by detecting the movement of the eyeball or the like. However, the above-described method may be difficult to detect. In this modification, a simple gaze detection method will be described. In this modification, the actual line of sight is not detected, but the direction of the glasses-type communication terminal 100, that is, the direction of the glasses (user's face) is detected as the direction of the line of sight. Therefore, it is only necessary to detect the direction of the glasses (user's face).

  Specifically, the glasses-type communication terminal 100 in this modification does not include the self-gaze detection unit 102. Then, without detecting his / her own line of sight, the other party's line-of-sight detection unit 103 detects whether or not the other party is facing him / her. For example, if the camera 101 acquires an image of the partner user who is wearing the glasses-type communication terminal within a predetermined range, and the partner line-of-sight detection unit 103 determines that the partner's line of sight is facing the user, the line of sight is Judgment is met. Further, when it can be determined whether or not the partner in the image acquired by the camera 101 is facing the front, the partner line-of-sight detection unit 103 may determine that the line of sight is in line.

  Further, as another method, the glasses-type communication terminals 100a and 100b are arranged so that a light source with high directivity matches the line of sight (for example, the direction of the eyeball or face) (that is, the direction orthogonal to the lens of the glasses-type communication terminal 100a). A) a light emitting means for emitting light; In the glasses-type communication terminal 100a of the glasses-type communication terminal 100a that is the communication partner, in the glasses-type communication terminal 100a, the partner line-of-sight detection unit 103 detects the light of the highly directional light source as the partner's line of sight, 104 may determine that the line of sight has been met when the light is detected. Various information can be put on the emitted light to perform visible light communication, or to acquire the communication address of the other party and perform communication by the communication unit 106. .

  Next, operational effects of the glasses-type communication terminal 100 of the present embodiment will be described. According to the glasses-type communication terminal 100, the self gaze detection unit 102 and the partner gaze detection unit 103 detect the gaze of the user who is the operation target and the gaze of the other party, respectively. The line-of-sight match determination unit 104 determines whether or not the user's line of sight matches the line of sight of the other party. If it is determined that the line of sight matches, the process start unit 105 executes a predetermined process. In the present embodiment, for example, the communication unit 106 performs communication processing with a partner whose line of sight matches. Thus, the process can be executed with a simple and natural operation such as matching the line of sight without performing an operation for the process. Further, since an explicit operation for the processing is not performed, the processing can be executed without informing the surrounding people what is being done.

  In the above-described embodiment, the communication process has been described. However, the present invention is not limited to this. In addition to communicating directly with the communication partner, information on the communication partner may be acquired from the server, or another process may be performed.

  Further, according to the glasses-type communication terminal 100 according to the modification, the line-of-sight matching determination process may be performed based only on the line of sight of the other party without detecting his / her line of sight. For example, it can be considered that the line of sight has been met when the line of sight of the other party is facing his / her direction.

  Further, according to the glasses-type communication terminal 100 of the present embodiment, the self gaze detection unit 102 calculates the user's gaze vector v1, and the partner gaze detection unit 103 calculates the partner's gaze vector v2. The line-of-sight match determination unit 104 executes line-of-sight match determination processing based on these vectors. Thereby, it is possible to determine whether or not the line of sight has been met by calculation.

  Further, according to the glasses-type communication terminal 100 of the present embodiment, the camera 101 acquires a predetermined range of video (for example, video in front of the user's eyes) in order to detect the partner's line of sight. The line-of-sight match determination unit 104 determines that the line-of-sight line-of-sight match determination process is not performed or the line of sight does not match when it is determined that the other party is not within the predetermined range based on the acquired video. For example, as shown in FIG. 6 (a), the lines of sight are in opposition to each other, and when only the line of sight is viewed, the lines of sight may appear to be in alignment, but their positions are shifted. In general, it may not be said that the line of sight is in line. In such a case, since it is unnatural to perform the process that there is a line of sight, it is not determined that there was a line of sight according to the positional relationship of the other party, or the line-of-sight matching determination process is not performed.

  Also, according to the glasses-type communication terminal 100 of the present embodiment, first, the self-gaze detection unit 102 detects the user's gaze and defines a predetermined viewing range with the gaze as the center line. Then, the line-of-sight match determination unit 104 is based on the viewing range generated based on the detected user's line of sight, and the other party is in that range based on the video and based on the video captured by the camera 101. When it can be determined that the user is within the predetermined range defined by the partner line-of-sight detection unit 103, line-of-sight matching determination processing is performed. As a result, when they are within the predetermined range, they are generally in a relationship in which their lines of sight match each other, but there are cases where this is not the case. By defining, it is possible to perform a line-of-sight match determination process between persons in an appropriate positional relationship. Therefore, processing by a natural operation can be executed.

  Further, according to the glasses-type communication terminal 100, the self-gaze detection unit 102 detects the direction in which the user is facing as a gaze, and the partner gaze detection unit 103 detects the direction in which the partner is facing as a gaze. By doing so, it is possible to simplify the processing configuration by setting the direction obtained by a simple method such as detecting the direction the face is facing, without performing complicated processing such as detecting eye movements. Can be.

DESCRIPTION OF SYMBOLS 100a ... Glasses type communication terminal, 100b ... Glasses type communication terminal, 101 ... Camera, 102 ... Self gaze detection part, 103 ... Opposite gaze detection part, 104 ... Gaze coincidence determination part, 105 ... Processing start part, 106 ... Communication part, 107: Communication content storage unit, 108: Communication content selection unit, 109: Display unit.

Claims (7)

An information processing apparatus that is carried by a user and acquires information on the other party through the user's operation,
Partner line-of-sight detection means for detecting the line of sight of the other party;
Line-of-sight determination means for executing line-of-sight match determination processing based on the line of sight of the other party detected by the partner line-of-sight detection means;
A process execution unit that executes a predetermined process when the line of sight determination unit determines that the line of sight matches;
An information processing apparatus comprising: It further comprises self-gaze detection means for detecting the gaze of the user,
The line-of-sight determination means performs a line-of-sight match determination process for determining whether or not the line of sight of the user detected by the line of sight detection means matches the line of sight of the other party detected by the partner line of sight detection means. The information processing apparatus according to claim 1, wherein the information processing apparatus is executed. The self gaze detection means calculates a user's gaze vector as the user's gaze,
The partner line-of-sight detection means calculates the partner's line-of-sight vector as the partner's line of sight,
The information processing apparatus according to claim 2, wherein the line-of-sight determination unit performs line-of-sight matching determination processing based on the user's line-of-sight vector and the opponent's line-of-sight vector. In order to detect the other party's line of sight, it further comprises camera means for acquiring a predetermined range of video,
The line-of-sight determination means determines that the line-of-sight match determination processing is not performed or the line of sight does not match when it is determined that the partner is not within a predetermined range based on the video acquired by the camera means. The information processing apparatus according to any one of claims 1 to 3. Camera means for acquiring a predetermined range of video in order to detect the opponent's line of sight;
A visual range generation unit that generates a visual range based on the line of sight detected by the self-gaze detection unit;
When it can be determined that the opponent is within the predetermined range based on the video imaged by the camera means, and the visual line determination means is in the visual recognition range generated by the visual recognition range generation means, the visual line determination means The information processing apparatus according to claim 2, wherein the information processing apparatus performs processing. A light emitting means for emitting light having directivity in a direction according to the line of sight;
Detecting means for detecting light emitted from the counterpart device;
The counterpart line-of-sight detection means detects light emitted from the counterpart device as the line of sight of the counterpart,
The line-of-sight determination unit determines that the line of sight of the user and the line of sight of the other party are matched when the partner line-of-sight detection unit detects light emitted from the partner apparatus. The information processing apparatus according to any one of claims 5 to 6. A processing execution method in an information processing apparatus that is carried by a user and acquires information on the other party by the user's operation,
An opponent gaze detection step of detecting the opponent's gaze;
A line-of-sight determination step for performing a line-of-sight match determination process based on the line of sight of the other party detected in the partner line-of-sight detection step;
A process execution step for executing a predetermined process when it is determined by the line-of-sight determination step that the line of sight has been matched;
A process execution method comprising:

Images