JP2015204603A - Information processing device, information processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing device capable of precisely outputting a warning.SOLUTION: An information processing device includes: a moving state determination part which determines a moving state of the device itself on the basis of acquired information representing the moving state; and a vision state determination part which detects a direction based upon an image of a user detected from an acquired picked-up image, and determines, based upon a direction based upon the detected image of the user and the moving direction determined by the moving state determination part, whether a predetermined direction and a direction different from the predetermined direction are detected as the direction based upon the image of the user while switched to each other with the user in the moving state.

Description

  The present invention relates to an information processing apparatus, an information processing method, and a program.

  With the spread of multifunctional mobile phone terminals (smartphones), a person who moves (for example, walks or moves by bicycle) while viewing the display surface of the multifunctional mobile phone terminal and the moving direction (for example, forward) alternately It has increased. In the following description, visual recognition means that the user's line of sight is directed, and user's visual direction means the direction in which the user's line of sight is directed. In the following description, for convenience of explanation, a state in which various information processing apparatuses including a multi-function mobile phone terminal are viewed will be referred to as a viewing state, and a viewing state while moving will be referred to as an alternating viewing state. Since the movement in the alternating visual recognition state may be accompanied by danger due to carelessness in the front, it may be taken up as a social problem.

  In this connection, the moving state determination unit determines whether or not the device is moving, and the person's face is captured on the captured image captured by the imaging device provided on the same surface as the display device. Based on these determination results, if the device is moving and a person's face is captured in the captured image, it is determined that the user is moving in an alternating viewing state. A portable terminal for notifying a user of a warning is known (see Patent Document 1).

Japanese Patent No. 4058455

  However, in the conventional portable terminal, it is determined whether or not the user's face is imaged during movement, but whether the moving user switches the line of sight alternately between the display surface of the portable terminal and the moving direction. As a result, the warning could not be output with high accuracy.

  Therefore, the present invention has been made in view of the above-described problems of the prior art, and an object thereof is to provide an information processing apparatus, an information processing method, and a program that can output a warning with high accuracy.

  According to one aspect of the present invention, a movement state determination unit that determines a movement state of the own apparatus based on information indicating the acquired movement state, and a direction based on a user image detected from the acquired captured image are detected. The user is moving based on the detected direction based on the user image and the movement state determined by the movement state determination unit, and the direction is based on the user image. And a visual recognition state determination unit that determines whether or not a predetermined direction and a direction different from the predetermined direction are detected.

  ADVANTAGE OF THE INVENTION According to this invention, the information processing apparatus, the information processing method, and program which can output a warning accurately can be provided.

It is a figure which shows an example of a function structure of the information processing apparatus 1 which concerns on 1st Embodiment. 5 is a flowchart illustrating an example of a flow of alternate visual state suppression processing by a control unit 20. 5 is a flowchart illustrating an example of a flow of a visual state determination process by a visual state determination unit 28. 3 is a diagram schematically illustrating an example of a relationship between a viewing direction of a user U and a display surface of an output unit 15 of the information processing apparatus 1. FIG.

<First Embodiment>
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a diagram illustrating an example of a functional configuration of the information processing apparatus 1 according to the first embodiment. The information processing apparatus 1 according to the first embodiment is, for example, a multi-function mobile phone terminal, but instead, a mobile phone terminal, an e-book reader, a PDA (Personal Digital Assistant), a notebook PC (Personal Computer), It may be a tablet PC or the like. The information processing apparatus 1 includes a detection unit 11, an imaging unit 13, an output unit 15, a storage unit 17, and a control unit 20.

  The detection unit 11 is various sensors included in the information processing apparatus 1. For example, the detection unit 11 is an acceleration sensor that detects acceleration generated by the movement of the information processing apparatus 1. Instead, the information processing apparatus 1 moves. It may be a vibration sensor or the like that detects vibration caused by this. The detection unit 11 outputs the detected detection information (for example, information indicating acceleration or vibration) to the control unit 20. The detection information is an example of information indicating a movement state.

  The imaging unit 13 is a camera including, for example, a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like that is an imaging element that converts the collected light into an electrical signal. A lens for condensing light on the imaging element of the imaging unit 13 is provided on the same surface as the display surface of the output unit 15. The imaging unit 13 captures a captured image in accordance with a request from the imaging control unit 25. The imaging unit 13 outputs the captured image to the control unit 20.

  In the first embodiment, the imaging unit 13 is hardware integrated with the information processing apparatus 1. Instead of the configuration integrated with the information processing device 1, the imaging unit 13 may be configured to be communicably connected to the information processing device 1 by wire or wirelessly as a separate body from the information processing device 1.

  The output unit 15 is a display of the information processing apparatus 1, and is, for example, a liquid crystal display panel or an organic EL (ElectroLuminescence) display panel. The output unit 15 may further include a speaker that outputs sound, a vibrator that generates vibration, and the like.

  The storage unit 17 includes, for example, an SSD (Solid State Drive), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a ROM (Read-Only Memory), a RAM (Random Access Memory), and the like. Stores various information, images, and programs. The storage unit 17 may be an external storage device in place of the storage unit 17 incorporated in the information processing apparatus 1.

  The input receiving unit 19 is a device that receives an input from the user. For example, the input receiving unit 19 is a touch panel provided integrally with the display surface of the output unit 15, but may include various buttons and switches. The input receiving unit 19 receives an input from the user and outputs information representing the received input to the master control unit 21 of the control unit 20.

  The control unit 20 includes a master control unit 21, a movement state determination unit 23, an imaging control unit 25, an output control unit 27, a visual state determination unit 28, and an alternating visual state suppression unit 29. Some or all of these functional units included in the control unit 20 are realized by, for example, a CPU (Central Processing Unit) (not shown) executing various programs stored in the storage unit 17. In addition, some or all of these functional units included in the control unit 20 may be hardware functional units such as LSI (Large Scale Integration) and ASIC (Application Specific Integrated Circuit).

  The master control unit 21 acquires information input from the user by the input receiving unit 19 and controls each functional unit of the information processing apparatus 1 based on the acquired information. In addition, when the information processing apparatus 1 is activated, the master control unit 21 performs the alternate visual state suppression process by controlling each functional unit of the control unit 20. The alternate visual recognition state suppression process is a process of warning (notifying) that the current visual recognition state is the alternating visual recognition state when it is determined that the visual recognition state of the user is the alternating visual recognition state. Here, the visual recognition state indicates which direction the user is visually recognizing, and in the present embodiment, indicates one of the following states 1) to 3). Moreover, an alternating visual recognition state shows the state of following 2).

1) A state where the user is not viewing the display surface of the output unit 15 (for example, a state where the user is moving with the information processing apparatus 1 in a bag).
2) A state where the user is alternately viewing the display surface of the output unit 15 and a direction different from the display surface alternately (for example, while the user is moving by walking or biking, the user alternates between the information processing device 1 and the moving direction) )
3) A state in which the user continues to visually recognize the display surface of the output unit 15 (for example, a state in which the user continues to visually recognize (operate) the information processing apparatus 1 while moving by public transportation such as a bus or train)

The movement state determination unit 23 acquires detection information from the detection unit 11. The movement state determination unit 23 determines whether the movement state of the information processing apparatus 1 is moving or stopped based on the acquired detection information.
The imaging control unit 25 causes the imaging unit 13 to capture a captured image and acquires the captured image from the imaging unit 13.
The output control unit 27 displays various display images on the output unit 15. The output control unit 27 outputs sound to the speaker when the output unit 15 includes a speaker, and vibrates the vibrator when the output unit 15 includes a vibrator.

  When the movement state determination unit 23 determines that the movement state of the information processing apparatus 1 is moving, the visual recognition state determination unit 28 is based on the captured image acquired from the imaging unit 13 by the imaging control unit 25. It is determined which of the above 1) to 3) is the viewing state.

  When the visual recognition state determination unit 28 determines that the visual recognition state is the visual recognition state 2), the alternate visual recognition state suppression unit 29 determines that the current visual recognition state is the alternating visual recognition state, and And generating an alternate visual state suppression image (for example, an image displaying a warning sentence or a notification sentence) for warning (notifying) that the visual recognition state is an alternating visual state. The data is output to the output control unit 27 and displayed on the output unit 15.

  Note that when the output unit 15 includes a speaker, the alternating visual recognition state suppression unit 29 determines that the current visual recognition state of the user is the alternating visual recognition state, and the visual recognition state is the alternating visual recognition state for the user. A sound for warning is generated, and the generated sound is output to the output control unit 27 and output from the output unit 15. In addition, when the output unit 15 includes a vibrator, the alternate visual state suppression unit 29 determines that the current user's visual state is the alternating visual state, and the visual state is the alternating visual state for the user. Information indicating the vibration for warning that there is, is generated, and the information indicating the generated vibration is output to the output control unit 27 to vibrate the vibrator of the output unit 15.

  Hereinafter, the alternate visual recognition state suppression process by the control unit 20 will be described with reference to FIG. FIG. 2 is a flowchart illustrating an example of the flow of the alternating visual recognition state suppression process by the control unit 20. In the following, the information processing apparatus 1 is activated at the time of “start”, and the function control unit 20 is controlled by the master control unit 21 to control the alternate visual state suppression process from step S100 to step S190. Description will be made assuming that each functional unit of the unit 20 performs. First, the movement state determination unit 23 acquires detection information from the detection unit 11. Then, the movement state determination unit 23 determines whether the movement state of the information processing apparatus 1 is moving or stopped based on the acquired detection information (step S100).

  Here, the determination process of the movement state by the movement state determination part 23 is demonstrated. When the detection information is information indicating acceleration, the movement state determination unit 23 acquires information indicating acceleration from the detection unit 11, and stores the acquired information indicating acceleration in the storage unit 17 together with time. Then, the movement state determination unit 23 reads information indicating acceleration in a time interval in a range that is back by a predetermined time from the current time from the storage unit 17, and calculates an average value based on the read acceleration. Here, the predetermined time is, for example, about 30 seconds, but may be 30 seconds or more, or less than 30 seconds. In addition, the predetermined time is configured to be registered in advance in the movement state determination unit 23, but may be configured to be set by the user.

  The movement state determination unit 23 determines that the movement state of the information processing apparatus 1 is moving when the average value of the calculated accelerations is equal to or greater than a predetermined value. As described above, the movement state determination unit 23 determines that the movement state is moving when the average acceleration value is equal to or greater than the predetermined value, thereby changing the movement state of the information processing apparatus 1 to the movement state of the user. Can be approximated. In other words, such a determination can prevent the movement state determination unit from determining that the movement state of the information processing apparatus 1 is moving while the movement state of the user is stopped.

  The moving state determination unit 23 calculates the average value of acceleration, and instead of the configuration that determines the moving state based on the calculated average value of acceleration, the number of acceleration detections in the time interval is a predetermined value or more. In such a case, the moving state of the information processing apparatus 1 may be determined based on some other value calculated based on acceleration, such as a configuration that determines that the moving state is moving. In addition, although the said predetermined value shall be the structure previously registered into the movement state determination part 23, the structure which can be set by a user may be sufficient.

  When the detection information is information indicating vibration, the movement state determination unit 23 acquires information indicating vibration from the detection unit 11 and stores the acquired information indicating vibration in the storage unit 17 together with time. Then, the movement state determination unit 23 reads information indicating the vibration in the time interval in the range that is backed by the predetermined time from the current time from the storage unit 17, and calculates the number of vibration detections in the time interval. The movement state determination unit 23 determines that the movement state of the information processing apparatus 1 is moving when the calculated number of vibration detections is equal to or greater than a predetermined value. The predetermined value may be registered in advance in the movement state determination unit 23 or may be configured to be set by the user.

  When the movement state determination unit 23 determines in step S100 that the movement state of the information processing apparatus 1 is moving (step S100-Yes), the visual state determination unit 28 is executing the visual state determination process (in FIG. 2). It is determined whether or not the visual recognition state is being determined (step S110). Here, the visual recognition state determination process is a process for determining which of the above-described 1) to 3) is the visual recognition state of the information processing apparatus 1, and is started in step S170, and then is performed in step S140 or step. This is a process that continues to be executed until it is terminated in S190 (continues determination at each time).

  When the visual recognition state determination unit 28 determines that the visual recognition state determination process is being executed (step S110-Yes), is the user's visual recognition state at the current time determined by the visual recognition state determination process an alternating visual recognition state? It is determined whether or not (step S120). On the other hand, when the visual recognition state determination unit 28 determines that the visual recognition state determination process is not being executed (step S110-No), the visual recognition state determination process is started (step S170). It is determined whether or not the user's visual state at the current time determined by the process is an alternating visual state.

  When the visual recognition state determination unit 28 determines that the user's visual recognition state at the current time of the information processing device 1 is not the alternating visual recognition state (step S120-No), the movement state determination unit 23 returns to step S100 and again performs information. The movement state of the processing apparatus 1 is determined. On the other hand, when the visual recognition state determination unit 28 determines that the visual recognition state of the user at the current time of the information processing device 1 is an alternating visual recognition state (step S120—Yes), the alternating visual recognition state suppression unit 29 An alternate viewing state suppression image for warning (notifying) that the current user's viewing state of the information processing apparatus 1 is an alternate viewing state is generated, and the generated alternate viewing state suppression image is output to the output control unit 27. And displayed on the output unit 15 (step S130). Note that the alternating visual recognition state suppression image is an example of information indicating a warning.

  Next, the visual recognition state determination unit 28 stops the visual recognition state determination process started in step S170 (step S140). Next, the alternate visual recognition state suppression unit 29 waits until the movement state determination unit 23 determines that the movement state of the information processing apparatus 1 is stopped (step S150). When the movement state determination unit 23 determines that the movement state of the information processing device 1 is stopped in step S150 (step S150-No), the alternate visual recognition state suppression unit 29 determines the current state of the information processing device 1 for the user. The output control unit 27 is caused to control the output unit 15 so as to cancel the display on the output unit 15 of the alternate visual state suppression image for warning that the visual recognition state is the alternating visual recognition state (step S160). Then, the movement state determination unit 23 returns to step S <b> 100 again and determines the movement state of the information processing apparatus 1.

  On the other hand, when the movement state determination unit 23 determines that the movement state of the information processing apparatus 1 is stopped in step S100 (step S100-No), the visual state determination unit 28 determines whether the visual state determination process is being performed. Is determined (step S180). When the visual recognition state determination unit 28 determines that the visual recognition state determination process is not being executed (No in step S180), the movement state determination unit 23 returns to step S100 again and determines the movement state of the information processing apparatus 1. On the other hand, if the visual recognition state determination unit 28 determines that the visual recognition state determination process is being executed (step S180-No), the visual recognition state determination process starts at step S170 (step S190), and then the movement state The determination unit 23 returns to step S <b> 100 again and determines the movement state of the information processing apparatus 1.

  In the present embodiment, the control unit 20 is configured to always perform the processing from step S100 to step S190 while the information processing apparatus 1 is being activated. By receiving the input, the configuration may be such that the processing from step S100 to step S190 is performed only when the information processing apparatus 1 is in the alternating visual recognition state suppression mode.

  Hereinafter, with reference to FIG. 3, the visual recognition state determination process by the visual recognition state determination unit 28 will be described. FIG. 3 is a flowchart illustrating an example of the flow of the visual state determination process performed by the visual state determination unit 28. In the following description, it is assumed that the visual state determination process is executed by the visual state determination unit 28 in step S170 shown in FIG. First, the visual recognition state determination unit 28 causes the imaging control unit 25 to activate the imaging unit 13 so that imaging can be performed (step S200).

  Next, the visual recognition state determination unit 28 initializes the facing count and the non-facing count to predetermined initial values (step S210). The predetermined initial value is zero, but may be any other integer instead. Here, the facing count indicates a value obtained by the visual recognition state determination unit 28 counting the number of times the user visually recognizes the display surface of the output unit 15 based on the captured image captured by the imaging unit 13. Note that the counter count was calculated based on the number of times the user visually recognized the display surface of the output unit 15 instead of the value of the visual state determination unit 28 counting the number of times the user visually recognized the display surface of the output unit 15. It may be a value.

  Further, the non-facing count indicates a value obtained by the visual state determination unit 28 counting the number of times that the user visually recognizes a direction different from the display surface of the output unit 15 based on the captured image captured by the imaging unit 13. Note that the counter count is determined by the user viewing the direction different from the display surface of the output unit 15 instead of the value that the visual state determination unit 28 counted the number of times the user viewed the direction different from the display surface of the output unit 15. It may be some other value calculated based on the number of times it has been performed.

  Next, the visual recognition state determination unit 28 determines whether or not the state transitions to step S140 or step S190 illustrated in FIG. 2 (transition to a state in which the visual state determination process is stopped) (step S220). If the visual recognition state determination unit 28 determines that the state has changed in this way (step S220—Yes), the image pickup control unit 25 stops the image pickup unit 13 (step S280), and the process ends. On the other hand, when the visual recognition state determination unit 28 determines that the state has not transitioned in this way (step S220-No), the imaging control unit 25 acquires the captured image from the imaging unit 13, and the acquired captured image is displayed. Based on this, it is determined whether or not the user visually recognizes the direction in which the display surface of the output unit 15 is visually recognized (step S230).

  Here, with reference to FIG. 4, the process in which the visual recognition state determination part 28 determines whether the user is visually recognizing the display surface of the output part 15 is demonstrated. FIG. 4 is a diagram schematically illustrating an example of the relationship between the viewing direction of the user U and the display surface of the output unit 15 of the information processing apparatus 1. In the present embodiment, the visual recognition state determination unit 28 estimates the orientation of the user's face detected based on the captured image as the user's visual recognition direction. FIG. 4A illustrates an example of a state where the viewing direction of the user U is the display surface of the output unit 15 (for example, the face orientation V1 in FIG. 4). FIG. 4B illustrates an example of a state where the viewing direction of the user U is not the display surface of the output unit 15 (for example, the face direction V2 in FIG. 4). The arrow M indicates the direction in which the user is moving with the information processing apparatus 1.

  The visual recognition state determination unit 28 detects, for example, the orientation of the face of the user U from the captured image by pattern matching with a pre-registered (captured) image of the face of the user U, and the like. Based on the orientation, the viewing direction of the user U is estimated, and when the estimated viewing direction of the user U is within a predetermined solid angle centered on the lens of the imaging unit 13, the user displays the display surface of the output unit 15. Is determined to be visually recognized (if it is out of range, it is determined that another direction is visually recognized). Here, the visual recognition state determination unit 28 calculates the deviation from the reference with respect to the user U's visual recognition direction, for example, based on the face of the user U on a pre-registered image. Estimate by Note that the visual recognition state determination unit 28 may be configured to detect the orientation of the face by some other method that can detect the orientation of the face instead of the configuration that detects the orientation of the face by pattern matching. The face orientation is an example of a direction based on the user's image. Hereinafter, for convenience of explanation, the estimated viewing direction of the user U will be referred to as the face direction of the user U.

  The visual recognition state determination unit 28 determines that the user U is viewing the display surface of the output unit 15 when determining that the direction of the face of the user U is the direction V1 illustrated in FIG. On the other hand, when it is determined that the orientation of the face of the user U is the orientation V2 illustrated in FIG. 4B, the viewing state determination unit 28 visually recognizes a direction different from the display surface of the output unit 15. It is determined that The visual recognition state determination unit 28 is different from the display surface of the output unit 15 when the user U's face is not captured in the captured image or when the orientation of the user U's face cannot be detected from the captured image. Suppose that it is determined that the direction is visually recognized.

  When it is determined that the user is viewing the display surface of the output unit 15 (step S230-Yes), the visual recognition state determination unit 28 increases the facing count by a predetermined number X (step S240), and calculates an alternate visual index. (Step S250). The predetermined number X is, for example, 1, but may be any integer other than zero. On the other hand, when the visual recognition state determination unit 28 determines that the user does not visually recognize the display surface of the output unit 15 (step S230-No), the non-facing count is increased by the predetermined number X (step S290), In step S250, an alternate visual recognition index is calculated.

Here, the alternate visual recognition index is, for example, a value obtained by dividing the facing count by the sum of the facing count and the non-facing count. 4 shows the ratio of the number of times the user visually recognizes the display surface of the output unit 15 shown in FIG. That is, when the facing count is represented by n and the non-facing count is represented by m, the alternating visual recognition index L is represented by the following formula (1).
L = n / (n + m) (1)

Next, the visual recognition state determination unit 28 determines whether or not the alternating visual recognition index is a value within a range represented by the following expression (2) (step S260).
Predetermined value A <alternate visibility index L <predetermined value B (2)

  Here, the predetermined value A is a value different from the predetermined value B and is smaller than the predetermined value B. The predetermined value A is 0, for example, and the predetermined value B is 1, for example. By setting the predetermined value A and the predetermined value B to such values, the visual recognition state determination unit 28 repeatedly visually recognizes the display surface of the output unit 15 and a direction different from the display surface. The state can be determined as an alternating visual recognition state. Note that each of the predetermined value A and the predetermined value B may be any real number between 0 and 1, instead of the above-described values. However, it is assumed that the predetermined value A is a real number smaller than the predetermined value B.

  The visual recognition state determination unit 28 determines that the visual recognition state of the user at the current time is not the alternating visual recognition state when the alternating visual recognition index is determined not to be within the range of the above formula (2) (step S260-No). (Step S300). On the other hand, when the visual recognition state determination unit 28 determines that the alternate visual recognition index is within the range of the above formula (2) (step S260-Yes), the visual recognition state of the user at the current time is determined as the alternating visual recognition state. (Step S270). Since the information processing apparatus 1 determines the user's visual state based on the alternating visual index as described above, the state in which the user is viewing the information processing apparatus 1 while moving by the public transportation described above is mistaken as the alternating visual state. Determination can be suppressed.

  After the process of step S270 or step S300 is executed, the visual recognition state determination unit 28 returns to step S220 and determines again whether the state has changed to step S140 or step S190 shown in FIG.

  As described above, the information processing apparatus 1 according to the first embodiment determines the movement state of its own apparatus based on the acquired detection information, and determines the orientation of the user's face detected from the acquired captured image. Based on the detected direction of the user's face and the determined movement state, it is determined whether or not the user is in an alternate viewing state. Thereby, the information processing apparatus 1 can output a warning with high accuracy.

  Further, the information processing apparatus 1 counts the number of times that the direction based on the orientation of the user's face is detected as the direction in which the user is viewing the display surface of the output unit 15, and is calculated based on the counted number. When the measured value is within the predetermined range, it is determined that the state is the alternating visual recognition state. Thereby, the information processing apparatus 1 can determine that the state in which the user is repeatedly viewing the display surface of the output unit 15 and the direction different from the display surface is an alternate viewing state.

  In addition, when it is determined that the user's visual recognition state is the alternating visual recognition state, the information processing apparatus 1 outputs the alternating visual recognition state suppression image. Thereby, the information processing apparatus 1 can suppress the operation from the user in the alternating visual recognition state.

Second Embodiment
Hereinafter, a second embodiment of the present invention will be described. In addition, about the structure of the information processing apparatus 1 which concerns on 2nd Embodiment, FIG. 1 is used and the same code | symbol is attached | subjected and demonstrated to the same function part. The information processing apparatus 1 according to the second embodiment detects the orientation of the user's face from the captured image, and instead of using the captured image to determine the user's visual state based on the detected orientation of the user's face. The user's line-of-sight direction is detected, and the visual recognition state is determined based on the detected line-of-sight direction. The line-of-sight direction is an example of a direction based on the user's image.

  The visual recognition state determination unit 28 according to the second embodiment detects, for example, the pupil of the user U from the captured image, and detects the line-of-sight direction based on the detected pupil. Then, the visual recognition state determination unit 28 determines whether or not the detected line-of-sight direction is facing the display surface of the output unit 15.

  Moreover, the visual recognition state determination part 28 determines with the user U visually recognizing the display surface of the output part 15, when it determines with the user's U gaze direction being the direction V1 shown to FIG. 4 (A). On the other hand, when the visual recognition state determination unit 28 determines that the line-of-sight direction of the user U is the direction V2 illustrated in FIG. 4B, the user U is viewing a direction different from the display surface of the output unit 15. Is determined. The visual recognition state determination unit 28 is a direction in which the user U visually recognizes the display surface of the output unit 15 when the face of the user U is not captured in the captured image or when the gaze direction of the user U cannot be detected from the captured image. Assume that it is determined that the user is viewing a different direction.

  As described above, the information processing apparatus 1 according to the second embodiment detects the orientation of the user's face from the captured image, and instead of the configuration that determines the visual recognition state based on the detected orientation of the face. The user's line-of-sight direction is detected from the image, and the visual recognition state is determined based on the detected line-of-sight direction. Thereby, the information processing apparatus 1 can acquire the effect similar to 1st Embodiment.

<Third Embodiment>
Hereinafter, a third embodiment of the present invention will be described. In addition, about the structure of the information processing apparatus 1 which concerns on 3rd Embodiment, FIG. 1 is used and the same code | symbol is attached | subjected and demonstrated to the same function part. In the information processing apparatus 1 according to the third embodiment, instead of the configuration in which the detection information is acquired from the detection unit 11, the input reception unit 19 receives the movement state from the user, and the movement state determination unit according to the received movement state 23 determines the movement state.

  As described above, the information processing apparatus 1 according to the third embodiment accepts the movement state from the user by the input reception unit 19 instead of the configuration in which the detection information is acquired from the detection unit 11, and enters the accepted movement state. Accordingly, the movement state determination unit 23 determines the movement state. Thereby, even when the information processing apparatus 1 does not include the detection unit 11, the information processing apparatus 1 can execute the visual recognition state determination process, and the same effect as that of the first embodiment can be obtained.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and changes, substitutions, deletions, and the like are possible without departing from the gist of the present invention. May be.

  Further, a program for realizing the function of each unit constituting the information processing apparatus 1 in the above embodiment is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system. The information processing apparatus 1 may be implemented by executing. Note that the “computer system” here includes an OS (Operation System) and hardware such as peripheral devices.

Further, the “computer system” includes a homepage providing environment (or display environment) if the WWW system is used.
The “computer-readable recording medium” refers to a storage device such as a flexible disk, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, a “computer-readable recording medium” dynamically holds a program for a short time, like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included. The program may be a program for realizing a part of the above-described functions, or may be a program that can realize the above-described functions in combination with a program already recorded in a computer system.

(1) According to one aspect of the present invention, a movement state determination unit that determines a movement state of the device based on information indicating the acquired movement state, and a direction based on a user image detected from the acquired captured image The user is moving based on the direction based on the detected user image and the movement state determined by the movement state determination unit, and the user image And a visual recognition state determination unit that determines whether or not a predetermined direction and a direction different from the predetermined direction are detected by switching.

(2) Another aspect of the present invention is the information processing apparatus according to (1), in which the visual recognition state determination unit counts the number of times a direction based on the user's image is detected as a predetermined direction, When the value calculated based on the number of times is within a predetermined range, the information processing apparatus determines that the state is present.

(3) Another aspect of the present invention is the information processing apparatus according to (1) or (2), and outputs information indicating a warning when the visual state determination unit determines that the state is the state. An information processing apparatus including an output unit.
(4) According to another aspect of the present invention, the movement state of the own apparatus is determined based on the information indicating the acquired movement state, the direction based on the user image detected from the acquired captured image is detected, Based on the detected direction based on the user's image and the moving state determined by the moving state determination unit, the user is moving, and the direction is based on the user's image. In this information processing method, it is determined whether or not a predetermined direction and a direction different from the predetermined direction are detected.

(5) According to another aspect of the present invention, the computer determines the movement state of the device based on the acquired information indicating the movement state, and determines the direction based on the user image detected from the acquired captured image. Based on the detected direction of the user and the detected direction of the user and the movement state determined by the movement state determination unit, the user is moving, and the user's image This is a program for determining whether or not a predetermined direction and a direction different from the predetermined direction are switched and detected as the directions based on.

DESCRIPTION OF SYMBOLS 1 Information processing apparatus, 11 Detection part, 13 Imaging part, 15 Output part, 17 Storage part, 19 Input reception part, 20 Control part, 21 Master control part, 23 Moving state determination part, 25 Imaging control part, 27 Output control part 28 visual recognition state determination unit 29 alternate visual state suppression unit

Claims (5)

A movement state determination unit that determines the movement state of the own device based on the acquired information indicating the movement state;
A direction based on a user image detected from the acquired captured image is detected, and based on the detected direction based on the user image and the movement state determined by the movement state determination unit, the user And a visual state determination unit that determines whether a predetermined direction as a direction based on the image of the user is switched and a direction different from the predetermined direction is detected.
An information processing apparatus comprising: The information processing apparatus according to claim 1,
The visual recognition state determination unit counts the number of times that the direction based on the user's image is detected as a predetermined direction, and determines that the state is the state when the value calculated based on the number of times is within a predetermined range. ,
Information processing device. The information processing apparatus according to claim 1 or 2,
An output unit that outputs information indicating a warning when the visual state determination unit determines that the state is present;
An information processing apparatus comprising: Based on the acquired information indicating the movement state, determine the movement state of the own device,
Detect the direction based on the user's image detected from the acquired captured image,
Based on the detected direction based on the user's image and the determined moving state, the user is moving, and the direction based on the image is a predetermined direction, and the predetermined direction It is determined whether or not a direction different from the direction is detected.
Information processing method. On the computer,
Based on the information indicating the acquired movement state, the movement state of the own device is determined,
The direction based on the user's image detected from the acquired captured image is detected,
Based on the detected direction based on the user's image and the determined moving state, the user is moving, and the direction based on the image is a predetermined direction, and the predetermined direction To determine whether it is in a state where it is detected by switching to a different direction.
program.

Images