JP2015126812A - Information processing device, information processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily evaluate a target operation even when the target operation is not performed.SOLUTION: An imaging device 1 has an analysis information acquisition section 52, and an analysis evaluation processing section 53. The analysis information acquisition section 52 acquires information on the line of sight of a person whose operation is to be an evaluation target. The analysis evaluation processing section 53 evaluates operation of the person on the basis of the information on the line of sight of the person which is acquired by the analysis information acquisition section 52. Therefore, the imaging device 1 can easily evaluate a target operation even when the operation is not performed.

Description

  The present invention relates to an information processing apparatus, an information processing method, and a program for evaluating a person's action.

  As a conventional technique, there is known a technique in which a user checks his / her own movement by providing an external device so as to face the user with a golf ball sandwiched in order to confirm a movement in a golf swing (for example, , See Patent Document 1).

JP 2004-321767 A

  However, the technique disclosed in Patent Document 1 has a problem that the time when the user's operation can be evaluated is limited to the operation only because the operation state can be confirmed only when the external device is used in real time.

  The present invention has been made in view of such a situation, and an object thereof is to make it possible to easily evaluate a target operation even if the operation is not in progress.

In order to achieve the above object, an information processing apparatus of one embodiment of the present invention provides:
First acquisition means for acquiring information on the line of sight of a person to be evaluated for movement;
Evaluation means for evaluating the movement of the person based on the information on the line of sight acquired by the first acquisition means;
It is characterized by providing.

  According to the present invention, it is possible to easily evaluate a target operation even if the target operation is not in progress.

It is a schematic diagram which shows the state which is evaluating the operation | movement of a subject using a detection apparatus. It is a block diagram which shows the hardware constitutions of the imaging device which is a detection apparatus which concerns on one Embodiment of this invention. FIG. 3 is a functional block diagram illustrating a functional configuration for executing subject evaluation processing among the functional configurations of the imaging apparatus in FIG. 2. It is an example of a display of the analysis evaluation result displayed on an output part. It is another example of a display of the analysis evaluation result displayed on an output part. 4 is a flowchart for explaining a flow of subject evaluation processing executed by the imaging apparatus of FIG. 2 having the functional configuration of FIG. 3. It is another example of a display of the analysis evaluation result displayed on an output part. 4 is a flowchart for explaining a flow of subject evaluation processing in another modification executed by the imaging apparatus of FIG. 2 having the functional configuration of FIG. 3. It is a schematic diagram which shows the other example of a detection method. It is the schematic diagram which showed a mode that the evaluation of the to-be-photographed object in 2nd Embodiment is performed. It is a figure for demonstrating various scores. 4 is a flowchart for explaining a flow of subject evaluation processing in a second embodiment executed by the imaging apparatus of FIG. 2 having the functional configuration of FIG. 3. It is a flowchart explaining the flow of stability evaluation processing among subject evaluation processing. It is a schematic diagram which shows the other example of evaluation of a to-be-photographed object.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<First Embodiment>
In the present embodiment, a series of actions of the subject is evaluated. The evaluation method is performed based on the state of the line of sight of the subject in operation. In other words, it is performed by detecting the line of sight of the subject and evaluating whether the line of sight is suitable.
In this example, a golf swing (hereinafter simply referred to as “swing”) is targeted as a series of actions of the subject. In a golf swing, it is preferable that the line of sight does not change during a series of swing operations from the address to the finish. Accordingly, since it is preferable that there is no change in the line of sight, the state of the subject is evaluated by analyzing the change in the line of sight.

  In the swing, it is also preferable that the line of sight is in a predetermined direction, that is, toward the ball. Therefore, it is also a suitable line of sight that the line of sight is directed toward the ball.

  Furthermore, in the swing, in order to create a state in which the line of sight hardly changes or a state in which the line of sight tends to face the ball, it is additionally necessary that the face direction does not change during the operation or the face is directed toward the ball. Become an element.

  Therefore, in this embodiment, the swing motion is evaluated by detecting the line of sight of the person who is performing the swing (hereinafter also referred to as “player”) and analyzing the state of the line of sight.

The line of sight is detected by using an existing method such as an IROG method for evaluating a reflection image of the cornea and a VOG method for evaluating an iris pattern. In recent years, it can be detected by analyzing an image photographed by a device having a high-definition and high-precision imaging function without using a dedicated machine.
The face orientation can also be detected by analyzing, for example, an image of the whole body of the player including the ball or a part of the player including the face of the player in consideration of the position of the ball and the player.

FIG. 1 is a schematic diagram illustrating a state in which the motion of the subject is evaluated using the detection device.
In the present embodiment, as shown in the example of FIG. 1A, the detection device 1 is arranged on the ground or the like that can detect the line of sight, the face direction, and the swing motion directly facing the player (target person) H. Detect gaze / face orientation / swing motion.
Further, when the orientation of the face changes due to the swing, there is a possibility that the line of sight cannot be detected at all depending on the installation method of the detection device. Therefore, as shown in FIG. 1B, a plurality of detection devices 1A, 1B Can be used to detect the direction of the line of sight and the face from multiple viewpoints.

FIG. 2 is a block diagram illustrating a hardware configuration of the imaging apparatus 1 which is a detection apparatus according to an embodiment of the present invention.
The imaging device 1 is configured as a digital camera, for example.

  The imaging apparatus 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an imaging unit 16, and an input unit 18. An output unit 19, a storage unit 20, a communication unit 21, and a drive 22.

  The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 20 to the RAM 13.

  The RAM 13 appropriately stores data necessary for the CPU 11 to execute various processes.

  The CPU 11, ROM 12, and RAM 13 are connected to each other via a bus 14. An input / output interface 15 is also connected to the bus 14. An imaging unit 16, a sensor unit 17, an input unit 18, an output unit 19, a storage unit 20, a communication unit 21, and a drive 22 are connected to the input / output interface 15.

  Although not shown, the imaging unit 16 includes an optical lens unit and an image sensor.

The optical lens unit is configured by a lens that collects light, for example, a focus lens or a zoom lens, in order to photograph a subject.
The focus lens is a lens that forms a subject image on the light receiving surface of the image sensor. The zoom lens is a lens that freely changes the focal length within a certain range.
The optical lens unit is also provided with a peripheral circuit for adjusting setting parameters such as focus, exposure, and white balance as necessary.

The image sensor includes a photoelectric conversion element, AFE (Analog Front End), and the like.
The photoelectric conversion element is composed of, for example, a CMOS (Complementary Metal Oxide Semiconductor) type photoelectric conversion element or the like. A subject image is incident on the photoelectric conversion element from the optical lens unit. Therefore, the photoelectric conversion element photoelectrically converts (captures) the subject image, accumulates the image signal for a predetermined time, and sequentially supplies the accumulated image signal as an analog signal to the AFE.
The AFE performs various signal processing such as A / D (Analog / Digital) conversion processing on the analog image signal. Through various signal processing, a digital signal is generated and output as an output signal of the imaging unit 16.
Hereinafter, the output signal of the imaging unit 16 is referred to as “captured image data”. Data of the captured image is appropriately supplied to the CPU 11 or an image processing unit (not shown).

  The sensor unit 17 is configured to be able to detect acceleration, and includes a piezoresistive type or electrostatic capacitance type detection mechanism, and detects the three-axis (X, Y, Z) components of acceleration using the detection mechanism. Then, data indicating the detection result is output.

The input unit 18 includes various buttons and the like, and inputs various types of information according to user instruction operations.
The output unit 19 includes a display, a speaker, a vibrator, an LED lamp, and the like, and outputs an image, sound, vibration, light, and the like.
The storage unit 20 is configured by a hard disk, a DRAM (Dynamic Random Access Memory), or the like, and stores various image data.
The communication unit 21 controls communication with other devices (not shown) via a network including the Internet.

  A removable medium 31 composed of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately attached to the drive 22. The program read from the removable medium 31 by the drive 22 is installed in the storage unit 20 as necessary. The removable medium 31 can also store various data such as image data stored in the storage unit 20 in the same manner as the storage unit 20.

  The imaging device 1 that is the detection device configured as described above has a function of being able to evaluate a player's motion such as a swing motion and provide advice on the evaluation.

FIG. 3 is a functional block diagram illustrating a functional configuration for executing subject evaluation processing among the functional configurations of the imaging apparatus 1 as described above.
The subject evaluation process refers to a process from obtaining analysis information such as a line of sight from the imaging unit 16, evaluating a subject based on the obtained analysis information, and outputting an evaluation result.

As shown in FIG. 3, in the subject evaluation process, the imaging control unit 51, the analysis information acquisition unit 52, the analysis evaluation processing unit 53, and the output control unit 54 function in the CPU 11.
An analysis information storage unit 71 and an evaluation information storage unit 72 are set in one area of the storage unit 20.
The analysis information storage unit 71 stores information (hereinafter referred to as “analysis information”) necessary for analysis for subject evaluation. The analysis information is, for example, a moving image acquired from the imaging unit 16.
The evaluation information storage unit 72 stores evaluation results and information necessary for displaying the evaluation results (hereinafter referred to as “necessary information”). The necessary information is, for example, information for comparison with a target person who has been evaluated such as professional line-of-sight information and face orientation information.

  The imaging control unit 51 controls the imaging unit 16 to shoot a moving image. The moving image shot by the imaging unit 16 is stored in the analysis information storage unit 71.

The analysis information acquisition unit 52 acquires analysis information from the analysis information storage unit 71.
Specifically, an image corresponding to the vicinity of the impact is acquired from the analysis information storage unit 71 among the images constituting the moving image as the analysis information.

The analysis evaluation processing unit 53 analyzes the analysis information acquired by the analysis information acquisition unit 52 and evaluates the subject based on the analysis result. Then, the analysis evaluation processing unit 53 stores the evaluation result in the evaluation information storage unit 72.
Specifically, the analysis evaluation processing unit 53 analyzes the image corresponding to the vicinity of the impact acquired by the analysis information acquisition unit 52, and analyzes the change in the line of sight. In the analysis of the line of sight in each image, the direction in which the line of sight is directed is analyzed from the image.
The analysis of the line of sight uses, for example, an existing method such as an analysis of the movement of the line of sight, an IROG method for evaluating a reflection image of the cornea, and a VOG method for evaluating an iris pattern.
In addition, the analysis evaluation processing unit 53 analyzes the image corresponding to the vicinity of the impact acquired by the analysis information acquisition unit 52, and analyzes the change in the orientation of the face.
Note that the swing time such as impact is specified using an existing technique such as detecting the posture from an image.

The analysis evaluation processing unit 53 evaluates the subject based on the analysis result.
Specifically, the analysis evaluation processing unit 53 evaluates the suitability of the line of sight based on the analyzed line of sight. The suitability of the line of sight is determined by the positional relationship between the analyzed line of sight and the ball. In golf, it is good that the line of sight is not far from the ball, so the closer to the ball, the higher the evaluation.

  The output control unit 54 controls the output unit 19 to display the analysis evaluation result. Specifically, the output control unit 54 displays the direction of the line of sight analyzed by the analysis evaluation processing unit 53, and further outputs so as to display the positional relationship between the evaluated line of sight and the ball and advice corresponding to the evaluation. The unit 19 is controlled.

FIG. 4 is a display example of the analysis evaluation result displayed on the output unit 19.
As shown in the example of FIG. 4, the analysis evaluation result is shown in a schematic view of the player at the time of impact looking down from the overhead, and the visual line direction L1 as the analysis result and the positional relationship between the line of sight and the ball (“ "I'm away.") And advice ("Look better at the ball.").

FIG. 5 is another display example of the analysis evaluation result displayed on the output unit 19.
As shown in the example of FIG. 5, the analysis evaluation result may display a change in the line of sight near the impact in a graph. At this time, a change in professional line of sight as a sample may be displayed simultaneously.
In this example, the evaluation result is presented by display, but it may be configured to notify only whether the evaluation is good or bad by voice, vibration, light, or the like. This is effective when the player confirms the evaluation of his / her movement at the time of movement.

FIG. 6 is a flowchart for explaining the flow of subject evaluation processing executed by the imaging apparatus 1 of FIG. 2 having the functional configuration of FIG.
The subject evaluation process is started by a predetermined operation from the input unit 18 by the user.

In step S <b> 11, the CPU 11 determines whether or not there has been a shooting start operation from the input unit 18.
If there is no shooting start operation, it is determined as NO in step S11, and a standby state is entered until there is a shooting start operation.
If there has been a shooting start operation, YES is determined in step S11, and the process proceeds to step S12.

  In step S12, the imaging control unit 51 controls the imaging unit 16 to start swing shooting. The captured moving image is stored in the analysis information storage unit 71.

In step S <b> 13, the CPU 11 determines whether or not a photographing end operation has been performed from the input unit 18.
If there is no photographing end operation, it is determined as NO in step S13, and a standby state is entered until there is a photographing end operation.
If there is a photographing end operation, YES is determined in step S13, and the process proceeds to step S14.

  In step S <b> 14, the analysis information acquisition unit 52 acquires an image corresponding to the vicinity of the impact among the images constituting the moving image stored in the analysis information storage unit 71.

  In step S15, the analysis evaluation processing unit 53 analyzes the change in the line of sight from the analysis information. Specifically, the analysis evaluation processing unit 53 analyzes the image corresponding to the vicinity of the impact acquired by the analysis information acquisition unit 52, and analyzes the change in the line of sight. In the analysis of the line of sight in each image, the direction in which the line of sight is directed is analyzed from the image.

In step S16, the analysis evaluation processing unit 53 outputs the evaluation of the subject. Specifically, the analysis evaluation processing unit 53 evaluates the suitability of the line of sight based on the analyzed line of sight. The suitability of the line of sight is determined by the change in the line of sight analyzed and the positional relationship between the line of sight and the ball. In golf, it is considered good that the line of sight has little change or is not separated from the ball. Therefore, the evaluation is high as the line of sight changes little and is closer to the ball.
The analysis evaluation processing unit 53 stores the evaluation result of the subject in the evaluation information storage unit 72.

In step S <b> 17, the output control unit 54 controls the output unit 19 to display the analysis evaluation result based on the evaluation result of the subject stored in the evaluation information storage unit 72. Specifically, the output control unit 54 displays the direction of the line of sight analyzed by the analysis evaluation processing unit 53 as the analysis evaluation result, and further corresponds to the positional relationship and evaluation between the evaluated line of sight and the ball. The output unit 19 is controlled so as to display advice as shown in FIG.
Thereafter, the subject evaluation process ends.

<Modification>
In the first embodiment described above, the subject is evaluated based on the change in the line of sight at the time of impact. However, in this modified example, seven time points of the swing from the address to the finish (hereinafter referred to as “seven time points”). It is configured to evaluate the line of sight and the orientation of the face.

  Specifically, the analysis information acquisition unit 52 acquires, as analysis information, images corresponding to seven time points out of images constituting a moving image stored in the analysis information storage unit 71.

  The analysis evaluation processing unit 53 analyzes the images corresponding to the seven time points acquired by the analysis information acquisition unit 52, and analyzes the change in the line of sight and the orientation of the face. In the analysis of the line of sight in each image, the direction in which the line of sight is directed and the direction in which the face is directed are analyzed from the image.

  The analysis evaluation processing unit 53 evaluates the suitability of the analyzed line of sight and face orientation. Whether the line of sight and the orientation of the face are appropriate is evaluated based on whether or not it matches the professional line of sight and the direction of the face as a model stored in the evaluation information storage unit 72. In this example, information on the professional line of sight and face orientation as models is obtained by the same method as the player. That is, a swing is imaged in advance, and changes in line of sight and face orientation at seven time points are analyzed and acquired. Note that the information on the professional line of sight and the orientation of the face to be compared is acquired by performing from the imaging to the analysis in the imaging apparatus 1 in this example, but may be configured to be acquired from an external apparatus.

  The output control unit 54 displays the line of sight and the face direction analyzed by the analysis evaluation processing unit 53 on the image at each time point, and further displays the professional image to be compared, so that the line of sight and the face direction match. The output unit 19 is controlled to display an evaluation of whether or not to do so.

FIG. 7 is a display example of the analysis evaluation result displayed on the output unit 19.
As shown in the examples of FIGS. 7A to 7C, the analysis evaluation results are displayed schematically on the image corresponding to each time point, and the image is schematically displayed on the professional image that can be compared. Is displayed.

FIG. 8 is a flowchart for explaining the flow of subject evaluation processing in another modification executed by the imaging apparatus 1 of FIG. 2 having the functional configuration of FIG.
The subject evaluation process is started by a predetermined operation on the input unit 18 by the user.

In step S <b> 31, the CPU 11 determines whether or not there has been a shooting start operation from the input unit 18.
If there is no shooting start operation, it is determined NO in step S31, and a standby state is entered until there is a shooting start operation.
If there is a shooting start operation, YES is determined in step S31, and the process proceeds to step S32.

  In step S32, the imaging control unit 51 controls the imaging unit 16 to start shooting. The captured moving image is stored in the analysis information storage unit 71.

In step S <b> 33, the CPU 11 determines whether or not a photographing end operation has been performed from the input unit 18.
If there is no shooting end operation, it is determined as NO in step S33, and a standby state is entered until there is a shooting end operation.
If there is a photographing end operation, YES is determined in step S33, and the process proceeds to step S34.

  In step S34, the analysis information acquisition unit 52 acquires analysis information. Specifically, the analysis information acquisition unit 52 acquires images corresponding to seven time points out of the images constituting the moving image stored in the analysis information storage unit 71.

  In step S <b> 35, the analysis / evaluation processing unit 53 analyzes the images corresponding to the seven time points acquired by the analysis information acquisition unit 52, and analyzes the changes in the line of sight and the face direction. In the analysis of the line of sight in each image, the direction in which the line of sight is directed and the direction in which the face is directed are analyzed from the image.

In step S <b> 36, the CPU 11 determines whether or not there has been a comparison operation from the input unit 18.
When there is no comparison operation, it is determined as NO in Step S36, and it is in a standby state until there is a comparison operation.
If there is a comparison operation, YES is determined in step S36, and the process proceeds to step S37.

  In step S37, the analysis / evaluation processing unit 53 performs a comparative analysis process of the line of sight / face orientation. The analysis / evaluation processing unit 53 performs comparison processing with a professional model image obtained by separately capturing a swing and analyzing the change in the line of sight and the direction of the face at seven time points, as a comparative analysis process of the line of sight / face orientation. . The comparison with the model image is performed by judging whether the line of sight matches the direction of each point.

  In step S <b> 38, the output control unit 54 controls the output unit 19 so as to compare and display the analysis evaluation result. In the comparison display, for example, as shown in FIGS. 7A to 7C, the player and professional images at each point are displayed in parallel so that they can be compared, and the comparison result (line of sight / face orientation) is displayed. Match / mismatch) is also displayed.

In this example, as shown in FIG. 1A, the imaging apparatus 1 that is one detection apparatus is configured to detect seven time points, and the gaze and face orientation at each time point.
However, the detection of the seven time points and the gaze and face orientation at each time point is not limited to this.

FIG. 9 is a schematic diagram illustrating another example of the detection method.
As shown in the example of FIG. 9A, a detection device 1C used for detection of the time of swing and detection of the orientation of the face and a detection device 1D used for detection of the line of sight may be used.
Further, as shown in the example of FIG. 9B, the detection of the swing time is performed by the detection device 1E capable of detecting the motion attached to the player H, and the detection device 1F is used for detection of the line of sight and the face orientation. You may comprise.

<Second Embodiment>
In the above-described embodiment, the subject is evaluated as the form evaluation based on the change in the line of sight and the face direction. In this example, the subject is evaluated by evaluating the concentration from changes in the line of sight and the head.

  In this embodiment, the evaluation of the subject in this embodiment is, for example, evaluating whether or not the subject is concentrating in a scene where the cue is being applied to the ball when the subject is a billiard player. By doing. Concentration is evaluated from the line of sight and head movement. That is, the evaluation of concentration is based on the fact that the change in the movement of the line of sight is stable with little change, and the change in the movement of the head is stable with little change.

FIG. 10 is a schematic diagram showing a state in which the subject is evaluated in the present embodiment.
As shown in FIG. 10, the evaluation of the subject is performed by photographing the subject from a predetermined position, evaluating the movement of the line of sight from the photographed video and the like, and detecting the head from the sensor unit 17 provided on the subject's head. Evaluate the movement. That is, in the imaging apparatus 1, the movement of the line of sight is evaluated by analyzing the output result from the imaging unit 16, and the movement of the head is performed by analyzing the output result from the sensor unit 17.
In the present embodiment, the movement of the head is detected by the sensor unit 17 included in the imaging apparatus 1, but the present invention is not limited to this. For example, the movement of the head may be acquired from the imaging unit 16. You may comprise so that it may acquire from the output result of.

Further, in the present embodiment, the imaging apparatus 1 uses the output unit 19 of the imaging apparatus 1 to output an evaluation result such as a bad evaluation result that does not satisfy a predetermined standard, for example, light, sound, vibration, or the like. Feedback on output.
The billiard player, who is the subject, corrects the trajectory of play, for example, assuming that the poor evaluation result lacks concentration. In other words, the player can easily check his / her own motion as the subject.
Further, in the imaging apparatus 1, by holding the evaluation result and displaying it on the output unit 19, it is possible to easily confirm the operation of the subject later even if the operation is not being performed.

  The functional blocks in this embodiment are the same as the functional blocks in the first embodiment, and are not shown. Also, the imaging control unit 51 has the same function, and therefore description thereof is omitted. That is, only parts different from the first embodiment will be described below.

  The subject evaluation processing of the present embodiment refers to processing from evaluation of a subject based on output results acquired from the imaging unit 16 and the sensor unit 17 until output of the evaluation results.

  The analysis information acquisition unit 52 temporally corresponds to the information on the change direction of the line of sight (hereinafter referred to as “line of sight information”) from the moving image output from the imaging unit 16 and the moving image data output from the sensor unit 17. The acquired acceleration information is acquired as analysis information.

The analysis evaluation processing unit 53 performs subject analysis and analysis result evaluation based on the analysis information stored in the analysis information storage unit 71.
Specifically, the analysis evaluation processing unit 53 analyzes the movement of the line of sight from the images constituting the moving image in the analysis information. Specifically, the analysis / evaluation processing unit 53 analyzes the movement of the line of sight in an image (for example, an image corresponding to a scene or the like in a posture where a ball is hit with a cue) that constitutes a portion to be analyzed in a moving image.
In the present embodiment, the movement of the line of sight is measured by measuring the stasis time of the sight line, and the time required until the stasis time of the line of sight reaches a predetermined time (hereinafter referred to as “first rest time”). (Hereinafter referred to as “first required time”).
Further, the analysis evaluation processing unit 53 analyzes the movement of the head from the acceleration information at the time corresponding to the image constituting the portion to be analyzed in the analysis information.
In this embodiment, the movement of the head is evaluated by measuring the stationary time of the head and until the stationary time of the head reaches a predetermined time (hereinafter referred to as “second stationary time”). This is done by deriving the required time (hereinafter referred to as “second required time”).

The analysis / evaluation processing unit 53 evaluates each analysis result of the movement of the line of sight and the movement of the head, and comprehensively determines the evaluated evaluation results to evaluate the subject.
Specifically, the analysis / evaluation processing unit 53 divides the time required for the line of sight and the head into time zones, and determines the concentration score of the line of sight and the head. The criterion for scoring is configured so that, for example, the shorter the time required to reach a predetermined time after being stationary, the higher the probability of concentration, the higher the score.
Then, a stability evaluation score, which is a score of total concentration, is determined from the gaze and head concentration scores.
Thereafter, the subject is evaluated by determining whether or not the stability evaluation score is equal to or higher than the concentration reference value. If the stability evaluation score is equal to or higher than the reference value, the subject that is concentrated is evaluated. If the stability evaluation score is less than the reference value, the subject that is not concentrated is evaluated. To do.

FIG. 11 is a diagram showing various scores (concentration score and stability evaluation score).
In this embodiment, each concentration score of the line of sight and the head is determined with reference to a table including predetermined time and concentration score as shown in the example of FIG.
For example, when the required time is from 0 second to 1 second, the concentration score is determined so as to be 100 points with reference to the corresponding portion.
As a result, as shown in FIG. 11C, the concentration scores for the line of sight and the head are determined.

In this embodiment, as shown in the example of FIG. 11B, the safety evaluation score is determined with reference to a table including a predetermined gaze concentration score and a head concentration score. .
As a result, the safety evaluation score is determined as shown in FIG.

The output control unit 54 controls the output in the output unit 19 based on the evaluation result of the subject by the analysis evaluation processing unit 53.
Specifically, when the safety evaluation score is equal to or higher than the reference value, the output control unit 54 evaluates the subject when concentrating, and does not make an announcement so as not to disturb the operation. The output in the output unit 19 is not performed.
On the other hand, when the safety evaluation score is less than the reference value, the output control unit 54 evaluates the subject if it is not concentrated, so that the voice from the speaker, the LED lamp, The output unit 19 is controlled to output light such as light from the vibrator and vibration from the vibrator.

FIG. 12 is a flowchart for explaining the flow of subject evaluation processing in the second embodiment executed by the imaging apparatus 1 of FIG. 2 having the functional configuration of FIG.
The subject evaluation process is started by a predetermined operation from the user to the input unit 18.

  In step S51, the imaging control unit 51 controls the imaging unit 16 to start shooting.

  In step S <b> 52, the analysis information acquisition unit 52 acquires, as analysis information, acceleration data in a time zone corresponding to moving image data output from the imaging unit 16 and moving image data output from the sensor unit 17.

  In step S53, the analysis evaluation processing unit 53 executes stability evaluation processing. The stability evaluation process will be described later.

  In step S54, the analysis evaluation processing unit 53 compares the calculated concentration score with the reference value.

In step S55, the analysis evaluation processing unit 53 determines whether or not the calculated concentration score is greater than or equal to a reference value. In this step, if it is determined that the reference value is equal to or greater than the reference value, the subject is evaluated as being concentrated, and if it is determined to be less than the reference value, the subject is evaluated as not being concentrated.
If it is less than the reference value, NO is determined in step S55, and the process proceeds to step S56.

  In step S56, the output control unit 54 controls the output unit 19 to perform output in the sense of alerting the subject because the subject is evaluated as being less concentrated than the reference value and not concentrated.

  On the other hand, if it is greater than or equal to the reference value, YES is determined in step S55, and the process proceeds to step S57.

In step S57, the CPU 11 determines whether or not shooting has been completed.
If shooting has not ended, NO is determined in step S57, and the process returns to step S52.
If shooting has been completed, YES is determined in step S57, and the subject evaluation process ends.

  FIG. 13 is a flowchart for explaining the flow of the stability evaluation process in the subject evaluation process.

  In step S <b> 71, the analysis evaluation processing unit 53 acquires line-of-sight information from the analysis information from the analysis information storage unit 71. Specifically, the analysis / evaluation processing unit 53 acquires line-of-sight information for a period in which a ball is about to be shot.

  In step S <b> 72, the analysis / evaluation processing unit 53 analyzes the acquired line-of-sight information and measures the first stationary time.

  In step S73, the analysis / evaluation processing unit 53 calculates the time (first required time) required for the first stationary time to reach the reference time.

  In step S74, the analysis / evaluation processing unit 53 calculates the time required for the calculated first stationary time to reach the reference time (first required time) based on the table shown in FIG. Determine the concentration score for the corresponding line of sight.

  In step S <b> 75, the analysis evaluation processing unit 53 acquires acceleration information from the analysis information from the analysis information storage unit 71. Specifically, the analysis evaluation processing unit 53 acquires acceleration information in a time zone corresponding to the line-of-sight information.

  In step S76, the analysis evaluation processing unit 53 analyzes each acquired acceleration information and measures the second stationary time.

  In step S77, the analysis / evaluation processing unit 53 calculates the time required for the second stationary time to reach the reference time.

  In step S78, the analysis evaluation processing unit 53 determines the concentration of the head corresponding to the time required for the calculated second stationary time to reach the reference time based on the table as shown in FIG. Determine the score.

  In step S79, the analysis evaluation processing unit 53 determines a stability evaluation score from the determined gaze concentration score and head concentration score based on the table shown in FIG. 11B.

The imaging device 1 configured as described above includes an analysis information acquisition unit 52 and an analysis evaluation processing unit 53.
The analysis information acquisition unit 52 acquires analysis information that is information on the line of sight of a person who is an object of motion evaluation.
The analysis evaluation processing unit 53 evaluates the movement of the person based on the analysis information acquired by the analysis information acquisition unit 52.
Thereby, in the imaging device 1, since the state of the subject's line of sight affects the motion of the subject, the motion of the subject can be evaluated.
As a result, in the imaging device 1, the operation of the subject can be easily and objectively confirmed even during the operation.

The analysis information acquisition unit 52 acquires a plurality of images.
The analysis evaluation processing unit 53 acquires line-of-sight information from each of the acquired images. The analysis evaluation processing unit 53 compares the line-of-sight information of each image acquired by the analysis information acquisition unit 52, and evaluates the operation according to the comparison result.
In the above-described embodiment, an image is acquired from the imaging unit 16, but an image may be acquired from an external device or the like.
Therefore, in the imaging apparatus 1, for example, evaluation can be performed by comparing with an image as a model.

The analysis information acquisition unit 52 acquires information on the face direction of the person or information on the position of the head as analysis information.
Further, the analysis evaluation processing unit 53 evaluates the movement of the person based on the analyzed information on the face direction of the person or the information on the head.
Thereby, in the imaging device 1, the precision of evaluation of operation | movement of object can be raised by adding a further reinforcing element.

Further, the analysis evaluation processing unit 53 analyzes the change in the line of sight or the positional relationship between the specific target and the line of sight as the state of the line of sight of the person. In addition, the analysis evaluation processing unit 53 evaluates a person's movement higher as the change in the line of sight is small or the specific target is closer to the line of sight.
Thereby, in the imaging device 1, the accuracy of the evaluation of the target operation can be further increased.

Further, the analysis evaluation processing unit 53 evaluates a component that evaluates the motion of the subject.
In addition, the analysis evaluation processing unit 53 integrates the evaluation of the constituent elements.
The analysis evaluation processing unit 53 evaluates a person based on the evaluation of the integrated component.
Thereby, in the imaging device 1, comprehensive evaluation can be performed based on evaluation of each component, and high quality evaluation can be performed.

In addition, the imaging apparatus 1 includes an output control unit 54 that generates advice information corresponding to the evaluation of the motion of the subject by the analysis evaluation processing unit 53 during output control.
Thereby, in the imaging device 1, the advice with respect to the result analyzed and evaluated can be provided.

The imaging apparatus 1 further includes an output unit 19 that outputs advice information generated during output control by the output control unit 54.
As a result, the imaging apparatus 1 can display and output advice information for the evaluation result by itself.

In addition, the imaging apparatus 1 includes an output unit 19 that notifies the subject person of the evaluation of the motion of the subject by the analysis evaluation processing unit 53 by sound, vibration, or the like.
Thereby, in the imaging device 1, even when the player is playing, for example, by notifying when a negative evaluation is made, it is possible to call attention without moving the line of sight and without interrupting the play. .

Further, the analysis information acquisition unit 52 acquires as analysis information from the image captured by the imaging unit 16.
As a result, the imaging apparatus 1 can consistently perform analysis information acquisition and evaluation by itself without using other devices.

  In addition, this invention is not limited to the above-mentioned embodiment, The deformation | transformation in the range which can achieve the objective of this invention, improvement, etc. are included in this invention.

In the above-described embodiment, the evaluation of the subject is an example for golf or billiard players, but is not limited thereto.
FIG. 14 is a schematic diagram illustrating another example of subject evaluation.
It can also be used to evaluate a subject in baseball pitching as shown in the example of FIG. 14 (a) or batting as shown in FIG. 14 (b).
Specifically, the motion of the subject described above is the motion of the player in golf, billiards or baseball sports.

  In the above-described embodiment, the description has been made on the assumption that the player is photographed and becomes a subject. However, the present invention is not limited to this. In the case where gaze and face direction detection is performed without performing image analysis, the player is evaluated based on the detection result.

In the above-described embodiment, the imaging apparatus 1 to which the present invention is applied has been described using a digital camera as an example, but is not particularly limited thereto.
For example, the present invention can be applied to general electronic devices having a subject evaluation processing function. Specifically, for example, the present invention can be applied to a notebook personal computer, a printer, a television receiver, a video camera, a portable navigation device, a mobile phone, a smartphone, a portable game machine, and the like.

The series of processes described above can be executed by hardware or can be executed by software.
In other words, the functional configuration of FIG. 2 is merely an example and is not particularly limited. That is, it is sufficient that the imaging apparatus 1 has a function capable of executing the above-described series of processing as a whole, and what functional blocks are used to realize this function is not particularly limited to the example of FIG.
In addition, one functional block may be constituted by hardware alone, software alone, or a combination thereof.

When a series of processing is executed by software, a program constituting the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer incorporated in dedicated hardware. The computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose personal computer.

  The recording medium including such a program is not only constituted by the removable medium 31 of FIG. 1 distributed separately from the apparatus main body in order to provide the program to the user, but also in a state of being incorporated in the apparatus main body in advance. It is comprised with the recording medium etc. which are provided in. The removable medium 31 is composed of, for example, a magnetic disk (including a floppy disk), an optical disk, a magneto-optical disk, or the like. The optical disc is composed of, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versatile Disc), a Blu-ray (registered trademark) Disc (Blu-ray Disc), and the like. The magneto-optical disk is configured by an MD (Mini-Disk) or the like. In addition, the recording medium provided to the user in a state of being preinstalled in the apparatus main body includes, for example, the ROM 12 in FIG. 2 in which the program is recorded, the hard disk included in the storage unit 20 in FIG.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series along the order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.

  As mentioned above, although several embodiment of this invention was described, these embodiment is only an illustration and does not limit the technical scope of this invention. The present invention can take other various embodiments, and various modifications such as omission and replacement can be made without departing from the gist of the present invention. These embodiments and modifications thereof are included in the scope and gist of the invention described in this specification and the like, and are included in the invention described in the claims and the equivalent scope thereof.

The invention described in the scope of claims at the beginning of the filing of the present application will be appended.
[Appendix 1]
First acquisition means for acquiring information on the line of sight of a person to be evaluated for movement;
Evaluation means for evaluating the movement of the person based on the information on the line of sight acquired by the first acquisition means;
An information processing apparatus comprising:
[Appendix 2]
It further comprises image acquisition means for acquiring a plurality of images,
The first acquisition unit acquires the line-of-sight information from each image in the plurality of images acquired by the image acquisition unit,
The evaluation means includes
A comparison unit that compares the line-of-sight information of each image acquired by the first acquisition unit;
The operation is evaluated according to the comparison result by the comparison means.
The information processing apparatus according to appendix 1, wherein
[Appendix 3]
A second acquisition means for acquiring information on the orientation of the person's face or information on the position of the head;
The evaluation unit is configured to determine the movement of the person based on the line-of-sight information acquired by the first acquisition unit and the face orientation information or the head position information acquired by the second acquisition unit. Do the evaluation,
The information processing apparatus according to appendix 1 or 2, characterized in that:
[Appendix 4]
Analyzing means for analyzing the positional relationship between the gaze change or the specific target and the gaze as the gaze state of the person,
The evaluation means highly evaluates the movement of the person as the change in the line of sight is small, or the specific object and the line of sight are closer.
The information processing apparatus according to any one of supplementary notes 1 to 3, wherein
[Appendix 5]
The evaluation means includes
Element evaluation means for evaluating a component for evaluating the movement of the person;
Further comprising integration means for integrating evaluations of components by the element evaluation means;
Evaluating the movement of the person from the evaluation of the components integrated by the integration means;
The information processing apparatus according to any one of supplementary notes 1 to 4, wherein
[Appendix 6]
A generating unit that generates advice information corresponding to the evaluation of the movement of the person by the evaluating unit;
The information processing apparatus according to any one of supplementary notes 1 to 5, wherein:
[Appendix 7]
Output means for outputting the advice information generated by the generating means;
The information processing apparatus according to appendix 6, wherein:
[Appendix 8]
Informing means for informing the person of the evaluation of the action of the person by the evaluating means,
The information processing apparatus according to any one of supplementary notes 1 to 5, wherein:
[Appendix 9]
The first acquisition unit acquires the line-of-sight information from an image captured by the imaging unit.
The information processing apparatus according to any one of supplementary notes 1 to 6, wherein:
[Appendix 10]
The movement of the person is a movement of a player in golf, billiards or baseball sports.
The information processing apparatus according to any one of appendices 1 to 9, characterized in that:
[Appendix 11]
An acquisition step of acquiring gaze information of a person to be evaluated for movement;
An evaluation step for evaluating the movement of the person based on the line-of-sight information acquired in the acquisition step;
An information processing method comprising:
[Appendix 12]
Computer
Acquisition means for acquiring information on the line of sight of the person to be evaluated for movement;
Evaluation means for evaluating the movement of the person based on the information of the line of sight acquired by the acquisition means;
A program characterized by functioning as

  DESCRIPTION OF SYMBOLS 1 ... Detection apparatus (imaging device), 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... Bus, 15 ... Input / output interface, 16 ... Sensor part, 17 ... Imaging unit, 18 ... Input unit, 19 ... Output unit, 20 ... Storage unit, 21 ... Communication unit, 22 ... Drive, 31 ... Removable media, 51. .. Imaging control unit, 52... Analysis information acquisition unit, 53... Analysis evaluation processing unit, 54... Output control unit, 71... Analysis information storage unit, 72.

Claims (12)

First acquisition means for acquiring information on the line of sight of a person to be evaluated for movement;
Evaluation means for evaluating the movement of the person based on the information on the line of sight acquired by the first acquisition means;
An information processing apparatus comprising: It further comprises image acquisition means for acquiring a plurality of images,
The first acquisition unit acquires the line-of-sight information from each image in the plurality of images acquired by the image acquisition unit,
The evaluation means includes
A comparison unit that compares the line-of-sight information of each image acquired by the first acquisition unit;
The operation is evaluated according to the comparison result by the comparison means.
The information processing apparatus according to claim 1. A second acquisition means for acquiring information on the orientation of the person's face or information on the position of the head;
The evaluation unit is configured to determine the movement of the person based on the line-of-sight information acquired by the first acquisition unit and the face orientation information or the head position information acquired by the second acquisition unit. Do the evaluation,
The information processing apparatus according to claim 1 or 2. Analyzing means for analyzing the positional relationship between the gaze change or the specific target and the gaze as the gaze state of the person,
The evaluation means highly evaluates the movement of the person as the change in the line of sight is small, or the specific object and the line of sight are closer.
The information processing apparatus according to any one of claims 1 to 3. The evaluation means includes
Element evaluation means for evaluating a component for evaluating the movement of the person;
Further comprising integration means for integrating evaluations of components by the element evaluation means;
Evaluating the movement of the person from the evaluation of the components integrated by the integration means;
The information processing apparatus according to claim 1, wherein the information processing apparatus is an information processing apparatus. A generating unit that generates advice information corresponding to the evaluation of the movement of the person by the evaluating unit;
The information processing apparatus according to claim 1, wherein the information processing apparatus is an information processing apparatus. Output means for outputting the advice information generated by the generating means;
The information processing apparatus according to claim 6. Informing means for informing the person of the evaluation of the action of the person by the evaluating means,
The information processing apparatus according to claim 1, wherein the information processing apparatus is an information processing apparatus. The first acquisition unit acquires the line-of-sight information from an image captured by the imaging unit.
The information processing apparatus according to any one of claims 1 to 6. The movement of the person is a movement of a player in golf, billiards or baseball sports.
The information processing apparatus according to claim 1, wherein the information processing apparatus is an information processing apparatus. An acquisition step of acquiring gaze information of a person to be evaluated for movement;
An evaluation step for evaluating the movement of the person based on the line-of-sight information acquired in the acquisition step;
An information processing method comprising: Computer
Acquisition means for acquiring information on the line of sight of the person to be evaluated for movement;
Evaluation means for evaluating the movement of the person based on the information of the line of sight acquired by the acquisition means;
A program characterized by functioning as

Images