JP2019020834A - Information measuring instrument, information measuring method and information measuring program - Google Patents

Abstract

To measure user's reaction to a video as a numerical value.SOLUTION: An information measuring instrument for measuring user's reaction to a video has: a video display unit which displays the video; an elapsed time measuring unit which measures an elapsed time from the start of display of the video; a reaction information acquisition unit which acquires information of user's reaction to the video; and a measuring unit which weighs a level of reaction acquired on the basis of the information of user's reaction over the elapsed time to measure the level of reaction as a numerical value.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information measuring device that measures a user's response to an image.

  In recent years, when a user's behavior analysis or an object of interest and a survey of needs are conducted, it is increasingly performed using an appliance or the Internet instead of a face-to-face exchange.

  As a case of user analysis using an instrument, there is a technique in which an instrument such as an eye camera is used to measure the movement of the subject's line of sight, the residence time, and the size of the pupil to investigate the condition of the subject. For example, by running a test subject wearing an eye camera, obtaining data including the gaze point, gaze part, and gaze time, and comparing the data with the data of the accident-free driver and the driver who caused the accident, This is to discriminate driving aptitude.

  In addition, as a case of investigating needs using the Internet, there is a method called behavior targeting advertisement (tracking advertisement). For example, based on the browsing history of the user who is the target of the advertisement, the user's interests are estimated, and Internet advertisement distribution is performed by narrowing down the target.

  In either case, the operation information of the user is acquired using an appliance or the Internet, the action content is patterned from the operation information, and the state of the user is measured.

http://www.kyodoprinting.co.jp/release/2015/20150423-1577.html

  Non-Patent Document 1 contains an article on “Behavior Analysis Package Using Eye Tracking and Training Video”. Eye tracking is a method of investigating impressions and needs of an object by measuring the movement and dwell time of the line of sight when the object is viewed, and the size of the pupil, and grasping the “movement of the heart” as a numerical value. " In the above-mentioned eye tracking, the acquired information “gaze movement, dwell time, pupil size” is uniformly replaced with a numerical value, and with the uniformly replaced numerical value, “heart movement” ”And try to investigate the impressions and needs of the object. Among them, the subject environment where the subject is placed is not mentioned. That is, it tries to grasp the “movement of the heart” by substituting with a uniform numerical value under unspecified conditions. However, there is a problem that there is a limit in estimating the psychological state and behavior pattern such as “impression and need for the subject” of the subject only by replacing the information uniformly obtained under unspecified conditions with a numerical value. there were.

  Therefore, the present invention displays the video intended by the administrator, obtains the user's reaction information for the specific video, and based on the user's reaction information associated with the elapsed time from the start of the video display. It aims at solving the said problem by weighting the acquired reaction degree.

  The present invention is an information measuring device that measures a user's response to a video, a video display unit that displays the video, an elapsed time measurement unit that measures an elapsed time from the start of display of the video, and the video A reaction information acquisition unit that acquires the reaction information of the user, and a measurement unit that weights the reaction degree acquired based on the reaction information according to the history of the elapsed time and measures the reaction degree as a numerical value. It is characterized by that.

  The measurement unit of the information measuring device according to the present invention is characterized in that the reaction degree is replaced with a numerical value based on a reaction degree replacement table based on the history of the elapsed time and the reaction information.

  The reaction information acquisition unit of the information measuring device according to the present invention divides the elapsed time and acquires the reaction information for each of the divided time zones.

  The measuring unit of the information measuring device according to the present invention is characterized in that the weighting is different for the degree of reaction depending on a time zone obtained by dividing the elapsed time.

  The reaction degree substitution table of the information measuring device according to the present invention includes one or more measurement values for each reaction degree.

  The reaction information acquisition unit of the information measuring apparatus according to the present invention is characterized in that a predetermined body movement of the user is acquired as the reaction information.

  The reaction information acquisition unit of the information measuring device according to the present invention is characterized in that the predetermined duration and / or repetition interval time of the body movement is acquired as the reaction information.

  The information measuring apparatus according to the present invention includes a reaction degree output unit that outputs a user reaction degree to the video based on the numerical value measured by the measurement unit.

  The reaction degree output unit of the information measuring device according to the present invention is characterized in that the reaction degree is visualized from the numerical value by any one or more display forms such as a score, a graph, and the like.

  An information measurement method according to the present invention is an information measurement method for measuring a user's response to a video, the step of displaying the video, the step of measuring an elapsed time from the display start of the video, and the video The step of acquiring the reaction information of the user and the step of measuring the degree of reaction as a numerical value by weighting the degree of reaction acquired based on the reaction information according to the history of the elapsed time are performed. And

  An information measurement program according to the present invention is an information measurement program for measuring a user's reaction to a video, a function of displaying the video on a computer, a function of measuring an elapsed time from the start of display of the video, A function of acquiring reaction information of the user with respect to the video, and a function of measuring the reaction degree as a numerical value by weighting the reaction degree acquired based on the reaction information associated with the history of the elapsed time. It is characterized by that.

  According to the present invention, it is possible to display a video intended by an administrator, and measure the degree of response obtained by weighting the user's response information to the video according to the elapsed time from the start of video display as a numerical value. That is, it is possible to instantly estimate a more precise behavior / psychological state by weighting the acquired user reaction information according to the condition under specific conditions.

It is a functional block diagram of an information measuring device concerning Embodiment 1 of the present invention. It is a processing flow figure of the information measuring device concerning Embodiment 1 of the present invention. It is a functional block diagram of the information measuring device which concerns on Embodiment 2 thru | or Embodiment 2D of this invention. It is a processing flowchart of the information measuring device which concerns on Embodiment 2 thru | or Embodiment 2D of this invention. It is a figure which shows the screen of the terminal 10 of the information measuring device which concerns on Embodiment 2 thru | or Embodiment 2D of this invention, (a) is an input screen of a comment, (b) is a display screen of an advertisement. It is a figure which shows the screen of the screen 30 of the information measuring device which concerns on Embodiment 2 thru | or Embodiment 2D of this invention, (a) is a display screen of a comment, (b) is a comment result screen. It is the setting information held in the server 20 of the information measuring apparatus according to Embodiment 2 to Embodiment 2D of the present invention, (a) is a reaction information code table in which a code is assigned to the reaction information, and (b) is a code in the measured value. Is a measurement value code table to which is assigned. It is the setting and / or recording information stored in the server 20 of the information measuring device according to the second to second embodiments of the present invention, and (a) replaces the history of elapsed time and the reaction degree obtained from the reaction information with numerical values. (B) is an example of user input values, and (c) is a diagram showing an example of conversion from the input values of (b) to numerical values based on the reactivity degree replacement table of (a). It is the setting and / or recording information held in the server 20 of the information measuring apparatus according to the second to second embodiments of the present invention, and (a) is obtained from the elapsed time and the reaction information that distinguishes single shots and repeated shots. (B) is an example of user input values, (c) is an example of conversion from (b) input values to numerical values based on (a) reaction degree substitution table. FIG. It is a functional block diagram of the information measuring device which concerns on Embodiment 3 thru | or Embodiment 3E of this invention. It is a processing flowchart of the information measuring device which concerns on Embodiment 3 thru | or Embodiment 3E of this invention. It is the setting information held in the server 20 of the information measuring apparatus according to Embodiment 3 to Embodiment 3E of the present invention, (a) is a reaction information code table in which a code is assigned to the reaction information, and (b) is a code in the measured value. Is a measurement value code table to which is assigned. The setting and / or recording information held in the server 20 of the information measuring device according to the third to third embodiments of the present invention, wherein (a) replaces the history of elapsed time and the reaction degree obtained from the reaction information with numerical values. (B) is an example of a user input value, (c) is an example of converting the input value of (b) into a numerical value based on the reactivity degree replacement table of (a), (d) is (b ) Of the user's second input value, (e) is a diagram showing an example in which the input value of (d) is converted to a numerical value based on the reactivity degree substitution table of (a). It is the setting information held in the server 20 of the information measuring apparatus according to Embodiment 3 to Embodiment 3E of the present invention, (a) is a reaction information code table in which a code is assigned to reaction information, and (b) is a code in the measurement value Is a measurement value code table to which is assigned. The setting and / or recording information held in the server 20 of the information measuring device according to the third to third embodiments of the present invention, wherein (a) replaces the history of elapsed time and the reaction degree obtained from the reaction information with numerical values. (B) is an example of a user input value, (c) is converted from the input value of (b) into a numerical value based on the reactivity degree replacement table of (a). For example, (d) is a diagram showing a table charted as a radar chart based on the result of (c). It is the setting and / or recorded information held in the server 20 of the information measuring apparatus according to Embodiment 3 to Embodiment 3E of the present invention, and (a) is a reaction acquired from the history of elapsed time and reaction information acquired for each gaze time. Reactivity degree substitution table for substituting degrees for numerical values, (b) is an example of user input values, (c) is an example of conversion from input values of (b) to numerical values based on the reactivity degree substitution table of (a). FIG. It is a figure showing the gaze range which the terminal 10 of the information measuring device which concerns on Embodiment 3 thru | or Embodiment 3E of this invention acquires.

  Hereinafter, an embodiment for implementing an information measuring device for measuring a user's reaction according to the present invention will be described with reference to the drawings.

[Embodiment 1]
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
Based on FIG. 1, a more precise behavior / psychological state can be obtained by displaying an image and weighting the degree of reaction acquired based on the user's reaction information along with the elapsed time from the start of display of the image. An example that makes it possible to infer will be described as a first embodiment.

  Terms used in the specification will be described below. In the specification, a video indicates a video for the purpose of education, training, entertainment, advertisement, music, live broadcasting, and the like.

  User response information is information related to the user's response to the video, that is, from the user's body part (gaze, neck movement, finger movement, jump, crouch, limb movement, vocalization, pulse, etc.) A reaction involving physical movement.

  The elapsed time is the elapsed time from the start of the video display, and the elapsed time is how the time has elapsed since the start of the display. The reaction information associated with the history indicates what kind of user reaction is occurring within the elapsed time. Specifically, when the terminal includes the elapsed time measurement unit 3 and the reaction information acquisition unit 4 in the present invention, when the user's reaction information is acquired as a finger movement, The single tap determination is included as reaction information associated with the above-described elapsed time. Note that it is only necessary to be able to acquire what kind of user reaction occurs, and the present invention is not limited to the above.

  The degree of reaction indicates the degree of reaction acquired based on the history of elapsed time and user's reaction information. That is, a psychological level including excitement, discouragement, joy, etc., and a capability level including attention, response speed, and the like.

  Weighting means performing quantitative evaluation (scoring) according to importance. In the present invention, quantitative evaluation is performed on the importance of the video, the importance of the reaction of the user, the importance of the time (elapsed time and the history of the elapsed time), and other importance, and the evaluation is included in the above-described degree of reaction. Shows what is quantified.

[Constitution]
FIG. 1 is a diagram showing a system configuration according to Embodiment 1 of the present invention.
In FIG. 1, the information measuring apparatus 1 includes a video display unit 2, an elapsed time measuring unit 3, a reaction information acquiring unit 4, and a measuring unit 5 that receives information from the elapsed time measuring unit 3 and the reaction information acquiring unit 4. Have.

  Although FIG. 1 shows a configuration in which the information measuring device 1 is configured as one device, a terminal possessed by a plurality of users, a communication network (not shown) connecting the terminal and the server, and a communication network are shown. It may be configured to have a server that accepts communication via the server and performs various settings, registration, management, etc., and has functions of a video display unit 2, an elapsed time measurement unit 3, a reaction information acquisition unit 4, and a measurement unit 5. Any configuration may be used.

  In the case of having the communication network, the communication network is a public switched telephone network (PSTN), a cellular phone network, an IP telephone network, a closed network, a wireless LAN (WiFi), etc., and functions as a network or other communication network. I just need it.

  When the terminal is included, the terminal is a smart phone, a mobile phone, a PC (Personal Computer), a tablet, or the like, as long as it can perform the function.

Next, the operation of Embodiment 1 of the present invention will be described.
In the configuration of FIG. 1, processing is executed at the steps shown in FIG. First, display of an image intended by the administrator is started (step S1 in FIG. 2). At the same time, the elapsed time measuring unit 3 starts measuring the elapsed time from the start of video display (step S2 in FIG. 2). The reaction information acquisition unit 4 is based on the elapsed time including the body movement from the user's body part (gaze, neck movement, finger movement, jump, crouch, limb movement, vocalization, pulse, etc.) with respect to the video. Accompanying reaction information is acquired (step S3 in FIG. 2). The reaction information includes information indicating that no response is made even if the user does not respond at all.

  Next, the measurement unit 5 obtains information of the elapsed time measurement unit 3 and the reaction information acquisition unit 4, acquires the reaction degree based on the reaction information accompanying the history of the elapsed time, and weights the reaction degree (see FIG. 2 step S4), the weighted reaction degree is measured as a numerical value (step S5 in FIG. 2). When the video is displayed (Yes in step S6 in FIG. 2), the processes in steps S3 to S5 in FIG. 2 are repeated. When the display of the video is completed (No in step S6 in FIG. 2), the numerical value of the measurement result by the measurement unit 5 may be output (step S7 in FIG. 2), the numerical value may be processed, and the measurement result There is no limitation on how to use and use. When all the processes are completed, the process ends (step S8 in FIG. 2).

  According to the first embodiment of the present invention, by performing the above-described processing, the user's reaction information is not uniformly replaced with a numerical value. , Importance of user reaction, importance of time (elapsed time and history of elapsed time), other importance, and weighted results can be acquired as numerical values. In other words, weighting according to the situation makes it possible to grasp the degree of user response, that is, the psychological level and the capability level instantaneously and from various perspectives.

  In the above description, the present invention is constructed as a hardware information measuring device. However, the present invention displays the above-described video display on software by executing an application stored in a memory on a computer (CPU) of a terminal and a server. It may be constructed as a program for constructing a section, an elapsed time measuring section, a reaction information acquiring section, and a measuring section.

  Specifically, a program to be executed by a computer in the embodiment of the present invention is an information measurement program for measuring a user's reaction to an image, the function for displaying the image on the computer, and the display start of the image. A function of measuring the elapsed time from the above, a function of acquiring the user's response information for the video, and a weight of the response level acquired based on the response information associated with the history of the elapsed time, By executing the function of measuring as a numerical value, the computer is constructed as a configuration for measuring the degree of reaction by the computer.

[Embodiment 2]
[Constitution]
In the first embodiment, the user's degree of response to the video is weighted and the behavior / psychological state can be estimated. However, in the following embodiment, the video intended by the administrator is embodied, A specific example of measuring a user's reaction to an image will be described. The second embodiment is an example in which the video is a live video of a bicycle race at a bicycle racetrack, and the configuration thereof will be described below with reference to FIGS. 3 to 6 and FIG.

The outline of the second embodiment will be described below.
In the second embodiment, the video display device uses a fan participation type digital signage (hereinafter referred to as a screen 30). A screen 30 is installed in the bicycle racetrack, and an environment is provided in which a bicycle racer can be supported in real time by screen operation on a smartphone or mobile terminal (hereinafter referred to as terminal 10) possessed by a user staying in the bicycle racetrack. To do. The cheering enables a user to input a comment of the content to be cheered by the terminal 10 (comment input screen 51 in FIG. 5A), and the input comment is posted on the screen 30 as needed (FIG. 6 ( a) Screen image comment display screen 53). At the same time, it is possible to measure the psychological degree including the user's excitement, discouragement, joy, etc. as a numerical value by weighting the degree of response acquired based on the user's input comment and the history of elapsed time.

The device configuration of the second embodiment will be described below.
In FIG. 3, the information measuring apparatus 1 accepts communication via the communication network 50, the terminal 10 owned by a plurality of users, the communication network 50 connecting the terminal 10 and the server 20, and various settings / registrations. The server 20 that performs management and the like, the screen 30 that receives communication via the communication network 50 and displays video, and the recording unit 40 that receives information from the server 20 are included.

  The terminal 10 acquires, as reaction information, a communication unit 11 that performs communication via the communication network 50, a control unit 12 that performs various controls, an input unit 13 that inputs a user's comment, and an input value of the input unit 13. It has the reaction information acquisition part 4 and the elapsed time measurement part 3 which measures the process of the elapsed time from the display start of an image | video.

  The screen 30 includes a communication unit 31 that receives information from the server 20 via the communication network 50, a control unit 32 that performs various controls, a video display unit 2 that displays video, and an input unit 13 of the terminal 10. It has the output part 33 which outputs an input value, and the display part 34 which displays the image | video acquired from the video display part 2 and the output part 33, and a comment.

  The server 20 weights the degree of reaction acquired from the communication unit 21 that performs communication via the communication network 50, the control unit 22 that performs various controls, the reaction information acquisition unit 4 and the elapsed time measurement unit 3 of the terminal 10. The weighting unit 23, the measuring unit 5 that measures the weighted reaction degree as a numerical value, and the reaction degree output unit 24 that outputs the user's reaction degree to the video based on the numerical value measured by the measuring unit 5.

  The recording unit 40 is used to record information for performing setting, registration, management, and the like including information received from the reaction information acquisition unit 4 and / or the elapsed time measurement unit 3 of the terminal 10 by the server 20.

  The device configuration is not limited to the above. For example, the server 20 may include the elapsed time measurement unit 3 and the reaction information acquisition unit 4 of the terminal 10.

Next, the operation of Embodiment 2 of the present invention will be described.
The server 20 instructs the screen 30 to display the actual video of the bicycle race (step S11 in FIG. 4), the video display unit 2 of the screen 30 instructs the display unit 34 to display the video, and the display unit 34 displays the live video. Is started (step S13 in FIG. 4). The server 20 instructs the terminal 10 to start measuring elapsed time simultaneously with the start of the bicycle race (step S12 in FIG. 4), and the terminal 10 receives the instruction from the server 20 and the elapsed time measuring unit 3 determines the elapsed time. Measurement is started (step S14 in FIG. 4), and the input unit 13 displays the comment input screen 51 in FIG. When the comment of the support content is input to the input unit 13 of the terminal 10 (step S15 in FIG. 4), the reaction information acquisition unit 4 of the terminal 10 performs the predetermined physical action of the user including the comment content. Obtained as the reaction information (step S16 in FIG. 4). The control unit 12 of the terminal 10 acquires the reaction information acquired by the reaction information acquisition unit 4 and the elapsed time measured by the elapsed time measurement unit 3, and the communication unit 11 transmits the acquired information to the server 20 ( Step S17 in FIG.

  The server 20 examines the received comment display (step S18 in FIG. 4), and gives a comment display instruction to the screen 30 (step S19 in FIG. 4). The output unit 33 of the screen 30 instructs the display unit 34 to display a comment, and the display unit 34 outputs the comment that has received the display instruction on the actual video of the bicycle race (step S20 in FIG. 4). The scrutiny is a process including a display order when comments are concentrated on the server 20 and deletion of inappropriate comments in the embodiment that allows free word input. The scrutiny may or may not be provided depending on the embodiment.

  The weighting unit 23 of the server 20 weights the reaction degree from the reaction information and the elapsed time received in step S17 in FIG. 4 (step S21 in FIG. 4), and the measurement unit 5 measures the weighted reaction degree as a numerical value. (Step S22 in FIG. 4). The numerical value replaces the reaction degree with a numerical value based on a reaction degree substitution table (shown in FIG. 8A) based on the history of the elapsed time and the reaction information.

  The response level output unit 24 of the server 20 outputs the numerical value to the recording unit 40 as the response level of the user to the video (step S23 in FIG. 4). The recording unit 40 records the degree of reaction. The reaction degree output unit 24 may output the reaction degree to the recording unit 40 as described above, or may output it to the other, and the output destination is not limited. Moreover, although it performs by step S23 of FIG. 4, you may output collectively after completion | finish of video display (step S27 No of FIG. 4), and the timing of an output is not limited.

  When the actual video of the bicycle race has not ended (step S27 in FIG. 4), the processing from step S15 to step S23 is repeated. When the actual video of the bicycle race ends (No in step S27 in FIG. 4), the server 20 instructs the terminal 10 to end the comment input (step S29 in FIG. 4), and ends the process (step S31 in FIG. 4). The input unit 13 of the terminal 10 ends the comment input screen 51 in FIG. 5A (step S30 in FIG. 4). The display unit 34 of the screen 30 ends the live video (step S28 in FIG. 4).

  According to the second embodiment of the present invention, it is possible to acquire the user's reaction degree as a numerical value from the history of the elapsed time and the content of the user's comment. Reflecting the input comment from the terminal on the screen leads to prompting input to the terminal, and the reaction information acquired by the server is activated. When the response information acquired by the server increases, the degree of response measured accordingly increases, that is, it becomes possible to estimate a more precise behavior / psychological state.

  The weighting unit 23 of the server 20 weights the degree of response in step S21 of FIG. 4. The weighting is an importance level, and the purpose is to obtain what kind of degree of response (or psychological state type). Depending on whether or not, the weighting target and the value are different.

[Embodiment 2A]
[Constitution]
In the second embodiment, the server is weighted based on the elapsed time and reaction information acquired from the terminal. However, in the second embodiment, the weighting method for the reaction degree and the acquired reaction degree are set. An example of a configuration that makes it possible to use the numerical values to be expressed will be described below with reference to FIGS. 3 to 5 and FIGS. Other configurations are the same as those of the second embodiment.

An outline of the embodiment 2A will be described below.
In Embodiment 2A, a case will be described in which the actual degree video of the bicycle race and the content of the user's comment are weighted, and the degree of reaction is regarded as the degree of excitement. Furthermore, it is assumed that a product suitable for the user's psychological state is introduced using the degree of excitement.

The device configuration of Embodiment 2A will be described below.
In FIG. 3, an advertisement display unit 14 that displays an advertisement for which a display instruction is issued by the advertisement instruction unit 25 of the server 20 based on the information acquired from the reaction information acquisition unit 4 and the elapsed time measurement unit 3 is added to the terminal 10. Then, the server 20 is configured such that an advertisement instruction unit 25 for instructing display of an advertisement corresponding to the degree of reaction is added.

Next, the operation of Embodiment 2A will be described.
The server 20 instructs the screen 30 to display the actual video of the bicycle race (step S11 in FIG. 4), the video display unit 2 of the screen 30 instructs the display unit 34 to display the video, and the display unit 34 displays the live video. Is started (step S13 in FIG. 4). The server 20 instructs the terminal 10 to start measuring elapsed time simultaneously with the start of the bicycle race (step S12 in FIG. 4), and the terminal 10 receives the instruction from the server 20 and the elapsed time measuring unit 3 Measurement is started (step S14 in FIG. 4), and the input unit 13 displays the comment input screen 51 in FIG. When the comment of the support content is input to the input unit 13 of the terminal 10 (step S15 in FIG. 4), the reaction information acquisition unit 4 of the terminal 10 performs the predetermined physical action of the user including the comment content. Obtained as the reaction information (step S16 in FIG. 4). The control unit 12 of the terminal 10 acquires the reaction information acquired by the reaction information acquisition unit 4 and the elapsed time measured by the elapsed time measurement unit 3, and the communication unit 11 transmits the acquired information to the server 20 ( Step S17 in FIG.

  The process in step S17 in FIG. 4 described above may be performed at any time in units of reaction information acquisition (step S16 in FIG. 4). However, in the embodiment 2A, the elapsed time is divided and the divided time zones are It is described as obtaining reaction information.

  The server 20 examines the received comment display (step S18 in FIG. 4), and gives a comment display instruction to the screen 30 (step S19 in FIG. 4). The output unit 33 of the screen 30 instructs the display unit 34 to display a comment, and the display unit 34 outputs the comment that has received the display instruction on the actual video of the bicycle race (step S20 in FIG. 4). The scrutiny is a process including a display order when comments are concentrated on the server 20 and deletion of inappropriate comments in the embodiment that allows free word input. The scrutiny may or may not be provided depending on the embodiment.

  The weighting unit 23 of the server 20 weights the reaction degree from the reaction information and the elapsed time received in step S17 in FIG. 4 (step S21 in FIG. 4), and the measurement unit 5 sets the weighted reaction degree as a numerical value. Measurement is performed (step S22 in FIG. 4). The numerical value of the measurement unit 5 is to replace the reaction degree with a numerical value based on a reaction degree substitution table (shown in FIG. 8A) based on the history of the elapsed time and the reaction information.

  The response level output unit 24 of the server 20 outputs the numerical value to the recording unit 40 as the response level of the user to the video (step S23 in FIG. 4). The recording unit 40 records the degree of reaction. The reaction degree output unit 24 may output the reaction degree to the recording unit 40 as described above, or may output it to the other, and the output destination is not limited. Moreover, although it performs by step S23 of FIG. 4, you may output collectively after completion | finish of video display (step S27 No of FIG. 4), and the timing of an output is not limited.

  When the degree of response acquired as the numerical value exceeds a certain value, the advertisement instruction unit 25 of the server 20 determines and acquires an advertisement corresponding to the user's degree of excitement (step S24 in FIG. 4), and sends it to the terminal 10. An advertisement display instruction is issued (step S25 in FIG. 4). The advertisement display unit 14 of the terminal 10 displays the advertisement (illustrated in FIG. 5B) (step S26 in FIG. 4).

  If the actual video of the bicycle race has not ended (step S27 in FIG. 4), the processing from step S15 to step S22 is repeated. When the actual video of the bicycle race ends (No in step S27 in FIG. 4), the server 20 instructs the terminal 10 to end the comment input (step S29 in FIG. 4), and ends the process (step S31 in FIG. 4). The input unit 13 of the terminal 10 ends the comment input screen 51 in FIG. 5A (step S30 in FIG. 4). The display unit 34 of the screen 30 ends the live video (step S28 in FIG. 4).

Next, the reactivity degree substitution table used in step S22 of FIG. 4 described above will be described below.
The reaction degree substitution table (shown in FIGS. 8 and 9) shows a table for replacing the reaction degree with a numerical value as described above. The reactivity degree substitution table needs to be set in advance in carrying out the embodiment 2A. As shown in FIG. 7, reaction information and a measured value are set as values.

  The reaction information is a predetermined body motion of the user, and indicates a tap operation when the terminal 10 is used as a smartphone or a tablet terminal with a finger and a click operation when a mouse is used. . Further, when the terminal 10 is a push button type mobile phone, it indicates a button pressing operation. In any case, input items that can be detected by the terminal 10 are set as reaction information. FIG. 7A is a table for assigning codes to the reaction information.

  In the present invention, the measured value is a value that is set depending on what degree of response (or the type of psychological state) is intended to be obtained. In the embodiment 2A, the product is suitable for the psychological state of the user. It is used for the purpose of sorting. Accordingly, FIG. 7B is a table in which measured values are assigned to products.

The reactivity degree substitution table will be described below with reference to FIG.
In the present invention, since the video is specified in advance, the approximate time from the start to the end of the display can be specified. In the embodiment 2A, since it is a live video of a bicycle race, an accurate time cannot be specified in advance, but a certain degree of prediction is possible for each held race.

  FIG. 8 (a) shows an example in which the period from the start of the bicycle race to the goal is 5 minutes, and 5 minutes is divided into 10 and set at equal intervals of 30 seconds per division. The division unit may be equally spaced, or the time per division may be determined for each division unit to be unequal intervals. In addition, when the race is 5 minutes or longer, the tenth division (T10 in FIG. 8A) is used as it is.

  The elapsed time from the start to the goal is the horizontal axis, and the vertical axis is the reaction information code set in FIG. Using the elapsed time and the reaction information, a weighted numerical value of the reaction degree is acquired from the matrix of FIG.

  For example, when “insert!” Is input 40 seconds after the start, the value “X = 1” in the frame 57A is acquired from the matrix of FIG. As for the value “X” in the frame, referring to FIG. 7B, it can be seen that a numerical value is entered for “alcohol”. This is the intention to advance “alcohol” if the excitement continues as it is at the beginning of the race, as long as the excitement continues as it is, that is, acquired based on the reaction information with the history of the elapsed time The reaction degree is weighted and the reaction degree is measured as a numerical value.

  Further, when “Put!” Is input after 4 minutes and 20 seconds from the start, the value “X = 8” within the frame 57B is acquired from the matrix of FIG. Depending on the time zone in which the elapsed time is divided, the degree of reaction is differently weighted. Even if the same comment is entered, it is judged that the excitement level is higher if “Put!” Is entered at the end of the race, and “alcohol” is displayed more easily. The number is set to increase according to the elapsed time, and this is due to the nature of the bicycle race, with the expectation that the base excitement level is high from the beginning of the race to the end of the race, and the elapsed time from the start of the race. This is because the matrix of FIG. 8A is created by weighting. In addition, although said description presupposes what divides | segments elapsed time and acquires the said reaction information for every said divided | segmented time slot | zone, you may make it acquire reaction information at any time, without dividing | segmenting elapsed time.

  Further, when “Gaman!” Is input after 4 minutes and 40 seconds from the start, the values “X = 10” and “Z = 10” within the frame 57C are acquired from the matrix in FIG. 8A. It can be seen that the value “Z” in the frame is “ice” with reference to FIG. Since the word “Gaman!” Is pressed at the end of the race, it is determined that the user's degree of stress is high, and “alcohol” and “ice” are easily displayed. As shown here, the degree of reaction substitution table allows one or more measurements to be included for each degree of reaction. By including a plurality of measured values for one input value, it is possible to infer a more complicated psychological state and introduce a product suitable for the psychological state.

  FIG. 8B shows an example of input values of a certain user.

  In the frame 58A in FIG. 8 (b), three "D" s are described. This is because "D" is pressed three times between 1 minute 00 seconds and 1 minute 29 seconds. I can hear that. Referring to the frame 57D in FIG. 8A, it can be seen that “4” is added to the measurement value “Y” when “D” is pressed once. Therefore, since “D” is pressed three times, “Y” becomes “12” is shown in the frame 59A in FIG. 8C.

  In the frame of 58B in the table of FIG. 8B, two “D” s and one “E” are described, but this is “D” between the start 1 minute 30 seconds and 1 minute 59 seconds. "" Is pressed twice and "E" is pressed once. Referring to the frame 57E in FIG. 8A, it can be seen that “4” is added to the measured value “Y” per “D” press, and “8” is added to the result “Y”. Become. Referring to the frame 57F in FIG. 8A, since there is no value, it can be seen that even if “E” is pressed, no addition is performed. This is because even if “Gaman!” Is pressed in the middle of the race, there is not much movement in the race development due to the nature of the bicycle race, and therefore it is not weighted. According to the calculation, “Y” becomes “20” in total. Here, when the advertisement display threshold is set to “20”, an advertisement with the advertisement content of the advertisement display screen 52 shown in FIG. 5B as “soft drink” is displayed on the terminal. The

  The above-described threshold value for displaying an advertisement indicates a boundary value for determining whether or not to display an advertisement. In the above example, since the threshold value is “20”, the degree of response is aggregated for each measured value from the response information of the terminal, and the corresponding advertisement is displayed when the measured value becomes “20”. is there. When the advertisement is displayed, the measurement value is cleared, and the state in the frame indicated by 59C in FIG.

  The above advertisement is displayed at any time when each measurement value exceeds the threshold value, but a plurality of measurement values exceed the threshold value at the same time as indicated by 59D in FIG. 8C. If there is a possibility, the priority of the advertisement may be set in advance. Here, in the table of measured values in FIG. 7B, the priority is set in the order of the table, and “alcohol” is displayed.

  A method for acquiring the advertisement in step S24 of FIG. 4 will be described below. In the advertisement instruction unit 25 of the server 20, it is necessary to set a table for associating the measurement value with the advertisement in advance before implementing this embodiment. The table to be linked is, for example, “alcohol”, “soft drink”, and “ice” as measured values in FIG. 7B, but in contrast to the beer advertisement images shown in FIG. 5B, respectively. This is a table for linking various images. The advertisement is not limited to a moving image, a still image, audio, or the like, and may be set in advance at the time of implementation.

  According to Embodiment 2A of the present invention, the support (especially cheering) of a bicycle race is acquired as reaction information, the user's reaction level is regarded as the excitement level, and a product suitable for the user's psychological state is introduced. Therefore, the present invention can be used more commercially.

  Further, in the reaction degree replacement table, it is necessary to set a value based on human behavior psychology by marketing or the like in advance, but after setting, the output result of the reaction degree output unit 24 is accumulated in step S24 of FIG. By using the advertisement displayed in step S26 of FIG. 4 and collating with the purchase information for actually purchasing the product, it is possible to always analyze the advertising effect, and to update the reaction degree substitution table as needed. It becomes possible to measure a more precise psychological state.

  In addition, although the mechanism of the said advertisement display has demonstrated the example which displays an advertisement immediately when each measured value exceeds a threshold value, the timing which displays an advertisement is controlled by the reaction degree output part 24 of the server 20. Also good. For example, in the case of entering the border after the start of the race 4 minutes, even if the advertisement is displayed at the start of the 4th minute, it is considered that there are few users standing for purchase, and the measured value has not reached the threshold at the start of the 3rd minute Even in such a case, an advertisement corresponding to the highest measured value at that time may be displayed. In order to realize the advertisement display, it is necessary to set the elapsed time from the start and the process of “display the advertisement corresponding to the highest measured value” in the response level output unit 24 of the server 20 in advance. is there. In addition, when the bicycle racetrack is wide and it is not possible to easily purchase during the race, it may be displayed after the race.

  The degree-of-reaction output unit 24 of the server 20 controls the advertisement display timing, and when the timing is reached, instructs the advertisement instruction unit 25 to display the advertisement and sends the advertisement to the advertisement display unit 14 of the terminal 10. Is displayed.

  In addition, as described above, by accumulating display advertisements and actual purchase information, it is statistically at what timing it is most effective to display advertisements, and advertisements are maintained to maintain the user's excitement. It is possible to grasp the time zone when it is better not to display. You may set to the reaction degree output part 24 of the server 20 so that an advertisement may be displayed at an effective advertisement display timing. Note that the grasp of the timing of the effective advertisement display is omitted here because it is not directly related to the present invention.

  As described above, it is possible to more accurately measure the psychological state and display an advertisement suitable for the psychological state (introducing a product) by finely dividing the measurement value and the elapsed time division unit.

  The configuration of Embodiment 2A is not limited to the method and / or configuration described above.

[Embodiment 2B]
[Constitution]
In Embodiment 2A, the weighting method for the degree of response and a configuration that allows the use of a numerical value representing the obtained degree of reaction are used. However, in Embodiment 2B, the finger movement when inputting a comment on the terminal An example of a configuration that also detects this will be described below with reference to FIG. Other configurations are the same as those of the embodiment 2A.

  In the embodiment 2B, the finger movement indicates a distinction between input intervals on the terminal, that is, discrimination of input by repeated hitting of a button, double click, or single shot.

  In addition, it describes below about the distinction of the said single shot and repeated hits. In order to distinguish between single shots and repeated shots, it is necessary to define a repeat interval in advance. The definition of the repetition interval is, for example, continuous hit when the next reaction information is detected in less than 0.5 seconds, single shot when the interval is 0.5 seconds or longer, and the like.

  The server 20 acquires the reaction information acquired from the reaction information acquisition unit 4 of the terminal 10 and the time when the elapsed time measurement unit 3 detects the reaction information (step S17 in FIG. 4), and the interval with the immediately previous reaction information. Get time. For example, if the previous reaction information and the interval of 0.3 seconds are compared with the definition of the repetition interval, the reaction degree is weighted as repeated hits (step S21 in FIG. 4). Then, for example, when the interval is 0.6 seconds from the immediately previous reaction information, the reaction degree is weighted as a single shot (step S21 in FIG. 4). Note that the distinction between repeated hits and single shots may be limited to the interval time between the same reaction information, or as described above, not limited to the same reaction information, but may be performed based on the interval time of the reaction information.

  As for the distinction between single shot and continuous hit, depending on the embodiment, when the reaction information acquisition unit 4 acquires the reaction information, it may be distinguished as single click and double click, and may be acquired as different reaction information. It is only necessary to acquire reaction information associated with the circumstances and distinguish between single shots and repeated hits. At the same time, if it is necessary to define the above-mentioned repetition interval, it is defined separately at the time of implementation.

  By distinguishing between single shots and repeated hits and capturing them as different body movements of the user, it becomes possible to obtain the degree of excitement of the user more precisely. FIG. 9 shows an example of a reaction degree substitution table for distinguishing between single shots and repeated shots.

  FIG. 9 (a) is a table in which reaction information is further distinguished by single shot and repeated hitting from the matrix of FIG. 8 (a). FIG. 9B shows an example of a case where the pressed comment is the same as that in FIG. 8B, but the pressing interval between C and B in the 61A frame is short and it is regarded as repeated hitting. The result of obtaining continuous reaction information “C, C, B, B” and single reaction information “B” is within the frame 62D in FIG. 9C. When the calculation formula is described with the values obtained from the degree-of-reaction substitution table in FIG. 9A, the continuous reaction information “C, C, B, B” is “12, 12, “20, 20” and the measured value “Z” are “7, 7, 0, 0”, and the single reaction information “B” is “18” for the measured value “X”. Therefore, as shown in the 62D frame, “X” is “82” and “Z” is “14”.

  In the embodiment 2B, weighting is performed not only on the elapsed time from the start but also on the repetition interval time including single shot and repeated hits. In addition, although the repetition interval time is acquired as reaction information here, it is also possible to acquire a pressing time (long press) or the like, and the predetermined duration of physical movement and / or the repetition interval time is used as reaction information. Any method may be used as long as it is obtained. By acquiring not only the input value but also the history of input to the terminal (repetitive hits, single shots, etc.) as reaction information, it has become possible to acquire a more precise state of user reaction.

  Note that the configuration of Embodiment 2B is not limited to the method and / or configuration described above.

[Embodiment 2C]
[Constitution]
In Embodiments 2 to 2B, the user's reaction degree at the bicycle racetrack is acquired. However, in Embodiment 2C, the input to the terminal is further promoted, and the reaction information acquired by the server is activated. An example will be described below with reference to FIGS. The server 20 has a configuration in which a totaling unit that counts comments is added to the configuration in FIG. Other configurations are the same as those of the embodiment 2A.

  In the embodiment 2C, it is possible to obtain the above-mentioned supporting bicycle racer, that is, to select a target to which the comment of the content to be supported is selected, and at the same time, it is possible to rank and display the comments counted by the server 20 after the race is finished. And

The operation of Embodiment 2C will be described below.
First, as shown in 51A (illustrated in FIG. 5A) of the comment input screen 51, buttons having the same number and the same color as the number and colors of players are displayed on the input unit 13 of the terminal 10. The user selects a button of the same color as the player who wants to cheer, then presses the comment (step S15 in FIG. 4), and the reaction information acquisition unit 4 of the terminal 10 acquires the press information of the color and the comment as the reaction information. (Step S16 in FIG. 4). The terminal 10 transmits the obtained reaction information and elapsed time to the server 20 (step S17 in FIG. 4).

  Next, the server 20 performs a comment display process (step S18 in FIG. 4), and gives a comment display instruction including the comment color on the screen 30 (step S19 in FIG. 4). The output unit 33 of the screen 30 instructs the display unit 34 to output a comment, and the display unit 34 displays the comment on the display video (step S20 in FIG. 4) (FIG. 6A) screen video comment display screen. 53.)

  When the live video of the bicycle race ends (No in step S27 in FIG. 4), the server 20 aggregates the comment information acquired as the reaction information in the aggregation unit, and transmits the aggregation result totaled in the aggregation unit to the screen 30. . The totaling unit for totaling the comments is not shown in the functional block diagram of FIG. Moreover, in order to unify processes such as replacement and calculation, the measurement unit 5 may have a function of a totaling unit. As shown in the screen comment result screen 54 in FIG. 6B, the screen 30 displays the comment summation result as the encouragement ranking on the display unit 34 via the output unit 33.

  According to the embodiment 2C, it is possible to input a comment as support for the target player, not just support, and since it is finally announced as a ranking, it is possible to promote activation of input of the comment. . As described above, when the reaction information (comment information) acquired by the server increases, the degree of response measured accordingly increases, that is, it becomes possible to estimate a more precise action / psychological state.

  Note that the configuration of Embodiment 2C is not limited to the method and / or configuration described above.

[Embodiment 2D]
[Constitution]
In Embodiment 2 thru | or Embodiment 2C, although it was set as the structure which acquires the user's reaction degree in a bicycle race track, in Embodiment 2D, an example of the structure which changes a reaction degree according to a user's age, sex, and other user information is shown. This will be described below. Other configurations are the same as those of the embodiment 2A.

An outline of the embodiment 2D will be described below.
In Embodiment 2D, the user is prompted to input a questionnaire before the start of the video, that is, before the start of the race. The questionnaire items are set in advance such as age, sex, address, number of visits, and the like. For example, even if the same input (for example, “Send!” Etc.) is used, the degree of excitement varies depending on age, sex, number of visits, etc., so the degree of response corresponding to the user information obtained from the contents of the questionnaire is acquired. The degree of reaction according to the user information is acquired, and an appropriate advertisement is distributed to each user.

The operation of Embodiment 2D will be described below.
First, a questionnaire input screen (not shown) set in advance is displayed on the input unit 13 of the terminal 10. The reaction information acquisition unit 4 of the terminal 10 acquires the input questionnaire contents. After the questionnaire contents are acquired, the processing from step S11 to step S15 in FIG. 4 is performed in the same manner as in the embodiment 2A. The reaction information acquisition unit 4 of the terminal 10 acquires information including the input comment, elapsed time, and questionnaire contents as reaction information (step S16 in FIG. 4) and transmits it to the server 20 (step S17 in FIG. 4). . The processing from step S18 to step S20 in FIG. 4 is performed in the same manner as in the embodiment 2A, and the weighting unit 23 of the server 20 weights the reaction degree (step S21 in FIG. 4), and measures the reaction degree as a numerical value (FIG. 4). 4 step S22).

  The degree of response varies depending on age, sex, number of visits, and the like. Specifically, not a single degree-of-reaction substitution table used when measuring numerical values in step S22 of FIG. 4, but a plurality of substitution tables according to the user such as age, sex, number of visits, etc. are set. For example, a reaction degree replacement table for women in their twenties and users who have visited once, and a reaction degree replacement table for users in their twenties and users who have visited twice to five times, respectively. Set it. Therefore, in step S22 of FIG. 4, based on the user information obtained from the acquired questionnaire content, the reaction degree is acquired as a numerical value from the target reaction degree replacement table.

  When the degree of response acquired as the numerical value exceeds a certain value, the advertisement instruction unit 25 of the server 20 acquires an advertisement according to the degree of excitement of the user (step S24 in FIG. 4), and displays the advertisement on the terminal 10 An instruction is given (step S25 in FIG. 4). The advertisement display unit 14 of the terminal 10 displays the advertisement (illustrated in FIG. 5B) (step S26 in FIG. 4). The processing from step S27 in FIG. 4 to step S31 in FIG. 4 is performed in the same manner as in the embodiment 2A.

  It is possible to obtain a more precise excitement degree by changing the reaction degree substitution table used for each user information obtained from the contents of the questionnaire. For example, when a man in his 80s is a target, even if a high excitement state can be read, it is difficult to connect with the desire to eat snacks, and for example, an advertisement display such as an alcoholic beverage or other food or drink is appropriate. In addition, it is expected that females in their 70s and males in their 20s will also have different input response speeds to the terminal. When using the reaction degree substitution table as shown in FIG. Thus, it is possible to acquire the degree of reaction corresponding to each user.

  The questionnaire content is not limited to age, gender, address, and number of visits. For example, if you are focusing on advertising food and drinks at the bicycle racetrack, enter the availability of drinking, the sweets, spicy party, etc. By doing so, it becomes possible to display an advertisement according to the user.

  Note that the configuration of Embodiment 2D is not limited to the method and / or configuration described above.

[Embodiment 3]
[Constitution]
In the first embodiment, it is possible to estimate the behavior / psychological state by weighting the user's degree of response to the video, and in the second and subsequent embodiments, the video intended by the administrator is embodied, and the video A specific example of measuring the user's reaction was explained. Although Embodiment 2 explained the example in the case of making the above-mentioned picture into the actual condition picture of the bicycle race at the bicycle racetrack, Embodiment 3 is an example in which the above-mentioned picture is made into the picture for performing the driving instruction on the bicycle. This will be described below with reference to FIGS.

The outline of the third embodiment will be described below.
In Embodiment 3, a smartphone and a VR (Virtual Reality) headset (hereinafter referred to as a terminal 10) are used as the video display device. A person who receives guidance (hereinafter referred to as a student) wears a VR headset with a smartphone on his head, and is used by a bicycle road driving leader (hereinafter referred to as a leader). An environment is provided in which a video display instruction can be given to the terminal 10 by the management terminal 60 (hereinafter, management terminal 60). The management terminal 60 is a smartphone, a mobile phone, a PC (Personal Computer), a tablet, or the like, and may be any device that can perform the function. The student views a video for instructing bicycle driving on the road, the terminal 10 detects the angle, acquires information including the angle as reaction information, and the server 20 describes the history of the reaction information and the elapsed time. It is possible to measure the degree of ability including attention and reaction speed as a numerical value by weighting the degree of response obtained based on

The device configuration of the third embodiment will be described below.
In FIG. 10, the information measuring apparatus 1 receives a terminal 10 owned by a plurality of students, a communication network 50 that connects the terminal 10 and the server 20, and receives various communications via the communication network 50. The server 20 that performs registration and management, the management terminal 60 that receives communication via the communication network 50 and manages the terminal 10, and the recording unit 40 that receives information from the server 20 are included.

  The terminal 10 includes a communication unit 11 that performs communication via the communication network 50, a control unit 12 that performs various controls, a reaction information acquisition unit 4 that acquires a student's reaction as reaction information, An elapsed time measuring unit 3 that measures the history of the elapsed time is provided.

  The server 20 weights the degree of reaction acquired from the communication unit 21 that performs communication via the communication network 50, the control unit 22 that performs various controls, the reaction information acquisition unit 4 and the elapsed time measurement unit 3 of the terminal 10. The weighting unit 23, the measuring unit 5 that measures the weighted reaction degree as a numerical value, and the reaction degree output unit 24 that outputs the user's reaction degree to the video based on the numerical value measured by the measuring unit 5 are provided.

  The recording unit 40 is used to record information received by the server 20.

  The management terminal 60 includes a communication unit 61 that performs communication via the communication network 50, a control unit 62 that performs various controls, an instruction unit 63 that performs various instructions to the terminal 10, and a reaction degree output unit 24 of the server 20. It has the result display part 64 which displays the output result.

  The device configuration is not limited to the above. For example, the server 20 may include the elapsed time measurement unit 3 and the reaction information acquisition unit 4 of the terminal 10.

Next, the operation of Embodiment 3 of the present invention will be described with reference to FIG.
First, the management terminal 60 transmits to the server 20 an instruction to the terminal 10 to display an image for instructing driving on a bicycle on the instruction unit 63 (step S41 in FIG. 11). The server 20 issues a video display instruction and an elapsed time measurement start instruction to the terminal 10 (step S42 in FIG. 11). In response to the instruction from the server 20, the terminal 10 starts displaying video on the video display unit 2, and starts measuring elapsed time on the elapsed time measuring unit 3 (step S43 in FIG. 11). The reaction information acquisition unit 4 of the terminal 10 detects an angle and acquires a predetermined body motion of the user as the reaction information (step S44 in FIG. 11). By checking the angle detection and the elapsed time, it is possible to acquire what and how the student was watching.

  Next, the terminal 10 transmits the reaction information acquired by the reaction information acquisition unit 4 and the elapsed time measured by the elapsed time measurement unit 3 to the server 20 (step S45 in FIG. 11).

  The measurement unit 5 of the server 20 weights the reaction degree based on the reaction information received in step S45 of FIG. 11 and the history of the elapsed time (step S46 of FIG. 11), and the history of the elapsed time and the reaction information Based on the reaction degree substitution table (shown in FIG. 13A), the reaction degree is substituted with a numerical value and measured (step S47 in FIG. 11).

  If the video for instructing on-the-bike driving has not ended (step S48 in FIG. 11), the processing from step S44 to step S47 is repeated. When the video is finished (No in step S48 in FIG. 11), the reaction degree output unit 24 of the server 20 outputs the measurement result (step S49 in FIG. 11), and transmits the measurement result to the management terminal 60 (step in FIG. 11). S50). The result display unit 64 of the management terminal 60 displays the received measurement result (step S51 in FIG. 11) and ends all the processes (step S53 in FIG. 11).

  Bicycles are familiar vehicles from a young age, and there is a need for early and easy bicycle driving education. However, bicycle driving skills tended to be neglected and there were very few opportunities to measure each person's ability level.

  According to the third embodiment of the present invention, it is possible to acquire what and how the student was watching from the history of the elapsed time and the response information of the student. By displaying video from the management terminal to multiple terminals at the same time and displaying the measurement results on the management terminal at the end of the video, the instructor can instantly determine the ability level including the attention and response speed of the student It becomes possible to grasp. In addition, by using a smartphone or tablet terminal, it is possible to easily carry out on-road driving guidance for a large number of people.

[Embodiment 3A]
[Constitution]
In the third embodiment, the server is configured to weight the reaction degree based on the elapsed time and the reaction information acquired from the terminal. However, in the embodiment 3A, a specific method for weighting the reaction degree and the acquired information are obtained. An example of a configuration for outputting a numerical value indicating the degree of reaction will be described below with reference to FIGS. 10 to 13. Other configurations are the same as those of the third embodiment.

An outline of the embodiment 3A will be described below.
In Embodiment 3A, weighting is applied to reaction information acquired based on the history and angle of the elapsed time of viewing a video for performing bicycle driving instruction, and the degree of reaction is regarded as an ability level. Explains how to measure the driving ability of a person.

The operation of Embodiment 3A will be described.
First, the management terminal 60 transmits to the server 20 an instruction to the terminal 10 to display an image for instructing driving on a bicycle on the instruction unit 63 (step S41 in FIG. 11). The server 20 issues a video display instruction and an elapsed time measurement start instruction to the terminal 10 (step S42 in FIG. 11). In response to the instruction from the server 20, the terminal 10 starts displaying video on the video display unit 2, and starts measuring elapsed time on the elapsed time measuring unit 3 (step S43 in FIG. 11). The reaction information acquisition unit 4 of the terminal 10 detects an angle and acquires a predetermined body motion of the user as the reaction information (step S44 in FIG. 11). By checking the angle detection and the elapsed time, it is possible to acquire what and how the student was watching. The reaction information acquisition unit 4 divides the elapsed time and acquires the reaction information for each of the divided time zones. In Embodiment 3A, a mode in which the elapsed time is divided will be described. However, reaction information may be acquired at any time or after the video ends without being divided.

  Next, the terminal 10 transmits the reaction information acquired by the reaction information acquisition unit 4 and the elapsed time measured by the elapsed time measurement unit 3 to the server 20 (step S45 in FIG. 11).

  The measurement unit 5 of the server 20 weights the reaction degree based on the reaction information received in step S45 of FIG. 11 and the history of the elapsed time (step S46 of FIG. 11), and the history of the elapsed time and the reaction information Based on the reaction degree substitution table (shown in FIG. 13A), the reaction degree is substituted with a numerical value and measured (step S47 in FIG. 11).

  If the video for instructing on-the-bike driving has not ended (step S48 in FIG. 11), the processing from step S44 to step S47 is repeated. When the video is finished (No in step S48 in FIG. 11), the reaction degree output unit 24 of the server 20 outputs the measurement result (step S49 in FIG. 11), and transmits the measurement result to the management terminal 60 (step in FIG. 11). S50). The result display unit 64 of the management terminal 60 displays the received measurement result (step S51 in FIG. 11) and ends all the processes (step S53 in FIG. 11).

  Next, an example of assigning different weights to the reaction degrees depending on the time zone obtained by dividing the elapsed time will be described below based on the reaction degree substitution table in FIG.

  The reaction degree substitution table (shown in FIG. 13A) shows a table for substituting the reaction degree with a numerical value as described above. The reaction degree substitution table needs to be set in advance in carrying out the embodiment 3A. As shown in FIG. 12, reaction information and a measured value are set as values.

  The reaction information is information including detection of an angle by a user's predetermined body movement, that is, a terminal. FIG. 12A is a table for assigning codes to the reaction information.

  In the present invention, the measured value is a value set according to what degree of response (or type of psychological state) is intended to be obtained. In the embodiment 3A, the user's ability level is measured. 12B is an example in which only “actual skill points” are set.

The reactivity degree substitution table will be described below with reference to FIG.
In the present invention, since the video is specified in advance, the time from the display start to the end can be specified.

  FIG. 13A shows an example in which the time from the start to the goal of the bicycle road driving instruction video is 5 minutes, and 5 minutes is divided into 10 and set at equal intervals of 30 seconds per division. The division unit may be equally spaced, or the time per division may be determined for each division unit to be unequal intervals.

  The elapsed time from the start to the goal is the horizontal axis, and the vertical axis is the reaction information code set in FIG. Using the elapsed time and the reaction information, a weighted numerical value of the reaction degree is acquired from the matrix of FIG.

  For example, when “look left and right” 40 seconds after the start, the value “X = 5” within the frame of 65A is acquired from the matrix in FIG. FIG. 13B shows this, and it can be seen that the value “X” in the frame contains “5” when referring to the frame 67A in FIG. 13C. As shown in the upper part of FIG. 13A, an intersection image is flowing. The intention is to place importance on whether the student is able to confirm the left and right sides when facing the intersection. That is, the degree of reaction is measured as a numerical value by weighting the degree of reaction acquired based on the reaction information according to the history of elapsed time. Since the present invention is applied to moving images rather than still images, the positions of the images such as “intersection, signal, pedestrian, car” shown in FIG. 13A are not fixed. Therefore, at the time of implementation of this embodiment, it is necessary to separately set coordinates in which the positions of “intersections, signals, pedestrians, cars” and the like are digitized along with the moving image.

  Further, “E” is always set to “−2” in the matrix of FIG. 13A. However, by “E = looking down”, points are deducted because the degree of driving danger increases. In the example of the students shown in FIGS. 13B and 13C, the user looks down from 4:00 to 29 minutes and is “−2” as shown in 67B.

  As described above, each numerical value is set as the actual skill point, and the total value of the actual skill points is output last. The measurement result of the practical skill point of the student shown in FIGS. 13B and 13C is “13” in the 67C frame. The output item of the measurement result may be “13” of the total value, or may be output for each check point such as “intersection, signal, pedestrian, car”, and the output method of the acquired information is any But you can.

  In any case, it is possible to measure the ability level including the bicycle driving skill of the student as a numerical value, and it becomes easier for the instructor to grasp the acquired part and the unacquired part of the student. Bicycle driving can be encouraged.

  The above embodiment 3A may be implemented in any way, but it is used to measure the proficiency level by conducting a lecture in advance, or by first viewing and measuring the degree of normal driving ability, It is possible to expect effects related to practical improvement rather than just knowledge by using it to grasp the weaknesses of the students by taking the lectures in combination with, or combining with lectures such as desktop learning.

  The configuration of Embodiment 3A is not limited to the method and / or configuration described above.

[Embodiment 3B]
[Constitution]
In Embodiments 3 to 3A, each reaction information is regarded as one reaction. However, in Embodiment 3B, an example of a structure including one or more reactions in each reaction information is described below with reference to FIG. explain.

  In Embodiments 3 to 3A, an angle is detected and information including the angle is acquired as reaction information. However, it is assumed that there is a width in the gaze range depending on the student, and the coordinates are exactly one. It is difficult to limit. Therefore, a method for setting a target range of attention in the reaction information will be described.

  For example, when an angle to be detected is within the range of 77A in FIG. 17 when facing a signal in an image, it is acquired as “view signal” reaction information. In the present embodiment, it is an image relating to bicycle road driving guidance, and when facing a signal, it is required to surely “see the signal”. Accordingly, the 77B range is set in addition to the 77A range, and the ability level including the attention of the student is further measured by changing the score for the same “watch the signal” response. Is possible. Accordingly, it is possible to set a plurality of gaze target ranges. When this item is represented by a reaction degree substitution table, 77A in FIG. 17 is used when assigning codes to reaction information in FIG. The code “A (view signal)” may be assigned to, and the code (A ′ (view signal (center))) may be assigned to 77B to obtain another reaction information.

  As described above, by weighting the gaze range as well, it is possible to grasp the quality of the action even for the same “watch signal” action. When combined with measurement values for measuring the quality and ability level of the action, it is possible to obtain a more detailed degree of response.

  Note that the configuration of Embodiment 3B is not limited to the method and / or configuration described above.

[Embodiment 3C]
[Constitution]
In the embodiment 3A, the weighting method for the reaction degree and the configuration that allows the use of the numerical value that represents the acquired reaction degree are used. However, in the embodiment 3C, the actual skill points that are acquired as numerical values can be compared. One example will be described below with reference to FIGS. Other configurations are the same as those of the embodiment 3A.

The operation of Embodiment 3C will be described below.
After the video display instruction of the instruction unit 63 of the management terminal 60 (step S41 in FIG. 11), the processing is performed from step S42 in FIG. 11 to step S51 in FIG. Thereafter, when the video is to be displayed again (Yes in step S52 in FIG. 11), the instruction unit 63 of the management terminal 60 issues the video display instruction again, and executes the processes in and after step S41 again. When the video is to be ended (No in step S52 in FIG. 11), the processing is ended.

  In step S47 to step S51 in FIG. 11, the measurement unit 5 of the server 20 outputs the measurement result obtained by measuring the reaction degree as a numerical value by the reaction degree output unit 24, and transmits the measurement result to the management terminal 60. The result display unit 64 displays the measurement result, and an example in which the skill level is output separately from the measurement result after viewing multiple times will be described below. The server 20 is configured to include a proficiency level determination unit 26.

  In step S49 of FIG. 11, the measurement result is output by the response level output unit 24 of the server 20, and if it is the first viewing, the process proceeds to step S50 as it is, but if it is the second and subsequent viewing, the server 20 The proficiency level determination unit 26 compares the measurement results of each time to determine the proficiency level. The determination of the proficiency level relates to the result of the road driving instruction of the bicycle. You may simply compare actual skill points, but for example, if you watched twice, whether or not the item you couldn't get actual skill points at the first time was obtained at the second time. It may be a comparison.

  The proficiency level determination unit 26 of the server 20 transmits the measurement result and the proficiency level determination result to the management terminal 60, and the result display unit 64 of the management terminal 60 displays the measurement result and the proficiency level determination result (step of FIG. 11). S51).

  In the present embodiment 3C, it is possible to deepen the understanding to the student by repeatedly viewing the road driving image of the bicycle. For example, it is possible to measure the driving skill of a normal student by attaching the headset to the student before the class such as desktop learning and executing the processing from step S41 to S51 in FIG. Thereafter, the instructor conducts a class such as desktop learning, causes the student to put on the headset again, causes the management terminal 60 to redisplay the video in step S52 of FIG. 11, and steps S41 to S51 of FIG. The process up to is executed again.

  Through the above processing, the measurement result and the proficiency level determination result for two times are displayed on the management terminal. This makes it easy for both the trainee and the instructor to grasp the point that does not improve even in the second time (the weakness of the trainee).

  FIGS. 13 (d) and (e) are tables relating to the degree of response when viewed for the second time. When (b) and (d) in FIG. It can be seen that the pedestrian was visually recognized when the pedestrian from 2 seconds to 29 seconds passed.

  However, since (d) in FIG. 13 looks down from 4:00 to 29:29, as in (b), the first action of “looking down” is not a coincidence. It is clear that this is a point that should draw attention to students. As described above, it is possible to use effectively by repeatedly viewing.

  In addition, about the said student's reaction degree, although the measurement result of both 1st time and 2nd time can be grasped | ascertained by comparing the enumeration of a numerical value, as above-mentioned, it is an item in the proficiency level determination part of the server 20 Alternatively, the comparison result may be displayed on the result display unit as the proficiency level determination result. In addition, when positioning the second viewing as a test, it may be determined whether or not it is acceptable. In any case, the proficiency level determination result may be any as long as it can be output by the proficiency level determination unit 26 based on the information of the measurement results of each time. It is only necessary to define what and how to determine, and how to output the determination result (graph, score, pass / fail, etc.).

  The proficiency level determination unit 26 has been described as the configuration for determining the proficiency level from comparison of each time when viewing multiple times. However, the proficiency level determination unit 26 performs a driving course on a bicycle first and then tests the proficiency level. It is assumed that the proficiency level may be determined using the proficiency level determination unit 26 even when only viewing is performed. As described above, it is only necessary to define the determination result output method (graph, score, pass / fail, etc.) even for one-time viewing.

  Note that the configuration of Embodiment 3C is not limited to the method and / or configuration described above.

[Embodiment 3D]
[Constitution]
In Embodiment 3A, the measurement values used in the reaction degree substitution table are configured as practical points. However, the reaction degree substitution table in Embodiment 3D is configured to include one or more measurement values for each degree of reaction. An example configuration for visualizing from the numerical value substituted by the reactivity degree substitution table by any one or more display methods such as points, graphs, and the like will be described below with reference to FIGS. 14 and 15. Other configurations are the same as those of the embodiment 3A.

  As described above, the measured value is a value set depending on what kind of response (or type of psychological state) is to be obtained in the present invention. In Embodiments 3 to 3B, practical skill points are assigned to the measurement values for the purpose of acquiring a capability level. However, in Embodiment 3D, the ability required for driving skills is subdivided and acquired. use.

  As shown in FIG. 14B, a plurality of items are assigned to the measurement values in the embodiment 3D, and the matrix in FIG. 15A includes a plurality of measurement values for each degree of reaction. The matrix in FIG. 15A is a reaction degree substitution table used when the measurement unit 5 of the server 20 measures the reaction degree as a numerical value in step S47 in FIG.

  For example, when “see the signal” between 1 minute 30 seconds and 1 minute 59 seconds from the start, numerical values “5” are measured for the measured value “X” and “5” are measured for “Z”. That is, “attentiveness” and “settlement” are recognized when the signal is visually recognized when facing the signal.

  In addition, when “seeing a pedestrian” between 2 minutes 00 seconds and 2 minutes 29 seconds from the start, numerical values “5” are measured for the measured value “X” and “10” are measured for “Y”. That is, “attentiveness” and “reaction speed” are recognized because the pedestrian can be visually recognized when facing the pedestrian (moving one).

  In FIG.15 (c), the total value of each measured value is output and the total value is represented on the radar chart of FIG.15 (d).

The output of the radar chart will be described below with reference to FIGS.
In step S47 of FIG. 11, the measurement unit 5 of the server 20 measures the reaction degree as a numerical value, and in step S49, the reaction degree output unit 24 outputs the measurement result. The degree-of-reaction output unit 24 may output the numerical value received from the measurement unit 5 as it is, or process the numerical value and output it in any one or more display methods such as points, graphs, and the like. Also good. In the embodiment 3D, the reaction degree output unit 24 outputs the measurement result as a radar chart and transmits a measurement result display instruction to the management terminal 60.

  In Embodiment 3A, the measurement was performed as a single technical score, and the result was acquired. However, in Embodiment 3D, by setting a plurality of measurement values, one response of the student was captured from multiple perspectives. It became possible to measure the degree of ability. In FIG. 14B, three items of “attention, reaction speed, and calmness” are set for the measured value. However, if the measured value is increased, a complicated ability level can be measured accordingly. It becomes possible.

  Furthermore, as shown in FIG. 15 (d), by outputting the measurement results as a radar chart, the instructor can visually grasp the driving skill, ability level, and / or proficiency level of the student. It became. In FIG. 15D, the data is output using a radar chart. However, any form may be used as long as the degree of response of the student can be grasped.

[Embodiment 3E]
[Constitution]
In the embodiment 3D, a plurality of measurement values are set and the measurement result is displayed in a graph. However, in the embodiment 3E, a predetermined duration of physical movement and / or a repetition interval time is acquired as reaction information. An example of the configuration will be described below with reference to FIGS. The duration of the body motion is a gaze time, and the repetition interval time is a distinction between an act of watching twice with a short interval of time or an action of watching twice in an instant such as twice. Other configurations are the same as those of the embodiment 3C.

  In the matrix of FIG. 16A, an example in the case where the duration time is acquired is shown. FIG. 12 is used for reaction information and measurement value codes. In FIG. 16 (a), the elapsed time is divided and the reaction information is acquired for each divided time zone, and the division unit is set at unequal intervals. Also good.

  The duration will be described below. In the present embodiment, it is assumed that the gaze range of Embodiment 3B is set.

  In the present embodiment, the duration is the time during which the user continuously gazes within the set gaze range. The server 20 acquires the reaction information acquired from the reaction information acquisition unit 4 of the terminal 10 and the time when the elapsed time measurement unit 3 detects the reaction information (step S45 in FIG. 11) and is within the set gaze range. Determine whether or not.

  In addition, since the said reaction information is acquired for every divided | segmented time slot | zone, when it is set as 1 division | segmentation 30 seconds, for example, and angle information is acquired per 1 second, the said reaction information is 30 pieces of angle information. Will have.

  When the angle of the reaction information is outside the set gaze range, it is not determined as an action such as “see signal” or “view left and right”, and the response information code set in FIG. Since it is not assigned, the process proceeds to check whether the next angle is within or outside the set gaze range. The “next angle” described here means that when the reaction information is composed of 30 pieces of angle information, for example, when the confirmation of the angle information of the reaction information acquired first out of 30 pieces is completed, 2 The process proceeds to the confirmation of the angle information of the reaction information acquired second, which means the angle information of the second reaction information. When the angle of the reaction information is within the gaze range, it is confirmed whether or not the next angle is also within the set gaze range. The angles are compared until the end (all 30 angles have been confirmed).

  The above-mentioned confirmation of whether the angle included in the reaction information is within the set gaze range is performed sequentially from the earliest measurement time associated with the angle included in the reaction information acquired by the server 20. To do. For example, when there is an angle of 5: 1: 1 seconds, an angle of 5: 1: 1, 5 seconds, an angle of 5: 1: 1, 3 seconds,..., Processing is performed in order from the angle of 5: 1: 1.

  If all the angles of the acquired reaction information are outside the set gaze range, the process proceeds to step S48 without performing steps S46 to S47 in FIG. 11, and if the video is being displayed, the next division is performed. Get reaction information for each time period.

  When the outside of the gaze range or the acquired reaction information is completed (when all 30 angles have been confirmed), the time during which the gaze range is continuously watched is acquired. The gaze time may be acquired by comparing the time associated with the angle within the gaze range and the time associated with the angle immediately before the gaze range, or may be obtained in any manner.

  In addition, it is necessary to set a repetition interval time for distinguishing the repetition interval time. For example, when the repetition interval time is less than 0.3 seconds, it is set to look twice. In the acquisition of the duration time, the time stayed within the set gaze range is set, but the repeat interval time is the interval between the time when the angle that is within the set gaze range is once outside the gaze range and again within the gaze range. get. The acquisition of the repetition interval time may be performed by applying the method for acquiring the duration time.

  In addition, although the said reaction information divided | segmented elapsed time and was demonstrated as a structure which acquires the said reaction information for every said divided | segmented time slot | zone, it is good also as a structure which acquires reaction information at any time, without dividing elapsed time. . Further, the acquisition method of the duration (gazing time) and / or the repetition interval time is not limited to the above-described configuration and method as long as the duration (gazing time) and / or the repetition interval time can be acquired.

  For example, in 74A of FIG. 16A, when “looking at the signal” facing the signal, “5” is “X” when the gaze time is less than 1 second, and “10” is “X” when it is 1 second or longer. Is measured. Although the signal is confirmed in less than 1 second, “5” is set because the signal confirmation time is short. The elapsed time is divided along the timing at which the signal appears. For example, 0.5 seconds (1 second in total) before and after the timing of switching from red to blue may be used as one division unit. In that case, it is possible to more accurately determine whether or not the student was watching the signal.

  Further, the time division of T3 of 74B in FIG. 16A is set to 0.5 second from 1 second before the signal switching timing, and the time division of T5 of 74C is changed from 0.5 second to 1 after the signal switching timing. When it is detected that the signal has been visually recognized before and after switching, the signal is normally confirmed, and the same (or different) numerical value as in the frame of 74A is measured. Also good. In this case, it is necessary to set a separate combination condition at the time of implementation. For example, in the case described above, the condition setting may be such that when both 74B and 74C detect reaction information indicating “view signal”, a numerical value is set with reference to the frame of 74A.

  Further, as shown in the 74D frame, the duration is not set in the case of “looking left and right”. This is because, in Embodiment 3E, the duration of the act of looking left and right is not emphasized, and it is only necessary to be able to detect left and right information within the division unit. In the case where importance is attached at the time of implementation, the duration time may be set separately.

  As shown in the frame of 74E, points are deducted when “look down” for 0.5 seconds or longer. In the embodiment 3E, a case where the head is merely tilted for a moment is also assumed, and the setting of not being included in the reaction of “looking down” is performed in less than 0.5 seconds.

  FIG. 16 (b) shows the response information of a student, but when looking inside the frame of 75A, since the signal was seen for 3 seconds, as shown in 76A of FIG. “10” is measured. In the frame of 75B, the act of “seeing a pedestrian” for 0.3 seconds is repeated twice. By repeating the actual skill point “5” twice, “10” is measured as shown in 76B. This is because the power of attention to the pedestrian can be enhanced even when viewed twice, so the same number of values is measured when the pedestrian is viewed for more than 1 second and when it is viewed less than 1 second but twice.

  As shown in embodiment 3E, it is possible to set duration and / or repetition interval time. In FIG. 16 (a), in order to clearly set the duration time and / or the repetition interval time, the measurement value has been described as only the practical point. However, a plurality of measurement values are set, and the duration time and / or the repetition interval time are set. By combining, it becomes possible to acquire a more detailed degree of reaction.

  In the embodiment 3E, the reaction information including the duration time is mainly weighted. However, in general, the instruction video (teaching video) tends to be distracted in the second half, and therefore, on the bicycle road. When the driving instruction video is long, the elapsed time may be weighted, for example, by setting a large number in the second half even in the same “seeing pedestrian” action.

  As described above, by setting the time division unit, obtaining the duration and / or repetition interval time, and setting various weights, the student's degree of response, that is, the ability level and the proficiency level are grasped in detail. It became possible to do.

  Note that the configuration of Embodiment 3E is not limited to the method and / or configuration described above.

  The present invention can be embodied in many forms without departing from its essential characteristics. Therefore, it is needless to say that the above-described embodiment is exclusively for description and does not limit the present invention.

DESCRIPTION OF SYMBOLS 1 Information measuring device 2 Image | video display part 3 Elapsed time measurement part 4 Reaction information acquisition part 5 Measurement part 10 Terminal 11 Communication part 12 Control part 13 Input part 14 Advertisement display part 20 Server 21 Communication part 22 Control part 23 Weighting part 24 Reaction degree Output unit 25 Advertisement instruction unit 26 Proficiency determination unit 30 Screen 31 Communication unit 32 Control unit 33 Output unit 34 Display unit 40 Recording unit 50 Communication network 60 Management terminal 61 Communication unit 62 Control unit 63 Instruction unit 64 Result display unit

Claims (11)

An information measuring device for measuring a user's reaction to an image,
A video display unit for displaying the video;
An elapsed time measuring unit that measures an elapsed time from the start of display of the video;
A reaction information acquisition unit for acquiring reaction information of the user with respect to the video;
Weighting the reaction degree acquired based on the reaction information along with the history of the elapsed time, and measuring the reaction degree as a numerical value,
An information measuring device comprising:   The information measuring apparatus according to claim 1, wherein the measurement unit replaces the reaction degree with a numerical value based on a reaction degree substitution table based on the history of the elapsed time and the reaction information.   The information measurement apparatus according to claim 1, wherein the reaction information acquisition unit divides the elapsed time and acquires the reaction information for each of the divided time zones.   The information measuring device according to claim 2, wherein the measurement unit weights the reaction degree differently according to a time zone obtained by dividing the elapsed time.   3. The information measuring apparatus according to claim 2, wherein the reaction degree substitution table includes one or more measurement values for each reaction degree.   The information measurement apparatus according to claim 1, wherein the reaction information acquisition unit acquires a predetermined body motion of the user as the reaction information.   The information measurement apparatus according to claim 6, wherein the reaction information acquisition unit acquires the predetermined duration and / or repetition interval time of the body movement as the reaction information.   The information measurement apparatus according to claim 1, further comprising: a reaction degree output unit that outputs a user reaction degree with respect to the video based on the numerical value measured by the measurement unit.   The information measurement apparatus according to claim 8, wherein the reaction degree output unit visualizes the reaction degree from the numerical value by any one or more display forms such as a score, a graph, and the like. An information measurement method for measuring a user's reaction to an image,
Displaying the video;
Measuring an elapsed time from the start of display of the video;
Obtaining reaction information of the user for the video;
Weighting the reaction degree acquired based on the reaction information with the history of the elapsed time, and measuring the reaction degree as a numerical value;
An information measurement method comprising: An information measurement program for measuring a user's response to an image,
On the computer,
A function of displaying the video;
A function of measuring an elapsed time from the start of display of the video;
A function of obtaining reaction information of the user with respect to the video;
A function of measuring the reaction degree as a numerical value by weighting the reaction degree acquired based on the reaction information according to the history of the elapsed time;
An information measurement program characterized by causing

Images