JP7040599B2 - Viewing support device, viewing support method and program - Google Patents

Description

(Description of related applications)
The present invention is based on the priority claim of Japanese patent application: Japanese Patent Application No. 2018-045582 (filed on March 13, 2018), and all the contents of the application are incorporated in this document by citation. It shall be.
The present invention relates to a viewing support device, a viewing support method, and a program.

Patent Document 1 discloses an example of a moving body identification device that associates a plurality of moving bodies with a moving image of a plurality of moving bodies. Further, Patent Document 2 discloses a configuration including a portable information recognition device that recognizes the identification information of the moving body obtained by photographing the moving body and searches from the identification information registered in advance. Further, in Patent Document 2, page 13, line 8 and below, image pickup devices are placed in various parts of the track in athletics track competition, the bib number is read from the still image of the athlete, and the split of each athlete is accompanied by a video for general households. The configuration for delivering time is disclosed.

Further, Non-Patent Document 1 discloses a system for estimating the distance between runners in a road race relay such as a relay road race or a marathon. In addition, the distance estimation system of the same document estimates the distance between the camera and the runner from the position of the relay vehicle, camera data, and the runner coordinates (position of the subject in the frame) in the image, and from the change between the frames of the runner position. It is stated that the speed of the runner can be determined (see FIG. 1).

Japanese Unexamined Patent Publication No. 2018-005474 International Publication No. 2003/034278

"Road Race Relay Distance Estimating System", Kenrokukan Publishing, "Broadcasting Technology", Vol. 69, May 2016, pp.101-105

The following analysis is given by the present invention. The method described in the background technique described above has a problem that the speed of the athlete at any time cannot be estimated.

Further, in the method of Non-Patent Document 1, the speed of the runner at an arbitrary time point can be estimated, but it is a condition that the position of the relay vehicle and the camera data can be obtained in real time.

The present invention is a viewing support device, a viewing support method, and a viewing support method that can contribute to the enrichment of configurations that can be provided as incidental information of a video by measuring a moving body and its speed projected on a relay video even if the above information cannot be obtained. The purpose is to provide a program.

According to the first viewpoint, a means for cutting out an image on which the moving object is projected is provided at a predetermined time interval from a relay image having a moving object moving from the first point to the second point as a subject. A viewing support device is provided. The viewing support device further includes means for estimating the speed of the moving body based on the change in the background image of the image on which the moving body is projected, and means for outputting the estimated speed of the moving body. ..

According to the second viewpoint, an image in which the plurality of moving objects are projected at predetermined time intervals from a relay image in which a plurality of moving objects moving from the first point to the second point are the subjects. A means for cutting out, a means for estimating the distance difference of the moving body based on a change in the background image of the image on which the plurality of moving bodies are projected, and a means for outputting the distance difference of the plurality of moving bodies. A equipped viewing support device is provided.

According to the third viewpoint, a step of cutting out an image on which the moving object is projected at a predetermined time interval from a relay image of a moving object moving from the first point to the second point as a subject. A viewing support method including a step of estimating the speed of the moving body and a step of outputting the estimated speed of the moving body based on a change in the background image of the image on which the moving body is projected is provided. This method is linked to a specific machine, which is a computer that takes at least a relay image as an input, performs image analysis, and outputs incidental information.

According to the fourth viewpoint, the moving object is displayed on the computer constituting the viewing support device at predetermined time intervals from the relay image of the moving object moving from the first point to the second point as a subject. Based on the process of cutting out the projected image, the process of estimating the speed of the moving body based on the change in the background image of the projected image of the moving body, and the process of estimating the speed of the moving body, and the image of the moving body projected on the image. Further, a program for executing a process of specifying the moving body and a process of outputting the information of the specified moving body and the estimated speed thereof is provided. Note that this program can be recorded on a computer-readable (non-transitional) storage medium. That is, the present invention can also be embodied as a computer program product. Further, this program is input to a computer device from an input device or an external communication interface, stored in a storage device, drives a processor according to a predetermined step or process, and processes the result including an intermediate state as necessary. Can be displayed step by step via a display device, or can communicate with the outside via a communication interface. Computer devices for that purpose typically include, for example, a processor, a storage device, an input device, a communication interface, and, if necessary, a display device that can be connected to each other by a bus.

According to the present invention, it is possible to estimate the speed of a moving body at an arbitrary time point. That is, the present invention converts the viewing support device described in the background technology into a device capable of providing speed information of a moving object as a subject.

It is a figure which shows the structure of one Embodiment of this invention. It is a figure which shows the whole structure of the 1st Embodiment of this invention. It is a figure which shows the structure of the viewing support device of 1st Embodiment of this invention. It is a figure which shows an example of the information held in the runner information database of the viewing support apparatus of 1st Embodiment of this invention. It is a figure which shows an example of the information provision form by the viewing support device of 1st Embodiment of this invention. It is a figure which shows another example of the information provision form by the viewing support device of 1st Embodiment of this invention. It is a figure which shows the structure of the viewing support device of the 2nd Embodiment of this Akira. It is a figure which shows an example of the information provision form by the viewing support device of the 2nd Embodiment of this invention. It is a figure which shows the structure of the viewing support device of the 3rd Embodiment of this invention. It is a figure which shows an example of the information held in the reference background image database of the viewing support apparatus of the 3rd Embodiment of this invention. It is a figure which represented typically the relay image cut out by the viewing support apparatus of the 3rd Embodiment of this invention. It is a figure for demonstrating the principle of locating a runner by the viewing support apparatus of 3rd Embodiment of this invention. It is a figure which shows the structure of the computer which comprises the viewing support device of this invention. It is a figure which shows the modified structure of one Embodiment of this invention. It is a figure which shows the modified structure of the viewing support device of 1st Embodiment of this invention. It is a figure which shows another example of the information provision form by the viewing support device of 1st Embodiment of this invention. It is a figure which shows another example of the information provision form by the viewing support device of 1st Embodiment of this invention.

First, an outline of one embodiment of the present invention will be described with reference to the drawings. It should be noted that the drawing reference reference numerals added to this outline are added to each element for convenience as an example for assisting understanding, and the present invention is not intended to be limited to the illustrated embodiment. Further, the connecting line between blocks such as drawings referred to in the following description includes both bidirectional and unidirectional. The one-way arrow schematically shows the flow of the main signal (data), and does not exclude bidirectionality. Further, although there are ports or interfaces at the input / output connection points of each block in the figure, they are not shown. Also, the program is executed via a computer device, which includes, for example, a processor, a storage device, an input device, a communication interface, and a display device as needed. Further, the computer device is configured to be able to communicate with a device inside or outside the device (including a computer) via a communication interface regardless of whether it is wired or wireless.

In one embodiment of the present invention, as shown in FIG. 1, the present invention can be realized by a viewing support device 10 including an image cutting unit 11, a speed estimation unit 12, and an output unit 14.

More specifically, the image cutting unit 11 displays an image on which the moving object is projected at predetermined time intervals from a relay image whose subject is a moving object moving from the first point to the second point. It functions as a means of cutting out.

The speed estimation unit 12 functions as a means for estimating the speed of the moving body based on the change in the background image of the image on which the moving body is projected.

The output unit 14 functions as a means for outputting the estimated speed of the moving body. According to the output unit 14, various output forms of the estimated speed of the moving body can be considered. For example, the estimated speed of the moving object may be displayed as the information to be superimposed and displayed (superimposed) on the relay image. Further, for example, the estimated speed of the moving body may be displayed as information to be displayed in a sub-region different from the relay image. Further, the estimated speed of the moving object may be displayed as the information to be displayed by the website or the application program for knowing the contents of the relay video in more detail.

As described above, according to the present embodiment, it is possible to measure the moving body and its speed projected on the relay video and provide it as incidental information of the video.

Further, in another embodiment, the present invention can be configured as a viewing support device that estimates and outputs a distance difference between a plurality of moving objects instead of the estimated speed or in combination with the estimated speed. (See FIG. 14). In the example of FIG. 14, a distance difference estimation unit 18 is provided instead of the speed estimation unit 12 described above. Then, in this embodiment, the image cutting unit 11 is the plurality of moving objects at predetermined time intervals from the relay image in which the plurality of moving objects moving from the first point to the second point are the subjects. Performs the process of cutting out the projected image. Then, the distance difference estimation unit 18 estimates the distance difference between the moving bodies based on the change in the background image of the image on which the plurality of moving bodies are projected. Then, the output unit 14 outputs the distance difference between the plurality of moving bodies.

As described above, according to the present embodiment, it is possible to measure the distance difference between a plurality of moving objects projected on the relay video and provide it as incidental information of the video.

[First Embodiment]
Subsequently, the first embodiment of the present invention will be described in detail with reference to the drawings. FIG. 2 is a diagram showing the overall configuration of the first embodiment of the present invention. Referring to FIG. 2, a configuration in which a camera 200 mounted on a relay vehicle that relays a road race or the like, a viewing support device 100, and a television receiver 300 that is an output destination of information of the viewing support device 100 are connected. It is shown.

The camera 200 transmits the captured relay video to the viewing support device 100. The data transfer between the camera 200 and the viewing support device 100 may be a wired method, a wireless method, or a physical medium transfer method such as a magnetic tape.

The viewing support device 100 is arranged in a broadcasting station, a video distribution company, or the like in a desirable form. The viewing support device 100 is not limited to a broadcasting station, a video distribution company, or the like, and may be arranged, for example, in a relay vehicle or on the television receiver side. Further, the viewing support device 100 may be arranged on the Internet or a cloud platform.

The television receiver 300 is an output destination of information obtained by the viewing support device 100 in addition to the relay image. The output destination of the information obtained by the viewing support device 100 may be any device that can display the relay image and its incidental information, and a device other than the television receiver 300 may be used. For example, a PC (personal computer), a tablet terminal, a smartphone or other device capable of playing a moving image via the Internet can be used instead of the television receiver 300.

FIG. 3 is a diagram showing a configuration of a viewing support device according to the first embodiment of the present invention. Referring to FIG. 3, a configuration including an image cutting unit 110, a speed estimation unit 120, a moving object specifying unit 130, an output unit 140, and a runner information DB (database) 150 is shown.

The image cutting unit 110 cuts out an image for specifying the position of the runner from the relay video and sends it to the speed estimation unit 120 and the moving object specifying unit 130. In the present embodiment, the image cutting unit 110 cuts out an image at the timing when the foot of the runner, which is the subject in the relay video, touches the ground. The reason why the timing of cutting out the image is the timing when the runner's foot reaches the ground is that the positional relationship between the runner and the background image can be appropriately specified, and the speed estimation accuracy is improved. In the present embodiment, the expression "cut out the image" is used, but in reality, a frame in which the runner's foot is on the ground may be selected from the frames constituting the relay video.

The moving body specifying unit 130 refers to the information stored in the runner information DB 150, identifies the runner from the face image and the bib of the runner, which is the subject of the relay video, and outputs the result to the output unit 140. When a face image is used to identify the runner, a method of specifying a runner having a feature amount similar to the face image registered in advance can be used by using AI (Artificial Integrity).

FIG. 4 is a diagram showing an example of information held in the runner information DB 150. In the example of FIG. 4, the runner information in which the bib and the player name are associated with each other is stored. The moving body specifying unit 130 recognizes a bib from the image sent from the image cutting unit 110, reads out the runner name corresponding to the bib, and sends it to the output unit 140. In the example of FIG. 4, information is shown when the runner is identified by the bib. For example, when the runner is identified from the face image, the runner's face taken in advance is taken instead of the bib. The image is registered. In addition to the example of FIG. 4, for example, profile information such as the team to which each runner belongs, age, and past winning history may be registered in the runner information DB 150.

The speed estimation unit 120 estimates the speed of the runner from the change in the background image of the runner who is the subject of the relay image, and outputs the result to the output unit 140.

An example of the above speed estimation method is as follows. The speed estimation unit 120 determines the movement amount of the camera 200 and the runner from the difference information of a plurality of consecutive frames cut out by the image cutout unit 110, the position of the horizon and the ground surface included in the background image in the image, and the runner's foot. By estimating the ground contact position, the relative distance between the camera 200 and the runner is estimated. At the same time, the speed estimation unit 120 estimates the moving distance of the camera 200 (relay vehicle) by the same method. Next, the speed estimation unit 120 calculates the relative speed of the runner (speed seen from the camera 200) from the frame rate of the frame cut out by the image cutting unit 110 and the change in the relative distance. At the same time, the speed estimation unit 120 estimates the moving speed of the camera 200 (relay vehicle) by the same method. Finally, the speed estimation unit 120 calculates the moving speed of the runner by adding up the relative speed of the runner and the moving speed of the camera 200 (relay vehicle).

The output unit 140 provides the viewer with the runner information received from the mobile object specifying unit 130 and the estimated speed of the runner received from the speed estimation unit 120 in association with each other. FIG. 5 is an example of the form of providing information by the output unit 140, and in the example of FIG. 5, the runner's information (player name) and the estimated speed are displayed in a form of being superimposed on the relay video. This allows the viewer to obtain information such as how fast the runner is currently running, as well as whether the pace is slowing down or, conversely, the pitch is rising.

The information of the runner and the output form of the estimated speed are not limited to the example shown in FIG. For example, as shown in the boxes 400a and 400b of FIG. 6, it is also possible to specify the runner information for each of the plurality of runners projected on the image and to obtain and display the estimated speed of each runner. This allows the viewer to grasp the speed difference of each runner. Further, for example, a form in which the list of the specified runners and the estimated speed of each runner are collectively displayed in a sub-area different from the display area of the relay video can be adopted.

In the above embodiment, the image cut out from the image cutting unit 110 is sent to the moving body specifying unit 130, but the timing of transmitting the image to the moving body specifying unit 130 is not limited to this. For example, the moving body specifying unit 130 may acquire an image at an appropriate timing such as scene switching, and may specify the runner from the relay video or the frame image thereof independently of the speed estimation. This is because once the runner's information is specified, there is basically no need to change it.

For example, even in comparison with Patent Document 1, the present invention has an advantage that it is not necessary for a moving athlete or the like to wear a measuring device such as an acceleration sensor. Further, in comparison with Patent Document 2, the present invention has an advantage that it is not necessary to arrange the image pickup apparatus in various places of the predetermined course.

Further, the viewing support device of the present embodiment can also be provided with a function of displaying a distance difference between a plurality of moving objects, that is, a distance difference between a plurality of runners. FIG. 15 is a diagram showing a modified configuration of the viewing support device 100c according to the first embodiment of the present invention. The difference from the configuration of FIG. 3 is that a distance difference estimation unit 180 is added between the speed estimation unit 120 and the output unit 140.

The distance difference estimation unit 180 estimates the distance difference between a plurality of runners by using the position information of the runners calculated in the process of speed estimation by the speed estimation unit 120. Then, the distance difference estimation unit 180 outputs the estimated distance difference between the plurality of runners to the output unit 140. Then, the output unit 140 provides the viewer with a distance difference between the plurality of runners in addition to the estimated speed of the runners.

According to the modified configuration shown in FIG. 15, as shown in FIG. 16, a bidirectional arrow between runners and an estimated distance difference can be displayed. As a result, the viewer can make predictions such as "it seems to catch up in a few minutes" or "cannot catch up at this pace" by referring to each distance difference and speed difference between the plurality of runners.

Further, in a more desirable form, when the past record time or the like is recorded, the virtual runner who put out the record time can be displayed from the record time by using AR (Augmented Reality) technology. can. The runner represented by the broken line in front of the number 11 in FIG. 17 is an image of a virtual record time holder displayed using AR technology. In the example of FIG. 17, the distance difference between the virtual record time holder and the actual runner is displayed. As a result, the viewer can make predictions such as "the record time is likely to be updated" and "the record time cannot be updated at this pace" by referring to each distance difference and speed difference.

[Second Embodiment]
Subsequently, the second embodiment of the present invention to which the function of determining the facial expression of the runner and displaying it as incidental information will be described in detail with reference to the drawings. FIG. 7 is a diagram showing a configuration of a viewing support device according to a second embodiment of the present invention. The difference from the viewing support device 100 of the first embodiment shown in FIG. 3 is that the facial expression determination unit 170 is added to the lower stage of the mobile body identification unit 130. Since other configurations and operations are the same as those of the first embodiment, the differences will be mainly described below.

When the facial expression determination unit 170 receives the relay image from the image cutting unit 110 via the moving body identification unit 130, the facial expression determination unit 170 identifies the runner's face image from the image, determines the facial expression, and outputs the result to the output unit 140. do. Various methods can be adopted as the facial expression determination method in the facial expression determination unit 170. For example, a method of determining a facial expression can be adopted by using the change and the amount of movement of each organ of the runner's face. Further, the facial expression may be determined not only from the facial expression but also from the gesture of the runner. For example, even if the runner's face itself is expressionless, if the face continues to sway from side to side, the runner may be determined to have a “painful facial expression”. Further, the teacher data for each facial expression may be registered in advance, and the facial expression may be determined by comparing with the facial expression of the runner.

The output unit 140 provides the viewer with the runner information received from the moving object specifying unit 130, the estimated speed of the runner received from the speed estimation unit 120, and the facial expression of the runner received from the facial expression determination unit 170. FIG. 8 is an example of an information provision form by the output unit 140. The difference from the first embodiment shown in FIG. 6 is that an icon indicating the facial expression of the runner is added in the boxes 400a and 400b. This allows the viewer to infer the state from the facial expressions of each runner. For example, in the case of FIG. 8, the facial expression of the runner A on the front side of the screen can be grasped from the relay image, but the facial expression of the runner B on the back side of the screen has a small face or the camera is out of focus. For some reason, it may not be possible to grasp directly from the live video. According to the present embodiment, it is possible to convey the facial expression of the runner to the viewer even in such a case.

As described above, according to the present embodiment, it is possible to convey the facial expression of the runner to the viewer in addition to the information of the runner and the estimated speed.

[Third Embodiment]
Subsequently, a third embodiment of the present invention in which the method of estimating the speed of the runner is modified will be described in detail with reference to the drawings. FIG. 9 is a diagram showing the configuration of the viewing support device 100b according to the third embodiment of the present invention. The difference from the viewing support device 100 of the first embodiment shown in FIG. 3 is that the speed estimation unit 120 is replaced with the speed estimation unit 120b and the reference background image database (reference background image DB) 160 is added. Is. Since other configurations and operations are the same as those of the first embodiment, the differences will be mainly described below.

The speed estimation unit 120b of the present embodiment estimates the speed of the runner from the change in the background image of the runner, which is the subject of the relay image, with reference to the information stored in the reference background image DB 160, and outputs the result to the output unit 140. Output to.

FIG. 10 is a diagram showing an example of information held in the reference background image DB 160. In the example of FIG. 10, information in which a reference background image for specifying the position of the runner and a point corresponding to the image (distance from the start point) are stored is stored. Upon receiving the image (for example, FIG. 11) sent from the image cutting unit 110, the speed estimation unit 120b extracts a background image (see FIG. 12). Then, the speed estimation unit 120b specifies from the reference background image DB 160 a point associated with the reference background image having a feature amount common to the feature amount of the background image as a runner's position. By repeating the above processing, for example, the runner position at time t1 and the runner position at time t + 1 shown in FIG. 11 can be specified, and the speed (estimated travel distance / (t2-t1)) can be estimated. The image sent from the image cutting unit 110 and the image held in the reference background image DB 160 are preferably cut out at the timing when the runner's foot touches the ground, as in the first embodiment.

As the reference background image, the background image of the model moving body included in the captured image when the model moving body moves along the moving path of the moving body can be used. Further, as the background image of this model moving body, an image cut out from the video of the same tournament held in the past can also be used.

According to this embodiment, there is an advantage that the speed of the runner can be estimated without using the speed of the camera 200 (relay vehicle).

Although each embodiment of the present invention has been described above, the present invention is not limited to the above-described embodiment, and further modifications, substitutions, and adjustments are made without departing from the basic technical idea of the present invention. Can be added. For example, the network configuration, the configuration of each element, and the expression form of the message shown in each drawing are examples for facilitating the understanding of the present invention, and are not limited to the configurations shown in these drawings. Further, in the following description, "A and / or B" is used to mean at least one of A and B.

For example, in the above-described embodiment, the relay video is reproduced by the television receiver via the viewing support device 100, but the form of the viewing support device 100 is not limited to this. For example, the viewing support device 100 may be made to estimate the speed of the subject and provide the estimated speed for the relay video distributed by the video distribution company or the like via the Internet. In this case, the destination of the speed information and the like provided by the viewing support device 100 is a PC (personal computer), a tablet terminal, a smartphone, or other device capable of playing a moving image via the Internet. Of course, television receivers with internet connectivity are also included in these devices.

Further, in the above-described embodiment, the subject is specified and the speed of the subject is estimated mainly by using the image cut out from the relay video, but the estimated speed is estimated by using other auxiliary information. A configuration that corrects or eliminates errors can also be adopted. For example, when the speed information of the relay vehicle is obtained, it is possible to verify whether or not the estimated speed of the subject is correct by using the information. In addition, depending on the competition, it may be obligatory to attach RFID tags or chips to the body or wear of runners or the like. Information obtained from these RFID tags and chips can also be used to identify runners and verify their estimated speeds.

For example, in the above-described embodiment, an example of providing runner information and an estimated speed thereof from a relay video of a road race has been described, but the scope of application of the present invention is not limited to this, and a relay video can be obtained. It can be applied to all competitions. For example, even in the training of track and field athletes, it is possible to measure the speed distance in real time from the image taken by the camera and utilize it for training. In addition to general track events, it can also be applied to speed estimation of subjects in relay images such as bicycle races, horse races, car races, and swimming.

In addition to competitive competitions, for example, for images taken by drones that are patrolling for security purposes such as event venues, the subject is identified by the method described above, the speed is estimated, and security personnel are in charge. It can also be applied to the purpose of notifying a person. For example, by providing a security commander with a specific monitored person and its speed information, it can be applied to a command application such as sending a security officer or expanding the security range.

Further, in the procedure shown in the first to third embodiments described above, the computer (9000 in FIG. 13) that functions as the viewing support device 10, 100 to 100c is provided with the function as the viewing support device 10, 100 to 100c. It can be realized by the program to be realized. Such a computer is exemplified in a configuration including a CPU (Central Processing Unit) 9010, a communication interface 9020, a memory 9030, and an auxiliary storage device 9040 in FIG. That is, the CPU 9010 in FIG. 13 may execute a mobile object identification program or a speed estimation program, and update each calculation parameter held in the auxiliary storage device 9040 or the like.

That is, each part (processing means, function) of the viewing support devices 10, 100 to 100c shown in each of the above-described embodiments uses the hardware of the processor mounted on these devices to perform each of the above-mentioned processes. It can be realized by a computer program to be executed.

Finally, the preferred embodiments of the present invention are summarized.
[First form]
(Refer to the viewing support device from the first viewpoint above)
[Second form]
The mobile body handled by the above-mentioned viewing support device is a runner of a competitive competition.
The cutting means can be configured to cut out an image at the timing when the runner's foot touches the ground.
[Third form]
The means for estimating the speed of the moving body is
The relative distance between the camera and the runner is estimated from the image of the moving object.
It is possible to adopt a configuration in which a process of estimating the relative speed between the camera and the moving body is executed from the frame rate of the image on which the moving body is projected and the change in the relative distance between the camera and the runner.
[Fourth form]
The means for estimating the speed of the moving body is
By summing the relative speed of the moving body and the moving speed of the camera, it is possible to adopt a configuration for calculating the moving speed of the runner.
[Fifth form]
In the above-mentioned viewing support device
The means for estimating the speed of the moving body can adopt a configuration for estimating the speed of the moving body based on the change in the feature amount calculated from the background image of the image on which the moving body is projected.
[Sixth form]
In the above-mentioned viewing support device
The means for estimating the speed of the moving body is
The feature amount of the background image of the model moving body included in the captured image when the model moving body moves along the moving path of the moving body, and
By collating with the feature amount calculated from the background image of the image on which the moving body is projected, the position of the moving body is specified.
A configuration can be adopted in which the position of the moving body is estimated using the specified position.
[7th form]
A means for cutting out an image in which the plurality of moving objects are projected at predetermined time intervals from a relay image having a plurality of moving objects moving from the first point to the second point as subjects.
A means for estimating the distance difference between the plurality of moving objects based on the change in the background image of the image on which the plurality of moving objects are projected, and
A viewing support device comprising a means for outputting a distance difference between the plurality of moving objects.
[8th form]
The above-mentioned viewing support device is
Further, a means for identifying the moving body based on the image of the moving body projected on the image is provided.
It is possible to adopt a configuration that outputs the information of the specified moving object and at least one of the estimated speed or the distance difference thereof.
[Ninth form]
In the above-mentioned viewing support device
The mobile is a runner in a competitive competition and
The means for identifying the moving body is
A configuration for identifying the runner can be adopted based on the characteristics of the face image of the runner or the information of the bib.
[10th form]
In the above-mentioned viewing support device
Moreover,
A means for determining the facial expression of the runner from the characteristics of the face image of the runner is provided.
The output means can adopt a configuration in which the facial expression of the runner is output in a predetermined mode.
[11th form]
(Refer to the viewing support method from the third viewpoint above)
[Twelfth form]
(Refer to the program from the fourth viewpoint above)
The eleventh to twelfth forms can be expanded into the second to tenth forms in the same manner as the first form.

The disclosures of the above patented and non-patented documents shall be incorporated into this document by citation. Within the framework of the entire disclosure (including the scope of claims) of the present invention, it is possible to change or adjust the embodiments or examples based on the basic technical idea thereof. In addition, various combinations or selections (parts) of various disclosure elements (including each element of each claim, each element of each embodiment or embodiment, each element of each drawing, etc.) within the framework of the disclosure of the present invention. (Including target deletion) is possible. That is, it goes without saying that the present invention includes all disclosure including claims, various modifications and modifications that can be made by those skilled in the art in accordance with the technical idea. In particular, with respect to the numerical range described in this document, any numerical value or small range included in the range should be construed as being specifically described even if not otherwise described.

10, 100, 100a, 100b, 100c Viewing support device 11, 110 Image cutting section 12, 120, 120b Speed estimation section 14, 140 Output section 18, 180 Distance difference estimation section 130 Moving object identification section 150 Runner information DB (database)
150a Runner specific engine 160 Reference background image DB (database)
170 Facial expression judgment unit 200 Camera 300 Television receiver 400a, 400b Box 401a, 401b Icon 9000 Computer 9010 CPU
9020 Communication interface 9030 Memory 9040 Auxiliary storage

Claims (10)

A means for cutting out an image on which a moving object is projected at predetermined time intervals from a relay image of a moving object moving from a first point to a second point as a subject.
A means for estimating the speed of the moving body based on a change in the background image of the image on which the moving body is projected, and a means for estimating the speed of the moving body.
A viewing support device including means for outputting the estimated speed of the moving object. The mobile is a runner in a competitive competition and
The viewing support device according to claim 1, wherein the cutting means cuts out an image at the timing when the runner's foot touches the ground. The means for estimating the speed of the moving body is
The relative distance between the camera and the moving object is estimated from the image on which the moving object is projected.
The viewing support device according to claim 1 or 2, which executes a process of estimating the relative speed between the camera and the moving body from the frame rate of the image on which the moving body is projected and the change in the relative distance between the camera and the moving body. The means for estimating the speed of the moving body is
The viewing support device according to claim 3, wherein the moving speed of the moving body is calculated by adding up the relative speed of the moving body and the moving speed of the camera. The means for estimating the speed of the moving body is the viewing support device according to claim 1 or 2, which estimates the speed of the moving body based on the change in the feature amount calculated from the background image of the image on which the moving body is projected. .. The means for estimating the speed of the moving body is
The feature amount of the background image of the model moving body included in the captured image when the model moving body moves along the moving path of the moving body, and
By collating with the feature amount calculated from the background image of the image on which the moving body is projected, the position of the moving body is specified.
The viewing support device according to any one of claims 1 to 3, which estimates the position of the moving body using the specified position. A means for cutting out an image in which the plurality of moving objects are projected at predetermined time intervals from a relay image having a plurality of moving objects moving from the first point to the second point as subjects.
A means for estimating the distance difference between the plurality of moving objects based on the change in the background image of the image on which the plurality of moving objects are projected, and
The means for outputting the distance difference between the plurality of moving objects is provided.
The viewing support device of claim 6 . Further, a means for identifying the moving body based on the image of the moving body projected on the image is provided.
The viewing support device according to claim 7 , which outputs information on the specified moving object and at least one of its estimated speed or distance difference. A step of cutting out an image on which the moving object is projected at a predetermined time interval from a relay image of a moving object moving from the first point to the second point as a subject.
A step of estimating the speed of the moving body based on a change in the background image of the image on which the moving body is projected, and a step of estimating the speed of the moving body.
The step of outputting the estimated speed of the moving body and
Viewing support methods including. For the computers that make up the viewing support device,
A process of cutting out an image on which a moving object is projected at predetermined time intervals from a relay image of a moving object moving from a first point to a second point.
A process of estimating the speed of the moving body based on a change in the background image of the image on which the moving body is projected, and a process of estimating the speed of the moving body.
The process of outputting the estimated speed of the moving body and
A program to execute.

Images