JP2011175070A - Video information display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video information display device that increases the degree of attention of passersby. <P>SOLUTION: A photographing device 100 and a display device 200 are provided on a moving route of passersby, and images of the passersby are displayed as a real-time video V1. A display object video V2 such as an advertising video is created by a display object video providing means 400A and is displayed by changing time periods of the video V1 and the video V2 by a video switching means 300A. The presence of a passerby is detected by a passerby detecting means 500A to control the switching time of the video switching means 300A. The display object video providing means 400A can create the display object video V2 in real time by using various material data, and can also create the display object video V2 by using a background image or an image of passersby as a material taken by the photographing device 100. When a passerby pays an attention to the real-time video V1 in which the passerby himself/herself is displayed, then the display object video V2 is effectively displayed. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a video information presentation apparatus that presents video information to passersby, and in particular, is installed in a street or public facility where an unspecified number of people come and go to present advertisements and other information on a display screen. It is related with the apparatus to do.

  Video information presentation devices that present advertisements and other information on the display screen to passers-by in public facilities such as streets, stations, airports, hotels, shopping malls, and movie theaters where an unspecified number of people come and go are old. It is used from. In recent years, since the technology for creating and distributing digital video has been improved, an advertising medium called digital signage that uses various digital technologies using a computer to present information has also become widespread.

  For example, Patent Document 1 below discloses a technique for presenting a different video depending on the observation position by controlling the viewing angle of the video displayed on the display screen. Patent Document 2 discloses a technique for increasing the frequency of incentives for advertisements by switching broadcast stations for each time period and inserting advertisements at the time of switching when presenting a television broadcast on the street. . Furthermore, Patent Literature 3 discloses a technique for increasing the attention level by displaying character information input by the user himself on a display screen installed on the street. Patent Literature 4 discloses a display screen. A technology is disclosed that presents advertisements that meet the user's demand by collecting answers to the questions presented above via the user's terminal device and displaying advertisements based on the results of the answers on the display screen. ing.

JP-A-6-230735 JP 2002-251566 A JP 2003-15567 A JP 2003-22346 A

  The purpose of installing a video information presentation device in a street or public facility where an unspecified number of people come and go is, of course, to transmit advertisements and other information to be presented to passers-by. Advertising signage using large display devices installed on the street and digital signage using communication technology and CG technology were initially attracting attention due to their rarity, but recently they are frequently seen in various places. In the future, it will be unavoidable to keep going obsolete. For this reason, by introducing technologies such as those disclosed in the above-mentioned patent documents, the device has been devised to increase the degree of attention of passers-by, but the effect of attracting the attention of passers-by has not improved so much. Is the current situation. In particular, when presenting commercial advertisement information, it is a big problem that sufficient cost-effectiveness corresponding to investment cannot be obtained.

  Therefore, an object of the present invention is to provide a video information presentation device that can further improve the attention level of a passerby.

(1) A first aspect of the present invention is a video information presentation device for presenting video information to a passerby,
A display device installed in the travel route or stopover of a passerby,
A photographing device installed at a position suitable for photographing a passerby observing the display screen of the display device;
A presentation target video providing means for providing a presentation target video for presentation to a passerby;
Video that performs processing for selecting one of the real-time video captured by the imaging device and the presentation target video provided by the presentation target video providing means and providing it to the display device, and switching the video presented on the screen Switching means;
Is provided.

(2) According to a second aspect of the present invention, in the video information presentation device according to the first aspect described above,
The video switching means performs a process of alternately switching between the real-time video and the presentation target video every time a predetermined time set in advance elapses.

(3) According to a third aspect of the present invention, in the video information presentation device according to the second aspect described above,
The video switching means switches to the presentation target video when a predetermined set time elapses from the time of switching to the real time video, and switches to the real time video when the presentation target video ends. By doing this, the process of switching between the real-time video and the video to be presented alternately is performed,
The presentation target video providing means starts the presentation target video from the time when the video switching means switches to the presentation target video.

(4) According to a fourth aspect of the present invention, in the video information presentation device according to the first aspect described above,
A passer-by detection means for detecting whether or not a passer-by exists in a predetermined detection area set in the vicinity of the display device;
The video switching means switches the video based on the detection result of the passerby detection means.

(5) According to a fifth aspect of the present invention, in the video information presentation device according to the fourth aspect described above,
A passer-by detection means is detected based on a wave irradiation unit that irradiates electromagnetic waves or sound waves in a detection area, a reflected wave receiving unit that receives a reflected wave from a passer-by, and a reflected wave received by the reflected wave receiving unit And a presence determination unit that determines whether or not a passerby exists in the area.

(6) According to a sixth aspect of the present invention, in the video information presentation device according to the fourth aspect described above,
The passerby detection means determines a moving body recognition unit that performs moving body recognition based on a real-time video imaged by the imaging device, and determines whether or not the moving body recognized by the moving body recognition unit is a passerby that exists in the detection region. And a passer-by determination unit.

(7) According to a seventh aspect of the present invention, in the video information presentation device according to the fourth to sixth aspects described above,
The video switching means detects the presence of a passerby after switching to the real-time video, and switches to the presentation target video when the detection continues for a predetermined time, and the presentation target video is displayed. By switching to real-time video at the end of, the process to switch between the real-time video and the presentation target video alternately,
The presentation target video providing means starts the presentation target video from the time when the video switching means switches to the presentation target video.

(8) According to an eighth aspect of the present invention, in the video information presentation device according to the first to seventh aspects described above,
The presentation target video providing unit includes a video storage unit that stores a presentation target video created in advance and a video output unit that outputs the presentation target video stored in the video storage unit.

(9) According to a ninth aspect of the present invention, in the video information presentation device according to the first to seventh aspects described above,
The presentation target video providing means creates a presentation target video using a material data storage unit that stores material data as a material for creating the presentation target video, and material data stored in the material data storage unit, This is composed of a video creation unit that outputs this.

(10) According to a tenth aspect of the present invention, in the video information presentation device according to the ninth aspect described above,
The video creation unit creates the presentation target video by using both the material data stored in the material data storage unit and the real-time video shot by the imaging device.

(11) An eleventh aspect of the present invention is the video information presentation device according to the tenth aspect described above,
The video creation unit creates a presentation target video by recognizing and extracting a passerby part from the real-time video and synthesizing a part or all of it with material data.

(12) According to a twelfth aspect of the present invention, in the video information presentation apparatus according to the tenth aspect described above,
The video creation unit recognizes the part of the passerby from the real-time video, extracts features related to its size, shape, posture, or color, and presents the target subject with features related to the extracted features Is to create.

(13) According to a thirteenth aspect of the present invention, in the video information presentation device according to the first to seventh aspects described above,
The presentation target video providing means provides a presentation target video with a background image reflected in the shooting field of view of the imaging apparatus as a background.

(14) According to a fourteenth aspect of the present invention, in the video information presentation apparatus according to the thirteenth aspect described above,
The presentation target video providing unit outputs a presentation target video stored in the video storage unit and a video storage unit that stores a presentation target video that is created in advance and has a background image reflected in the shooting field of view of the imaging device. And a video output unit.

(15) According to a fifteenth aspect of the present invention, in the video information presentation device according to the fourteenth aspect described above,
The video storage unit stores a presentation target video including a moving image in which at least the background image changes from moment to moment, with an image including a background image reflected in the shooting field of view of the imaging apparatus as an initial image.

(16) According to a sixteenth aspect of the present invention, in the video information presentation device according to the thirteenth aspect described above,
The presentation target video providing means is presented by using the material data storage unit storing the material data including the background data indicating the background image reflected in the imaging field of the imaging apparatus, and the background data stored in the material data storage unit as the material. And a video creation unit that creates a target video and outputs the target video.

(17) According to a seventeenth aspect of the present invention, in the video information presentation device according to the sixteenth aspect described above,
The material data storage unit stores background video data indicating the background that changes from moment to moment, with the background image reflected in the field of view of the imaging device as the initial image, and the video creation unit uses the background video data to present the target video. Is to create.

(18) According to an eighteenth aspect of the present invention, in the video information presentation device according to the seventeenth aspect described above,
The video creation unit creates the presentation target video by using both the material data stored in the material data storage unit and the real-time video shot by the imaging device.

(19) According to a nineteenth aspect of the present invention, in the video information presentation device according to the eighteenth aspect described above,
The video creation unit recognizes and cuts out a passerby part from the real-time video, and performs a process of synthesizing a part or all of it into background video data, thereby creating a presentation target video.

(20) According to a twentieth aspect of the present invention, in the video information presentation device according to the nineteenth aspect described above,
The video creation unit recognizes the part of the passerby from the real-time video, extracts features related to its size, shape, posture, or color, and presents the target subject with features related to the extracted features Is to create.

  (21) In a twenty-first aspect of the present invention, the presentation target video providing means and the video switching means in the video information presentation apparatus according to the first to twentieth aspects are configured by incorporating a dedicated program in a computer. Is.

(22) According to a twenty-second aspect of the present invention, in the video information presentation method for presenting video information to a passer-by using a display device installed in a travel route or a stopover place of the passer-by,
A photographing device that captures a passerby observing a display screen of the display device and generates a real-time image;
An image that is displayed on the screen by the computer selecting and providing either a real-time image captured by the image capturing device or a presentation target image prepared in advance for presentation to a passerby to the display device Stage to switch between,
Is to do.

(23) According to a twenty-third aspect of the present invention, in a video information presentation method for presenting video information to a passer-by using a display device installed in a travel route or a stopover place of the passer-by,
A photographing device that captures a passerby observing a display screen of the display device and generates a real-time image;
The computer selects either a real-time video imaged by the imaging device or a presentation target video image created using previously prepared material data, gives it to the display device, and is presented on the screen Stage to switch video,
Is to do.

(24) According to a twenty-fourth aspect of the present invention, in the video information presentation method according to the twenty-third aspect described above,
The presentation target video is created using both material data prepared in advance and part or all of the real-time video shot by the shooting device.

  In the video information presentation device according to the present invention, the passer's own video is shot as a real-time video, and the real-time video and the original video to be presented (for example, an advertisement video) are switched on the screen of the display device. Is displayed. For this reason, a passerby who recognizes an image in which he / she appears on the display screen inevitably pays attention to the image. Eventually, since the video is switched to the original video to be presented, the video to be presented is presented with the attention of the passerby, and the degree of attention of the passerby can be further improved.

  Although switching between the real-time video and the original video to be presented can be performed at predetermined time intervals, a detection means for detecting whether or not there is a passerby in the vicinity of the display device is provided. When switching is performed based on the detection result, the presentation target video can be presented at a more effective timing.

  In addition, as the presentation target video, an existing presentation target video prepared in advance may be used, but the presentation target video is displayed each time by the CG technology using the prepared material data as a material. You may make it create. In the latter case, it is possible to create a presentation target video in which a passer's own video shot as a real-time video is incorporated, so that the degree of attention to the presentation target video itself can be improved.

  On the other hand, if a background image that appears in the field of view of the photographing device is used as the background of the presentation target video, the background of the real-time video and the background of the presentation target video are the same, so even if the video is switched. The passerby can recognize an image having a sense of unity in which background images are continuous before and after switching, and can experience a presentation target image with a sense of reality. In this case, if a presentation target video incorporating a passer's own video shot as a real-time video is created, the sense of reality can be further enhanced.

  Furthermore, by extracting features related to the size, shape, posture or color of passers-by from the real-time video, and creating a presentation target video that includes a target object with features related to the extracted features, it is captured as real-time video. Since the real world that has been made and the virtual world that is presented as the presentation target video are related via the feature, the interest of the passerby can be further increased.

It is a block diagram which shows the basic composition of the video information presentation apparatus which concerns on the 1st Embodiment of this invention. It is a front view which shows the specific positional relationship of the imaging device 100 and the display apparatus 200 of the video information presentation apparatus shown in FIG. FIG. 3 is a top view illustrating a specific installation state of the photographing apparatus 100 and the display apparatus 200 illustrated in FIG. 2. It is a top view which shows an example of the real-time image | video V1 image | photographed with the imaging device 100 of the video information presentation apparatus shown in FIG. It is a top view which shows an example of the presentation target image | video V2 provided by the presentation target image | video provision means 400 of the video information presentation apparatus shown in FIG. It is a timing chart which shows the example of the switching operation | movement of the video switching means 300 of the video information presentation apparatus shown in FIG. It is a block diagram which shows the basic composition of the video information presentation apparatus which concerns on the 2nd Embodiment of this invention. It is a front view which shows the specific structural example of the passerby detection means 500 of the video information presentation apparatus shown in FIG. It is a top view which shows the specific structural example of the passerby detection means 500 of the video information presentation apparatus shown in FIG. It is a timing chart which shows an example of the switching operation | movement of the video switching means 300A in the video information presentation apparatus shown in FIG. It is a block diagram which shows the basic composition of the video information presentation apparatus which concerns on the 3rd Embodiment of this invention. It is a top view which shows the passerby image area (hatching part) recognized by the moving body recognition part 540 of the video information presentation apparatus shown in FIG. It is a block diagram which shows the basic composition of the video information presentation apparatus which concerns on the 4th Embodiment of this invention. It is a block diagram which shows the basic composition of the video information presentation apparatus which concerns on the 5th Embodiment of this invention. It is a top view which shows an example of the presentation target image | video V2 provided by the presentation target image | video provision means 400A of the video information presentation apparatus shown in FIG. FIG. 16 is a plan view showing material data M1 and M2 for creating the presentation target video V2 shown in FIG. 15. It is a top view which shows the passerby image area (hatching part) obtained by the passerby detection means 500A of the video information presentation apparatus shown in FIG. It is a top view which shows an example of the presentation target image | video V2 containing the presentation target object (bottle) with the characteristic relevant to the characteristic regarding the attitude | position of the passerby recognized based on the passerby image area | region (hatching part) shown in FIG. is there. It is a top view which shows an example of the relationship between the characteristic regarding the color of a passerby, and the characteristic regarding the color of a presentation target object (bottle). It is a top view which shows an example of the background image Bk utilized with the video information presentation apparatus concerning the 6th Embodiment of this invention. It is a top view which shows an example of the presentation target image | video V2 produced using the background image Bk shown in FIG. It is a top view which shows another example of the presentation target image | video V2 produced using the background image Bk shown in FIG. FIG. 21 is a plan view showing still another example of the presentation target video V2 created using the background image Bk shown in FIG.

  Hereinafter, the present invention will be described based on the illustrated embodiments.

<<< §1. First embodiment (basic embodiment) >>
FIG. 1 is a block diagram showing a basic configuration of a video information presentation apparatus according to the first embodiment of the present invention. As shown in the figure, this device is constituted by a photographing device 100, a display device 200, a video switching means 300, and a presentation target video providing means 400, and fulfills a function of presenting video information to a passerby.

  The display device 200 is installed in a passerby's movement route or a stopover location, and the imaging device 100 is installed in a position suitable for photographing a passerby who is observing the display screen of the display device 200. FIG. 2 is a front view showing a specific positional relationship between the imaging device 100 and the display device 200 of the video information presentation device. The display device 200 can be installed in various places such as a street where an unspecified number of people come and go, a station, an airport, a hotel, a shopping mall, a movie theater, and the like. In the figure, a passerby P who is observing the display screen while passing through the front of the display device 200 is depicted. In this way, the photographing apparatus 100 is installed at a position suitable for photographing the passerby P who is observing the display screen of the display apparatus 200. In the case of the illustrated example, the imaging device 100 is attached to the upper center of the display device 200.

  The photographing apparatus 100 may be any apparatus as long as it has a function of photographing a passerby and generating a video signal thereof. In general, it is preferable to use a digital video camera having a function of shooting a moving image and generating video data. However, a digital camera having a still image shooting function or an analog video camera may be used. On the other hand, the display device 200 may be any device as long as it has a function of presenting video on the screen based on the video signal generated by the photographing device 100. In the figure, an example using a relatively large flat display is shown, but a display device of an arbitrary system of an arbitrary size according to the content of the video to be presented, the purpose of presentation, the installation location, etc. Can be used.

  FIG. 3 is a top view showing a specific installation state of the photographing apparatus 100 and the display apparatus 200 shown in FIG. Here, for convenience of explanation, an example in which the photographing device 100 and the display device 200 are installed in a passage in a hotel will be shown. As shown in the figure, this passage is partitioned by walls 10 and 20, and the passerby P walks on the floor 30 of the passage. A wall-mounted display device 200 is attached to the wall 10, and a photographing device 100 is attached to the upper center. A one-dot chain line in the figure indicates a field of view of the photographing apparatus 100, and a passerby P is in the field of view of the photograph with the wall 20 as a background.

  FIG. 4 is a plan view showing an image in the photographing field of view shown in FIG. Here, for convenience of explanation, it is assumed that the picture frames 41 and 42 and the lighting fixture 43 are attached to the wall 20, and a decorative fence 50 is placed in the vicinity of the wall 20. In the image within the field of view, the passerby P is shown against the background of the wall 20 and the floor 30 including these articles. Since the video is a video shot in real time by the imaging device 100, it will be referred to as “real-time video V1” hereinafter. In the case of the embodiment shown here, a digital video camera is used as the photographing apparatus 100, and the real-time video V1 is a current video shot by this digital video camera.

  On the other hand, FIG. 5 is a plan view showing an example of an original video to be presented to a passerby. Here, an example of an advertisement video of a product “Patent Drink” is shown. Hereinafter, the original video to be presented to the passerby is referred to as “presentation target video V2”. Here, an example in which the presentation target video V2 is configured by a moving image is shown, but the presentation target video V2 may be a still image. In addition, the presentation target video V2 is not necessarily an advertising video, and may be a video for displaying some information to be transmitted to a passerby.

  In the configuration of FIG. 1, the point that the photographing apparatus 100 generates the real-time video V1 as shown in FIG. 4 is as already described. On the other hand, the presentation target video providing unit 400 includes a video storage unit 410 that stores a presentation target video V2 created in advance, a video output unit 420 that outputs the presentation target video V2 stored in the video storage unit 410, and And provides the function of providing the presentation target video V2 to be presented to the passerby P. Specifically, video data for displaying the presentation target video V2 as shown in FIG. 5 is stored in the video storage unit 410, and the video output unit 420 includes the still image included in the video data. A process of sequentially outputting image data in time series is performed.

  Of course, a plurality of types of video data may be stored in the video storage unit 410, and any video data may be selected and output by the video output unit 420. Alternatively, the video output unit 420 may select a plurality of video data at the same time to generate and output a multi-window composite video. If the video prepared in the video storage unit 410 is a still image, the video output unit 420 may continuously output the still image.

  The video switching unit 300 selects either one of the real-time video V1 captured by the imaging device 100 and the presentation target video V2 provided by the presentation target video providing unit 400 and provides the selected video to the display device 200. The process which switches the image | video shown to is performed. That is, on the screen of the display device 200, the real-time video V1 shown in FIG. 4 and the presentation target video V2 shown in FIG. 5 are switched and displayed.

  FIG. 6 is a timing chart in which the time axis t is taken in the horizontal direction in order to show an example of the switching operation of the video switching means 300.

  FIG. 6A shows an example in which the video switching unit 300 performs a process of alternately switching between the real-time video V1 and the presentation target video V2 every time a predetermined time set in advance elapses. In this example, the periods T1 to T5 on the time axis are all set to 15 seconds, and the real-time video V1 and the presentation target video V2 are alternately switched every 15 seconds as shown in the figure. In this case, a 15-second moving image is prepared as the presentation target video V2, and the video output unit 420 outputs the presentation target video V2 when the video switching unit 300 switches to the presentation target video V2. Can be started. Then, the presentation target video V2 starts from the beginning of each of the periods T2 and T4. Of course, different presentation target videos V2 may be selected in the period T2 and the period T4 by the selection function of the video output unit 420.

  On the other hand, FIG. 6B shows that the video switching means 300 switches to the presentation target video V2 when a predetermined time set in advance has elapsed since the switching to the real-time video V1. The example which performs the process which switches the real-time video V1 and the presentation object video V2 alternately by switching to the real-time video V1 at the time when the screening of the video has ended is shown. In this case, the video output unit 420 may start the presentation target video V2 from the time when the video switching unit 300 switches to the presentation target video V2.

  Specifically, in the illustrated example, three types of presentation target videos V2A, V2B, and V2C are prepared in the video storage unit 410, and the video output unit 420 sequentially performs these operations in the order of V2A → V2B → V2C →. In this example, V2A → V2B → V2C →... Is selected and output. As shown in the figure, the video switching means 300 performs a process of alternately switching between the real-time video V1 and the presentation target video V2 every time periods T1 to T6 on the time axis elapse. In this example, period T1 = 15 seconds, period T2 = screening time of video V2A, period T3 = 6 seconds, period T4 = screening time of video V2B, period T5 = 13 seconds, period T6 = screening time of video V2C Has been.

  Therefore, when 15 seconds of the period T1 for presenting the real-time video V1 has elapsed, the video output unit 420 starts outputting the video V2A, and the video switching unit 300 switches to the presentation target video V2. The video switching means 300 switches to the real-time video V1 when the period T2 elapses and the screening of the video V2A ends. Subsequently, when 6 seconds of the period T3 for presenting the real-time video V1 has elapsed, the video output unit 420 starts outputting the video V2B, and the video switching unit 300 switches to the presentation target video V2. The video switching means 300 switches to the real-time video V1 when the presentation of the video V2B ends after the period T4 elapses. The same applies hereinafter.

  After all, in this video information presentation device, a real-time video V1 as shown in FIG. 4 and a presentation target video V2 as shown in FIG. 5 are alternately presented to the passerby P along the time axis t. Will be. Of course, the original video to be presented to the passerby P is the presentation target video V2 as shown in FIG. 5 (in this example, the advertising video of the product “Patent Drink”), but this presentation target video V2 Compared with the form of presenting only alone, the form of alternately presenting with the real-time video V1 has the effect of improving the attention level of the passerby P.

  This is because the presentation target video V2 that includes only information that is not directly related to the passerby P who has just passed in front of the display device 200 does not attract much attention. This is because the real-time video V1 in which oneself is shown becomes extremely interesting information. Many passers-by will watch the display screen when it recognizes the video on which it appears. In this way, since the switching from the real-time video V1 to the presentation target video V2 is performed in a state where the attention of the passerby is guided on the screen, the passerby inevitably pays attention to the presentation target video V2. Become. Then, when the presentation of the presentation target video V2 is completed, the switching to the real time video V1 is performed again, so that the passerby's attention can be further maintained, and the presentation target video V2 displayed after the switching is performed again. Can also be expected.

  Of the components shown as blocks in FIG. 1, the display device 200 needs to be installed in a place suitable for presenting a video to a passerby, for example, and the photographing device 100 takes a picture of this passerby. However, the video switching unit 300 and the presentation target video providing unit 400 may be installed in arbitrary places. Since these means 300 and 400 can be practically configured by an electronic circuit, a computer, and other peripheral devices, for example, they can be incorporated in the frame of the display device 200. Of course, the video storage unit 410 and the video output unit 420, the video output unit 420 and the video switching unit 300, and the video switching unit 300 and the display device 200 can be connected via a LAN or the Internet. Therefore, the video switching unit 300 and the presentation target video providing unit 400 may be installed at a remote location from the installation location of the display device 200 or the imaging device 100.

<<< §2. Second embodiment (detection of passers-by) >>>
In the first embodiment described above, the video switching by the video switching unit 300 is automatically performed at a predetermined timing regardless of the presence or absence of the passerby P. Here, an embodiment will be described in which the presence or absence of a passerby P is detected and video switching is performed based on the detection result.

  FIG. 7 is a block diagram showing a basic configuration of a video information presentation apparatus according to the second embodiment of the present invention. In this apparatus, a passer-by detection means 500 is further added to the apparatus according to the first embodiment shown in FIG. 1, and a video switching means 300A is used instead of the video switching means 300.

  The passer-by detection means 500 is a device that detects whether or not a passer-by exists within a predetermined detection area set in the vicinity of the display device 200. As shown in the figure, a wave irradiation unit 510, a reflected wave reception unit 520 and presence determination unit 530. The wave irradiation unit 510 has a function of irradiating electromagnetic waves (including light) or sound waves in the detection area, and the reflected wave receiving unit 520 has a function of receiving reflected waves from passersby based on the electromagnetic waves or sound waves. Have. Then, the presence determination unit 530 determines whether or not a passerby exists in the detection area based on the reflected wave received by the reflected wave reception unit 520, and notifies the video switching unit 300A of the result. On the other hand, the video switching unit 300A performs video switching processing based on the detection result of the passerby detection unit 500.

  FIG. 8 is a front view showing a specific configuration example of the passer-by detection means 500 shown in FIG. Here, an example in which three object sensors 501 to 503 are arranged above a passerby P on the floor 30 is shown. Each of the object sensors 501 to 503 is attached to, for example, a ceiling above the floor 30 and has a function of irradiating electromagnetic waves or sound waves downward and a function of receiving these reflected waves. In other words, each of the object sensors 501 to 503 has the functions of the wave irradiation unit 510 and the reflected wave receiving unit 520 shown in FIG. A one-dot chain line in the figure indicates an irradiation range of electromagnetic waves or sound waves from the individual object sensors 501 to 503.

  FIG. 9 is a top view showing detection areas of the object sensors 501 to 503 shown in FIG. Here, an example is shown in which three object sensors 501 to 503 are installed on the ceiling in order to detect the presence of a passerby P walking on the floor 30 of the passage partitioned by the walls 10 and 20. As illustrated, a wall-mounted display device 200 is attached to the wall 10, and a photographing device 100 is attached to the center of the upper portion thereof. The passer-by detection means 500 is a device that detects whether or not a passer-by exists within a predetermined detection area set in the vicinity of the display device 200. In the illustrated example, the passer-by detection means 500 uses each of the object sensors 501 to 503. The inside of the one-dot chain line circle that is the irradiation range of the electromagnetic wave or the sound wave is set as the detection region. The detection area may be set to any range as long as it is an area suitable for observing the video on the display device 200.

  As described above, each of the object sensors 501 to 503 has a function of receiving a reflected wave based on the irradiated electromagnetic wave or sound wave. The intensity of the reflected wave and the detection timing vary depending on the presence or absence of an object that has entered the detection area. Therefore, the presence determination unit 530 determines whether or not a passerby exists in the detection area based on the information of the reflected wave. Specifically, for example, when the obtained reflected wave has a characteristic of a reflected wave from a relatively large object existing on the floor 30, it may be determined that the object is a passerby. The apparatus having the function of detecting the presence / absence of human presence in the predetermined area and the determination algorithm itself are already known techniques, and thus detailed description thereof is omitted here.

  Eventually, a signal indicating whether or not a passerby has been detected in the detection area (“passer detection / non-detection”) is given from the presence determination unit 530 to the video switching unit 300A. Of course, the detection sensitivity also changes by changing the detection criterion of the presence determination unit 530. Also, even for the same “passerby”, there is a difference in height between adults and children, so the detection / non-detection criterion also changes. come. Furthermore, the result of “passenger detection” indicates that at least one passerby has been detected, and it is unknown how many passersby were actually detected. However, since the determination result by the presence determination unit 530 is simply used to determine the timing of the switching process performed by the video switching unit 300A, the detection accuracy is not so high.

  FIG. 10 is a timing chart showing an example of the switching operation of the video switching means 300A in the video information presentation apparatus shown in FIG. FIG. 10A shows the detection result of the passer-by detection means 500 (presence determination unit 530) (another “passer detection / non-detection”). Specifically, “non-detection” is performed between times t0 and t1, “detection” is performed between times t1 and t4, and “non-detection” is performed after time t4. This is a detection result corresponding to an example in which there is no passerby in the vicinity of the display device 200 until time t1, a passerby visits at time t1, stays until time t4, and leaves at time t4. is there.

  On the other hand, FIG. 10B shows an example of switching processing by the video switching means 300A based on the detection result shown in FIG. That is, in the case of this example, the switching process from the real-time video V1 to the presentation target video V2 by the video switching unit 300A is performed by the passer-by detection means 500 detecting the presence of a passer-by after the switching to the real-time video V1, and The detection is performed when the detection continues for a predetermined time. On the other hand, the switching process from the presentation target video V2 to the real-time video V1 is performed at the time when the presentation target video V2 is finished.

  Specifically, first, the real-time video V1 is selected at the time t0. Thereafter, at time t1, the detection result of the passer-by detection means 500 changes from “non-detection” to “passer-by detection”. However, when the presence of a passer-by is detected in this way, the video switching process is performed. The switching process to the presentation target video V2 is performed for the first time at time t2 when the detection state continues for a predetermined time T1.

  As described above, the time difference is provided only for the predetermined time T1 because the real-time video V1 (video showing the passerby) is displayed for the predetermined time T1 for the passerby who has entered the detection area near the display device 200. This is to draw attention. If the state has changed to the “non-detection” state before the predetermined time T1 has elapsed, it is considered that a passerby who has once entered the detection area has left the vicinity of the display device 200. Switching to video V2 is not performed.

  Now, the presentation target video providing unit 400 starts the presentation target video V2 from time t2 when the switching to the presentation target video V2 is performed by the video switching unit 300A. Here, it is assumed that the presentation time of the presentation target video V2 is T2. In this case, the switching process to the real-time video V1 is performed at time t3 when the screening time T2 has elapsed. The switching process is irrelevant to the detection result of the passer-by detection means 500. In the case of the illustrated example, the passerby has left the detection area at time t4 when time T3 has elapsed from the presentation end time t3 of the presentation target video V2.

  After all, from the viewpoint of the passerby, when passing near the display device 200, the real-time video V1 in which he / she is shown was screened. At the beginning, when the presentation target video V2 is watched to the end, the real-time video V1 in which the subject is shown again is screened. As described above, the passer-by detection unit 500 is used to detect whether or not a passer-by exists within a predetermined detection area, and the video switching unit 300A switches the video based on the detection result. Then, the presentation target video V2 can be presented to passers-by at a more appropriate timing, and the degree of attention to the presentation target video V2 can be further improved.

  When the passerby does not leave at time t4 and keeps standing in the vicinity of the display device 200 (that is, the “passerby detection” band shown by hatching in FIG. 10 (a) further moves to the right side. If it continues to grow), at time t3 after switching to the real-time video V1, the passer-by detection means 500 detects the presence of the passer-by, so when a predetermined time T1 has elapsed from time t3, again, The switching process to the presentation target video V2 is performed, and the presentation target video V2 is again presented to the passerby.

<<< §3. Third Embodiment (Passer Detection by Moving Object Recognition) >>>
In §2, as shown in FIG. 7, the example in which the passer-by detection means 500 detects the presence of the passer-by and switches the video at the optimum timing has been described. Here, as the passer-by detection means 500, object sensors 501 to 503 as shown in FIGS. 8 and 9 are used. In the third embodiment described here, the presence of a passerby is detected and video switching is performed at an optimal timing, but by moving object recognition processing using the real-time video V1 obtained by the imaging device 100. It is characterized by detecting passers-by.

  FIG. 11 is a block diagram showing the basic configuration of the video information presentation apparatus according to the third embodiment. A difference from the second embodiment shown in FIG. 7 is that a passer-by detection means 500 </ b> A is used instead of the passer-by detection means 500. As shown in the figure, the passer-by detection means 500A includes a moving object recognition unit 540 that performs moving object recognition based on the real-time video V1 captured by the image capturing device 100, and the moving object recognized by the moving object recognition unit 540 is within the detection region. A passer-by determination unit 550 that determines whether the passer-by exists.

  The moving object recognizing unit 540 analyzes a still image of each frame constituting the real-time video V1 provided from the imaging device 100 in time series, and performs processing for recognizing an area where a moving object is expected to exist. FIG. 12 is a plan view showing a passerby image area 60 (hatched portion) recognized by such moving object recognition processing. In general moving object recognition processing, the variation of the pixel value of each pixel of a large number of still images that are continuous in time series is examined, and the variation of the pixel value with respect to the average pixel value within the past sample period (for example, the past one hour). Is based on the basic principle that a pixel within the predetermined allowable range is determined as a pixel in the background region, and a pixel whose fluctuation in the pixel value exceeds the allowable range is determined as a pixel in the moving object region. Such a specific method of moving object recognition is a well-known technique that has been put into practical use in various fields, and therefore detailed description thereof is omitted here.

  The passerby determination unit 550 determines whether or not the moving object recognized by the moving object recognition unit 540 is a passerby existing in the detection area. For example, when the moving object recognition unit 540 recognizes that the hatched area 60 in FIG. 12 is a moving object, the passer-by determination unit 550 determines that the area 60 is an area corresponding to a human image, and It is determined whether or not the person exists in a predetermined detection area. The simplest method for making such a determination is a method for determining whether or not the area of the region 60 is equal to or greater than a predetermined threshold value.

  For example, when a condition that “the area of the region 60 is 1/10 or more than the area of the entire screen” is set and the condition is satisfied, “the passerby exists in the detection region” A determination may be made. The moving object that constitutes the region 60 that satisfies the above condition can be normally determined as “human”, and it can be determined that “it is close to the photographing apparatus 10 to some extent”. If the criterion “1/10” is lowered, a wider detection area can be set, and if the criterion “1/10” is raised, a narrower detection area can be set. Of course, an additional condition regarding the shape of the region 60 may be imposed such that “the aspect ratio of the region 60 is 2: 1 or more”.

  In this way, a “passer detection / non-detection” signal is given from the passer-by determination unit 550 to the video switching means 300A. The point that the video switching unit 300A performs the switching process between the real-time video V1 and the presentation target video V2 based on the determination result is exactly the same as the second embodiment described in §2. The determination result by the passer-by determination unit 550 is merely used to determine the timing of the switching process performed by the video switching unit 300A, and thus does not require so high detection accuracy.

  In the case of the second embodiment described above, it is necessary to provide the object sensors 501 to 503 on the ceiling, but the passer-by detection means 500A (moving object recognition unit 540 and passer-by determination unit 550) used in the third embodiment. ) Can be constituted by a computer or a microprocessor, so that an advantage of saving space can be obtained as compared with the second embodiment.

<<< §4. Fourth Embodiment (Creation of Presentation Target Video) >>>
In the case of the embodiment described so far, as shown in FIGS. 1, 7, and 11, the presentation target video providing means 400 includes a video storage unit 410 that stores a presentation target video V2 created in advance, and the video storage. And a video output unit 420 that outputs the presentation target video V2 stored in the unit 410. The embodiment described here adopts a method of creating and presenting the presentation target video V2 each time instead of presenting the presentation target video V2 created in advance.

  FIG. 13 is a block diagram showing the basic configuration of the video information presentation apparatus according to the fourth embodiment. The difference from the first embodiment shown in FIG. 1 is that a presentation target video providing unit 400A is used instead of the presentation target video providing unit 400. The presentation target video providing unit 400A includes a material data storage unit 430 and a video creation unit 440 as illustrated. Here, the material data storage unit 430 is a component that performs a function of storing material data as a material for creating the presentation target video V2, and the video creation unit 440 is stored in the material data storage unit 430. This is a component that fulfills the function of creating the presentation target video V2 using the current material data and outputting it to the video switching means 300.

  Actually, the presentation target video providing unit 400A can be configured by a computer or a microprocessor. In the material data storage unit 430, various still image data, moving image data, character data, and the like as materials are prepared. The video creation unit 440 creates a presentation target video V2 by appropriately combining these data. Will do. Due to the development of CG technology, a method for creating a new video by combining various material data is known. If a program for creating such a video is prepared in the video creation unit 440, the program In accordance with the processing function, a new presentation target video V2 can be created each time.

  In this way, when the presentation target video V2 is created each time, video presentation with a higher degree of freedom is possible, and the presentation target video V2 that further attracts the attention of the passerby can be presented. A typical example is the fifth embodiment described in §5 below.

<<< §5. Fifth embodiment (video creation using passers-by) >>>
As described in the fourth embodiment in §4, the great merit of adopting a method of creating and presenting a new presentation target video V2 each time is one of the real-time videos V1 photographed by the photographing device 10. This is the point that a presentation target video V2 incorporating a part or all of the part can be created and presented. That is, in FIG. 13, the real-time video V <b> 1 captured by the imaging device 10 is directly supplied to the video creation unit 440, and the video creation unit 440 stores the material data stored in the material data storage unit 430 and the imaging. A function of creating the presentation target video V2 using both the real-time video V1 photographed by the device 100 may be provided. Here, in particular, an example in which the presentation target video V2 is created using the passer's own video included in the real-time video V1 will be described as the fifth embodiment.

  FIG. 14 is a block diagram showing a basic configuration of a video information presentation apparatus according to the fifth embodiment of the present invention. A difference from the fourth embodiment shown in FIG. 13 is that a passer-by detection means 500A is newly added and a video switching means 300A is used instead of the video switching means 300. Here, the passer-by detection means 500A is the same as the passer-by detection means 500A shown in FIG. 11, and a moving object recognition unit 540 that performs moving object recognition based on the real-time video V1 photographed by the photographing apparatus 100, and this moving object. A passer-by determination unit 550 that determines whether or not the moving body recognized by the recognition unit 540 is a passer-by existing in the detection region. Then, the video switching unit 300A performs video switching based on the detection result of the passerby detection unit 500A as described in §2. Instead of the passer-by detection means 500A, a passer-by detection means 500 shown in FIG. 7 may be used. In this case, for example, it is necessary to provide object sensors 501 to 503 as shown in FIGS.

  The most important feature of the fifth embodiment shown in FIG. 14 is that a real-time video V1 captured by the imaging device 100 is also given to the video creation unit 440. The video creation unit 440 can create the presentation target video V2 using both the material data stored in the material data storage unit 430 and the real-time video V1. In particular, in the case of the embodiment described here, the video creation unit 440 recognizes and cuts out a passerby part from the real-time video V1, and performs a process of synthesizing part or all of it with material data, thereby providing a presentation target video. It has a function of creating V2.

  Such a function can be realized by causing the video creation unit 440 to have a function equivalent to the moving object recognition unit 540 shown in FIG. 11 (practically, the moving object recognition unit 540 provided in the passer-by detection unit 500A is It may be used for the moving object recognition process in the video creation unit 440). As already described, the moving body recognition unit 540 can perform moving body recognition on the real-time video V1 and can recognize the passer-by image area 60 as shown in FIG. Therefore, it is possible to cut out only the portion of the passer-by image area 60 from the real-time video V1 and use this as a material to create the presentation target video V2.

  FIG. 15 is a plan view showing an example of the presentation target video V2 created by the video creation unit 440 in this way. As shown in the drawing, the presentation target video V2 is an advertising video of a product “Patent Drink”, and the video of the passerby P itself is included in the advertising video. That is, the presentation target video V2 shown in the figure is configured by combining two material data M1 and M2 as shown in FIG. Here, the material data M1 is image data that is created in advance as an advertisement image of the product “Patent Drink” and stored in the material data storage unit 430, whereas the material data M2 is the image data 100. This is obtained by cutting out only the part of the passer-by image area 60 (the hatched area in FIG. 12) obtained by the moving object recognition process from the real-time video V1 (for example, the video as shown in FIG. 4) captured by Video data.

  Here, the material data M1 and M2 may be a still image or a moving image. Since moving object recognition can be performed on still images of one frame and one frame that are continuously given as moving images, it is possible to cut out only passersby as moving images based on the moving images given as real-time video V1. When such a cut-out process is performed, the material data M2 is a moving image that shows only the part of the passerby in real time. If the material data M2 cut out as an operation is synthesized with the material data M1 prepared as a moving image, a presentation target video V2 as shown in FIG. 15 can be created as a moving image.

  The presentation target video V2 as shown in FIG. 15 is a video with a very high degree of interest for passers-by. In the case of the illustrated example, the user himself / herself appears in the advertisement video of the product “Patent Drink”, and the video of herself (part of the material data M2) that is appearing is a real-time video. If a passerby observing this advertisement video raises his right arm, he who is appearing in the advertisement video also raises his right arm, and his own action in the real world and his action in the virtual world in the advertisement video And will be synchronized. Passers who notice this kind of synchronization phenomenon will look at the advertisement video in various poses. In this way, the presentation target video V2 created using the passer's own real-time video has the effect of significantly improving the passer's attention level.

  As described above, the feature of the fifth embodiment is that the image creation unit 440 uses both the material data stored in the material data storage unit 430 and the real-time image 100 captured by the image capturing apparatus 100. However, as a method of using the real-time video 100, the part of the passerby is necessarily cut out, and the presentation target video V2 is created using the cut out passer's video itself. The method is not limited. For example, features such as the size, shape, posture, and color of the passerby are extracted from the extracted passerby image, and a presentation target video V2 including a presentation target having a feature related to the extracted feature is obtained. It is also possible to create it.

  For example, if the passerby performs an action of tilting his / her body in one direction, the passerby image area 60 obtained by the moving object recognition process for the real-time video V1 changes as shown in FIG. Therefore, the video creation unit 440 has a function of recognizing the inclination of the passer-by image area 60 (for example, for the passer-by image area 60 hatched in the figure, a center point is obtained for each horizontal line. Then, the inclination of the approximate straight line obtained by connecting these center points up and down may be calculated), and if the presentation target video V2 in which the presentation target is inclined so as to match the inclination is created. Good.

  FIG. 18 shows a presentation target video V2 including a presentation target 65 (bottle) having characteristics related to the characteristics related to the posture of the passerby recognized based on the passerby image area 60 (hatched portion) shown in FIG. It is a top view which shows an example. In this example, an example is shown in which the presentation object 65 (bottle) is tilted to the left in the figure. This is because the video creation unit 440 changes the orientation of the bottle 65 to the passerby image shown in FIG. This is because processing for matching the inclination of the region 60 has been performed. In short, the video creation unit 440 recognizes a passerby part from the real-time video V1, extracts a feature related to the posture (inclination direction of the body), and presents an object 65 (bottle bottle) having a feature related to the extracted feature. ) Included in the presentation target video V2. For this reason, when a passerby tilts his / her body to the left and right, the presentation object 65 (bottle) in the presentation target video V2 displayed on the display screen also tilts to the left and right in accordance with the movement of the passer's body. become.

  Thus, from the viewpoint of a passerby, the presentation object 65 (bottle) in the presentation target video V2 synchronizes to his / her posture and changes its posture, so that a passerby who has noticed such a synchronization phenomenon Let's take a look at the advertisement video while taking various attitudes. As a result, the attention of the passerby on the product bottle (advertisement object 65) “Patent Drink” is extremely high, and an extremely large advertising effect is obtained.

  The feature extracted from the passerby image area 60 is not necessarily limited to the posture of the passerby. For example, it is possible to extract the size of the passer-by image area 60 as a feature and perform a process of changing the size of the presentation target object 65 in the presentation target video V2 according to the extracted size. . Specifically, the video creation unit 440 performs processing for obtaining the area (number of pixels) of the passer-by image area 60, and the size of the presentation target object 65 (bottle) in the presentation target video V2 is proportional to the area. That's fine. Then, when the passerby leaves the display device 200 (when the area of the passer-by image area 60 in the real-time video V1 becomes small), the presentation target object 65 (bottle) in the presentation target video V2 also becomes small. Eventually, when a passerby approaches or leaves the display device 200, it synchronizes with it, and the presentation object 65 (bottle) changes its size.

  Alternatively, the shape (outline) of the passer-by image area 60 may be extracted, and the presentation target video V2 including the presentation target having the same shape as the extracted shape may be created. For example, what is necessary is just to display the product bottle (advertisement target object 65) with the same outline as a passerby's outline.

  It is also possible to recognize a passerby part from the real-time video V1, extract features relating to the color, and create a presentation target video V2 including a presentation target having features related to the extracted features. . FIG. 19 is a plan view showing an example of the relationship between the characteristics relating to the color of such passers-by and the characteristics relating to the presentation object 75 (bottle). FIG. 19A shows a passer-by image 70 recognized from the real-time video V1, and FIG. 19B shows a presentation object 75 (bottle) to be displayed in the presentation target video V2. Here, the color of each part of the presentation object 75 (bottle) is determined for each part of the passer-by image 70 according to the color.

  Specifically, for example, when a passer-by image 70 as shown in FIG. 19 (a) is extracted by moving object recognition processing on the real-time video V1, the vertical dimension L is measured, and the vertical dimension L is used as a reference. Height levels L1, L2, L3, L4, and L5 are set at positions of 10%, 40%, 60%, 80%, and 98%, respectively. And the average value of the color of the pixel in the height level L5 among the pixels of the passerby image 70 is set as the color of the bottle stopper portion 75A, and the average value of the color of the pixel in the range of the height levels L1 to L2 Is the color of the bottle main body portion 75B, and the average value of the colors of the pixels in the range of the height levels L3 to L4 is the color of the bottle label portion 75C.

  If the presentation object video V2 is created using the presentation object 75 (bottle) whose color is determined by such a method, the presentation object 75 (bottle) having a color distribution similar to the color distribution of the passerby's whole body is obtained. Can be presented. For example, if a passerby is wearing a red hat, a yellow jacket, and light blue jeans, a bottle 75 having a red bottle stopper portion 75A, a light blue bottle main body portion 75B, and a yellow label portion 75C, It will be displayed in the presentation target video V2. Of course, if the color is reflected more finely, it is possible to display a bottle having the same pattern as the clothes pattern.

  In this way, if features relating to the size, shape, posture or color of passersby are extracted from real-time video, and a presentation target video including a presentation target having features similar to the extracted features is created, real-time video Since the virtual world presented as the presentation target video is related to the real world photographed as the presentation target video, it is possible to further increase the interest of the passerby.

<<< §6. Sixth embodiment (video using a background) >>
In the embodiments described so far, there is nothing in common regarding the background between the real-time video V1 and the presentation target video V2. For example, in the real-time video V1 shown in FIG. 4, the background (the wall 20, the floor 30, etc.) where the passerby P stands is shown as it is, whereas the presentation target video V2 shown in FIG. The presentation target video V2 shown in FIG. 15 is composed of an advertising video that is completely different from the real-time video V1 having such a background.

  The feature of the sixth embodiment described here is that the presentation target video V2 is provided by the presentation target video providing unit 400 or 400A with the background image captured in the shooting field of view of the imaging apparatus 100 as a background. For example, when the photographing apparatus 100 is installed in an environment as shown in FIG. 3, a real-time video V1 as exemplified in FIG. 4 is taken. In this example, the passerby P is shown, but if a picture is taken without the passerby P, a background image Bk as shown in FIG. 20 is obtained. That is, the background image Bk shown in FIG. 20 is an image that appears in the field of view of the photographing apparatus 100 installed in the environment shown in FIG.

  Therefore, using such background image Bk, for example, a presentation target video V2 as shown in FIG. 21 may be created and presented to the passerby. The presentation target video V2 shown in FIG. 21 is an advertisement video of a product “Patent Drink”, and the background image Bk shown in FIG. 20 is used as the background. As described above, if the background image Bk that appears in the field of view of the photographing apparatus 100 is used as the background of the presentation target video V2, the background of the real-time video V1 and the background of the presentation target video V2 become the same. Even if the switching is performed, the passerby can recognize the sense of unity that shares the background video Bk before and after the switching, and can experience the presentation target video V2 with a sense of reality.

  For example, when the sixth embodiment is implemented on the basis of the devices shown in FIGS. 1, 7, and 11, the background image as shown in FIG. Bk is photographed in advance, and a presentation target video V2 as shown in FIG. 21 is created using the background image Bk. The video storage unit 410 stores the presentation target video V2 created in advance. Then, the video output unit 420 can output the presentation target video V2 as shown in FIG. Eventually, for the passerby, the real-time video V1 as shown in FIG. 4 and the presentation target video V2 as shown in FIG. 21 are switched and presented, and the images have the same background. On the other hand, switching from the real-world video (real-time video V1) in which the user is photographed to the virtual world video (presentation-target video V2) in which the product (presentation object) is photographed is performed. As a result, it is possible to give a passerby a sense of unity and realism that images are continuous before and after switching, and an effect of improving the degree of attention can be obtained.

  FIG. 22 is a plan view showing an example of the presentation target video V2 that can give a stronger impact to a passerby. This presentation target video V2 is composed of moving images that gradually change as shown in FIGS. 20, 22 (a), 22 (b), and (c). That is, this moving image starts with a background image Bk as shown in FIG. 20 as an initial image, and eventually, as shown in FIG. 22 (a), a picture frame 42 hung on the wall 20 is displayed in the decoration basket 50. In addition, as shown in FIG. 22 (b), the picture 41 is also drawn into the decorative basket 50, and finally, in the space on the left side where the pictures 41 and 42 disappear, As shown in 22 (c), it is a moving image with the content that an advertisement video of a product “Patent Drink” appears.

  In this way, with the image including the background image Bk that appears in the field of view of the photographing apparatus 100 as an initial image, the presentation target video V2 that is a moving image in which the background image Bk changes from moment to moment can be stored in the video storage unit 410. For example, a passerby can be presented with an image in which the scenery of the place where he is standing now is suddenly changing, so the passerby's attention is extremely high. In fact, in the example shown in FIG. 22, there is an unrealistic image in which the picture of the forehead is magically sucked into the bag in the hotel corridor where the passerby is currently walking, so there is a sense of presence. However, since an “event that is impossible in reality” is presented, the impact on passers-by is very large.

  Further, instead of presenting “an event that is practically impossible”, an “actually possible event” may be presented. For example, instead of the phenomenon that is not possible in the real world, “the picture is sucked into the wall”, if a realistic event such as “the picture is falling on the floor” is presented, the response of the passerby is It will be different. Some passers-by who have seen the picture frame fall on the display screen may think that the picture picture has actually fallen and look back on the wall 20 side for confirmation. In the real world, if a passerby who recognizes that there is no abnormality in the picture, sees the display screen again at the timing when he sees the display screen again, a very impactful advertising effect Is obtained.

  Of course, the sixth embodiment can be implemented based on the apparatus shown in FIGS. In this case, a background image Bk as shown in FIG. 20 is captured in advance and stored in advance as one of the material data in the material data storage unit 430, and the video creation unit 440 uses this material data storage unit 430. The presentation target video V2 may be generated using the background data Bk stored in the file as a material and output. Furthermore, if an image of a bottle to be presented is prepared as one of the material data in the material data storage unit 430, the video creation unit 440 combines them and presents them as shown in FIG. The target video V2 can be created.

  Alternatively, in the material data storage unit 430, background moving image data (moving image data from FIG. 20 to FIGS. 22 (a) and 22 (b)) indicating the background that changes every moment is stored using the background image Bk as an initial image. In addition, the video creation unit 440 may perform a process of creating the presentation target video V2 using the background moving image data (for example, a process of adding a video as shown in FIG. 22C).

  Also in this case, the video creation unit 440 can create the presentation target video V2 using both the material data stored in the material data storage unit 430 and the real-time video V1 captured by the imaging device 100. it can. In particular, if the presentation target video V2 incorporating the passer's own video shot as the real-time video V1 is created, the sense of reality can be further enhanced. Specifically, as described in §5, the subject video V2 is displayed by performing processing for recognizing and cutting out the passerby part from the real-time video V1 and synthesizing part or all of it into the background video data. Create it.

  FIG. 23 shows an example of a moving image created by synthesizing a passer-by image with the moving image shown in FIG. 22 is prepared in the material data storage unit 430 in advance, and a video as illustrated in FIG. 23 is created by synthesizing the video of the passerby cut out from the real-time video V1 with the video. It is possible. In this case, the passerby is first presented with the real-time video V1 as shown in FIG. 4, and subsequently presented with the presentation target video V2 as shown in FIGS. 23 (a) to (c).

  From the viewpoint of passers-by, even if the real-time video V1 shown in FIG. 4 is switched to the presentation target video V2 shown in FIG. It will be recognized as if the video is continuously presented. However, as shown in FIG. 23 (b), an unrealistic video presentation of “the frame picture is sucked into the bag” will be made, and an effect of having a very great impact is obtained. Finally, as shown in FIG. 23 (c), the advertisement video is presented, so that a strong image of the advertisement object can be given to the passerby.

  Of course, also in the case of video presentation as shown in FIG. 23, as described in §5, the video creation unit 440 recognizes the passerby part from the real-time video V1, and its size, shape, and posture Alternatively, a color-related feature may be extracted, and a presentation target video V2 including a presentation target (for example, a bottle) having a feature related to the extracted feature may be created. For example, when the video shown in FIG. 23 (c) is presented, if the passerby changes his / her posture, the bottle moves to change its posture accordingly, or the passerby approaches or moves away from the display device. If you do, you can add an effect that the size of the bottle changes accordingly. Also, the color of the bottle can be displayed in accordance with the color of the passerby's clothes.

<<< §7. Device configuration using a computer >>>
The present invention has been described based on several embodiments. All of the devices according to these embodiments have a function of presenting video information to a passer-by using a display device 200 installed on a travel route or a stopover location of the passer-by, and a photographing device. 100 has a function of shooting a passerby who is observing the display screen of the display device 200 and generating a real-time video V1. Then, presentation target video providing means 400, 400A for providing the presentation target video V2 to be displayed on the display device and video switching means 300, 300A for switching the video to be displayed on the display device are provided. Furthermore, depending on the embodiment, passer-by detection means 500, 500A are added.

  Here, the video switching means 300, 300A and the presentation target video providing means 400, 400A are preferably configured using a computer in practice. Moreover, it is preferable that a part of the passer-by detection means 500 (presence determination unit 530) and the passer-by detection means 500A are practically configured using a computer. In that case, the processing performed by these means is executed by the function of the program incorporated in the computer.

  Specifically, the computer functioning as the video switching means 300, 300A and the real-time video V1 shot by the shooting device 100 and the presentation target video V2 prepared in advance for presentation to the passerby (or prepared in advance). One of the presentation target videos V2) created using the material data that has been made is selected and given to the display device 200, and the process of switching the video presented on the screen is performed. Here, when creating the presentation target video V2, it can be created using both the material data prepared in advance and a part or all of the real-time video V1 captured by the imaging device 100, For such a creation process of the presentation target video V2, programs using various known CG techniques can be used.

  Further, since the computers can be interconnected via a LAN or the Internet, when the components of the apparatus according to the present invention are realized by a computer, the individual components are configured by a plurality of computers arranged in a distributed manner. It is also possible to construct the entire apparatus according to the present invention by interconnecting these computers with a LAN or the Internet.

  In the embodiments described so far, only the example in which a video is presented to a passerby using the display device 200 has been described, but it is needless to say that audio may be presented together with the video. In particular, the computer can handle audio along with the video. If the audio data is included in the data of the real-time video V1 or the presentation target video V2, and the speaker is used together with the display device 200, Audio can be presented along with video.

10: Wall 20: Wall 30: Floor 41, 42: Frame picture 43: Lighting fixture 50: Decoration basket 60: Passer image area 65: Presentation object (bottle)
70: Passerby image 75: Presentation object (bottle)
75A: Bottle stopper part 75B: Bottle body part 75C: Bottle label part 100: Imaging device 200: Display device 300, 300A: Video switching means 400, 400A: Presentation target video providing means 410: Video storage part 420: Video output part 430 : Material data storage unit 440: Video creation unit 500, 500A: Passer detection means 501 to 503: Object sensor 510: Wave irradiation unit 520: Reflected wave reception unit 530: Presence determination unit 540: Moving object recognition unit 550: Passer determination Part Bk: Background image L: Vertical dimension of passerby image L1 to L5: Height level of passerby image M1, M2: Material data P: Passerby T1 to T6: Period on time axis t: Time axis t0 to t4 : Time V1: Real-time video V2: Presentation target video

Claims (24)

A video information presentation device for presenting video information to a passerby,
A display device installed in the travel route or stopover of a passerby,
A photographing device installed at a position suitable for photographing a passerby observing the display screen of the display device;
A presentation target video providing means for providing a presentation target video for presentation to a passerby;
A process of selecting any one of a real-time video captured by the imaging device and a presentation target video provided by the presentation target video providing unit and providing the selected video to the display device, and switching the video presented on the screen Video switching means for performing
A video information presentation apparatus comprising: The video information presentation device according to claim 1,
A video information presentation apparatus, wherein the video switching means performs a process of alternately switching between a real-time video and a presentation target video every time a predetermined time set in advance elapses. The video information presentation device according to claim 2,
The video switching means switches to the presentation target video when a predetermined set time elapses from the time of switching to the real time video, and switches to the real time video when the presentation target video ends. By doing this, the process of switching between the real-time video and the video to be presented alternately is performed,
A video information presentation device, wherein the presentation target video providing means starts the presentation target video from the time when the video switching means switches to the presentation target video. The video information presentation device according to claim 1,
A passer-by detection means for detecting whether or not a passer-by exists in a predetermined detection area set in the vicinity of the display device;
The video information presenting apparatus, wherein the video switching means switches the video based on a detection result of the passerby detection means. The video information presentation device according to claim 4,
The passer-by detection means includes a wave irradiation unit that irradiates electromagnetic waves or sound waves in the detection region, a reflected wave receiving unit that receives a reflected wave from the passer-by, and the reflected wave received by the reflected wave receiving unit based on the reflected wave And a presence determining unit that determines whether or not a passerby exists in the detection area. The video information presentation device according to claim 4,
A passer-by detection unit determines a moving object recognition unit that performs moving object recognition based on a real-time video imaged by the imaging device, and determines whether or not the moving object recognized by the moving object recognition unit is a passerby existing in the detection area. A video information presentation device comprising: a passer-by determination unit. The video information presentation device according to claim 4,
The video switching means detects the presence of a passerby after switching to the real-time video, and switches to the presentation target video when the detection continues for a predetermined time, and the presentation target video is displayed. By switching to real-time video at the end of, the process to switch between the real-time video and the presentation target video alternately,
A video information presentation device, wherein the presentation target video providing means starts the presentation target video from the time when the video switching means switches to the presentation target video. In the video information presentation device according to any one of claims 1 to 7,
The presentation target video providing means includes a video storage unit that stores a presentation target video created in advance, and a video output unit that outputs the presentation target video stored in the video storage unit. Information presentation device. In the video information presentation device according to any one of claims 1 to 7,
The presentation target video providing means creates a presentation target video using a material data storage unit storing material data as a material for generating the presentation target video and the material data stored in the material data storage unit. And a video creation unit for outputting the video information presentation device. The video information presentation device according to claim 9,
A video information presentation device, wherein the video creation unit creates a presentation target video using both the material data stored in the material data storage unit and the real-time video shot by the imaging device. The video information presentation device according to claim 10,
A video information presentation device characterized in that a video creation unit creates a presentation target video by performing processing for recognizing and extracting a part of a passerby from a real-time video and synthesizing a part or all of it with material data . The video information presentation device according to claim 10,
The video creation unit recognizes the part of the passerby from the real-time video, extracts features related to its size, shape, posture, or color, and presents the target subject with features related to the extracted features A video information presentation device characterized by creating a video. In the video information presentation device according to any one of claims 1 to 7,
A video information presentation apparatus, wherein the presentation target video providing means provides a presentation target video with a background image reflected in a photographing field of view of the photographing apparatus. The video information presentation device according to claim 13,
The presentation target video providing unit outputs a video storage unit that stores a presentation target video that is created in advance and that has a background image reflected in the field of view of the photographing apparatus, and the presentation target video stored in the video storage unit. And a video information presentation device. The video information presentation device according to claim 14,
Video information characterized in that the video storage unit stores a presentation target video consisting of a moving image in which at least the background image changes from moment to moment, with an image including a background image reflected in the shooting field of view of the imaging device as an initial image. Presentation device. The video information presentation device according to claim 13,
The presentation target video providing means uses, as a material, a material data storage unit that stores material data including background data indicating a background image reflected in a shooting field of view of the imaging device, and the background data stored in the material data storage unit A video information presentation apparatus comprising: a video creation unit that creates a presentation target video and outputs the video. The video information presentation device according to claim 16,
The material data storage unit stores background video data indicating a background that changes from moment to moment, with the background image reflected in the field of view of the imaging device as the initial image, and the video creation unit uses the background video data to present A video information presentation apparatus characterized by creating a video. The video information presentation device according to claim 17,
A video information presentation device, wherein the video creation unit creates a presentation target video using both the material data stored in the material data storage unit and the real-time video shot by the imaging device. The video information presentation device according to claim 18,
Video information presentation, wherein the video creation unit creates a presentation target video by recognizing and extracting a passerby part from the real-time video and synthesizing part or all of it into background video data apparatus. The video information presentation device according to claim 19,
The video creation unit recognizes the part of the passerby from the real-time video, extracts features related to its size, shape, posture, or color, and presents the target subject with features related to the extracted features A video information presentation device characterized by creating a video.   A program that causes a computer to function as a presentation target video providing unit and a video switching unit in the video information presentation device according to any one of claims 1 to 20. A video information presentation method for presenting video information to a passer-by using a display device installed on a passerby's movement route or stopover,
A step of photographing a passerby who is observing the display screen of the display device to generate a real-time image;
The computer selects either a real-time video imaged by the imaging device or a presentation target video image prepared in advance for presentation to a passer-by and provides it to the display device, which is presented on the screen. Stage to switch the video to be
A video information presentation method characterized by comprising: A video information presentation method for presenting video information to a passer-by using a display device installed on a passerby's movement route or stopover,
A step of photographing a passerby who is observing the display screen of the display device to generate a real-time image;
The computer selects either a real-time video imaged by the imaging device or a presentation target video image created using material data prepared in advance and gives it to the display device for presentation on the screen. Stage to switch the video to be played,
A video information presentation method characterized by comprising: The video information presentation method according to claim 23,
A video information presentation method, wherein a presentation target video is created using both material data prepared in advance and a part or all of a real-time video shot by a shooting device.

Images