JP2004287004A - Display system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display system having more enhanced entertainment properties. <P>SOLUTION: The display system is provided with a photographing means 1 for photographing a prescribed space area and persons entering the space area, an effect compositing means 2 for compositing effects with video images photographed by the photographing means 1, and a display means 3 for displaying video images having effects composited by the effect compositing means 2, and the display system has the photographing means 1 and the display means 3 installed in a space which unspecified persons visit, so that the display system can be utilized by unspecified persons. Thus the display system having the more enhanced entertainment properties is realized. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a display system installed in a space visited by an unspecified person.
[0002]
[Prior art]
2. Description of the Related Art There are known large-sized video screens installed in large-scale exhibition halls and stadiums, and billboards installed on the walls of buildings (for example, see Patent Document 1 below).
[0003]
[Patent Document 1] Japanese Patent Application Laid-Open No. 2001-215424
[Problems to be solved by the invention]
Advertisement displays and billboards are installed in so-called meeting places where many people stand, such as around major arterial stations. In many cases, the display and billboard itself are the sign of the meeting.
[0005]
However, pure CM and ready-made content are exclusively broadcast on the display and billboard as described above, and there is no direct relationship with the person watching it. Therefore, although it can kill time at the time of meeting, it cannot provide more fun, and it is not always friendly to the person who is meeting.
[0006]
In view of the above problems, an object of the present invention is to provide a display system with further improved entertainment.
[0007]
[Means for Solving the Problems]
In order to solve the above-mentioned problem, according to the present invention, as shown in FIG. 1, a photographing means 1 for photographing a predetermined space area and a person who has entered the space area, and applying an effect to an image photographed by the photographing means 1. An effect synthesizing means 2 for synthesizing, and a display means 3 for displaying an image obtained by synthesizing the effect by the effect synthesizing means 2 are provided. The photographing means 1 and the display means 3 are installed in a space where an unspecified person visits. Thus, a display system that can be used by an unspecified person was constructed. In such a case, since a person present at the place can be the subject of shooting and display independently, it is possible to play and greatly enjoy using the display system. Of course, an advertisement may be displayed in a part of the display area of the display means 3 in the display system. At this time, a higher advertisement effect can be expected as compared with the related art.
[0008]
It is preferable that the display unit 3 has a size capable of displaying a person photographed by the photographing unit 1 in a substantially life-size manner.
[0009]
As shown in FIG. 2, the apparatus further includes a measuring unit 4 for measuring a time during which a person who has entered the space area has been present in the space area or an accumulation thereof, and wherein the effect synthesizing means 2 includes the measuring means. 4, if the person is present in the spatial area or if it is to synthesize an effect corresponding to the accumulation thereof, for example, the length of time the person waiting is waiting Can be synthesized.
[0010]
As shown in FIG. 3, if it is further provided with a storage unit 5 for storing an image captured by the imaging unit 1, the display unit 3 can display the image stored in the storage unit 5. Live and performances performed by musicians, entertainers, and other people are stored as content, and can be reproduced later. In other words, it is possible to broadcast original content that is never completed, and this also provides amateur musicians, entertainers, and the like with the opportunity to make presentations.
[0011]
A control command optically input via the photographing means 1 for controlling recording for storing the video in the storage means 5 or reproduction for displaying the video stored in the storage means 5 on the display means 3 As long as it further includes the command interpreting means 6 for interpreting the command, there is no need to separately provide an operation input device for inputting a recording command or a playback command.
[0012]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings. The display system according to the present embodiment includes: a photographing unit 1 for photographing a predetermined spatial region R and a person P who has entered the spatial region R; an effect combining unit 2 for combining an effect with a video captured by the photographing unit 1; A display unit 3 for displaying an image obtained by combining the effects by the effect combining unit 2 is a main component. Then, the photographing means 1 and the display means 3 of the display system are installed in a space where the unspecified person P visits, and are used by the unspecified person P.
[0013]
The photographing unit 1 can be configured using, for example, a known video camera. The photographing means 1 photographs a spatial area R facing the screen of the display means 3 and a person P present in the spatial area R. The photographing unit 1 may be installed so as to face the screen of the display unit 3 as illustrated in FIG. 4, or may be oriented substantially in the same direction as the screen of the display unit 3 as illustrated in FIG. 5. (Particularly in such a manner as to be embedded in the screen of the display means 3). It is simple to use a fixed point observation type that does not perform panning or tilting, but the imaging unit 1 may be one that can perform panning or tilting. Further, the number of photographing means 1 may be one or plural.
[0014]
On the other hand, the display means 3 is, for example, an LED display, a liquid crystal display, a plasma display, or the like, a combination of a screen and a projector that projects an image on the screen, or the like. As shown in FIGS. 7 and 8, it is preferable that the display means 3 has a size capable of displaying the person P photographed by the photographing means 1 in substantially the same size. The illustrated example has a screen display area from the vicinity of the ground or floor where the display means 3 is installed to a height position exceeding the height of the person P.
[0015]
Thus, the effect synthesizing means 2 acquires the video data or the video signal output from the photographing means 1, synthesizes the effect with the video as required, and outputs the video data or the video signal to be displayed on the display means 3. Take the role of. The effect synthesizing means 2 includes, for example, hardware resources such as a processor 2a, a main memory 2b, a hard disk drive and other auxiliary storage devices 2c, a display control device 2d, and an input interface 2e, as shown in FIG. The display control device 2d configures an image to be displayed based on the drawing instruction received from the processor 2a, generates a video data or a video signal, and has a function of transmitting the generated video signal or video signal to the display unit 3 (or A device such as a video chip (Video RAM) that temporarily stores image data and the like is used. The input interface 2e receives video data of a video image captured by the image capturing unit 1. It uses a data communication interface or a device such as a video capture (digitizer) for converting a video signal into digital data. Usually, a program to be executed by the processor 2a is stored in the auxiliary storage device 2c. When the program is executed, the program is read from the auxiliary storage device 2c into the main memory 2b and decoded by the processor 2a. Then, the above-mentioned hardware resources are operated according to the program, so that at least the function as the effect synthesizing means 2 is exhibited.
[0016]
The effect synthesizing unit 2 analyzes the dynamics of the person P photographed by the photographing unit 1 by analyzing the image provided by the photographing unit 1. Conditions for the effect synthesizing means 2 to start or end the processing for synthesizing various effects are set in advance, and when the dynamics of the person P obtained as a result of the analysis matches the conditions, the conditions are immediately set to the matched conditions. The processing for synthesizing the effect obtained is started or ended.
[0017]
The effect synthesized by the effect synthesizing means 2 is an effect for the photographed person P, an effect using the image of the photographed person P, or an aspect having an association with the photographed person P. Is preferred. Hereinafter, specific examples of the effects are listed. FIG. 7A shows an example in which an effect corresponding to the time during which the person P to be photographed (that is, the display object) exists in the spatial region R or the accumulation thereof is synthesized. . That is, when the waiting person P is waiting longer than a predetermined time, a message M1 indicating the fact or a mark M2 indicating the suggestion (in other words, the feeling of the person) is displayed in the video. To be displayed. The display system in this case also includes a measuring means 4 for measuring the time during which the person P who has entered the space area R is present in the space area R or the accumulation thereof. The measurement unit 4 can be configured using, for example, an RFID (Radio Frequency Identification) recognition technology for recording or reading information on a recording medium that records identification information using electromagnetic waves. That is, the measuring unit 4 transmits the RFID tag T which is possessed by the person P and stores the identifier for identifying the person P, and the RFID tag T which is possessed by the person P present in the space area R. An RFID reader A that receives an identifier and a person P present in the spatial region R by acquiring the identifier via the RFID reader A, and detects the time during which the person P exists or the accumulated time. And a counter for counting. The counter may be separate from the hardware 2 functioning as the effect synthesizing means, but it is preferable that the hardware 2 functioning as the effect synthesizing means also exerts the function as the counter by a program. At this time, the RFID reader A and the hardware 2 functioning as effect synthesizing means are communicably connected via an electric communication line. The effect synthesizing unit 2 refers to the time during which the person P to be photographed is present in the spatial region R or the accumulation thereof, and measures the message M1, A process for synthesizing an image such as the mark M2 with the original video is executed, and video data or a video signal of the video obtained as a result is transmitted to the display unit 3. Incidentally, if the above-mentioned RFID system is attached, it is possible to identify the person P to be photographed and determine the mode of the effect to be combined with the video. Of course, the RFID system functions as sensing means for sensing whether or not the person P exists in the spatial region R. Therefore, when the sensing means senses the presence of the person P, the effect synthesizing means 2 may execute the effect processing, while when the sensing means does not sense the presence of the person P, the effect processing may not be executed. It is.
[0018]
The procedure of the processing executed by the effect synthesizing unit 2 will be described with reference to flowcharts shown in FIGS. 11 to 13. The effect synthesizing unit 2 determines whether or not a person exists in the spatial region R imaged by the imaging unit 1. This is sensed (step S1), and if there is a person, effect combining processing is performed (step S2), and a video combined with the effect is displayed on the display means 3 (step S3). On the other hand, if no person exists, the effect combining process is not performed. When the effect synthesizing process is not performed, the image photographed by the photographing means 1 can be directly displayed on the display means 3 (step S4). In performing the process of synthesizing the effect as illustrated in FIG. 7A (step S2), the time during which the person P to be imaged exists in the spatial region R or the accumulation thereof is referred to (step S2). S21), a process of combining the image such as the message M1, the mark M2, and the like with the original video is executed (step S22).
[0019]
FIGS. 7B and 7C show an example in which a direct effect is combined with the image of the photographed person P, in other words, an image using the photographed image of the person P is generated. In the example shown in FIG. 7B, when the person P in front of (in the space area R) of the screen of the display means 3 jumps, the person S shown on the screen stops in the air without falling, Or jump up everywhere. In the example shown in FIG. 7C, when the person P in front of the screen of the display means 3 moves, the onomatopoeic sound M3 is synthesized under the feet of the person S displayed on the screen. Furthermore, when the person P in front of the screen of the display means 3 moves faster than the predetermined speed, in other words, when the person P runs, the person S displayed on the screen runs faster than the person P in the real world. Would. In performing the processing for synthesizing these effects (step S2), the effect synthesizing unit 2 extracts the image S of the person P to be subjected to the effect from the original video by using a background difference, an inter-frame difference, or another method. Is executed (step S23). Then, an effect to be combined is selected by judging the direction and speed of movement of the extracted image P of the person P (step S24), and an effect combining process using the extracted image S of the person P is executed. (Step S25). In the example in which the person P jumps, the image S of the person P to be photographed and the background image are separated from each other, and the image of the background is displaced so that the image S of the person P stops or jumps up in the air. Is executed. Further, in an example in which a person overtaking the person P appears, the image S of the person P to be photographed and the background image are separated from each other, and the time axis of the image S of the person P is made faster than that of the background image to increase the background. (Such as superimposing the image S of the person P performing fast forward reproduction on the background image). However, the effect as shown in FIG. 7B may be realized by simply taking out a certain frame of the video and displaying the frame as a still image on the display means 3, and after the video is cached in the main memory 2b. The effect as shown in FIG. 7 (c) may be realized by fast-forwarding this. Then, the video data or video signal of the video obtained as a result is transmitted to the display means 3.
[0020]
In addition, the display system according to the present embodiment may further include a storage unit 5 that stores the image captured by the imaging unit 1, and the display unit 3 may display the image stored in the storage unit 5. . The storage unit 5 uses, for example, a required storage area of the main memory 2b or the auxiliary storage device 2c mounted on the hardware 2 functioning as an effect synthesizing unit. Incidentally, the image N indicating the video content stored in the storage means 5 and the index of the video content stored in the storage means 5 are displayed on the screen of the display means 3 to notify people of the existence of the video content. You may do so.
[0021]
Further, a recording instruction for instructing that the image photographed by the photographing means 1 is stored in the storage means 5, a reproduction instruction for instructing that the image stored in the storage means 5 is displayed on the display means 3, a fast forward It is preferable to be configured so that playback, playback pause, selection of content to be played, and other control commands can be optically input via the photographing means 1. The display system in this case also includes a command interpreting means 6 for interpreting a control command optically input via the photographing means 1. More specifically, the hardware 2 functioning as the effect synthesizing means also functions as the instruction interpreting means 6 by a program. For example, as shown in FIGS. 10A and 10B, the recording command and the reproduction command are characters and graphics meaning a recording command (FIG. 10A) and a reproduction command (FIG. 10B). And the like, or an object O having a shape meaning a recording instruction and a reproduction instruction.
[0022]
That is, when the object O as described above is presented to the photographing unit 1, a video image of the object O is provided to the command interpreting unit 6. The procedure of the process executed by the command interpreting means 6 will be described with reference to a flowchart shown in FIG. 14. The command interpreting means 6 acquires a photographed video (step S5), and outputs a recording command and a character representing a playback command. , A figure, a shape, and the like are extracted by image analysis to interpret the input command. Typically, template matching is performed by paying attention to geometric features such as characters, graphics, and shapes that mean control commands such as a recording command and a playback command (step S6), and the input command is interpreted. Then, the hardware 2 is controlled in accordance with the interpreted command (step S7), and the video provided by the photographing unit 1 is stored in the storage unit 5, or the video content stored in the storage unit 5 is read and displayed. Or to be displayed. However, a control command may be made using a specific gesture of the person P, and the command interpreting means 6 may analyze these and execute recording or playback.
[0023]
According to the present embodiment, a photographing unit 1 for photographing a predetermined space region R and a person P entering the space region R, an effect synthesizing unit 2 for synthesizing an effect with a video photographed by the photographing unit 1, A display unit 3 for displaying an image obtained by synthesizing the effect by the effect synthesizing unit 2; and the photographing unit 1 and the display unit 3 are installed in a space where the unspecified person P visits to use the unspecified person P. Since the display system that can be provided is configured, the person P present at the place can be the subject of shooting and display. Therefore, the person P present at the place can play and greatly enjoy using the display system. Of course, an advertisement may be displayed in a part of the display area of the display means 3 in the display system. At this time, a higher advertisement effect can be expected as compared with the related art.
[0024]
Since the display means 3 has a size capable of displaying a person P photographed by the photographing means 1 in a substantially life-size manner, the display means 3 is just like a mirror for reflecting oneself, while displaying the image of oneself. The effects are synthesized and show excellent entertainment that can attract everyone's interest.
[0025]
The apparatus further includes measuring means 4 for measuring the time during which the person P who has entered the space area R is present in the space area R or the accumulation thereof, and the effect synthesizing means 2 is measured by the measuring means 4 Since the effect is based on the time during which the person P is present in the spatial region R or an effect corresponding to the accumulation thereof, for example, the length of time that the waiting person P is waiting is It is possible to combine the effects as shown.
[0026]
It further includes a storage unit 5 for storing the image captured by the imaging unit 1, and the display unit 3 is configured to display the image stored in the storage unit 5, so that musicians, entertainers, and other persons can be displayed. Live and performance performed by the user are stored as content, and can be reproduced later. In other words, it is possible to broadcast original content that is never completed, and this also provides amateur musicians, entertainers, and the like with the opportunity to make presentations.
[0027]
A recording instruction optically input through the photographing unit 1 for instructing the storage unit 5 to store the video, and displaying the video stored in the storage unit 5 on the display unit 3. Command interpreting means 6 for interpreting a control command such as a playback command for instructing a recording command or the like, it is not necessary to separately provide an operation input device for inputting a recording command or a playback command.
[0028]
Note that the present invention is not limited to the embodiment described in detail above. In particular, the display system may include a recording unit that records the sound in the spatial region R, and a sound output unit that outputs the sound recorded by the recording unit. In this case, it does not prevent the effect synthesizing unit 2 from synthesizing the effect not only with the video but also with the audio. Furthermore, it does not prevent the storage unit 5 from storing not only video but also audio.
[0029]
This does not prevent the effect synthesizing unit 2 from synthesizing the effect with the video to be stored in the storage unit 5. Further, at the time of reproducing the content, it does not prevent the video stored in the storage unit 5 from being combined with the effect and displayed on the display unit 3.
[0030]
The effect synthesizing means 2 according to the present invention can be configured by installing a program on a personal computer or other general-purpose computer, and it is not essential to manufacture dedicated hardware.
[0031]
In addition, the specific configuration of each unit and the procedure of the processing shown in FIGS. 11 to 14 are not limited to the above embodiment, and various modifications can be made without departing from the spirit of the present invention.
[0032]
【The invention's effect】
According to the present invention described in detail above, it is possible to realize a display system with further improved entertainment.
[Brief description of the drawings]
FIG. 1 is a functional block diagram of a display system according to the present invention. FIG. 2 is a functional block diagram of a display system according to the present invention. FIG. 3 is a functional block diagram of a display system according to the present invention. FIG. 5 is a top view schematically showing an installation mode of the means. FIG. 5 is a top view schematically showing an installation mode of the photographing means and the display means. FIG. 6 is a diagram showing hardware resources included in the display system. FIG. 8 is a view showing an example of an effect by the effect synthesizing means. FIG. 8 is a view showing an example of an RFID tag and an RFID reader. FIG. 9 is a view showing a state in which an image showing video contents stored in the storage means is displayed on the screen of the display means. FIG. 10 is a diagram exemplifying a control command input via the photographing means. FIG. 11 is a flowchart showing a procedure of processing executed by the effect synthesizing means. Chart 12] [Explanation of symbols] a flowchart showing the procedure of processing the flowchart 13 the flow 14 instruction interpreting means is executed
Reference Signs List 1 photographing means 2 effect synthesizing means 3 display means R predetermined space area P unspecified person

Claims (5)

Photographing means for photographing a predetermined space area and a person who has entered the space area;
Effect synthesizing means for synthesizing an effect with the image shot by the shooting means,
Display means for displaying an image obtained by synthesizing the effect by the effect synthesizing means,
A display system in which the photographing unit and the display unit are installed in a space visited by an unspecified person and can be used by an unspecified person. 2. The display system according to claim 1, wherein the display means has a size capable of displaying a person photographed by the photographing means in a substantially life-size manner. The apparatus further includes a measurement unit that measures a time or a cumulative time that the person who has entered the space area is present in the space area,
The display system according to claim 1, wherein the effect synthesizing unit synthesizes an effect measured by the measuring unit according to a time during which the person is present in the space area or an accumulation thereof. The image capturing apparatus further includes a storage unit configured to store an image captured by the imaging unit,
4. The display system according to claim 1, wherein the display unit is configured to display an image stored in the storage unit. A command for optically inputting via the photographing unit, a command for interpreting a control command for controlling recording for storing the video in the storage unit or reproducing for displaying the video stored in the storage unit on the display unit. The display system according to claim 4, further comprising an interpreting unit.

Images