JP2006325161A - Video system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video system capable of controlling a visual effect device by the intention of a player even under performance by the player. <P>SOLUTION: The video system projects a video to a range including an object on the basis of the motion of the object and the video system has an imaging means for imaging the object, an object position detection means for detecting the position of a light source attached to the object from a video signal to be outputted from the imaging means, a control means for selecting or generating a video corresponding to the position or displacement of the light source, and a projection means for projecting the video selected or generated by the control means to a range including the object. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a video system technology. Specifically, the present invention relates to a technique for projecting an image on a range including an object based on the movement of the object such as a musical instrument.

  Traditionally, in music events held at live houses and concert venues, visual effect devices such as multicolored lighting lamps, moving lights, laser beams, electrical boards, etc., can be incorporated to enhance music performance by performers. Many. This visual effect device is operated in accordance with the flow of a song or song.

  By the way, the operation of these visual effect devices is generally operated by an operator, but the labor cost of the operator is required. Moreover, the operation requires a certain level of proficiency, and the operation quality depends on the skill level of the operator.

Thus, a control device for operating the visual effect device is provided, and this control device has been proposed to enable the operation of the visual effect device in accordance with music performed by a performer (for example, Patent Document 1). 2).
Japanese Patent Laid-Open No. 6-222753 JP-T-2004-534356

  According to the configurations of Patent Documents 1 and 2, since the visual effect device can be dynamically operated along with the performance, an operator is not required and the content set in advance is faithful.

  However, in order to operate the visual effect device, it is necessary to perform the setting in advance, and the work becomes complicated. In particular, when there are many songs to be played, this setting operation requires a great deal of labor. In addition, since there are a wide variety of operating contents and combinations of the visual effect devices and it is necessary to consider them, the time spent for producing the visual effects before live performances and concerts becomes enormous.

  In addition, before the start of the live or concert, the setting of the control content of the visual effect device has been completed, so it becomes difficult to change the performance songs and the order that the performer planned during the live or concert. It was.

  On the other hand, performers often add accents to each other while watching the audience to enliven live performances. In particular, rockers in rock bands have a strong desire for self-revelation and often repeat their assertiveness during performances.

  Therefore, an object of the present invention is to provide an image system that can control a visual effect device according to a player's intention even when the player is performing.

  Accordingly, the invention described in claim 1 is an image system that projects an image on a range including the object based on the movement of the object, and includes an imaging unit that images the object, and the imaging unit. Object position detection means for detecting the position of the light source attached to the object from the output video signal, control means for selecting or generating an image corresponding to the position or displacement of the light source, and selection by the control means Or a projection unit that projects the generated image onto a range including the object.

  The invention according to claim 2 is the invention according to claim 1, wherein the projection unit projects an image corresponding to the position of the object on the basis of the position of the light source. And

  The invention according to claim 3 is the invention according to claim 1 or 2, wherein the control means changes the total luminance in accordance with the height or displacement of the light source. An image is projected from the projection means.

  The invention according to claim 4 is the invention according to claim 3, wherein the control means causes the projection means to project a radially expanded image with the position of the light source as a substantially base point. And

  The invention according to claim 5 is the invention according to claim 4, wherein the control means projects the image in which the radial spread or length is changed according to the height of the light source. Projecting from means.

  The invention according to claim 6 is the invention according to claim 2, wherein the control means displays an image in which the amount of a high-intensity shower-like image is changed according to the height of the light source. Projecting from the projection means.

  The invention according to claim 7 is the invention according to claim 1, wherein the control means arranges the same video as the acquired video output from the imaging means on the left and right of the acquired video, respectively. An image obtained by combining the images is projected from the photographing unit.

  Moreover, invention of Claim 8 is invention of any one of Claims 1-7, Comprising: The said light source is an infrared light source, It is characterized by the above-mentioned.

  The invention according to claim 9 is the invention according to any one of claims 1 to 8, wherein the object is a musical instrument such as a guitar or a drum stick.

  The invention described in claim 10 is the invention described in claim 9, further comprising an audio device for inputting an audio signal output from the musical instrument and changing the volume or / and frequency of the audio signal. The control means controls the audio device to change a volume or / and a frequency according to the position of the light source.

  The invention according to claim 11 is the invention according to claim 10, further comprising detection means for inputting an audio signal output from the musical instrument and detecting a volume or / and frequency of the audio signal, The control means selects or generates an image corresponding to the position of the light source and the detection result of the detection means.

  An invention according to claim 12 is the invention according to any one of claims 1 to 8, wherein the object is a mobile phone, and the light source is a display of the mobile phone. Features.

  The invention according to claim 13 is the invention according to claim 12, wherein the type of the display is detected, and an image corresponding to the type of the display and the position of the light source is selected or generated. And

  According to the first aspect of the present invention, since an image corresponding to the movement of the light source attached to the object can be projected on a range including the object, for example, an image projected after the performer is It can be changed easily by moving the instrument in live performances and concerts.

  According to the second aspect of the invention, it is possible to project an image based on the position of the light source, so that the visual effect can be enhanced.

  According to the invention described in claim 3, since the total luminance of the projected image can be changed according to the height and displacement of the light source, the visual effect can be enhanced.

  According to the fourth aspect of the present invention, it is possible to project an image that is radially expanded with the position of the light source as a base point according to the height of the light source, and thus it is possible to enhance the visual effect. .

  According to the fifth aspect of the present invention, it is possible to project an image having a radially expanded or changed length according to the height of the light source, so that it is possible to further enhance the visual effect. .

  According to the invention described in claim 6, it is possible to project an image in which the amount of a high-intensity shower-like image is changed according to the height of the light source. It becomes possible.

  In addition, according to the seventh aspect of the present invention, it is possible to further project a part of the object to the left and right of the object, so that it is possible to further enhance the visual effect.

  According to the invention described in claim 8, since the infrared light source is used as the light source, the detection accuracy of the light source can be increased. Furthermore, since the infrared light source is not visible, it does not give a visual discomfort to the audience.

  According to the ninth aspect of the present invention, it is possible to easily change the video while playing by moving the musical instrument played by the performer.

  Further, according to the invention described in claim 10, since the volume and frequency of the audio signal output from the musical instrument can be changed according to the position of the musical instrument, it is possible to produce a more auditory effect. It becomes.

  According to the eleventh aspect of the present invention, the projected image can be changed depending on the volume and frequency of the audio signal output from the musical instrument in addition to the position of the musical instrument. An effect can be produced.

  According to the twelfth aspect of the invention, since the display can be used as a light source without specially attaching a light source to the mobile phone, a video system having excellent versatility can be provided.

  Further, according to the invention described in claim 13, since the video can be selected according to the type and position of the display of the mobile phone, the visual effect can be further enhanced.

  Embodiments of the present invention will be described below with reference to the drawings. 1 and 2 are diagrams showing the configuration of a video system in the present embodiment.

[Overview of video system]
As shown in FIG. 1, the video system in this embodiment includes a musical instrument 10 as an object, an imaging device 20 as an imaging means, a projection device 30 as a projection means, an audio control device 40, a speaker 41a, b and a computer device 50 are provided. Further, the image projected from the projection device 30 is projected on the screen S. The screen S may be a simple wall.

  The musical instrument 10 is, for example, an electric guitar, and a light source 11 such as a miniature bulb or an infrared light is attached to the tip (guitar head). If the musical instrument 10 is a drum, a light source 11 is attached to the tip of the drum stick used by the player A, the drum stick is made transparent and the light source 11 is attached therein, and a fluorescent paint is applied to the entire drum stick. It can also be made to paint. Alternatively, the microphone 12 may be used as an object instead of the musical instrument 10, and the light source 11 may be attached to the rear end or front end of the microphone.

  The imaging device 20 is set in advance so as to capture a range in which the player A who is playing the musical instrument 10 moves (hereinafter referred to as “imaging range”), and an image including the player A and the musical instrument 10 is displayed. Acquired and output to the computer device 50 as a video signal. When an infrared light is used as the light source 11 attached to the object such as the musical instrument 10, it is desirable to attach an infrared filter to the imaging device 20.

  The projection device 30 projects an image on a screen or wall on the back of the performer based on the video signal output from the computer device 50 over a range equal to or larger than the imaging range of the imaging device 20. . Note that a high-luminance projector or the like is used as the projection device 30.

  The audio control device 40 receives the audio signal output from the musical instrument 10 and the audio signal output from the microphone 12 by the audio interface 42, mixes it by the mixer 43, and outputs it to the speakers 41a, 41b.

  Audio signals output from the musical instrument 10 and the microphone 12 are also output to the computer device 50. Further, the audio control device 40 is provided with a MIDI tone generator 44, which receives MIDI data output from the computer device 50, converts it into an audio signal, and outputs it to the mixer 43. Note that an audio signal may be generated and output in the computer device 50.

  The computer device 50 detects the position of the light source 11 from the video signal output from the imaging device 20, selects or generates a video signal based on the detection result, and outputs the video signal to the projection device 30. As shown in FIG. 2, the computer device 50 includes an object position detection unit 51, a storage unit 52, and a control unit 53.

[Description of each configuration of computer device 50]
The object position detection means 51 receives the video signal output from the imaging device 20, and detects the horizontal position X and the vertical position Y (see FIG. 3) of the light source 11 from this video signal. The light source 11 is detected by detecting the position of an image having a predetermined luminance and a predetermined size from a plurality of frames of video signals. As described above, since the position of the light source 11 is detected from the video signals of a plurality of frames, it is possible to avoid the problem of erroneously detecting the portion having a predetermined luminance or higher caused by light reflection as the light source 11. Further, when the light source 11 is an infrared ray, the possibility of erroneous detection can be further reduced by outputting a video signal taken from the imaging device 20 through an infrared filter.

  In addition, the storage unit 52 stores information about an image to be output from the projection device 30 (hereinafter referred to as “image information”). As this image information, for example, three types of images of large, medium, and small with different sizes of flames are stored as images of flames or images imitating them.

  In the present embodiment, a flame mode, a rain mode, a fireball mode, a survivor mode, and an afterimage mode are provided as modes, but are not limited thereto. The flame mode is a mode in which an image projected from the projection device 30 is a flame or an image imitating it (hereinafter referred to as “flame image”), and the rain mode is an image projected from the projection device 30 in the rain or A mode imitating the image (hereinafter referred to as “rain image”) and a fireball mode are images of a fireball or flame radiation or an image imitating it (hereinafter referred to as “fireball image”). Is a mode in which an image of an object and a player (hereinafter referred to as a “separate object”) is projected from the projection device 30 in proximity to the alternate object, and an afterimage mode is an object. In this mode, the image of the performer (hereinafter referred to as “afterimage target”) is projected from the projection device 30 in the vicinity of the afterimage object as an afterimage for a certain period.

  The storage means 52 stores a video information table in which a plurality of video information is associated with each mode. In the video information table, for example, in the rain mode, heavy rain video information, medium rain video information, and light rain video information are associated as video information 1, 2, and 3, respectively.

  The control means 53 receives the position information of the light source 11 output from the object position detection means 51, and performs control according to this position information. For example, when the video system is in the rain mode, the control unit 53 refers to the video information table in the storage unit 52 and acquires rain video information corresponding to the position information of the light source 11 from the storage unit 52. Based on the above, a rain video is generated and output to the projection device 30 as a video signal. The control means 53 obtains sucking video information when the light source 11 is at a position higher than the first height, and acquires light rain video information when the light source 11 is at a position lower than the second position. .

  Further, the control means 53 continuously receives the position information of the light source 11 output from the object position detection means 51, detects the displacement of the light source 11, and also performs control according to the displacement. For example, when the video system is in the flame mode, the control unit 53 refers to the video information table in the storage unit 52 and acquires flame video information corresponding to the displacement information of the light source 11 from the storage unit 52. Then, a flame image is selected based on the flame image information, and is output to the projection device 30 as a video signal. The control means 53 selects a large flame image from the storage means 52 when the displacement of the light source 11, that is, the temporal fluctuation degree is large, and selects a small flame image from the storage means 52 when the fluctuation degree is small. select.

The operation of the video system configured as described above will be described below for each mode.

[Explanation of flame mode]
As described above, the flame mode is a mode in which a fireball image is projected from the projection device 30, and the operation in this mode will be specifically described with reference to FIG.

  When the video system mode is set to the flame mode by the computer device 50, the control means 53 sequentially acquires the position information of the light source 11 output from the object position detection means 51.

  Subsequently, if the control means 53 determines that the position of the light source 11 is low Y1 based on the received position information, it does not project a flame image (see FIG. 4A). Thereafter, when the position of the light source 11 becomes as high as Y2, the control unit 53 selects a small flame image from the images stored in the storage unit 52 and projects it from the projection device 30 (see FIG. 4B). ). Further, when the position of the light source 11 becomes as high as Y3, the control unit 53 selects a large flame image from the images stored in the storage unit 52 and projects it from the projection device 30 (see FIG. 4C).

  As described above, in the flame mode, the image is changed according to the height of the light source 11, but the image is also changed according to the displacement of the light source 11. That is, the control unit 53 sequentially acquires the position information sequentially output from the object position detection unit 51, calculates the displacement amount of the light source 11 per time, and projects the flame image corresponding to the displacement amount to the projection device 30. Project from.

  In this way, the image projected from the projection device 30 is changed according to the amount of displacement, and the performer who plays the musical instrument 10 projects from the projection device 30 depending on the height and movement of the musical instrument 10. The picture can be changed easily. Audiences who are enjoying the performance of the performer can enjoy this visual effect because the total brightness of the video in the background of the performer changes.

[Explanation of rain mode]
As described above, the rain mode is a mode in which a rain video is projected from the projection device 30, and the operation in this mode will be specifically described with reference to FIG.

  When the video system mode is set to the rain mode by the computer device 50, the control means 53 sequentially acquires the position information of the light source 11 output from the object position detection means 51.

  Subsequently, when the control unit 53 determines that the position of the light source 11 is low Y1 from the acquired position information, it acquires video information of light rain from the storage unit 52, and rain video from the number of rains included in the video information Is generated. In addition, in the generation of this rain video, the starting point of each high-brightness line indicating rain is determined at random, and the vertical length of each line is also determined at random, and sequentially in the horizontal direction. It is done by the method of shifting. The light rain image thus generated is projected from the projection device 30 as shown in FIG.

  Thereafter, when the control means 53 determines that the position of the light source 11 is high Y2 from the acquired position information, the control means 53 acquires the image information of the middle rain from the storage means 52, and from the number of rain included in this image information, the above method Generate a rainy season video. The video generated in this way is projected from the projection device 30 as shown in FIG. Further, when the position of the light source 11 is high Y3, the control unit 53 similarly projects a heavy rain image from the projection device 30 as shown in FIG. 5C based on the heavy rain video information.

  As described above, in the rain mode, the image projected from the projection device 30 is changed according to the height of the light source 11, and the performer who plays the musical instrument 10 uses the light source 11 attached to the musical instrument 10. By changing the height, the image projected from the projection device 30 can be easily changed. As in the flame mode, the type of rain video may be changed based on the amount of displacement of the light source 11. The audience enjoying the performance of the performer can enjoy the effect of this visual effect because the amount of the high-intensity shower-like image reflected in the performer's background changes.

[Explanation of fireball mode]
As described above, the fireball mode is a mode in which a fireball image is projected from the projection device 30, and the operation in this mode will be specifically described with reference to FIG.

  When the video system mode is set to the fireball mode by the computer device 50, the control means 53 sequentially acquires the position information of the light source 11 output from the object position detection means 51.

  Subsequently, the control means 53 randomly determines the length of each high-brightness line indicating a spark within a predetermined range from the acquired position information, using the position of the light source 11 as a reference start point, and determines the angle. A radially expanding image is generated by a method of sequentially shifting. When the position of the light source 11 is Y1, the fireball image is not projected as shown in FIG. 6A, and when the position of the light source is Y2, as shown in FIG. 6B. In the case where the image having a small radial spread is generated and the position of the light source 11 is Y3, a video having a large radial spread is generated and projected from the projection device 30 as shown in FIG. .

  The control means 53 changes the spark length range according to the amount of displacement of the light source 11 from the acquired position information. For example, when the amount of displacement of the light source 11 is large, the spark length image is generated so that the length range of the spark is long, and conversely, when the amount of displacement is small, the spark length image is shortened.

  As described above, in the fireball mode, the image projected from the projection device 30 is changed according to the height and displacement of the light source 11, and the player who plays the instrument 10 is obsessed with the instrument 10. By changing the height and movement amount of the light source 11, the image projected from the projection device 30 can be easily changed.

[Description of alternation mode]
As described above, the alternation mode is a mode in which an image of the subject of the alternation target is generated as an afterimage and an image close to the subject of the alternation for a certain period is generated and projected from the projection device 30. The operation in this mode is illustrated in FIG. This will be described in detail.

  When the video system mode is set to the alternation mode by the computer device 50, the control means 53 sequentially acquires the position information of the light source 11 output from the object position detection means 51 and outputs it from the imaging device 20. The video signal to be played is acquired.

  Subsequently, the control means 53 determines the position of the light source 11 from the acquired position information, generates an image obtained by shifting the acquired image by a predetermined distance to the left, and generates an image obtained by shifting the acquired image by a predetermined distance to the right. To do. Then, the generated video is synthesized and projected from the projection device 30 as shown in FIG.

  Note that the control means 53 may increase or decrease the number to be divided according to the amount of displacement of the light source 11 from the acquired position information. For example, when the displacement amount is large, two videos are generated by shifting the acquired video by a predetermined distance to the left, and two videos are generated by shifting the acquired video by a predetermined distance to the right. Then, the generated video is synthesized and output from the projection device 30.

  As described above, in the split mode, the split image is projected from the projection device 30, but may be combined with the flame mode, the rain mode, the fireball mode, and the like.

[Description of afterimage mode]
As described above, the afterimage mode is a mode in which an afterimage target video is generated in the vicinity of the afterimage target and projected from the projection device 30. The operation in this mode is specifically described with reference to FIG. Explained.

  When the video system mode is set to the afterimage mode by the computer device 50, the control means 53 sequentially acquires the position information of the light source 11 output from the object position detection means 51 and outputs it from the imaging device 20. The video signal to be played is acquired.

  Subsequently, the control means 53 determines the position and displacement amount of the light source 11 from the acquired position information, and displays the generated afterimage image from when the displacement amount becomes equal to or greater than a predetermined value until it becomes equal to or less than the predetermined value. To project for a predetermined time. An example of an image projected from the projection device 30 in this way is shown in FIG. Note that the afterimage can be generated by, for example, synthesizing one frame of video one second before and two seconds before from the acquired video signal into one video. Further, FIG. 8A is an image two seconds before FIG. 8B.

  Note that the afterimage image may be, for example, an afterimage image of a rainbow color instead of an image of an object or a player. For example, the rainbow afterimage image generates a rainbow image in a horizontal displacement range (moving range) from the second second to the present time and in a predetermined height range, and projects it from the projection device 30. You can also.

[Description of other modes]
In addition to the above-described mode, a psychedelic mode for projecting a psychedelic image is also provided. The operation of this mode will be described below.

  When the video system mode is set to this mode by the computer device 50, the control means 53 acquires the video signal output from the imaging device 20.

  Subsequently, the control means 53 sequentially captures the acquired video signal and detects a change between the current video or a video at a certain time and the video 1/30 seconds before. After detecting the change of the video in this way, the video is generated such that the portion where the change is not detected is a white video and the detected portion is a black video. Then, the control means 53 performs loop control to add a video whose luminance is changed after converting the video size at the current time or a certain time to a predetermined magnification to the video generated in this way, and generates a psychedelic video. Project from the imaging device 20.

[Description of mode setting and change]
Here, setting and changing of the mode will be described. The video system of the present embodiment has a plurality of modes as described above, and the selection and change are (a) selection and change by input from an input means (not shown) of the computer device 50; (B) Selection and change based on audio signals from the musical instrument 10 and the microphone 12, (c) Selection and change based on the displacement or position of the light source 11, and (d) Change based on time.

  First, the mode setting and change in (a) will be described. The computer device 50 has input means such as a keyboard (not shown), and the mode is set and changed by input from the input means. For example, when the operator of the computer apparatus 50 inputs a mode change from the input means in accordance with the progress of live performance or the like, the control means 53 performs control by switching the mode according to the input from the input means.

  Note that a foot switch may be provided near the performer and used as an input means. For example, the mode is set or operated depending on how many times the foot switch is stepped on for a predetermined time (for example, 5 seconds). For example, the rain mode is set when it is stepped once, the flame mode is set when it is stepped twice, and the alternation mode is set when it is stepped three times. Also, a plurality of foot switches may be provided, and switching may be performed in association with the mode for each foot switch.

  Next, mode setting and change in (b) will be described. An audio signal from the musical instrument 10 and the microphone 12 is input to the control means 53 from the audio interface 42, and the mode is set and changed based on the audio signal.

  For example, when a predetermined keyword is input from the microphone 12, the control unit 53 can recognize the voice to select the mode. As this keyword, a keyword that is not included in a song or a shout is selected and set in the storage means 52 in advance.

  Further, based on the audio signal from the musical instrument 10, the control means 53 can extract the rhythm and tempo of the song being played, and can select a mode corresponding to the rhythm and tempo. The control means 53 selects the rain mode for a relatively quiet song and the flame mode for a fast-tempo song. Instead of selecting a mode for each song, it is also possible to change the mode at the change of rhythm or tempo in the song.

  Also, the mode can be changed when the audio signal from the musical instrument 10 is interrupted for a long period. This makes it easy to change the mode for each song. When the audio signal is interrupted, the mode may be selected not only for each song but also for each song, such as selecting the rain mode.

  Next, mode setting and change in (c) will be described. The control means 53 detects the displacement or position of the light source 11, and sets or changes the mode based on the detection result. For example, the mode is changed by moving the musical instrument 10 by a predetermined distance in the horizontal direction, or the mode is changed by moving the position of the light source 11 to the highest position. It is also possible to switch the mode by detecting when the light source 11 attached to the musical instrument 10 of a plurality of players approaches. In this way, the performer can easily change the mode by performing a predetermined operation.

  Next, mode setting and change in (d) will be described. In this mode setting and change, the mode is changed every predetermined time, for example, every two minutes, the time is counted by the control means 53, and the modes are sequentially changed. This time may be changed randomly.

  As described above, the mode can be set and changed as shown in (a) to (d), but is not limited thereto, and the mode may be set or changed by a combination thereof.

  In the present embodiment, an image corresponding to the position or displacement of the light source 11 is selected or generated, and the image is projected onto a range including the object. However, in addition to this image or instead of this image, the image is projected. Depending on the position and displacement of the light source 11, the audio interface 42 may be controlled to change the volume and frequency of the audio signal output from the musical instrument 10, the microphone 12, and the computer device 50. For example, when the position of the light source 11 is increased, the volume is increased or the frequency is changed.

  In addition, as a change in the volume and frequency of the audio signal, the audio interface 42 detects the frequency of the audio signal and changes the value of the frequency or synthesizes the frequency corresponding to the frequency. May be. For example, when the audio interface 42 is set to convert an input audio signal to a sound of a C major scale, an audio signal having a frequency that does not correspond to a sound of the C major scale among the input audio signals. The audio interface 42 operates so as to convert the frequency into a frequency that can be accommodated in the sound of the C major scale and output it.

  In addition, a mode may be provided in which a sound with a height corresponding to the height of the light source 11 is output from the speakers 41a and 41b. That is, when this mode is set in the computer device 50, the control unit 53 acquires the position information of the light source 11 output from the object position detection unit 51, and determines the position of the light source 11. Then, a sound having a height corresponding to the height of the light source 11 is generated as an audio signal. By repeating this operation, it is possible to generate and output a melody simply by moving the position of the object.

  In addition to the position or displacement of the light source 11, each mode may be controlled or changed between modes based on the volume and frequency of the audio signal output from the musical instrument 10 and the microphone 12. For example, when the control is performed in the fireball mode or the rain mode, the color of the fireball or rain is changed according to the volume or frequency of the audio signal.

  In the present embodiment, an electric guitar has been described as an example of the musical instrument 10, but a drum can also be targeted. In this case, the light source 11 is attached to two places, a drum and a drum stick, and various images are projected from the projection device 30 by detecting these light sources 11.

  For example, the control unit 53 detects the position and displacement of the light source 11 attached to the drumstick, selects or generates an image based on the detection result, and projects the image from the projection device 30. In the fireball mode or the flame mode, a visual effect that emphasizes the drum is obtained by selecting or generating an image based on the position of the light source 11 attached to the drum and projecting it from the projection device 30. It becomes possible. 9A shows a state before the projection of the image from the projection device 30, and FIG. 9B shows a state in which a large flame image is projected from the projection device 30 when the drummer raises the drumstick. Is shown.

  In addition, when an audio signal from the drum is input, the control means 53 can change the video according to the size and frequency of the audio signal. Further, the control means 53 detects from which part of the drum the audio signal is, selects an image based on that part from the generation or storage means 52 and projects it from the projection device 30. In addition, by arranging the light source 11 having a different color or shape on each part of the drum or the drum stick, it is possible to detect the position of each part and use those parts as a reference.

  In the above-described embodiment, the object is described as a musical instrument, but a mobile phone may be used as the object. In this case, a video system is configured using the display as a light source.

  For example, based on the video signal output from the imaging device 20, the object position detection means 51 detects the position of the display of the mobile phone, and changes the image projected from the projection device 30 according to the height of the display. . When the mobile phone is at the position of height Y3, as shown in FIG. 10A, when a green image is projected from the projection device 30 and the height of the mobile phone becomes Y4, FIG. ), A blue image is projected from the projection device 30.

  If the height of the display is changed with reference to the position of the display of the mobile phone, the image of the heart as shown in FIG. 11 (a) changes to the image of the star as shown in FIG. 11 (b). It can also be done.

  Furthermore, a type such as the size and shape of the display of the mobile phone may be detected, and an image based on a pattern corresponding to the detected type may be projected. For example, when the display size is large, a rainbow image is projected when the height of the mobile phone is set to Y4.

  Note that the size of the display of the mobile phone may be not the actual size but the size in the video when the image is captured by the imaging device 20. In this way, size detection becomes easy. The display is detected in a state where a display backlight or a front light (hereinafter referred to as “light”) is driven in the mobile phone.

  In addition, the display light of the mobile phone is turned on. Depending on the number of times of OFF, the pattern of FIG. 10 can be changed to the pattern of FIG. 11, that is, the mode can be changed.

  As described above, by using the display of the mobile phone, for example, in a karaoke box, it is possible to easily produce a visual effect, and it is possible to further improve entertainment.

  Note that a melody may be generated and output by associating the pitch of the light source 11 with the pitch of the sound. For example, if the control means 53 determines that the karaoke song being played is the C major, a table corresponding to the C major is obtained from the storage means 52, and the sound corresponding to the height of the light source 11 is referred to this table. And output from the speakers 41a, 41b. FIG. 12A shows the relationship between the height of the light source 11 and the pitch of the sound when the song is C major, and this relationship is a table stored in the storage means 52. By doing in this way, since the melody suitable for the music currently played in karaoke is produced, it becomes possible for anyone to play a melody according to karaoke. FIG. 12B shows the relationship between the height of the light source 11 and the pitch of the sound when the song is C minor.

  Further, in the present embodiment, the object position detection means 51 detects the light source 11, so that the control means 53 performs various controls based on this detection information. An object (for example, a player) may be identified by image recognition to detect the object.

The figure which showed the whole structure of the video system which concerns on one Embodiment of this invention. The block diagram of an imaging | video system. The figure for demonstrating the positional information on a light source. Explanatory drawing of flame mode. Explanatory drawing of rain mode. Explanatory drawing of fireball mode. Explanatory drawing of alternation mode. Explanatory drawing of afterimage mode. The figure which shows the projection image | video with respect to a drum. The figure which shows the projection image | video with respect to a mobile telephone. The figure which shows the projection image | video with respect to a mobile telephone. The figure which shows the relationship between the height of a mobile telephone, and the pitch of a sound.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Musical instrument 20 Imaging apparatus 30 Projection apparatus 40 Audio control apparatus 50 Computer apparatus 51 Object position detection means 52 Memory | storage means 53 Control means

Claims (13)

An image system that projects an image on a range including the object based on the movement of the object,
Imaging means for imaging the object;
An object position detecting means for detecting a position of a light source attached to the object from a video signal output from the imaging means;
Control means for selecting or generating an image corresponding to the position or displacement of the light source;
An image system comprising: a projecting unit that projects an image selected or generated by the control unit onto a range including the object.   The video system according to claim 1, wherein the projection unit projects an image corresponding to the position of the object with the position of the light source as a reference. The control means includes
3. The video system according to claim 1, wherein an image having a total luminance changed according to a height or displacement of the light source is projected from the projection unit. The control means includes
The video system according to claim 3, wherein an image that is radially expanded with the position of the light source as a substantially base point is projected from the projection unit. The control means includes
5. The video system according to claim 4, wherein the projection unit projects an image in which the radial spread or length is changed in accordance with the height of the light source. The control means includes
3. The video system according to claim 2, wherein an image in which an amount of a high-intensity shower-like image is changed in accordance with a height of the light source is projected from the projection unit. The control means includes
The video system according to claim 1, wherein a video obtained by synthesizing videos obtained by arranging the same video as the acquired video output from the imaging unit on the left and right sides of the acquired video is projected from the imaging unit.   The video system according to claim 1, wherein the light source is an infrared light source.   The video system according to claim 1, wherein the object is a musical instrument such as a guitar or a drum stick. An audio device for inputting an audio signal output from the musical instrument and changing a volume or / and a frequency of the audio signal;
The control means includes
The video system according to claim 9, wherein the audio device is controlled to change a volume or / and a frequency according to a position of the light source. An audio signal output from the musical instrument is input, and a detection means for detecting the volume or / and frequency of the audio signal is provided.
The control means includes
The video system according to claim 10, wherein a video corresponding to a position of the light source and a detection result of the detection unit is selected or generated.   The video system according to claim 1, wherein the object is a mobile phone, and the light source is a display of the mobile phone. The control means includes
The video system according to claim 12, wherein a type of the display is detected, and a video corresponding to the type of the display and the position of the light source is selected or generated.

Images