JP6833313B2 - Electronic musical instrument that makes full use of light receiving elements - Google Patents

Description

Musical instrument PC smartphone Light receiving element

As an instrument that makes full use of a light receiving sensor (light receiving element), there is a light receiving type keyboard system that is sensitive to the keyboard movement angle of a keyboard with a reflector of Japanese Patent Application No. H06-298573 regarding a piano keyboard device.
Further, in the patent registration of P-5396420, a delicate detection method of reflected light converted from irradiation light, which is a reading means related to an optical disc medium recording / reading technique, can be mentioned.
In addition, the reflection of light using a polygon mirror was used as a performance navigator to instruct on the keyboard (JP5-241494 1993-09-21), and the keyboard with a built-in optical sensor was illuminated by holding the light source in a human hand. It was confirmed by the advanced technology survey that the performance (JP63-121092 1988-05-25) etc.

CDs and DVDs, which are typical means of playing music using light reflection, are systems that read signals that are stored and fixed by light irradiation, and cannot perform perceptual conversion (operation) in real time. (Control of reflection, etc.) seems to be a big difference from this idea. The navigator system for keyboard instruments that uses polygon mirrors described in the previous technology (JP5-241494) is a precision and elaborate technology that includes polygon mirrors, but it is not a technology that can be controlled by human perception, and memory is fixed. It can be seen that the operation in which the signal from the music data, the limited light source, and the polygon mirror are linked is indispensable technology.
In addition, there is no description of applied technology to others, and it seems that the technology cannot be operated by the same perceptual operation as the DVD or CD optical disc technology.
In addition, regarding the method of irradiating the note name scale of a keyboard instrument using a light reflector, it cannot be easily denied when asked about the preceding technology, but the technical details of (JP5-241494) are not described in detail. From this, it can be seen that it is an application from other conventional techniques, but this invention does not invent the difference in technical details similar to the previous technique regarding the irradiation method using the polygon mirror.
The present invention is a technology based on the premise that various lights can be used as a light source for creating music, and can be combined with a video camera shooting function such as a smartphone that anyone can carry around. Etc. are also technologies that will be explained later.
I'm sorry to repeat that, but the literature of the prior art (JP5-241494) states "... multiple light sources that can be irradiated ...", but all of these are linked with precise and elaborate light irradiation means based on the stored data. There is a description of how it works, and it seems that the technology cannot be applied to light sources other than those linked with stored data.
The light used in this technique is a technique of irradiating a polygon mirror with a signal from stored music data and reproducing the reflected position on the keyboard, and the effect of the invention is completely different.
(The meaning of perception is used to mean recognizing the situation on the spot through sensory organs such as sight and hearing, and perceptual operation is an abbreviation for operating machines by activating various human senses.)

Many electronic musical instruments based on the MIDI standard are posted on the Internet, and a program that allows you to join and play multiple and various musical instruments under computer control and the evolution of conversion technology for musical instrument performance methods using a performance controller. These are now softened, and even performances on PCs and automatic composition software are on sale.

However, from simple Internet browsing, various lights in everyday life (room lighting, street lights, city illuminations, various lights in the video screen, etc.) can be used as light sources to play sounds and melodies. With a light reflector equipped with a freely movable function that enables perceptual operation of light incident from an incident port, which has a feature that can be used for the above and has a function of setting and adjusting light from the various light sources. , The controller that performs the perceptual operation of the light reflector (divided into the right-handed side and the left-handed side when playing a wind instrument, and the finger holes that can handle the performance of multiple wind instruments are arranged, and the sound name of each wind instrument of multiple wind instruments While playing an electronic wind instrument using the electronic conversion by the synthesizer function that memorizes the finger hole pattern of the tone scale and the breath controller, lever controller, etc., connect to the control of the light reflector equipped with the freely movable function or the synthesizer function. By operating a control lever (including a control lever that has the characteristic of enabling other functions to be operated at the same time as playing a wind instrument), light receiving is divided according to the note name scale connected to an electronic musical instrument, synthesizer, etc. A sensor (light receiving element) is perceived to be irradiated, and the light receiving sensor (light receiving element) that receives the perceived irradiation by the light reflecting plate detects and senses the light to create a change in sound and play a melody. There wasn't.

JP-A-2008-194933 Japanese Patent Application No. 1994-298573 P-5396420 (JP63-121092A-Yamaha Corporation) 1988-05-25 (JP5-241494A-Casio Computer Co., Ltd.) 1993-09-21

nothing special

The object of the present invention is to excavate music and melody from light, mainly street lights, and illuminations of the city, which are always familiar in daily life, and music is used as various light sources that are the roots related to the excavation. Is to create a way to convert to.

It will be a simple explanation as a means to solve the problem, but it was selected from the incident port equipped with the function of selecting, setting, adjusting, etc. of various lights and light sources for playing the melody, and the incident port. By controlling the reflection of light by a freely movable light reflector that can be perceived, it irradiates the sound name that delivers the signal to the sound module or electronic musical instrument, and the light receiving element that is divided by scale to create a change in sound. I devised a playing method.

We believe that the general musical instrument size of the electronic musical instrument devised this time can be expected to perform at live performances and concert halls, which will attract an unprecedented audience.
Various hardware such as PCs, smartphones, NES, drive recorders, etc. that can be linked to the shooting function section of a small video camera by digitizing the functional information and operation function information of the musical instrument described in item 0009 and converting it to software. It is an electronic musical instrument that can be installed on a wear device to enjoy musical instrument functions in various places with light.

FIG. 1 shows a light reflector equipped with a mechanism that enables reflection of light and light rays from an incident port and an incident port in all directions, and a light receiving element or light that senses the reflection and delivers a signal of the sound name scale. An explanatory diagram showing an example of a keyboard with a built-in sensor for connection to a signal storage device, a PC, self-operated music software, an electronic musical instrument of MIDI system, etc. Fig. 2 is a composite diagram of other systems with a freely movable light reflector light receiving sensor (light receiving element). Arrow lines indicate the basic system for sound creation. Arrow dotted lines indicate the system when the light source is diverted from a video camera function such as a smartphone. Description FIG. 3 shows a projection drawing in which a freely movable light reflector and a light receiving sensor (light receiving element) joined to an electronic musical instrument are incorporated in the shooting function of a video camera body of a CCD or CMOS image sensor system, and the relationship with the computerization of the system. Device and connection example The upper part shows the improved freely movable light reflector with the addition of a laser beam lamp, and the lower part is an explanatory diagram of the new synthesizer, which is a conventional synthesizer with an electronic wind instrument divided into two parts, a right-handed side and a left-handed side. It is a picture of, and each end divided into two is connected to the end of the freely movable light reflector controller based on the conventional synthesizer, etc., enabling ensemble with the freely movable light reflector while playing a wind instrument. Also, an example of a synthesizer that has a controller connection end that incorporates a circuit that enables conversion to connection to various devices that activate lighting equipment and performance production systems related to the performance while playing an electronic wind instrument. Outline explanatory diagram

As an explanation of the reason and background of the present invention, it is always noticeable when driving a car at night.
A musical note-like streetlight that takes into consideration the dangers of dark roads.
The existence of the streetlight is usually a natural sight, and it seems that it is not something to be noticed.
However, while listening to his favorite music in a car, he was fascinated by the lights of the many streetlights that flowed during night driving, and began to think about the points of contact with music.
That's why I came up with a system that converts this flowing streetlight into music.

At first, I imagined the sunroof part of a car as a piano keyboard that detects light and makes a sound, and imagined the music created from the passage of light, but there is little change and it is difficult to produce many songs. The excess must be repeated. There is no way to be allowed to make sounds that make such dangerous driving.

Therefore, the light of the flowing street light is reflected by a reflector that enables free movement, the reflection angle of the reflector is controlled, the rotation speed of the reflector is controlled, and the light, light rays, etc. are received by the light receiving sensor. (Light receiving element) We devised a method of irradiating the keyboard to create a change in sound. With this method, it is possible to create a wide range of sounds at a constant speed, during normal driving, and even when the vehicle is stopped, and the music that can be created when the car is moving has changed to music that can be created with light.
(It is assumed that the operation of musical instruments is limited to passengers other than the driver)

Although the simple background and ingenuity up to the invention have been described in the above sections 0012 to 0014, the description of the freely movable light reflector and the light receiving sensor (light receiving element) detection type electronic musical instrument, which is the name of the invention, will be added.
I think that everyone played with a mirror in their hands and reflected the sunlight to the position they aimed at when they were young, but it is easy to understand how to play it. The light from a preset light source is controlled by using a reflector to play the light receiving sensor (light receiving element) keyboard. Here, the operation of holding the reflector in hand and controlling it is mechanized. It is easy to understand if you think of it as a freely movable light reflector.
As the basic structure of the present invention, various lights, light sources, wavelengths, light quantities, etc. are detected, selected, and set.
An incident port equipped with a function for making adjustments, a light reflector and a controller for freely controlling the reflection of the incident light to produce a sound, and a sound detection signal of the light emitted by the light reflector. It is an electronic musical instrument composed of a light receiving element that enables distribution for each famous sound scale and a synthesizer (sound source module, etc.) that converts the signal distributed from the light receiving element into various sounds.

The mechanism briefly explained in Section 0014 is included in the explanation using drawings.
Reference numeral A in FIG. 1 is a light receiving sensor (light receiving element) keyboard, and FIG. 1 is a diagram in which light controlled by a freely movable reflector is applied to the (arrow) keyboard. The keyboard is divided into sound names and scales by a light receiving sensor (light receiving element), and the light incident from the code E in Fig. 1 is controlled by a perceptual operation on the freely movable light reflector, and the keyboard is irradiated with sound. Explains the mechanism of playing a melody.
Flexible movable reflector Fig. 1A has a triangular shape, but there is a part that may be pentagonal or hexagonal, or a mirror plate on one side that is not a polygon mirror (rotating multi-sided mirror), and reciprocating movement by rotation or change of rotation direction, etc. It is also one of the functions that is also used for the operation of separating the sound from the sound by using the light reflection interval of the light, and the melody is electronically controlled by programming the timing of the sound division and the rotation speed of the reflector. It is a part that enables easy perceptual manipulation in playing. Then, as a function to forcibly create a break in the sound, a method such as incorporating a function to easily fix the reflector to a position where the light receiving sensor is not irradiated by an operation such as a fingertip is required in the controller, but a combination such as electronic control is required. Details are for future work.
In addition, specifications that improve light reflection controllability by making the reflective surface of the reflector curved are easy by configuring a calculation program based on the specifications of the reflective surface of the light reflector in the electronic simulation operation. This freely movable reflector can be rotated in both left and right directions, the rotation speed can be controlled, and the functional structure method does not matter as long as it is a mechanism form that can be freely moved up and down, left and right, or freely.

The symbol B is a fixed base of a freely movable light reflector, and is a mechanism that enables movement in all directions by a free movement, that is, a perceptual operation (the symbols B1 and B2 are the movable directional arrows), and this free movement. It is one of the functions to create a change in sound by irradiating light from various light sources by reflection and controlling the irradiation to the light receiving sensor (light receiving element) keyboard, and as explained in the previous section 0016, it is freely movable. The mechanism that accompanies this can be any specification, and it can be expected to compose the sound by combining this with changes in light and light sources due to the movement of the entire body (see moving images such as drive recorders). The rotation of the reflector of the D part and the freely movable light reflector of reference numeral B1B2 have a function of operating a plurality of patterns by a program and enable automatic performance. Future tasks include moving force and a freely movable light reflector. It is a fusion of the operation program of the above and the program of the self-operated music software on the market. (See Fig. 2)
In addition, we think that the way of enjoying can be doubled by adding a function to widen the range of sound change by combining a vibration function that adds ambiguous changes in the reflected light as needed.

Reference numeral C is an explanatory diagram of the main body of the reflector, and as described in item 0016, the image of the reflector happens to be composed of three surfaces, but it is a part that can be changed from one surface on one side to multiple surfaces depending on the purpose. There is no particular designation of a polygon mirror, but rather a mirror plate (light reflector) on one side of a flat surface is considered to be easier to use in terms of perceptual operability, and there is no limitation on specification changes.
Continue to devise light reflectors.
The structure is such that the rotation can be controlled in both directions indicated by the arrows of the reference numeral B4 with the vicinity of the reference numeral D as an axis, and the dotted line of the main body of the reference numeral C2 arranges a number of small motors divided on the rotation axis in the rotation of the main body of the reflector. It is a dotted line that enables divisional movement by such means and represents the boundary line.
In addition to the method shown in the example diagram in which the rotation axis is shared, a light receiving sensor (light receiving element) that matches the performance of various musical instruments by using a method in which a plurality of freely movable light reflecting plates are individually moved independently. By arranging multiple light sources and combining electronic control and perceptual operation for light distribution irradiation, and by devising a specification that adds multiple incident ports equipped with a function for adjusting the setting of light from a light source, etc., only one electron It is a system that is not impossible from musical instruments, such as band group performances of 4 to 5 people and multiple performances of dozens of units like an orchestra.

Reference numeral D is a diagram of a part accommodating a control circuit of a freely movable light reflector, which is a simple image as a receiving unit for remote control, and reference numeral E is a simple image indicating an incident port lens for light and light rays. It is a figure.
A light source to be converted into music is set, light or light rays from the light source are incident on the freely movable light reflector from the incident port of the reference numeral E, and the reflection of the incident light is controlled to control the light receiving sensor (light receiving element). ) This is a picture explaining the mechanism of illuminating the keyboard to make a sound as a simple example.

In addition, as details about the incident port equipped with light and light source setting, adjustment, and selection functions, from the viewpoint of playing a melody of light and light sources that apply setting functions such as subject brightness, focus, and zoom when shooting with a camera. The adjustment is the function to make it clear.
Then, we decided the light and light source that creates sound by diverting triangular survey, radio wave survey, and the latest surveying technology, and the exact positional relationship between the position of the light and light source and the light reflector and the light receiving element, and the angle of the reflector. By numerically extracting the irradiation position due to changes in the light source and processing it with a computer program prepared in advance, it is set to support accurate and accurate performance even in the operation of simulating an electronic musical instrument.
Then, as a function to select which light to convert from the light into sound in various places full of light, specifically, the intensity by extracting the amount of light, wavelength, etc. is determined steplessly and the light is fixed. Therefore, the function that enables avoidance from a light source with a strong amount of light is selected.
Since it is not yet in practical use, it is thought that new technology will be introduced over time, so at this point it is difficult to limit the details of functions related to functions such as setting, adjusting, and selecting light and light sources related to the entrance port. It's just an explanation.

Next, from a mechanical engineering point of view, a system for playing the light receiving sensor (light receiving element) key by controlling the reflection of the light from the light source set in items 0016 to 0020 and the light beam from the incident port by the movable light reflector. By converting the information into electronic (3DCG, etc.) and softening it, it is possible to install it on a hardware device (PC, smartphone, drive recorder, Famicom, etc.) that enables the video camera function and its imaging. By making it possible to operate the simulation of the board, it is also possible to play the light incident from the camera lens of the PC, smartphone, drive recorder with the screen touch of the smartphone or the keyboard of the PC, and the MIDY system that meets other needs. We believe that connecting electronic instruments such as performance controllers and synthesizers will lead to the creation of technical performance performance.

A description will be added regarding the minimum digitized functional information required for converting and using the electronic musical instrument functions described in items 0016 to 0020 to software.
The configuration of the invented electronic musical instrument is roughly classified into the four described in 0015.
1 Incident port equipped with a function to detect light, light source, wavelength, amount of light, etc. and make selection, setting, adjustment, etc.
2 A light reflector for freely controlling the reflection of incident light to produce sound, and a controller that can remotely control the perceptual operation of the light reflector 3 Light emitted by the light reflector A light receiving element that enables distribution of detection signals for each sound name scale. 4 It is composed of a synthesizer (sound source module, etc.) that converts the signal delivered from the light receiving element into various sounds.
Regarding the first of the configurations of the electronic musical instrument this time, the entrance port, the setting, adjustment and selection of light outside the hardware that uses the musical instrument function after conversion to software, or the video and image recorded on the hardware It depends on the light settings and adjustments inside.
When selecting and adjusting the light outside the hardware, the detection system signal provided at the entrance port is electronic because it uses the detection information that is digitized regardless of whether it is combined with the camera shooting function. The conversion process can be used as it is.
Next, when selecting and setting and adjusting the light in the image or image on the screen of the hardware that is blocked from the outside of the hardware, the position of the light is simply based on a number of actual data. Pre-program and use specifications that can determine the relationship.
However, both of the above-mentioned description regarding the video or image taken by the incident port having the light setting, adjustment and selection function outside the hardware and recorded and stored by superimposing the information of the incident port function on the video or image. Specifications that can be used with the functions of are also possible.

Information on the freely movable mechanism of the light reflector that enables the light set at the second and first incident ports of the configuration to be reflected in all directions and the delicate position of the light emitted from the angle of the reflector. Information will be digitized, and information such as specifications that the mechanism enables remote control and operates in conjunction with the remote-controlled controller will also be digitized.
Regarding the optical sensor light receiving element that receives the irradiation by the freely movable light reflector, the position and time of irradiation from the freely movable light reflector in the light receiving plates divided by the sound name scale, and The function of calculating the collation of information from the configuration 1 and transmitting the signal to the synthesizer and the sound module is digitized.
Since the sound module in the synthesizer that converts the signal delivered from the fourth configuration and the configuration 3 into sound is originally digitized, it is used as it is. In addition, it is possible to divert the sound module software already on the market that displays the device as a simulation image on the hardware screen.
It is possible to combine various digitized functions around the electronic musical instrument, which is composed of the above four electronic musical instruments and converted into software, and the application of the musical instrument invented this time. I think that it can be expected to be diverted.
The wording (light or light ray ...) Cited in this specification is considered to be in the range from infrared rays to ultraviolet rays recognized in the field of optics, so the electron of system information in the above item 0021 When the conversion process to (3DCG, etc.) is performed and the image is replaced with a simulated image, the range of light and light rays will be described so as to include a level at which the amount of light can be measured even in a simulated manner.

Next, the outline of the mechanism of the freely movable reflective light receiving instrument from 0016 to 0022, and the theoretical outline of the examples and the technology to be added according to this mechanism (composite of CCD or CMOS image sensor and 3DCG, etc.) are briefly described. explain.
FIG. 3 is a projection view of the main body of the photographing function unit containing a lens unit that captures a subject such as a digital camera, a CCD, and a CMOS image sensor, and a device (reference numeral R) for producing sound in the lens unit. It is a simple explanatory drawing which incorporated the board and the light-receiving sensor (light-receiving element) keyboard which is joined to an electronic musical instrument (reference numeral A), a sound module, and the like.

As a supplement from the drawing, a device for playing sound (reference numeral R), a freely movable light reflector, and a light receiving sensor joined to an electronic musical instrument (reference numeral A) at a position that does not affect the camera and video recording function. It is explained that a new way of enjoying light and sound is attached as an addition of new functions on the premise that the (light receiving element) keyboard is arranged and the smartphone, drive recorder, and PC can be used as before. It seems easy to understand.

This is a system in which the freely movable light reflector shown in FIG. 3 (reference numeral R) is manually controlled (such as a controller) to irradiate the light receiving sensor (light receiving element) key of (reference numeral A) with light or light rays to produce sound (reference numeral R). ), By programming multiple movements of the freely movable light reflector and making it compatible with automatic composition software, etc., automatic composition selected from the programs is also possible, as explained in item 0017. It's a light.

The pursuit of excellent melodies is still an issue for the future, but here are some ways to enjoy the functions described in items 0024 to 0026 on smartphones.

For example, in a room, any lighting can be used, and by simply placing the camera lens toward the light source, the settings including the automatic performance of the part (reference numeral R) in Fig. 3 can be heard and edited. In addition, I think that the enjoyment will be doubled by combining the ability to listen to the performance of a music box-like flowing streetlight just by placing it on the dashboard of a car and the function of combining the melody with beats. .. In addition, the camera lens part can be divided (or a dedicated optional camera lens) as a single unit, the light you want to make music is set, the camera lens part is fixed, and the (code R) part is displayed on the control touch screen installed on the smartphone body. It is possible to follow the light and play the sound while watching the camera image under its own control, and it is not impossible to share the music composition with friends who are far away. In addition, it is possible to play sounds and melody from the same video recorded by taking advantage of the video camera function over and over again, and eventually it is excellent for creating music dedicated to the musical instrument system devised this time. It is possible that an optical image will be composed, and this is a future issue.

In the description of items 0024 to 0028, a device for playing sound (reference numeral R), a freely movable light reflector, and a device (reference numeral R) for playing sound in a main body containing a lens unit for capturing a subject of a digital camera and a CCD or CMOS image sensor. (Code A) It is a figure in which a light receiving sensor (light receiving element) keyboard joined to an electronic musical instrument is incorporated, and the description given in Sections 0021 to 0023 is repeated, but the incident port of the electronic musical instrument system is a video camera or the like. By diverting an incident lens for shooting from a device equipped with a video camera function and incorporating the electronic musical instrument system inside the video camera shooting function (see Fig. 3), the light source can be used while viewing the video screen of the subject by the video camera function. It is theoretically possible to set and adjust the light of the camera, but when operating while visually observing the monitor and the freely movable light reflector, the size of the equipment to be incorporated depends on the arrangement of the monitor and the instrument device. There is no problem if there are no restrictions, but for equipment with a shooting function that fits in a pocket, it is indispensable to combine a freely movable light reflector and a light receiving element simulation on the video screen.

Before moving on to the next explanation, the explanations up to the preceding paragraph 0029 of the specification so far will be briefly summarized.
The theoretical technical details regarding the function of the electronic musical instrument invented this time, the explanation that this electronic musical instrument can be combined with the video camera function, and when combining with the video camera, this electronic musical instrument is digitized and converted into software for PC and I have explained that it is possible to combine it with a smartphone, drive recorder, etc. Next, the description related to the reference numeral W in FIG. 3 accompanying the digitization will be given.

A new function is incorporated in FIGS. 3 (reference numeral R) and (reference numeral A) for the purpose of producing sound from light in a CCD or CMOS image sensor type camera. However, it is not easy to incorporate this device into a very small shooting function unit and spread it.
(Code W) is a combination of a video signal of the video camera function with a signal delivered from the light receiving element of the code A by digitizing the electronic musical instrument (code R + code A) function incorporated in the video camera shooting function. A multi-purpose softbox that synthesizes an electronic musical instrument simulation on the video screen of a video camera and makes various fusion settings such as the software, synthesizer function, editing, and composition software described in items 0017 and 0026 of the previous section, and enables distribution to the sound module. It was.
It will be explained repeatedly, but it is a 3DCG compatible multiplex software that is installed and used in hardware devices such as drive recorders, PCs, and smartphones that have a video camera function, and signals sent from the CCD and CMOS image sensors that are the shooting functions. Alternatively, the simulated electronic musical instrument can be controlled by synthesizing the signal to be converted into an image and activating the simulation of the electronic musical instrument on the screen, and controlling the precisely calculated light and light rays reflected on the screen. It is software that makes it possible to play sounds and melody.

The idea this time is to play a light receiving sensor (light receiving element) by reflecting light or light rays under the control of a freely movable light reflecting plate, but light reflection (specular reflection, regression reflection, diffuse reflection) or refraction , There is a fixed formula for polarization, etc., and the system detects the exact position of the light source, the accurate angle of the light from the light source and the reflector that controls the light, and the accurate positional relationship of the light receiving sensor (light receiving element). It can be expected that it can be diverted to a different-dimensional image by simulating it as software by performing electronic (3DCG, etc.) conversion processing.

The explanation is a little mixed up, but if you use the zoom function that can tolerate the high level range of the video camera lens, it is possible to create songs from constellations and daytime scenery in the night sky, and the position of stars in the universe. By combining software that memorizes the above, it is possible to create songs centered on constellations, etc., even if the light does not reach.
(For example, in the solar system, you can create a sense of reality by combining music played from a simulation that moves at high speed by controlling a movable reflector and a light receiving sensor in a four-dimensional space that adds time to three-dimensional three-dimensional space, or by combining current computer graphic technology. Can reproduce the full space)

Although there is no description on the drawing of FIG. 1, the technology (zoom function, triangular distance measurement, other latest detection system, etc.) used for digital cameras and the like described in Item 0020 is applied in the vicinity of this incident port lens. By equipping it and making it possible to electronically control the setting of the light source, the system of 0016 to 0019 can be simulated by software that has been digitized (3DCG, etc.) into images from a CCD or CMOS image sensor. It is also explained in Sections 0031 and 0032 that it is possible to synthesize and play sounds.

As a function improvement point on the light receiving sensor (light receiving element) keyboard side with respect to the electronic freely movable reflector, the light receiving sensor (light receiving element) keyboard of FIG. 1 (reference numeral A) is digitized (3DCG). When using it after converting it to, arrange multiple keyboards of the light receiving sensor (light receiving element) as needed (for example, two-stage, three-stage stacking, arranging many units in a straight line, number 59 like a clock. It is also possible to break away from the common sense of performance by connecting the 0th keyboard in a circle. It is also possible to incorporate a light receiving sensor (light receiving element) converted into a drum set or guitar chord, and it is a technology that can be diverted to various simulation musical instruments by devising the operation and reflection method of the light reflector. ..
Although it is a diagram of the light receiving sensor (light receiving element) keyboard of code A, it can be applied to drum sets, guitars, and other musical instruments if the light receiving sensor (light receiving element) is configured and provided according to the sound playing method of each musical instrument. Needless to say.

In addition, as a method of arranging the optical sensor (light receiving element) according to the keyboard-shaped sound name and scale, a method of individually arranging the optical sensor at the position divided for each sound name, and an integrated unit light receiving element and an integral The wiring structure of the light receiving surface or array board of the interline type CCD image sensor composed of the light receiving sensor (light receiving element) of is divided by sound name and scale, and the signal charge and signal voltage are read for each divided arrangement, and the synthesizer or A CCD image sensor with a structure that enables distribution to a sound source module, etc. is used, and the CMOS image sensor also divides the unit light receiving elements arranged in such an application into each sound name scale, and corresponds to each division. The CMOS image sensor is the same as the CCD image sensor, which is composed of an integrated light receiving element by using a transfer circuit with a distribution structure equipped with a light receiving plate whose scale is the maximum value of the amount of light. It is considered that it can be diverted to the light receiving function for discriminating. Furthermore, in the detection and detection of light by the light receiving element, it is considered possible to change the way the sound is produced by programming the control by devising various measures such as the amount of light and the extraction region of the wavelength.
As a repetitive explanation, an electronic musical instrument with a distribution structure equipped with a light receiving plate in which the arranged unit light receiving elements are divided into note name scales and the maximum value of the amount of light corresponding to each division is the scale.

In a light receiving sensor (light receiving element) used in an electronic musical instrument system that creates a change in sound by detecting and detecting light and plays a melody by making full use of the light receiving sensor (light receiving element), the light receiving sensor (light receiving element) is used as a video. The light-receiving elements (see Fig. 3-code Q), which consist of an integrated array (lattice) of interline-type CCD image sensors, CMOS image sensors, etc., used for the shooting function of cameras, etc., are classified by sound name tone scale. (See Fig. 1-Code A and Fig. 3-Code A), and a light-receiving sensor with a distribution structure that can send signals for each sound name scale according to the arrangement of the divided light-receiving elements to an electronic musical instrument synthesizer or the like (see FIG. It is an electronic musical instrument that uses a light receiving element) to create changes in sound by detecting and detecting light and play a melody, and also prepares a control circuit for the sensing level of the light receiving sensor. In other words, by using a light receiving element that has the characteristics of being able to measure the amount of light corresponding to each division and set and adjust the reference value to start output from that division in the light receiving element divided by the note name scale. , When weak light is selected and set, it is possible to avoid strong light and receive light.

Then, in preparation for playing the various musical instruments of item 0030 to at the same time, the (reference numeral R) freely movable reflector and the (reference numeral A) light receiving sensor (light receiving element) key of FIG. 3 are configured to have a plurality of configurations. Light-receiving sensor (light-receiving element) A functional structure that can convert the light-receiving part of the keyboard from the keyboard to a string instrument, wind instrument, etc. is also possible. To briefly summarize the techniques from item 0033 above, the electronic musical instrument mechanism (3DCG, etc.) is processed. Is converted into software installed in a hardware device equipped with a video camera function such as a PC, smartphone, or drive recorder, and a hardware device connected to the divided video camera function, and incorporated into the program. Using the video and image signals of the video camera function, the perceived irradiation function of the light reflector converted into software and the simulation of the electronic musical instrument by the light receiving sensor (light receiving element) are combined with the video camera video and activated. The light reflector with a freely movable function and the light receiving sensor (light receiving element) simulation, which are configured on the video camera image screen, are used as the light source for the perceived operation and the various calculated lights on the screen due to computerization. By playing sounds and melody and easily increasing the number of the electronic musical instruments in the video camera image, it is possible to play various musical instruments at once, and the (reference numeral R) freely movable reflection of FIG. It is considered that a functional structure that can convert the light receiving part of the light receiving sensor (light receiving element) keyboard from the keyboard to a string musical instrument, a wind instrument, etc. is also possible by forming the board and the light receiving sensor (light receiving element) keyboard into a plurality of configurations. ..

In addition, the setting screen is synthesized on the screen of the image sent from various video elements (light receiving elements) used in the video camera (screens of PCs, smartphones, etc.), and the note names are divided by scale. A program configuration that can freely change the position arrangement for each scale is configured, and the grid pattern of the screen of a PC or the like divided for each pitch name is discriminated from the intensity of light set for each scale. It is thought that a method that can transmit the signal to a synthesizer or the like and read the detection signal of the light receiving sensor is also recommended, and this is an original that draws and composes a simulation instrument such as a normal keyboard or drum set on the screen. It is thought that you can enjoy various musical instruments.
It is considered possible to easily provide a function that can simultaneously separate and distribute a normal video signal and a set light signal. If it is a light receiving element dedicated to musical instruments, it does not require as delicate technology as a video element, and if it is a simulation, it can be constructed at a lower cost.

From the description of the light receiving element described in the previous section 0036 to 0039, there are two light receiving elements, the code A used for the keyboard sensor of the light receiving element of FIG. 3 and the code Q used for the photographing function. However, it is unavoidable from the explanations in paragraphs 0036 to 0039 that it is possible to perform two functions only with the light receiving element of the code Q, but a solution to avoid the influence of the photographing function on the image is also required. There are many problems and it will be a future issue.
The explanation of the function description to be added is continued.

The incident port of the code F in FIG. 1 is equipped with a zoom function that is as thin as possible, a zoom function that can set or zoom in / out the light projected in a wide range from a fisheye lens to an astronomical telescope at ultra-high speed, and a light source. A light detection position detection sensor, etc., which is indispensable for delicate information processing when using the settings and electronic software, is installed. In addition, the instrument body support base, which is composed of a freely movable light reflector equipped with an incident port for setting a light source and a light receiving element, is also equipped with a freely movable function to support remote control. In addition, the set light can be used as a target such as a lock-on system used in military terms, and the position where the instrument body is set can be moved by equipping it with a function that captures the light and automatically tracks it. It is also possible to play from a combination with power

Also, with smartphones, etc., when electronic software can be downloaded, the electronic musical instrument function can be used by linking the software to the signal of the shooting function unit that is standard equipment on the smartphone body, but it is used as a musical instrument. In some cases, it is necessary to change the mounting position of the incident port for electronic musical instruments, which is also used with the camera shooting function unit, and to devise a specification that allows adjustment, so the incident port and the camera function unit can be clipped or driven. It is considered that a stand-alone type of the camera unit for photography and the entrance of the electronic musical instrument, in which the main body such as a camera and the camera unit for photography are separated and joined by radio or the like, is recommended. At this time, I think that it is a point that can not be overlooked that it can be diverted to a drive recorder.

Regarding the reflective surface of the reflector of the reference numeral C part in FIG. 1, the configuration is composed of three surfaces in FIG. It is like a digital polarizing filter that controls the light and light rays emitted between the parts, and it is thought that the sound range can be stabilized and delicate sound can be created by devising the incident control from the reflector.
Then, in the performance of this electronic musical instrument, as for the pursuit of crisp sound so far, the timing of detection by the light receiving element and the change of sound flow were explained in item 0016, but the subtle sound intensity and sharpness were explained. The length of the sound is combined with the setting from the structure of the delicate electronically controlled program.

Next, although it is an example, the novelty of the connection of the light receiving instrument and the related device combined with the light-receiving instrument by the freely movable light reflector devised in FIG. 2 will be explained.

The system for playing the light-receiving musical instrument described in Items 0011 to 0016 will be described as an example of how to enjoy the system by combining a synthesizer, automatic composition software, a PC, a smartphone, and the like.
Reference numeral K in FIG. 2 has a synthesizer function capable of converting the sound when the light receiving sensor (light receiving element) is irradiated into various sounds in the system described in 0011 to 0016, and instantly converts the played sound and melody. It is a system that can convert and memorize musical scores. You can connect it to a speaker as it is to produce sound (code H + I + J + K + speaker), but you can expect a completely different sound by joining it to the newly commercially available automatic composition software that stores the score conversion. (Code H + I + J + K + M + speaker)

Join a smartphone, a PC with a video camera, a drive recorder, etc. (reference numeral L) installed with software (reference numeral N) that digitizes the system of the light receiving instrument using the freely movable light reflector to the above-mentioned (reference numeral K). This allows you to enjoy item 0020. (H + L + N + K) + (M) Further, the code K musical score data has a system configuration that can be edited later on a PC or the like and enjoyed.

Next, we will enter the combined explanation with the newly devised synthesizer shown in FIG.

First, FIG. 4 (reference numeral R) is an improved board in which the reflector body of the freely movable light reflector of FIG. 3 (reference numeral R) and a laser beam lamp are provided on the fixing base of the reflector, and FIG. 4 (reference numeral Z) is a controller. It is a specification that adds the operation of irradiating the light receiving sensor (light receiving element) keyboard connected to the electronic musical instrument by automatically and manually controlling the color composition, blinking, lighting, left and right up and down, rotation speed, etc. by the operation of.
A system in which the control operation of the reflector according to the above items 0016 to 0020 can be performed by almost the same operation.
The difference is whether the light receiving sensor (light receiving element) is irradiated with reflection or with a laser beam.
However, in reality, it can be assumed that it is necessary to supplement the function due to the difference in irradiation method, and at this stage, the explanation is about theoretical novelty.

Next, with respect to FIG. 4 (reference numeral Z) (reference numerals X1 to 4), most of the methods of producing sounds of electronic musical instruments called conventional synthesizers seemed to be the type of playing a plurality of tones from the performance of the keyboard.
In the current synthesizer, with the advent of the wind synthesizer, which separates the sound module from the keyboard synthesizer and combines it with an electronic wind instrument, it is possible to play various wind instrument sounds from a single wind instrument (wind synthesizer).
The idea of this time is to control the freely movable light reflector and at the same time play a wind instrument (including a wind synthesizer) in a performance method that plays a sound defined by a pattern that closes the hole with a finger, with the wind instrument in the right hand. It is divided into one for use and one for left hand use, and the end of the divided wind instrument is connected to the operation end of the freely movable light reflector controller or the terminal, or linked with the terminal using a wireless interface or the like. It is a device that allows you to play a wind instrument at the same time as playing an instrument, allowing you to enjoy a solo ensemble.
Further, in the above description of the same section, there is a connection or connection with the controller end of the freely movable light reflector, but it is not a limited connection or interlocking to this function, but any function operation controller end, terminal (performance performance). It is a wind instrument that can be connected to and linked to lighting equipment and various stage equipment controllers.

The wind instrument is played with 10 fingers, and by playing the right-hand side and the left-hand side separately during normal performance, the wind instrument body is connected to the end of the wind instrument even while playing. Fig. 4 (reference numeral R) is a system that controls the freely movable reflector and enables ensemble with an electronic musical instrument played by the perceptual operation of the light reflector. The tone is the same as that of a conventional synthesizer. You can choose freely. It is also possible to use a breast controller or control the lever on one of the eight channels of X1 and X2 to breathe. As details, it is best to use the control switch of the lever controller operation panel, which is divided into X1 and X2, for the stepless slide mechanism system, for example, the operation lever system for operating the back four system of construction machinery. Yes, the control for breathing may be up / down or left / right, but if the fixed position is 0 and the upper part blows, the lower part is the suction operation, and the length of the lever slide is the strength of the blowing wind. The ideal method is a switch mechanism, but the control switch can be switched to various function operations according to the need, and the function that allows the program such as combination to be easily rearranged is ideal.
From the above description, dozens of types of functional control are possible.

Although it is an example of the operation controller of FIG. 4 (reference numeral R), the operation of breathing is +1 with a total of 7 channels, 2 channels up and down, 2 channels left and right, 2 channels before and after rotation + rotation speed. There are a total of 8 channels. In addition, it is possible to install control devices with various functions attached to the arm part of the controller, and as explained from the image of dividing an integrated electronic wind instrument, it is based on a conventional synthesizer or sound module. The controller connected to the right-hand side and the left-hand side can be made into a removable joint type, and the removed two can be connected to form a normal integrated wind instrument for playing.
The explanation returns to the state of the wind instrument in which the module sound module is divided into two basses, but the symbols 1X and X2 in Fig. 4 have no problem even if they are played as if they were wind instruments. There is no problem with the operation of playing and the operation of other functions, and the shape will be an issue in the future for further ease of use.
Also, the operation unit is not limited to 8 channels, and the number of channels is not limited by the method of the operation unit, and the fact that 8 channels are brought out is the description in the function explanation and is the most understood. This is because I thought it was an easy lever control method.

In items 0043 to 0046, it is possible to play a certain degree of accurate perceptual rhythm of the performer from the playing principle of the wind instrument and to play along with the score, so I think that it is an electronic controller instrument that can quickly enjoy the fusion of the freely movable light reflection system. There is.
In addition, although the way to close the holes differs depending on each wind instrument, the function of changing the specifications of each wind instrument such as a wind synthesizer can be easily done, which is an excellent point of electronic musical instruments, such as trumpet with the right hand and trombone with the left. It is a system that enables ensemble.

The large-scale system devised this time is capable of performance performances that attract unprecedented audiences at live performances and concert halls, and the electronic version of this system is used in the music industry, PCs, Famicom game machines, mobile phones, etc. There is a possibility that it will lead to the activation of the field of music, and I think that many people who are interested in music can expect new entrants who try to compose with a system that allows anyone to compose. I think that it will lead to the activation of the music world by feeling familiar with composition.

A Light receiving sensor (light receiving element) keyboard joined to electronic musical instruments, etc. B Freely movable light reflector fixing base (with vibrator function)
B1 Flexible movable light reflector left and right rotation direction arrow line B2 Flexible movable light reflector top diagonally movable arrow line B3 freely movable light reflector fixed base bottom diagonally movable arrow line B4 freely movable Rotation direction arrow line of the main body of the light reflector C Freely movable light reflector C2 Dotted line of the split part where the freely movable light reflector indicates split movement D Part E containing the rotational power and control circuit of the freely movable light reflector E Light and light rays Inlet (or video camera lens)
F Score conversion software and storage device
Connection port for G PC and MIDI system (sound module, etc.) control
H Light source I Incident lens of freely movable light reflector system
J (Fig. 1) Freely movable light reflector system body K Light receiving sensor system L PC body with camera such as smartphone M Commercial automatic composition software and system body N (J) digitized and digitized software
O Subject P light and light rays sent to CCD and CMOS image sensor Q CCD, CMOS image sensor Light receiving element R (Fig. 3) Freely movable light reflector body S PC, smartphone T controller U New functions of video camera system and camera lens section Main unit V Small camera unit W (R) + (A) new function and 3DCG compatible multiplex software X1 Flexible light reflector system controller Left X2 Flexible movable light reflector System controller Right X3 Keyboard X4 Output control unit Y1 Reflection Laser beam lamp Y2 attached to the plate body Laser beam lamp Z attached to the fixed base of the reflector Overall view of the new synthesizer

Claims (8)

A music creation device installed in a vehicle that sequentially measures the position information (angle, depth, etc.) of an in-vehicle video camera that can be photographed by the external environment and a moving light source captured by the video camera. A sensor, a reflecting means that sequentially changes the direction of the light source based on the position information measured by the early sensor, and a light receiving element (sensor) that receives light that has changed direction by the early reflecting means and is divided into sound names. ), And a synthesizer or a sound source module driven by the characteristics of the light receiving element (sensor). A music creation device provided in a video camera, which is measured by a sensor that sequentially measures the position information (angle, depth, etc.) of a light source that moves during imaging based on the shooting position of the video camera, and a sensor in the previous term. A reflecting means that sequentially changes the direction of the light source based on the above-mentioned position information, a light receiving element (sensor) that receives light whose direction is changed by the early reflecting means, and a light receiving element (sensor) that is divided into musical names. ) Is provided with a synthesizer or a sound source module driven by the characteristics of). A music creation device provided in a video camera. When the shooting position is moved during shooting by the video camera, the position information (angle, angle,) of the light source that moves during imaging based on the shooting position of the video camera. A sensor that sequentially measures (depth, etc.), a reflecting means that sequentially changes the direction of the light source based on the position information measured by the sensor, and a sound name scale that receives light that has changed direction by the reflecting means. It is characterized by having a separated light receiving element (sensor) and driving a synthesizer, a sound source module, and a sound source device by delivering a sound signal according to the characteristics of the light receiving element (sensor) classified for each musical scale. Music creation device The music creation device according to any one of claims 1 to 3, wherein a sensor that measures position information of a plurality of light sources captured by the video camera and a direction of each light source are determined based on the plurality of position information. The reflecting means for changing each and the reflected light of each of the light sources are received by each light receiving element divided for each sound name tone scale, and the characteristics of the different light receiving elements (sensors) and the different light receiving elements (sensors) are used. A music creation device, characterized in that it comprises each driven synthesizer or light source module. In the video camera of the music creation device provided in the vehicle according to claim 1 or the video camera of the music creation device provided in the video camera according to any one of claims 2 to 4, the moving image is taken from the video camera. Based on the position information measured by a sensor that can sequentially measure the position information (angle, depth, etc.) of the light source, the reflecting means that sequentially changes the direction of the light source and the light that changes direction by the reflecting means irradiate. A simulation is constructed by digitizing the function and structure of delivering sound signals by receiving light from the light receiving elements (sensors) divided by sound name and sound scale, and on the image of the moving light source captured by the video camera. The simulation is synthesized and activated, and the position where the light whose direction is changed by the reflecting means is emitted from the light source is determined through a calculation program prepared in advance, and the light receiving element (sensor) divided into the determined sound name scales. A music creation device characterized by driving a synthesizer, a sound source module, and a sound source device by delivering a sound signal at a position where the music is received. The music creation device included in the video camera according to claim 5, wherein in the recording function of the video camera, when the video of the moving light source is recorded by the video camera, the position information of the light source is superimposed and recorded. Based on the position information of the recorded moving light source, the simulation according to claim 5 can be synthesized and activated on the recorded moving light source image to repeatedly create music from the same image. The music creation device according to claim 5, characterized in that the above is performed. A music creation device provided in the video camera according to any one of claims 5 and 6, wherein the reflection that sequentially changes the direction of the light source is synthesized and activated on the image captured by the video camera of the music creation device. The position of the sound name sound scale received by the simulation of the light receiving element (sensor) divided for each sound name sound scale by means is calculated, and the synthesizer or the sound source module and the sound source device are distributed by the distribution of the calculated sound signal. A sound device equipped with a video camera that can convert the driving function into software and install it, or a sound device that is equipped with hardware that can be connected to the video camera and can be connected to either inside or outside the hardware. A music creation device characterized by delivering sound signals to A music creation device included in the in-vehicle video camera according to claim 1 or the video camera according to any one of claims 2 to 7, further comprising a controller capable of remotely controlling the reflection means and an electronic wind instrument. The electronic wind instrument is divided, the end of the divided electronic wind instrument is connected to the end of the control lever of the controller, and the control lever of the controller is used while playing the divided electronic wind instrument. A music creation device characterized in that the reflecting means can be remotely controlled.

Images