Classifications

• • G—PHYSICS
  • G10—MUSICAL INSTRUMENTS; ACOUSTICS
  • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
  • G10H5/00—Instruments in which the tones are generated by means of electronic generators
  • G10H5/16—Instruments in which the tones are generated by means of electronic generators using cathode ray tubes
• • G—PHYSICS
  • G10—MUSICAL INSTRUMENTS; ACOUSTICS
  • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
  • G10H7/00—Instruments in which the tones are synthesised from a data store, e.g. computer organs
• • G—PHYSICS
  • G10—MUSICAL INSTRUMENTS; ACOUSTICS
  • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
  • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
  • G10H2220/155—User input interfaces for electrophonic musical instruments
  • G10H2220/441—Image sensing, i.e. capturing images or optical patterns for musical purposes or musical control purposes
  • G10H2220/455—Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data
• • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
  • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
  • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
  • Y10S84/00—Music
  • Y10S84/06—Cathode-ray tube

Definitions

• the present invention relates to a method and, a sound creation device involving a transformation of images into sounds, which makes it possible to analyze images including at least one moving object, and to produce musical sounds from this analysis.
• a sound creation device characterized in that it comprises first means for observing an image encompassing a moving object and producing image signals translating at least two parameters of the image varying during the displacement of the object, and of the second means for producing from said image signals, sound control signals, and for ensuring a synthesis of sounds by using said sound control signals to control the variations of at least two parameters different from the sounds produced.
• the first means can advantageously include a video signal generator producing the image signals.
• the second means can advantageously be designed to control parameters of the sounds chosen from among the high teur of the sound, its timbre, its intensity, and possibly the rhythm of succeession of the sounds or their duration or any combination of these parameters.
• the invention involves the use of a device for transforming a video signal into sounds, comprising at least one generator of a video signal, an analog digital converter if the video signal is not not already digital, a means of transforming the digitized video signal into a multitude p of signals representative of P parameters, a set of digital analog converters in a number equal to the number of parameters, a matrix connecting the P signals to a second multitude of q inputs of a sound synthesizer whose output is connected to a loudspeaker.
• 1 designates a video signal generator which can be constituted, as will be seen below, by one or more achrome or polychrome video cameras, or else by a video recorder, a video disc or any other way. Except in the case of the video disc, the video signals coming from the means 1 are generally not in digital form. From the generator output they then feed an analog / digital converter 2, which transforms the analog signals into digital signals to transmit them to the input of an interface 3, which can be constituted either by a microprocessor device or by wired logic, which will be described later. In the event that the video signal is produced from origin in digital form, it would be admitted to interface 3 directly.
• the multitude p of the P outputs of the interface also supply P analog digital converters whose P outputs are connected to a connection matrix, making it possible to modify the P outputs of the analog converters 4, into a multitude q of outputs which are connected the inputs of an analog sound synthesizer, the only output of which is connected to a loudspeaker.
• the synthesizer must have a sufficient number of voltage inputs. It is desirable to be able to control at least a first input, acting on the synthesizer circuit defining the pitch, a second input acting on the synthesizer circuit defining the timbre of the sound and therefore the number of harmonics contained in the sound , a third input acting on the synthesizer circuit regulating the intensity of the sound, a fourth input acting on the synthesizer circuit regulating the rhythm of succession of the notes, and a fifth input acting on the synthesizer circuit regulating the duration of the said notes.
• the sound synthesizer offers the possibility of controlling special effects in voltage, vibrato, distortion, reverberation, echo, etc., it is possible to provide connections to the inputs controlling the special effects.
• connection matrix therefore makes it possible, from a number of outputs P of the converters, to control the q inputs of the synthesizer.
• This matrix can easily be produced by any device making it possible to combine the P signals to transform them into Q signals.
• This connection matrix is within the reach of any person skilled in the art; it can simply be carried out by plug-in pads making it possible to connect the outputs and the inputs together.
• the main role of interface 3 is to transform the digital video signal into P signals which we will use to control the synthesizer.
• An example of selection in the image of P parameters representative of its evolution is given by considering a frame C which represents either a television screen or the viewfinder of a camera which is used to film the image.
• a frame C which represents either a television screen or the viewfinder of a camera which is used to film the image.
• For each frame an object can be defined and represented by its dimensions x, y and by its position X, Y relative to an origin 0 chosen in a corner of the frame.
• the image can be that of a dancer who moves on a stage and whose movements are translated by the variation of the parameters X, Y, y, x.
• a module for extracting the synchronization signals delivers the video signal to be digitized and the line and frame synchronization signals.
• the converter 2 codes the video signal on a single bit.
• the output of the analog / digital converter 2 is connected to the input of a serial-parallel converter, controlled by a clock (itself slaved to the line synchronization signal), which delivers 16-bit words to the interface 30 .
• the line and frame synchronization signals set the state organs of the interface to 1. They make it possible to synchronize the progress of the program with the line and frame scans, which is important for enabling the system to operate in real time.
• the exchanges between the interface and the microprocessor are either programmed or triggered by interruption.
• a data bus connects this interface to the microprocessor.
• the microprocessor is also connected by these address, data and control buses to a memory containing the program for processing digital information.
• the input-output interface transmits by P outputs, the P words resulting from the processing of the digital video signal, to the P digital / analog converters 4.
• filtering which is optional, is to get rid of parasitic luminances, by deciding that the passage from 0 to 1 only took place after having seen a certain number of 1 pass and that the passage from 1 to 0 takes place only after having seen a certain shadow of 0 (which number will determine the power of the filtering), which amounts to requiring a transition to have a certain stability before taking it into account.
• the microprocessor calculates the position (x min. Or x max.), Stores this information in memory, examines the organ d 'state corresponding to line synchronization (bit at 1 during top line time), and if the latter is at 0, waits for the next complete word indication to redo the same operation.
• the microprocessor executes the second phase, or line processing phase, by comparing the information x min. and x max. relating to line n processed with information x min. and x max. Which it has in memory and which result from the processing of the previous line n-1. It only remembers the smallest of the x min. and the largest of x max., so that when all the lines have been processed, only the extreme values in x of the position of the object in frame i will remain in memory (x min. frame i, x maximum frame i).
• the microprocessor also determines whether the rank of the line processed corresponds to Y min. or Y max. after filtering. In this filtering, the decision is made that a line contains 1 only if a certain number of lines following also contain (y min.); similarly, the decision that a line does not contain more than 1 is only taken if a certain number of the lines which follow does not contain either • (y max.)
• the microprocessor then stores the values of y min. and y max. It scans the interface output corresponding to the frame synchronization signal. If this is 0, it waits for the next full word indication to process a new line, otherwise it starts a third phase, which is a frame processing phase.
• the microprocessor performs calculations on the information it has in memory and which are: x max. frame i, x min. frame i, y min. frame i, y max. frame i.
• the microprocessor restores this information to the digital / analog converters by addressing the outputs of the interface 39 and waits for the following complete word indication to process a new frame i + 1.
• the only limit to the complexity of the programs is the execution time. For example, it can be decided that the line has 10 words of 16 bits and since the scanning of a line lasts 52.5 s, the processing of a word must be carried out in less than 5.2 s , processing a line (during line feed) in less than 12 s, processing a frame (during line feed) in less than 1.2 milliseconds. These time constraints condition the real-time operation of the system.
• the output of the device 1 providing a video signal is connected to the input of a circuit 48 for extracting line and frame synchronization signals.
• An output of circuit 48 provides a line synchronization signal, which serves to synchronize a clock, and which, on the other hand, is connected to an input of a logic circuit 45 with five inputs, whose two outputs respectively deliver the signals y and Y to the digital analog converters 4.
• the other four inputs of the logic circuit 45 receive the frame synchronization signal supplied to an output of the circuit 48, two of the output signals of a logic 46 and the output signal of a comparator 41, making it possible to digitize the video signal received at an input to comparator 41.
• This video signal, supplied by an output of circuit 48 is compared with a reference voltage supplied to the input of comparator circuit 41. Acting on the reference voltage, the luminance level on which the switching takes place is determined.
• logic circuit 45 The role of logic circuit 45 is to detect the first blank line at the end of the object y max. (advantageously with filtering). It builds a first signal which goes to 1 as soon as a non-blank line is encountered and which drops to zero at the end of the frame. It is during its high position that a counter will be authorized to count the line synchronization ticks, which will provide the quantity Y.
• Logic 45 constructs a second signal which goes to 1 as soon as a non-blank line is encountered as the preceding signal) and which drops to zero after the end of object detection. It is during the high position of this signal that a second counter will be authorized to count the line synchronization tops, which will provide the magnitude y.
• An output of the comparator 41 drives a shift register 43, looped on itself, the shift of which is synchronized by the signal from a clock, which is itself synchronized with the line synchronization signal.
• This shift register constitutes a rotating memory which makes it possible to construct and then store the location of the parameter x on a line.
• the output of the shift register 43 is connected to an input of a logic block 44 with seven inputs, the other six inputs of which receive the line synchronization signal, the clock signal and the four signals of the outputs of the logic block 46, which receives on its first input the line synchronization signal and on its second input the frame synchronization signal.
• the logic circuit 46 consists of a counter and a demultiplexer. Its purpose is to provide a secondary time base in order to carry out the processing which takes place after the frame return top.
• the circuit thus provides four logic signals which, with the line and frame synchronization signals, allow the sequencing of the operations carried out by the system.
• the outputs of logic block 44 deliver the signals representative of x and X respectively to the analog digital converters of circuit 4.
• This circuit will notably include a counter and buffers.
• the values X and Y respectively designate the abscissas and ordinates at the start of the object in projection on each axis, and not the mediums between minimum and maximum as in the previous case.

Landscapes

• Engineering & Computer Science (AREA)
• Physics & Mathematics (AREA)
• Acoustics & Sound (AREA)
• Multimedia (AREA)
• General Engineering & Computer Science (AREA)
• Studio Circuits (AREA)
• Electrophonic Musical Instruments (AREA)
• Processing Or Creating Images (AREA)

Applications Claiming Priority (2)

Related Parent Applications (1)

Publications (1)

Family

ID=9279949

Family Applications (2)

Family Applications After (1)

Country Status (6)

Cited By (1)

Families Citing this family (29)

Citations (2)

Family Cites Families (8)

• 1982
  • 1982-12-10 FR FR8220695A patent/FR2537755A1/fr active Granted
• 1983
  • 1983-12-08 US US06/641,960 patent/US4658427A/en not_active Expired - Fee Related
  • 1983-12-09 JP JP84500038A patent/JPS60500228A/ja active Pending
  • 1983-12-09 DE DE8383402385T patent/DE3371952D1/de not_active Expired
  • 1983-12-09 EP EP84201244A patent/EP0142179A1/fr not_active Withdrawn
  • 1983-12-09 EP EP83402385A patent/EP0112761B1/fr not_active Expired
  • 1983-12-09 WO PCT/FR1983/000247 patent/WO1984002416A1/fr unknown

Patent Citations (2)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events