WO1998029863A1 - Acoustic phenomenon visualisation procedure - Google Patents

Acoustic phenomenon visualisation procedure Download PDF

Info

Publication number
WO1998029863A1
WO1998029863A1 PCT/SI1997/000036 SI9700036W WO9829863A1 WO 1998029863 A1 WO1998029863 A1 WO 1998029863A1 SI 9700036 W SI9700036 W SI 9700036W WO 9829863 A1 WO9829863 A1 WO 9829863A1
Authority
WO
WIPO (PCT)
Prior art keywords
acoustic
field
phenomenon
acoustic phenomenon
signal
Prior art date
Application number
PCT/SI1997/000036
Other languages
French (fr)
Inventor
Boz^¿idar SVETEK
Original Assignee
Svetek Bozidar
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Svetek Bozidar filed Critical Svetek Bozidar
Priority to AU78931/98A priority Critical patent/AU7893198A/en
Publication of WO1998029863A1 publication Critical patent/WO1998029863A1/en

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0008—Associated control or indicating means

Definitions

  • the invention refers to the acoustic phenomenon visualisation procedure involving the transformation of an acoustic signal into a visual signal and offering a solution for recording the respective transformation to a physical medium, e.g. video, CD, or for application at direct transmission.
  • a physical medium e.g. video, CD
  • the well known light show technique allows for direct light accompaniment of musical substance, i.e. activation of different colour illuminants with reference to different frequency ranges of the sound and/or produced music.
  • the weak points of the light show technique mainly lie in the simplification and non-homogeneity of visual and acoustic (musical) substance. Further there exists some structural mismatch between the visual and the acoustic as well as the non-uniform involvement of the audience's hearing and sight; in spite of the interactive capacity of the audience. It ensues from the above facts that on producing music both the audience and the performers often close their eyes, which means "elimination" of the unsuitable visual substance/structure and/or look of a given room.
  • music processed in the light show technique in case of the record to a physical medium, allows to the music no autonomy outside the room designed for light show.
  • the proposed procedure provides for reproduction and development of visual substance, in volume and quality comparable to music.
  • Music gains some visual, autonomous form of expression and no more holds a subordinate function, i.e. as a support to natural visual substances usual for film or television.
  • each piece of music becomes a specific autonomous film.
  • the acoustic phenomenon visualisation procedure referred to in this invention will be explained hereafter on the basis of the concrete example and the corresponding drawings whereof:
  • Figure 1 shows the flow chart of the procedure referred to in this invention
  • Figure 2 shows an example of specific association patterns Ai;
  • Figure 3 shows the operating field on the screen, such as applied for the procedure referred to in this invention;
  • Figure 4 shows the f 1 ow chart of the procedure referred to in this invention in case of a musical phonogram;
  • Figure 5 shows the f 1 ow chart of the procedure referred to in this invention at direct transmission ot a piece of music
  • Figure 6 shows examples of neume-like records.
  • Figure 1 shows the flow chart of the procedure involving the transformation of an acoustic phenomenon (piece of music) into a visual substance. Every acoustic signal (element) of the acoustic phenomenon is associated with a visualisation pattern Ai.
  • the pattern Ai is elaborated in the way to provide for maximum association between the visual and the acoustic.
  • An example of the association pattern Ai is shown in Figure 2.
  • the signal (element) of the acoustic phenomenon 1 i is directly transcribed with the pattern Ai, on the screen field E of the computer 4i.
  • the operating field M (shown in Figure 3) with the field of association patterns Ai, field 12 for pattern modifications, field 13 for colour variation and field 14 with colour spectrum.
  • the operating field M on the screen E is shaped in the way that the field of association patterns Ai, the field 12 for association pattern modifications and the field 13 for colour modifications are located on the left side of the screen, whereas the field 14 with colour spectrum is located on the right side of the screen due to reaction times.
  • the transformation procedure of the acoustic phenomenon 1 i, performed on the operating field M, is effected in a script similar in meaning and shape to neumes. A few such signs are shown in Figure 6.
  • the reaction colour from field 14 is added to the association pattern Ai.
  • Field 12 for modification of association patterns is provided with two built-in switches 12a and 12b. The first switch 12a provides for magnification of the association pattern Ai at lowering of tones (punctum- gravis) and the switch 12b provides for reduction of the association pattern Ai at rising of tones (virgoaktus).
  • Field 13 for colour variation is provided with two built-in switches 13a and 13b.
  • the first switch 13a allows for changing of reaction colour into darker shades at lowering of tones (punctum-gravis) and the switch 13b provides for changing of reaction colour into lighter shades at rising of tones (virgo-aktus).
  • the transformed substance of the elements of an acoustic phenomenon (music) in the form of various association patterns Ai, reaction colour as well as change of shape and colour is currently stored in the processor 5i.
  • the summing integrator 7 activates the contents of all processors 5i into a uniform signal which is recorded on a physical medium or directly transmitted.
  • the above procedure leads to a signal which combines the visual and the acoustic substance of all signals (elements) of an acoustic phenomenon. Transcription of a signal and/or elements of an acoustic phenomenon (music) can be effected in two modes.
  • the transcription involves the existing phonograms.
  • the procedure is performed by a single person on the computer R1 , on the screen E1 , in the operating field M 1 , i.e. every acoustic signal 1 i apart with an optional number of association patterns Ai.
  • the visual and the acoustic substance of each transcription 3i is stored on a separate processor 5i.
  • the summing integrator 7 activates itself and simultaneously combines all processors 5i, which results in a joint acoustic and visual signal 6, i.e. the signal which is, together with other signals, via the summing integrator 7, recorded on a physical medium as a final acoustic and visual record 8 or is subject to direct transmission 9.
  • the procedure referred to in this invention and relating to direct transmission of a piece of music whereof the flow chart is shown in Figure 5, is, however, effected in the way that the direct transmission of an acoustic phenomenon (piece of music) is transcribed by several persons in a coordinated process.
  • Each person performs the transcription with a single association pattern Ai on his/her computer 4i and the processor 5i.
  • On all performers' operating fields M there are also displayed the resulting transcription substances of all performers.
  • Coordination and reconciliation of all appearing visual substances/transcriptions with the acoustic signal/piece of music is performed by a single person K on the separate computer R2, with the screen E2 and with the operating field M2.
  • the visual and the acoustic substances are stored in the processor 52 and the summing integrator 72 and/or are directly transmitted into the very environment of the acoustic phenomenon and/or reproduction of music or they are recorded on a physical medium.

Abstract

The invention refers to the acoustic phenomenon visualisation procedure involving the tranformation of an acoustic signal into a visual signal and offering a solution for recording the respective transformation to a physical medium, e.g. video, CD, or for application at direct transmission. The acoustic phenomenon visualisation procedure provides for the fact that the signal and/or element of the acoustic phenomenon (1i) is directly transcribed with the pattern (Ai), on the screen field (E) of the computer (4i); such transformed substance of the elements of an acoustic phenomenon (1i) in the form of various association patterns (Ai), reaction colour as well as change of shape and colour is currently stored in the processor (5i), whereupon, after the transformation is completed, the summing integrator (7) activates the contents of all processors (5i) into a uniform signal which is recorded on a physical medium or directly transmitted. The procedure referred to in this invention is used for transformations of an acoustic phenomenon (1i) into a script similar in meaning and shape to neumes.

Description

ACOUSTIC PHENOMENON VISUALISATION PROCEDURE
The invention refers to the acoustic phenomenon visualisation procedure involving the transformation of an acoustic signal into a visual signal and offering a solution for recording the respective transformation to a physical medium, e.g. video, CD, or for application at direct transmission.
The well known light show technique, however, allows for direct light accompaniment of musical substance, i.e. activation of different colour illuminants with reference to different frequency ranges of the sound and/or produced music. The weak points of the light show technique mainly lie in the simplification and non-homogeneity of visual and acoustic (musical) substance. Further there exists some structural mismatch between the visual and the acoustic as well as the non-uniform involvement of the audience's hearing and sight; in spite of the interactive capacity of the audience. It ensues from the above facts that on producing music both the audience and the performers often close their eyes, which means "elimination" of the unsuitable visual substance/structure and/or look of a given room. In addition to the above, music processed in the light show technique, in case of the record to a physical medium, allows to the music no autonomy outside the room designed for light show.
The proposed procedure provides for reproduction and development of visual substance, in volume and quality comparable to music. Music gains some visual, autonomous form of expression and no more holds a subordinate function, i.e. as a support to natural visual substances usual for film or television. With the proposed procedure each piece of music becomes a specific autonomous film. The acoustic phenomenon visualisation procedure referred to in this invention will be explained hereafter on the basis of the concrete example and the corresponding drawings whereof:
Figure 1 shows the flow chart of the procedure referred to in this invention;
Figure 2 shows an example of specific association patterns Ai; Figure 3 shows the operating field on the screen, such as applied for the procedure referred to in this invention; Figure 4 shows the f 1 ow chart of the procedure referred to in this invention in case of a musical phonogram;
Figure 5 shows the f 1 ow chart of the procedure referred to in this invention at direct transmission ot a piece of music; Figure 6 shows examples of neume-like records.
Figure 1 shows the flow chart of the procedure involving the transformation of an acoustic phenomenon (piece of music) into a visual substance. Every acoustic signal (element) of the acoustic phenomenon is associated with a visualisation pattern Ai. The pattern Ai is elaborated in the way to provide for maximum association between the visual and the acoustic. An example of the association pattern Ai is shown in Figure 2.
In the visualisation procedure the signal (element) of the acoustic phenomenon 1 i is directly transcribed with the pattern Ai, on the screen field E of the computer 4i.
On the computer screen field E, there is programmed the operating field M (shown in Figure 3) with the field of association patterns Ai, field 12 for pattern modifications, field 13 for colour variation and field 14 with colour spectrum. In view of ergonomic properties, the operating field M on the screen E is shaped in the way that the field of association patterns Ai, the field 12 for association pattern modifications and the field 13 for colour modifications are located on the left side of the screen, whereas the field 14 with colour spectrum is located on the right side of the screen due to reaction times.
The transformation procedure of the acoustic phenomenon 1 i, performed on the operating field M, is effected in a script similar in meaning and shape to neumes. A few such signs are shown in Figure 6. During the transcription - transformation of a signal (element) of the acoustic phenomenon 1 i with the signal which corresponds to the association pattern Ai, the reaction colour from field 14 is added to the association pattern Ai. Field 12 for modification of association patterns is provided with two built-in switches 12a and 12b. The first switch 12a provides for magnification of the association pattern Ai at lowering of tones (punctum- gravis) and the switch 12b provides for reduction of the association pattern Ai at rising of tones (virgoaktus). Field 13 for colour variation is provided with two built-in switches 13a and 13b. The first switch 13a allows for changing of reaction colour into darker shades at lowering of tones (punctum-gravis) and the switch 13b provides for changing of reaction colour into lighter shades at rising of tones (virgo-aktus). The transformed substance of the elements of an acoustic phenomenon (music) in the form of various association patterns Ai, reaction colour as well as change of shape and colour is currently stored in the processor 5i.
Once the transformation is completed, the summing integrator 7 activates the contents of all processors 5i into a uniform signal which is recorded on a physical medium or directly transmitted. In the final phase the above procedure leads to a signal which combines the visual and the acoustic substance of all signals (elements) of an acoustic phenomenon. Transcription of a signal and/or elements of an acoustic phenomenon (music) can be effected in two modes.
In the first mode, whereof, the flow chart in shown in Figure 4, the transcription involves the existing phonograms. The procedure is performed by a single person on the computer R1 , on the screen E1 , in the operating field M 1 , i.e. every acoustic signal 1 i apart with an optional number of association patterns Ai. The visual and the acoustic substance of each transcription 3i is stored on a separate processor 5i. Once the transcription is completed, the summing integrator 7 activates itself and simultaneously combines all processors 5i, which results in a joint acoustic and visual signal 6, i.e. the signal which is, together with other signals, via the summing integrator 7, recorded on a physical medium as a final acoustic and visual record 8 or is subject to direct transmission 9.
The procedure referred to in this invention and relating to direct transmission of a piece of music whereof the flow chart is shown in Figure 5, is, however, effected in the way that the direct transmission of an acoustic phenomenon (piece of music) is transcribed by several persons in a coordinated process. Each person performs the transcription with a single association pattern Ai on his/her computer 4i and the processor 5i. On all performers' operating fields M, there are also displayed the resulting transcription substances of all performers. Coordination and reconciliation of all appearing visual substances/transcriptions with the acoustic signal/piece of music is performed by a single person K on the separate computer R2, with the screen E2 and with the operating field M2. The visual and the acoustic substances are stored in the processor 52 and the summing integrator 72 and/or are directly transmitted into the very environment of the acoustic phenomenon and/or reproduction of music or they are recorded on a physical medium.

Claims

PATENT CLAIMS
1. The acoustic phenomenon visualisation procedure, characterised in that the signal (element) of the acoustic phenomenon (1 i) is directly transcribed with the pattern (Ai), on the screen feld (E) of the computer (4i) whereby the transformed substance of the elements of an acoustic phenomenon (1 i) in the form of association patterns (Ai) of specific reaction colours as well as shape and colour changes is currently stored in the processor (5i) whereupon after the final transformation the summing integrator (7) activates the contents of processors (5i) into a uniform signal which is recorded on a physical medium or performed in the form of a direct transmission.
2. The acoustic phenomenon visualisation procedure referred to in the claim 1 , characterised in that the transformations of an acoustic phenomenon (1 i) are effected in a script similar in meaning and shape to neumes.
3. The acoustic phenomenon visualisation procedure referred to in the claim 1 , characterised in that on the computer screen field (E), there is programmed the operating field (M) with the field of association patterns (Ai), field (12) for pattern modifications, field (13) for colour variation and field (14) with colour spectrum, whereby the field (12) for association pattern modifications and the field (13) for colour modifications are located on the left side of the screen (E), whereas the field (14) with colour spectrum is located on the right side of the screen.
4. The acoustic phenomenon visualisation procedure, referred to in the claim 3, characterised in that the field (12) for modification of association patterns is provided with built-in switches (12a, 12b).
5. The acoustic phenomenon visualisation procedure, referred to in the claim 3, characterised in that the field (13) for change of colours is provided with built-in switches (13a, 13b).
6. The acoustic phenomenon visualisation procedure, referred to in the claims 1 and 2, for transcription of the existing phonograms, characterised in that a single person on the computer (R1 ), on the screen (E1 ), in the s operating field (M1 ), transcribes every acoustic signal (1 i) apart with an optional number of association patterns (Ai) and that the visual and the acoustic substance of each transcription (3i) is stored on a separate processor (5i), whereupon the summing integrator (7) activates itself and simultaneously combines all processors (5i), which results in a joint o acoustic and visual signal (6), which is recorded on a physical medium as a final acoustic and visual record (8) or is subject to direct transmission (9).
7. The acoustic phenomenon visualisation procedure, referred to in claims s 1 and 2, for transcription at direct transmission of a piece of music where direct transmission of an acoustic phenomenon is transcribed by several persons in a coordinated process, characterised in that each person performs the transcription with a single association pattern o (Ai) on his/her computer (4i) and the processor (5i), whereby on all performers' operating felds (M), there are also displayed the resulting transcription substances of other performers whereby coordination and reconciliation of all appearing visual substances with the acoustic signal is performed by a single person (t on the separate computer (R2), with the screen (E2) and with the operating feld (M2). The visual and the acoustic substances are stored in the processor (52) and in the summing integrator (72) and/or are recorded on a physical medium as a final acoustic and visual record (8) or is subject to direct transmission
(9)-
PCT/SI1997/000036 1996-12-30 1997-12-29 Acoustic phenomenon visualisation procedure WO1998029863A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU78931/98A AU7893198A (en) 1996-12-30 1997-12-29 Acoustic phenomenon visualisation procedure

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
SI9600376A SI9600376A (en) 1996-12-30 1996-12-30 Sound event visualisation procedure
SIP-9600376 1996-12-30

Publications (1)

Publication Number Publication Date
WO1998029863A1 true WO1998029863A1 (en) 1998-07-09

Family

ID=20431976

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SI1997/000036 WO1998029863A1 (en) 1996-12-30 1997-12-29 Acoustic phenomenon visualisation procedure

Country Status (3)

Country Link
AU (1) AU7893198A (en)
SI (1) SI9600376A (en)
WO (1) WO1998029863A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4068262A (en) * 1976-12-30 1978-01-10 Sandler Michael E Auxiliary variable coordinate sonic display system
WO1986005409A1 (en) * 1985-03-20 1986-09-25 Paist Roger M Video display of two-channel audio signals
US4753148A (en) * 1986-12-01 1988-06-28 Johnson Tom A Sound emphasizer
US4885969A (en) * 1987-08-03 1989-12-12 Chesters Thomas P Graphic music system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4068262A (en) * 1976-12-30 1978-01-10 Sandler Michael E Auxiliary variable coordinate sonic display system
WO1986005409A1 (en) * 1985-03-20 1986-09-25 Paist Roger M Video display of two-channel audio signals
US4753148A (en) * 1986-12-01 1988-06-28 Johnson Tom A Sound emphasizer
US4885969A (en) * 1987-08-03 1989-12-12 Chesters Thomas P Graphic music system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
MONT-REYNAUD ET AL.: "ICCM Glasgow 1990 Proceedings", 1990, ICMC, GLASGOW,UK, XP002066768 *
POCOCK-WILLIAMS: "Towards the automatic generation of visual music", LEONARDO, vol. 25, no. 1, 1992, LEONARDO (UK), pages 29 - 36, XP002066767 *

Also Published As

Publication number Publication date
AU7893198A (en) 1998-07-31
SI9600376A (en) 1998-08-31

Similar Documents

Publication Publication Date Title
Straebel et al. Alvin Lucier's music for solo performer: experimental music beyond sonification
Saldanha et al. Timbre cues and the identification of musical instruments
US6369312B1 (en) Method for expressing vibratory music and apparatus therefor
AU756265B2 (en) Apparatus and method for presenting sound and image
WO1997007476A3 (en) Method and apparatus for formatting digital audio data
Savage Mixing and mastering in the box: the guide to making great mixes and final masters on your computer
Gibson The Ultimate Live Sound Operator's Handbook
Hutton Daphne Oram: innovator, writer and composer
Mooney et al. Sonic imaginaries: How Hugh Davies and David Van Koevering performed electronic music’s future
Dunaway Digital radio production: towards an aesthetic
Wicke The sonic: Sound concepts of popular culture
WO1998029863A1 (en) Acoustic phenomenon visualisation procedure
Strawn Analysis and synthesis of musical transitions using the discrete short-time Fourier transform
Kramer Mapping a single data stream to multiple auditory variables: A subjective approach to creating a compelling design
Struthers Technology in the art of recording
Reese et al. Radio production worktext: studio and equipment
Babbitt THE REVOLUTION IN SOUND: ELECTRONIC MUSIC.
US3257493A (en) Teaching device
Ussachevsky The processes of experimental music
EP0475758B1 (en) Method of multipurpose playback utilization of instrumental music reproduction video tape or the like
JPH0744182A (en) Music reproducing device
Zager Writing music for commercials: Television, radio, and new media
Wagler Sonovision: A visual display of sound
Clark Listening technology for automotive sound systems
Zager Writing music for television and radio commercials (and more): a manual for composers and students

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE GH GM GW HU ID IL IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SK SL TJ TM TR TT UA UG US UZ VN YU ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 1997949325

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: CA

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWW Wipo information: withdrawn in national office

Ref document number: 1997949325

Country of ref document: EP

122 Ep: pct application non-entry in european phase