KR20080085551A - Method and system for expressing a sound source in the form of the graphic - Google Patents

Method and system for expressing a sound source in the form of the graphic Download PDF

Info

Publication number
KR20080085551A
KR20080085551A KR1020070027245A KR20070027245A KR20080085551A KR 20080085551 A KR20080085551 A KR 20080085551A KR 1020070027245 A KR1020070027245 A KR 1020070027245A KR 20070027245 A KR20070027245 A KR 20070027245A KR 20080085551 A KR20080085551 A KR 20080085551A
Authority
KR
South Korea
Prior art keywords
sound source
color
sound
change
graphic
Prior art date
Application number
KR1020070027245A
Other languages
Korean (ko)
Inventor
박만옥
Original Assignee
박만옥
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 박만옥 filed Critical 박만옥
Priority to KR1020070027245A priority Critical patent/KR20080085551A/en
Publication of KR20080085551A publication Critical patent/KR20080085551A/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/06Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids
    • G10L21/10Transforming into visible information

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Processing Or Creating Images (AREA)

Abstract

A method for expressing a sound source in a graphic form and a system for performing the method are provided to change and express the color defined for a sound source according to a change in one of attributes of the sound source. A sound source storage unit(101) stores a plurality of sound sources. A color defining unit(102) defines a color corresponding to each sound source. A sound source expressing unit(103) displays the defined color on a display according to reproducing of the sound sources. The sound source includes at least one of a voice of a person, a mechanical sound, a sound of the nature. The color defining unit defines the colors in consideration of at least one of the frequency of each sound source, a signal size, and a waveform. The color defining unit defines the colors such that the colors are changed according to a change in the frequency of each sound source, the signal size and the waveform.

Description

TECHNICAL AND SYSTEM FOR EXPRESSING A SOUND SOURCE IN THE FORM OF THE GRAPHIC

1 is a diagram illustrating a configuration of a system for representing a sound source in a graphic form according to an embodiment of the present invention.

2 is a flowchart illustrating a method for representing a sound source in graphic form according to the present invention.

3 and 4 illustrate an embodiment to which a method for representing a sound source as a graphic image is applied according to the present invention.

<Explanation of symbols for the main parts of the drawings>

101: sound source storage unit

102: color definition

103: sound source expression unit

The present invention relates to a method for representing a sound source in a graphic form and to a system for performing the method. The present invention relates to a method for representing a sound source in a graphic form for expressing a defined color change, and a system for performing the method.

BACKGROUND With the rapid development of digital devices such as computers, displays, and sound devices, multimedia contents such as movies, music, dramas, etc. are visually and audibly presented to users.

Various development processes are being progressed to provide a more human-friendly, lively sound source and visual effects, and are used in various fields.

An example is the online game field. Various techniques for expressing the motions of characters appearing in the game in visual and audio form are being applied, and provide more realistic games to users.

However, the method and system for providing a conventional online game to a user are limited to each other in expressing the effects of vision and hearing, but are not expressed in mutual interaction with each other. It is true.

For example, in representing a motion state and a characteristic state of a character on a conventional game, most of them are linked by expressing a sound source in an image representing the character. Therefore, it is true that the linked sound source is reproduced according to the movement of a specific character regardless of the change of the image to express the attributes of the character, that is, the sense of distance, speed, power, and the like.

Therefore, the present invention intends to propose a new technique that can maximize the effect of the combination of hearing and vision by mapping visual elements to auditory elements.

The present invention has been made to improve the prior art as described above, and aims to maximize the visual expression effect according to the change of the sound source by defining a color in the sound source for visual representation.

In addition, an object of the present invention is to change the color defined in the sound source according to the change of at least one of the attributes of the sound source.

In order to achieve the above object and to solve the above problems of the prior art, a system for representing a sound source in a graphic form according to an embodiment of the present invention is a sound source storage unit for storing a plurality of sound sources, the respective sound sources And a color definition unit defining a color corresponding to the display unit, and a sound source expression unit displaying the defined color on a display according to reproduction of the sound source.

In addition, the method for representing a sound source according to the present invention is a sound source storage step of storing a plurality of sound sources, a color definition step of defining a color corresponding to each sound source, and the definition according to the reproduction of the sound source And a sound source representation step of displaying the displayed color on the display.

Hereinafter, a method for representing a sound source in graphic form and a system for performing the method will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a configuration of a graphic image representation system according to an embodiment of the present invention.

As shown in FIG. 1, a system 100 for expressing a sound source in a graphic form (hereinafter, “system”) includes a sound source storage unit 101, a color definition unit 102, and a sound source expression unit 103. ).

The sound source storage unit 101 stores a plurality of sound sources for representing in a graphic form input from the user.

The sound source is not limited to a specific kind, and may include at least one of a human voice, a mechanical sound, and a natural sound.

The color defining unit 102 defines a color corresponding to each sound source.

According to the present invention, by defining a specific color of each sound source, it is possible to maximize the expression effect by combining the visual elements to each other in the auditory elements.

As another example, in defining a sound source, the sound source may be defined in graphic form using at least one of sound source attributes of a frequency, a signal magnitude, and a waveform of the sound source.

That is, by defining the color with high saturation or brightness as the frequency of the sound source increases, the color may be differently defined for each property of the sound source. Alternatively, the color property may be defined differently in proportion to the signal size of the sound source, for example, the volume.

Alternatively, the color can be defined differently according to the waveform of the sound source. The waveform of the sound source can determine the tone, and by defining different colors according to the waveform of the sound source, the user can effectively transform the auditory element visually.

As another embodiment according to the present invention, the color defined in the sound source may be changed according to the change of at least one of the attributes of the sound source.

Although the attributes of the frequency, signal magnitude, and waveform described above are constantly the same for a single sound source, the attributes can usually be changed. Thus, according to the present invention, the color may be defined to change according to the conversion of the sound source property. Eventually, by correlating the change of the sound source property with the change of color visually, more various expression effects can be obtained.

As another embodiment according to the present invention, the color change may be defined to be associated with any one of a sense of distance and a sense of speed.

It is possible to express the sense of distance and speed through the change of sound source properties. In the present invention, the sense of distance and speed can be expressed more three-dimensionally by matching the color change to the change of sound source properties.

As another example, the color definer 102 may define a color using an RGB attribute value. Today, display apparatuses use three primary colors (Red, Green, Blue) to express color images. In the present invention, colors may be defined using the RGB attribute values.

The sound source expression unit 103 expresses the color defined in the sound source on the display according to the reproduction of the sound source. The sound source expression unit 103 may define a visual expression including at least one of a sense of distance, a motion state, a speed, and a peripheral effect to be expressed as a sound source in the sound source and display it on the display.

For example, a color corresponding to the sound source may be defined in a sound source for expressing a stationary expression and a dynamic state of the character, and the expression form of the color may be differently expressed according to the change of the sound source.

2 is a flowchart illustrating a method for representing a sound source in graphic form according to the present invention.

3 and 4 illustrate the results of applying the method according to FIG. 2. In the following description, FIGS. 2 and 4 will be described in more detail with reference to FIGS. 3 and 4.

In operation S210, a plurality of sound sources for representing in a graphic form input from the user are stored. The sound source may include at least one of a human voice, a mechanical sound, and a natural sound. In addition, the sound source may be a separately produced and stored sound source corresponding to the characteristic of the color for representing the sound source in graphic form.

In operation S220, a color corresponding to each sound source is defined using the stored sound source. The sound source may be defined in a color for expressing the sound source in graphic form using the sound source property of at least one of frequency, signal magnitude, and waveform.

Alternatively, the color defined in the sound source may be changed according to the change of at least one of the attributes of the sound source.

For example, in the case of FIG. 3, when a characteristic of a character (airplane) defined in the sound source is expressed in graphic form, a sound source is defined for each type of movement that can be expressed through the character (airplane). The characteristic of the character (airplane) may be a visual expression form including at least one of a sense of distance, a state of movement, a sense of speed, and a peripheral effect. Defines the color for each graphic stored in the form of a graphic.

In operation S240, a visual expression form including at least one of a sense of distance, a movement state, a sense of speed, and a peripheral effect to be expressed as a sound source may be defined and displayed on the display. The sound source may be expressed through colors defined in association with the characteristics of the character (airplane).

For example, in the case of FIG. 3, when the first character (airplane) on the game approaches a neighboring second character (airplane), the sound source is used to visually express the characteristics of the first character (airplane). The type of sound source can be expressed differently according to the navigation distance, the navigation time, and the navigation speed. According to the change in the sound source reproduced at a specific position of the first character (airplane), the color defined in the sound source, that is, the flame color and the expression form of the discharge port may be expressed differently.

As another example, in the case of FIG. 4, when the situation in which the character (person) in the game is running is represented by a sound source, the walking distance, the walking time, and the sense of walking speed that visually express the characteristics of the character (person) Therefore, the type of sound source can be expressed differently. According to the change of the sound source reproduced at a specific position of the character (person), the color defined in the sound source, that is, the color and the expression form of the dust silhouette displayed around the character (person) may be expressed differently. In addition, according to the change of the sound source reproduced at a specific position of the character (sword), the color defined in the sound source, that is, the color of the flash and the expression form of the color displayed around the knife that the character wield may be expressed differently.

As described above, according to the present invention, a method for representing a sound source as a graphic image and a system for performing the method define a color in a sound source for visual expression, and change the sound source according to at least one change of attributes of the sound source. Since the color defined in FIG. 5 can be expressed, the user can enjoy a more realistic visual effect using the sound source.

The method for representing a sound source according to the present invention as a graphic image may be implemented in the form of program instructions that can be executed by various computer means and recorded in a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the media may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter. The hardware device described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

In the present invention as described above has been described by the specific embodiments, such as specific components and limited embodiments and drawings, but this is provided to help a more general understanding of the present invention, the present invention is not limited to the above embodiments. For those skilled in the art, various modifications and variations are possible from such description.

Therefore, the spirit of the present invention should not be limited to the described embodiments, and all the things that are equivalent to or equivalent to the claims as well as the following claims will belong to the scope of the present invention. .

According to the present invention, a color may be defined in a sound source for visual expression, and the color defined in the sound source may be changed according to at least one change of attributes of the sound source, so that a user may use a sound source. The effect is to enjoy realistic visual effects.

Claims (8)

In the system for representing the sound source in a graphic form, A sound source storage unit for storing a plurality of sound sources; A color definition unit defining a color corresponding to each sound source; And A sound source expression unit for displaying the defined color on the display according to the reproduction of the sound source Graphical image representation system comprising a. The method of claim 1, And the sound source comprises at least one of a human voice, a mechanical sound, and a natural sound. The method of claim 1, And the color defining unit defines the color in consideration of at least one of a frequency, a signal magnitude, and a waveform of the sound source. The method of claim 3, And the color definition unit defines the color to change according to at least one of a frequency, a signal amplitude, and a waveform of the sound source. The method of claim 4, wherein And said color change is associated with a sense of distance and a sense of speed. The method of claim 1, And the color definition unit defines the color by determining an RGB attribute value. In the method for representing the sound source in graphic form, A sound source storage step of storing a plurality of sound sources; A color definition step of defining a color corresponding to each sound source; And A sound source representation step of displaying the defined color on the display according to the reproduction of the sound source Graphic image representation method comprising a. A computer-readable recording medium having recorded thereon a program for executing the method of claim 7.
KR1020070027245A 2007-03-20 2007-03-20 Method and system for expressing a sound source in the form of the graphic KR20080085551A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020070027245A KR20080085551A (en) 2007-03-20 2007-03-20 Method and system for expressing a sound source in the form of the graphic

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020070027245A KR20080085551A (en) 2007-03-20 2007-03-20 Method and system for expressing a sound source in the form of the graphic

Publications (1)

Publication Number Publication Date
KR20080085551A true KR20080085551A (en) 2008-09-24

Family

ID=40025256

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020070027245A KR20080085551A (en) 2007-03-20 2007-03-20 Method and system for expressing a sound source in the form of the graphic

Country Status (1)

Country Link
KR (1) KR20080085551A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023113321A1 (en) * 2021-12-15 2023-06-22 삼성전자주식회사 Display apparatus and method for controlling same

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023113321A1 (en) * 2021-12-15 2023-06-22 삼성전자주식회사 Display apparatus and method for controlling same
US11915641B2 (en) 2021-12-15 2024-02-27 Samsung Electronics Co., Ltd. Display apparatus and controlling method thereof

Similar Documents

Publication Publication Date Title
CA2748301C (en) Method and system for visual representation of sound
CN110047119B (en) Animation generation method and device comprising dynamic background and electronic equipment
US20170359667A1 (en) Three dimensional audio speaker array
WO2022193614A1 (en) Water wave special effect generation method and apparatus, storage medium, computer device
CN111464430B (en) Dynamic expression display method, dynamic expression creation method and device
Ren et al. Towards the design of effective haptic and audio displays for augmented reality and mixed reality applications
US20100303265A1 (en) Enhancing user experience in audio-visual systems employing stereoscopic display and directional audio
US10347004B2 (en) Musical sonification of three dimensional data
KR20180012166A (en) Story-telling system for changing 3 dimension character into 3 dimension avatar
JP2013161205A (en) Information processing device, information processing method and program
US20200410982A1 (en) Information processing apparatus and information processing method and computer-readable storage medium
KR20080085551A (en) Method and system for expressing a sound source in the form of the graphic
US9704276B1 (en) Enhancement and display methods for intuitively read three-dimensional visual representations of digital audio files
CN110097618A (en) A kind of control method, device, vehicle and the storage medium of music animation
CN112883223A (en) Audio display method and device, electronic equipment and computer storage medium
KR101725068B1 (en) Apparatus and method of providing workbook using resource of electronic book
CN113885828A (en) Sound effect display method and terminal equipment
CN107093209A (en) Image processing method, equipment and virtual reality device
KR102372038B1 (en) Method of spatial-tangible color education using multimedia contents, application and terminal for the same
JP2016047193A (en) Video game processing program, video game processor, and video game processing system
Tanprasert et al. AR music visualizers: Application space and design guidelines
CN110992450A (en) Music fountain simulation system based on OpenGL
JP7392074B2 (en) Speech bubble generation program and video game processing system
Salter Taking Over the World, Again? Examining Procedural Remakes of Adventure Games
JP7370363B2 (en) Information processing device, program and drawing method

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E601 Decision to refuse application