KR20080085551A - Method and system for expressing a sound source in the form of the graphic - Google Patents
Method and system for expressing a sound source in the form of the graphic Download PDFInfo
- Publication number
- KR20080085551A KR20080085551A KR1020070027245A KR20070027245A KR20080085551A KR 20080085551 A KR20080085551 A KR 20080085551A KR 1020070027245 A KR1020070027245 A KR 1020070027245A KR 20070027245 A KR20070027245 A KR 20070027245A KR 20080085551 A KR20080085551 A KR 20080085551A
- Authority
- KR
- South Korea
- Prior art keywords
- sound source
- color
- sound
- change
- graphic
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 29
- 239000003086 colorant Substances 0.000 abstract description 7
- 230000000007 visual effect Effects 0.000 description 13
- 230000033001 locomotion Effects 0.000 description 7
- 230000000694 effects Effects 0.000 description 6
- 230000002093 peripheral effect Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/06—Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids
- G10L21/10—Transforming into visible information
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Computational Linguistics (AREA)
- General Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Processing Or Creating Images (AREA)
Abstract
Description
1 is a diagram illustrating a configuration of a system for representing a sound source in a graphic form according to an embodiment of the present invention.
2 is a flowchart illustrating a method for representing a sound source in graphic form according to the present invention.
3 and 4 illustrate an embodiment to which a method for representing a sound source as a graphic image is applied according to the present invention.
<Explanation of symbols for the main parts of the drawings>
101: sound source storage unit
102: color definition
103: sound source expression unit
The present invention relates to a method for representing a sound source in a graphic form and to a system for performing the method. The present invention relates to a method for representing a sound source in a graphic form for expressing a defined color change, and a system for performing the method.
BACKGROUND With the rapid development of digital devices such as computers, displays, and sound devices, multimedia contents such as movies, music, dramas, etc. are visually and audibly presented to users.
Various development processes are being progressed to provide a more human-friendly, lively sound source and visual effects, and are used in various fields.
An example is the online game field. Various techniques for expressing the motions of characters appearing in the game in visual and audio form are being applied, and provide more realistic games to users.
However, the method and system for providing a conventional online game to a user are limited to each other in expressing the effects of vision and hearing, but are not expressed in mutual interaction with each other. It is true.
For example, in representing a motion state and a characteristic state of a character on a conventional game, most of them are linked by expressing a sound source in an image representing the character. Therefore, it is true that the linked sound source is reproduced according to the movement of a specific character regardless of the change of the image to express the attributes of the character, that is, the sense of distance, speed, power, and the like.
Therefore, the present invention intends to propose a new technique that can maximize the effect of the combination of hearing and vision by mapping visual elements to auditory elements.
The present invention has been made to improve the prior art as described above, and aims to maximize the visual expression effect according to the change of the sound source by defining a color in the sound source for visual representation.
In addition, an object of the present invention is to change the color defined in the sound source according to the change of at least one of the attributes of the sound source.
In order to achieve the above object and to solve the above problems of the prior art, a system for representing a sound source in a graphic form according to an embodiment of the present invention is a sound source storage unit for storing a plurality of sound sources, the respective sound sources And a color definition unit defining a color corresponding to the display unit, and a sound source expression unit displaying the defined color on a display according to reproduction of the sound source.
In addition, the method for representing a sound source according to the present invention is a sound source storage step of storing a plurality of sound sources, a color definition step of defining a color corresponding to each sound source, and the definition according to the reproduction of the sound source And a sound source representation step of displaying the displayed color on the display.
Hereinafter, a method for representing a sound source in graphic form and a system for performing the method will be described in detail with reference to the accompanying drawings.
1 is a diagram illustrating a configuration of a graphic image representation system according to an embodiment of the present invention.
As shown in FIG. 1, a
The sound
The sound source is not limited to a specific kind, and may include at least one of a human voice, a mechanical sound, and a natural sound.
The
According to the present invention, by defining a specific color of each sound source, it is possible to maximize the expression effect by combining the visual elements to each other in the auditory elements.
As another example, in defining a sound source, the sound source may be defined in graphic form using at least one of sound source attributes of a frequency, a signal magnitude, and a waveform of the sound source.
That is, by defining the color with high saturation or brightness as the frequency of the sound source increases, the color may be differently defined for each property of the sound source. Alternatively, the color property may be defined differently in proportion to the signal size of the sound source, for example, the volume.
Alternatively, the color can be defined differently according to the waveform of the sound source. The waveform of the sound source can determine the tone, and by defining different colors according to the waveform of the sound source, the user can effectively transform the auditory element visually.
As another embodiment according to the present invention, the color defined in the sound source may be changed according to the change of at least one of the attributes of the sound source.
Although the attributes of the frequency, signal magnitude, and waveform described above are constantly the same for a single sound source, the attributes can usually be changed. Thus, according to the present invention, the color may be defined to change according to the conversion of the sound source property. Eventually, by correlating the change of the sound source property with the change of color visually, more various expression effects can be obtained.
As another embodiment according to the present invention, the color change may be defined to be associated with any one of a sense of distance and a sense of speed.
It is possible to express the sense of distance and speed through the change of sound source properties. In the present invention, the sense of distance and speed can be expressed more three-dimensionally by matching the color change to the change of sound source properties.
As another example, the color definer 102 may define a color using an RGB attribute value. Today, display apparatuses use three primary colors (Red, Green, Blue) to express color images. In the present invention, colors may be defined using the RGB attribute values.
The sound
For example, a color corresponding to the sound source may be defined in a sound source for expressing a stationary expression and a dynamic state of the character, and the expression form of the color may be differently expressed according to the change of the sound source.
2 is a flowchart illustrating a method for representing a sound source in graphic form according to the present invention.
3 and 4 illustrate the results of applying the method according to FIG. 2. In the following description, FIGS. 2 and 4 will be described in more detail with reference to FIGS. 3 and 4.
In operation S210, a plurality of sound sources for representing in a graphic form input from the user are stored. The sound source may include at least one of a human voice, a mechanical sound, and a natural sound. In addition, the sound source may be a separately produced and stored sound source corresponding to the characteristic of the color for representing the sound source in graphic form.
In operation S220, a color corresponding to each sound source is defined using the stored sound source. The sound source may be defined in a color for expressing the sound source in graphic form using the sound source property of at least one of frequency, signal magnitude, and waveform.
Alternatively, the color defined in the sound source may be changed according to the change of at least one of the attributes of the sound source.
For example, in the case of FIG. 3, when a characteristic of a character (airplane) defined in the sound source is expressed in graphic form, a sound source is defined for each type of movement that can be expressed through the character (airplane). The characteristic of the character (airplane) may be a visual expression form including at least one of a sense of distance, a state of movement, a sense of speed, and a peripheral effect. Defines the color for each graphic stored in the form of a graphic.
In operation S240, a visual expression form including at least one of a sense of distance, a movement state, a sense of speed, and a peripheral effect to be expressed as a sound source may be defined and displayed on the display. The sound source may be expressed through colors defined in association with the characteristics of the character (airplane).
For example, in the case of FIG. 3, when the first character (airplane) on the game approaches a neighboring second character (airplane), the sound source is used to visually express the characteristics of the first character (airplane). The type of sound source can be expressed differently according to the navigation distance, the navigation time, and the navigation speed. According to the change in the sound source reproduced at a specific position of the first character (airplane), the color defined in the sound source, that is, the flame color and the expression form of the discharge port may be expressed differently.
As another example, in the case of FIG. 4, when the situation in which the character (person) in the game is running is represented by a sound source, the walking distance, the walking time, and the sense of walking speed that visually express the characteristics of the character (person) Therefore, the type of sound source can be expressed differently. According to the change of the sound source reproduced at a specific position of the character (person), the color defined in the sound source, that is, the color and the expression form of the dust silhouette displayed around the character (person) may be expressed differently. In addition, according to the change of the sound source reproduced at a specific position of the character (sword), the color defined in the sound source, that is, the color of the flash and the expression form of the color displayed around the knife that the character wield may be expressed differently.
As described above, according to the present invention, a method for representing a sound source as a graphic image and a system for performing the method define a color in a sound source for visual expression, and change the sound source according to at least one change of attributes of the sound source. Since the color defined in FIG. 5 can be expressed, the user can enjoy a more realistic visual effect using the sound source.
The method for representing a sound source according to the present invention as a graphic image may be implemented in the form of program instructions that can be executed by various computer means and recorded in a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the media may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter. The hardware device described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.
In the present invention as described above has been described by the specific embodiments, such as specific components and limited embodiments and drawings, but this is provided to help a more general understanding of the present invention, the present invention is not limited to the above embodiments. For those skilled in the art, various modifications and variations are possible from such description.
Therefore, the spirit of the present invention should not be limited to the described embodiments, and all the things that are equivalent to or equivalent to the claims as well as the following claims will belong to the scope of the present invention. .
According to the present invention, a color may be defined in a sound source for visual expression, and the color defined in the sound source may be changed according to at least one change of attributes of the sound source, so that a user may use a sound source. The effect is to enjoy realistic visual effects.
Claims (8)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020070027245A KR20080085551A (en) | 2007-03-20 | 2007-03-20 | Method and system for expressing a sound source in the form of the graphic |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020070027245A KR20080085551A (en) | 2007-03-20 | 2007-03-20 | Method and system for expressing a sound source in the form of the graphic |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20080085551A true KR20080085551A (en) | 2008-09-24 |
Family
ID=40025256
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020070027245A KR20080085551A (en) | 2007-03-20 | 2007-03-20 | Method and system for expressing a sound source in the form of the graphic |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20080085551A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2023113321A1 (en) * | 2021-12-15 | 2023-06-22 | 삼성전자주식회사 | Display apparatus and method for controlling same |
-
2007
- 2007-03-20 KR KR1020070027245A patent/KR20080085551A/en not_active Application Discontinuation
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2023113321A1 (en) * | 2021-12-15 | 2023-06-22 | 삼성전자주식회사 | Display apparatus and method for controlling same |
US11915641B2 (en) | 2021-12-15 | 2024-02-27 | Samsung Electronics Co., Ltd. | Display apparatus and controlling method thereof |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CA2748301C (en) | Method and system for visual representation of sound | |
CN110047119B (en) | Animation generation method and device comprising dynamic background and electronic equipment | |
US20170359667A1 (en) | Three dimensional audio speaker array | |
WO2022193614A1 (en) | Water wave special effect generation method and apparatus, storage medium, computer device | |
CN111464430B (en) | Dynamic expression display method, dynamic expression creation method and device | |
Ren et al. | Towards the design of effective haptic and audio displays for augmented reality and mixed reality applications | |
US20100303265A1 (en) | Enhancing user experience in audio-visual systems employing stereoscopic display and directional audio | |
US10347004B2 (en) | Musical sonification of three dimensional data | |
KR20180012166A (en) | Story-telling system for changing 3 dimension character into 3 dimension avatar | |
JP2013161205A (en) | Information processing device, information processing method and program | |
US20200410982A1 (en) | Information processing apparatus and information processing method and computer-readable storage medium | |
KR20080085551A (en) | Method and system for expressing a sound source in the form of the graphic | |
US9704276B1 (en) | Enhancement and display methods for intuitively read three-dimensional visual representations of digital audio files | |
CN110097618A (en) | A kind of control method, device, vehicle and the storage medium of music animation | |
CN112883223A (en) | Audio display method and device, electronic equipment and computer storage medium | |
KR101725068B1 (en) | Apparatus and method of providing workbook using resource of electronic book | |
CN113885828A (en) | Sound effect display method and terminal equipment | |
CN107093209A (en) | Image processing method, equipment and virtual reality device | |
KR102372038B1 (en) | Method of spatial-tangible color education using multimedia contents, application and terminal for the same | |
JP2016047193A (en) | Video game processing program, video game processor, and video game processing system | |
Tanprasert et al. | AR music visualizers: Application space and design guidelines | |
CN110992450A (en) | Music fountain simulation system based on OpenGL | |
JP7392074B2 (en) | Speech bubble generation program and video game processing system | |
Salter | Taking Over the World, Again? Examining Procedural Remakes of Adventure Games | |
JP7370363B2 (en) | Information processing device, program and drawing method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
E902 | Notification of reason for refusal | ||
E601 | Decision to refuse application |