KR20170134178A - Apparatus and method for generation of olfactory information - Google Patents

Abstract

The present invention relates to an expression method for expressing the capability of an electronic nose device and transferring a recognized smell in a virtual reality system. The present invention provides an apparatus and a method for generating olfactory information. According to an embodiment of the present invention, the apparatus for generating olfactory information has a configuration to measure and digitize the strength of human recognition compared with gas density of a chemical substance detected by an electronic nose. According to another embodiment of the present invention, the apparatus for generating olfactory information has a configuration to express a quantitative index regarding the harmfulness of a substance sensed by the electronic nose. The method of generating olfactory information is performed through configuration to generate all information in the form of an extensible mark-up language (XML) format. Through this configuration, the type of odor sensed by an actual olfactory sense, the time required for sensing, the degree of fatigue of an olfactory organ of a human body, or the like are digitized and expressed to correspond to the operation of the actual olfactory organ of the human body.

Description

[0001] APPARATUS AND METHOD FOR GENERATION OF OLFACTORY INFORMATION [0002]

The present invention relates to a representation method for expressing the capability of an electronic nose device and a recognized smell in a virtual reality system based on MPEG-V, and more particularly, ≪ RTI ID = 0.0 > (MPEG-V) < / RTI >

The present invention relates to a representation method for expressing the capability of an electronic nose device and a recognized smell in a virtual reality system based on MPEG-V, and more particularly, ≪ RTI ID = 0.0 > (MPEG-V) < / RTI >

In the real world, the concept of electronic nose (E-Nose) is used as a sensor for detecting particles or gases that cause odors. In the real world, odors are detected in a physical, chemical or biological way based on the concentration of the gas or the concentration of the particles causing the odor.

An attempt has been made in the MPEG-V standardization conference to express the sense of smell sensed by such an electronic nose sensor to reproduce in a virtual world or other real world.

It is time to develop a data type for sharing the olfactory information between the virtual world and the real world which are upgraded and standardized through the MPEG-V standardization conference.

An object of the present invention is to provide an interoperability between a virtual world and a real world by recognizing the smell existing in the real world within the scope of MPEG-V and transmitting the smell of the real world to the virtual world.

The present invention aims at generating and delivering detailed information in the process of delivering the smell of the real world to the virtual world. The present invention provides a virtual world in which the concentration of a gas, which is a cause of the smell of a real world, is transferred to a virtual world as raw data, while a quantitative evaluation result according to a human organoleptic test is transmitted to a virtual world. And to more faithfully reproduce the mood represented by the smell of smoke.

The present invention reflects the olfactory adaptation effect over time, maps the change in the concentration of gas in the real world to the result of quantitative evaluation felt by humans, thereby reducing the fatigue of the olfactory sense, And to provide a means for effectively reproducing it in the world.

It is an object of the present invention to provide a method and apparatus for generating smell information that can effectively cope with toxic gases in the real world. By mapping the intensity of the smell felt by humans to the specific gas and the quantitative evaluation result of the toxicity of the gas, safety management for harmful gas which can not be recognized by humans can be made.

In order to achieve the above object, a method of generating a smell information according to an embodiment of the present invention assumes a case where a human perceived intensity is recorded in parallel with a concentration of a chemical substance sensed by an electronic nose Information which is judged to be a quantitative value felt by a human olfactory is generated as information having a format such as XML.

A method of generating smell information that can be shared between a real world and at least one or more virtual worlds, the method comprising the steps of: detecting a smell of the real world by a sensor that recognizes the smell of the real world, Obtaining quantitative / qualitative information on the actually detected gas; Obtaining phenotypic data comprising an evaluation of the quantitative value of the real world odor by the analysis processor for the original data; And generating the olfactory information of the real world including the original data and the expression data together.

The original data may be quantitative information and qualitative information about the actually detected gas, and the phenotype data may mean information obtained by determining the strength felt by the human olfactory sense.

The olfactory information of the real world including the original data and the expression data can be generated as information having a format such as XML and compatible with various platforms.

The phenotypic data may include a concentration interval that quantitatively indicates a case where the human being is imperceptible.

Both the original data and the expression data may contain values over time. For example, the original data may include a series of results that perceive the smell of the real world over time, and the phenotype data may include a series of evaluations of the quantitative values of the real world odors over time. The passage of time can be expressed using a time stamp.

The olfactory information generation method according to another embodiment of the present invention expresses the harmfulness of the substance sensed in the electronic nose by a quantitative index having a format such as XML.

A method of generating smell information that can be shared between a real world and at least one or more virtual worlds, the method comprising the steps of: detecting a smell of the real world by a sensor that recognizes the smell of the real world, Obtaining quantitative / qualitative information on the actually detected gas; Obtaining phenotypic data which is harmfulness information including quantitative evaluation of the toxicity of the smell of the real world by the analysis processor for the original data; And generating olfactory information of the real world including the expression data.

The present invention can monitor the harmfulness of the noxious gas and its effect on the human body by mapping the quantitative evaluation result of the toxicity to the specific gas and the actual gas concentration with respect to the intensity of the smell felt when the person recognizes the specific gas.

If only the olfactory original data is provided without the phenotype data, only the concentration information of the actual gas is provided to the virtual world, so there is no information about how the virtual characters in the virtual world will react to the gas, so that the virtual characters react unrealistically These virtual characters are objects to which real users mainly interact or empathize, and as a result of this compatibility error, the reliability of the virtual world is drastically reduced, so that there is a great restriction on the usage field of the virtual world. Providing phenotypic data information is very important. Since the present invention generates and transmits the phenotype data and the original data as the olfactory information, reliability of the olfactory information in the virtual world can be increased.

Expression data is essential to the virtual world. To produce phenotype data, it is necessary to have fine-grained original data at millisecond level over a long period of time. Therefore, it is ultimately a costly option to send original data directly because the data size is very large. Ultimately, converting olfactory information to processed phenotypic data to a certain extent in order to deliver the olfactory information in the virtual world will be an inevitable choice in the evolution of the virtual world. At this time, providing the original data at an appropriate level to the generation and transmission of the phenotype data is a means of dramatically increasing the reality when reproducing in the virtual world while effectively reducing the data transmission capacity.

According to the present invention, it is possible to recognize the smell existing in the real world within the scope of MPEG-V, and deliver the smell of the real world to the virtual world, thereby providing interoperability between the virtual world and the real world.

The present invention digitizes and displays the type of odor sensed by the actual olfactory sense, the time required for sensing, and the fatigue of the body's olfactory organ, so as to correspond to the action of the human body's olfactory organ. This can contribute to the commercialization of research that digitizes human senses such as Virtual Reality and Scent Display.

According to the present invention, it is possible to generate and deliver detailed information in the process of delivering the smell of the real world to the virtual world. According to the present invention, the concentration of the gas, which is the cause of the smell of the real world, is transferred to the virtual world as raw data while the quantitative evaluation result according to the organoleptic test sensed by the human being is transmitted to the virtual world. It is possible to faithfully reproduce the mood represented by the smell of the world.

According to the present invention, it is possible to include time-series hypothetical olfactory information by using a change in the gas density of the real world and the strength of the smell felt by humans with the lapse of time, Can be reproduced in the virtual world as it is.

According to the present invention, it is possible to provide a more effective method for realizing the virtual olfactory sense in the virtual world by generating the phenotype data in consideration of the olfactory adaptation effect to the smell of the real world. In addition, it is possible to reduce the fatigue of the human olfactory and to increase the olfactory transmission effect without decreasing the sensitivity of the olfactory angle even in the generation of the continuous virtual olfactory angle.

According to the present invention, the quantitative evaluation result of the intensity of the odor felt by humans and the toxicity of the gas can be mapped to the specific gas, so that the safety management of the harmful gas which can not be perceived by humans can be made.

In the case of extracting gas information using existing gas sensors, it is difficult to extract low-concentration gas information irrespective of the surrounding environment because it is highly influenced by surrounding situations and sensitivity is limited. Although the idea was difficult to imagine, the development of nanosensors enabled low concentrations, and the development of the Convolution Neural Network enabled the standardization of measurement through automation of time series feature extraction in complex situations, so it is possible to replace human sensory evaluation Level.

1 is a flowchart of a method of generating smell information to generate phenotype data including a quantitative evaluation of original data of a gas concentration and a smell of a real world according to an embodiment of the present invention.
2 is a flowchart of a method of generating smell information to generate phenotype data including a quantitative evaluation of the toxicity of the smell of real world according to another embodiment of the present invention.
3 is a view showing a smell information generating apparatus according to an embodiment of the present invention.
4 is a diagram showing the correspondence relationship between the intensity of the odor of the real world (concentration of gas) and the quantitative evaluation index felt by humans according to an embodiment of the present invention.
5 is a diagram showing a change in the intensity of the smell in the real world over time according to an embodiment of the present invention and a corresponding relationship between quantitative evaluation indexes felt by humans over time.
FIGS. 6 and 7 are diagrams showing expression data of a quantitative evaluation index over time according to an embodiment of the present invention. FIG.
8 is a diagram showing the correspondence relationship between the intensity of the odor of the real world (concentration of gas), the quantitative evaluation index felt by humans, and the evaluation index for the degree of harmfulness according to an embodiment of the present invention.
9 is a diagram illustrating an XML representation syntax of a Sensed Information Base Type according to an embodiment of the present invention.
10 is a diagram illustrating a binary representation syntax of a Sensed InfoBaseType according to an embodiment of the present invention.
11 is a diagram showing the semantics of the Sensed InfoListType according to an embodiment of the present invention.
12 is a diagram illustrating a binary representation syntax of fragrance intensity according to an embodiment of the present invention.
FIGS. 13A and 13B are diagrams illustrating changes in the overall Binary representation syntax by adding an imperceptible step to the binary representation of the strength according to an embodiment of the present invention. FIG.
FIG. 14 is a view schematically illustrating a process of generating information on a harmful odor generated in the olfactory information generating process according to an embodiment of the present invention. Referring to FIG.
FIG. 15 is a diagram illustrating an XML representation syntax of an E-Nose Sensor Type according to an embodiment of the present invention.
16 is a diagram illustrating a binary representation syntax of an inose sensor type according to an embodiment of the present invention.
FIGS. 17 through 19 are diagrams illustrating Semantics of the EnceSensorType of the Enosensor Type Semantics according to an embodiment of the present invention.
FIG. 20 is a diagram showing a syntax defining harmfulness among the XML representation syntax of an in-noose sensor type according to an embodiment of the present invention.

Other objects and features of the present invention will become apparent from the following description of embodiments with reference to the accompanying drawings.

Preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. Also, for convenience of explanation, the embodiments shown in the drawings may be partially exaggerated.

However, the present invention is not limited to or limited by the embodiments. Like reference symbols in the drawings denote like elements.

A typical virtual world processing system included as part of the configuration of the present invention may correspond to an engine, a virtual world, and the real world. In the real world, it includes an electronic nose device for sensing information about the real world, or a smell diffusion device for realizing information about the virtual world in the real world. In addition, the virtual world may include a virtual world per se implemented by a program or a smell media playback apparatus that plays back content containing smell information that can be implemented in a real world.

For example, the electronic nose device can sense information about the smell of the real world, the capability and specification of the electronic nose device, and transmit it to the engine. Or an electronic nose instrument is a part describing the kind of sensor necessary for defining the inoperability type, which is an Innose Capability Type which is a part for transmitting the capability and specification of the electronic nose instrument to the engine A Odor Sensor Technology CS, and an Enose Sensed Info Type, which is a part for transmitting information recognized by the electronic nose equipment to the engine.

The engine can send Sensed Information to the virtual world. At this time, the sensed information virtual world is applied, and the effect corresponding to the inactive sensed infotype corresponding to the smell of the real world can be realized in the virtual world.

An effect event generated in a virtual world can be driven by a smell diffusion apparatus in a real world. (Sensory Effect), which is information on an effect event occurring in the virtual world, to the engine. In addition, the VW Object Characteristics can be transmitted between the virtual world and the engine.

In this paper, we propose a smell diffusion system and a user's preference in the real world within the scope of MPEG-V. The smell diffusion apparatus exists in the real world and plays a role of enabling users to feel the sense of reality by synchronizing with the content of the virtual world by giving incense to the user. For this purpose, Scent Capability Type is defined as the part that transmits the capability and specification of the smell diffusion apparatus to the engine. Also, in order to compensate the difference between the fragrance characteristics provided by the smell diffusion apparatus and the fragrance characteristics felt by the user, a portion providing the user's preference is defined as a Scent Preference Type. In addition, a command portion for causing the smell diffusion apparatus to incense is defined as a Scent Effect.

The generalized virtual world processing method included as part of the constitution of the present invention is a method of transmitting the olfactory information about the virtual world, the real world and the other virtual world between a virtual world and a real world or between the virtual world and another virtual world , And expressing the olfactory information through the smell diffusion apparatus. The generalized virtual world processing method includes acquiring virtual information which is olfactory information of a virtual world, acquiring real information which is olfactory information of the real world through a realistic recognition unit which is a device for recognizing the smell, And provides the virtual world or other virtual world with the reality information, and can make the user experience the user through the smell diffusion apparatus based on the virtual information and the reality information.

The reality information includes an ability of the electronic nose device, which is the reality recognition device, an inose's capacity type, which is a part for transmitting the specification to the engine, and a type of sensor required for defining the inose's capability type, By nose

Which is a part for transmitting the recognized information and the information recognized by the electronic nose.

In order to compensate for the difference between the fragrance characteristics provided by the fragrance spreader and the fragrance sensed by the user, a step of defining the Scent Capability Type, Defining a Scent Preference Type, which is a part for providing a fragrance, and defining a Scent Effect, which is an instruction portion for causing the fragrance smell to be fragrant.

3 is a view showing a smell information generating apparatus according to an embodiment of the present invention.

The olfactory information generating apparatus 300 of FIG. 3 may be implemented in the form of an electronic nose, but may be installed in cooperation with a gas sensor. The olfactory information generation apparatus 300 includes a sensor 310, a processor 320, a database 330, and a communication module 340.

Although not explicitly shown in FIG. 3, a user interface such as a button or a switch that can input an ON / OFF command of a power source from the outside may be additionally included. In addition, a keypad, a touch screen, A user interface such as a microphone may be added.

The sensor 310 recognizes the smell of the real world. The flow 310a of the gas particles constituting the smell of the real world is sensed by the sensor 310. The sensor 310 may be implemented in a plurality of combinations of gas sensors sensing a specific type of gas. The plurality of gas sensors may detect different types of gas, and the same type may also include a plurality of gas sensors corresponding to different concentration ranges.

The sensor 310 acquires the result of sensing the smell of the real world as original data. The original data contains quantitative and qualitative information on the actually detected gas. The quantitative information is the concentration of the gas or the concentration of the gas over time, and the qualitative information may include information about the type of gas and the situation in which the gas is detected. Such an operation can be performed more precisely by the density data generation unit inside the processor 320. [

The processor 320 may convert the original data of the real world odor to phenotypic data including an assessment of the quantitative value of the real world odor. At this time, the quantitative evaluation can be performed on the basis of the sensory evaluation information that the human senses about the smell of the real world. The information of the sensory evaluation for each gas may be stored in the database 330. The phenotype data generation unit in the processor 320 may execute the conversion process to the phenotype data.

Processor 320 generates real-world olfactory information that includes both source data and expression data. The phenotypic data includes information on thresholds that humans can feel about a specific gas. In other words, the phenotype data may include information about an imperceptible gas concentration section that humans can not feel.

The sensor 310 may track different gas concentrations over time and store them in the database 330 with a timestamp. The raw data generated by the sensor 310 over time can be transferred to the processor 320 via the database 330. [ The processor 320 may convert the original data over time into quantitative evaluation information according to the gas concentration period. The processor 320 can generate quantitative evaluation information as the expression data over time.

The toxicity expression data generation unit in the processor 320 may generate the toxicity expression data including the quantitative evaluation information on the toxicity corresponding to the original data.

The communication module 340 may transmit the expression data generated by the processor 320 and the original data generated by the sensor 310 to an external server or a relay device. The processor 320 may generate olfactory information in the form of xml including both the original data and the expression data. The communication module 340 can substitute for delivery of the original data and the expression data by transmitting the olfactory information of xml type.

The communication module 340 may transmit the olfactory information generated in real time to the outside, but the olfactory information may be stored in the database 330 as it is generated, and may be transmitted to the outside by the communication module 340 at a predetermined time interval . For convenience of explanation, the result information obtained by collecting the olfactory information generated in real time can be referred to as a fine-grained history. Coarse-Grained History is a result of analyzing fine-grained history information accumulated over a long period of time, and it is possible to obtain long-term sensor information from Fine-Grained History As shown in FIG. Fine-Grained History is stored in the Fine-Grained History DB in the database 330, and Coarse-Grained History is stored in the Coarse-Grained History DB.

1 is a flowchart of a method of generating smell information to generate phenotype data including a quantitative evaluation of original data of a gas concentration and a smell of a real world according to an embodiment of the present invention. Referring to FIG. 1, in a smell information generating method for generating smell information that can be shared between a real world and at least one virtual world, it is checked whether initialization of the sensor is completed (S110).

The initialization process of the sensor is repeated until the initialization of the sensors is completed. When the initialization of the sensors is completed, BaseLine information of the sensors is obtained (S112). BaseLine information is the measurement value of the gas sensor according to the location and environment value in the zero-gas state, and zero point can be adjusted.

Gas-reaction-related output information and fine-grained history of the sensors are stored (S120). Fine-Grained History refers to the raw raw measurement data obtained by subdividing the time interval into small segments.

Gas concentration data is generated (S122). It is checked whether the accumulation of the sensor data is completed (S130). When accumulation of sensor data is completed, short-term phenotype data is generated (S132). Short-term phenotypic data refers to data that is converted into the strength felt by humans based on the sensory evaluation result felt by humans in the information collected by the sensor for a short-term time interval.

Short-term phenotype data is analyzed based on the olfactory adaptation or olfactory adaptation effect (S134). Variation information and coarse-grained history over time of the short-term phenotype data are stored (S136). The Coarse-Grained History information may include raw data collected by the sensor as accumulated information for a time interval set in the mid / long term.

It is checked whether accumulation of short-term phenotype data is completed (S140). When the accumulation of short-term phenotype data is completed, accumulated phenotype data is generated (S142).

The original data of the result of sensing the smell of the real world can be obtained by the sensor recognizing the smell of the real world. At this time, quantitative information on the actually detected gas, that is, the odor molecule, is obtained. At this time, the original data can be expressed by a chemical gas density item to be described later.

After obtaining the original data, the analysis processor for the original data may obtain phenotypic data including an assessment of the quantitative value of the real world odor. Here, the evaluation of the quantitative value means the information determined based on the strength of the fragrance that can be felt by the human smell.

The olfactory information according to the intensity of the smell is generated by generating the smell information of the real world together with the original data and the expression data acquired in the previous step. The olfactory information at this time means information having a format such as XML. The olfactory information can include both original data and phenotypic data, which will be a means to more accurately convey the atmosphere of the real world when reproducing the olfactory information of the real world in the virtual world.

2 is a flowchart of a method of generating smell information to generate phenotype data including a quantitative evaluation of the toxicity of the smell of real world according to another embodiment of the present invention. 2, in the method of generating smell information that can be shared between the real world and at least one virtual world, steps S210, S212, S220, S222, and S230 of FIG. , S112, S120, S122, and S130, duplicate descriptions are omitted.

When accumulation of sensor data is completed in step S230, short-term toxicity expression data is generated (S232). Short-term toxicological expression data refers to data converted into a quantitative assessment (harmfulness) about the harmfulness to human beings based on the harmfulness evaluation result of the information collected by the sensor for a short-term time interval.

Short-term toxicity expression data is analyzed based on the toxic accumulation effect (S234). That is, even if the degree of harmfulness is low in the short-term toxicity data, long-term exposure can increase the harmful effects on the human body. Depending on the gas, long-term exposure may accumulate in the human body and continue to be harmful, so it is necessary to analyze short-term toxicity expression data based on exposure time and toxic accumulation effects.

The variation information and the coarse-grained history of the short-term toxicity expression data over time are stored (S236). The Coarse-Grained History information may include raw data collected by the sensor as accumulated information for a time interval set in the mid / long term.

The accumulation of the short-term toxicity expression data is checked (S240). When the accumulation of the short-term toxicity expression data is completed, cumulative toxicity expression data is generated (S242).

After obtaining the original data, the analysis processor for the original data may obtain the toxicity expression data, including a quantitative assessment of the toxicity of the real world odor. Here, a quantitative evaluation of toxicity means information determined based on whether the sensed odor has harmfulness. Harmfulness can be provided in the form of a result of an evaluation if it is difficult to express it by numerical value alone. The results of the evaluation of the harmfulness introduced in Fig. 15 or 20 to be described later may be an example of such a quantitative evaluation.

It generates olfactory information including information on whether or not the sensed odor is a harmful substance through a process of generating the olfactory information of the real world including the toxicity expression data acquired in the previous step. The olfactory information at this time means information having a format such as XML.

4 is a diagram showing the correspondence relationship between the intensity of the odor of the real world (concentration of gas) and the quantitative evaluation index felt by humans according to an embodiment of the present invention.

Referring to FIG. 4, an example of the concentration interval 410 to 460 corresponding to the quantitative evaluation index of the concentration of the specific gas detected by the sensor 310 is shown.

The concentration interval 410 is an interval that humans can not feel, and the evaluation index corresponding to the concentration interval 410 is imperceptible to humans. The evaluation index corresponding to the concentration interval 420 is very weak and the evaluation index corresponding to the concentration interval 430 is weak.

The evaluation index corresponding to the concentration interval 440 is distinct and the evaluation index corresponding to the concentration interval 450 is strong and the evaluation index corresponding to the concentration interval 460 is very strong, to be. The example of the evaluation index shown in Fig. 4 is one example, and the idea of the present invention is not limited by this embodiment. The corresponding interval of the evaluation index may be further subdivided or briefly expressed. Hereinafter, for convenience of explanation, it is assumed that each concentration interval 410 to 460 can be represented by a median value of the concentration interval. In particular, when the olfactory information of the real world is reproduced in the virtual world, the virtual gas concentration may be reproduced as it is in the virtual world, but the virtual olfactory angle may be reproduced based on the median value of the concentration ranges 410 to 460.

5 is a diagram showing a change in the intensity of the smell in the real world over time according to an embodiment of the present invention and a corresponding relationship between quantitative evaluation indexes felt by humans over time.

Graph 510 is a graph showing changes in gas concentration over time. Here, the quantitative evaluation index can be represented by the graph 512. That is, a difference between the actual gas concentration change and the gas concentration (representative value of the corresponding concentration section) indicated by the evaluation index may appear by the difference between the graph 512 and the graph 510. [ As time elapses, humans can experience olfactory adaptation due to olfactory fatigue and feel no smell. However, reflecting the olfactory adaptation effect, even if the gas concentration remains above the threshold value, the quantitative evaluation index becomes more imperceptible can do.

In the first time period 510a, the graph 512 of the strength felt by humans may be expressed as imperceptible, i.e., 0, even though the graph 510 of the actual gas concentration is not zero. In the second time period 510b, the graph 510 of the actual gas concentration corresponds to the weak section in the graph 512 of the strength felt by the human. In the third time period 510c, the graph 510 of the actual gas concentration can correspond to the disinct section in the graph 512 of the strength felt by the human being.

When the third time period 510c elapses, a smell compliance graph 512 of the smell intensity felt by humans appears to fall to zero. That is, in the fourth time period 510d after the olfactory adaptation, the graph 510 of the actual gas concentration shows a non-zero value, but the graph 512 of the smell intensity felt by humans indicates zero.

The graph 510 indicating the change in the actual gas concentration can be converted into the graph 520 indicating the change in the quantitative evaluation index over time by the processor 320. At this time, based on the mapping relationship between the actual gas concentration shown in FIG. 5 and the concentration interval 410 to 460 corresponding to the quantitative evaluation index, the processor 320 calculates the graph 510 as a graph 520 Can be converted.

If the change in the gas concentration with the lapse of time shown in FIG. 5 can be reproduced in the real world, it is possible to reproduce not only the smell but also the mood to which the smell is delivered. For example, a certain odor may spread slowly and show an atmosphere of a scent of incense, a certain odor may represent a very explosive intense aroma, and some odor may spread at an early stage, And can turn into a strong smell that stings your nose.

The mood formed by the smell can be reproduced more accurately by transmitting the smell information including both the change in the gas concentration and the change in the quantitative evaluation index over time as shown in Fig.

At this time, more precise reproduction is possible if both the gas concentration and the quantitative evaluation index are taken into consideration. For example, considering whether the gas concentration is actually "0" or not "0" when the evaluation index is imperceptible, the intensity of the smell that is reproduced in the virtual world is not a "0" or a "0" Can be set.

FIGS. 6 and 7 are diagrams showing expression data of a quantitative evaluation index over time according to an embodiment of the present invention. FIG.

In FIG. 6, transition is made to an imperceptible state, a weak state, a distinct state, and an imperceptible state with passage of time. At this time, it is difficult to distinguish whether the initial imperceptible state and the final imperceptible state are completely the same or not.

The imperceptible state can be expressed by distinguishing the imperceptible (non-zero) state from the imperceptible (zero) state as shown in FIG. The change of the quantitative evaluation index of FIG. 7 can be implemented corresponding to the actual gas concentration of FIG. 4 and the quantitative evaluation index graph of FIG.

The first time period 510a in FIG. 5 is a case where the actual gas concentration is a value other than "0" and a value smaller than a threshold value that humans can feel. In this case, the quantitative evaluation index shows an imperceptible state. However, if the actual gas concentration is reflected, the corrected quantitative evaluation index of the initial state can be expressed as an imperceptible (non-zero) state as in the first state of FIG.

Conversely, the fourth time interval 510d in FIG. 5 includes both the interval where the actual gas concentration is not "0 " and the interval when the actual gas concentration is" 0 ", and the quantitative evaluation index is represented by the olfactory adaptation effect in an imperceptible state. In this case, even if the actual gas concentration is not "0" due to the olfactory adaptation effect, the intensity of the smell felt by humans can be regarded as an imperceptible state. That is, since the final state is recognized as imperceptible regardless of whether the actual gas concentration is "0" or not "0", the corrected quantitative evaluation index of the final state is imperceptible (zero / non-zero) do not care state.

7, the final state of FIG. 7 may be divided into imperceptible (zero) and imperceptible (zero / non-zero) states. This is an embodiment that more accurately reflects the actual gas concentration in FIG.

When the initial state of the imperceptible (non-zero) state is displayed separately, the gas concentration of the odorous gas to be reproduced in the virtual world can be realized using the intermediate value of the concentration domain 410 of FIG. On the other hand, the imperceptible (zero) state will be reproduced as the odorant gas concentration "0". The graph 510 of actual gas concentration shown in FIG. 5 continuously increases even in the imperceptible state of the graph 520 in the first time period 510a, and transitions to a weak state while exceeding the threshold value. At this time, if the imperceptible initial state of the first time interval 510a is simply reproduced as the gas concentration "0 ", it is difficult to control because the gas concentration must be rapidly changed when transitioning to the weak state in the second time interval 510b. In the virtual world, the gas concentration of the smell for reproducing the virtual smell can be reproduced as it is or can be implemented based on a quantitative evaluation index. When the gas concentration of the smell for reproducing the virtual smell is implemented based on the quantitative evaluation index, the imperceptible status is divided into zero, non-zero and do not care states by using the corrected evaluation index of FIG. 7 It is possible to effectively reproduce the target virtual olfactory angle while reducing the energy at the time of smell diffusion.

8 is a diagram showing the correspondence relationship between the intensity of the odor of the real world (concentration of gas), the quantitative evaluation index felt by humans, and the evaluation index for the degree of harmfulness according to an embodiment of the present invention.

The concentration section 860, the concentration section 870 and the concentration section 880 are the same as the concentration sections 410 to 430 shown in Fig. 4, which represent the intensity of the smell felt by humans in association with the quantitative evaluation index Duplicate description is omitted.

The concentration interval 810 is an interval in which there is no harm to humans, and the evaluation index corresponding to the concentration interval 810 is harmless (no_hazard). The evaluation index corresponding to the concentration interval 820 is minimal, and the evaluation index corresponding to the concentration interval 830 is moderate. The evaluation index corresponding to the concentration interval 840 is serious and the evaluation index corresponding to the concentration interval 850 is severe.

One example of the evaluation index shown in Fig. 8 is one example, and the spirit of the present invention is not limited by this embodiment. The corresponding interval of the evaluation index may be further subdivided or briefly expressed.

There may be safety problems when the actual gas concentration, the quantitative evaluation index that humans can feel, and the evaluation index for the hazard are inconsistent with each other. For example, as shown in FIG. 8, the evaluation index for harmfulness may change to no_hazard, minimal, moderate in a concentration interval 860 that can not be sensed, which is less than a threshold value that humans can feel. That is, when the human being is exposed to the concentration section 820 having minimal harmfulness without feeling, or exposed to the concentration section 830 having a moderate harmfulness without feeling human being, humans may inhale harmful gas without knowing it Can be. As described above, since the toxicity of the gas may accumulate in the body when exposed for a long time, the corresponding section of the evaluation index in FIG. 8 may be adjusted to increase the evaluation of toxicity when the exposure time to gas is prolonged.

Therefore, according to the present invention, it is possible to notify the user of harmful gas that can not be felt by humans based on the mapping relationship between the actual gas concentration, the quantitative evaluation index that humans can feel, and the evaluation index for the harmfulness, thereby enhancing safety. By adjusting the assessment of the harmfulness of the gas taking into account the time of exposure to the gas, safety management can be further improved.

There is also a gas which is seriously or severely harmful in a state in which no human senses as a colorless and odorless gas at some degree depending on the gas and therefore the olfactory information generating apparatus or apparatus of the present invention In the connected server, if it is judged that the human being can not feel when the harmful gas is detected, it can induce a special alarm to call attention of the people around and to take necessary measures to secure safety.

9 is a diagram illustrating an XML representation syntax of a Sensed Information Base Type according to an embodiment of the present invention.

In order to reproduce information sensed or acquired by the electronic nose sensor so that the human nose can feel the virtual world or other real world, a TimeStamp item indicating the time when information is sensed or acquired in the electronic nose sensor is additionally introduced. Considering the characteristics of the olfactory organ, which are more sensitive and easily fatigued than other organs, the inclusion of time items in olfactory information is a very important factor. The TimeStamp is defined in ISO / IEC 23005-6 as "There is a choice of three timing schemes, which are absolute time, clocktick time, and delta of clock tick time." Can be defined in the form of.

The TimeStamp is information for defining the information sensed or acquired by the electronic nose sensor and may be defined as a sub item of the Sensed InfoBaseType, which is a type of sensed infotype as shown in FIG. FIG. 9 shows an XML representation syntax in which TimeStamp is defined as a sub item of the sensed information type.

10 is a diagram illustrating a binary representation syntax of a Sensed InfoBaseType according to an embodiment of the present invention. Referring to FIG. 10, the binary representation syntax of the sensed information type can be known.

11 is a diagram showing the semantics of the Sensed InfoListType according to an embodiment of the present invention. Referring to FIG. 8, details of the sensed InfoList type according to the semantics can be obtained. The TimeStamp item provides information on the time at which the information sensed in the electronic nose is acquired, and includes a method such as absolute time, clocktick time, and delta of clock tick time As described above. The TimeStampFlag item is a Flag indicating whether or not the TimeStamp item exists.

12 is a diagram illustrating a binary representation syntax of fragrance intensity according to an embodiment of the present invention. The fragrance intensity shown in FIG. 12 means a value estimated from the intensity of the smell sensed by the electronic nose to the intensity that the human can actually feel. Humans have olfactory adaptation, and if they are exposed to the same odor for more than a certain period of time or more than a certain intensity, the olfactory fatigue may limit the intensity of feeling no smell or smell. 12 may be a value including an estimation by the olfactory adaptation phenomenon, and the intensity of the actually sensed odor may be mapped to the intensity of the fragrance as shown in FIG. 4 through an organoleptic test Can be added.

Referring to FIG. 13A, the binary expression syntax of the perfume intensity can be known. "0000" is very weak (very_weak), "0001" is weak, "0010" is distinct, "0011" is strong and "0100" is strong. Quot; is very strong, "0101" is intolerable, and "0111-1111 " is reserved for future use.

FIG. 13B is a diagram showing a change in the overall perfume intensity binary representation syntax by adding an imperceptible step to the binary representation of the strength according to an embodiment of the present invention.

In other words, as a result of detection of the electronic nose, although the concentration of the particles causing odor is not zero, but there is also a fragrance that can not be detected by the olfactory organ, it is more imperceptible to express the sense strength of the olfactory organ ) Step was added. Thus, the conventional binary phenotypes shown in FIG. 13A were increased by one in FIG. 13B due to the introduction of imperceptible intensity.

FIG. 14 is a view schematically illustrating a process of generating information on a harmful odor generated in the olfactory information generating process according to an embodiment of the present invention. Referring to FIG. As can be seen from the upper left corner of the figure, the perceived aroma is divided into six stages from no harm (grade 0) to a serious level (grade 5). FIG. 14 schematically shows a use case in which fragrance and perfume information sensed by an electronic nose are matched with information of a previously stored perfume database to evacuate people to a safe place when harmful fragrance is generated. However, even with such a configuration, the variety of odor molecules present on the earth does not precisely match the respective scents.

FIG. 15 is a diagram illustrating an XML representation syntax of an E-Nose Sensor Type according to an embodiment of the present invention. Referring to FIG. 15, an XML representation syntax of an inose sensor type can be known.

Referring to FIG. 15, "strengthType" and "harmfulnessType" are introduced as sub items of SensedInfoBaseType, and "chemicalGasDensity" item is introduced among attribute names. Here, "chemicalGasDensity" means the concentration of gas actually sensed in the electronic nose, and "chemicalGasDensityUnit" The term "strengthType" means a value converted or estimated to a human perceivable strength, so that the numerical value may be expressed as a value such as ppm, or may be provided in a form in which the sensory evaluation value is reflected. In FIG. 15, examples of the value of "strengthType" are shown as "imperceptible", "very_weak", "weak", "distinct", "strong", "very_strong", "intolerable" .

In addition to the numerical value in "harmfulness", the result of evaluating the degree of harmfulness can be provided as value. Examples of the values of "harmfulness" shown in FIG. 15, "no_hazard", "minimal", "slight", "moderate", "serious" and "severe"

Use cases that use "strengthType" and "harmfulness" are very useful when the electronic nose is used for the safety diagnosis of factories, because harmful gases may be present even when humans classify them as colorless odorless gases. Will be.

When the olfactory information of the real world sensed and generated in the electronic nose is to be shared in another real world or virtual world, it can be very useful to transmit the mood as it is. Thus, providing the "chemicalGasDensity" value actually sensed in the electronic nose and the "strengthType" with the intensity of the odor re-evaluated on the basis of the human olfactory can be a very effective means of sharing olfactory information between the virtual world and the real world.

When information on the olfactory sense of the real world is shared in the virtual world, information on the time when human beings are exposed to odors can also be usefully used. That is, when the TimeStamp item introduced in Figs. 9 to 11 and the "stengthType" item are provided together, the atmosphere of the smell actually sensed in the electronic nose can be easily reproduced in the virtual world.

16 is a diagram illustrating a binary representation syntax of an inose sensor type according to an embodiment of the present invention. Referring to FIG. 16, an inose sensor type binary expression syntax is known.

17 to 19 are diagrams illustrating the definitions of the lower items of the Enose Sensor Type according to an embodiment of the present invention. In Fig. 19, it is introduced that EnoseSensorType can define the physical sensor type of the electronic nose, but can include all the information about the electronic nose including the sensed information.

In FIGS. 18 and 19, items such as strength, harmfulness, chemicalGasDensity, and chemicalGasDensityUnit are defined. In FIG. 19, an example of values that strength and harmfulness items can have is once again introduced.

FIG. 20 is a diagram showing a syntax defining harmfulness among the XML representation syntax of an in-noose sensor type according to an embodiment of the present invention. Referring to FIG. 20, an XML expression syntax defining harmfulness in the inose sensor type can be known.

The method according to an embodiment of the present invention may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

300: Smell information generating device
310: sensor 320: processor
330: memory 340: communication module

Claims (18)

A method of generating olfactory information that generates olfactory information that can be shared between a real world and at least one or more virtual worlds,
Obtaining original data as a result of sensing the smell of the real world by a sensor recognizing the smell of the real world;
Obtaining phenotypic data comprising an evaluation of the quantitative value of the real world odor by the analysis processor for the original data; And
Generating olfactory information of the real world including the original data and the expression data together;
/ RTI > The method according to claim 1,
Wherein the expression data includes an interval that quantitatively indicates a case where the human being is imperceptible. 3. The method of claim 2,
Detecting the presence of the specific gas component in the real world, wherein the presence of the specific gas component is not felt by the user, by including the original data and the expression data together;
Wherein the smell information generating step further comprises: 4. The method of claim 3, further comprising: detecting whether the specific gas component detected is harmful to the human body;
Wherein the smell information generating step further comprises: The method according to claim 1,
Wherein the original data includes a series of results of sensing the smell of the real world over time together with a time stamp,
Wherein the phenotype data comprises a series of evaluations of a quantitative value of the real world odor over time with the timestamp. 6. The method of claim 5,
Generating a series of virtual olfactory information to be reproduced in a virtual world by using the series of olfactory information of the real world according to the passage of time using the time stamp;
Wherein the smell information generating step further comprises: The method according to claim 6,
The step of generating the series of hypothetical olfactory information
And reflecting a mood provided by the smell of the real world to a series of virtual olfactory information to be reproduced in the virtual world. The method according to claim 6,
The step of generating the series of hypothetical olfactory information
Correcting the phenotype data in consideration of the olfactory adaptation effect to the smell of the real world; And
Generating a series of virtual olfactory information to be reproduced in the virtual world based on the corrected expression data;
/ RTI > A method of generating olfactory information that generates olfactory information that can be shared between a real world and at least one or more virtual worlds,
Obtaining original data as a result of sensing the smell of the real world by a sensor recognizing the smell of the real world;
Obtaining first phenotypic data comprising a quantitative assessment of the toxicity of the real world odor by the analysis processor for the original data; And
Generating olfactory information of the real world including the first phenotype data;
/ RTI > 10. The method of claim 9,
Obtaining second phenotypic data comprising an evaluation of the quantitative value of the real world odor by the analysis processor for the original data; And
Embedding the second phenotype data in the olfactory information of the real world together with the first phenotype data;
Wherein the smell information generating step further comprises: 11. The method of claim 10,
Detecting a toxic specific gas component in the real world using the original data, the first phenotypic data, and the second phenotypic data, but detecting a situation in which a human can not feel;
Wherein the smell information generating step further comprises: 10. The method of claim 9,
The step of obtaining the first phenotype data
Mapping the quantitative assessment of the toxicity of the real world odor to each of the concentration ranges of the real world odor contained in the original data; And
Obtaining each of the concentration ranges of the odor of the real world to which the quantitative evaluation is mapped as a part of the first phenotype data
/ RTI > A smell information generating apparatus for generating smell information that can be shared between a real world and at least one virtual world,
A sensor for recognizing the smell of the real world and acquiring original data as a result of sensing the smell of the real world; And
A processor for analyzing the original data to obtain phenotypic data including an evaluation of the quantitative value of the odor of the real world, and generating the real-world olfactory information including the original data and the phenotype data;
And a smell information generating unit. 14. The method of claim 13,
Wherein the processor includes information on a section that quantitatively indicates a case where the human can not feel the sensory data. 14. The method of claim 13,
The sensor generates, as the original data, a series of results of sensing the smell of the real world over time with a time stamp,
Wherein the processor generates, as the expression data, information on a series of evaluations of a quantitative value of the real world odor with the passage of time together with the time stamp. A smell information generating apparatus for generating smell information that can be shared between a real world and at least one virtual world,
A sensor for recognizing the smell of the real world and acquiring original data as a result of sensing the smell of the real world; And
A processor for analyzing the original data to obtain first phenotypic data including a quantitative evaluation of the toxicity of the odor of the real world and generating olfactory information of the real world including the first phenotypic data;
And a smell information generating unit. 17. The method of claim 16,
Wherein the processor analyzes the original data to generate an evaluation of the quantitative numerical value of the smell of the real world as second expression data, and the olfactory information of the real world including the first expression data and the second expression data together The smell information generating device generating smell information. A computer-readable recording medium having recorded therein a program for executing the method according to any one of claims 1 to 12.

Images