JP2011215462A - Olfactory information controller, olfactory information control method and scent generation system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an olfactory information controller and a scent generation system for easily producing a sense of perspective or strength change of scents in association with audiovisual video information or the like.SOLUTION: The olfactory information controller includes: a storage unit storing audiovisual information data; and a unit for providing a virtual space on the basis of the audiovisual information data acquired from the storage unit. The olfactory information controller transmits pulse ejection control information of scent to a scent generator which performs pulse ejection of multiple kinds of perfumes into flowing air for a very short time at a prescribed pulse interval independently for each perfume. The pulse ejection control information of the scent is the information formed on the basis of scent array which is formed on the basis of the relationship between the audiovisual information data acquired from the storage unit and a scent generating source in the virtual space, and which determines the kind of scent, the amount of scent ejection, and the order of ejection of the kinds of scents.

Description

  The present invention relates to an olfactory information control device, an olfactory information control method, and a fragrance generating system that can effectively associate audiovisual information and olfactory information.

  In recent years, with the development of 3D video technology and 3D sound, the need for providing an environment that gives a sense of realism has increased, and the presentation of olfactory information corresponding to changes in video and audio has attracted attention as a means of providing even greater realism. Yes.

  So far, a technique for providing a scent according to a user's preference or a technique for presenting a fragrance in conjunction with multimedia has been proposed. (Patent Document 1, Patent Document 2)

JP 2003-162212 A JP 2006-48611 A

  However, in the prior art, the presentation of fragrance is to change the type of fragrance to be presented, or to turn on / off the presentation of fragrance, and the problem of adaptation of the olfactory nerve due to continuous injection of fragrance and the remaining fragrance The effect was inevitable.

  For this purpose, for example, as the character (avatar), which is the user's alternation in the virtual space, moves and moves, the presentation of multiple scents is finely changed, and the perspective and intensity change of the scent corresponding to the audiovisual information is changed. Could not be directed. In addition, the presentation of a plurality of scents was finely changed according to the video, and it was not possible to produce a sense of perspective or change in strength.

  Furthermore, those effects cannot be presented to the viewer in an easily understandable manner.

  The present invention solves such problems, and can easily produce a sense of perspective (perspective expression) and a change in strength in response to audiovisual video information and the like, and an olfactory information control device and an olfactory information control method And it aims at providing a scent generation system.

An olfactory information control apparatus that solves the above-mentioned problems has storage means for storing audiovisual information data, and means for providing a virtual space based on the audiovisual information data acquired from the storage means. It is an olfactory information control device that transmits fragrance pulse ejection control information to a fragrance generating device that individually pulsates a plurality of types of fragrances at a predetermined pulse interval for each fragrance,
The scent pulse ejection control information is formed based on the relationship between the audiovisual information data acquired from the storage means and the scent generation source in the virtual space, the scent type, the scent ejection amount, and the scent type. It is based on the scent arrangement | sequence which defined the injection | emission order.
Further, an olfactory information control method for solving the above-described problem has storage means for storing audiovisual information data, and means for providing a virtual space based on audiovisual information data acquired from the storage means, An olfactory information control device that transmits scent pulse emission control information to a scent generating device that individually pulsates a plurality of types of fragrances in flowing air at a predetermined pulse interval based on audiovisual information data The olfactory information control method in
The scent pulse ejection control information is formed based on the relationship between the audiovisual information data acquired from the storage means and the scent generation source in the virtual space, the scent type, the scent ejection amount, and the scent type. It is based on the scent arrangement | sequence which defined the injection | emission order.
Furthermore, a scent generating system that solves the above-described problems includes a storage unit that stores audiovisual information data, a unit that provides a virtual space based on the audiovisual information data acquired from the storage unit, and a flowing air A fragrance generating device that individually pulses a plurality of types of fragrances at predetermined pulse intervals for each fragrance, and a fragrance pulse injection control on the fragrance generating device based on the audiovisual information data acquired from the storage means A scent generation system comprising an olfactory information control device for transmitting information,
The scent pulse ejection control information is formed based on the relationship between the audiovisual information data acquired from the storage means and the scent generation source in the virtual space, the scent type, the scent ejection amount, and the scent type. It is based on the scent arrangement | sequence which defined the injection | emission order.

  According to the present invention, it is possible to easily produce a sense of scent perspective (perspective expression) or intensity change corresponding to audiovisual video information or the like.

  Moreover, those effects can be presented to the viewer in an easy-to-understand manner.

The conceptual diagram which shows the whole olfactory information control apparatus and fragrance system of this invention. The block diagram of the olfactory information control apparatus and fragrance generation system of this invention. Explanatory drawing of fragrance pulse ejection. The operation | movement conceptual diagram of the head of the bubble jet (trademark) system which performs the pulse injection of a fragrance | flavor. The conceptual diagram of the head which carries out pulse ejection of a fragrance | flavor. The figure which shows an example of the pulse injection apparatus of a fragrance (partially broken view). FIG. 7 is an AA cross-sectional view of the apparatus shown in FIG. 6. FIG. 8 is an enlarged view of the discharge port array viewed from the direction of arrow B in FIG. 7. Flow chart of scent arrangement. Explanatory drawing of fragrance arrangement | sequence formation by the movement of the avatar in virtual space. Explanatory drawing of scent arrangement | sequence formation by operation | movement of the avatar in virtual space. Explanatory drawing of scent arrangement | sequence formation by a moving image.

The olfactory information control device, the olfactory information control method, and the scent generation system of the present invention will be described in detail with reference to the drawings.
<Overall configuration>
FIG. 1 is a conceptual diagram showing the entire olfactory information control device and scent system of the present invention.

  Reference numeral 100 denotes an information processing apparatus such as a PC (personal computer) or a server that constitutes the olfactory information control apparatus of the present invention, and controls the olfactory information data to be linked or synchronized with the audiovisual information data and the video display unit 101. Virtual space data or moving image data is provided to the virtual space or moving image. Moreover, the control information (control signal) which makes the fragrance generating apparatus 200 perform scent pulse injection is transmitted. Reference numeral 103 denotes input means capable of operating the movement or movement of a character (hereinafter referred to as “avatar”) as a substitute for the user 10 in the virtual space.

  The scent generating apparatus 200 that emits a plurality of scents in a pulse shape is synchronized with or synchronized with the movement or operation of the avatar in the virtual space displayed on the video display unit 101 such as a display. Based on the control information, a scent is produced to the user 10 by giving a sense of perspective or strength to the scent emitted.

  Further, in the case where moving image data such as a landscape is displayed on the video display unit 101, a plurality of scents synchronized with the moving image data can be emitted.

  Note that the information processing unit also includes sound generation means (not shown) such as a speaker, and can provide audiovisual information data or auditory information data. Even in this case, it is possible to produce a sense of incense intensity or a sense of perspective in conjunction with or synchronized with the auditory information data.

FIG. 2 is a configuration diagram of an apparatus for carrying out the olfactory information control device, the scent generating system, and the olfactory information control method of the present invention. 107, a user interface 108, and the like. The information processing apparatus further includes an input unit 103 such as a mouse and a keyboard, an output 104 such as a printer and a monitor, a program storage device 105 in which a program for forming a scent array, which will be described later, is stored.

  Reference numeral 110 denotes an audiovisual information storage unit as audiovisual information data storage means in which data (moving space size, structure, virtual object shape, texture, position, etc.) data and moving image data are stored. .

  120 is a scent effect information storage unit in which data for scent effect is stored, and scent information data related to the scent generation source of the virtual space or the scent generation source of the moving image, for example, scent type, scent Information data for producing a scent such as the strength of the scent is stored.

  Of course, these audiovisual information data and scent effect information data can be acquired through a network such as the Internet.

The scent generating apparatus 200 includes a fragrance tank 270, a scent ejection unit 210 that emits a scent pulse, a control unit 260, and the like. The scent generator is described in detail below.
<Aroma generator>
In practicing the present invention, it is preferable that the fragrance generating device can control fine fragrance injection and can inject various fragrances by replacing the fragrance tank.

  FIG. 3 is a schematic diagram showing the operation of the generating means for generating the pulsed scent 201 discharged from the scent generating apparatus (device) 200 of FIG. 1, and 202 is injected into the flowing air for a short time. , 203 indicates the pulse interval, and 204 indicates the pulse emission of the fragrance.

In this invention, when inject | pouring a fragrance | flavor into air in a pulse form, it is necessary to make air flow.
There is no particular restriction on the air flow speed, but since the scent is felt by the olfactory organ, it is usually preferred to be from about a breeze (0.8 m / sec) to about 2.0 m / sec which is said to be comfortable to the skin. If the wind speed is increased too much, the scent is disturbed and mixed in the air, so that the effect of emitting in a pulse shape is lost.

  Although air in the natural state is used as air, depending on the situation where the present invention is used, for example, air with an increased oxygen concentration may be used. Further, the humidity and temperature of the air may be adjusted.

  The pulse width (injection time) is related to the flow velocity of the flowing air and the pulse interval, but is preferably 0.01 to 0.5 seconds. If it is less than 0.01 seconds, there is a case where the amount of the fragrance is small and the scent is not felt. Moreover, since the influence which it has on the perception of fragrance is small even if it exceeds 0.5 second, a fragrance | flavor may be wasted.

  In the embodiment of the present invention, the pulse width is set to 0.1 seconds as will be described later.

  The pulse interval (ejection interval) depends on human respiration. In human breathing, the smell of smell is felt when inhaling air (when inhaling).

  Human breathing has an average breathing cycle of 5 seconds at rest for healthy individuals, so if a pulse of scent is emitted so that it can be sensed during inspiration at intervals of 5 seconds, the scent can be sensed without using a breathing sensor. Will be able to. However, since there are individual differences in the number of breaths per unit time when a healthy person is at rest, an adjustment means that can adjust the interval at which the scent pulse is emitted is provided so that the interval matches the timing of your breathing. It is preferable to adjust. Moreover, when such an adjustment means is provided, it can be used other than when a healthy person is at rest.

  In order to perceive multiple types of fragrances at the same time (almost simultaneously) and not as a mixed fragrance, but as individual scents, multiple types of fragrances must be added during a single inspiration period. It is necessary to emit pulses separately at predetermined pulse intervals for each fragrance. Since the ratio of inspiration and expiration in respiration at the time of rest of a healthy person is 1: 1.5, the average time of inspiration in respiration is 2 seconds. In the inhalation, the period in which the scent is felt is a two-thirds period from the start to the end of the inspiration, and the time is 1.33 seconds. For this reason, at the time of rest of a healthy person, the kind of the fragrance | flavor which can be perceived in the period of inhalation is preferable 1-2 types, For example, even if 3 types of fragrance | flavors are separately pulse-emitted in 1.3 seconds It is difficult to sense the three types of scents.

  However, in the case of so-called deep breathing, which breathes slowly and greatly, the breathing cycle has a length of around 10 seconds, and the period in which inhalation is felt becomes longer, so it is possible to sense three or more fragrances.

Since the number of breaths per unit time when a healthy person is at rest varies slightly from person to person, when two kinds of fragrances are pulsed separately, the interval between the previous pulse ejection and the subsequent pulse ejection is 0. It is preferable that adjustment is possible in the range of 8 to 1.4 seconds.
In the embodiment of the present invention, the pulse interval is set to 1.3 seconds.

  Furthermore, the present invention can be used at times other than when a healthy person is resting. In such a case, for example, it can be adjusted within a range of 0.6 to 1.4 seconds so as to cope with quick breathing. Is preferred.

  The device of the present invention can be implemented by any type of device as long as it is capable of pulsing the means for flowing air and the fragrance.

  As a means for flowing air, a blower (fan) having a simple structure and easy operation is preferable, but air may be flowed by other means such as a suction device. When use in a quiet environment is required, it is preferable that the sound generated from the blower be as small as possible.

  As a means for emitting the fragrance in pulses, an on-demand type bubble jet (registered trademark) head used in an ink jet printer is preferable. As shown in FIG. 4, this bubble jet (registered trademark) type head guides the fragrance to the fragrance chamber 212 in the head unit 211a and heats the heater 213 on the head wall surface (214 represents the heater heating operation). The fragrance is boiled to generate bubbles (bubbles) 215, and the fragrance is discharged (injected) into the air in the form of droplets 216 using the rapid increase in pressure in the head caused by the generation of bubbles. is there. Since the discharged fragrance droplets are extremely fine, they are vaporized 100%. This Bubble Jet (registered trademark) type head can control the amount of fragrance discharged in units of several picoliters, so the fragrance concentration can be easily adjusted by adjusting the amount of fragrance discharged. can do. Further, since the pulse interval can be adjusted in units of 0.1 second, the control becomes easy.

As a means for discharging the fragrance, an ink jet head using a piezoelectric element may be used instead of the heating means.
In addition, the present invention can be implemented by any means as long as it is means for spraying perfume other than ink jet means into flowing air and the pulse emission of the present invention is possible.

  FIG. 5 shows an example of an ejection head for scent pulse injection suitable for performing scent pulse ejection (in FIG. 5, the rightmost liquid path has the partition constituting the liquid path removed). The heater 213 is exposed. The ejection head 211 for pulse injection is heated by the heater 213 when the fragrance from the fragrance tank 270 passes through the liquid path 217, and is ejected to the outside as a droplet 216 from the fragrance discharge port 220.

  A plurality of liquid passages 217 inside the pulse ejection ejection head 211 are provided, and a heater 213 is provided in each liquid passage 217, and on / off control for pulse ejection can be performed for each liquid passage. It is possible.

  Each fragrance discharge port 220 has the same diameter. When a switch (not shown) for supplying electricity to the heater 213 is turned on, the fragrance is discharged from the discharge port. For example, when the heaters of two liquid paths are simultaneously turned on, the fragrance is discharged from the two discharge ports. To do. Further, when the heaters of the four liquid passages are simultaneously turned on, the fragrance is discharged from the four discharge ports. Thus, the injection quantity of the fragrance | flavor in the flowing air can be adjusted by turning on some number of heaters among the heaters of each liquid passage. That is, by adjusting the number of heaters to be turned on at the same time, it is possible to increase or decrease the amount of the fragrance injected into the air flowing in one pulse.

  FIG. 6 shows an example of the scent generating apparatus 200 for carrying out the present invention, FIG. 7 is a cross-sectional view taken along the line AA including the pulse ejection ejection head 211 and the wind tunnel 223 of FIG. 6, and FIG. The arrangement | sequence of the fragrance | flavor discharge port of the discharge head 211 for pulse injection seen from the B cross section is each shown.

  Reference numeral 240 denotes a blower (fan), and the wind speed can be adjusted in units of 0.1 m / second within a range of 0.8 to 2.0 m / second, and 221 is a scent discharge port. 223 is a wind tunnel, and the fragrance is pulsed from the fragrance discharge port 220 (FIG. 5) of the fragrance pulse ejection head 211 into the flowing air (arrow C) blown from the blower 240 into fine droplets ( It is sprayed) and mixed to form a scent and is discharged from the scent discharge port 221. The information processing apparatus 100 controls the emission pulse width of the fragrance (fragrance) ejected from the scent pulse ejection ejection head 211 of the scent generating apparatus 200, the pulse interval, the rotational speed of the blower, and the like.

  FIG. 7 shows an example in which the fragrance tank 270 includes two 270a and 270b.

  In the example of FIG. 8, the fragrance discharge port is divided into two blocks 224 and 225. Each discharge block can discharge a different fragrance for each block. Each discharge block has 128 discharge ports. For example, the discharge block 224 includes discharge ports 224-1, 244-2,... 224-127, 224-128. Similarly, the discharge block 225 includes 128 discharge ports. In the discharge block having these 128 discharge ports, the amount of fragrance discharged can be adjusted from 1 to 128 for each fragrance type by adjusting the number of heaters corresponding to each discharge port simultaneously turned on. Is possible.

  For example, in the case where 10 heaters of a certain fragrance discharge head are simultaneously turned on and discharged from the discharge port, and in the case where 20 heaters of the discharge head are simultaneously turned on for the same fragrance, the latter is doubled with respect to the former. Discharge amount. When none of the heaters in the liquid path to which a certain fragrance is supplied is turned on, the discharge amount of the fragrance is zero.

  Of course, it is obvious to those skilled in the art that the number and size of the fragrance tanks, the number of discharge blocks, or the number of discharge ports provided in each discharge block can be increased or decreased as necessary.

  For example, among a plurality of fragrances, a certain fragrance is stored in a large tank, the number of discharge ports of the corresponding discharge head is 256, and other fragrances are stored in a small tank, and the discharge ports of the corresponding discharge head are stored. It can be 128 or 64.

  In addition, when discharging three kinds of fragrances, it is only necessary to provide three or more fragrance tanks and discharge blocks. When discharging more fragrances, the number of fragrances to be discharged is equal to or more than that. A perfume tank and a discharge block may be provided. In the examples shown in FIGS. 7 and 8, it is also possible to discharge only one type of fragrance using only one fragrance tank and one discharge block.

  The fragrance used in the present invention provides olfactory information suitable for audiovisual information and can be pulse-emitted with a bubble jet (registered trademark) type head, regardless of natural fragrance, artificial fragrance, Any kind of perfume can be used.

  For example, in the case of presenting olfactory information that fits into the virtual space of a plurality of fruit fields, such as melon, strawberry, and lemon, fragrances (natural or artificial) such as melon, strawberry, and lemon can be used.

  It is also possible to create a healing atmosphere by presenting the scent of lavender or jasmine on a fragrance that is not directly related to the scenery in the moving image, for example, the scene of a spider.

  It is of course possible to create a healing atmosphere combining auditory information (for example, favorite music) and aroma production.

  One fragrance can be used alone or a plurality of fragrances can be mixed.

  Moreover, the (natural) fragrance | flavor extract itself may be used for a fragrance | flavor, and you may use it as the fragrance | flavor water which added water and ethanol.

  By using such a scent generating device, it is possible to produce a fine effect on the scent's perspective and strength.

Next, a scent injection rule and a scent arrangement for implementing fine scent effects such as perspective and strength of scent corresponding to audiovisual data will be described in order.
<Aroma injection rules in the present invention>
The scent array is a control method for fragrance injection that defines the order of the fragrance to be ejected, the amount of fragrance to be ejected, and the type of fragrance to be ejected for one or a plurality of fragrances in accordance with the scent injection rules.

  Here, the injection rule indicates the aspect (specification) of the injection of the fragrance to convey the plurality of fragrances to the user accurately and easily in correspondence with the audiovisual information data. The following items (i) to ( including iv).

(i) A small width pulse is emitted at regular time intervals.
(ii) In the case of a plurality of fragrances, one type of pulse is emitted.
(iii) Increase / decrease in the amount of perfume per injection is N series (N is 1 or more).
(iv) The intensity of the scent is changed by changing the scent injection amount and the injection frequency.

Specific numerical values of the above rule items can be appropriately selected by the user, but in the examples of the present invention, the following modes are adopted;
The minute width of the pulse is set to 0.1 seconds so that the fragrance can be reliably recognized with a small amount.

  As described above, the pulse emission interval is set to 1.3 seconds from the viewpoint of reducing the influence of adaptation and remaining incense.

  When using a plurality of fragrances, each type is pulse-emitted in order to make the user recognize the difference in the fragrances.

  Regarding the increase and decrease of perfume per injection, it is known that the human sensory intensity is proportional to the logarithm of physical stimulation (Tatsuaki Kawasaki, Motoki Nakajima, Mitsuo Tonoike: Characteristics and analytical evaluation of odor substances, Fragrance Journal, 2003), since it is known that the olfaction shows the same tendency, the N-fold series (N is a number of 1 or more) is used for the intensity of fragrance.

In order to make the change in the intensity of the scent more effective, it is preferable to change the amount of the intensity of the scent and the frequency of the scent injection at the same time. That is, when changing the intensity of the fragrance from 1 to 2, when the intensity is 1, the pulse injection of the injection amount 1 is performed once, whereas when changing to the intensity 2, the injection amount is 2 And the injection frequency is performed twice. According to this rule, the user can reliably recognize that the scent has become stronger by setting the injection amount to 2 and repeating it twice, compared to simply changing the injection amount from 1 to 2. Can do.
<Scent arrangement>
Next, formation of a scent array based on the scent injection rule will be described.

  The scent array is formed using unit data (hereinafter referred to as “node”) that defines the type of scent and the strength of the scent. By operating this node, simple operations can be performed for various situations. It becomes possible to cope with. The intensity of the scent is indicated by an integer.

  “Scent intensity 1” indicates the intensity of the scent (minimum) that allows the user to discriminate the scent type when the user smells a scent. The number of the discharge ports 220 of the above-described fragrance discharge ports 220 at which “scent intensity 1” is discharged simultaneously differs depending on the type of fragrance, the concentration of the fragrance, and the like. For example, in the case of lavender, if the user can discriminate the fragrance of lavender when the fragrance is pulse-injected from 23 outlets simultaneously, the intensity of the lavender scent injected from the 23 outlets is “Lavender scent. Strength 1 ”.

  The intensity control of the scent is performed in the N-fold series. Here, when changing the “strength 1” to the “strength 2”, the injection amount of the “strength 2” fragrance is the “scent 1” fragrance. The injection amount is N times the injection amount. In the case of the above lavender, if N is 2, for example, the amount of lavender fragrance injected in the case of “strength 2” is the amount simultaneously injected from 23 × 2 = 46 outlets. Note that N is not limited to an integer. For example, in the above example, when N is 1.2, the injection amount in the case of “strength 2” is 23 × 1.2≈28 ejection ports. It becomes the quantity injected at the same time.

  In the following description, “flower scent” and “scent strength 1” of a node that defines the type of fragrance and the strength of scent are indicated as “flower scent 1”. Although the term “flower scent” is used here, it is clear that specific types of flowers such as “rose scent” or “plum blossom scent” can be used more specifically. It is a thing.

  FIG. 9 is a flowchart showing a method for forming a scent array using nodes.

  First, the information processing apparatus 100 in FIG. 2 takes in a program for executing the scent effect of the present invention from the program storage device 105.

  In step S501 in FIG. 9, the information processing apparatus 100 acquires audiovisual information data from the audiovisual information storage unit 110 and displays the virtual space on the video display unit 101. Further, the scent effect information is acquired from the scent effect information storage unit 120. The scent effect information data is a node that defines the type of fragrance and the strength of the scent.

  When, for example, an avatar is moved by the input unit 103 in step S502, the information processing apparatus 100 recognizes the position of the avatar in the virtual space. Then, a virtual space (image) is displayed on the video display unit 101 by processing data in the information processing apparatus.

  In step S510, it is determined whether or not the avatar has entered a scented virtual space area (area) based on the relationship with the scent generation source. Here, “entered” indicates a case where a new scented area is entered, or in the case of the same type of scent, the intensity of the scent changes. Movement within the same scented area does not mean “entered”.

  If the scent has entered the virtual space region, it is determined in step S511 whether or not the scent type in the region is already included in the scent array. If it is already included in the scent array, it is rewritten to a node having the same strength as that of the region in step S512, and the process proceeds to step S513. Even if the strength is the same as the existing strength, rewrite is performed.

If the scent type is not included in the scent array in S511, the process proceeds to S513.
In S513, a node indicating the type of the scent and the strength of the scent in the region is added to the head of the scent array. For example, when the intensity of the scent in the region is 1, the scent type and the scent 1 node are added to the head of the scent array. In addition, when the intensity of the scent of the area is strength 2, the number of nodes of strength 2 is added to the scent array so that it is the same number as the strength, and there are two nodes with total strength 2 Included in the array. Furthermore, in the case of strength 3, a node with strength 3 is added to be the same as the strength.

  Thus, when there is a change in the type or intensity of the scent, the changed scent is first pulsed after the change, so the user can easily recognize that the change has occurred according to the visual information. Therefore, the scent effect can be presented to the viewer in an easy-to-understand manner.

  When an avatar enters a plurality of areas almost simultaneously, information (type and strength) of the scent of the area where the avatar has entered the latest in time is added to the head of the scent array. That is, the scent information of the area that has entered last is located at the head of the scent array.

  In step S520, it is determined whether or not the avatar has left the scented area. If the scent does not come out of the area, the process proceeds to step S530.

  If the scent comes out of the scented area, it is rewritten to a node having the same strength as that of the area in step S521, and the scent node of the scent array is deleted contrary to step S513, and the process proceeds to step S530.

  In S530, it is determined whether or not a predetermined time, for example, 1.3 seconds has elapsed since the previous pulse emission. If 1.3 seconds have not elapsed, the process returns to S502 without sending the pulse ejection information to the scent generator 200.

  In S530, if 1.3 seconds or more have elapsed since the last fragrance pulse injection, information on performing pulsation of strength with the type in the scent node is sent to the scent generation device according to the scent node located at the beginning of the scent array. Send.

  The transmitted node is moved to the end of the scent array, and the process returns to step S502 again.

  Thereafter, the above steps are repeated.

As Example 1, FIGS. 10A to 10G show a scent effect using an avatar that moves in a virtual space.

  In the virtual space, virtual space regions 540 and 541 having a flower scent and a virtual space region 544 having a grassy scent are presented. The floral scent is a region far from the floral scent generation source 543 and is a donut-shaped region with a weak floral scent “flower scent 1”, a circular region close to the floral scent generation source and a strong floral scent “Flower scent 2” is presented. Also, a grassy field fragrance area “grass scent 1”, which is weak as a whole, is presented.

  FIG. 10 (a) shows the state of S502 in FIG. 9, and the avatar 545, which is a part of the user's virtual space, is located in the virtual space area without fragrance. Information (node) is not formed. The scent array 550 does not need to be displayed on the video display unit 101, but may be displayed on the video display unit 101 as necessary.

  FIG. 10B shows a state in which the user moves the avatar using the input means and positions the avatar in the virtual space area of the flower scent 1.

  If it does so, it will be judged by S510 that it entered into the scented area | region, and it progresses to S511, and since the scent of the said flower is not included in the scent arrangement | sequence yet, it progresses to S513 and the node 560 of "scent of flower 1" Is added to the top of the scent array 550. Next, the process proceeds to step S520, and if the avatar is located in the flower scent 1 area in the virtual space area, the process proceeds to S530.

  In S530, since the injection of the fragrance has not been performed so far, since 1.3 seconds have passed since the previous injection, the process proceeds to S531, and the pulse injection control information for injecting the fragrance of the flower of strength 1 is It is sent from the information processing apparatus 100 to the scent generating apparatus 200, and a fragrance having a strength of 1 is emitted from the scent generating apparatus with a pulse width of 0.1 second.

  Next, in step 532, the ejected node of “flower scent 1” moves to the end of the array table, but since there is only one node in the array, the position is maintained as it is.

  When the avatar stays in the area (area) of “flower scent 1” as it is, the pulse injection control information of “flower scent 1” is transmitted to the scent generator 200 every 1.3 seconds, and the strength is increased. 1 “Flower scent” pulsed. That is, based on the flowchart of FIG. 9, the steps of S502 → S510 → S511 → S512 → S513 → S520 → S530 → S531 → S532 → S502 are repeated.

FIG. 10 (c) shows a case where the avatar has advanced to the “flower scent 2” area.
Since it progressed to the scented area | region by S510, it progresses to S511. Since “flower scent” is already included in the scent array, the process proceeds to S512. Since the avatar is located in the area of “flower scent 2”, the node 561 is rewritten to “flower scent 2”.

  Based on the injection rule (iv), “the change in the intensity of the scent is performed by changing the injection amount and the injection frequency of the scent.” In S513, the node “scent of flower 2” is added to the head.

  If the avatar remains in the “flower scent 2” area, the process proceeds to S530, and if 1.3 seconds or more have elapsed since the previous injection, the pulse emission control information of the node “flower scent 2” Is transmitted to the scent generating device, and the “flower scent” is pulse-injected with a strength of 2 (an injection amount twice the strength of 1). The pulse ejected node moves to the end of the scent array. In this case, since the two nodes of the scent array are the same, there is no substantial change before and after the movement. When the avatar remains in the “flower scent 2” region, a “flower scent” of strength 2 is pulse-emitted every 1.3 seconds.

  FIG. 10D shows a case where the avatar further moves to enter the virtual space area 541 of “flower fragrance 2” and enters the virtual space area 544 of “grass fragrance 1”.

  Here, “grass scent 1” is a scent that is not included in the scent array, and the process advances to step S513, and a grass scent node of strength 1 is added to the head of the scent array. The scent array 550 at this time is the node array shown in FIG.

  If the avatar remains in this position, the process proceeds to S530, and if 1.3 seconds or more have elapsed since the previous pulse emission, the process proceeds to S531, where the information of the node of “grass scent 1” Is transmitted to the scent generator, and first, the “grass scent” of strength 1 is pulse-injected. Thereby, since the user can recognize the scent of the grassland first by moving the avatar, the user can recognize that the scent has changed. Next, the node of “grass scent 1” in the scent array moves to the end of the scent array. The scent arrangement at this time is in the order of “flower scent 2”, “flower scent 2”, and “grass scent 1”.

  If the avatar still remains in the same place, the control information of the node “flower scent 2” at the head of the scent array is sent from the information processing apparatus 100 to the scent generating apparatus 200 again in step S531. A “flower scent” of intensity 2 is pulsed. The pulse-emitted “flower scent 2” node moves to the end of the scent array. The scent array 550 at this time is in the order of “flower scent 2”, “grass scent 1”, and “flower scent 2”.

  If the avatar stays in the same area, the next step is “grass scent 1”, “flower scent 2”, “flower scent 2”, and then “grass 1 → flowers” every 1.3 seconds. Repeat 2 → flower 2 → meadow 1 → flower 2 → flower 2 → meadow 1 →.

  FIG. 10E shows a virtual space where the avatar has moved from the “flower scent 2” region to the “flower scent 1” region. In this case, the process proceeds from S520 to S521, the node of “flower scent 2” is rewritten from the node of “flower scent 1”, and one of the two nodes is deleted in S522. As a result, the scent arrangement becomes nodes of “grass scent 1” 562 and “flower scent 1” 560, and each fragrance is pulse-emitted from the scent generator on the basis of the following information of this scent arrangement.

  FIG. 10F shows a case where the avatar moves and moves from the virtual space of “flower scent 1” to the space of “meadow scent 1” only. Also in this case, the process proceeds from S520 to S521 and S522, and the node of “flower scent 1” is deleted from the scent array. Accordingly, only the “grass scent 1” node remains in the scent array, and based on this scent array information, the scent generating device emits a “grass scent” with a pulse every 1.3 seconds. Is done.

  In FIG. 10 (g), the avatar moves from the scented virtual space area and is located in the scentless virtual space area. Therefore, there is no node in the scent array. It is never injected.

  In the above example, when the avatar moves from FIG. 10 (e) to FIG. 10 (d), the scent arrangement in FIG. 10 (d) is “flower scent 2” (top), “grass scent 1 "" Flower scent 2 ".

  In Example 1 of FIGS. 10 (a) to 10 (g) described above, the scent is produced by the movement of the avatar in the virtual space area where the kind of scent or the strength of the scent changes.・ Display the virtual space area in which the type and intensity of the scent is changed according to the color, size, etc., and form a node indicating the type and intensity of the scent in the virtual space area to produce the scent. Is also possible.

  FIG. 11 shows Example 2 in which the scent generation source in the virtual space region is changed by the operation of the avatar 545.

  In FIG. 11A, since the avatar has not yet eaten the fruit on the fruit dish, the scent array 550 does not include a node.

  In FIG. 11B, since the avatar ate melon, a space region 546 of melon scent is formed around the avatar, and a scent array including nodes 563 of melon scent 1 is formed.

  In FIG. 11 (c), since the avatar ate the grape, the grape scent area 547 overlaps with the melon scent area 546, and the grape scent and the melon scent are alternately emitted from the scent generator. Is done.

  In this example, for example, when the avatar removes the melon skin 548 from the fruit dish, the melon scent node 563 can be deleted from the scent array, and only the scent of grapes can be continuously pulsed.

  It is also possible to change the avatar into a facial expression showing emotions and to make a virtual space area having a fragrance generation source adapted to the facial expression of the avatar.

  In the example described above, audiovisual information is displayed as a virtual space on the video display unit, but the <Ejection Rule> and <Scent Arrangement> of the present invention are very effective for moving images.

  FIG. 12 shows one scene in a moving image.

  In the case of a moving image, the effect of scent is graphed (numerized) in advance with the relationship between the moving image reproduction time (the elapsed time of the moving image reproduction start time) and the type and intensity of the fragrance. Preferably, when these graphs can be visualized on the screen as necessary, the operability can be further improved. The center line 570 shows the current playback time.

  In FIG. 12, for example, assuming that the landscape of an image is a virtual scene (scene) moving from the front of the image toward the back of the image, for example, the plum blossoms are plotted along the horizontal axis of the video playback time. Since the scent 571 and the cut flower scent 572 are digitized (graphed), the type and strength of the scent change in synchronization with the change of the moving image (elapsed time). In the case of the virtual space using the avatar described above, the numerical values on the graph are converted into a scent array and pulse injection control information is transmitted from the information processing apparatus 100 to the scent generating apparatus 200 every 1.3 seconds. The same scent can be produced.

  In the case of FIG. 12, the scent on the center line 570 is “plum blossom 3” “cut flower 2” because the scent of plum blossoms is strength 3 and the scent of cut flowers is 1.5 on the graph. Approximate and adapt to the example of the virtual space using the avatar described above, the scent arrangement is “plum blossom scent 3”, “plum blossom scent 3”, “plum blossom scent 3”. In the order of “cut flower 2” and “cut flower 2”, the scent is pulsed every 1.3 seconds. As you move closer to the direction of the plum blossom in the scene on the video screen, the plum blossom scent gradually becomes a node of “plum blossom scent 4”, while the scent of cut flowers weakens. “Cut flower 1”. Hereinafter, the scent of plum blossoms and the scent of cut flowers can be changed based on scene changes in the moving image.

  As is clear from the above embodiments, the scent arrangement in the present invention has versatility and can be used in both a virtual space and a moving image.

  In addition, by using an avatar that moves or operates in a virtual space, various scent effects can be presented in an easy-to-understand manner according to user preferences.

  Furthermore, it is possible to easily construct multimedia data that produces a sense of perspective (perspective expression) or strength of scent that is linked or synchronized with audiovisual data.

  INDUSTRIAL APPLICABILITY The present invention can be used in the multimedia industry and the like using audiovisual information and olfactory information that can produce a sense of perspective and strength.

100 Information processing device (olfactory information control device)
DESCRIPTION OF SYMBOLS 101 Image | video display part 103 Input means 105 Program memory | storage device 107 Control part (arithmetic part)
DESCRIPTION OF SYMBOLS 110 Audiovisual information storage part 120 Fragrance production information storage part 200 Fragrance generating apparatus 203 Injection pulse width 204 Injection pulse interval 210 Fragrance injection part 211 Pulse injection head 213 Heatato 220 Fragrance discharge port 221 Scent discharge port 240 Blower (fan)
270, 270a, 270b Fragrance tank 540, 541, 542, 544, 546, 547 Virtual space area (area)
543 Scent generation source 550 Scent arrangement 560-564 Node

Claims (8)

Storage means for storing audiovisual information data, and means for providing a virtual space based on the audiovisual information data acquired from the storage means. An olfactory information control device that transmits scent pulse injection control information to a scent generator that separately emits pulses at predetermined pulse intervals,
The scent pulse ejection control information is formed based on the relationship between the audiovisual information data acquired from the storage means and the scent generation source in the virtual space, the scent type, the scent ejection amount, and the scent type. An olfactory information control apparatus characterized by being based on a scent arrangement in which the order of injection is determined. The olfactory information control apparatus according to claim 1, further comprising means for moving an avatar in the virtual space, wherein the scent array is formed based on a position of the avatar in the virtual space. When the avatar moves in a virtual space and the virtual space has a new type of scent generation source, the scent array is formed so that the new scent type is located at the beginning of the scent array. The olfactory information control device according to claim 2, wherein The olfactory information control device according to claim 2 or 3, wherein when the avatar remains in the same virtual space for a predetermined time or more, the same scent array as the scent array is repeatedly formed. The olfactory information control device according to claim 1, further comprising means for operating an avatar in the virtual space, wherein the scent array is formed based on an operation of the avatar in the virtual space. The audiovisual information data is dynamic audiovisual information data, and the scent array is formed based on a relationship between the dynamic audiovisual information data and a scent generation source in the moving image, 2. The olfactory information control apparatus according to claim 1, wherein the scent arrangement is a scent arrangement in which the order of scent types is determined. There are storage means for storing audiovisual information data, and means for providing a virtual space based on the audiovisual information data acquired from the storage means, and a plurality of types in the flowing air based on the audiovisual information data The olfactory information control method in the olfactory information control device for transmitting the fragrance pulse ejection control information to the fragrance generating device that pulsates the fragrance for a short time, separately at a predetermined pulse interval for each fragrance,
The scent pulse ejection control information is formed based on the relationship between the audiovisual information data acquired from the storage means and the scent generation source in the virtual space, the scent type, the scent ejection amount, and the scent type. An olfactory information control method characterized by being based on a scent arrangement in which an injection order is determined. Storage means for storing audiovisual information data, means for providing a virtual space based on audiovisual information data acquired from the storage means, and a plurality of types of perfume in the flowing air for a predetermined period of time for each perfume A scent generating device that individually emits pulses at pulse intervals, and an olfactory information control device that transmits scent pulse injection control information to the scent generating device based on the audiovisual information data acquired from the storage means, A fragrance generating system,
The scent pulse ejection control information is formed based on the relationship between the audiovisual information data acquired from the storage means and the scent generation source in the virtual space, the scent type, the scent ejection amount, and the scent type. A fragrance generating system characterized by being based on a scent arrangement that defines the order of injection.