JP6532847B2 - Aroma fluctuation display method and information processing apparatus - Google Patents

Description

  The present invention relates to a technique for displaying a change in aroma. In the present specification, "aroma" or "scent" means a smell and does not limit the quality of the smell.

Currently, there are a variety of scented products that are scented. Efforts are also being actively made to combine psychological effects with video to enhance psychological effects.
For example, in Patent Document 1, it is possible to efficiently perform scent education for better understanding of the scent by presenting information related to the scent visually or aurally while causing the scent emission to release the scent. It is disclosed that the
Further, Patent Document 2 discloses a method of presenting an air-tactile sensation to a person by an air flow during reproduction of at least one of an image and a sound, and presenting the smell associated with the image or the like to the person after the air flow is presented. There is. According to this method, the approach of a person is detected, the air intake of a person is naturally induced, and the scent is presented at the timing when the inspiration occurs. It is disclosed that it is possible to view the content of the content in a realistic manner.

  On the other hand, there are people called "flavorers" as specialists who make various products. The perfumer prepares the perfume and creates an aroma that evokes the image of various products.

JP 2008-65147 A JP, 2013-162378, A

As disclosed in the above-mentioned patent documents, there are currently various methods for effectively utilizing aroma. However, there are currently no methods to support the creation of aroma, and the creation of aroma is often left to the intuition and skill of the perfumer.
Companies that develop scented products analyze the scent of aromatic plants such as roses and use it as a motif to create a product scent, but the composition and intensity of the scent component of the aromatic plants It fluctuates greatly depending on the band and the flowering state. For this reason, composition information of the scent component of each time zone is acquired by analyzing the fluctuation of the released scent, and this information is provided to the perfumer.
However, simply by quantifying the composition information of the aroma component as individual data, it is not possible to compare which stage of aroma evokes an image more than just knowing the perfume composition in a certain temporary state. It is difficult to intuitively grasp the fluctuations of the subject and it does not provide enough support for the perfumer to get motivation and inspiration.

  This invention is made in view of such a subject, and provides the technique of showing the fluctuation | variation of an aroma component in an easy-to-understand manner.

  The present invention has the following aspects in order to solve the problems described above.

  The first aspect relates to an aroma fluctuation display method. The aroma fluctuation display method according to the first aspect includes a first moving image showing temporal change of the appearance of the object and a second moving image showing temporal change of the amount or ratio of the aroma component corresponding to the object in graph form. Outputs a display that is reproduced with the time series associated.

  The second aspect relates to an information processing apparatus. An information processing apparatus according to a second aspect comprises: first acquiring means for acquiring image data of a first moving image showing temporal change in appearance of an object; and time-series data of an amount or a ratio of an aroma component of the object A graph showing the amount or ratio of the aroma component at each time is generated based on the second acquisition means to be acquired and the time series data, and the generated graph is used to calculate the amount or ratio of the aroma component Moving image generating means for generating a second moving image showing temporal change in a graph format; and output processing means for outputting a display in which the first moving image and the second moving image are reproduced in association with time series to a display device And.

  Note that as another aspect of the present invention, a program may be a program that causes a computer to execute the method according to the first aspect, or a computer readable storage medium storing such a program. This recording medium includes non-transitory tangible medium.

  According to each of the above aspects, it is possible to provide a technique for presenting changes in the aroma component in an easy-to-understand manner.

It is a flowchart which shows the aroma fluctuation display method which concerns on this embodiment. It is a figure which shows the example of the aroma fluctuation display in this embodiment. It is a figure showing an example of hardware constitutions of an information processor concerning this embodiment notionally. It is a figure which shows notionally the process structural example of the information processing apparatus which concerns on this embodiment. It is a figure which shows the aroma fluctuation display in a modification. It is a table | surface which shows the time-sequential data of the measured value of the extract | collected aroma component. It is a figure which shows the display of the simultaneous reproduction | regeneration of the motion graph of the bar graph in this example, and the external appearance moving image of rose. It is a figure which shows the display of the simultaneous reproduction | regeneration of the motion graph of the bar graph in this example, and the external appearance moving image of rose. It is a figure which shows the display of the simultaneous reproduction | regeneration with the motion graph of a bubble chart and a rose external appearance moving image in a present Example. It is a figure which shows the display (type 2) in which the list (table of FIG. 6) of an aroma component value and the external appearance moving image of a rose flower are located in a line as a comparative example. It is a figure which shows the display (type 4) in which the line graph of an aroma component value and the external appearance moving image of a rose flower are located in a line as a comparative example. It is a figure which shows the evaluation result of a perfumer.

  Hereinafter, embodiments of the present invention will be described. The embodiments described below are exemplifications, and the present invention is not limited to the configurations of the following embodiments.

First, an outline of the present embodiment will be described.
In the aroma fluctuation display method according to the present embodiment, the first moving image showing the temporal change of the appearance of the object and the second moving image showing the temporal change of the amount or ratio of the aroma component corresponding to the object in graphic form Outputs a display in which series are associated and reproduced.
In the present embodiment, the above-mentioned "object" is not limited as long as it is a thing reminiscent of aroma. As the said "object", as mentioned later, the aromatic plant in which at least one of a shape, a color, a pattern, and a size changes with progress of time is illustrated. Some flowers, leaves, roots or fruits of this aromatic plant may be considered as the "object". The “target object” is not limited to plants only, and may be clothing worn by people or animals, household goods used by people or animals, scenery, and the like.

The "first animation" and the "second animation" mean an image with motion. For this reason, the “first moving image” and the “second moving image” may be individually playable moving images, or may be individual partial moving image regions in one moving image.
The “first moving image” may be a moving image obtained by photographing the appearance of the object by any method, or may be a moving image obtained by performing some image processing on the appearance video of the object. Good. As the former, for example, there are moving images obtained by imaging such as visible light, far-middle and near-infrared rays, and X-rays. As the latter, there is, for example, a moving image obtained by synthesizing an appearance image of an object with an image showing temporal change of an aroma component or some other component generated from the object.
The “aroma component corresponding to the object” indicated by the “second moving image” may be an aroma component having some relationship with the object indicated in the first image. That is, the “aroma component corresponding to the object” may be an aroma component actually collected from the object itself shown in the first image, or as the object and object shown in the first image It may be an aroma component collected from different but identical objects, or it may be an aroma component associated with the object shown in the first image.
The “second moving image” is an image with a motion that shows temporal changes in the amount or ratio of the aroma components in the form of a graph. For this reason, the "second moving image" may be a moving image in which the amount or ratio of the aroma component dynamically changes with the passage of time, or the time relative to the amount or ratio of the aroma component shown statically It may be a moving image that dynamically shows the progress of. An example of the former is a moving image in which a region showing an aroma component value in a circle graph or a band graph changes dynamically, and an example of the latter is time in a line graph showing aroma component values on the vertical axis and time on the horizontal axis. A moving image in which the mark shown moves dynamically on the horizontal axis is exemplified.
Further, the ratio of the aroma component shown in the second moving image may be a ratio to a certain reference value (such as the maximum value) in the same aroma component, or may be a relative ratio between the aroma components . Further, the ratio of the aroma component may be a value indicating the odor intensity in consideration of the odor sensitivity.

The "time series is associated" between the "first moving image" and the "second moving image" means that the time axis of the first moving image and the time axis of the second moving image are related with some relationship. . Therefore, both moving images may be synchronized on a common time axis using real time, or may be associated at the same time of different years, months or days.
Moreover, the output method of the display in this embodiment is not restricted. The display may be output to a display device such as a television, a monitor, or a head mounted display, or may be projected on a wall or the like using a projector.

According to the present embodiment, by outputting the display as described above, the viewer can easily associate the change in appearance of the object with the change in the aroma component, and intuitively grasp the change in the aroma component can do. Thereby, for example, the perfumer can intuitively grasp the amount or ratio of the aroma component corresponding to a certain state of the appearance of the object, and it is easy to obtain motivation and inspiration for aroma development. Is expected to be
Further, as the present embodiment, an information processing apparatus that causes the display device to output the above-described display and a program that causes the computer to execute the output of the above-described display may be realized.

  Hereinafter, the present embodiment will be described in more detail. In the following description, the above-mentioned "first moving image" is described as an appearance moving image, and "second moving image" is described as a motion graph. Moreover, "the amount or ratio of an aroma component" is described as an aroma component value.

[Various aroma display method]
FIG. 1 is a flowchart showing an aroma fluctuation display method (hereinafter also referred to as the present method) according to the present embodiment.
This method includes the steps (S11), (S13), (S15), (S17), (S19), (S21), (S23), and (S25).

Step (S11) is a step of acquiring image data of the appearance moving image of the object. In the example of FIG. 1, the method acquires, as the image data, a still image group obtained by continuously shooting an object at constant intervals. The “fixed interval” may be arbitrary, may be determined in advance, or may be determined based on the sampling interval of the aroma component value as described later.
Furthermore, in the method (S11), moving image data captured by slow motion imaging or time-lapse imaging may be acquired as the image data, or moving image data acquired by normal video imaging may be acquired. May be When moving image data that can be used as the appearance moving image as it is in the step (S11) is acquired, the step (S21) may be omitted.

  When the method is performed by a computer such as an information processing apparatus described later, the step (S11) may be performed automatically or may be performed based on the user's operation. When the step (S11) is automatically performed, the computer can acquire image data of the appearance moving image from the camera by communication. The computer can also obtain the image data from a portable recording medium, another computer, or the like based on the user's operation.

A process (S13) is a process of acquiring time series data of an aroma component value corresponding to a subject.
The time-series data of the aroma component value is data in which the aroma component value is associated with time information.
When the method is performed by a computer such as an information processing apparatus described later, the step (S13) can be performed based on the user's operation. For example, the computer can acquire the time-series data from a portable recording medium, another computer, or the like based on the user's operation. In addition, when the user manually inputs the time series data to a file on the computer, the computer can acquire the file of the time series data.

  In the present embodiment, the aroma component value obtained by analyzing the aroma collected from the object indicated by the image data acquired in the step (S11) is used. Furthermore, the collection of the aroma is performed at a predetermined sampling cycle during the imaging period of the object for obtaining the image data. This makes it possible to show the correspondence between the change in the aroma component value collected from the common object and the appearance change on the common time axis. In other words, it is possible to show the viewer a realistic correspondence between the actual appearance change of the object and the variation of the aroma component actually emitted from the object, resulting in stronger inspiration. Can be given.

  Various methods are available for collecting aroma from the object. For example, the aroma can be collected by suctioning from the object and adsorbing the aroma onto the adsorbent in the aroma collection tube. In this case, by replacing the aroma collection pipe at a predetermined sampling cycle, the aroma collection pipe is obtained at each sampling time, the aroma is thermally desorbed from each aroma collection pipe, and introduced into the gas chromatograph mass spectrometer. An aroma component value to be analyzed can be obtained for each sampling time.

A process (S15) is a process of performing data interpolation of the time-series data of the aroma component value acquired at the process (S13). As a data interpolation method here, a known data interpolation method such as Lagrange interpolation, spline interpolation, Bezier curve interpolation, data interpolation using a least squares method may be used. However, when data interpolation is unnecessary, such as when the sampling period of the aroma component is sufficiently short, the step (S15) may be omitted.
In the following steps, time-series data obtained by adding the aroma component values interpolated in step (S15) to the time-series data of aroma component values acquired in step (S13) is used. Hereinafter, this time series data is simply referred to as time series data of aroma component values.

The step (S17) is a step of generating a graph of the aroma component value using the time-series data of the aroma component value including the interpolated data. In the step (S17), a graph including axes indicating a plurality of types of aroma components is generated for the number of values of the aroma components included in the time series data.
The type of graph generated in the step (S17) is preferably one which indicates each aroma component value at a unique (unique) position for each aroma component. In other words, in the step (S17), it is preferable to select a graph type other than a graph type (for example, a line graph etc.) in which the aroma component values of different aroma components may completely overlap each other. For example, the graph includes a bar graph, a bubble chart, a pie graph, a radar chart, and the like. According to the graph showing each aroma component value at such a unique (unique) position for each aroma component, it becomes easy to distinguish the aroma component and to grasp the aroma component value.
Moreover, the graph which determined the intrinsic | native position for every aroma component according to the characteristic for every aroma component may be sufficient. For example, there is a bubble chart with saturated vapor pressure (mmHg) on one axis and an aroma sensitivity threshold (ng / Lair) on the other axis. According to such a graph type, it is possible to make the perfumer understand the fluctuation of the aroma component while adding the characteristic of the aroma component.

Step (S19) is a step of generating a motion graph of the aroma component value using the group of graphs generated in step (S17). The motion graph to be generated is a moving image that dynamically changes in time series a graph (a graph generated in step (S17)) indicating the amount or ratio of each aroma component at a unique position for each aroma component Is preferred.
For example, in the step (S19), the method stores each graph generated in the step (S17) as image data, and generates a motion graph by arranging each image data in time series and animating. A known method may be used as the method of moving image data. For example, by setting the reproduction time or total reproduction time for each image data, it is possible to create a moving image in which each image is displayed and switched for a predetermined time.

Step (S21) is a step of generating an appearance moving image using the image data acquired in step (S11).
When a still image group obtained by continuously photographing an object at constant intervals in step (S11) is acquired, the respective still images are arranged in time series and animated in the same manner as in step (S19) Can generate an appearance animation. At this time, the acquired still image group may be thinned out to reduce the number of images, and then animated.
In addition, when moving image data obtained by normal shooting in the step (S11) is acquired as the image data, frame thinning is performed on the moving image data (when the frame rate is dropped) as necessary, and an appearance moving image is obtained. It can also be done.

Step (S23) is a step for enabling simultaneous reproduction of the motion graph generated in step (S19) and the appearance moving image generated in step (S21).
For example, when the motion graph and the appearance moving image are generated as separate moving image files, two moving image files can be simultaneously reproduced. At this time, one file may be generated which includes two moving image files or is linked to each moving image file. It can be realized by general software processing that each moving image file is played back at a certain predetermined timing (for example, detection of a predetermined user operation, etc.).

  In the example of FIG. 1, the motion graph and the appearance moving image are respectively generated in separate steps, but one moving image file may be generated so that both moving images are displayed in a local area of one moving image file. In this case, the step (S19) and the step (S21) may be integrated into one step. Then, it is regarded as one still image in which the image data and the graph generated in the step (S17) are arranged at each time, and the still image is arranged in time series and animated to localize the motion graph and the appearance moving image Can create a single movie file that can be displayed. In this case, the step (S23) may not be performed.

Here, when the time series of the image data acquired in the step (S11) and the time series data acquired in the step (S13) correspond to each other, the motion graph generated in the step (S19) and the step (S21) With regard to the appearance animation generated in), the time series are naturally associated with each other. Therefore, by reproducing both moving images simultaneously, both moving images are reproduced in association with time series.
When the motion graph is generated based on the aroma component value collected from the object at a predetermined sampling cycle during the photographing period of the image of the object forming the appearance moving image, the motion graph and the appearance by simultaneous reproduction The video and the video are played back synchronously on a common time axis.

The step (S25) is a step of outputting a display on which the appearance moving image and the motion graph are simultaneously reproduced to one or more display devices. This display is preferably output to one or more display devices in a state where the appearance animation and the motion graph can be simultaneously compared.
Here, the form of the output “in a state in which both moving pictures can be compared at the same time” may be as follows. For example, a mode in which both moving images are simultaneously arranged in the display area of one display device and simultaneously output, a mode in which one moving image is simultaneously output in each display area of two adjacently arranged display devices, a transmittance of one moving image In the raised state, both moving images are superimposed on the display area of one display device and simultaneously output, and the moving image is output while switching between the two moving images to the display area of one display device with a time difference.

FIG. 2 is a view showing an example of the aroma fluctuation display in the present embodiment.
In the example of FIG. 2, the appearance animation AM and the motion graph MG are displayed adjacent to each other. In addition, rose flowers are considered as objects, and 12 kinds of aroma components “Rose Oxide”, “Citronellal”, “Linalool”, “Phenyl acetaldehyde”, “Citronellyl Acetate”, “Citral”, “Giranyl Acetate”, "Citronellol", "Nerol", "Geraniol", "Phenyl Ethyl Alcohol" and "Methyl Eugenol" are the analysis targets.
In the motion graph MG, 12 types of aroma components are shown on the horizontal axis, and aroma component values are shown on the vertical axis. And the ratio of each value which makes the maximum value for every aroma component 100% is made into an aroma component value.

In this display, the appearance of the rose flowering from the bud state in the appearance animation AM is dynamically displayed, and in the motion graph MG, 12 flavor components collected from the rose on the time axis common to the appearance animation AM The variation of each value of is dynamically displayed. In other words, the motion graph MG in the example of FIG. 2 shows how the length of the stick for each of the aroma components dynamically changes.
For this reason, FIG. 2 shows spots of the appearance of a rose flower at a certain time and the distribution of aroma component values collected from the rose flower.

According to the present embodiment, by outputting the display as shown in FIG. 2, the viewer can easily associate the flowering state of the rose flower with the corresponding fluctuation of the aroma component, and the rose flower It is possible to intuitively grasp the fluctuation of the aroma component emitted from Thereby, for example, the perfumer can intuitively grasp the distribution of the aroma component value corresponding to the flowering state of the rose flower, and it becomes easy to obtain motivation and inspiration for aroma development Be expected.
In addition, the appearance animation shows that the flowering plants flower or the fruit matures with the passage of time, and the aroma component value periodically increases / decreases with the passage of time for the aroma component shown by the motion graph. However, an aroma component may be included that shows a tendency to increase toward flowering or maturation. According to such a display, not only does it indicate that the aroma component value increases from the bud toward flowering or toward fruit ripening, but the aroma component value also increases with the passage of time in the flowering state or the maturation state. Can show motivations and inspiration to the perfumer by

  In the flowchart shown in FIG. 1, a plurality of steps are described in order, but the order of execution of the steps performed in the present embodiment is not limited to the described order. In the present embodiment, the order of the illustrated steps can be changed within the range in which there is no problem in the content. For example, the step (S11) and the step (S13) may be performed in reverse or simultaneously. In addition, the generation of the appearance moving image (step (S21)) and the generation of the motion graph (step (S19)) may be reversed or may be performed simultaneously.

[Information processing apparatus]
Next, an information processing apparatus (hereinafter, referred to as an information processing apparatus according to the present embodiment) that executes the aroma fluctuation display method according to the present embodiment will be described using FIGS. 3 and 4.
FIG. 3 is a diagram conceptually showing an example of the hardware configuration of the information processing apparatus 10 of the present embodiment.
The information processing apparatus 10 is a so-called computer, and includes, for example, a CPU (Central Processing Unit) 11, a memory 12, an input / output interface (I / F) 13, a communication unit 14 and the like mutually connected by a bus. The number of hardware elements forming the information processing apparatus 10 is not limited, respectively, and these hardware elements can also be collectively referred to as an information processing circuit. In addition, the information processing apparatus 10 may include hardware elements not illustrated in FIG. 3, and the hardware configuration is not limited.

The CPU 11 may be configured by an application specific integrated circuit (ASIC), a DSP (Digital Signal Processor), a GPU (Graphics Processing Unit) or the like, in addition to a general CPU.
The memory 12 is a random access memory (RAM), a read only memory (ROM), or an auxiliary storage device (such as a hard disk).
The input / output I / F 13 can be connected to user interface devices such as the output device 15 and the input device 16. The output device 15 is at least one of a device such as a liquid crystal display (LCD) or a cathode ray tube (CRT) display that displays a screen corresponding to drawing data processed by the CPU 11 or the like, a printing device, or the like. In addition, the output device 15 may be a projector device that projects a display corresponding to the drawing data. The input device 16 is a device such as a keyboard, a mouse or the like that receives an input of a user operation. The output device 15 and the input device 16 may be integrated and realized as a touch panel.
The communication unit 14 performs communication with other computers via a communication network, exchanges signals with other devices, and the like. A portable recording medium or the like may also be connected to the communication unit 14. In addition, a camera (not shown) that captures an object for appearance moving image may be connected to the communication unit 14.
Further, the information processing apparatus 10 may be a device having a camera.

FIG. 4 is a diagram conceptually showing an example of a processing configuration of the information processing apparatus 10 according to the present embodiment.
The information processing apparatus 10 includes a first acquisition unit 21, a second acquisition unit 22, a moving image generation unit 23, an output processing unit 24, and the like. These processing modules are software elements, and are realized, for example, by executing a program stored in the memory 12 by the CPU 11. This program is installed from, for example, a portable recording medium such as a CD (Compact Disc), a memory card, etc. or another computer on a network via the input / output I / F 13 or the communication unit 14 and stored in the memory 12 May be
The information processing apparatus 10 executes the above-described aroma fluctuation display method by the operations of the first acquisition unit 21, the second acquisition unit 22, the moving image generation unit 23, and the output processing unit 24. In other words, the information processing apparatus 10 can execute the above-mentioned aroma fluctuation display method by executing the installed program.

The first acquisition unit 21 acquires image data of an appearance moving image showing a temporal change of the appearance of the object. That is, the first acquisition unit 21 executes the above-described process (S11). The “image data” to be acquired and the “object” related to the image data are as described above. That is, as an object, an aromatic plant in which at least one of the shape, the color, the pattern, and the size changes with the passage of time is exemplified.
The first acquisition unit 21 can acquire the image data from an external computer, device, portable recording medium, or the like via the input / output I / F 13 or the communication unit 14.

The second acquisition unit 22 acquires time-series data of the amount or the ratio (aroma component value) of the aroma component of the object. That is, the second acquisition unit 22 executes the above-described process (S13). The acquired “time-series data” and the “object” relating to this time-series data are as described above. Therefore, the time series data acquired by the second acquisition unit 22 analyzes the aroma collected from the object at a predetermined sampling cycle during the imaging period of the object for acquiring the image data of the appearance moving image You may include the aroma component value obtained by The analysis and extraction method of this aroma component value is also as described above.
The second acquisition unit 22 can acquire the time-series data from an external computer, device, portable recording medium, or the like via the input / output I / F 13 or the communication unit 14. Further, the second acquisition unit 22 can store the time series data input by the user operating the input device 16 as a file in the memory 12 and use this file.

  Furthermore, the second acquisition unit 22 may perform data interpolation on the time series data acquired as described above, as necessary. That is, the second acquisition unit 22 may execute the above-described step (S15). The data interpolation method is as described above.

  The moving image generation unit 23 generates a graph indicating the aroma component value at each time based on the time-series data (including the interpolated value) acquired by the second acquisition unit 22 and uses the generated graph. Then, a motion graph is generated which shows temporal changes of the aroma component value in the form of a graph. That is, the moving image generation unit 23 executes the above-described step (S17) and step (S19). The graph generation method and the motion graph generation method are as described above. The “motion graph” itself is also as described above, and is preferably a moving image in which graphs showing the respective aroma component values at unique positions of the aroma components are dynamically changed in time series.

  Furthermore, the moving image generation unit 23 can also generate an appearance moving image based on the image data acquired by the first acquisition unit 21. That is, the moving image generation unit 23 may execute the above-described step (S21). However, when the first acquisition unit 21 acquires moving image data that can be used as an appearance moving image as it is, the moving image generation unit 23 may not execute the appearance moving image generation processing. The “appearance animation” and the generation method thereof are as described above.

The output processing unit 24 outputs, to the output device 15 (display device), a display in which the appearance moving image and the motion graph are associated and reproduced. That is, the output processing unit 24 executes the above-described step (S23) and step (S25).
Thereby, when the motion graph is generated based on the aroma component value collected from the object at a predetermined sampling cycle during the photographing period of the image of the object forming the appearance moving image, the motion is simultaneously reproduced. The graph and the appearance animation are synchronously reproduced on a common time axis.
Further, the output processing unit 24 preferably outputs the display to one or more output devices 15 (display devices) in a state where the appearance moving image and the motion graph can be simultaneously compared. The form of the output “both in a state where it is possible to simultaneously compare both moving images” is as described above.

  Each processing module of the information processing apparatus 10 described above may operate spontaneously, or may operate triggered by detection of a predetermined user operation using the input device 16.

[Supplement]
Here, the relationship between the sampling period of the aroma component value and the photographing time width between the adjacent frames forming the appearance moving image will be supplementarily described.
First, it is preferable that the imaging time width be shorter than the sampling period. By doing this, it is possible to observe the variation of the aroma component value by following the temporal change of the appearance.
Furthermore, it is preferable that the sampling period and the imaging time width be determined to have a correlation. For example, even if the sampling period is daily or weekly, if the shooting time width is 1/100 (seconds) or less using a high-speed camera etc., the fluctuation display speed of the aroma component value Becomes too loose, it becomes difficult to grasp the fluctuation of the aroma component value and the temporal change of the appearance.

  Therefore, it is preferable that the photographing time width between the adjacent frames (still image data) forming the appearance moving image is set to be equal to or less than the sampling period of the aroma component value and at least 1/120 of the sampling period. This is one index for setting the display speed of the measured value of the aroma component value to 2 seconds or less in order to easily grasp the relationship between the fluctuation of the aroma component value and the temporal change of the appearance. When the measured value display speed of aroma component value is within 2 seconds, the measured value of one aroma component value is not displayed longer than 2 seconds, that is, the display of the measured value of one aroma component value is It means to switch within 2 seconds.

Hereinafter, the relationship between the photographing time width and the sampling period (1/120) and the display speed of the measured value of the aroma component value will be described by way of an example. First, let us consider generating a 30-second moving image (appearing moving image and motion graph) by setting the moving image reproduction rate to 60 fps, which is the highest level at the present time, and setting the sampling period and the photographing period to 1 hour.
In order to generate a 30-second moving image, it is preferable that 1800 pieces of image data (still image) be captured, and according to the above relationship, it is preferable that 15 or more actual measured values of the aroma component value be obtained. Since the sampling period is one hour, the sampling cycle is set to 4 minutes or less, and the photographing period is one hour, so the photographing time width is set to 2 seconds.
That is, it is preferable that the photographing time width be set to one-twentieth (= 2/240) or more of the sampling period.
Since the value of "1/120" depends on the moving image reproduction rate, if the moving image reproduction rate is assumed to be 30 fps (normal television level) in the above example, the photographing time width is 60 sampling cycles. It is preferable that the ratio is set to 1⁄4 (= 4/240) or more. Naturally, the value of "1/60" belongs to the range of "1/120 or more".

[Modification]
According to the aroma fluctuation display method according to the present embodiment, as described above, it is expected that the perfumer can easily obtain motivation and inspiration for aroma development. Furthermore, it is possible to associate the flavored product developed by the perfumer with the appearance or aroma component distribution of the object motivated or inspired by the perfumer at the time of the development of the flavor. it can. By presenting this correspondence to the consumer, advertising effects of the product are also expected.
Therefore, the amount of a plurality of aroma components corresponding to the aroma (odor) of the target product in one or both of the appearance animation being played and the motion graph in the display where the appearance animation and the motion graph are simultaneously reproduced. Alternatively, timing may be presented where the ratio is shown in the motion graph.
Here, the “target product” is a product having some relationship with the aroma component distribution indicated by the motion graph, and for example, as described above, a product in which the aroma recalled from the aroma component distribution is irritated It is.
There are various methods for the "timing presentation" method. For example, there is a method of stopping the reproduction of the appearance moving image and the motion graph for a predetermined time at the timing when the aroma component distribution corresponding to the target product is displayed. There is also a method of discoloring at least a part of the display or adding a decoration at the timing when the aroma component distribution corresponding to the target product is displayed.

FIG. 5 is a diagram showing an aroma fluctuation display in a modification. In the example of FIG. 5, in addition to the appearance moving image AM and the motion graph MG, the image PD of the target product is further displayed. Then, the reproduction of the appearance moving picture AM and the motion graph MG is stopped for a predetermined time at the timing when the aroma component distribution corresponding to the aroma smelled to the target product is indicated by the motion graph MG. Furthermore, in the example of FIG. 5, at that time, a character string MK2 “the moment indicating the aroma component distribution corresponding to the product” is displayed, and a frame MK1 is displayed on the photographing time display of the appearance moving image AM.
Thus, the relationship between the target product and the aroma component distribution or appearance can be presented in an easy-to-understand manner, so that the person who saw the product can be interested in the target product, and advertising effects of the target product can be expected.

  Hereinafter, the above-mentioned contents will be described in more detail by way of examples. The embodiments described above are not limited to the description of the following examples.

In this example, a rose (variety: Kazanlik) purchased from a farm was used as the above-mentioned object. And while this flowering from the state of the bud immediately before the flowering of this rose flower is image | photographed over 42 hours, during the imaging | photography (42 hours), a predetermined sampling period (every 2 hours) from the rose flower The aroma was collected at).
In the shooting, a digital camera capable of time-lapse shooting was used, and the state of the flower was time-lapsed every 3 minutes. As a result, in the present embodiment, 840 still images having a width of 3⁄4 were acquired (step (S11)).

On the other hand, for the collection of aroma, a rose cocoon was covered with a glass cover, and an aroma collection tube was attached to the opening of the cover. A suction pump was attached to the aroma collection pipe, and by suctioning at a flow rate of 100 mL / min by the pump, rose aroma was adsorbed to the adsorbent inside the collection pipe. The aroma collection tubes were replaced every 2 hours, and a total of 21 aroma collection tubes were obtained in 42 hours. The room temperature of the room in which the rose was placed was set to 26 ° C., and the humidity was set to 60% RH.
The aroma was thermally desorbed from each of the acquired aroma collection tubes using a thermal desorber, and introduced into a gas chromatograph mass spectrometer (GC-MS). The peak area of each aroma component to be analyzed was calculated from the obtained chromatogram (total ion chromatogram, TIC), and the ratio of each aroma component to the maximum value of the component was calculated as the aroma component value.
In this example, as shown in FIG. 6, 12 flavor components "Rose Oxide", "Citronellal", "Linalool", "Phenyl acetaldehyde", "Citronellyl Acetate", "12 as aroma components to be analyzed""Citral","GeranylAcetate","Citronellol","Nerol","Geraniol","Phenyl Ethyl Alcohol", "Methyl Eugenol" were analyzed.
FIG. 6 is a table showing time-series data of the measured values of the collected aroma components. In the example of FIG. 6, each aroma component value is each shown by the percentage with respect to the maximum value of the aroma component. For example, the odor component "Geranyl Acetate" has a maximum value (100%) at the last 13 o'clock, and has a lower value at other times.
In the present embodiment, time-series data shown in FIG. 6 is acquired in the above-described step (S13).

  Furthermore, data interpolation is performed on the time series data shown in FIG. 6 (step (S15)). In this embodiment, cubic spline interpolation is used as a data interpolation method, and the interpolation data is calculated by commercially available software.

Subsequently, time-series data of aroma component values including interpolated data were graphed using commercially available software. In this example, two types of graphs, a bar graph and a bubble chart, were generated, and the generated graph was output as an image file (step (S17)).
Furthermore, the image file group was animated using commercially available software to generate two types (a bar graph and a bubble chart) of a motion graph of about 28 seconds (step (S19)).
On the other hand, 840 still images were animated using commercially available software, and an appearance animation of approximately 28 seconds was generated (step (S21)).

In the present embodiment, as described above, the motion graph and the appearance moving image are generated as separate moving image files, and they are arranged side by side on one slide using commercially available software so that they can be simultaneously reproduced on one screen (Step (S23)).
Then, the slide is displayed on the display of a PC (Personal Computer), whereby the display as shown in FIGS. 7A and 7B is output (step (S25)).
FIG. 7A and FIG. 7B are diagrams showing the display of the simultaneous reproduction of the motion graph of the bar graph and the appearance video of the rose in the present embodiment. FIG. 8 is a view showing the display of the simultaneous reproduction of the motion graph of the bubble chart and the appearance video of the rose in the present embodiment.
In the example of FIG. 7A and FIG. 7B, in addition to the rose image, the photographing time is displayed in the appearance moving image AM, and the time-lapse situation can be viewed. Further, the length of the bar graph indicates the magnitude of each aroma component value, and the size of the bubble of the bubble chart indicates the magnitude of each aroma component value.

According to the display shown in each figure, it is possible to easily compare the appearance animation AM with the motion graph MG, and as the rose is flowered, each aroma component value increases or decreases and the ratio of the aroma component changes You can intuitively understand how you are going. Further, as shown in FIG. 7B, even in the flowering state in which the degree of visual discrimination is determined to be the same, it can be easily grasped that the distribution of the aroma component value differs depending on the time.
Here, the bubble chart in FIG. 8 is a bubble chart in which the vertical axis indicates saturated vapor pressure (mmHg), the horizontal axis indicates an aroma sensitivity threshold (ng / Lair), and the radius of each bubble is the volatilization amount, It is also good. According to such a bubble chart, a region where the saturated vapor pressure is high and the aroma sensitivity threshold is high (mainly a component contributing to the top note), conversely, the region where the saturation vapor pressure is low and the aroma sensitivity threshold is low (mainly Components that contribute to the last note (residual aroma), and regions where the saturated vapor pressure is high but the aroma sensitivity threshold is low (mainly components that contribute to the top to middle notes), while the saturation vapor pressure is low but the aroma sensitivity threshold is Each aroma component value (volatilization amount) is indicated by the bubble size at a position according to the characteristics of each aroma component such as a high region (mainly, a component that contributes to the middle to last note by using a large amount) Therefore, it is possible to make it possible to grasp the fluctuation of the aroma component while making the aromatizer consider the characteristic of the aroma component. Known information may be used as the saturated vapor pressure and the aroma sensitivity threshold value for each aroma component.

Furthermore, the present inventors verified the effect of the above-mentioned embodiment using the time-series data of the aroma component value of the rose flower and the still image group acquired as described above. Specifically, eight types of displays were shown to two perfumers, and then each display was made to evaluate the degree to which it receives hints of aroma creation such as motivation or inspiration.
The eight types of indication are as follows.
Type 1: A display in which a list of aroma component values (table in FIG. 6) and a still image of a rose flower (at the time of flowering) are arranged.
Type 2: A display in which a list of aroma component values (table in FIG. 6) and an appearance video of a rose flower are arranged.
Type 3: A line graph of aroma component values and a still image of a rose flower (at the time of flowering) are displayed side by side.
Type 4: A display in which a line graph of aroma component values and an appearance video of a rose flower are lined up.
Type 5: A display in which a bar graph motion graph and a rose flower still image (at the time of flowering) are aligned.
Type 6: A display in which a bar graph motion graph and a rose flower appearance video are aligned.
Type 7: A display in which a motion chart of a bubble chart and a still image of a rose flower (at the time of flowering) are aligned.
Type 8: A display in which a motion chart of a bubble chart and an appearance video of a rose flower are lined up.
Of the eight types of displays, types 6 and 8 correspond to the aroma fluctuation display of the present embodiment, and the other types correspond to comparative examples.
FIG. 9 is a diagram showing a display (type 2) in which a list of aroma component values (table in FIG. 6) and a moving image of appearance of rose flowers are arranged as a comparative example. FIG. 10 is a diagram showing a display (type 4) in which a line graph of aroma component values and an appearance moving image of a rose flower are arranged as a comparative example.
In the line graph, as shown in FIG. 10, the horizontal axis shows time, the vertical axis shows aroma component values, and 12 kinds of aroma components are shown by different marks.

FIG. 11 is a diagram showing the evaluation result of the perfumer. In FIG. 11, each perfumer's evaluation shows the degree of receiving hints of the creation of aroma in five steps (1 to 5).
As shown in FIG. 11, the comparative example has many comments such as “incomprehensible” and “incomprehensible” and low evaluation (3 points or less), but “type of interest” is the type 6 and 8 corresponding to the present embodiment. Comments and high ratings (more than 4 points) such as “I'm Wow” and “Let's get a hint” are attached.
According to the evaluation result, it is easy to intuitively grasp the fluctuation of the aroma component as compared with the other display forms in the display for simultaneously reproducing the motion graph and the appearance moving image as in this embodiment. Information alone has proven to be a sufficient support for perfumers to get motivation and inspiration. For example, it is possible to give a hint of aroma creation to use as an aroma component to be a base for an aroma component with little increase and decrease among aroma components to be displayed and to use as an accent for an aroma component with large increase and decrease.

  Some or all of the above contents may also be specified as follows. However, the above content is not limited to the following description.

<1> The first moving image showing the temporal change of the appearance of the object and the second moving image showing the temporal change of the amount or ratio of the aroma component corresponding to the object in graphic form are reproduced in time series Output the display
Aroma change indication method.

<2> The second moving image is a moving image that dynamically changes in a time series a graph indicating the amount or ratio of each aroma component at a unique position for each aroma component.
The aroma fluctuation display method as described in <1>.
<3> The target object is an aromatic plant in which at least one of a shape, a color, a pattern, and a size changes with the passage of time.
The aroma fluctuation display method as described in <1> or <2>.
<4> The second moving image is based on a value obtained by analyzing an aroma collected from the object at a predetermined sampling cycle during a photographing period of the image of the object forming the first moving image. Is generated,
The display synchronously reproduces the first moving image and the second moving image on a common time axis,
The aroma fluctuation display method as described in any one of <1> to <3>.
<5> The second moving image is generated based on the value obtained in the predetermined sampling cycle and the value obtained by performing data interpolation on the value.
The aroma fluctuation display method as described in <4>.
<6> The imaging time width between the adjacent frames forming the first moving image is set to 1/120 or more of the predetermined sampling period,
The aroma fluctuation display method as described in <4> or <5>.
<7> The first moving image shows how a flower plant blooms or how a fruit matures with the passage of time,
The aroma component shown by the second moving image includes an aroma component which tends to increase toward flowering or maturation while its amount or ratio periodically increases and decreases with the passage of time.
The aroma fluctuation display method as described in any one of <1> to <6>.
<8> The display is output to one or more display devices in a state in which the first moving image and the second moving image can be compared simultaneously.
The aroma fluctuation display method as described in any one of <1> to <7>.
<9> The display indicates that at least one of the first moving image and the second moving image being reproduced, the amount or the ratio of the plurality of types of aroma components corresponding to the aroma of the target product is the second moving image Present the timing shown
The aroma fluctuation display method as described in any one of <1> to <8>.
<10> A first acquisition unit for acquiring image data of a first moving image showing temporal change of the appearance of an object,
A second acquisition unit for acquiring time-series data of the amount or ratio of the aroma component of the object;
The graph which shows the quantity or ratio of the above-mentioned aroma component for each time is generated based on the time series data, respectively, and the generated graph is used to show the time-dependent change of the quantity or ratio of the above-mentioned aroma component in graph form A moving image generating means for generating two moving images;
An output processing means for outputting a display in which the first moving image and the second moving image are reproduced in association with time series, to a display device;
An information processing apparatus comprising:
<11> The second moving image is a moving image that dynamically changes, in time series, a graph indicating the amount or ratio of each aroma component at a unique position for each aroma component.
The information processing apparatus according to <10>.
<12> The target object is an aromatic plant in which at least one of a shape, a color, a pattern, and a size changes with the passage of time.
The information processing apparatus according to <10> or <11>.
<13> The time-series data acquired by the second acquiring unit is an aroma collected from the object at a predetermined sampling cycle during a photographing period of an image of the object forming the first moving image. Including the values obtained by analysis
The output processing means outputs the display for synchronously reproducing the first moving image and the second moving image on a common time axis.
The information processing apparatus according to any one of <10> to <12>.
<14> The second acquisition unit acquires the time-series data including interpolated values by performing data interpolation on the values acquired in the predetermined sampling cycle.
The information processing apparatus according to <13>.
<15> The first moving image shows how a flower plant blooms with the passage of time,
The aroma component shown by the second moving image includes an aroma component that tends to increase toward flowering while the amount or ratio periodically increases and decreases with the passage of time.
The information processing apparatus according to any one of <10> to <14>.
<16> The output processing means outputs the display to one or more of the display devices in a state where the first moving image and the second moving image can be compared simultaneously.
The information processing apparatus according to any one of <10> to <15>.

10 information processing apparatus 11 CPU
12 Memory 13 I / O I / F
14 communication unit 15 output device 16 input device 21 first acquisition unit 22 second acquisition unit 23 video generation unit 24 output processing unit

Claims (11)

A display in which a first moving image showing temporal change of the appearance of the object and a second moving image showing temporal change of the amount or ratio of the aroma component corresponding to the object in graphic form are reproduced in time series. Aroma fluctuation display method to output,
The second moving image is a moving image that dynamically changes, in time series, a graph indicating the amount or ratio of each aroma component at a unique position for each aroma component.
Incense care change display method. A display in which a first moving image showing temporal change of the appearance of the object and a second moving image showing temporal change of the amount or ratio of the aroma component corresponding to the object in graphic form are reproduced in time series. Aroma fluctuation display method to output,
The object is an aromatic plant in which at least one of shape, color, pattern and size changes with the passage of time.
Incense care change display method. A display in which a first moving image showing temporal change of the appearance of the object and a second moving image showing temporal change of the amount or ratio of the aroma component corresponding to the object in graphic form are reproduced in time series. Aroma fluctuation display method to output,
The second moving image is generated based on a value obtained by analyzing the aroma collected from the object at a predetermined sampling cycle during a photographing period of the image of the object forming the first moving image. Yes,
The display synchronously reproduces the first moving image and the second moving image on a common time axis,
Incense care change display method. The second moving image is generated based on the value obtained in the predetermined sampling cycle and a value obtained by performing data interpolation on the value.
The aroma fluctuation display method according to claim 3 . The imaging time width between the adjacent frames forming the first moving image is set to at least 1/120 of the predetermined sampling period.
The method according to claim 3 or 4 . A display in which a first moving image showing temporal change of the appearance of the object and a second moving image showing temporal change of the amount or ratio of the aroma component corresponding to the object in graphic form are reproduced in time series. Aroma fluctuation display method to output,
The first animation shows how a flower plant blooms or a fruit matures with the passage of time,
The aroma component shown by the second moving image includes an aroma component which tends to increase toward flowering or maturation while its amount or ratio periodically increases and decreases with the passage of time.
Incense care change display method. The first moving image showing the temporal change of the appearance of the object and the second moving image showing the temporal change of the amount or ratio of the plurality of types of aroma components corresponding to the object in graphic form are reproduced in time series The aroma fluctuation display method which outputs the
The developed product in which the aroma is scented is associated with the amount or ratio of a plurality of aroma components corresponding to the aroma in the developed product,
Wherein the display includes a plurality of kinds of aroma components corresponding to the aroma of the product development in the time course of the amount or ratio of said plural kinds of aroma components corresponding to the object represented by the second video being played when the amount or the specific rate is shown, presenting the reproduction timing,
Incense care change display method. A first acquisition unit for acquiring image data of a first moving image showing temporal change of the appearance of the object;
A second acquisition unit for acquiring time-series data of the amount or ratio of the aroma component of the object;
The graph which shows the quantity or ratio of the above-mentioned aroma component for each time is generated based on the time series data, respectively, and the generated graph is used to show the time-dependent change of the quantity or ratio of the above-mentioned aroma component in graph form A moving image generating means for generating two moving images;
An output processing means for outputting a display in which the first moving image and the second moving image are reproduced in association with time series, to a display device;
Equipped with
The second moving image is a moving image that dynamically changes, in time series, a graph indicating the amount or ratio of each aroma component at a unique position for each aroma component.
Information processing apparatus. A first acquisition unit for acquiring image data of a first moving image showing temporal change of the appearance of the object;
A second acquisition unit for acquiring time-series data of the amount or ratio of the aroma component of the object;
The graph which shows the quantity or ratio of the above-mentioned aroma component for each time is generated based on the time series data, respectively, and the generated graph is used to show the time-dependent change of the quantity or ratio of the above-mentioned aroma component in graph form A moving image generating means for generating two moving images;
An output processing means for outputting a display in which the first moving image and the second moving image are reproduced in association with time series, to a display device;
Equipped with
The object is an aromatic plant in which at least one of shape, color, pattern and size changes with the passage of time.
Information processing apparatus. A first acquisition unit for acquiring image data of a first moving image showing temporal change of the appearance of the object;
A second acquisition unit for acquiring time-series data of the amount or ratio of the aroma component of the object;
The graph which shows the quantity or ratio of the above-mentioned aroma component for each time is generated based on the time series data, respectively, and the generated graph is used to show the time-dependent change of the quantity or ratio of the above-mentioned aroma component in graph form A moving image generating means for generating two moving images;
An output processing means for outputting a display in which the first moving image and the second moving image are reproduced in association with time series, to a display device;
Equipped with
The time-series data acquired by the second acquisition unit is an analysis of aroma collected from the object at a predetermined sampling cycle during a photographing period of an image of the object forming the first moving image. Including the value obtained,
The output processing means outputs the display for synchronously reproducing the first moving image and the second moving image on a common time axis.
Information processing apparatus. A first acquisition unit for acquiring image data of a first moving image showing temporal change of the appearance of the object;
A second acquisition unit for acquiring time-series data of the amount or ratio of the aroma component of the object;
The graph which shows the quantity or ratio of the above-mentioned aroma component for each time is generated based on the time series data, respectively, and the generated graph is used to show the time-dependent change of the quantity or ratio of the above-mentioned aroma component in graph form A moving image generating means for generating two moving images;
An output processing means for outputting a display in which the first moving image and the second moving image are reproduced in association with time series, to a display device;
Equipped with
The first video shows how the flowering plant blooms with the passage of time,
The aroma component shown by the second moving image includes an aroma component that tends to increase toward flowering while the amount thereof periodically increases and decreases with the passage of time,
Information processing apparatus.

Images