JP2020160982A - Information processing device, program and information providing system - Google Patents

Abstract

To visually grasp flavor or taste when objects are mixed.SOLUTION: In the case that a plurality of samples 60 are placed on a sensing surface of a sensor device 40, a display control part 14 displays representations about the respective samples in display areas corresponding to position relationships of the samples 60 of the respective samples 60. For example, when two samples A, B are placed on the sensing surface, a representation common in the sample A and the sample B is displayed in a display area between the sample A and the sample B. Also, a certain reference point is determined on the sensing surface, and the display control part 14 displays a mixture ratio with a ratio corresponding to distance from the reference point to respective samples as the mixture ratio of each sample.SELECTED DRAWING: Figure 3

Description

The present invention relates to a technique for knowing the scent or taste when the scent or taste of an object is mixed.

It is known that scents give various effects to humans by acting on the limbic system that controls human emotions, behaviors, and memories. For example, Patent Document 1 describes that a subject who smells a scent is presented with a question about a mental event recalled by smelling the scent, and the answer is obtained as a numerical value.

Japanese Unexamined Patent Publication No. 2016-180830

By the way, it is difficult to know exactly what kind of scent will be when one scent and another scent are mixed. This applies not only to the scent of an object, but also to the taste of an object, and it is not possible to know exactly what the taste will be when an object with one taste and an object with another taste are mixed. It is not easy.

Therefore, an object of the present invention is to make it possible to visually grasp the scent or taste when an object is mixed.

In order to solve the above problems, the present invention stimulates a specific part that specifies the position of a plurality of objects that stimulate the user's sense of smell or taste, and a display area corresponding to the position of each specified object by the object. It is a display control unit that displays one or more expressions related to the sense of smell or taste, and is characterized by including a display control unit that displays each of the above expressions in a display area corresponding to the positional relationship of the plurality of objects. To provide an information processing device.

The display control unit may display the expression common to the first object and the second object in the display area between the first object and the second object. ..

The display control unit has an olfactory or taste sensation stimulated by a mixed object in which the first object and the second object are mixed in the display region between the first object and the second object. You may want to display the expression about.

The display control unit displays an expression having a predetermined relationship between the expression relating to the first object and the expression relating to the second object in a display mode that can be distinguished from the expression not having the predetermined relationship. You may do so.

The display control unit may set the distance from the reference point to each of the objects as the mixing ratio of each object and display the mixing ratio.

The display control unit may set the distance from a predetermined reference point to each of the objects as the mixing ratio of the respective objects, and display the expression in a display mode according to the mixing ratio.

Further, in the present invention, the computer is stimulated by a specific unit that specifies the position of a plurality of objects that stimulate the user's sense of smell or taste, and a display area corresponding to the position of each specified object. Provided is a display control unit that displays one or more expressions related to the sense of smell or taste, and provides a program for realizing a display control unit that displays each of the above expressions in a display area corresponding to the positional relationship of the plurality of objects. To do.

Further, the present invention controls the operating device, the display device, the specific unit that specifies the position where the operation that stimulates the user's sense of smell or taste is placed in the operating device, and the display device. It is a display control unit that displays one or more expressions related to the sense of smell or taste stimulated by the object in the display area corresponding to the position of each specified object, and each said expression is the positional relationship of the plurality of objects. Provided is an information providing system characterized by having a display control unit for displaying in a display area according to the above and an information processing device provided.

According to the present invention, it becomes possible to visually grasp the scent or taste when an object is mixed.

It is a block diagram which illustrates the whole structure of the information providing system which concerns on one Embodiment of this invention. It is a side view which illustrates the structure of an information provision system. It is a block diagram which shows an example of the hardware composition of the information processing apparatus which concerns on one Embodiment of this invention. It is a figure which shows an example of the expression DB which the information processing apparatus stores. It is a block diagram which shows an example of the functional structure of an information processing apparatus. It is a flowchart which shows an example of the operation of an information processing apparatus. It is a top view which illustrates the state when the sensing surface of a sensor device is seen from above at the time of using an information providing system. It is a top view which illustrates the state when the sensing surface of a sensor device is seen from above at the time of using an information providing system. It is a top view which illustrates the state when the sensing surface of a sensor device is seen from above at the time of using an information providing system. It is a top view which illustrates the state when the sensing surface of a sensor device is seen from above at the time of using an information providing system.

[Constitution]
First, the overall configuration of the information providing system 1 according to the embodiment of the present invention will be described. The information providing system 1 is a system that provides information so that the user can visually grasp the relationship between the scent of an object and the expression of the scent. As shown in FIG. 1, the information providing system 1 includes an information processing device 10, a projector device 20, a sensor device 40, and a plurality of samples 60. The information processing device 10, the projector device 20, and the sensor device 40 are communicably connected by wire or wirelessly. The information processing device 10 is an example of the information processing device according to the present invention, and is a device that controls central control in the information providing system 1. The projector device 20 is an example of a display device that displays information to the user. The sensor device 40 is an example of an operation device that accepts a user's operation. Each of the plurality of samples 60 is an object that emits a scent that stimulates the user's sense of smell. For example, the sample 60 may be a natural substance that emits a scent (for example, a plant called lavender itself), or an artificial product containing the scent (for example, a volatile liquid from which the scent of lavender is extracted or a liquid thereof is impregnated). It may be a sheet or the like. In the present embodiment, as the sample 60, a cylindrical vial with a lid containing a liquid called aroma oil containing a scent extracted from a natural substance that emits a scent is used. Each sample 60 is attached with a sticker or a tag with the name of the sample (for example, the name of a plant called "lavender"). The user visually identifies each sample by referring to this name.

FIG. 2 is a side view illustrating the structure of the information providing system 1, and more specifically, a diagram illustrating the positional relationship when the projector device 20, the sensor device 40, and the sample 60 are viewed from the horizontal direction. The sensor device 40 has, for example, a thin rectangular plate shape, and its upper surface is a horizontal sensing surface. The sample 60 is provided with a tag 61, which is a storage medium that stores identification information (referred to as a sample ID) that identifies each sample. When the sample 60 is placed on the sensing surface, the sensor device 40 reads the sample ID stored in the tag 61 of the sample 60 by using, for example, a short-range wireless communication standard called NFC (Near Field Communication), and the sensor device 40 reads the sample ID. The position where the sample 60 is placed (that is, the reading position of the tag 61 on the sensing surface) is detected.

The projector device 20 is installed above the sensor device 40 (for example, the ceiling of a room). As shown by the broken line in FIG. 2, the projector device 20 has the entire range of the sensing surface of the sensor device 40 as the projection range, and projects light to an arbitrary position on the sensing surface based on the above X and Y coordinates to obtain an image. Can be displayed. That is, the sensing surface of the sensor device 40 also functions as a display surface on which an image is displayed.

FIG. 3 is a diagram illustrating a hardware configuration of the information processing device 10. The information processing device 10 is a computer having a CPU 101 (Central Processing Unit), a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an auxiliary storage device 104, and a communication IF (Interface) 105.

The CPU 101 is a processor that performs various calculations. The ROM 102 is, for example, a non-volatile memory that stores programs and data used for starting the information processing apparatus 10. The RAM 103 is a volatile memory that functions as a work area when the CPU 101 executes a program. The auxiliary storage device 104 is a non-volatile storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and stores programs and data used in the information processing device 10. By executing this program, the CPU 101 realizes a function described later and also executes an operation described later. The communication IF 105 is an interface for performing communication according to a predetermined communication standard. This communication standard may be a standard for wired communication or a standard for wireless communication. In addition to the configuration illustrated in FIG. 3, the information processing device 10 may include other configurations such as a display device such as a liquid crystal display and an operation device such as a keyboard.

The auxiliary storage device 104 stores an expression database as shown in FIG. 4 (hereinafter, the database is referred to as a DB). In this expression DB, each sample ID is associated with one or more expressions related to the sense of smell stimulated by the sample 60 corresponding to the sample ID (that is, one or more expressions expressing the scent of the sample 60 in characters). ing. That is, when the user smells the scent of the sample 60, this expression is used as a means for transmitting the scent to others. This expression may be an expression using any part of speech such as a noun or an adjective, and also covers from a direct expression to an indirect expression of the scent. The direct expression here is an expression commonly used when reminiscent of the image of a scent, such as "sweet" or "fruity", and the indirect expression is, for example, "spring". Compared to the above direct expressions such as "morning" and "walking", it is an expression that is not commonly used as an expression of scent. The indirect expression is a secondary expression recalled from the direct expression based on the direct expression, and may be said to be an expression that abstractly expresses the scent as compared with the direct expression.

Further, this expression DB includes a display mode when displaying each expression. This display mode is, for example, the position where the expression is displayed, the distance between the position where the expression is displayed and the sample 60, the direction of the display position of the expression with respect to the sample 60, the color when the expression is displayed, and the size when the expression is displayed. The font when displaying the expression, the modification when displaying the expression, the time when the expression is displayed, the time when the expression is displayed, the movement of the expression (including the spatial or temporal change of the expression), or , Includes languages used for expression, etc.

This display mode changes depending on the relationship between the sample 60 and the expression. The relationship between the sample 60 and the expression is the intensity or amount of the scent (more strictly speaking, the component contained in the scent of the sample) represented by the expression in the sample 60, or the abstraction of the expression with respect to the scent. Degree etc. For example, the expression "sweet" is displayed near the sample 60 having a strong scent of "sweet", or the expression "sweet" is displayed in a large or conspicuous color for the sample 60 having a strong scent of "sweet". For sample 60, which has a strong scent of "sweet", an example of displaying the expression "sweet" so that it stands out by moving in a vibrating manner depends on the relationship between the sample 60 and the expression. This is an example of a changing display mode. Also, for example, for a sample with a strong scent of "sweet" and a weak scent of "fruity", the expression "sweet" is displayed near the sample and the expression "fruity" is displayed far away from the sample. Is also an example of a display mode that changes according to the relationship between the sample 60 and the expression. In addition, when a direct expression and an indirect expression are associated with a certain sample, the direct expression is displayed near the sample and the indirect expression is displayed far away from the sample. As described above, the example of changing the distance between the sample 60 and the expression according to the degree of abstraction of the expression is also an example of the display mode that changes according to the relationship between the sample 60 and the expression. In short, the expression is displayed in a display mode in which the content of the relationship between the sample 60 and the expression (specifically, the strength of the relationship and the way of the relationship) can be visually recognized.

In the example of FIG. 4, for the sample 60 of the sample ID “ID001”, “sweet” is set as the expression 1, “fresh” is set as the expression 2, “flower” is set as the expression 3, and so on. Among these expressions, the display mode of the expression 1 "sweet" is that the distance between the position where the expression is displayed and the sample is "2 units" (1 unit is a length arbitrarily determined on the sensing surface). The color is "red", the font is "Gothic", the size is "25 points", and the movement is "blinking".

Next, FIG. 5 is a block diagram showing an example of the functional configuration of the information processing apparatus 10. The information processing device 10 realizes the functions of the sample identification unit 11, the position identification unit 12, the expression DB storage unit 13, and the display control unit 14.

When the sample 60 is placed on the sensing surface of the sensor device 40, the sample identification unit 11 determines which sample 60 is placed on the sensing surface based on the reading result of the sample ID stored in the tag 61 of the sample 60. Identify.

When the sample 60 is placed on the sensing surface of the sensor device 40, the position specifying unit 12 places the sample 60 at any position on the sensing surface based on the position where the sample ID stored in the tag 61 of the sample 60 is read. It is specified whether it has been placed (that is, the position where the sample 60 is placed in the sensor device 40).

The display control unit 14 controls the projector device 20 and relates to the sense of smell stimulated by the sample 60 specified by the sample identification unit 11 in the display area corresponding to the position of the sample 60 specified by the position identification unit 12. Display the above expression. At this time, the display control unit 14 displays in the expression DB stored in the expression DB storage unit 13 in a display mode corresponding to the sample specified by the sample identification unit 11. The display area corresponding to the position of the sample 60 is, for example, an area on the sensing surface within a range of a distance determined from the position of the sample 60, and specifically, the position of the sample 60 on the sensing surface is the center. An example is conceivable that it is a circular area with a radius of 10 cm or less. However, the display area corresponding to the position of the sample 60 is not limited to this example, and may be an area in which the user can recognize which sample the displayed expression is related to.

The number of samples 60 placed on the sensing surface of the sensor device 40 is not limited to one, and a plurality of samples 60 may be placed at the same time. In this case, the display control unit 14 displays the expression related to each sample 60 in the display area corresponding to the positional relationship of each sample 60. For example, when two samples A and B are placed on the sensing surface, the expression common to the samples A and B is displayed in the display area between the samples A and B. The display area between the sample A and the sample B referred to here is, for example, a display area including at least a part of a straight line connecting the position of the sample A and the position of the sample B. In short, the displayed expression is Any display area may be used so that the user can recognize which sample and which sample the expression is related to. Further, a certain reference point is determined on the sensing surface, and the display control unit 14 sets the ratio according to the distance from the reference point to each sample as the mixing ratio of each sample, and displays the mixing ratio. ..

[motion]
Next, the operation of this embodiment will be described with reference to the flowchart of FIG. Note that FIG. 7 is a plan view illustrating a state when the sensing surface of the sensor device 40 is viewed from above. In this example, the above-mentioned reference point P is approximately the center of the sensing surface.

Here, the user places a sample (here, sample 60a) for which he / she wants to know the expression related to the scent on the sensing surface of the sensor device 40 with reference to the sample name attached to the sample 60. At this time, the sample specifying unit 11 of the information processing device 10 identifies which sample 60 is placed on the sensing surface based on the reading result of the sample ID by the sensor device 40 (step S11 in FIG. 6). Further, the position specifying unit 12 of the information processing device 10 identifies which sample 60 is placed on the sensing surface and where on the sensing surface based on the reading position of the sample ID by the sensor device 40 (step S12 in FIG. 6). The order of the processes in steps S11 and S12 may be opposite to that in the example of FIG. 6, and both processes may be performed substantially at the same time.

Next, the display control unit 14 uses the sample ID of the sample 60a as a key to search the expression DB for the expression corresponding to the sample ID (step S13 in FIG. 6). Then, the display control unit 14 determines the distance from the reference point P to each sample as the mixing ratio of each sample (step S14 in FIG. 6). Here, since only one sample is placed, there is no equivalent to the concept of mixing ratio. Further, the display control unit 14 refers to the expression DB and determines the display mode corresponding to each of the searched expressions (step S15 in FIG. 6). Then, the display control unit 14 controls the projector device 20 to display the expression searched in step S13 in the display area corresponding to the position of the sample 60a specified by the position specifying unit 12 in the display mode determined in step S15. Is displayed (step S16 in FIG. 6).

As a result, as illustrated in FIG. 8, the expression regarding the scent of the sample 60a is displayed inside a circle of an arbitrary size centered on the position of the sample 60a, for example. As described above, the display mode of each expression at this time is a display mode according to the relationship between the expression and the sample 60a. The user can know how to express the scent of the sample 60a by opening the lid of the sample 60a and smelling the scent while looking at these expressions. At the same time, the user can also know the relationship between the scent of the sample 60a and each expression by referring to the display mode of each expression. For example, in the example of FIG. 8, the user indicates that the scent of sample 60a is a scent typically expressed as "sweet", but also includes a scent component such as "gorgeous" and "fruit". Furthermore, it can be recognized that those scents are associated with events such as "spring" and "flowers".

Next, the user places yet another sample (here, sample 60b) on the sensing surface of the sensor device 40. At this time, the sample specifying unit 11 of the information processing device 10 identifies which sample 60 is placed on the sensing surface based on the reading result of the sample ID by the sensor device 40 (step S11 in FIG. 6). Further, the position specifying unit 12 of the information processing device 10 identifies which sample 60 is placed on the sensing surface and where on the sensing surface based on the reading position of the sample ID by the sensor device 40 (step S12 in FIG. 6).

Next, the display control unit 14 uses the sample ID of the newly placed sample 60b as a key to search the expression DB for the expression corresponding to the sample ID (step S13 in FIG. 6). Further, the display control unit 14 refers to the expression DB and determines the display mode corresponding to each of the searched expressions (step S15 in FIG. 6). Then, the display control unit 14 determines the ratio according to the distance from the reference point P to the respective samples 60a and 60b as the mixing ratio of each sample. Here, the ratio of the distances from the reference point P to the respective samples 60a and 60b is 72:28, and the mixing ratio of the samples 60a and 60b is the reciprocal ratio of the ratios of 1/72: 1/28 = 28%: 72%. Then, the display control unit 14 controls the projector device 20 to search the display area corresponding to the positional relationship of the samples 60a and 60b specified by the position specifying unit 12 for each of the samples 60a and 60b in step S13. The representation is displayed in the display area corresponding to the positional relationship of the samples 60a and 60b in the display mode determined in step S15 for each of the samples 60a and 60b (step S16 in FIG. 6).

As a result, as illustrated in FIG. 9, the expression regarding the scent of the sample 60a is displayed inside a circle of an arbitrary size centered on the position of the sample 60a, and the expression regarding the scent of the sample 60b is displayed. For example, it is displayed inside a circle of arbitrary size centered on the position of the sample 60b. The display mode of each expression at this time excludes the display mode relating to the area for displaying the expression (for example, the position where the expression is displayed, the distance between the position where the expression is displayed and the sample 60, and the direction of the display position of the expression with respect to the sample 60). The display mode is defined by the expression DB illustrated in FIG. The scent expression of sample 60a is "sweet", "gorgeous", "fruit", "spring", and "flower" as described above, whereas the scent expression of sample 60b is "sweet", "fruit", and "flower". "Fresh," "pink," and "transparency." Among these expressions, "sweet", "fruit", and "flower", which are expressions common to samples 60a and sample 60b, refer to a display area between sample 60a and sample 60b, for example, the position of sample 60a and the position of sample 60b. It is displayed in the display area including the midpoint of the connecting line segment. Then, expressions that are not common to the sample 60a and the sample 60b are displayed in a display area other than the display area between the sample 60a and the sample 60b. At this time, the display area in which the expressions common to the samples 60a and the samples 60b are displayed is surrounded by, for example, a circle indicated by a chain line, and an image connecting the circle and each sample is displayed to the user. It may be possible to clearly indicate which expression is a common expression for each sample. At this time, the mixing ratio of the sample 60a and the sample 60b "28%": "72%" is further displayed.

Further, the user places a third sample (here, sample 60c) on the sensing surface of the sensor device 40. At this time, the sample specifying unit 11 of the information processing device 10 identifies which sample 60 is placed on the sensing surface based on the reading result of the sample ID by the sensor device 40 (step S11 in FIG. 6). Further, the position specifying unit 12 of the information processing device 10 identifies which sample 60 is placed on the sensing surface and where on the sensing surface based on the reading position of the sample ID by the sensor device 40 (step S12 in FIG. 6).

The display control unit 14 uses the sample ID of the newly placed sample 60c as a key to search the expression DB for the expression corresponding to the sample ID (step S13 in FIG. 6). Further, the display control unit 14 refers to the expression DB and determines the display mode corresponding to each of the searched expressions (step S15 in FIG. 6). Then, the display control unit 14 determines the ratio according to the distance from the reference point P to each sample as the mixing ratio of each sample. Here, the ratio of the distances from the reference point P to the respective samples 60a, 60b, 60c is 64:22:14, and the mixing ratio of the samples 60a, 60b, 50c is 1/64, which is the reciprocal ratio of the ratio. : 1/22: 1/14 = 12: 34: 54. Then, the display control unit 14 controls the projector device 20 to step on each of the samples 60a, 60b, 60c in the display area corresponding to the positional relationship of the samples 60a, 60b, 60c specified by the position specifying unit 12. The expression searched in S13 is displayed in the display area corresponding to the positional relationship of the samples 60a, 60b, 60c in the display mode determined in step S15 for each of the samples 60a, 60b, 60c (step S16 in FIG. 6).

As a result, as illustrated in FIG. 10, the expression regarding the scent of the sample 60a is displayed inside a circle of an arbitrary size centered on the position of the sample 60a, and the expression regarding the scent of the sample 60b is displayed, for example. It is displayed inside a circle of arbitrary size centered on the position of the sample 60b, and the expression regarding the scent of the sample 60c is displayed inside a circle of an arbitrary size centered on the position of the sample 60c, for example. To. The display mode of each expression at this time excludes the display mode relating to the area for displaying the expression (for example, the position where the expression is displayed, the distance between the position where the expression is displayed and the sample 60, and the direction of the display position of the expression with respect to the sample 60). This is the display mode defined in the expression DB illustrated in FIG. The expression of the scent of sample 60a is "sweet", "gorgeous", "fruit", "spring", and "flower" as described above, and the expression of the scent of sample 60b is "sweet", "fruit", "flower", and "fresh". The expressions of the scent of the sample 60c are "pink" and "transparency", and the expressions of the scent are "sweet", "fresh", "morning", "walking" and "relaxing". Of these expressions, "fruit" and "flower", which are expressions common to samples 60a and sample 60b, are displayed in the display area between sample 60a and sample 60b, and are expressions common to samples 60b and sample 60c. "Fresh" is displayed in the display area between the sample 60b and the sample 60c, but nothing is displayed because there is no expression common to the sample 60a and the sample 60c. Further, "sweet", which is an expression common to all of the samples 60a, 60b, and 60c, is a display area between the samples 60a, 60b, and 60c, for example, the center of gravity of a triangle whose apex is the position of these three samples. It is displayed in the display area corresponding to. At this time, expressions that are not common between the two or more samples are displayed in a display area other than the display area between the samples. At the same time, the mixing ratios of the samples 60a, 60b, and 60c "12%": "34%": "54%" are displayed.

While referring to these expressions, the user can add a sample 60 to be placed on the sensing surface, remove the sample 60 from the sensing surface, or change the distance from the reference point P to each sample 60. It is possible to imagine the overall scent when the sample 60 of the above is mixed. In addition, the user can also mix and sniff a plurality of samples 60 in a cup at the indicated mixing ratio. Alternatively, if the scent adjusted by the automatic perfumer is to be emitted, the user can smell the emitted scent by specifying the sample ID and the mixing ratio for the automatic perfumer. It may be. This makes it possible to know the difference between the visually grasped scent mixture image and the actual scent mixture result with the sense of smell.

According to the embodiment described above, it is possible to visually grasp the scent when the samples are mixed.

[Modification example]
The present invention is not limited to the embodiments described above. The above-described embodiment may be modified as follows. Further, the following two or more modified examples may be combined and carried out.

[Modification 1]
The present invention is applicable not only to those intended for olfaction but also to those intended for taste (for example, wine, sake, spices, seasonings, etc.). That is, the present invention may be carried out by replacing the "scent" in the embodiment with the "taste".

[Modification 2]
The display mode according to the positional relationship of the plurality of samples 60 is not limited to the example of the embodiment. For example, for the three samples 60a to 60c, the display control unit 14 has a sample between the sample 60a and the sample 60b, between the sample 60b and the sample 60c, and between the sample 60c and the sample 60a, respectively. The expression of the scent that is considered to be recognized only when the 60a and the sample 60b, the sample 60b and the sample 60c, and the sample 60c and the sample 60a are mixed may be displayed. Similarly, the display control unit 14 may display the expression of the scent that is considered to be recognized only when these samples 60a, 60b, 60c are mixed at the intermediate position of the samples 60a, 60b, 60c. Good. As a result, for example, the expression "sweet and sour" is displayed between the sample 60a corresponding to the expression "sweet" and the sample 60b corresponding to the expression "sourness", and the sample 60b corresponding to the expression "sourness" The expression "calm" is displayed between the sample 60c corresponding to the expression "tree", and between the sample 60c corresponding to the expression "tree" and the sample 60a corresponding to the expression "sweet". An example is conceivable in which the expression "fruit" is displayed and the expression "forest" is placed at an intermediate position between these samples 60a, 60b, and 60c. In this case, a database or rule of which scent and which scent should be mixed to obtain a scent corresponding to what kind of expression is stored in advance in the auxiliary storage device 104 or the like, and the display control unit 14 refers to it. To do. In this way, the display control unit 14 has an olfactory sense stimulated by a mixed object in which the first object and the second object are mixed in the display area between the first object and the second object. You may want to display the expression about.

[Modification 3]
When the display control unit 14 displays the expressions in the display mode according to the positional relationship of the plurality of samples 60, the display control unit 14 displays the expressions that are compatible with each other in a display mode that can be identified by color, movement, or the like. May be good. For example, the sample 60a corresponding to the expression "sweet" and the sample 60b corresponding to the expression "mellow" are referred to as "sweet" and "mellow" on the premise that "sweet" and "mellow" are compatible with each other. An example is conceivable in which expressions are displayed in the same color, and expressions that do not have such a good relationship are displayed in different colors. Similarly, the display control unit 14 may display in a display mode in which expressions that are incompatible with each other can be identified by color or movement. For example, the sample 60a corresponding to the expression "sweet" and the sample 60b corresponding to the expression "bitter" are referred to as "sweet" and "bitter" on the premise that "sweet" and "bitter" are incompatible. An example is conceivable in which expressions are displayed with similar violent movements, and expressions that do not have such an incompatible relationship are displayed without movement. As described above, the display control unit 14 has a display mode in which the expression relating to the first object and the expression relating to the second object, which have a predetermined relationship, can be distinguished from the expression not having the predetermined relationship. It may be displayed. The expression in which a plurality of expressions have a predetermined relationship is similar to the above-mentioned relationship of good / bad compatibility, and the plurality of expressions all match / do not match the user's taste. Examples of belonging to / not belonging to the scent expression group are also conceivable. In this case, the user's preference regarding the scent and the expression group of the similar scent are collected and stored in a database in advance and stored in the auxiliary storage device 104 or the like, and the display control unit 14 refers to the scent.

[Modification example 4]
In the embodiment, the display mode of the expression of each sample 60 is a display mode according to the relationship between the expression illustrated in FIG. 4 and the sample 60a, except for the display mode relating to the area for displaying the expression. The unit 14 may display the expression in a display mode according to the mixing ratio. For example, an example may be considered in which the expression relating to the sample 60 having a large mixing ratio is highlighted by size, color, or the like so that the expression becomes a strong scent when mixed. That is, the display control unit 14 sets the ratio according to the distance from the predetermined reference point to each sample 60 as the mixing ratio of each sample 60, and displays the expression in the display mode according to the mixing ratio. In this case, how to change the display mode of FIG. 4 based on the mixing ratio is pre-regulated and stored in the auxiliary storage device 104 or the like, and the display control unit 14 refers to the rule. , The display mode according to the mixing ratio shall be determined.

[Modification 5]
The display mode when displaying each expression may be in accordance with the relationship between the expression and the user who sees the display of the expression. The relationship between the expression and the user includes, for example, the degree of agreement between the scent of the scent expressed by the expression and the user's preference for the scent, the history of the user using the expression as the expression of the scent, and the like. For example, for users who prefer the scent of "sweet", the expression "sweet" may be displayed near the sample 60 placed on the sensing surface, or the expression "sweet" may be displayed in a large or conspicuous color. An example is conceivable in which the expression "sweet" is displayed prominently by moving in a vibrating manner. In this case, the user's preference regarding the scent is collected and stored in a database in advance and stored in the auxiliary storage device 104 or the like, and the display control unit 14 shall refer to it.

Also, for example, for users who have used the expression "sweet" a lot in the past, the expression "sweet" may be displayed near the sample 60 placed on the sensing surface, or the expression "sweet" may be displayed in a large or conspicuous color. Examples include displaying the expression "sweet" or displaying the expression "sweet" so that it stands out by moving in a vibrating manner. In this case, the history of expressions used by the user for the scent is collected and stored in a database in advance and stored in the auxiliary storage device 104 or the like, and the display control unit 14 shall refer to it.

[Modification 6]
The display mode when displaying each expression may correspond to the attribute of the scent represented by the expression. The attributes of the scent include, for example, the distinction between the top note, the middle note, and the last note, the strength / weakness of the scent stimulus, and the fascination, peculiarity, and rarity of the scent. Top note, middle note, and last note are the scents that are first recognized in time, the scents that are recognized next, and the scents that are recognized next when the scent changes. .. For example, an example of displaying expressions corresponding to the top note, middle note, and last note in order from near to far from the sample 60 placed on the sensing surface, and display of expressions corresponding to the top note, middle note, and last note. Can be considered as an example of switching to time series. In addition, expressions related to stimulating scents and rare scents can be displayed in specific colors, fonts, and movements.

[Modification 7]
The display mode when displaying each expression may be in accordance with the attributes of the expression. The attributes of the expression include, for example, the image received from the expression, the distinction of the part of speech of the expression, the type of characters used in the expression (hiragana, katakana, kanji, alphabet, etc.), the number of characters / words constituting the expression, and the like. For example, the expression "sweet" may be displayed in warm colors.

[Modification 8]
The display device and the operation device are not limited to the projector device 20 and the sensor device 40 illustrated in FIG. For example, the display device is not limited to projecting an image on the sensing surface of the sensor device 40, which is an operating device as in the embodiment, and the operating device itself may be, for example, a display device. Further, the display device may display an image on the wall surface (including the case where the image is projected on the wall surface and the case where the wall surface itself is a display device). Further, the display device may be a display device that realizes so-called augmented reality. Specifically, when the sample 60 is imaged by an image pickup device of a smartphone, a tablet, or a glass-type wearable device, the corresponding expression group may be displayed around the sample 60 in the captured image. Further, the operation device may be a device that detects the user's operation by the image recognition technology.

[Modification 9]
In the embodiment, when the sample 60 is placed on the sensing surface of the sensor device 40, the expression relating to the sample 60 is displayed. For example, when the lid of the lidded vial containing the aroma oil corresponding to the sample 60 is opened. , The expression relating to the sample 60 may be displayed. Similarly, for example, a natural object itself may be placed on a plate and covered with a transparent cover, and when the user removes the transparent cover, an expression relating to the scent of the natural object may be displayed.

[Modification 10]
The display form of the expression may be a two-dimensional display or a three-dimensional display. Further, the displayed "expression" is not limited to characters, and may be an image such as a color, an abstract image, or a person / landscape.

The present invention may be provided as an information processing method including steps of processing performed in the information processing apparatus 10. Further, the present invention may be provided as a program executed by the information processing apparatus 10. Such a program may be provided in the form of being recorded on a recording medium such as an optical disk, or may be provided in the form of being downloaded to a computer via a network such as the Internet and installed and made available. It is possible.

Although the present invention has been described in detail above, it is clear to those skilled in the art that the present invention is not limited to the embodiments described in the present specification. The present invention can be implemented as modifications and modifications without departing from the gist and scope of the present invention determined by the description of the claims. Therefore, the description of the present specification is for the purpose of exemplification and does not have any limiting meaning to the present invention.

1 ... Information providing system, 20 ... Projector device, 40 ... Sensor device, 60 ... Sample, 61 ... Tag, 101 ... CPU, 102 ... ROM, 103 ... RAM, 104 ... Auxiliary storage device, 105 ... Communication IF, 11 ... Sample Specific unit, 12 ... Position specific unit, 13 ... Expression DB storage unit, 14 ... Display control unit, P ... Reference point.

Claims (8)

A specific part that identifies the position of multiple objects that stimulate the user's sense of smell or taste,
It is a display control unit that displays one or more expressions related to the sense of smell or taste stimulated by the object in the display area corresponding to the position of each specified object, and each said expression is the positional relationship of the plurality of objects. An information processing device characterized in that it is provided with a display control unit that displays in a display area according to the above. The display control unit is characterized in that, in a display area between the first object and the second object, the expression common to the first object and the second object is displayed. The information processing device according to claim 1. The display control unit has an olfactory or taste sensation stimulated by a mixed object in which the first object and the second object are mixed in the display region between the first object and the second object. The information processing apparatus according to claim 1 or 2, wherein the information processing apparatus according to claim 1 or 2 is displayed. The display control unit displays the expression having a predetermined relationship between the expression relating to the first object and the expression relating to the second object in a display mode that can be distinguished from the expression not having the predetermined relationship. The information processing apparatus according to any one of claims 1 to 3. Any one of claims 1 to 4, wherein the display control unit sets a ratio according to the distance from the reference point to each of the objects as a mixing ratio of each object, and displays the mixing ratio. The information processing device described in. The display control unit is characterized in that the ratio according to the distance from a predetermined reference point to each object is set as the mixing ratio of each object, and the expression is displayed in a display mode according to the mixing ratio. The information processing apparatus according to any one of claims 1 to 5. On the computer
A specific part that identifies the position of multiple objects that stimulate the user's sense of smell or taste,
A display control unit that displays one or more expressions related to the sense of smell or taste stimulated by the object in a display area corresponding to the position of each specified object, and each said expression is a positional relationship between the plurality of objects. A program for realizing a display control unit that displays in the display area according to the above. Operating device and
Display device and
A specific unit that specifies the position where an object that stimulates the user's sense of smell or taste is placed in the operating device, and a display area that controls the display device and corresponds to the position of each specified object. Information provided by a display control unit that displays one or more expressions related to the sense of smell or taste stimulated by the object, and that displays each of the expressions in a display area corresponding to the positional relationship of the plurality of objects. An information providing system characterized by having a processing device.

Images