TW202005417A - Binaural sound processing apparatus, information processing apparatus, and program - Google Patents

Abstract

A binaural sound processing apparatus is provided with: a storage device in which application identification information for identifying each of a plurality of applications and binaural sound source information in which a sound when each application is applied to the skin is binaurally recorded are stored in association with each other; a means for determining application identification information that identifies at least one application from among the plurality of applications; a means for selecting the binaural sound source information associated with the determined application identification information; and a means for outputting the selected binaural sound source information.

Description

Stereo sound processing device, information processing device and program

The invention relates to a stereo sound processing device, an information processing device and a program.

In general, the coating applied to the human body (such as cosmetics) imparts a tactile sensation to the person being coated varies from person to person. For example, in addition to the cosmetic effects obtained by using cosmetics, consumers of cosmetics also consider cosmetics when using cosmetics (such as skin touch) and choose cosmetics. On the other hand, cosmetics sellers promote cosmetics sales by attracting consumers with both beauty effects and touch.

Japanese Patent Laid-Open No. 2003-186962 discloses the following technology: To help select cosmetics that take into account touch, the consumer inputs parameters related to the touch, and prompts cosmetics corresponding to the parameters input by the consumer Of formula.

[Problems to be solved by the invention]

However, in the technology of Japanese Patent Laid-Open No. 2003-186962, consumers cannot experience the touch. Therefore, the tactile sensation that consumers feel when actually using cosmetics corresponding to the suggested formula may be different from the tactile sensation that consumers imagine when inputting parameters. In particular, in the online shopping that has been rapidly popularized in recent years, consumers cannot experience the touch of cosmetics.

That is, before, before using the coating, the consumer cannot experience the tactile sensation of the coating.

The purpose of the present invention is to enable consumers to experience the tactile sensation of the coating before using the coating. [Technical means to solve the problem]

One aspect of the present invention is a stereo sound processing device, which includes: A mechanism that associates and memorizes the coating identification information that identifies each of the plurality of coatings, and the stereophonic source information that stereoscopically records the sound when each coating is applied to the skin; Decide the mechanism to identify the coating identification information of at least one coating from the multiple coatings; Select the organization of the stereo audio information associated with the coating identification information determined above; and An organization that outputs the information of the stereo sound source selected above. [Effect of invention]

According to the present invention, the consumer can experience the tactile feel of the coating before using the coating.

Hereinafter, an embodiment of the present invention will be described in detail based on the drawings. In addition, in the drawings for explaining the embodiments, in principle, the same constituent elements are denoted by the same symbols, and redundant descriptions thereof are omitted.

(1) Structure of sound processing system The structure of the sound processing system will be described. FIG. 1 is a schematic diagram showing the configuration of the sound processing system of this embodiment. FIG. 2 is a block diagram showing the structure of the sound processing system of FIG. 1. FIG.

As shown in FIGS. 1 and 2, the sound processing system 1 includes a stereo sound processing device 10, a sound output device 20, and a server 30. The stereo sound processing device 10 and the sound output device 20 are connected by wired communication or wireless communication. The stereo sound processing device 10 and the server 30 are connected via a network (eg, Internet or intranet) NW. The user U can hear the sound (for example, stereo sound) processed by the stereo sound processing device 10 through the sound output device 20.

The stereo sound processing device 10 is configured to generate a stereo sound sound signal. The stereo sound processing device 10 is an example of an information processing device that sends a request to the server 30. The stereo sound processing device 10 is, for example, a smartphone, a tablet terminal, or a personal computer.

The sound output device 20 is configured to output a stereo sound corresponding to the sound signal transmitted from the stereo sound processing device 10. The sound output device 20 is, for example, a headset or headphones.

The server 30 is an example of an information processing device that provides a response to the request sent from the stereo sound processing device 10 to the stereo sound processing device 10. The server 30 is, for example, a web (Web) server.

(1-1) Structure of stereo sound processing device The configuration of the stereo sound processing device 10 will be described with reference to FIG. 2.

As shown in FIG. 2, the stereo sound processing device 10 includes a memory device 11, a processor 12, an input/output interface 13, and a communication interface 14.

The memory device 11 is configured to memorize programs and data. The memory device 11 is, for example, a combination of ROM (Read Only Memory), RAM (Random Access Memory), and storage (such as flash memory or hard disk).

The program includes, for example, the following program. ·OS (Operating System: operating system) program ·Applications that perform information processing (such as applications for stereo sound processing)

The data includes, for example, the following data. ·Data base for reference in information processing · Data obtained by performing information processing (that is, the results of execution of information processing)

The processor 12 is configured to realize the function of the stereo sound processing device 10 by starting the program memorized in the memory device 11. The processor 12 is an example of a computer.

The input/output interface 13 is configured to obtain a user's instruction from an input element connected to the stereo sound processing device 10 and output information to an output element connected to the stereo sound processing device 10. The input element is, for example, a keyboard, a pointing element, a touch panel, or a combination of these. The output element is, for example, a display.

The communication interface 14 is configured to control the communication between the stereo sound processing device 10 and the server 30.

(1-2) Composition of the server 2, the configuration of the server 30 will be described.

As shown in FIG. 2, the server 30 includes a memory device 31, a processor 32, an input/output interface 33, and a communication interface 34.

The memory device 31 is configured to memorize programs and data. The memory device 31 is, for example, a combination of ROM, RAM, and storage (such as flash memory or hard disk).

The program includes, for example, the following program. ·OS program ·Applications for information processing

The data includes, for example, the following data. ·Data base for reference in information processing ·Execution results of information processing

The processor 32 is configured to realize the function of the server 30 by starting the program memorized in the memory device 31. The processor 32 is an example of a computer.

The input/output interface 33 is configured to obtain the user's instruction from the input element connected to the server 30 and output information to the output element connected to the server 30. The input element is, for example, a keyboard, a pointing element, a touch panel, or a combination of these. The output element is, for example, a display.

The communication interface 34 is configured to control the communication between the server 30 and the stereo sound processing device 10.

(2) Overview of the implementation form The outline of this embodiment will be described. FIG. 3 is an explanatory diagram of the outline of this embodiment.

The stereo sound processing device 10 stores stereo sound source information. Stereo sound source information is related to coatings that can be applied to the human body. The coated article is, for example, a cosmetic that can be applied to the skin. Examples of cosmetics include makeup cosmetics, skin care cosmetics, and hair care cosmetics. Examples of the form of cosmetics include solid, liquid, and spray. Stereo sound source information records the stereo sound reproduced by the vibration transmitted to the eardrum when each coating is applied to the human body. When the user U specifies the desired coating material, the stereo sound processing device 10 outputs the stereo sound source information associated with the designated coating material to the sound output device 20. The sound output device 20 outputs the stereo sound recorded in the stereo sound source information output from the stereo sound processing device 10.

The stereo sound of such a coating can stimulate the sense of hearing and the tactile sensation that accompanies the hearing, so that the user U can experience the tactile sensation when using the coating. In this embodiment, the user U can be prompted to listen to the tactile feeling when using the desired coating by listening to the stereo sound of the desired coating.

(3) Database The database of this embodiment will be described. The following database is stored in the memory device 11.

(3-1) Coating material information database The coating material information database of this embodiment will be described. FIG. 4 is a diagram showing the data structure of the coating material information database of this embodiment.

The coating material information database in FIG. 4 stores coating material information related to the coating material. The coating material information database includes a "coating material ID" field, a "coating material name" field, a "recommended attribute" field, a "stereo sound source" field, and a "content" field. The fields are related to each other.

In the "Coated Material ID" field, a coated material ID (an example of "coated material identification information") for identifying the coated material is stored. The coating ID is the main key of the coating information database record (hereinafter referred to as "coating information record").

In the "Coated Object Name" field, information (such as text) related to the name of the coated object is stored.

In the "recommended attribute" field, information related to the user attribute of the recommended coating material is stored (hereinafter referred to as "recommended attribute information"). The "recommended attributes" field includes a "gender" field, an "age" field, and a "skin status" field.

In the "Gender" field, information related to the sex of the recommended coating is stored.

The "age" field stores information related to the recommended age of the coating.

In the "Skin Status" field, information related to the skin condition of the recommended coating is stored.

In the "stereo sound source" field, there is stored a stereo sound source file (an example of stereo sound source information) that records the vibration sound when the coating material is applied.

In the "Content" field, there are stored content files related to the coating. The content includes, for example, at least one of the following. ·Dynamic image content · Still image content ·CG (Computer Graphics: computer graphics) content ·Sound content

(4) Information processing The information processing of this embodiment will be described. FIG. 5 is a flowchart of information processing in this embodiment. 6 is a diagram showing an example of a screen displayed in the information processing of FIG. 5.

As shown in FIG. 5, the stereo sound processing device 10 executes acceptance of the designation of the coating object (S100). Specifically, the processor 12 displays the screen P100 (FIG. 6) on the display.

The screen P100 includes operation objects B100a to B100b. The operation objects B100a to B100b are objects that accept user instructions for designating the coated object. The coated object ID is assigned to the operation objects B100a to B100b.

For example, when the user U operates the operation object B100a, the processor 12 specifies the coating object ID assigned to the operation object B100a. By this, the designation of the coating object is accepted.

After step S100, the stereo sound processing device 10 performs the selection of a stereo sound source (S101). Specifically, the processor 12 refers to the coating material information database (FIG. 4 ), and reads out the information of the “stereo sound source” field (ie, stereo sound source file) associated with the coating material ID specified in step S100.

After step S101, the stereo sound processing device 10 performs stereo sound playback (S102). Specifically, the processor 12 generates the sound signal of the stereo sound recorded in the stereo sound source file by opening the stereo sound source file read in step S101. The processor 12 sends the generated sound signal to the sound output device 20. The sound output device 20 outputs stereo sound based on the sound signal sent from the processor 12.

According to the present embodiment, the user U can experience the tactile sensation when using the desired coating by listening to the stereo sound output by the sound output device 20.

(5) Variation A variation of this embodiment will be described.

(5-1) Variation 1 Variation 1 will be described. Variation 1 is an example of outputting a stereo sound corresponding to the combination of the coating object and the user attribute of the user U.

(5-1-1) Summary of Variation 1 The outline of Modification 1 will be described. 7 is an explanatory diagram of a summary of Modification 1. FIG.

The stereo sound processing device 10 in FIG. 7 stores stereo sound source information. The stereoscopic sound source information is associated with the combination of coatings and user attributes (for example, coatings recommended according to the user attributes of user U). When the user U specifies the desired coating material, the stereo sound processing device 10 outputs the stereo sound source information associated with the combination of the specified coating material and the user attribute of the user U to the sound output device 20. The sound output device 20 outputs the stereo sound recorded in the stereo sound source information output from the stereo sound processing device 10.

In Variation 1, the touch felt when the user U is prompted to apply the recommended coating by listening to the stereo sound of the coating associated with the user attribute of the user U in the coating desired by the user U sense.

(5-1-2)Database The database of Variation 1 will be described.

(5-1-2-1) User Information Database The user information database of Variation 1 will be described. FIG. 8 is a diagram showing the data structure of the user information database of Variation 1.

The user information database of FIG. 8 includes a "user ID" field, a "user name" field, a "user attribute" field, and a "mobile history" field. The fields are related to each other.

A user ID (an example of "user identification information") identifying user U is stored in the "user ID" field. The user ID is the primary key of the user information database record (hereinafter referred to as "user information record").

In the "user name" field, information (eg text) related to the user name of user U is stored.

The user attribute information related to the attribute of user U is stored in the "user attribute" field. The "User Properties" field includes a "Gender" field, an "Age" field, and a "Skin Status" field.

Information related to the gender of user U is stored in the "Gender" field.

Information related to the age of user U is stored in the "age" field.

The skin state information related to the skin state of the user U is stored in the "skin state" field. In the "Skin Status" field, store it in the user information database by at least one of the following methods. The processor 12 stores the skin state information input by the user U in the "skin state" field. The processor 12 stores the skin state information sent from an element (such as a smartphone) that can obtain skin state information via the communication interface 14 in the "skin state" field. The processor 12 stores the skin state information sent from the wearable component worn by the user U in the "skin state" field.

In the "Action History" field, action history information related to the action history of the user U is stored. The "Mobile History" field includes the "Browsing History" field and the "Purchase History" field.

In the "Browsing History" field, browsing history information related to the website's browsing history is stored (as an example, the URL of the website that the user U has browsed (Uniform Resource Locator: Uniform Resource Locator)).

In the "Purchase History" field, purchase history information related to the purchase history of the product is stored (as an example, it is the coating material ID of the coating material purchased by the user U, and information related to the purchase date).

(5-1-3) Information processing The information processing of Variation 1 will be described. 9 is a flowchart of information processing in Modification 1. FIG. 10 is a diagram showing an example of a screen displayed in the information processing of FIG. 9.

As shown in FIG. 9, the stereo sound processing device 10 performs user information acquisition (S110). Specifically, the processor 12 displays the screen P110 (FIG. 10) on the display.

The screen P110 includes an operation object B110 and a field object F110. Field object F110 is an object that accepts input of user information. The operation object B110 is an object for accepting user instructions for determining user information input to the field object F110.

For example, when the user U enters the user ID into the field object F110 and operates the operation object B110, the processor 12 refers to the user information database (FIG. 8) to specify and input the field ID F110 User information records associated with the user ID.

After step S110, the stereo sound processing device 10 performs the selection of a stereo sound source (S111).

In the first example of step S111, the processor 12 refers to the "recommended attribute" field of the coating material information database (FIG. 4) to specify the user attribute information contained in the user information record corresponding to the specific step S111 (For example, information related to gender, age, and skin condition) The processor 12 reads the information in the "stereo sound source" field of the coating material information record (ie, stereo sound source file).

In the second example of step S111, the memory device 11 stores the action history of the user U and the related model of the coating material preferred by the user U. The input of the relevant model is the course of action of the user U. The output of the relevant model is the coating material information. The processor 12 inputs the information of the "mobile history" field (for example, at least one type of information in the "browsing history" field and the "purchase history" field) contained in the specific user information record in step S111 into the relevant Model, and predict coating material information (eg coating material ID) related to the coating material recommended to the user U. The processor 12 refers to the coating material information database (FIG. 4) to read out the information of the “stereo sound source” field (ie, stereo sound source file) associated with the predicted coating material ID.

After step S111, the stereo sound processing device 10 performs stereo sound playback in the same manner as in FIG. 5 (S102).

According to Variation 1, the user U can experience the tactile sensation when using the coating material recommended to use its own attributes by listening to the stereo sound output by the sound output device 20.

(5-2) Variation 2 Variation 2 will be described. Variation 2 is an example of outputting stereo sound optimized according to the movement of the user U.

(5-2-1) Summary of Variation 2 The outline of Modification 2 will be described. FIG. 11 is an explanatory diagram of a summary of Modification 2. FIG.

As shown in FIG. 11, while listening to the stereo sound output from the sound output device 20, when the user U moves, the stereo sound processing device 10 corrects the stereo sound according to the movement of the user U. The sound output device 20 outputs the stereo sound corrected by the stereo sound processing device 10.

(5-2-2) Information processing The information processing of Variation 2 will be described. FIG. 12 is a flowchart of information processing in Variation 2.

As shown in FIG. 12, the stereo sound processing device 10 executes steps S100 to S101 in the same manner as in FIG. 9.

After step S101, the stereo sound processing device 10 executes acquisition of mobile information (S120). Specifically, the stereo sound processing device 10 is connected to a movement sensor (not shown) configured to detect the movement of the user. The motion sensor includes, for example, at least one of the following. ·Image sensor for detecting the image of user U An acceleration sensor that detects the acceleration of a part of the user U's body (such as the hand) A rotation sensor that detects the angular acceleration of a part of the user U's body (such as the hand) ·Geomagnetic sensor for detecting geomagnetism

The processor 12 calculates the movement of the user U based on information detected by the movement sensor (for example, at least one of image, acceleration, rotation, and geomagnetism).

After step S120, the stereo sound processing device 10 performs stereo sound correction (S121). Specifically, the memory device 11 stores correction parameters for each movement of the user U. The processor 12 uses the correction parameters corresponding to the movement calculated in step S120 to correct the sound characteristics of the stereo sound. The sound characteristics include, for example, at least one of the following. ·Frequency (as an example of the playback speed) ·Sound pressure ·The time difference between the left and right stereo sound (as an example, the phase difference)

After step S121, the stereo sound processing device 10 executes step S102 as in FIG. 9.

According to Modification 2, the stereo sound processing device 10 corrects the stereo sound according to the movement of the user U. Thereby, the user U can interactively and actively experience the tactile sensation when using the coating object according to the movement during listening to the stereo sound. In addition, the user U can listen to the stereo sound optimized according to his own movement. Thereby, even when the user U moves while listening to the stereo sound, the tactile sensation when using the coated object can be accurately transmitted to the user U. More specifically, the interactive tactile sensation corresponding to the action of touching the skin can be prompted by correcting the frequency according to the speed at which the user U touches his own skin. By correcting the time difference between the left and right stereo sounds according to the position and direction of the skin of the user U touching himself, an interactive tactile sensation corresponding to the position and direction of touching the skin can be prompted. By modifying the sound pressure according to the intensity of the user U touching his own skin, the interactive tactile sensation corresponding to the intensity of touching the skin can be prompted. Since the sound of the opposite phase of the actual sound generated when the user U touches the skin of the user U can be superimposed on the stereo sound to eliminate the actual sound, the stereo sound corresponding only to the tactile sensation can be prompted.

(5-3) Variation 3 Variation 3 will be described. Variation 3 is an example of outputting stereo sound optimized according to the environment of the user U.

(5-3-1) Summary of Variation 3 The outline of the modified example 3 will be described. FIG. 13 is an explanatory diagram of the outline of Modification 3. FIG.

As shown in FIG. 13, while listening to the stereo sound output from the sound output device 20, the stereo sound processing device 10 corrects the stereo sound according to the environmental information related to the environment of the user U (ie, the playback environment of the stereo sound). The sound output device 20 outputs the stereo sound corrected by the stereo sound processing device 10.

(5-3-2) Information processing The information processing of Variation 3 will be described. FIG. 14 is a flowchart of information processing in Variation 3.

As shown in FIG. 14, the stereo sound processing device 10 executes steps S100 to S101 in the same manner as in FIG. 9.

After step S101, the stereo sound processing device 10 executes the acquisition of environmental information (S130). Specifically, the stereo sound processing device 10 is connected to an environment sensor (not shown) configured to detect environmental information related to the environment in which the user U exists. The sensor includes, for example, at least one of the following. ·Temperature sensor for detecting temperature ·Humidity sensor for detecting humidity ·Sensor to detect the UV level of user U exposure

The processor 12 obtains the environment information detected by the environment sensor through the input-output interface 13.

After step S130, the stereo sound processing device 10 performs stereo sound correction (S131). Specifically, the memory device 11 stores correction parameters for each environment information. The processor 12 uses the correction parameters corresponding to the environmental information obtained in step S130 to correct the sound characteristics of the stereo sound. The sound characteristics include, for example, at least one of the following. ·Frequency (as an example of the playback speed) ·Sound pressure ·The time difference between the left and right stereo sound (as an example, the phase difference)

After step S131, the stereo sound processing device 10 executes step S102 as in FIG. 9.

According to Variation 3, the stereo sound processing device 10 corrects the stereo sound according to the environment where the user U exists (ie, the playback environment of the stereo sound). In this way, for the user U, a tactile sensation corresponding to the environment can be experienced.

(5-4) Variation 4 Variation 4 will be described. Variation 4 is an example of outputting stereo sound in accordance with the content related to the coating material.

(5-4-1) Summary of Variation 4 The outline of the modified example 4 will be described. 15 is an explanatory diagram of a summary of Modification 4.

As shown in FIG. 4, in the coating material information database, the coating material ID, the stereo sound source file, and the content file are associated and stored. As shown in FIG. 15, after selecting the content (for example, the image content designated by user U), the stereo sound processing device 10 opens the stereo sound source file associated with the content file corresponding to the selected content, thereby generating the corresponding The sound signal of the stereo sound source file. The sound output device 20 outputs stereo sound based on the sound signal generated by the stereo sound processing device 10.

(5-4-2) Information processing The information processing of Variation 4 will be described. FIG. 16 is a flowchart of information processing in Variation 4. FIG. 17 is a diagram showing an example of a screen displayed in the information processing of FIG. 16.

As shown in FIG. 16, the stereo sound processing device 10 executes acceptance of content designation (S130). Specifically, the processor 12 displays the screen P130 (FIG. 17) on the display.

The screen P130 includes an operation object B130 and a field object F130. The field object F130 is an object that accepts user instructions for specifying the file name of the content file. The operation object B130 is an object that accepts the user instruction for determining the file name designated by the field object F130.

When the user U specifies an arbitrary file name in the field object F130 and operates the operation object B130, the processor 12 obtains the file name specified in the field object F130.

After step S130, the stereo sound processing device 10 performs the selection of a stereo sound source (S131). Specifically, the processor 12 refers to the coating material information database (FIG. 4 ), and reads out the stereoscopic sound source file associated with the content file corresponding to the file name obtained in step S130.

After step S131, the stereo sound processing device 10 performs content and stereo sound playback (S132). Specifically, the processor 12 opens the content file corresponding to the file name obtained in step S130, thereby displaying the screen P131 (FIG. 16) on the display.

The screen P131 includes the display object A131. On the display object A131, the content corresponding to the content file (for example, the promotional animation of the coating object) is played.

The processor 12 generates the sound signal of the stereo sound recorded in the stereo sound source file read in step S131 in synchronization with the content played in the display object A131. The processor 12 sends the generated sound signal to the sound output device 20. The sound output device 20 outputs stereo sound based on the sound signal sent from the processor 12.

According to Variation 4, the stereo sound processing device 10 synchronizes with the content specified by the user U and presents the stereo sound. In this way, the user U can experience the tactile sensation when using the coating material described in the content while facing the user U to prompt the desired content.

In addition, in the modification 4, when the stereo sound processing device 10 accepts the designation of the CG content in step S130, it may also change the CG content according to the user's instruction in step S132, and play the content corresponding to the changed CG content Stereo sound.

As an example, when the professional makeup artist specifies the CG content of the script of the coating applied to the face image of the user U, the user U may give at least one of the following user instructions to the stereo sound processing device 10. · Instructions for specifying the part (full or partial) where the coating should be applied · Instructions for specifying the coating method (such as thin coating or thick coating) The processor 12 changes the CG content displayed on the display according to the user's instruction, and also changes the stereoscopic sound source information according to the changed CG content.

In this case, the stereo sound processing device 10 presents the CG content and stereo sound corresponding to the user's instruction. Thereby, the user U can interactively and actively experience the tactile sensation when using the coating material according to the user's instruction during the experience of the CG content.

(5-5) Variation 5 Variation 5 will be described. Variation 5 is an example of correcting the stereo sound in accordance with the change of the composition of the coating material over time during the playback of the stereo sound.

(5-5-1) Summary of Variation 5 The outline of the modified example 5 will be described. 18 is an explanatory diagram of a summary of Modification 5.

As shown in FIG. 18, the stereo sound processing device 10 corrects the stereo sound according to the passage of time to listen to the stereo sound output from the sound output device 20. The sound output device 20 outputs the stereo sound corrected by the stereo sound processing device 10.

(5-5-2) Information processing The information processing of Variation 5 will be described. FIG. 19 is a flowchart of information processing in Modification 5.

As shown in FIG. 19, the stereo sound processing device 10 executes steps S100 to S101 in the same manner as in FIG. 9.

After step S101, the stereo sound processing device 10 performs stereo sound correction (S140). Specifically, the memory device 11 stores correction parameters corresponding to the tactile sensation that change with the passage of time for each coating object ID. The processor 12 specifies the correction parameter associated with the coating object ID specified in step S100. The processor 12 uses specific correction parameters to modify the sound characteristics of the stereo sound based on the playback time of the stereo sound. The sound characteristics include, for example, at least one of the following. ·Frequency (as an example of the playback speed) ·Sound pressure ·The time difference between the left and right stereo sound (as an example, the phase difference)

After step S131, the stereo sound processing device 10 executes step S102 as in FIG. 9.

According to Modification 5, the stereo sound processing device 10 corrects the stereo sound according to the playback time. As a result, the user U can experience the time change of the tactile sensation when using the coating material.

(6) Summary of this embodiment This embodiment is summarized.

The first aspect of this embodiment is a stereo sound processing device 10, which includes: A mechanism for associating and memorizing coating identification information (for example, coating ID) that identifies each of a plurality of coatings, and stereo sound source information (for example, stereo sound source file) in which the sound when each coating is applied to the skin is recorded in three dimensions (Eg memory device 11); A mechanism that determines the coating identification information that identifies at least one coating from among a plurality of coatings (for example, the processor 12 that performs the process of step S100); A mechanism for selecting stereoscopic sound source information associated with the determined coating identification information (for example, the processor 12 performing the process of step S101); and A mechanism for outputting the selected stereo sound source information (for example, the processor 12 executing the process of step S102).

According to the first aspect, the stereo sound processing device 10 presents the stereo sound corresponding to the coating object to the user U. In this way, the user U (for example, the consumer of the coating) can experience the tactile sensation of the coating before using the coating.

The second aspect of this embodiment is a stereo sound processing device 10, in which The decision mechanism decides the coating identification information according to the operator's instructions.

According to the second aspect, the stereo sound processing device 10 presents the stereo sound corresponding to the desired coating object to the user U. In this way, the user U (for example, the consumer of the coating) can experience the desired tactile feeling of the coating before using the coating.

A stereo sound processing device 10 includes: A mechanism that associates and memorizes stereoscopic sound source information and user attribute information related to user attributes; and A mechanism for obtaining user attribute information related to the attribute of the user (for example, the processor 12 executing the process of step S110); and The selected organization selects the stereoscopic sound source information associated with the determined coating identification information and the obtained user attribute information.

According to the third aspect, the stereo sound processing device 10 presents to the user U the stereo sound corresponding to the user attribute of the user U. In this way, the user U (for example, the consumer of the coating) can experience the tactile sensation suitable for the coating of the user U.

The fourth aspect of the present embodiment is a stereo sound processing device 10, which includes: Predict the mechanism of the coating recommended for the user (for example, the processor 12 that performs the process of step S111); and The organization that determines the coating identification information obtains the coating identification information of the determined coating.

According to the fourth aspect, the stereo sound processing device 10 presents to the user U the stereo sound of the coating article recommended to the user U. In this way, the user U (for example, the consumer of the coating) can experience the tactile sensation of the coating recommended by the user U.

The fifth aspect of this embodiment is a stereo sound processing device 10, in which The mechanism for determining the coating material determines the coating material based on the user's skin condition.

According to the fifth aspect, the stereo sound processing device 10 presents to the user U the stereo sound of the coating article recommended for use based on the skin condition of the user U. In this way, the user U (for example, the consumer of the coating) can experience the tactile sensation of the coating corresponding to the skin condition of the user U.

The sixth aspect of the present embodiment is a stereo sound processing device 10, which includes: Based on the user's course of action, predict the mechanism of the coating recommended by the user (for example, the processor 12 performing the process of step S111); and The selected institution selects the stereophonic information related to the coating identification information of the predicted coating.

According to the sixth aspect, the stereo sound processing device 10 presents to the user U the stereo sound of the coating article recommended for use based on the action history of the user U. In this way, the user U (for example, the consumer of the coating material) can experience the tactile sensation of the coating material corresponding to the user U's action tendency.

The seventh aspect of this embodiment is a stereo sound processing device 10, in which The mobile history includes at least one of the browsing history of the website visited by the user and the purchase history of the coating material purchased by the user.

According to the seventh aspect, the stereo sound processing device 10 prompts the stereo sound of the coating material recommended for use based on at least one of the browsing history of the user U's website and the purchase history of the coating material purchased by the user. In this way, the user U (for example, the consumer of the coating) can experience the tactile sensation of the coating corresponding to at least one of the user U's action tendency and purchase tendency.

The eighth aspect of this embodiment is a stereo sound processing device 10, which includes: A mechanism for obtaining movement information related to the movement of the user using the coating material (for example, the processor 12 executing the process of step S120); and Based on the acquired mobile information, the mechanism for modifying the selected stereo audio information (for example, the processor 12 executing the process of step S121); and The output mechanism outputs the corrected stereo sound source information.

According to the eighth aspect, the stereo sound processing device 10 corrects the stereo sound based on the movement of the user U while listening to the stereo sound. In this way, the user U can interactively and actively experience the tactile sensation when using the coating material. In addition, even when the user U moves while listening to the stereo sound, the tactile sensation when using the coated object can be accurately transmitted to the user U.

The ninth aspect of this embodiment is a stereo sound processing device 10, in which The mechanism for obtaining mobile information obtains mobile information from at least one of an image sensor, an acceleration sensor, a rotation sensor, and a geomagnetic sensor.

According to the ninth aspect, the tactile sensation when using the coated object can be accurately transmitted to the user U based on movement information specific to at least one of self-image, acceleration, angular acceleration, and geomagnetism.

The tenth aspect of this embodiment is a stereo sound processing device 10, which includes: An organization that obtains environmental information related to the user's environment (for example, the processor 12 that executes the process of step S130); and Based on the obtained environmental information, the mechanism for modifying the selected stereo sound source information (for example, the processor 12 executing the process of step S131); and The output mechanism outputs the corrected stereo sound source information.

According to the tenth aspect, the stereo sound processing device 10 corrects the stereo sound according to the environment where the user U exists (ie, the playback environment of the stereo sound). In this way, for the user U, a tactile sensation corresponding to the environment can be experienced.

The eleventh aspect of this embodiment is a stereo sound processing device 10, which includes: A mechanism that associates and memorizes the animation content related to the coating and the stereo sound source information; The selected institution selects the stereo sound source information associated with the animation content to be played; and According to the playback time of the animation content, the stereoscopic sound source information is corrected.

According to the eleventh aspect, the stereo sound processing device 10 presents the stereo sound in synchronization with the content designated by the user U. In this way, the user U can experience the tactile sensation when using the coating material described in the content while facing the user U to prompt the desired content.

The twelfth aspect of the present embodiment is a stereo sound processing device 10, which includes: A mechanism that associates and memorizes the CG content related to the coating and the stereo sound source information; The selected institution selects the stereo sound source information associated with the CG content to be played; and According to the operator's instructions accepted during the playback of CG content, the stereo sound source information is changed.

According to the twelfth aspect, the user U can interactively and actively experience the tactile sensation when using the coated object according to an instruction (eg, user instruction) given during the experience of the CG content.

A thirteenth aspect of this embodiment is a stereo sound processing device 10, which includes: Refer to the prediction model for predicting the time change of the composition when each coating is applied to the human body, and predict the mechanism of the time change of the composition of the coating identified based on the determined coating identification information; and Based on the predicted time change, the organization that converts the selected stereo sound source information to time; and The output mechanism outputs the time-converted stereo audio information.

According to the thirteenth aspect, the stereo sound processing device 10 corrects the stereo sound according to the playback time. As a result, the user U can experience the time change of the tactile sensation when using the coating material.

The fourteenth aspect of this embodiment is a program for a computer (for example, the processor 12) to implement any of the above mechanisms.

(7) Other changes

The memory device 11 can also be connected to the stereo sound processing device 10 via the network NW. The memory device 31 may also be connected to the server 30 via the network NW.

The stereo sound processing device 10 and the sound output device 20 may be integrated. In this case, the stereo sound processing device 10 and the sound output device 20 are not wired communication or wireless communication, but are connected by electrical circuits.

At least a part of the steps performed by the stereo sound processing device 10 may also be performed by the server 30. In this case, the stereo sound processing device 10 sends a request for information processing to the server 30. The server 30 performs information processing corresponding to the request sent from the stereo sound processing device 10 and sends a response containing the result of the information processing to the stereo sound processing device 10. The stereo sound processing device 10 sends a sound signal to the sound output device 20 based on the result of information processing included in the response sent from the server 30.

At least one of the databases stored in the memory device 11 may also be stored in the memory device 31.

The embodiments of the present invention have been described in detail above, and the scope of the present invention is not limited to the above-mentioned embodiments. In addition, the above-mentioned embodiment can have various improvements or changes without departing from the gist of the present invention. In addition, the above-described embodiments and modified examples can be combined.

1‧‧‧ sound processing system 10‧‧‧stereo sound processing device 11‧‧‧memory device 12‧‧‧ processor 13‧‧‧I/O interface 14‧‧‧Communication interface 20‧‧‧Sound output device 21‧‧‧Sound output section 23‧‧‧I/O interface 30‧‧‧Server 31‧‧‧memory device 32‧‧‧ processor 33‧‧‧I/O interface 34‧‧‧Communication interface A131‧‧‧Display objects B100a‧‧‧operating objects B100b‧‧‧operating objects B110‧‧‧Operation object B130‧‧‧Operation object F110‧‧‧field object F130 ‧‧‧ field object NW‧‧‧ Internet P100‧‧‧picture P110‧‧‧picture P130‧‧‧picture P131‧‧‧ screen S100～S102‧‧‧Step S110‧‧‧Step S111‧‧‧Step S120‧‧‧Step S121‧‧‧Step S130‧‧‧Step S131‧‧‧Step S132‧‧‧Step S140‧‧‧Step U‧‧‧ user

FIG. 1 is a schematic diagram showing the configuration of the sound processing system of this embodiment. FIG. 2 is a block diagram showing the structure of the sound processing system of FIG. 1. FIG. FIG. 3 is an explanatory diagram of the outline of this embodiment. FIG. 4 is a diagram showing the data structure of the coating material information database of this embodiment. FIG. 5 is a flowchart of information processing in this embodiment. 6 is a diagram showing an example of a screen displayed in the information processing of FIG. 5. 7 is an explanatory diagram of a summary of Modification 1. FIG. FIG. 8 is a diagram showing the data structure of the user information database of Variation 1. 9 is a flowchart of information processing in Modification 1. Fig. 10 is a diagram showing an example of a screen displayed in the information processing of Fig. 9. FIG. 11 is an explanatory diagram of a summary of Modification 2. FIG. FIG. 12 is a flowchart of information processing in Variation 2. FIG. 13 is an explanatory diagram of the outline of Modification 3. FIG. FIG. 14 is a flowchart of information processing in Variation 3. 15 is an explanatory diagram of a summary of Modification 4. FIG. 16 is a flowchart of information processing in Variation 4. FIG. 17 is a diagram showing an example of a screen displayed in the information processing of FIG. 16. 18 is an explanatory diagram of a summary of Modification 5. FIG. 19 is a flowchart of information processing in Modification 5.

1‧‧‧Coated material

20‧‧‧Sound output device

U‧‧‧ user

Claims (14)

A stereo sound processing device, including: A mechanism that associates and memorizes the coating identification information identifying each of the plurality of coatings, and the stereophonic information of the stereo sound source recording the sound when each coating is applied to the skin; Decide the mechanism to identify the coating identification information of at least one coating from the multiple coatings; Select the organization of the stereo audio information associated with the coating identification information determined above; and An organization that outputs the information of the stereo sound source selected above. The stereo sound processing device according to claim 1, wherein The above-mentioned decision mechanism decides the coating material identification information according to the operator's instruction. As claimed in claim 1, the stereo sound processing device has: A mechanism that associates and memorizes the above stereoscopic sound source information and user attribute information related to the user's attributes; and An organization that obtains user attribute information related to user attributes; and The selected mechanism selects the stereo sound source information associated with the determined coating identification information and the obtained user attribute information. As claimed in claim 3, the stereo sound processing device has: Decide on the recommended coating system for the above users; and The institution that determines the coating identification information described above obtains the coating identification information of the coating determined above. The stereo sound processing device according to claim 4, wherein The mechanism for determining the coating material determines the coating material based on the skin condition of the user. The stereo sound processing device according to any one of claims 1 to 5 is provided with: Based on the user's action history, predict the mechanism of the coating recommended by the user; and The above-mentioned selected mechanism selects the stereo sound source information associated with the predicted coating identification information of the coating. The stereo sound processing device according to claim 6, wherein The above action course is at least one of the browsing course of the website visited by the user and the purchase course of the coating material purchased by the user. The stereo sound processing device according to any one of claims 1 to 7 is provided with: A mechanism to obtain movement information related to the movement of the user using the coating; and Based on the mobile information obtained above, the mechanism for revising the stereo information selected above; and The output mechanism outputs the corrected stereo sound source information. The stereo sound processing device according to claim 8, wherein The mechanism for obtaining the movement information obtains the movement information from at least one of an image sensor, an acceleration sensor, a rotation sensor, and a geomagnetic sensor. The stereo sound processing device according to any one of claims 1 to 9 is provided with: Organizations that obtain environmental information related to the user's environment; and Based on the environmental information obtained above, the organization that revises the stereo sound information selected above; and The output mechanism outputs the corrected stereo sound source information. The stereo sound processing device according to any one of claims 1 to 10, which has: A mechanism for associating and memorizing the animation content related to the above-mentioned coating and the above-mentioned stereoscopic sound source information; The above-mentioned selected organization selects the stereo sound source information associated with the animation content to be played; and According to the playback time of the above animation content, the above stereoscopic sound source information is corrected. The stereo sound processing device according to any one of claims 1 to 11, wherein: A mechanism for associating and memorizing the CG (Computer Graphics) content related to the above-mentioned coating material and the above-mentioned stereoscopic sound source information; The organization selected above selects the stereo sound source information associated with the CG content to be played; and According to the operator's instructions accepted during the playback of the CG content, the information of the stereo sound source is changed. The stereo sound processing device according to any one of claims 1 to 12, which has: Refer to the prediction model for predicting the time change of the composition when each coating is applied to the human body, and predict the mechanism of the time change of the composition of the coating identified based on the coating identification information determined above; and Based on the above-mentioned predicted time change, the mechanism for time-converting the above-mentioned selected stereo sound source information; and The output mechanism outputs the time-converted stereo audio information. A program for causing the computer to implement each of the organizations as in any one of the request items 1 to 13.

Images