JPWO2018034113A1 - Content providing system, content providing method, and program for content providing system - Google Patents

Abstract

Provided are a content providing system, a content providing method, and a program for the content providing system that can affect a user's physical condition, mental condition, and the like without being conscious of the user, and lead to a predetermined state. The content providing system 1 detects biological information indicating the life activity or life state of the user 3, generates a biological signal corresponding to the biological information, analyzes the biological signal, and calculates a feature value of the biological signal. A feature amount calculation unit 14, a content processing unit 18 that performs change processing on at least a part of the content data based on the feature amount, and content output that outputs content based on the content data subjected to the change processing to the user 3 Part 20.

Description

  The present invention relates to a content providing system, a content providing method, and a program for the content providing system. In particular, the present invention relates to a content providing system, a content providing method, and a program for the content providing system that perform change processing on output content according to biometric information.

  Conventionally, a biological signal detecting means for detecting a biological signal by contacting an electrode with a forehead of a user, a transmitting means for transmitting a biological signal detected by the biological signal detecting means, and a biological signal transmitted from the transmitting means are received. Of the electroencephalogram, comprising: a receiving means that performs the FFT processing on the biological signal received by the receiving means to obtain an electroencephalogram power spectrum; application software that is operated by the power spectrum; and a control means that controls the application software. A brain training device controlled by biofeedback is known (for example, see Patent Document 1). According to the brain training apparatus described in Patent Document 1, the user can perform brain training while enjoying his / her eyes through vision in order to put his / her brain into a relaxed state or an excited state.

JP 2011-137717 A

  However, in the brain training apparatus described in Patent Document 1, the user needs to actively control application software by himself. That is, in the brain training device described in Patent Document 1, when the application software is controlled based on the user's biological signal, the user himself / herself must be aware of changing his / her biological signal. Therefore, the conventional technology including the brain training device described in Patent Document 1 changes the physical state and mental state of the user while leaving the user to the natural state without being aware of the brain training device or the like. I can't. In other words, in the prior art, the user must be conscious of actively changing his / her physical state and mental state.

  Therefore, an object of the present invention is to provide a content providing system, a content providing method, and a content providing system that can affect a user's physical condition, mental condition, and the like without being conscious of the user, and lead to a predetermined state. To provide a program.

  In order to achieve the above object, the present invention detects biological information indicating a user's life activity or life state, generates a biological signal corresponding to the biological information, analyzes the biological signal, and features of the biological signal A feature amount calculation unit for calculating the amount, a content processing unit for performing change processing on at least a part of the content data based on the feature amount, and content output for outputting content based on the content data subjected to the change processing to the user A content providing system comprising a unit is provided.

  In the content providing system, the content output unit may output at least part of the content in the augmented reality space or the virtual reality space.

  In the content providing system, the biometric sensor detects biometric information of a user who is in contact with the content based on the content data subjected to the change process, generates a biometric signal corresponding to the biometric information, and calculates a feature amount. The unit analyzes a biometric signal of a user who is in contact with the content based on the content data subjected to the change process, calculates a feature amount of the biosignal as a second feature amount, and the content processing unit It is preferable that the modification process is further performed on at least a part of the content data subjected to the modification process based on the feature amount.

  Further, in the content providing system, the biometric sensor detects biometric information that changes in real time in real time to generate a biometric signal, and the feature amount calculation unit calculates the feature amount of the biometric signal in real time, and the content processing unit However, based on the feature amount calculated in real time, at least a part of the content data can be changed in real time.

  In the above content providing system, the content is configured to have at least one element that can be perceived by the user, and the content processing unit changes the property and / or amount of the at least one element. Data can be modified.

  In order to achieve the above object, the present invention detects biological information indicating the life activity or life state of a user, analyzes a biological signal from a biological sensor that generates a biological signal corresponding to the biological information, A feature amount calculating stage for calculating a feature amount, a content processing stage for performing change processing on at least a part of the content based on the feature amount, and a content output stage for outputting the content subjected to the change processing to the user A content providing method is provided.

  In order to achieve the above object, the present invention is a program for a content providing system, which detects biological information indicating a user's life activity or life state on a computer and generates a biological signal corresponding to the biological information. A feature amount calculation function for analyzing a biological signal from a biological sensor and calculating a feature amount of the biological signal, a content processing function for performing a change process on at least a part of the content based on the feature amount, and a change process are performed. A program for a content providing system that realizes a content output function for outputting the content to a user is provided.

  According to the content providing system, the content providing method, and the program for the content providing system according to the present invention, the user's physical condition, mental condition, etc. can be affected and led to a predetermined state without being conscious of the user. Content providing system, content providing method, and program for content providing system can be provided.

1 is a schematic diagram of a content providing system according to an embodiment of the present invention. It is a functional structure block diagram of the content provision system which concerns on embodiment of this invention. It is a flowchart of the process in the content provision system which concerns on embodiment of this invention. It is a hardware block diagram of the content provision system which concerns on embodiment of this invention.

[Embodiment]
(Outline of content providing system 1)
FIG. 1 shows an outline of a content providing system according to an embodiment of the present invention. Specifically, as an example of the content providing system 1, an outline in the case where the brain wave information of the user 3 is used as biological information and the color of the image that the user 3 is in contact with is changed.

  FIG. 1 shows an example in which the content providing system 1 has a configuration of a head mounted display 5. The head mounted display 5 includes an image output unit 50 that outputs an image (still image and / or moving image), an audio output unit 52 that outputs sound, and an electroencephalogram sensor that detects an electroencephalogram of the user 3 and generates an electroencephalogram signal. 54. The head mounted display 5 includes a content storage unit that stores content data, a feature amount calculation unit that calculates the intensity of an electroencephalogram signal, a content processing unit that performs predetermined change processing on the content data based on the intensity of the electroencephalogram, Can also be provided. Note that the content storage unit, the feature amount calculation unit, and / or the content processing unit are external information processing devices (not shown. Note that information processing devices include mobile terminals such as mobile phones and smartphones, personal computers, servers, and the like. Information processing terminal, a server on a communication network such as the Internet, etc. The same shall apply hereinafter). In that case, the external information processing apparatus and the head mounted display 5 are connected to be communicable by wire or wirelessly. The head mounted display 5 receives the image data output from the image output unit 50 and / or the audio data output from the audio output unit 52 via a content storage unit and / or a communication network such as the Internet. The information may be acquired from an external information processing apparatus or the like that is communicably connected to the head mounted display 5. Furthermore, the audio output unit 52 may be a speaker arranged at a position away from the user 3.

Such a head-mounted display 5 includes predetermined content (for example, content that can be perceived by the user 3 and / or content composed of light outside the visible light range and content composed of sound outside the audible range). Content that cannot be perceived by the user 3 but physically exists). For example, the head mounted display 5 as the content providing system 1 outputs a predetermined image from the image output unit 50 and / or outputs a predetermined sound from the audio output unit 52. As an example, the image output unit 50 at time _{t 0,} and outputs an output image 200. As an example, it is assumed that the output image 200 includes a predetermined object 500 as shown in (c-1) of FIG.

  The electroencephalogram sensor 54 detects the electroencephalogram of the user 3 in real time and generates an electroencephalogram signal. Here, an outline of an electroencephalogram signal generated by the electroencephalogram sensor 54 is shown in FIG. FIG. 1B shows a graph 100 showing a change over time of an electroencephalogram signal (for example, an electroencephalogram signal of at least one of a delta wave, theta wave, an alpha wave, a beta wave, or a gamma wave), The horizontal axis indicates the passage of time, and the vertical axis indicates the intensity of the electroencephalogram signal.

The brain wave of the user 3 in contact with the output image 200 output from the image output unit 50 and / or the sound output from the audio output unit 52 (for example, music or sound corresponding to the output image 200 output from the image output unit 50). After the user 3 unconsciously, when the output image 200 and / or the sound is output, or after a certain amount of time has elapsed from the time when the output image 200 and / or the sound is output (or during the process). Then, a change corresponding to the output image 200 and / or the output sound occurs (or keeps changing). For example, as shown in FIG. 1B, the intensity of the electroencephalogram signal at time t ₀ when the output image 200 is provided shows a characteristic change at time t ₁ after a predetermined time has elapsed from time t ₀ , and time t in the period from ₀ to time t _1, a change below the intensity X of the intensity of the brain wave signal is predetermined occurred.

In this case, the feature amount calculation unit calculates the strength of the electroencephalogram signal in real time as the feature amount of the electroencephalogram signal. Then, the content processing unit performs a predetermined change process on the output image 200 based on the intensity of the electroencephalogram signal calculated by the feature amount calculation unit. As an example, when the intensity of the electroencephalogram signal is equal to or less than a predetermined intensity X, the content processing unit executes a process of changing the color of the object in the output image to the first color, and the intensity of the electroencephalogram signal is determined in advance. If the intensity is greater than or equal to Y (provided that X <Y is satisfied), a process of changing the color of the object to a second color different from the first color is executed. At time t _1, the intensity of the brain wave signal is below the intensity X, the content processing unit executes a process of changing the color of the object 500 included in the output image 200 to the first color, the object 500 An object 500a whose color is changed to the first color is generated. Then, the image output unit 50 outputs an output image 205 including the object 500a (see (c-2) in FIG. 1C). Note that the content processing unit performs the process of changing the object from the original color to the first color or the second color, from the original color to the first color, or from the original color to the second color. It is possible to execute a color switching process such as a process that gradually changes to or a process that changes discontinuously. Similarly, the content processing unit performs a process of gradually changing the color or a discontinuity with respect to the change from the first color to the second color and / or the change from the second color to the first color. The process to change to can be executed.

Then, the brain wave signal of the user 3 in contact with the output image 205 changes again by contacting the output image 205. For example, as shown in FIG. 1 (b), the time _{t 2} (provided _that, t 1 _{<t 2)} the intensity of the EEG signal in is showed specific changes at time _{t 2,} from time _{t 0} to time _{t 2} Assume that a change occurs in which the intensity of the electroencephalogram signal exceeds a predetermined intensity Y. In this case, the feature amount calculation unit calculates the intensity of the electroencephalogram signal in real time, and the content processing unit performs a predetermined change process on the output image 205 based on the calculated intensity of the electroencephalogram signal. As an example, the content processing unit, the strength of the EEG signal at time t ₂ is a predetermined intensity Y above, changing the color of the object 500a from the first color to a second color, generating the object 500b . Then, the image output unit 50 outputs the output image 210 including the object 500b to the user 3 (see (c-3) in FIG. 1C). The head mounted display 5 as the content providing system 1 repeats the above process.

  As described above, the content providing system 1 according to the present embodiment presents content (hereinafter referred to as “first content”) to the user, and changes the user's life activity or the user's life activity by contacting the first content. Biological information indicating a life state is detected. The content providing system 1 performs a predetermined change process on the first content based on the feature amount of the biological signal corresponding to the detected biological information. Then, the content providing system 1 outputs the content subjected to the change process (hereinafter referred to as “second content”) instead of the first content. When the content providing system 1 changes the content to be presented to the user from the first content to the second content, the content providing system 1 continuously changes from the first content to the second content, or stepwise or discontinuous. Can be changed.

  Here, the life activity or life state of the user in contact with the content changes from the life activity or life state before the user himself / herself unintentionally contacts the content (regardless of whether the user is in an awake state or not) It is considered that the content that is output to the user causes the user's life activity or life state to change unconsciously. That is, the life activity or life state of the user in contact with the first content changes from the life activity or life state before contacting the first content even if the user is unconscious. The content providing system 1 detects the changed biological information of the user in real time, and performs a predetermined change process on the content data of the first content on the basis of the feature amount of the biological signal based on the biological information. Content data is generated, and the second content based on the generated content data is output to the user. Then, the content providing system 1 repeats this process. In other words, the content providing system 1 continues to change the content to be output to the user by recursively executing the above process.

  In this way, the content providing system 1 performs a change process on the content in real time and changes the content after the change process in response to a change in the biological information of the user caused by providing the content to the user. Present it to the user again. That is, the content providing system 1 detects the biometric information of the user, performs a change process on the content based on the detected biometric information, and again detects the biometric information of the user that has changed by touching the changed content. Then, the process of further applying the change process to the content is repeated regardless of whether or not the user intends to change the content. Thereby, according to the content provision system 1 which concerns on this Embodiment, a user's state (a mental state etc.) is a calming state, an excited state, a relaxing state, a state maintained at the present state, a meditation state, sleep It is possible to automatically transition to various states such as a state without the user being conscious. In other words, according to the content providing system 1, the user can passively change his / her state.

(Details of content providing system 1)
FIG. 2 shows an example of a functional configuration of the content providing system according to the embodiment of the present invention.

  The content providing system 1 includes a biological sensor 10 that generates a biological signal corresponding to the biological information of the user 3, a biological signal acquisition unit 12 that acquires the biological signal, and a feature amount calculation unit 14 that calculates a feature amount of the biological signal. A content storage unit 16 for storing content data, a content processing unit 18 for performing change processing on at least a part of the content data, and a content output unit 20 for outputting content based on the content data subjected to the change processing. Prepare. Note that at least one member of the biosignal acquisition unit 12, the feature amount calculation unit 14, the content storage unit 16, and the content processing unit 18 may exist on an external information processing apparatus or cloud.

(Biosensor 10)
The biological sensor 10 detects biological information indicating the life activity or life state of the user 3 and generates a biological signal corresponding to the biological information. The biometric sensor 10 can also detect biometric information of the user 3 that changes in real time in real time and generate a biometric signal in real time. Here, the biological information indicating the life activity or the life state is information relating to a state generated in association with the physical activity or the mental activity carried out for maintaining the life of the user 3. For example, biological information includes brain wave information, pulse wave information, heart rate information, pulse information, sweating information, body temperature information, respiratory activity information, blood pressure information, blood flow velocity information, blood flow information, blood oxygen concentration information, myoelectric information , Electrooculogram information, information indicating the degree of pupil opening, eye movement information, voice information, scent information (information about the scent emitted from the user himself), and gesture information which is information indicating the body movement of the user 3 At least one piece of information selected from the group consisting of, and the like. Then, the biosensor 10 detects the brain wave, pulse wave, heart rate, pulse rate, sweating, body temperature, respiratory activity, blood pressure, blood flow rate, blood flow rate, blood oxygen concentration, myoelectricity, ocular potential, and pupil opening condition of the user 3. The sensor detects at least one life activity or life state selected from the group consisting of eye movement, voice, smell, gesture, and the like as biological information and generates a biological signal corresponding to the detected biological information.

  Examples of the biosensor 10 include an electroencephalogram sensor, a pulse wave sensor, a heart rate sensor, a sweat meter, a thermometer, a respiratory sensor, a blood pressure meter, a blood flow sensor (blood flow meter), a blood oximeter (pulse oximeter), a muscle And at least one sensor selected from the group consisting of an electrical sensor, an electrooculogram sensor, a pupil sensor, a line-of-sight sensor, a voice detection sensor, an odor sensor, and a gesture sensor including an imaging unit, a depth sensor, and a multi-array microphone. . Note that the gesture sensor may further include an acceleration sensor and / or a gyro sensor. The biological sensor 10 supplies the generated biological signal to the biological signal acquisition unit 12.

(Biological signal acquisition unit 12)
The biological signal acquisition unit 12 acquires the biological signal generated by the biological sensor 10. The biological signal acquisition unit 12 can continuously acquire biological signals. The biological signal acquisition unit 12 can also acquire a biological signal at a predetermined sampling interval from the viewpoint of reducing the processing burden. The biological signal acquisition unit 12 is a noise removal process that removes noise from the biological signal, a prediction process that estimates the value of the biological signal in terms of time, an orthogonal transformation process that performs temporal frequency analysis, and / or a predetermined value. The biological signal may be subjected to signal processing such as filter processing for extracting or removing the frequency component. The biological signal acquisition unit 12 supplies the acquired biological signal to the feature amount calculation unit 14.

(Feature amount calculation unit 14)
The feature quantity calculation unit 14 analyzes the biological signal and calculates the feature quantity of the biological signal. The feature amount calculation unit 14 can also calculate the feature amount in real time. Moreover, the feature-value calculation part 14 can also estimate the physical state and mental state of the user 3 by analyzing a biological signal. Here, the feature amount is data that characterizes the biological signal, and includes, for example, the magnitude of the biological signal, the maximum value of the biological signal, the minimum value of the biological signal, and the average value of the biological signal (for example, within a predetermined period). The time average value of the magnitude and intensity of the acquired biological signal, etc.), the variance value of the biological signal, the differential value of the biological signal, the amount based on the temporal change of the biological signal, and the like.

  The amount based on the temporal change of the biological signal is, for example, the number of detections of the biological signal within a predetermined period (for example, pulse), the value of the rate of change of the biological signal within the predetermined period, and the biological signal within the predetermined period. The rate of change, the time required for the signal intensity of a biological signal acquired within a predetermined period to be 1 / n (where n is a numerical value of 1 or more) (for example, half-life), acquired within a predetermined period Until the time required for the signal strength of the biological signal to be n times (where n is a numerical value of 1 or more), the signal strength, magnitude, average value, or variance value of the biological signal exceeds a predetermined value. , The time required to reach a predetermined value or less than the predetermined value, the time during which the signal intensity, magnitude, average value, variance value, etc. of the biological signal is maintained within a predetermined range Etc.

  For example, when the biological signal is an electroencephalogram signal, the feature amount calculation unit 14 calculates the signal intensity of at least one electroencephalogram of delta waves, theta waves, alpha waves, beta waves, and gamma waves in real time, The signal intensity of the electroencephalogram is calculated as a feature amount. For example, when the biological signal is a heartbeat signal, the feature amount calculation unit 14 can calculate the number of heartbeats per unit time as the feature amount. The feature amount calculation unit 14 supplies the calculated feature amount and / or the estimation result of the physical state and mental state of the user 3 to the content processing unit 18.

(Content storage unit 16)
The content storage unit 16 stores content data. The content data includes at least one data among image data (still image data and / or moving image data), audio data, tactile data, olfactory data, and / or taste data. Here, the content based on the content data is the content defined by the content data, and the content that can be perceived by the user 3 and / or cannot be substantially perceived by the five senses of the user 3, but physically exists. Content to be listed.

  For example, the contents include visual contents (for example, still images, moving images, light (including visible light and / or light other than visible light such as infrared light and ultraviolet light)), auditory content (for example, human Examples include audible sound, sound outside human audible range), tactile content, olfactory content, and taste content. The visual content can be experienced by the user 3 by outputting an image or light from the content output unit 20 (for example, a monitor), and the audio content is output from the content output unit 20 (for example, a speaker). By doing so, the user 3 can be experienced.

  The tactile content can cause the user 3 to experience the tactile sensation by using, for example, a haptic device that applies haptics as the content output unit 20 that applies pressure, vibration, movement, etc. to the body of the user 3. In addition, the olfactory content can cause the user 3 to experience the odor and fragrance by using, for example, the fragrance generating device as the content output unit 20 that generates the odor and fragrance. Furthermore, the taste content can cause the user 3 to experience the taste by using, for example, a device that makes the user 3 feel the predetermined taste by applying electrical stimulation or the like to the miso of the user 3.

  The content may include at least one element that can be perceived by the user 3. In this case, the content can be perceived by the user 3. Here, the elements include color (including hue, brightness, and / or saturation), image (including objects included in the image), sound (sound within the human audible range, and sound outside the audible range). ), Odor, vibration, light (including visible light and light other than visible light), touch, and taste. For example, an image (still image or moving image) as visual content has elements such as an object and background color and / or light illuminated by the object and background in addition to the image. Composed. Further, as the content, at least two contents selected from the group consisting of visual content, auditory content, tactile content, olfactory content, and taste content can be combined.

  The tactile data stored in the content storage unit 16 is, for example, program data that drives a tactile device, and includes program data that defines the pressure, vibration, movement, and the like applied to the body of the user 3. Based on the program data, the tactile device is driven, and predetermined pressure, vibration, movement, and the like are applied to the body of the user 3. The olfactory data stored in the content storage unit 16 includes identification data for identifying a chemical substance constituting an odor released from the fragrance generating device, data indicating the timing for releasing the odor and / or the duration for releasing the odor. Etc. Furthermore, as taste data, the data which show the electric current value of the electrical stimulation given to the user's 3 miso, the voltage value, the duration which gives a stimulus, etc. are mentioned.

  The content storage unit 16 supplies the stored content data to the content processing unit 18 and / or the content output unit 20 in response to an action from the content processing unit 18 and / or the content output unit 20.

(Content processing unit 18)
The content processing unit 18 performs a change process on at least a part of the content data stored in the content storage unit 16 based on the feature amount calculated by the feature amount calculation unit 14. The content processing unit 18 performs a change process on the content data so that the property and / or amount of at least one element constituting the content is changed. In addition, the content processing unit 18 can also perform a change process in real time on at least a part of the content data based on the feature amount calculated in real time by the feature amount calculation unit 14. The content processing unit 18 may perform a change process on the content data based on a predetermined standard according to the type of content. Examples of the predetermined standard include a standard whose feature value is equal to or greater than a predetermined value, a standard that is less than a predetermined value, a standard that is within a predetermined value range, and a predetermined standard. Is at least one criterion selected from the group consisting of criteria that are outside the range of values. In addition, the content processing unit 18 performs a change process associated with each of various human states in advance based on the feature amount for the purpose of generating content in which the user 3 can objectively view his / her state. May be applied to data.

  Specifically, the content processing unit 18 emphasizes or maintains the current components such as color, image, sound, smell, vibration, light, touch, and / or taste. The content data is subjected to change processing so as to be weakened, changed to a different property and / or amount, or output from the content output unit 20 at a predetermined timing.

  For example, when the feature amount is the intensity of the electroencephalogram signal, the content processing unit 18 determines the criterion that the intensity of the electroencephalogram signal satisfies a predetermined intensity value or more, the criterion that satisfies the predetermined intensity value or less, A standard in which the average value of the intensity of the electroencephalogram signal within the time is greater than or less than a predetermined value, and a standard in which the rate of change in the intensity of the electroencephalogram signal within the predetermined time is greater than or less than the predetermined rate The change process is executed based on various criteria.

  As an example, the content processing unit 18 changes the content data so that the color, which is an element constituting the visual content, is changed according to the intensity of the electroencephalogram signal as the feature amount (that is, the elements have different properties). Can be modified. That is, the content processing unit 18 sets the color of visual content (for example, a still image or an object included in the still image) to the first color when the intensity of the electroencephalogram signal as the feature amount is equal to or higher than a predetermined first intensity value. When a change process for changing to one color (for example, red) is executed, and the intensity of the electroencephalogram signal is equal to or lower than a predetermined second intensity value (where the first intensity value> the second intensity value), A change process for changing the color of the visual content to the second color (for example, blue) can be executed.

  In addition, when the feature amount indicates an intensity value between the first intensity value and the second intensity value, the content processing unit 18 selects a color interpolated between the first color and the second color. It can be used to change the visual content. In other words, the content processing unit 18 generates a color that is linearly interpolated using the first color and the second color when the feature amount is a value between the first intensity value and the second intensity value. Then, the visual content is changed using the generated color. The content processing unit 18 changes the first color or the second color when changing the color of the visual content from the first color to the second color, or when changing the color from the second color to the first color. When changing from one color to another, and when changing from another color to the first color or the second color, the transition from the color before the change to the color after the change is gradually changed using the interpolation color. In addition, the color before the change can be discontinuously changed to the color after the change without using the interpolation color.

  In addition, when the feature amount correlates with the mental state of the user 3, the content processing unit 18 can perform a change process on the content data so that the content changes the mental state of the user 3 or maintains the current state. As an example, a case where the feature amount is the intensity of an electroencephalogram signal will be described. First, the content processing unit 18 specifies the state of the user 3 based on the estimation result of the physical state or mental state of the user 3 in the feature amount calculation unit 14. For example, the content processing unit 18 specifies whether the user 3 is in a normal state, in a relaxed state, in a tense state, in an awake state, in a sleep state, or the like. Then, the content processing unit 18 determines each state to be deeper, keeps each state as it is, suppresses each state, or randomly changes the state, and performs a change process on the content data. be able to.

  For example, the content processing unit 18 is configured so that the feature amount at the time when the mental state of the user 3 is specified becomes large after touching the content based on the content data subjected to the change processing, or the current state is maintained. Alternatively, the change processing may be performed on the content data so as to be smaller. In this case, it is preferable that the influence of the increase / decrease of the feature amount on the human mental state is grasped in advance. It is preferable that the influence of the content element (for example, color) on the human mental state is grasped in advance.

  That is, a correlation is recognized between the intensity of an alpha wave as a feature quantity, for example, an electroencephalogram signal, and a human relaxed state. In addition, a certain correlation is recognized between the color and the mental state of the human being in contact with the color. Therefore, the content processing unit 18 changes the color of the content to a color that improves the relaxed state when the mental state of the user 3 is more relaxed, and changes the color of the content when the mental state is maintained as it is. When changing to a color that does not substantially affect the mental state, or to keep the current color and make it tense, the purpose is to change the color of the content to a color that improves the tense state, A change process can be applied to the content data. The content processing unit 18 supplies the content data subjected to the change process to the content output unit 20.

(Content output unit 20)
The content output unit 20 outputs a content based on the content data subjected to the change process in the content processing unit 18 to the user. The content output unit 20 includes, for example, an image output unit that outputs an image (still image and / or moving image), an audio output unit that outputs sound, a tactile device that allows the user 3 to experience a tactile sensation, and a fragrance that emits scents and aroma It is configured to have at least one component selected from the group consisting of a generator and a device for applying electrical stimulation to the unsettled state. The content output unit 20 can also output at least part of the content in the augmented reality space or the virtual reality space. For example, when the content providing system 1 is configured in the form of the head mounted display 5, the content can be perceived by the user 3 in the augmented reality space or the virtual reality space using the head mounted display 5. The content output unit 20 outputs the content to the user 3 in the augmented reality space or the virtual reality space, so that an effect of improving the immersive feeling of the user 3 is expected.

  The content providing system 1 according to the present embodiment includes a therapy (for example, color therapy) such as physical therapy and psychotherapy, rehabilitation, game, sports training, news report, education, travel, amusement park, social networking, and / or user's It can be applied to creative expression of thought or emotion. The content providing system 1 is not limited to the head mounted display 5 that provides an augmented reality space or a virtual reality space, but also an amusement device used in a wider space, an information terminal such as a mobile phone or a smartphone, a personal computer, and the like. It can also be applied to information processing terminals.

(Outline of the processing flow of the content providing system 1)
FIG. 3 shows an example of the flow of processing in the content providing system according to the embodiment of the present invention.

  First, the biometric sensor 10 detects the biometric information of the user 3 (step 10; hereinafter, step is represented as “S”). The biological sensor 10 generates a biological signal corresponding to the detected biological information (S12). The biological sensor 10 supplies the generated biological signal to the biological signal acquisition unit 12. The biological signal acquisition unit 12 acquires a biological signal from the biological sensor 10 (S14). The biological signal acquisition unit 12 supplies the acquired biological signal to the feature amount calculation unit 14.

  The feature amount calculation unit 14 analyzes the biological signal received from the biological signal acquisition unit 12 and calculates the feature amount of the biological signal (S16). The feature amount calculation unit 14 supplies the calculated feature amount to the content processing unit 18. The content processing unit 18 performs a change process on at least a part of the content data based on the feature amount received from the feature amount calculation unit 14 (S18). The content processing unit 18 supplies the content data subjected to the change process to the content output unit 20. The content output unit 20 outputs content based on the content data on which the change process has been performed (S20).

  Since the biometric sensor 10 continues to detect the biometric information of the user 3, the biometric information of the user 3 in contact with the content based on the content data subjected to the change process is also continuously detected (S10). Subsequently, in the same manner as described above, the feature amount calculation unit 14 analyzes the biometric signal of the user 3 in contact with the content based on the content data subjected to the change process, and determines the feature amount of the biometric signal as the second amount. (S16). In the same manner as described above, the content processing unit 18 further performs a predetermined change process on at least a part of the content data subjected to the change process based on the second feature amount (S18). The content output unit 20 outputs content based on the content data that has been further changed (S20).

  As described above, the content providing system 1 according to the present embodiment repeatedly executes the process of recursively changing the content data based on the feature amount of the biological signal corresponding to the biological information that the user 3 changes.

  FIG. 4 shows an example of a hardware configuration of the content providing system according to the embodiment of the present invention.

  The content providing system 1 according to the present embodiment includes a CPU 1500, a graphic controller 1520, a random access memory (RAM), a memory 1530 such as a read-only memory (ROM) and / or a flash ROM, and a storage device 1540 for storing data. A reading / writing device 1545 for reading data from and / or writing data to a recording medium, an input device 1560 for inputting data, a communication interface 1550 for transmitting / receiving data to / from an external communication device, a CPU 1500 and a graphic controller 1520, a memory 1530, a storage device 1540, a read / write device 1545, an input device 1560, and a communication interface 1550 are communicably connected to each other. And a 510. Note that the constituent elements such as the CPU 1500 are one or more CPUs, and may include a plurality of CPUs.

  The chip set 1510 includes a memory 1530, a CPU 1500 that accesses the memory 1530 and executes predetermined processing, and a graphic controller 1520 that controls display on an external display device. Perform data passing. The CPU 1500 operates based on a program stored in the memory 1530 and controls each component. The graphic controller 1520 displays an image on a predetermined display device based on the image data temporarily stored on the buffer provided in the memory 1530.

  The chip set 1510 connects a storage device 1540, a read / write device 1545, and a communication interface 1550. The storage device 1540 stores programs and data used by the CPU 1500 of the content providing system 1. The storage device 1540 is, for example, a flash memory. The read / write device 1545 reads the program and / or data from the storage medium storing the program and / or data, and stores the read program and / or data in the storage device 1540. For example, the read / write device 1545 acquires a predetermined program from an information processing device such as a server on the Internet via the communication interface 1550 and stores the acquired program in the storage device 1540.

  The communication interface 1550 executes data transmission / reception with an external device via a communication network. Further, when the communication network is disconnected, the communication interface 1550 can execute data transmission / reception with an external device without going through the communication network. An input device 1560 such as a tablet or a microphone is connected to the chipset 1510 via a predetermined interface.

  The program for the content providing system 1 stored in the storage device 1540 is provided to the storage device 1540 via a communication network such as the Internet or a recording medium such as a magnetic recording medium or an optical recording medium. Then, the program for the content providing system 1 stored in the storage device 1540 is executed by the CPU 1500. Note that the program for the content providing system 1 can be installed in the computer by using the recording medium. The recording medium storing the program may be a non-transitory recording medium such as a CD-ROM or DVD. That is, the program for the content providing system 1 according to the present embodiment can be stored in a non-transitory recording medium.

  The program for the content providing system 1 executed by the content providing system 1 works on the CPU 1500 to describe the content providing system 1 with the biosensor 10, the biosignal acquisition unit 12, and the feature amount calculation unit described with reference to FIGS. 1 to 3. 14, function as a content storage unit 16, a content processing unit 18, and a content output unit 20.

(Effect of embodiment)
The content providing system 1 according to the present embodiment can change the content of the content provided to the user 3 based on the feature amount obtained by analyzing the biological signal of the user 3. The content providing system 1 can continue to automatically provide content that changes or maintains the state of the user 3 even when the user 3 is substantially unconscious. Then, the content providing system 1 can further change the content of the content and provide it to the user 3 based on the feature amount obtained by analyzing the biological signal of the user 3 in contact with the changed content. Thereby, the content provision system 1 can recursively change the content of the content based on the feature amount obtained by continuously analyzing the biological signal of the user 3. Therefore, according to the content providing system 1, it becomes easy for the user 3 to guide the state such as the mental state of the user 3 to a predetermined state unconsciously.

  In other words, the content providing system 1 keeps the user 3 in a natural state without being aware of the presence of the content providing system 1, that is, the user 3 is aware that his / her physical state and mental state change. Without doing so, the physical state and mental state of the user 3 can be changed. That is, the content providing system 1 can passively change the physical state and mental state of the user 3 for the user 3.

  Further, according to the content providing system 1 according to the present embodiment, the user 3 can perceive the content output from the content output unit 20 so that his / her physical condition and mental condition can be objectively viewed. For example, when the content output from the content output unit 20 is content corresponding to a tension state (for example, when the content element is a color, at least a part of the content has red as a color corresponding to the tension state) The user 3 can grasp his / her state by touching the output content. And a change arises in the state (physical state or mental state) of the user 3 who has grasped his / her state. In response to this change, the content providing system 1 can change the content to be output to the user 3 (for example, the color of the content is changed), so that the user 3 desires his / her state (for example, It is possible to easily change the state to a state preferable for itself such as a relaxed state, or a more tensioned state.

  While the embodiments of the present invention have been described above, the embodiments described above do not limit the invention according to the claims. In addition, it should be noted that not all combinations of features described in the embodiments are necessarily essential to the means for solving the problems of the invention. Furthermore, the technical elements of the above-described embodiments may be applied independently, or may be applied by being divided into a plurality of parts such as program parts and hardware parts.

DESCRIPTION OF SYMBOLS 1 Content provision system 3 User 5 Head mounted display 10 Biosensor 12 Biosignal acquisition part 14 Feature-value calculation part 16 Content storage part 18 Content processing part 20 Content output part 50 Image output part 52 Audio | voice output part 54 EEG sensor 100 Graph 200, 205, 210 Output image 500, 500a, 500b Object 1500 CPU
1510 chip set 1520 graphic controller 1530 memory 1540 storage device 1545 read / write device 1550 communication interface 1560 input device

Claims (7)

A biological sensor that detects biological information indicating the life activity or life state of the user and generates a biological signal corresponding to the biological information;
A feature amount calculation unit that analyzes the biological signal and calculates a feature amount of the biological signal;
A content processing unit that performs a change process on at least a part of the content data based on the feature amount;
A content providing system comprising: a content output unit that outputs content based on the content data subjected to the change process to the user.   The content providing system according to claim 1, wherein the content output unit outputs at least a part of the content in an augmented reality space or a virtual reality space. The biometric sensor detects the biometric information of the user in contact with the content based on the content data subjected to the change process, and generates the biometric signal corresponding to the biometric information;
The feature amount calculation unit analyzes the biosignal of the user in contact with the content based on the content data subjected to the change process, and calculates a feature amount of the biosignal as a second feature amount. ,
The content providing system according to claim 1, wherein the content processing unit further performs a change process on at least a part of the content data on which the change process has been performed based on the second feature amount. The biological sensor detects the biological information that changes in real time and generates the biological signal in real time;
The feature amount calculation unit calculates the feature amount of the biological signal in real time,
The content providing system according to any one of claims 1 to 3, wherein the content processing unit performs the change processing on at least a part of the content data in real time based on the feature amount calculated in real time. The content comprises at least one element perceivable by the user;
5. The content providing system according to claim 1, wherein the content processing unit performs the change process on the content data so that a property and / or amount of the at least one element is changed. A feature amount calculating step of detecting biological information indicating a life activity or life state of a user, analyzing the biological signal from a biological sensor that generates a biological signal corresponding to the biological information, and calculating a feature amount of the biological signal. When,
A content processing step of performing a change process on at least a part of the content based on the feature amount;
And a content output step of outputting the content subjected to the change process to the user. A program for a content providing system,
On the computer,
A feature amount calculation function for detecting biological information indicating a biological activity or life state of a user, analyzing the biological signal from a biological sensor that generates a biological signal corresponding to the biological information, and calculating a feature amount of the biological signal When,
A content processing function for performing a change process on at least a part of the content based on the feature amount;
A program for a content providing system that realizes a content output function for outputting the content subjected to the change process to the user.