JP2005032167A - Apparatus, method, and system for information retrieval, client device, and server device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To retrieve and recommend appropriate contents for every user corresponding to the state of feelings or the change of the state of feelings for every user. <P>SOLUTION: One or more kinds of biometric information for a user are detected by a recording apparatus 11 and analyzed by a feeling information analysis part in the recording apparatus 11, so that the state of feelings for the user, which is a supply origin of the biometric information, is analyzed. Based on the analysis results or the state of feelings for the user, a CPU 31 and a contents recommendation processing part 24 cooperate and retrieve contents suitable for the user from a contents information database 22 or through a communication part 21 to notify them to the user through a user interface 33. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an apparatus, method, and system for searching and providing information in response to a request from a user, for example.

  For example, content (books) that users would like to purchase in consideration of prior input information such as past purchase history and information on user (buyer) preferences, such as online shops offered through the Internet Information on CDs (Compact Discs) on which movies, music data, etc. are recorded, event tickets, etc.) is provided, and services for assisting the purchase of contents, tickets, etc. are provided.

  In this case, since the experience effect (satisfaction level, comfort level, etc.) of the content after purchase is not reflected, the recommended service including the purchase history of the content that has been dissatisfied in the past is implemented. In other words, even if a book purchased through online shopping is not very interesting, its purchase history will remain, and based on the purchase history, books of unfavorable genres and books of unfavorable authors may be recommended. .

  Also, the user's preference for content is not always the same, and may change depending on the mood and physical condition of the day. However, it is cumbersome to input information about one's preferences every time when receiving the recommended content service as described above, and the user himself / herself accurately grasps his / her physical condition and mood. It is difficult to input information corresponding to this as pre-input information.

  In view of this, it is considered to provide a content recommendation service using objective information that is different for each user, regardless of only history information or pre-input information. For example, Patent Document 1 (Japanese Patent Application Laid-Open No. 2002-222209) proposes a method using a user's emotion rhythm value.

  In the method described in Patent Document 1, the rental content is preliminarily examined and classified as to which emotional stimuli among emotions are included, and from each rental period of each classified content, The period of emotion is expressed by a sine wave function, each emotion rhythm value of the user is obtained based on the sine wave function, the user's date of birth data and gender data, and the user is obtained based on the emotion rhythm value. It recommends content that is suitable for the content.

  By using the method described in Patent Document 1, content recommendation can be performed based on objective information obtained for each user, such as the user's emotion rhythm, regardless of only history information or pre-input information. The information for recommending the content is provided to the user based on the new standard, and a new value can be added to the service itself recommending the content.

The patent documents mentioned above are as follows.
JP 2002-222209 A

  By the way, as described above, in the case of the method described in Patent Document 1, the user's emotion rhythm value is obtained based on the rental period of the rental content classified in advance, the user's date of birth, and gender. The rental cycle of rental content is affected by the number and types of rental content, customer segments, and the like. For this reason, when content is recommended using the user's emotion rhythm value obtained by using the rental period of rental content as a reference, the credibility of information provided to the user may be a problem. It is done.

  Therefore, it is possible to accurately analyze the emotional state of each user without using history information, prior input information, or other external information that is not information from the user, and to recommend appropriate content for each user. It is desired to be able to find the target content quickly and accurately.

  In view of the above, the present invention enables not only history information and pre-input information but also search and recommendation of appropriate content for each user according to the emotional state for each user or the change in emotional state. An object of the present invention is to provide an apparatus, a method, and a system.

In order to solve the above-described problem, an information search apparatus according to the invention described in claim 1
Detecting means for detecting one or more types of biological information from the user;
Analysis means for analyzing the emotional state of the user from one or more types of biological information detected by the detection means;
Search means for searching for recommended content for the user based on the analysis result by the analysis means;
Notification means for notifying the search result in the search means.

  According to the information retrieval apparatus of the first aspect, the detection unit detects one or more types of biological information of the user, which is analyzed by the analysis unit, and the emotional state of the user who is the supply source of the biological information is determined. Analyzed. Based on the analysis result of the analysis means, that is, according to the emotional state of the user, the search means searches for content recommended for the user, and the search result is notified to the user through the notification means.

  As a result, the user's own emotional state that is difficult for the user to recognize objectively is automatically analyzed from his / her own biological information, and the user's emotional state is determined according to the analysis result. Searched content is retrieved and recommended. That is, content search and recommendation based on the emotional state of the user are realized.

  Therefore, the user can receive the recommendation of the searched content according to his / her emotional state from among a large number of contents. Then, the user can select a favorite content from the recommended content and experience (use) it.

  According to the present invention, it is possible to obtain user emotion information by analyzing the biological information of the user, and to use this emotion information to recommend content that matches the individuality to the user. In other words, without analyzing the user's emotional state or performing complicated operations, the user's emotional state is automatically analyzed, and content suitable for the user is determined according to the analysis result. Be able to make recommendations.

  Therefore, when viewed from the user side, his / her emotional state is objectively grasped, and the content search / recommendation service more suitable for himself / herself can be received in consideration of the grasped emotional state. .

  Hereinafter, an embodiment of an apparatus, method, and system according to the present invention will be described with reference to the drawings.

The following embodiments will be described in the following order.
1: First embodiment (about content recommendation device)
1-1: Overview of content recommendation device 1-2: Configuration of recording device unit 11
1-3: An example of emotion analysis in the emotion analysis processing unit 120
1-4: Outline of operation of content recommendation device
1-5: Specific examples of content recommendations
1-6: Operation during content experience (use)
1-7: Summary of operation of content recommendation device
2: Second embodiment (about content search recommendation system)
2-1: Overview of content search recommendation system 2-2: About client terminal 1 2-3: About server device 2
2-4: Operation of content search recommendation system 3: Others

[1: First embodiment (about content recommendation device)]
[1-1: Overview of content recommendation device]
First, a content recommendation device to which an embodiment of an information search device and an information search method according to the present invention is applied will be described. FIG. 1 is a block diagram for explaining a content recommendation device according to this embodiment. The content recommendation device of this embodiment is a device used by a general user (end user). The content recommendation device is provided with a schedule book function that receives input of schedule information from the user and manages this.

  In addition, as will be described in detail later, the content recommendation device continuously detects and accumulates various biological information such as the user's body temperature and pulse, and based on the accumulated biological information, the user's emotional state is detected. It can be analyzed. Then, when the user inputs a content usage schedule on a target date, the content recommendation device according to this embodiment searches the content appropriate for the user in consideration of the emotional state, and sends this to the user. It can be recommended.

  In other words, the content recommendation device according to this embodiment is an information search device having a schedule book function and a content search recommendation function, and is linked to the schedule book function to obtain an appropriate content considering its own emotional state. The search recommendation function is realized. The content recommendation device according to this embodiment is applicable to various information processing devices such as a personal computer, an electronic notebook, and a PDA (Personal Digital Assistants).

  Hereinafter, the content recommendation apparatus of this embodiment will be described in detail. As shown in FIG. 1, the content recommendation device of this embodiment is configured by connecting an emotion state evaluation processing system 10 and a content search recommendation processing system 20 to a control unit 30. .

  The emotion state evaluation processing system 10 includes a video, audio, biological information and emotion recording device unit (hereinafter simply referred to as a recording device unit) 11, a composite information database 12, and a schedule base application unit 13. The content search recommendation processing system 20 includes a communication unit 21, a content information database 22, a user information database 23, and a content recommendation processing unit 24.

  The control unit 30 controls each unit of the content recommendation device according to this embodiment, and includes a CPU (Central Processing Unit) 31, a memory unit 32, and a user interface (hereinafter abbreviated as user I / F) 33. Are connected through the system bus 34.

  Although not shown, the memory unit 32 of the control unit 30 stores a program (ROM) and data necessary for processing, a ROM (Read Only Memory), and a RAM (Random Access Memory) used as a work area (work area) in various processes. ) Etc. The user I / F 33 of the control unit 30 includes an information receiving unit including a key operation unit and a pointing device that receives an instruction input and various information inputs from a user, a display element such as an LCD (Liquid Crystal Display), and a speaker. And the information providing department.

  Then, the recording device unit 11 of the emotion state evaluation processing system 10 detects the biometric information of the user of the content recommendation device, records it on a predetermined recording medium, and based on the recorded biometric information, the user's biometric information. The emotional state is analyzed, and the analysis result is also recorded on a predetermined recording medium. Here, the emotional state of the user obtained by analyzing the biometric information is used when searching for content suitable for the user of the content recommendation device and recommending it, as will be described in detail later. .

  The recording device unit 11 can be attached to and detached from the main body portion of the content recommendation device according to this embodiment, and the user removes the recording device unit 11 from the content recommendation device, for example, a jacket pocket. It can be easily carried around by putting it in. Thus, the user of the content recommendation device can always detect and store his / her biological information through the recording device unit 11.

  The biometric information detected by the recording device unit 11 and the analysis result of the emotional state are managed in cooperation with the recording unit included in the recording device unit 11 and the composite information database 12 of the content recommendation device, as will be described later. Like to do. The recording unit of the recording unit 11 and the composite information database 12 can be realized by various recording devices. In this embodiment, for example, the recording unit 11 is realized by a hard disk drive.

  As will be described later, the recording unit included in the recording device unit 11 records and holds actual data that is analysis information of biological information and emotional state, and the composite information database 12 stores biological information and emotional state. The so-called index information of the analysis information is stored and held.

  That is, as shown in FIG. 2A, for example, information such as a composite information ID, title, date, time, and data reference destination is registered in the composite information database 12. Here, the composite information ID is a unique identifier assigned to a data file recorded and stored by the recording device unit 11. The title represents the title (name) of the data file, and is used, for example, when the content of data is shown to the user during reproduction.

  The date represents the date when the recording device unit 11 started recording. The time represents the time when the recording device unit 11 starts recording data. Regarding the date and time, if they are described in the data file, their values can be used. The data reference destination represents a reference destination (for example, a file name) of the data file recorded and accumulated in the recording device unit 11.

  The index information (composite information) for the biometric information accumulated while the recording device unit 11 is removed from the content recommendation device is, for example, content when the recording device unit 11 is attached to the content recommendation device. The composite information database 12 is formed by the function of the control unit 30 of the recommended device 1.

  On the other hand, the file format of the data recorded in the storage unit of the recording device unit 11 may have various modes. For example, video, audio, time stamp, multiple biological signals (for example, electroencephalogram, myoelectricity, heart rate, pulse Wave (pulse), etc.), position (position where the recording device unit 11 is used), weather, etc. in a synchronized format, that is, information acquired at the same time is related to the acquisition time. Is recorded in a state that is maintained.

  As described above, the recording device unit 11 and the composite information database 12 can manage the biological information detected from the user and the emotional state analyzed according to the biological information. Furthermore, information such as position and weather can be managed in association with each other.

  In FIG. 1, the schedule-based application unit 13 of the emotional state evaluation processing system 10 performs so-called transaction processing, in a manner linked with the schedule book function, to the user of the content recommendation device of this embodiment. This is the part that realizes providing recommended functions for content.

  In this embodiment, the schedule-based application unit 13 manages recommended content in accordance with a process for managing an input schedule in accordance with an instruction input from a user and a processing result of a content recommendation processing unit 24 described later. Is provided with a processing unit 131 that performs processing for notifying the user and a storage unit 132 that stores parameters necessary for processing such as the user's biological information and emotion information.

  Note that the function of the processing unit 131 can be realized, for example, by executing a program recorded in the ROM 32 in the CPU 31. That is, the function of the processing unit 131 can be realized by software executed in the control unit 30. The storage unit 132 can be configured by a semiconductor memory such as a RAM or an EEPROM (Electrically Erasable and Programmable ROM) or a hard disk.

  Thus, in the content recommendation device of this embodiment, the recording device unit 11, the composite information database 12, and the schedule base application unit 13 measure (detect) biometric information, accumulate biometric information, and biometric information. The processing related to the evaluation of the emotional state, such as the evaluation and grasping of the emotional state, is mainly performed.

  Further, the communication unit 21 of the content recommendation processing system 20 is for connecting to a wide-area communication network such as the Internet and performing communication processing, for example, and the content recommendation device of this embodiment has various types. It is used when collecting information about content.

  In addition, the content information database 22 of the content recommendation processing system 20 stores and holds information on content that can be used by users provided from various information providing organizations, which is received through the communication unit 21, for example. Here, the information provider is responsible for the sales of tickets for stadiums, halls, cinemas, museums, etc. where it is installed or in charge, and the contents provided at those locations. For example, it is realized by a personal computer or the like.

  For example, the latest information is periodically updated in the content information database 22. In the content information database 22, for example, as shown in FIG. 2B, information such as a content ID, an item, the number of stocks, a unit price, a stock period, a valid period, a type, a stock place, a use place, an inquiry status, and sales results are stored. It is registered.

  The content ID in the content information database 22 is a unique identifier assigned to content (for example, an event ticket) and is widely used in common on the Internet. The item represents the name of the content. The inventory quantity represents the inventory quantity of content. The unit price represents the recommended selling price per unit of content. The inventory period represents the recommended inventory period of the content.

  The effective period represents the effective period of the recommended content. The type represents a classification of recommended content. For example, if the recommended content is a ticket, the classification of events (classification of music, tourism, etc.) targeted by the ticket is represented by type. In addition, when the recommended content is a movie, the content classification and content characteristics such as sad content, bright content, and content that can promote relaxation can be expressed.

  The inventory location represents the name of the store in charge, the region in charge, etc. managing the recommended content. The use place represents a place where the recommended content is experienced (for example, when the recommended content is a ticket, an event where an event that can be experienced with the ticket is performed). The inquiry status represents a level (degree of interest) calculated based on how much inquiry is made to the information provider regarding the recommended content. The sales record represents a level (popularity) calculated based on how much the recommended content has been sold since the sales start time.

  In addition, in order to recommend content according to the user's emotional state, information on the evaluation results of the content, such as how each content affects the user's emotion, is evaluated and information indicating the evaluation result of this property It is possible to efficiently search for content by storing and holding the content.

  As described above, the content information database 22 stores and holds the above-described various information about the content that can be used by the user, and is realized by, for example, a hard disk drive. Of course, in addition to the hard disk, it is also possible to use an optical disk or the like. In the case of an optical disk, a CD-ROM in which information related to content is recorded in advance can be used. In addition, by using a recordable optical disc, it is possible to store and hold information regarding external content acquired through the communication unit 21 as in the case of a hard disk.

  The user information database 23 is a part for storing information for so-called session management. In the user information database 23, for example, as shown in FIG. 2C, information such as a user ID, a content ID, a status, the number of purchases, a purchase date, a purchase time, a purchase place, an effective period, and emotion information is registered. The user information area is registered.

  In the user information database 23, the user ID is a unique identifier assigned to the user, and is registered in the storage unit 132 of the schedule base application unit 13, for example. This user ID is not normally required, but is required when, for example, communication is performed through the communication I / F 21. The content ID represents the name of the content that the user wants to recommend and the ID for identifying it.

  The status represents an acceptance state (rejection, hold, confirmation, cancellation) of the recommended content. The number of purchases represents the number of contents purchased by the user. The number of purchases is used, for example, for grasping the purchase unit of the user, providing a return service according to the number of purchases, and the like. The purchase date represents the date when the user purchased the content, and is used, for example, when grasping service usage information according to the user's season.

  The purchase time represents the time (time zone) when the user purchased the content. This purchase time is used for grasping the service usage status according to the user's time zone. The purchase location represents the name of the store in charge, the region in charge, etc. This purchase place is used, for example, for grasping the region classification where the user purchased the content.

  The effective period represents the effective period of the recommended content. This valid period is used to determine the period during which the service accompanying the content is provided. In addition, as described above, the emotion information is information indicating the emotional state of the user of the content recommendation device obtained by analyzing the biological information detected and accumulated in the recording device unit 11 and will be described later. In addition, information indicating an emotion distribution obtained by accumulating information indicating an emotion state for each type of emotion is stored.

  In the user information area, information related to the user, for example, personal information such as the current address is registered. The information registered in the user information area is used when the recommended content is a ticket, for example, when searching for a traffic route from home to the event venue where the recommended content is entered.

  As described above, the user information database 23 stores and holds various information about the user who is going to use the content search recommendation function, and is realized by, for example, a hard disk drive. Of course, a recording medium such as a recordable optical disk can also be used.

  The content recommendation processing system 20 includes a content recommendation processing unit 24. As shown in FIG. 1, the content recommendation processing system 20 includes a popularity level totaling unit 241, an interest level totaling unit 242, and an emotion prediction unit 243.

  The popularity degree totaling unit 241 of the content recommendation processing unit 24 is a part for totaling information on sales of content that has already been sold, and the interest level totaling unit 242 is used for inquiries about future sales or content that has already been sold. This is the part that aggregates the degree of information reference. The emotion prediction unit 243 is a part that predicts a change in emotion when the user experiences content.

  It should be noted that the functions realized by each of the popularity level totalization unit 241, the interest level totalization unit 242, and the emotion prediction unit 243 can also be realized by software executed by the CPU 31.

  Then, as described above, the biometric information of the user (user) of the content recommendation device is measured (detected) and accumulated by the content recommendation device shown in FIG. 1, and this is analyzed to determine the emotional state of the user. It is grasped and the search of the content in consideration of this emotional state is recommended. In this embodiment, the information related to the search target content is stored in the content information database of the content recommendation device, and can be used.

  In the first embodiment, the function as the detecting means for detecting the biological information and the function as the analyzing means for analyzing the emotional state are mainly recorded in the recording device section as will be described in detail later. 11 is realized by the CPU 31, the content recommendation processing unit 24, and the content information database 22, and the functions as the notification unit are the schedule base application unit 13 and the user I / F 33. This is realized by the information providing unit.

  The prediction means for predicting the emotional state of the user after using the content is realized by the emotion prediction section 243 of the content recommendation processing section 24, and the function as the prediction notification means is mainly performed by the information providing section of the user I / F 33. Realize. Moreover, the evaluation means for evaluating the emotional state of the user after using the content is realized by the CPU 31 or the like. Also, the function as a reception unit that receives input of schedule information and the like from the user is realized by the information reception unit of the user I / F 33.

[1-2: Configuration Example of Recording Device Unit 11]
Next, a configuration example of the recording device unit 11 of the content recommendation device configured as shown in FIG. 1 will be described. FIG. 3 is a block diagram for explaining a configuration example of the recording device unit 11 of the content recommendation device shown in FIG. As shown in FIG. 3, the recording device unit 11 of the content recommendation device according to this embodiment includes an imaging unit 111, an A / D converter 112, an imaging unit signal processing unit 113, an imaging unit controller 114, a CPU 115, a RAM 116, and biological information. Input unit 117, A / D converter 118, biological information input unit controller 119, emotion analysis processing unit 120, recording unit controller 121, recording unit 122, network interface (referred to as network I / F in FIG. 3) 123, display A unit controller 124, a display unit 125, and a reproduction processing unit 126 are provided.

  The imaging unit 111 includes a lens mechanism and an image sensor such as a CCD (Charge Coupled Device), and can capture an image of a subject and output the captured image as an analog video signal to a subsequent circuit. is there. The analog video signal from the imaging unit 111 is converted into a digital signal by the A / D converter 112, and this is supplied to the imaging unit signal processing unit 113.

  The imaging unit signal processing unit 113 performs image compression processing using an image compression method such as an MPEG (Moving Picture Experts Group) method, for example. The imaging unit signal processing unit 113, the imaging unit 111, and the A / D converter 112 are controlled mainly by the imaging unit controller 114. That is, the imaging unit controller 114 controls the imaging system including the imaging unit 111, the A / D converter 112, and the imaging unit signal processing unit 113 so that the subject image can be appropriately captured. .

  The image data after the image compression processing in the imaging unit signal processing unit 113 is converted into image data of an appropriate recording format by the CPU 115 using the RAM 116 as a work area. The image data converted into the recording format is supplied to the recording unit controller 121, and is recorded in the data storage area of the recording unit 122 by the recording unit controller 121. The recording unit 122 is, for example, a hard disk drive or a large-capacity recording type optical disc, and the recording unit controller 121 records image data converted into the above-described recording format in a signal format appropriate for the device. The

  The biometric information input unit 117 is a part that receives various types of biometric information of the user of the command recommendation device of this embodiment, which will be described in detail later. The biological information received by the biological information detection unit 117 is converted into a digital signal by the A / D converter 118, converted into an appropriate recording format by the biological signal input unit controller 119, the CPU 115, and the RAM 116, and is recorded by the recording unit controller 121. Are recorded in the recording unit 122.

  When the received biometric information is, for example, an electroencephalogram, the biometric information input unit 117 amplifies the electroencephalogram information detected as a change in potential of several microvolts, performs a filtering process on several frequency bands, and converts it into a digital signal And recorded in the recording unit 122 through the recording unit controller 121.

  Alternatively, the biological information received by the biological information detection unit 117 is converted into a digital signal by the A / D converter 118 and then supplied to the emotion analysis processing unit 10. Therefore, emotion analysis may be performed, and information indicating the emotional state obtained as a result may be converted into an appropriate recording format by the CPU 115 and the RAM 116 and recorded in the recording unit 122 by the recording unit controller 121.

  Also, here, the image data of the subject acquired through the imaging unit 111, the user's biological information acquired through the biological information input unit 117, and information indicating the emotional state obtained by analyzing the biological information are recorded in the recording unit 122. Although described as a thing, it is not restricted to this.

  For example, it is connected to a network such as the Internet through the network I / F 123 and transmitted to a predetermined server device provided on the network so that the server device stores and holds image data, biological information, and information indicating an emotional state. It is also possible to make it. Similarly, data can be recorded in a recording device provided separately from the client terminal 1.

  In addition, as described above, the emotion analysis processing unit 120 also describes, for example, various biological information received through the biological information input unit 117 or the biological information recorded in the recording unit 122. The emotional state is extracted by analyzing the emotion model. The information indicating the emotional state extracted here is transmitted to the server device 2, and a content search recommendation service is performed in consideration of the emotional state.

  The reproduction processing unit 126 performs processing for reproducing the image data output from the recording unit 122, and can perform image data subjected to image compression processing to form image data for reproduction. Is.

  The image data processed by the reproduction processing unit 126 is supplied to the display unit controller 124. The display unit controller 124 forms an image signal in a format to be supplied to the display unit 125 and supplies the image signal to the display unit 125. The display unit 125 is a display such as an LCD, and displays an image corresponding to the image signal from the display unit controller 124 on its own display screen.

  As described above, the recording device unit 11 receives the input of the user's biometric information and records it in the recording unit 122, or analyzes the received biometric information and the biometric information recorded in the recording unit 122. The user's emotional state can be extracted, and an image of the subject can be taken and recorded in the recording unit 122.

  Here, a more specific configuration example of the above-described biological information input unit 117, A / D converter 118, and biological signal input unit controller 119 will be described. FIG. 4 shows a configuration example of each of the biological information input unit 117, the A / D converter 118, and the biological signal input unit controller 119. As shown in FIG. 4, here, a case where an electroencephalogram, an electrocardiogram, a pulse wave (pulse), a body temperature, an electromyogram, or the like is detected as the biological information of the user will be described as an example.

  The biological information input unit 117 is an electrode (sensor) 71a for detecting a biological signal spontaneously and inductively generated by a human, in this embodiment, an electroencephalogram, an electrocardiogram, a pulse wave, a body temperature, a myoelectricity, and the like. 71b, 71c, 71d, 71e,... And amplification units 72a, 72b, 72c, 72d, 72e,... For amplifying the detected biological signal. Here, the electrodes 71a, 71b, 71c, 71d, 71e,... Have a function of measuring (detecting) bioelectric phenomena including brain waves and biomagnetic phenomena including brain magnetism.

  Each biological information detected through the electrodes 71a, 71b, 71c, 71d, 71e,... Is supplied to the corresponding amplifiers 72a, 72b, 72c, 72d, 72e,. , Supplied to the A / D converter 118. In this embodiment, the A / D converter 118 includes a plurality of A / D converters 81a, 81b, 81, 81d, 81e,... According to the supplied biological information, as shown in FIG. The biometric information (analog signal) supplied is converted into a digital signal.

  For example, the potential level of the electroencephalogram is generally about 50 μV (microvolt), and the potential level of the electrocardiogram is about 1 mV (millivolt), which varies depending on the type of biological signal. Therefore, the number of quantization bits at the time of A / D conversion in each of the A / D converters 81a, 81b, 81c, 81d, 81e,... Has an accuracy that does not fall below the potential level of various amplified biological signals. Has been.

  Each biometric information after A / D conversion is supplied to the biometric information input unit controller 119. The biometric information input unit controller 119 receives the various biometric signals that have been digitized, and receives the biometric information from an emotion analysis processing unit 120, a recording unit 122, a display unit 125, and a reproduction processing unit 126 described later. A biological signal processing unit 92 that performs processing for converting the signal into usable signals, and a transmission unit 93 that outputs the processed biological signal to the bus 127.

  The receiving unit 91 has a sampling frequency of digital signals at an interval at which the original biological signal is reproduced, and receives biological information output from the A / D converters 81a, 81b, 81c, 81d, 81e,. Then, this is supplied to the biological signal processing unit 92 in the subsequent stage.

  The biological signal processing unit 92 receives the supply of biological information from the receiving unit 91, and performs, for example, filter operation processing for amplitude adjustment and band passing, FFT, wavelet analysis, and the like for each of the supplied biological information. Time-frequency analysis, or nonlinear analysis such as neural network or chaos analysis, etc., and a format usable in the subsequent emotion analysis processing unit 120, recording unit 122, display unit 125, and reproduction processing unit 126. The signal is converted into a signal, and the converted biological information (biological signal) is supplied to the transmitter 93.

  The transmitter 93 sequentially outputs the biological signal formed by processing as described above to the bus 127 at an appropriate timing, and records it in the recording unit 122 through the recording unit controller 121 as described above. In addition, processing such as supplying to the emotion analysis processing unit 120 to analyze biological information and extracting an emotional state is performed.

[1-3: Example of Emotion Analysis in Emotion Analysis Processing Unit 120]
Next, an example of analysis processing performed in the emotion analysis processing unit 120 of the recording device unit 11 configured as shown in FIG. 3 will be described. The emotion analysis processing unit 120 is measured (detected), digitized, and necessary through the biological information input unit 117, the A / D converter 118, and the biological information input unit controller 119, which are configured as shown in FIG. A plurality of pieces of biological information obtained by performing signal processing and analysis processing are input.

  In some cases, biometric information is supplied to the emotion analysis processing unit 120 from the biometric information input unit controller 119 via the bus 127, or the biometric information stored in the recording unit 122 is read out through the recording unit controller 121, This may be supplied through the bus 127. In addition, it is possible to receive supply of biometric information stored in an external device or an external server through the network I / F 123.

  The emotion analysis processing unit 120 receives input of a plurality of biological information, performs analysis processing based on the plurality of inputs, and outputs a plurality of emotion parameter values defined by the emotion model. There are two-axis model, three-axis model, and six-axis model as emotion models. An example of these models is shown in FIG.

  The two-axis model is the simplest model. As shown in FIG. 5A, for example, as an emotional state, a first axis indicating a comfortable direction or an uncomfortable direction, and a second axis indicating an excitement, a tension direction, or a relaxation direction, The two axes are used to form an emotion model and grasp the emotional state.

  As shown in FIG. 5B, the three-axis model includes, as emotional states, a first axis indicating a comfortable direction or an uncomfortable direction, a second axis indicating an excitement direction or a calm direction, and a third axis indicating a tension direction or a relaxation direction. The three models are used to form an emotion model and grasp the emotional state.

  As shown in FIG. 5C, the six-axis model includes a first axis indicating the degree of anger, a second axis indicating the degree of fear, a third axis indicating the degree of sadness, and a fourth axis indicating the degree of joy. Then, an emotion model is formed by the six axes of the fifth axis indicating the degree of disgust and the sixth axis indicating the degree of surprise, and the emotion state is grasped.

  Then, the emotion analysis processing unit 120 uses any of the emotion models described above. For example, a three-layer back propagation or self-organization map (SOM: Self-organized map) that has been learned or has been relearned individually for each user. By using a neural network technique such as Organizing Map), emotion parameter values are obtained by analyzing emotion parameters from a plurality of types of biological information that have received input.

  Thus, in the emotion analysis processing unit 120 of the recording device unit 11 of the content recommendation device according to this embodiment, by analyzing a plurality of types of biological information using a predetermined emotion model and a neural network technique, It becomes possible to grasp the emotional state of the user who is the provider of such biometric information as an emotion parameter value.

  And, for example, it is possible to grasp the period in which feelings of joy appear, the period in which feelings of sadness appear, the period in which feelings of anger appear, the period in which feelings of fear appear, etc. . Then, as will be described later, for example, the distribution of each user's emotions in a predetermined period such as one week, six months, etc., that is, what percentage of joy feelings and what percentage of sadness feelings is grasped. It becomes possible to do.

  Further, as specific examples of the analysis of the emotional state using the biological information, various types can be considered as follows. For example, for evaluation of the relaxed state, an electroencephalogram can be used as biological information. In general, it is known that the ratio of the frequency component of the α wave and the frequency component of the β wave is taken, and the more the ratio of the α wave component is, the more relaxed the state is. It is also possible to make an evaluation based on the stability of the cycle of breathing and heartbeat and the amount of increase in pulse amplitude.

  For surprising evaluation, the electrical resistance value of the skin can be used. In general, it is known that the electrical resistance value of the skin increases due to surprise, fear, or worry. By this electrical resistance value of the skin, it is possible to evaluate surprise, which is one of emotional states. When joy is evaluated, it can be evaluated using heart rate, skin temperature (body temperature), and electrocardiogram (electrocardiogram frequency). That is, it is known that when the emotion of joy is great, the heart rate decreases, the skin temperature increases, and the electrocardiogram frequency increases.

  In general, in a mentally and psychologically stable state, peripheral blood vessels are dilated and arterial blood flows, so that the heart rate and pulse change slowly, and the body temperature tends to rise. On the other hand, in a high mental and psychological tension state, peripheral blood vessels contract and arterial blood flow decreases, so the heart rate and pulse rate increase, and the body temperature tends to decrease. It is possible to evaluate and grasp the emotional state according to such physiological changes.

  In addition to the physiological indices as described above, the combined use of myoelectric changes by facial expressions, facial expression recognition by images, posture recognition by acceleration sensors, tilt sensors, etc., voice recognition, etc., such as user anger and sadness The emotional state may be evaluated.

  In other words, it is possible to grasp whether the person is crying, laughing, or angry by changing the myoelectricity on the human face. It is possible to know whether you are laughing or angry.

  Also, it can be used as information when evaluating emotional state by determining the posture of the user by using an acceleration sensor or tilt sensor and detecting whether the chest is in a bent state or a forward bent state. Is possible.

  Moreover, it is also possible to use the result of speech recognition as information when evaluating the emotional state. For example, when you are happy, the voice of the person is relatively high, and when you are depressed, the voice of the person tends to be relatively low. Thus, it is possible to evaluate the emotional state. It is also possible to evaluate the emotional state based on the magnitude (level) of the audio signal.

  As described above, the client terminal 1 according to this embodiment can continuously detect the user's biometric information and analyze the detected biometric information to evaluate and grasp the emotional state. Then, a content search recommendation request including the grasped emotional state of the user is transmitted to the server device 2 and a request is made to search and recommend content suitable for use in consideration of the emotional state of the user. To be able to.

[1-4: Outline of operation of content recommendation device]
Next, an outline of the operation of the content recommendation device of this embodiment configured as described above will be described. As described above, the content recommendation device of this embodiment includes the recording device unit 11, continuously detects a plurality of types of biological information of the user of the content recommendation device, and stores this in a predetermined storage unit. I remember it.

  In addition, the content recommendation device 1 has a so-called schedule book function, and by performing a predetermined operation, the schedule input screen is displayed on the display screen of the display element of the user I / F 33, and in the empty portion of the schedule, An event type (for example, movie, concert, reading, travel, etc.) that the user wants to experience (use) on that day can be input and held as schedule information.

  As an interface for receiving information input from the user, a target item can be selected from a list (selection item list) displayed on the display screen using a pointing device such as a mouse connected to the client terminal 1, Connected to the content recommendation device as a user I / F, for example, can be configured by various means such as input through a keyboard, character recognition by handwriting input using a touch panel, and voice recognition by voice input. .

  When the event type is input, the content recommendation device according to this embodiment analyzes the emotional state of the user from the past to the present based on the collected biological information, and the emotional state obtained as a result of the analysis In consideration of the information (emotion information) indicating the content, the user is requested to recommend the content on the scheduled date (desired date) when the user wants to experience the target type of content.

  In the content recommendation device of this embodiment, when the desired date and time of the content is close to the current date and time (for example, within the current to several days), the emotion distribution of the user's latest designated section (for example, one week) is displayed. To recommend content. As described above, the evaluation of the emotion distribution is information indicating an emotional state obtained by analyzing the biological information acquired through the recording device unit 11, and includes past information accumulated by the recording device unit 11. The biological information from the designated time point to the present time is analyzed by the emotion analysis processing unit 120, or information (emotional information) indicating the emotional state already analyzed and accumulated is used.

  When the desired date / time of the content is far from the current date / time (for example, more than a dozen days), the mental state and emotional state of the human may fluctuate significantly, as is the case when the desired date of experience is close to the current date / time. Even if this process is performed, the accuracy may be low. Therefore, it seems that it is appropriate for the user who requested the content search with reference to emotion information from the past to the present for candidates narrowed down by the entry date of the event and the popularity and interest described below Make content recommendations.

  Note that the emotion analysis process in the content recommendation device according to this embodiment is such that the use date of the recommended content is determined for the user based on conditions such as the event expiry date or the event ticket purchase date. A confirmation process is requested, and the emotion analysis immediately before the user on the confirmed usage date is performed.

  In this case, the emotional state for a predetermined period from the past to the present is analyzed. For example, the emotional state is analyzed by the following method. That is, when the emotion analysis is performed from the biological signal acquired by the recording device unit 11 of the content recommendation device of this embodiment and recorded in the recording unit 122, the long-range emotion distribution and the short-range emotion distribution are obtained. Evaluate the current emotional transition using the emotion distribution of the range as a reference value.

  For this evaluation, for example, an emotion model learned by nonlinear analysis such as a neural network can be used. And a content recommendation apparatus searches and recommends the content suitable for the user based on a user's emotion distribution. At this time, the number of contents weighted by the user's emotion prediction result is presented for each emotion.

  At the same time, the content recommendation device predicts the emotional state after experiencing these contents (after using the content), and provides it to the user of the content recommendation device by displaying it. The prediction of the emotional state after the content experience is performed, for example, by giving an emotion value after the content experience (after using the content) as an expected input to the above-described emotion model.

  In other words, when the content recommended to the user is used, the extent to which the content affects the emotional state of the user is predicted from the characteristics of each content evaluated in advance for each content. Therefore, the user is notified of the emotional state after the content experience by indicating how much the emotional state of the user changes due to the use of the content. The user of the client terminal 1 can select the content to experience (use) in consideration of the prediction of his / her emotional state after using the content.

  In addition, since each of the data about each content stored in the content information database 22 can indicate the classification of the event and the characteristics of the content by, for example, the type as described above, With this characteristic, it is possible to predict the influence of the content on the user. For example, if it is evaluated that the content of a certain movie has a characteristic that raises the joyfulness by a predetermined point, it can be predicted that the joyful feeling of the user's emotional state will be raised by the predetermined point from the characteristic. it can.

[1-5: Specific example of content recommendation processing]
Next, as described above, a specific example of the content recommendation processing performed in consideration of the emotional state of the user obtained by analyzing the biological information continuously detected by the recording device unit 11 of the content recommendation device will be described. To do. In the following, as described above, the emotional state obtained by analyzing the acquired biological information using a predetermined emotion model and using a neural network technique is expressed for each emotional state and for each predetermined period. An example will be described in which the emotion distribution during the predetermined period is obtained by performing cumulative processing, and the content is recommended based on the emotion distribution during the predetermined period.

As shown below, the emotion distribution of the user for the last week determined as described above is as follows:
Joy 20%
Sadness 15%
Surprise 15%
Angry 45%
Relax 5%
Suppose that

In addition, the emotion distribution of the user over the last 6 months is as follows:
Joy 20%
10% sadness
20% surprise
Anger 25%
Relax 25%
Suppose that

Based on the above analysis result, the emotional state of the last 6 months is regarded as the reference value of the user, and the emotion change rate is obtained. The rate of change is obtained, for example, by the following equation (1).
D (En) = (Enb−Ena) / t (1)
En: types of emotions (in the case of joy, sadness, surprise, anger, relaxation, n = 1-5)
Ena: ratio of the short-term range of emotion En to the whole Enb: ratio of the long-term range of emotion En to the whole t: time from the short-term range to the long-term range D (En): rate of change of the emotion En.

  In this example, E1 is joyful, E2 is sad, E3 is surprised, E4 is angry, and E5 is relaxed. Based on the above-described evaluation formula (1), the user has an evaluation that he / she is not relaxed and is always angry for the last week. For this reason, it is desirable to recommend content that can be changed in a direction that increases relaxation and can be changed in a direction that reduces anger.

  As described above, the emotional state of the last six months is used as the reference value in order to more accurately grasp the emotional state. In other words, the biological information changes not only when it changes according to emotions but also when it changes due to normal physical activity. For this reason, in a relatively short period, a change in biological information accompanying physical activity may be detected as a change in emotional state. In order to eliminate such a so-called noise change of the emotional state and grasp the emotional state as accurately as possible, the emotional state of the last six months is used as a reference value.

  And when the type of content (ID for identifying the content) in the schedule book (desired to use) is a movie, and ten movies are recommended for this user, for example, Allocate according to proper policy.

  The top two emotions (in the above example, anger and relaxation) with the highest absolute value of the rate of change are obtained, and the recommended ratios that direct these two emotions in a pleasant way (direct in the preferred direction) are calculated. At this time, weighting is considered according to the types of emotions that lead human emotions to pleasure (joy, relaxation, etc.), emotions that lead to discomfort (sadness, anger, etc.), and emotions that lead to both comfort and discomfort (surprise, etc.). The recommended ratio may be calculated.

Here, the absolute value of the rate of change of relaxation and anger takes a large value. Because there is a lack of relaxation, there are 5 movies that can be relaxed, 3 because surprises are slightly reduced, 2 because joy is stable, and sorrow and anger are increasing, so let's encourage them Do not recommend movies that have a positive effect. Therefore, the recommended movie in this example is
2 movies of joy 0 movies of sadness 3 movies of surprise 3 movies of anger 0 movies 5 movies of relaxation.

  Further, when presenting information about recommended content, the popularity and interest level of the recommended content is displayed to notify the user. For example, the popularity of content is obtained from the ticket sales start time, purchase status, and reservation status. The ratio of the cumulative value of the number of purchases and the number of reservations to the total number of sales and the increase rate of the number of purchases and the number of reservations can be used as the popularity.

  Further, for example, the degree of interest in content is obtained from the number of information viewers (access count) and the number of inquiries from the information disclosure time to the present. The number of questions sent to the official website and the number of web page accesses can be used as the degree of interest.

  Also, by entering the schedule to go to the movie on the same day before and after the time, if you have received a content search recommendation service multiple times, show the difference from the previous recommendation list You can also

  In other words, in addition to the previously recommended content, if there is newly recommended content, the newly recommended content is recommended in addition to the previously recommended content. However, if there is content that is not recommended this time, the content is removed from the current recommendation list, or notification is made so that it can be understood that the content is not recommended this time. Of course, both the previous recommended result and the current recommended result can be presented to the user.

  In addition, when there is content that the user has requested in advance or content that the user has desired for some reason but has been excluded, the content is added to the recommended list or the content is corrected. be able to. Then, the content recommendation list is updated to confirm the recommended content.

  The content recommendation process described above is performed each time the user refers to the schedule book, reflecting the current emotional state at that time. Here, the case where the recommended content is a movie has been described as an example. But movies aren't the only recommended content. As described above, it is also possible to recommend various events such as concerts, plays, sports games, exhibitions, solo exhibitions, and so-called theme parks such as amusement parks.

  It is also possible to make a configuration so that when the recommended entry date (participation application deadline) and capacity are approaching, the user is notified and the schedule book is referred to. That is, the server device 2 can know the entry date and the application status based on the information from the information providing organization 4, and can prompt the reference of the schedule book by voice or vibration based on this.

[1-6: Operation during content experience (use)]
Furthermore, in this embodiment, biological information is measured (detected) simultaneously with the experience (use) of the recommended content. The biological information measured during the content experience is, for example, brain waves, electrocardiograms, pulse waves, body temperature, and myoelectricity, as in the case described above. As described above, the biological information measured during the content experience is evaluated according to the emotion model by using a neural network technique according to the emotion model.

  And the evaluation result of the emotional state at the time of content experience is transmitted to the server apparatus 2, and it is determined whether the selected content is satisfactory or unsatisfactory by, for example, obtaining a comfortable feeling as an emotional evaluation. it can. For content that is dissatisfied, it is possible to take improvement measures such as adjusting the recommended number of similar contents at the time of future recommendation.

  The biometric information measured during the content experience and the evaluated emotional state are stored in the composite information database 12 by the function of the recording device unit 11 of the content recommendation device, and the biometric information measured up to that point and the result of the analysis are stored. The emotional state obtained can be managed together. These pieces of information can be used when receiving the next content search recommendation service.

[1-7: Summary of operation of content recommendation device]
Next, the operation of the content recommendation device according to the first embodiment will be summarized with reference to the flowcharts shown in FIGS.

  FIG. 6 is a flowchart for explaining the measurement and storage operation of biometric information in the recording device unit 11 of the content recommendation device of this embodiment, and FIG. 7 is the content recommendation time of the content recommendation device of this embodiment. It is a flowchart for demonstrating operation | movement of. First, the operation of the recording device unit 11 of the content recommendation device of this embodiment will be described with reference to the flowchart of FIG.

  As described above, the recording device unit 11 captures an image, measures a user's biological information, and accumulates measurement results. For example, an image can be captured in accordance with an instruction from the user. Here, the measurement and accumulation processing of the user's biometric information necessary for obtaining the emotional state considered when recommending the content will be described.

  When a sensor portion such as an electrode of the biometric information input unit 117 of the recording device unit 11 configured as shown in FIG. 3 is attached to the user's body and the recording device unit 11 is turned on, the CPU 115 of the recording device unit 11 is turned on. Performs the processing shown in FIG. First, the biological information input unit controller 119 and the like are controlled to perform biological information measurement and collection processing through the biological information input unit 117 and the A / D converter 118 (step S1).

  The biometric information input unit controller 119 performs a biosignal processing such as adjusting or analyzing the biometric information supplied through the biometric information input unit 117 and the A / D converter 118, and can be used in a content recommendation apparatus. Is formed (step S2). Then, the biometric information after adjustment and analysis is sent from the biometric information input unit controller 119 and stored in the recording unit 122 through the storage unit controller 121 so that the biometric information is accumulated.

  Then, it is determined whether or not a predetermined end event has occurred, for example, the recording device unit 11 is turned off (step S4). If it is determined in step S4 that no end event has occurred, the processing from step S1 is repeated, and the measurement and storage processing of biological information is continued. If it is determined in step S4 that an end event has occurred, the process shown in FIG. 6 ends. In this way, the user's biological information is measured and stored in a usable format.

  Next, the operation at the time of content recommendation in the content recommendation device of this embodiment will be described with reference to the flowchart of FIG. When the execution of the schedule book function is instructed through the input reception unit of the user I / F 33 of the content recommendation device of this embodiment, the CPU 31 of the content recommendation device starts the process shown in FIG.

  Then, the CPU 31 of the content recommendation device executes the schedule book function, displays a schedule entry / reference screen on the display element of the information providing unit of the user interface 33, and inputs schedule information such as schedule entry / change. Is accepted (step S11). Here, for example, an event type to be used such as a movie, a concert, reading, or a trip is entered in the entry column for the corresponding date displayed on the calendar.

  In step S11, when the schedule information is input, the CPU 31 of the content recommendation device controls the recording device unit 11 to analyze the accumulated biological information, thereby grasping the emotional state of the user, and using the user information database. (Step S12). Then, the CPU 31 searches the content information database 22 for content recommended to the user from information related to the content stored in the content information database 22 based on the information indicating the emotional state of the user information registered in the user information database 23. (Step S13).

  Thereafter, the CPU 31 of the content recommendation device controls the popularity level totaling unit 241 and the interest level totaling unit 242 of the content recommendation processing unit 24, and inquires (interest level) and sales status (popularity) of the corresponding content in the content information database 22. The recommended content is narrowed down and the emotional state of the user after the content experience is predicted (step S14).

  Then, the CPU 31 recommends the content to the user by displaying, for example, a list of content search and narrowing results (step S15). Then, the CPU 31 determines whether or not recommendation is made for content of the same event type on the same scheduled date (step S16).

  If it is determined in the determination process in step S16 that content of the same event type is recommended on the same scheduled date, the content of the previous recommendation list and the content of the current recommendation list can be compared to the user. Present (step S17).

  After the process in step S17 or in the determination process in step S16, if it is determined that no recommendation is made for the content of the same event type on the same scheduled date, the CPU 31 determines whether the content is recommended for the current content. A selection input as to whether or not to perform a process of adding or correcting a request is accepted through the information input unit of the user I / F 33, and it is determined whether or not to add or modify the recommendation list (step S18).

  When it is determined in step S18 that addition or correction to the recommended list has been selected, the CPU 31 accepts addition or correction of content to the recommended list through the information input unit of the user I / F 33 (step S19). ). After the process of step S19 or when it is determined in step S18 that addition or correction to the recommended list has not been selected, the CPU 31 updates the recommended list to be presented to the user. The state is updated (step S20).

  Then, the CPU 31 receives an instruction input as to whether or not to confirm the content of the recommended list of content through the information input unit of the user I / F 33, and determines whether or not it is instructed to confirm the content of the recommended list. Judgment is made (step S21).

  If it is determined in step S21 that the content recommendation list has been instructed, the CPU 31 confirms the content recommendation list, and the user experiences on the scheduled date instructed. For example, the recommended list of desired contents is stored in the storage unit 132 of the schedule base application unit 13 and can be used by the schedule book function (step S22), and the process shown in FIG. 7 is terminated.

  On the other hand, when it is determined in the determination process in step S21 that it is not instructed to confirm the content of the recommended content list, the CPU 31 repeats the processing from step S19 to add or correct the recommended content list. To be able to.

  Thus, according to the content recommendation device of this embodiment, the emotion distribution (emotion transition) can be grasped from the time information (elapsed time) and the emotional state, and this emotion distribution is taken into account to act more on the inner surface of the user. Appropriate possible content can be recommended to the user. In addition, by linking the schedule book function with the recommended content search function, content search and recommendation can be performed in the process of using the schedule book function of inputting schedule information without any cumbersome input work. be able to.

  Further, by predicting the emotion transition from the emotion information obtained by analyzing the accumulated biological information to the content experience date, abundant content information can be presented to the user.

  In addition, by measuring the biometric information at the time of experience of the recommended content and feeding it back to the content recommendation device, the user's satisfaction with the recommended content can be accurately grasped. Therefore, it is possible to perform a highly accurate recommendation process.

  The analysis of the emotional state may be performed by analyzing the biometric information recorded and accumulated in the recording unit 122 as described above, or the biometrics detected in the recording device unit 11 may be analyzed. Information may be processed in real time to analyze the emotional state, the analysis result may be recorded in the recording unit 122, and the content may be searched and recommended using this.

[2: Second embodiment (content search recommendation system)]
Next, a content search recommendation system formed by applying one embodiment of an information search system, an information search method, a client device, and a server device according to the present invention will be described.

  The content search recommendation system to which the information search system according to the present invention is applied can be formed as a so-called local area network system in a closed area such as a home. Here, first, a public telephone network, A case of a content search recommendation system formed through a wide-area communication network such as the Internet will be described as an example.

[2-1: Overview of content search recommendation system]
FIG. 8 is a diagram for explaining the content search recommendation system of this embodiment. As shown in FIG. 8, in the content search recommendation system of this embodiment, client terminals 1a, 1b,... And a server device 2 are connected to a wide area communication network 5 such as a public telephone network or the Internet. It is formed.

  Each of the client terminals 1a, 1b,... Is one to which the client device according to the present invention is applied, and each has a substantially similar configuration. The server device 2 is the one to which the server device according to the present invention is applied.

  Further, as shown in FIG. 8, the certificate authority 3 is connected to the communication network 5, and information about contents provided at those places, such as stadiums, halls, movie theaters and museums, is provided. The provided terminal device such as a personal computer can be connected to the communication network 5 as the information providing organization 4.

  Each of the client terminals 1a, 1b,... Is a device used by a general user (end user). Each of these client terminals 1a, 1b,... Has a schedule book function for receiving schedule information from the user and managing it.

  Further, as will be described in detail later, each of the client terminals 1a, 1b,... Detects and accumulates various biological information such as the user's body temperature and pulse, and based on the accumulated biological information, The emotional state can be analyzed. Then, each of the client terminals 1a, 1b,... In this embodiment, when the user inputs a content use schedule on a target date, the analysis result of the emotional state and the identification information (identification ID) of the own device A content search recommendation request for requesting provision of information on appropriate content in consideration of the emotional state of the user can be transmitted to the server device 2 through the communication network 5.

  In other words, each of the client terminals 1a, 1b,... Sends a content search recommendation request for requesting provision of information about appropriate content in consideration of its own emotional state in conjunction with the schedule book function. By sending to, you can receive content search and recommended services.

  The server device 2 grasps the characteristics of each content that can be used by the user. When the server device 2 receives the content search recommendation request from the client devices 1a, 1b,..., The server device 2 determines the user based on the received analysis result of the emotional state of the user and the characteristics of the content available to the user. It is possible to search for a content suitable for provision to the client and return the search result as recommended content information to the requesting client device.

  Thus, for example, when the emotional state of the user is, for example, in a state where there is a lot of stress and a high proportion of angry emotions, it is recommended to search for fun content that reduces stress and suppresses anger. For example, the content can be searched and recommended according to the emotional state of the user. In other words, the server device 2 can provide a content search recommendation service in response to a request from the user.

  In this embodiment, the certificate authority 3 can access the server device 2 by the client terminals 1a, 1b,... That have accessed the server device 2 based on a request from the server device 2. It authenticates whether the terminal is capable of providing information. Usually, the operator of the server device 2 and the users of the client terminals 1a, 1b,... Have a contract relationship, and the certificate authority 3 accepts registration of identification information and the like of the client terminal that has the contract relationship with the server device 2. Hold this.

  As a result, the certificate authority 3 can authenticate whether the client terminal that has accessed the server device 2 can receive information from the server device 2. In this embodiment, unless otherwise indicated, the client terminals 1a, 1b,... Have a contract relationship with the server device 2 and receive a content search recommendation service from the server device 2. It is something that can be done.

  The information provider 4 also sells tickets for stadiums, halls, movie theaters, museums, etc. where it is installed or will be in charge, and contents such as entertainment provided at those locations. It provides information about the degree of interest about the. Such information can also be provided to the user of the client terminal so that it can be used as a reference when selecting content.

  In FIG. 8, only one server device 2 is shown, but there may be a plurality of server devices that provide similar services. In this case, access from a large number of client terminals can be distributed to ensure a good communication environment.

  As can be seen from the above description, each of the client terminals 1a, 1b,... Of this embodiment is mainly an emotional state of the content recommendation device of the first embodiment described with reference to FIG. The processing performed by the evaluation processing system 10 is performed, and the server apparatus 2 performs processing performed mainly by the content search recommendation processing system 20 of the content recommendation apparatus according to the first embodiment described with reference to FIG. Is what you do. Each of these client terminals 1a, 1b,... And the server device 2 cooperate to realize the same function as the content recommendation device of the first embodiment.

  Hereinafter, the configuration and operation of the client terminals 1a, 1b,... And the server apparatus 2 in the content search recommendation system of this embodiment will be specifically described. As described above, each of the client terminals 1a, 1b,... Has the same configuration. Therefore, hereinafter, each of the client terminals 1a, 1b,... Will be described as the client terminal 1.

[2-2: About the client terminal 1]
FIG. 9 is a block diagram for explaining the client terminal 1 constituting the content search recommendation system shown in FIG. The client terminal 1 of this embodiment is the same as that of the first embodiment described above except for the content search recommendation processing system 20 of the content recommendation device described with reference to FIG. The evaluation processing system 10 is configured. For this reason, in FIG. 9 showing the configuration of the client terminal 1 of this embodiment, the same reference numerals are given to the parts configured in the same manner as the content recommendation device of the first embodiment shown in FIG. Detailed description thereof will be omitted.

  9, the control unit 100 corresponds to the control unit 30 of the content recommendation device according to the first embodiment shown in FIG. 1, and includes a CPU 31, a memory unit 32, a CPU 101 corresponding to the user I / F 33, and a memory. The unit 102 and the user I / F 103 are connected via the system bus 14. In addition, the schedule base application unit 13 is provided with a communication unit 133 for performing communication with the server device 2 through the communication network 5.

  Each part other than the control unit 100 and the communication unit 133 is configured similarly to the emotion state evaluation processing system 10 of the content recommendation device according to the first embodiment shown in FIG. Therefore, the video, audio, biological information and emotion storage device section (hereinafter simply referred to as the storage device section) 11 of the client terminal 1 of this embodiment has the configuration shown in FIG. The A / D converter 118 and the biological information input unit controller 119 have the configuration shown in FIG. Further, the composite information database 12 of the client terminal 1 of this embodiment stores and holds each piece of information shown in FIG. 2A.

  In the case of the client terminal 1 of this embodiment, the recording device unit 11 measures (detects) the user's biological information, and the recording device unit 11 of the recording device unit 11 and the composite information database 12 measure it. Biometric information can be stored and managed. In addition, it is possible to grasp the emotional state by analyzing the biological information accumulated and managed by the recording unit 122 of the recording device unit 11 and the composite information database 12 by the emotion analysis processing unit 120 of the recording device unit 11. I can do it.

  Furthermore, the function of the schedule base application unit 13 realizes a schedule book function, and in conjunction with this schedule book function, in order to receive a content search recommendation service that also considers the user's emotional state, the user's emotional state is changed. A content search recommendation request including information to be shown and a user identification ID is formed and transmitted to the server device 2, and a content recommendation list from the server device is received and presented to the user. The

[2-3: Server apparatus 2]
FIG. 10 is a block diagram for explaining the server device 2 constituting the content search recommendation system shown in FIG. The server device 2 according to this embodiment is the same as that of the first embodiment described above except for the emotion state evaluation processing unit 10 of the content recommendation device described with reference to FIG. The search recommendation processing system 20 is configured. For this reason, in FIG. 10 which shows the structure of the server apparatus 2 of this embodiment, the same referential mark is attached | subjected to the part comprised similarly to the content recommendation apparatus of 1st Embodiment shown in FIG. Detailed description thereof will be omitted.

  10, the control unit 200 corresponds to the control unit 30 of the content recommendation device according to the first embodiment shown in FIG. 1, and includes a CPU 31, a memory unit 32, a CPU 201 corresponding to the user I / F 33, and a memory. The unit 202 and the user I / F 203 are connected via the system bus 27. Each part other than the control unit 200 is configured similarly to the content search recommendation processing system 20 of the content recommendation device according to the first embodiment shown in FIG.

  Therefore, the content information database 22 stores and holds the information shown in FIG. 2B, and the user information database stores and holds the information shown in FIG. 2C and can be referred to through the control unit 200. You can also add, change, delete, and so on.

  And the control part 200 of the server apparatus 2 of this embodiment will receive a content search recommendation request | requirement from the client terminal 1 through the communication part 21, and based on the information which shows the emotional state contained in the request | requirement, a content information database By referring to the data held in 22, the content suitable for the requesting user is searched.

  Then, the control unit 200 controls the content recommendation processing unit 24 so that the degree of popularity and the degree of interest are totaled according to the inquiry status and sales performance of each data in the content information database 22, and The content is narrowed down and the emotional state after the experience of the recommended content is also predicted to form a recommended content list, which is transmitted to the requesting client device 1 through the communication unit 21. The requesting client terminal 1 can be specified by the user identification ID included in the content search recommendation request.

  Thereafter, the client device 1 provides the received recommendation list through the user I / F 103 so that it can be compared with the previous recommendation list in the same manner as the processing from step S16 of the flowchart shown in FIG. By adding or correcting, the recommended list is confirmed, and this can be held and used in the client terminal 1.

  As a result, the user of the client terminal 1 is encouraged to recommend content suitable for use on the target date, and the user can use the content that is suitable for the recommended content, or use the content. You will be able to purchase tickets to do so.

  When searching for content, the server device 2 accesses not only the information in its own content information database 22 but also the information providing organization 4 connected to the communication network 5, and the content is determined by the information held by the information providing organization 4. You can also search for. The server device 2 is operated by a provider that provides a content search recommendation service, a content sales store, or the like.

  In the second embodiment, the information providing organization 4 can respond to a request from the server device 2 via a communication network such as the Internet. Then, information related to the recommended content (for example, content name, price, validity period, sales start date, inquiry status, sales performance, etc.) is provided. The information providing organization 4 is not only installed at a content store where content is to be provided, but also installed at a facility such as a theater or a stadium where the content is experienced.

  In the second embodiment, the recording device unit 11 of the client terminal 1 realizes the function as the detection unit for detecting the biological information and the function as the analysis unit for analyzing the emotional state. The function as the content search means is realized by the CPU 201 of the server device 2, the content recommendation processing unit 24, and the content information database 22, and the function as the notification means is the schedule base application unit 13 of the client terminal 1, the user I This is realized by the information providing unit of / F103.

  Further, the prediction means for predicting the emotional state of the user after using the content is realized by the emotion prediction section 243 of the content recommendation processing section 24 of the server device 2, and the function as the prediction notification means is mainly the user of the client terminal 1. The information providing unit of the I / F 33 is realized. Further, the evaluation means for evaluating the emotional state of the user after using the content is realized by the CPU 101 of the client terminal 1 or the like. In addition, the function as a reception unit that receives input of schedule information and the like from the user is realized by the information reception unit of the user I / F 103 of the client terminal.

  In addition, the communication unit 133 implements functions of a transmission unit and a reception unit for realizing communication processing mainly performed with the server device 2 in the client terminal 1, and the server device 2 mainly communicates with the client terminal 1. The communication unit 21 realizes the transmission means and the reception means for realizing the communication processing performed in FIG.

[2-4: Operation of content search recommendation system]
Next, the operation of the content search recommendation system according to the second embodiment will be described with reference to the timing charts of FIGS. In the above-described embodiment, the case where the information of the content information database 22 is used as the degree of popularity and interest of content has been described. However, here, the information indicating the degree of popularity and interest of content is the latest information. Therefore, the information provider 4 is inquired and the fact of the inquiry is also reflected in the information (inquiry status, etc.) held by the information provider.

  In the client terminal 1, measurement and accumulation of the user's biological information are continuously performed by the function of the recording device unit 11. Then, when the schedule information of the client terminal 1 is used and, for example, schedule information such as what month and what day a movie is watched is input, as shown in FIG. A content search recommendation request including the event type of the content to be performed and its own identification ID (user ID) is formed and transmitted to the server device 2 (step S31).

  When the server device 2 receives the content search recommendation request from the client terminal 1, the server device 2 authenticates whether or not the user can receive the content search recommendation service based on the user ID included therein. Therefore, a user authentication request including the user ID is transmitted to the certificate authority 3 (step S32). The certificate authority 3 performs an authentication confirmation process (authentication process) by referring to the user information registered as a member based on the user ID included in the authentication request (step S33), and returns the result to the server apparatus 2 (Step S34).

  If the authentication is not successful, the server device 2 notifies the requesting client terminal 1 that the content search recommendation service cannot be received because the authentication cannot be obtained (step S35). If the authentication is successful, the server device 2 supplies information provided by the user such as the user ID and event type (content content) to the user information database 23 and requests to record them. (Step S36). The user information database 23 records the requested user information (step S37) and returns a recorded response to the server device 2 (step S38).

  When the recorded response of the user information is returned, the server device 2 forms a request for analyzing the biological information and grasping the emotional state to the client terminal 1 that has transmitted the content search recommendation request. (Step S39). In response to this request, the client terminal 1 analyzes the biological information to grasp the emotion state, for example, obtains an emotion distribution in a predetermined period and transmits it to the server device 2.

  Upon receiving the emotion distribution from the client terminal 1, the server device 2 supplies this to the user information database 23 and requests to record it as the user data (step S41). The user information database 23 records the requested user information (step S42) and returns a recorded response to the server device 2 (step S43).

  Then, the server device 2 issues a request to search for content suitable for the user based on the emotion distribution and event type of the user (step S44). In response to this request, the content information database 22 performs a search process to search for content suitable for the user (step S45) and notifies the server device 2 of the search result (step S46).

  Upon receiving the notification of the search result, the server device 2 requests the information providing organization 4 related to the content to notify the popularity and interest of the content obtained as a result of the search, as shown in FIG. (Step S47). In response to this request, the information application organization 4 acquires information indicating the degree of popularity and information indicating the degree of interest for the requested content (step S48), and returns this to the server device 2 (step S49). .

  Thereafter, the server device 2 narrows down the recommended content in consideration of the degree of popularity and the degree of interest, and performs a process of predicting the emotional state of the user when experiencing the recommended content (step S50). A content recommendation result, that is, a content recommendation list, including the prediction processing result, popularity, and interest level, is transmitted to the requesting client terminal 1 (step S51).

  In the client terminal 1, when a comparison with the previous recommended list, addition or deletion of recommended content is performed by the user, and a confirmation operation of the recommended list of content is performed, a confirmation request is formed, and the server 2 (Step S52). Upon receiving the confirmation request, the server device 2 forms a request (update request) for updating the information on the content for which the information indicating the degree of popularity or the information indicating the degree of interest has been acquired. The information is transmitted to the corresponding information providing organization 4 (step S53).

  In response to this, the information providing organization 4 updates the information about the target content (step S54). That is, with the series of processes this time, the number of inquiries for the recommended content increases, and in the case of a ticket or the like, if the purchase is made, the sales performance increases. Then, the information providing organization 4 transmits an update result response to the server device 2 (step S55).

  When the server apparatus 2 receives the update result response from the information providing organization 4, the server device 2 forms a request for updating the corresponding content information in the content information database 22 in the same manner as the information about the content of the information providing organization 4. This is supplied to the content information database 22 (step S56), and the information in the content information database 22 is also updated (step S57). When the update is completed, the content information database 22 returns an update result response to the server device 2 (step S58).

  The server device 2 transmits the series of update results to the requesting client terminal 1 for notification (step S59), and when the requesting user performs an operation such as purchasing a ticket. The user information database 23 is requested to update such information (step S60), and the corresponding information in the user information database 23 is updated (step S61).

  After the update in step S61 is completed, an update result response is provided to the user information database 23 or the server device 2 (step S62). Thereafter, the server device 2 sends a request to the requesting client terminal 1. The end of the series of content search recommendation services is notified (step S63). Then, the user is notified of the end of a series of content search recommendation services as display information and the like, and the content search recommendation processing is ended.

  As described above, in the content search recommendation system according to the second embodiment as well, in the same manner as the content recommendation device according to the first embodiment described above, the emotion distribution is determined from the time information (elapsed time) and the emotion state. (Emotion transition) can be grasped, and in consideration of this emotion distribution, appropriate content that can act on the inner surface of the user can be recommended to the user.

  In addition, by linking the schedule book function with the recommended content search function, content search and recommendation can be performed in the process of using the schedule book function of inputting schedule information without any cumbersome input work. be able to.

  Further, by predicting the emotion transition from the emotion information obtained by analyzing the accumulated biological information to the content experience date, abundant content information can be presented to the user.

  In addition, by measuring the biological information at the time of the experience of the recommended content and feeding it back to the server device 2, it is possible to accurately grasp the user satisfaction with the recommended content. Can be used at the next recommendation, so that a highly accurate recommendation process can be performed.

  In other words, content that did not get much satisfaction was not recommended again, the same type of content as content that did not get satisfaction, or content of the same author as content that did not get satisfaction For content, it is possible to perform highly reliable content recommendation processing by reducing the priority of recommendation.

  Further, in the case of the content search recommendation system according to the second embodiment, since the server device 2 is provided on the communication network 5, the client terminal 1 does not have a large amount of information such as a content information database. You can do it. Further, it is possible to make a search for content using the latest information of more content.

  Here, the client terminal 1, the server device 2, the certificate authority 3, and the information providing organization 4 have been described as an example in which they are connected through a wide-area communication network 5 such as the Internet. However, the present invention is not limited to this. is not.

  For example, as shown in FIG. 13, the present invention can also be realized when a so-called home network system is constructed by connecting the client terminal 1 and the server device 2 according to the present invention to a predetermined LAN 9. In this case, it is possible to make recommendations for contents held by the hard disk recorder 7a, the DVD (Digital Versatile Disc) recorder 7b, the VTR (Video Tape Recorder) 7c, and the like. It is also possible for the server apparatus 2 to collect information on a larger amount of content and to search and recommend the content targeting these as well.

  The display device 8 shown in FIG. 13 can reproduce information from the hard disk recorder 7a, the DVD recorder 7b, and the VTR 7c, and can respond to various requests from the client terminal 1 and the server device 2. Can be displayed.

  In the content search recommendation system according to the second embodiment, the process of analyzing the biometric information and analyzing the emotional state of the user has been described as being performed on the client terminal 1 side. is not. For example, on the client terminal side, the user's biometric information is continuously detected and accumulated, and when the schedule information is input, the biometric information accumulated so far is transmitted to the server device 2. Thus, the server device 2 side may analyze the biological information to obtain the emotional state of the user.

  The biometric information may be transmitted from the client terminal 1 to the server device 2, and the control unit 200 of the server device 2 may realize the function as the emotion analysis processing unit 120 of the client terminal 1. The other processes are almost the same as those of the content search recommendation system of the second embodiment described above.

[3: Others]
[Various recommended methods]
In the present invention, by using the content information database or the user information database, it is possible to analyze and present the recommended content based on emotion in more detail. For example, by using the information on the usage location of the content information database, it is possible to recommend content that has been narrowed down by location to the user.

  Thereby, in addition to emotion information, the user can select content in consideration of information such as a point reduction service related to use at the same place, for example. In addition, by using the purchase date information in the user information database, it is possible to recommend content to the user in consideration of the season after performing emotion analysis. This allows the user to purchase a restaurant ticket that provides seasonal ingredients in a relaxing atmosphere, for example.

[Interaction with billing system]
It is also possible to construct a system that enables a recommended content purchase procedure by linking with a charging system prepared by an information providing organization or another organization. For example, in the case of the content search recommendation system according to the second embodiment, when it is desired to use the content recommended by the server device 2, the client terminal 1 uses the server device 2 or directly through the information providing organization. 4 is requested to provide the content, the authentication process is performed when the content is provided, the content is provided to the authenticated client terminal 1, and the user of the client terminal 1 is charged. Good.

  In this case, the settlement method may be such that a credit card number is registered and settlement using a credit card is performed, or a bank account is registered and the bank account is registered. By registering for automatic debit, it is also possible to settle by automatic debit from a bank account. It is also possible to issue a bill, send it to the user, and transfer the money through the financial institution.

  In addition, not only the information providing organization 4 but also the organization that generates billing is configured to always pass through the server device 2 so that the server device 2 generates billing and charges this. Alternatively, the certificate authority 3 can have a function as an organization that generates a charge.

[Linking with video and audio]
Also, the user's video and audio at the time of content experience are recorded by a recording device, and these data are used by the video and audio recognition device at the time of content recommendation, so that the emotion model analysis that constitutes a part of the present invention Make the output of the part more accurate. For example, it is possible to recommend content corresponding to more complex emotions by combining the output of the emotion model with the evaluation of the user's facial expression by image recognition, the recognition of exclamation words and intonation by voice recognition, and the like.

  In this case, both the first embodiment and the second embodiment can be realized by using an imaging system including the imaging unit 111, the A / D converter 112, and the imaging unit signal processing unit 113 of the recording device unit 11. Become. The imaging system is provided with a microphone, an A / D converter for audio, an audio signal processing unit, and the like, so that the user's voice is picked up together with the image, and the user's emotion is analyzed as described above. Can be done.

[Operation by group]
In addition, when the release of the schedule is permitted among individuals, it is also possible to make a content recommendation by a group by issuing a group ID or a group password. For example, presenting all recommended content based on the emotions of individual humans in the group, or integrating individual human emotions, seeking emotions as a group, and recommending content from these emotions Can be considered.

  In other words, from the biometric information of each individual who forms a group, the average emotional state of the group is grasped, and according to this, content suitable for the group is recommended. Even if only one piece of content can be used in a group consisting of a large number of people, it is possible to recommend content that is appropriate for the group in consideration of each of its members, and it is difficult to determine the content to use. It is possible to efficiently solve problems that frequently occur in groups such as.

  For example, at the birthday party or home party, select the content of the movie in consideration of the emotional state of all attendees, or select the content to be viewed at various content appreciation parties. In this case, it is possible to grasp the emotional state of each attendee from the biometric information of each attendee and recommend content suitable for the group (group) based on the grasped emotional state.

[Types of biometric information used]
In the above-described embodiment, the biological information to be measured has been described as using brain waves, electrocardiograms, pulse waves, body temperature, and myoelectrics, but is not limited thereto. For example, use various information such as respiratory information such as respiratory rate and respiratory volume, blood pressure information, skin sweat information, skin resistance information, body movement information, magnetoencephalogram information, pupil diameter, microvibration information, biochemical reaction information, etc. Is possible.

  That is, biological information that can be used includes heart rate information, pulse information, respiratory information, blood pressure information, electrocardiogram information, electroencephalogram information, skin sweat information, skin resistance information, body motion information, magnetoencephalogram information, myoelectric information. Use one or more of information, body surface temperature, pupil size, microvibration information, biochemical reaction information, etc., and analyze the measured biological information to understand the emotional state You can do it.

  Further, the present invention is not limited to the case where the emotional state is grasped by analyzing the above-described biological information spontaneously and inductively generated by the human body. For example, it is required to press the operation button switch at a predetermined rhythm for a certain period of time, and by detecting a shift in the rhythm of pressing the operation button switch of the user with respect to the predetermined rhythm, the stability of the emotion of the user Or the degree of excitement, or request that the operation button switch be pressed as many times as possible within a predetermined time, and depending on the number of pressing operations, the stability of the user's emotion, excitement, etc. For example, the user's operation input may be received, and the emotional state of the user may be determined based on the input information.

  That is, the biological information is not only information that the user's body voluntarily and triggers such as heartbeat, electrocardiogram, electroencephalogram, but also the user's intention such as the pressing rhythm and the number of pressings of the pressing button switch as described above. Information obtained from the user's action performed is also biological information in a broad sense, and information about the user obtained from such a user's active action can also be used as the biological information.

  In addition, as described above, recommended contents include data that can be recorded online and recorded on recording media such as CDs, DVDs, and semiconductor memories, as well as data for movies, music, books, etc., concerts, plays, sports Various events such as games, and various information such as art museums, museums, amusement parks, movie theaters, and so-called attractions are also included. In addition to this, it is possible to use the present invention when recommending various items that can be recommended according to the emotional state of the user, for example, food and drink such as dishes, and combinations of clothes. .

It is a block diagram for demonstrating the content recommendation apparatus with which one Embodiment of the information search device by this invention and the information search method was applied. It is a figure for demonstrating an example of the information stored in the composite information database shown in FIG. 1, a content information database, and a user information database. It is a block diagram for demonstrating the image | video, audio | voice, biometric information, and emotion recording apparatus part (recording apparatus part) 11 of the content recommendation apparatus shown in FIG. It is a block diagram for demonstrating the biometric information input part 117, the A / D converter 118, and the biometric information input controller 119 of the recording device part 11 shown in FIG. It is a figure for demonstrating the model for emotion analysis. 4 is a flowchart for explaining the operation of the recording apparatus unit 11 shown in FIGS. 1 and 3. 3 is a flowchart for explaining an operation during a content recommendation process performed in the content recommendation device shown in FIG. 1. It is a figure for demonstrating the content search recommendation system with which one Embodiment of the information search system by this invention and the information search method was applied. It is a block diagram for demonstrating the client terminal with which one Embodiment of the client apparatus by this invention was applied. It is a block diagram for demonstrating the server apparatus with which one Embodiment of the server apparatus by this invention was applied. It is a sequence diagram for demonstrating the process performed in the content search recommendation system shown in FIG. FIG. 12 is a sequence diagram following FIG. 11. It is a figure for demonstrating the other structural example of a content search recommendation system.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Emotional state evaluation processing system, 11 ... Video, voice, biological information and emotion recording device unit (recording device unit), 111 ... Imaging unit, 112 ... A / D converter, 113 ... Imaging unit signal processing unit, 114 ... Imaging unit controller, 115 ... CPU, 116 ... RAM, 117 ... biological information input unit, 118 ... A / D converter, 119 ... biological information input unit controller, 120 ... emotion analysis processing unit, 121 ... recording unit controller, 122 ... recording , 123 ... Network interface, 124 ... Display controller, 125 ... Display, 12 ... Composite information database, 13 ... Schedule-based application part, 131 ... Processing part, 132 ... Storage part, 20 ... Content search recommendation processing system, 21 ... Communication unit, 22 ... Content information database, 23 ... User information database 24 ... content recommendation processing unit, 241 ... popularity counting unit, 242 ... interest totaling unit, 243 ... emotion predicting unit, 30 ... control unit, 31 ... CPU, 32 ... memory unit, 33 ... user interface

Claims (32)

Detecting means for detecting one or more types of biological information from the user;
Analysis means for analyzing the emotional state of the user from one or more types of biological information detected by the detection means;
Search means for searching for recommended content for the user based on the analysis result by the analysis means;
An information search apparatus comprising: notification means for notifying a search result in the search means. The information search device according to claim 1,
Prediction means for predicting the emotional state of the user after use of the content based on at least the characteristics of the content searched by the search means;
An information search apparatus comprising: a prediction notification means for notifying a prediction result in the prediction means. The information search device according to claim 1 or 2, wherein
The detection means can also detect the user's biometric information when using content,
Evaluation means for evaluating the used content based on the biometric information detected by the detection means at the time of using the content. The search means is recommended to the user in consideration of the evaluation result in the evaluation means. An information search apparatus characterized by selecting content to be performed. The information search device according to claim 1, claim 2, or claim 3,
A reception means for receiving input of schedule information from the user,
The information search apparatus, wherein the search means searches for recommended content in consideration of a scheduled date and a type of content scheduled to be used in the schedule information received through the receiving means. A detection step of detecting one or more types of biological information from the user;
An analysis step of analyzing an emotional state of the user who is a generation source of the biological information from one or more types of the biological information detected in the detection step;
A search step for searching for content recommended for the user based on the analysis result in the analysis step;
A notification step of notifying a search result obtained in the search step. The information search method according to claim 5,
A prediction step of predicting the emotional state of the user after use of the content based on characteristics of the content obtained as a result of the search in at least the search step;
A prediction notification step of notifying a prediction result in the prediction step. The information search method according to claim 5 or 6, wherein
In the detection step, the biometric information of the user at the time of using the content is also detected.
An evaluation step for evaluating the used content based on the biometric information detected in the detection step when using the content;
In the search step, the content to be recommended to the user is selected in consideration of the evaluation result in the evaluation step. An information search method according to claim 5, claim 6 or claim 7,
A reception step for receiving input of schedule information from the user,
In the search step, the content search is performed in consideration of a scheduled date in the schedule information received in the reception step and a type of content scheduled to be used. . An information retrieval system formed by connecting a client device and a server device through a predetermined network,
The client device is
Detecting means for detecting one or more types of biological information from the user;
Analysis means for analyzing the emotional state of the user from one or more types of biological information detected by the detection means;
Analysis result transmission means for transmitting the analysis result of the emotional state from the analysis means to the server device;
Receiving means for receiving information about recommended content transmitted from the server device;
Notification means for notifying information on recommended content received through the receiving means,
The server device
Analysis result receiving means for receiving an analysis result of the emotional state from the client device;
Search means for searching for content recommended for the user based on the analysis result of the emotional state received through the analysis result receiving means;
An information retrieval system comprising: a transmission unit configured to transmit information regarding recommended content obtained as a result of the search by the search unit to the client device that is a request source. The information search system according to claim 9,
The client device is
A prediction result receiving means for receiving a prediction result of a user's emotional state after using the content transmitted from the server device;
Prediction notification means for notifying the prediction result received through the prediction result receiving means,
The server device
Prediction means for predicting the emotional state of the user after use of the content based on at least the characteristics of the content searched by the search means;
An information retrieval system comprising: a prediction result transmission unit configured to transmit a prediction result in the prediction unit to the client device. The information search system according to claim 9 or 10,
In the client device,
The detection means can also detect the user's biometric information when using content,
The client device is
Evaluation means for evaluating the used content based on the biometric information detected by the detection means when using the content;
Evaluation result transmission means for transmitting the evaluation result in the evaluation means to the server device,
The server device
An evaluation result receiving means for receiving the evaluation result from the client device;
In the server device,
The information search system, wherein the search means selects content to be recommended to a user in consideration of an evaluation result in the evaluation means. An information search system according to claim 9, claim 10 or claim 11,
The client device is
Accepting means for accepting input of calendar information from a user;
Transmitting means for transmitting the schedule information received through the receiving means to the server device,
The server device
A schedule information receiving means for receiving the schedule information from the client device;
In the server device,
The information search system, wherein the search means searches for content in consideration of a scheduled date in the schedule information received through the schedule information receiving means and a type of content scheduled to be used. An information retrieval system formed by connecting a client device and a server device through a predetermined network,
The client device is
Detecting means for detecting one or more types of biological information from the user;
Biometric information transmitting means for transmitting one or more types of biometric information detected by the detecting means to the server device;
Receiving means for receiving information about recommended content transmitted from the server device;
Notification means for notifying information on recommended content received through the receiving means,
The server device
Biometric information receiving means for receiving one or more types of biometric information from the client device;
Analyzing means for analyzing the emotional state of the user from one or more types of the biological information received through the biological information receiving means;
Search means for searching for content recommended to be provided to the user based on the analysis result by the analysis means;
An information retrieval system comprising: a transmission unit configured to transmit information regarding recommended content obtained as a result of the search by the search unit to the client device that is a request source. The information search system according to claim 13,
The client device is
A prediction result receiving means for receiving a prediction result of a user's emotional state after using the content transmitted from the server device;
Prediction notification means for notifying the prediction result received through the prediction result receiving means,
The server device
Prediction means for predicting the emotional state of the user after use of the content based on at least the characteristics of the content searched by the search means;
An information retrieval system comprising: a prediction result transmission unit configured to transmit a prediction result in the prediction unit to the client device. The information search system according to claim 13 or claim 14,
In the client device,
The detection means can also detect the user's biometric information when using content,
The biometric information transmitting means can transmit the biometric information detected by the detecting means when using content to the server device,
In the server device,
The biometric information receiving means is capable of receiving the biometric information detected by the detecting means of the client device at the time of content use and transmitted from the biometric information transmitting means of the client device,
The server device
Evaluation means for evaluating the used content based on the one or more biometric information detected by the detecting means of the client device when using the content received through the biometric information receiving means;
The information search system, wherein the search unit of the server device selects a content to be recommended to a user in consideration of an evaluation result in the evaluation unit. The information search system according to claim 13, 14 or 15,
The client device is
Accepting means for accepting input of calendar information from a user;
Transmitting means for transmitting the schedule information received through the receiving means to the server device,
The server device
A schedule information receiving means for receiving the schedule information from the client device;
The search unit of the server device searches for content in consideration of a scheduled date in the schedule information received through the schedule information receiving unit and a type of content scheduled to be used. Search system. The client device of the information search system in which a client device and a server device are connected through a predetermined network to provide a content recommendation service through the client device and the server device,
Detecting means for detecting one or more types of biological information from the user;
Analysis means for analyzing the emotional state of the user from one or more types of biological information detected by the detection means;
Analysis result transmission means for transmitting the analysis result of the emotional state from the analysis means to the server device;
Receiving means for receiving information about recommended content transmitted from the server device;
A client device comprising: notification means for notifying information on recommended content received through the receiving means. The client device according to claim 17, comprising:
A prediction result receiving means for receiving a prediction result of a user's emotional state after using the content transmitted from the server device;
A client apparatus comprising: a prediction notifying unit that notifies the prediction result received through the prediction result receiving unit. The client device according to claim 17 or 18, wherein:
The detection means can also detect the user's biometric information when using content,
Evaluation means for evaluating the used content based on the biometric information detected by the detection means when using the content;
An evaluation result transmission means for transmitting an evaluation result in the evaluation means to the server device. A client device according to claim 17, 18 or 19, comprising:
Accepting means for accepting input of calendar information from a user;
A client device comprising: a transmission unit that transmits the schedule information received through the reception unit to the server device. The client device of the information search system in which a client device and a server device are connected through a predetermined network to provide a content recommendation service through the client device and the server device,
Detecting means for detecting one or more types of biological information from the user;
Biometric information transmitting means for transmitting one or more types of biometric information detected by the detecting means to the server device;
Receiving means for receiving information about recommended content transmitted from the server device;
A client device comprising: notification means for notifying information on recommended content received through the receiving means. The client device according to claim 21, wherein
A prediction result receiving means for receiving a prediction result of a user's emotional state after using the content transmitted from the server device;
A client apparatus comprising: a prediction notifying unit that notifies the prediction result received through the prediction result receiving unit. The client device according to claim 21 or claim 22, wherein
The detection means can also detect the user's biometric information when using content,
The client apparatus characterized in that the biometric information transmitting means can also transmit the biometric information detected by the detecting means when using content to the server apparatus. A client device according to claim 21, claim 22 or claim 23,
Accepting means for accepting input of calendar information from a user;
A client device comprising: a transmission unit that transmits the schedule information received through the reception unit to the server device. The server device of the information search system in which a client device and a server device are connected through a predetermined network to provide a recommended content service through the client device and the server device,
Analysis result receiving means for receiving an analysis result of the emotional state from the client device;
Search means for searching for content recommended for the user based on the analysis result of the emotional state received through the analysis result receiving means;
A server device comprising: a transmission unit configured to transmit information related to a recommended content obtained as a result of the search by the search unit to the requesting client device. The server device according to claim 25, wherein
Prediction means for predicting the emotional state of the user after use of the content based on at least the characteristics of the content searched by the search means;
A server apparatus comprising: a prediction result transmission unit configured to transmit a prediction result in the prediction unit to the client device. 27. The server device according to claim 25 or claim 26, wherein:
An evaluation result receiving means for receiving the evaluation result from the client device;
The search unit selects a content to be recommended to a user in consideration of an evaluation result in the evaluation unit. A server device according to claim 25, claim 26 or claim 27,
A schedule information receiving means for receiving the schedule information from the client device;
The search means searches for content in consideration of the scheduled date of the schedule information received through the schedule information receiving means and the type of content scheduled to be used in addition to the analysis result by the analysis means. And a server device. The server device of the information search system in which a client device and a server device are connected through a predetermined network to provide a recommended content service through the client device and the server device,
Biometric information receiving means for receiving one or more types of biometric information from the client device;
Analyzing means for analyzing the emotional state of the user from one or more types of the biological information received through the biological information receiving means;
Search means for searching for content recommended to be provided to the user based on the analysis result by the analysis means;
A server device comprising: a transmission unit configured to transmit information related to a recommended content obtained as a result of the search by the search unit to the requesting client device. 30. The server device according to claim 29, wherein:
Prediction means for predicting the emotional state of the user after use of the content based on at least the characteristics of the content searched by the search means;
A server apparatus comprising: a prediction result transmission unit configured to transmit a prediction result in the prediction unit to the client device. The server device according to claim 29 or claim 30, wherein
The biometric information receiving means is capable of receiving the biometric information detected by the client device when content is used and transmitted from the client device,
An evaluation unit that evaluates the used content based on one or more of the biometric information detected in the client device when using the content received through the biometric information receiving unit;
The search unit selects a content to be recommended to a user in consideration of an evaluation result in the evaluation unit. The server device according to claim 29, claim 30, or claim 31,
A schedule information receiving means for receiving schedule information from the client device;
The server device, wherein the search unit searches for content in consideration of a scheduled date in the schedule information received through the schedule information receiving unit and a type of content scheduled to be used.

Images