JP2013029928A - Information terminal device, data processing method for the same and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information terminal device, a data processing method for the same and a program capable of simply conveying a psychological state and emotion to a communication partner.SOLUTION: The information terminal device measures biological information of a user by means of a sensor, detects predetermined particular psychological state and emotion of the user on the basis of the biological information measured by the sensor, and outputs psychology intensity information indicating intensity of the psychological state and the emotion. The information terminal device processes image data currently being generated or edited by the user, according to a previously determined processing method on the basis of a statistic value of the psychology intensity information.

Description

  The present invention relates to an information terminal device capable of sending and receiving e-mails, and taking and editing images and videos, and a data processing method and program thereof.

  When you communicate with others using e-mail, you can't see each other's facial expressions, attitudes, and so on. For example, even if you say the word “like”, it is difficult to tell how much you like it.

  If you meet and communicate with the other party directly, you can read the other party's emotions to a certain extent by using facial expressions, attitudes, and words. However, it is not always possible to meet the other party directly due to physical or time constraints. In recent years, the number of fixed telephones and mobile phones that can send and receive captured images at the same time as calls is increasing, but because the amount of data to be sent and received is large and call charges are high, when communicating psychological state and feelings to the communication partner, It is desirable to realize an information terminal device that can be used more easily.

  Patent Document 1 describes an apparatus and a method for detecting a human emotion and visualizing the emotion with a color.

JP 2005-058449 A

  As described above, if you communicate directly with a communication partner, you can read the other party's emotions to some extent by facial expressions, attitudes, wording, and the like. However, it is not always possible to meet the other party directly due to physical or time constraints.

  Also, fixed telephones and mobile phones that can send and receive captured images at the same time as calls have a large amount of data to be sent and received, and communication charges are high, so information that can be used more easily when communicating psychological state and emotions to the other party Realization of a terminal device is desirable.

  The present invention has been made to solve the problems of the background art as described above, and an information terminal device capable of easily transmitting a psychological state and emotion to a communication partner, a data processing method thereof, and a program therefor The purpose is to provide.

In order to achieve the above object, an information terminal device according to the present invention includes a biological information detecting unit that measures biological information of a user,
Based on the biological information measured by the biological information detection means, a predetermined psychological state / emotion of the user determined in advance, and a psychological state detection means for outputting psychological strength information indicating the strength;
Data processing means for processing the image data being created or edited by the user according to a predetermined processing method based on the statistical value of the psychological intensity information;
Have

On the other hand, the data processing method of the present invention is a data processing method of an information terminal device,
Processing equipment
Measure the user's biological information using sensors,
Based on the biological information measured by the sensor, the specific psychological state / emotion of the user determined in advance is detected, and psychological strength information indicating the strength is output,
A method of processing image data being created or edited by the user according to a predetermined processing method based on a statistical value of the psychological intensity information.

The program of the present invention is a program for causing an information terminal device to process image data,
Using the sensor to measure the user's biological information,
Based on the biological information measured by the sensor, the specific psychological state / emotion of the user determined in advance is detected, and psychological strength information indicating the strength is output,
Based on the statistical value of the psychological intensity information, the image data being created or edited by the user is processed according to a predetermined processing method.

  ADVANTAGE OF THE INVENTION According to this invention, the information terminal device which can transmit a mental state and an emotion easily to a communicating party is implement | achieved.

It is a block diagram which shows the example of 1 structure of the information terminal device of this invention. It is a block diagram which shows the structural example of embodiment of the information terminal device shown in FIG. It is a flowchart which shows an example of the process sequence by the information terminal device shown in FIG. It is a schematic diagram which shows an example of the data processing method by the information terminal device shown in FIG.

  Next, the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing an example of the configuration of the information terminal device of the present invention.

  As shown in FIG. 1, the information terminal device according to the present invention includes a biological information detection unit 10 that measures a user's biological information, and the predetermined information based on the biological information measured by the biological information detection unit 10. Based on the psychological state detection means 20 that detects a specific psychological state / emotion of the user and outputs psychological intensity information indicating the strength, and the user is creating or editing based on the statistical value of the psychological intensity information Data processing means 30 for processing the image data according to a predetermined processing method.

  FIG. 2 is a block diagram showing a configuration example of an embodiment of the information terminal device shown in FIG.

  As shown in FIG. 2, the information terminal device 1 of the present embodiment includes an input unit 2, an operation detection unit 3, a display unit 4, a communication unit 5, a biological information detection unit 6, a psychological state detection unit 7, and a data processing unit 8. Is provided.

  As the information terminal device 1, for example, a well-known mobile phone, PHS (Personal Handyphone System), PDA (Personal Data Assistance, Personal Digital Assistants), game machine, notebook type or tablet type personal computer There are stationary personal computers and the like.

  The input unit 2 is an input unit for inputting user instructions or data such as characters, numbers, and symbols to the information terminal device 1. The input unit 2 is realized by a known touch panel, keyboard, three-dimensional non-contact operation interface, or other input means.

  The operation detection unit 3 detects an operation (instruction input or data input of characters, numbers, symbols, etc.) of the information terminal device 1 by the user, and sends it to the biological information detection unit 6, the psychological state detection unit 7, and the data processing unit 8. Notify the detection result.

  The display unit 4 is a liquid crystal display or an organic EL panel that displays an image being processed by the information terminal device 1. When the input unit 2 is a touch panel, the touch panel may be installed on the display surface of the display unit 4.

  The communication unit 5 is a well-known communication circuit for transmitting and receiving various types of information such as e-mail, voice, and images to and from an information terminal device that is a communication partner via a network by wireless communication or wired communication.

  The biological information detection unit 6 measures the biological information of the user who is operating the information terminal device 1. This “operation” may include a state where the user is simply viewing the display unit 4. The biological information detection unit 6 is realized by various known sensors that measure a user's body temperature, pulse, blood pressure, sweating, and the like. A sensor necessary for detecting a specific psychological state / emotion of the user who is a detection target of the psychological state detecting unit 7 may be used as the biological information detecting unit 6. The biological information detection unit 10 illustrated in FIG. 1 is realized by the biological information detection unit 6.

  The psychological state detection unit 7 detects a specific psychological state / emotion of a predetermined user based on the biometric information detected by the biometric information detection unit 6, and indicates information indicating the strength (hereinafter, psychological strength information). Output). The psychological state / emotion of the user to be detected is preferably a positive psychological state such as “happy” or “fun”. As a method for detecting a person's psychological state / emotion, for example, the technique described in Patent Document 1 may be used. By detecting only a specific psychological state / emotion of a predetermined user in this way, the types of sensors necessary for detecting biometric information can be reduced. A psychological state detection unit 7 is obtained. The psychological state detection means 20 shown in FIG.

  The data processing unit 8 processes the image data being created or edited by the user using the information terminal device 1 based on the psychological intensity information output from the psychological state detection unit 7 and displays the processed image data Presented to the user by part 4. Examples of the processing target include an e-mail or an image or video taken by a user with a camera provided in the information terminal device 1. Processing methods include (1) change of fonts and colors of characters and symbols, (2) addition or change of pictograms and character images, (3) change of hue, saturation, brightness, etc. of display images, (4 ) Changes in facial expressions and clothes of persons, animals, characters, etc. included in the display image. The processing method may be set in advance for each processing target, for example, corresponding to the user's specific psychological state / emotion strength.

  The data processing unit 8 according to the present embodiment is output from the psychological state detection unit 7 while the user is creating or editing an e-mail, or while the user is taking an image or video with the camera, or before and after. Psychological intensity information is acquired in time series, and statistical values (maximum value, average value, minimum value, median value, mode value, standard deviation, variance, and / or addition / subtraction / division of those time series psychological intensity information are obtained. The image data is processed based on the combination. The image data may be processed when, for example, the maximum value or average value of the psychological intensity information is equal to or greater than a preset threshold value. Note that the threshold value need not be one, and a plurality of threshold values may be set, and the image data processing method may be changed according to the stage of each threshold value.

  Thus, by processing image data based on the statistical value of psychological intensity information, even if the user's psychological state / emotion fluctuates, the data processing unit 8 stably detects the user's specific psychological state / emotion. can do. Therefore, detection errors of the user's psychological state / emotion are reduced. In addition, if the psychological state / emotion of the user to be detected is set to a positive psychological state such as “joyful” or “fun”, the user does not want to communicate to the communication partner. Such a negative psychological state is not detected and the image data is not processed. Therefore, the person who views the processed data does not feel unpleasant.

  The data processing unit 8 may perform only the processing of the image data based on the psychological intensity information output from the psychological state detection unit 7, and may disable the processing of the image data by other means or a user's intentional operation. . In that case, for a person who views the processed e-mail or image (for example, a communication partner), the psychological state of the creator or photographer indicated by the processed e-mail or image is not a lie, and there is credibility. It turns out that it is expensive. The data processing means 30 shown in FIG. 1 is realized by the data processing unit 8.

  The e-mail or the like processed by the data processing unit 8 is transmitted by the communication unit 5 to the information terminal device serving as a communication partner via the network in accordance with a user operation.

  The operation detection unit 3, the psychological state detection unit 7, and the data processing unit 8 illustrated in FIG. 2 can be realized by a processing device including a known CPU (Central Processing Unit), DSP (Digital Signal Processor), memory, and the like. In that case, the CPU realizes the function as the information terminal device 1 by executing processing according to a predetermined control program stored in the memory, and also includes the operation detection unit 3, the psychological state detection unit 7, and the data processing unit. 8 function is realized.

  Next, the operation of the information terminal device shown in FIG. 2 will be described using the drawings.

  FIG. 3 is a flowchart showing an example of a processing procedure by the information terminal device shown in FIG. 2, and FIG. 4 is a schematic diagram showing an example of a data processing method by the information terminal device shown in FIG.

  Hereinafter, an example will be described in which the processing target is an electronic mail being created by the user, and the electronic mail is processed according to the psychological state and emotional strength of the user.

  As shown in FIG. 3, when the user operates the information terminal device 1 to start creating an e-mail, the operation detecting unit 3 detects an operation (creating an e-mail) by the user (step S1), and the detection. The result is notified to the biological information detection unit 6, the psychological state detection unit 7, and the data processing unit 8.

  When notified of the start of the user operation from the operation detection unit 3, the biological information detection unit 6 measures the predetermined biological information of the user and outputs the measurement value (step S2).

  The psychological state detection unit 7 detects a specific psychological state / emotion of a predetermined user based on the biometric information measured by the biometric information detection unit 6 and outputs psychological strength information indicating the strength ( Step S3).

  Based on the notification from the operation detection unit 3, the data processing unit 8 acquires psychological intensity information output from the psychological state detection unit 7 in time series while the user is creating or editing an e-mail or before and after the e-mail. Then, the statistical value of the time-series psychological intensity information is calculated. If the statistical value of the psychological intensity information is greater than or equal to a preset threshold value, the e-mail being created is processed according to a predetermined processing method (step S4). For example, when the psychological state / emotion of the user to be detected is the above-mentioned “joyful”, “fun” or the like, and the user inputs “I like” to the e-mail as shown in FIG. If the statistical value of information is equal to or greater than a predetermined threshold, the sentence may be processed so as to be surrounded by a plurality of heart marks as shown in FIG.

  According to the information terminal device of the present embodiment, since only the specific psychological state / emotion of the user determined in advance by the psychological state detection unit 7 can be detected, the types of sensors necessary for detecting biological information can be reduced. A biological information detection unit 6 and a psychological state detection unit 7 that are smaller and more feasible are obtained. Therefore, an information terminal device capable of easily transmitting a psychological state and emotion to a communication partner is realized.

  Further, by processing the image data based on the statistical value of the psychological intensity information, the data processing unit 8 stably detects the specific psychological state / emotion of the user even if the psychological state / emotion of the user fluctuates. be able to. Therefore, detection errors of the user's psychological state / emotion are reduced. In addition, if the psychological state / emotion of the user to be detected is set to a positive psychological state such as “happy” or “fun”, the user does not want to communicate to the communication partner, such as “dislike” or “dull” Image data is not processed based on a negative psychological state. For this reason, it is prevented that a person who views the processed data feels unpleasant.

  Furthermore, if the data processing unit 8 performs only the processing of the image data based on the psychological intensity information output from the psychological state detection unit 7, and disables the processing of the image data by other means or a user's intentional operation. For those who view the processed e-mail or image, it can be seen that the psychological state of the creator or photographer indicated by the processed e-mail or image is not a lie but a highly reliable one.

DESCRIPTION OF SYMBOLS 1 Information terminal device 2 Input part 3 Operation detection part 4 Display part 5 Communication part 6 Biological information detection part 7 Psychological state detection part 8 Data processing part 10 Biological information detection means 20 Psychological state detection means 30 Data processing means

Claims (10)

Biological information detection means for measuring the biological information of the user;
Based on the biological information measured by the biological information detection means, a predetermined psychological state / emotion of the user determined in advance, and a psychological state detection means for outputting psychological strength information indicating the strength;
Data processing means for processing the image data being created or edited by the user according to a predetermined processing method based on the statistical value of the psychological intensity information;
An information terminal device. The data processing means is
Psychological intensity information output from the psychological state detecting means during creation or editing by the user or before and after is acquired in time series, and the image data is based on the maximum value or average value of the time series psychological intensity information. 2. The information terminal device according to claim 1, wherein the information terminal device is processed. The psychological state detecting means is
The information terminal device according to claim 1, wherein a positive psychological state is detected as the psychological state / emotion of the specific user. The data processing means is
The information terminal device according to any one of claims 1 to 3, wherein the image data is processed based only on psychological intensity information output from the psychological state detection means. A data processing method for an information terminal device,
Processing equipment
Measure the user's biological information using sensors,
Based on the biological information measured by the sensor, the specific psychological state / emotion of the user determined in advance is detected, and psychological strength information indicating the strength is output,
A data processing method for processing image data being created or edited by the user according to a predetermined processing method based on a statistical value of the psychological intensity information. The processing device is
The psychological intensity information output by the user during creation, editing, or before and after is acquired in time series, and the image data is processed based on a maximum value or an average value of the time series psychological intensity information. 5. The data processing method according to 5. The processing device is
The data processing method according to claim 5, wherein a positive psychological state is detected as the psychological state / emotion of the specific user. The processing device is
The data processing method according to claim 5, wherein the image data is processed based only on the psychological intensity information. A program for causing an information terminal device to process image data,
Using the sensor to measure the user's biological information,
Based on the biological information measured by the sensor, the specific psychological state / emotion of the user determined in advance is detected, and psychological strength information indicating the strength is output,
A program for processing image data being created or edited by the user according to a predetermined processing method based on a statistical value of the psychological intensity information.   For obtaining the psychological intensity information output during or before or after creation by the user in time series, and for processing the image data based on the maximum value or the average value of the time series psychological intensity information The program according to claim 9.

Images