CN109770918A - Mood analytical equipment, method and the machine readable storage medium for recording this method program - Google Patents

Mood analytical equipment, method and the machine readable storage medium for recording this method program Download PDF

Info

Publication number
CN109770918A
CN109770918A CN201711251334.6A CN201711251334A CN109770918A CN 109770918 A CN109770918 A CN 109770918A CN 201711251334 A CN201711251334 A CN 201711251334A CN 109770918 A CN109770918 A CN 109770918A
Authority
CN
China
Prior art keywords
testee
image
mood
induction
analysis
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711251334.6A
Other languages
Chinese (zh)
Inventor
柳淑姬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
He Jia Co
Original Assignee
He Jia Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by He Jia Co filed Critical He Jia Co
Publication of CN109770918A publication Critical patent/CN109770918A/en
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/165Evaluating the state of mind, e.g. depression, anxiety
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/48Other medical applications
    • A61B5/486Bio-feedback
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • G06V20/63Scene text, e.g. street names
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Public Health (AREA)
  • Biomedical Technology (AREA)
  • Tourism & Hospitality (AREA)
  • Psychiatry (AREA)
  • Veterinary Medicine (AREA)
  • Animal Behavior & Ethology (AREA)
  • Surgery (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Multimedia (AREA)
  • General Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Social Psychology (AREA)
  • Strategic Management (AREA)
  • Primary Health Care (AREA)
  • Marketing (AREA)
  • Psychology (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Economics (AREA)
  • Child & Adolescent Psychology (AREA)
  • Developmental Disabilities (AREA)
  • Educational Technology (AREA)
  • Hospice & Palliative Care (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

The present invention relates to the readable storage medium storing program for executing that a kind of testee's mood analytical equipment, method and record have the program for executing this method.The present invention provides a kind of readable storage medium storing program for executing for having the program for executing this method for the Analysis server and analytical equipment of mood analysis, method and record comprising: communication module is communicated with analytical equipment;Memory module, storage induction image, the induction image provide the induction testee stimulation for expressing any one of a variety of moods mood;And control module, it transmits the induction image to the analytical equipment by the communication module, the frequency that testee expresses mood is exported from receiving display testee to induction image reaction from the analytical equipment later after data, then from described in data.

Description

Mood analytical equipment, method and the machine readable storage medium for recording this method program
Technical field
The present invention relates to a kind of mood analytical technologies.Specifically, a kind of offer induction testee expression feelings are exactly provided Device, method and the record for testee's mood that the presentation content of thread is showed to analysis have the program for executing this method Machine readable storage medium.
Background technique
So-called " psychological test " refers to be facilitated by the psychology such as intelligence, personality of measurement someone to this People carries out deeper time and analytical understanding, and executes a series of psychology mensuration program to subject, can by this measure It is assessed with the psychological characteristic to the individual such as spiritual pathology, adaptability, anlage.Psychological test is according to standardized mode Clinician by having received professional training executes.Psychological test is broadly divided into objective test and projective test (Projective Test)。
[advanced technical literature]
[patent document]
KR published patent the 2014-0053426th, on May 08th, 2014 open, and the three-dimensional psychology of entitled offer is surveyed Test the method and server of service.
Detailed description of the invention
Technical problem to be solved
The presentation content of mood is expressed to divide by providing induction testee the object of the present invention is to provide a kind of Device, method and the record for analysing the testee's mood showed have the machine readable storage medium for the program for executing this method.
The method for solving technical problem
To achieve the goals above, desirable embodiment is used for the Analysis server that mood is analyzed according to the present invention, comprising: logical Believe module, is communicated with analytical equipment;Memory module, storage induction image, it is tested which provides induction Person expresses the stimulation of any one of a variety of moods mood;And control module, by the communication module to described point Analysis apparatus transmits the induction image, receives what display testee reacted the induction image from the analytical equipment later The frequency that testee expresses mood is exported after observing data, then from described in data.
Further, the induction image, comprising: performance image, the performance image include: display with expression performance mood Cartoon figure image, the mood be induction testee with the mood to be expressed;And in order to tell about the testee Experience the experience of the mood, the sound and sympathetic response image that the cartoon figure puts question to the testee, the sympathetic response shadow Image as including: situation when the display cartoon figure experiences the mood;And the cartoon figure to the situation into The sound of row explanation.
Further, the control module embodies what testee reacted according to from during the performance image is shown The frequency that derived testee in data expresses mood is observed, the Emotion expression power of testee is assessed, and root According to derived testee expresses mood in data from embodying testee's reaction during the sympathetic response image is shown Frequency, the sympathetic response ability of testee is assessed.
Further, the control module, over the ground with the performance image or the sympathetic response image, from data Export is identified the reason of mood difference mood reason with induction testee's expression image and reason sound.
To achieve the goals above, desirable embodiment is used for the analytical equipment that mood is analyzed according to the present invention, comprising: camera shooting Portion, shoot testee and by the image of the testee, the testee image in characteristic point three-dimensional coordinate Displacement and the testee pupil image as observation data detect;Audio portion obtains the testee Sound as observation data;Display unit accordingly shows that offer induces testee's expression with a variety of moods respectively The induction image of the stimulation of specific emotional;And control unit, it is accordingly mentioned in data from described with the induction image It takes testee to express the frequency of mood, and is analyzed according to mood of the frequency of extraction to the testee.
Further, the induction image, comprising: performance image, the performance image include: display with expression performance mood Cartoon figure image, the mood be it is corresponding with a variety of moods respectively, induction testee with the mood to be expressed;And The experience of the mood is experienced in order to tell about the testee, the sound that the cartoon figure puts question to the testee Sound;And sympathetic response image, the sympathetic response image include: the image of situation when the display cartoon figure experiences the mood;And The sound that the cartoon figure is illustrated the situation.
Further, the control unit, from the observed number for embodying testee's reaction during the performance image is shown According to it is middle export testee Emotion expression power, and from during the sympathetic response image show embody testee reaction sight Examine the sympathetic response ability that testee is exported in data.
Further, the control unit, with the performance image or the sympathetic response image accordingly from data Export is identified the reason of mood difference mood reason with induction testee's expression image and reason sound.
To achieve the goals above, the mood analysis method of the Analysis server of desirable embodiment according to the present invention, comprising: The induction image transmission of corresponding with a variety of moods, induction testee's expression specific emotional stimulation respectively will be provided to analysis The step of device;The step of embodying data from testee reacts the induction image is received from the analytical equipment; And the frequency of testee's expression mood is extracted in data from described, and according to the frequency of extraction to the testee Mood the step of being analyzed.
To achieve the goals above, the mood analysis method of the analytical equipment of desirable embodiment according to the present invention, comprising: aobvious The step for inducing image for expressing the stimulation of specific emotional of, the induction testee corresponding with a variety of moods respectively will be provided by showing Suddenly;By the image of the testee corresponding with the induction image of display, embodying testee reaction, described The displacement of the three-dimensional coordinate of characteristic point in the image of testee, the pupil image of the testee and the testee The step of sound is collected as observation data;And the frequency of testee's expression mood is extracted in data from described Rate, and the step of being analyzed according to mood of the frequency of extraction to the testee.
In addition, the present invention provides a kind of machine readable storage medium, record, which has, executes aforementioned ideal according to the present invention in fact Apply the program of the mood analysis method of the Analysis server of example.
In addition, the present invention provides a kind of machine readable storage medium, record, which has, executes aforementioned ideal according to the present invention in fact Apply the program of the mood analysis method of the analytical equipment of example.
Invention effect
It according to the present invention, can be by inducing the induction image of specific emotional to carry out careful point to the mood of testee Analysis, and necessary consulting can be provided for testee based on this mood analysis result.
Detailed description of the invention
Fig. 1 is the schematic diagram for indicating testee's mood analysis system according to an embodiment of the present invention;
Fig. 2 is the composition block diagram for indicating psychological assessment Analysis server according to an embodiment of the present invention;
Fig. 3 is the long-range composition block diagram for surveying reading analytical equipment indicated according to an embodiment of the present invention;
Fig. 4 to Figure 12 is the picture example for indicating induction image according to an embodiment of the present invention;
Figure 13 is the flow chart of testee's mood analysis method according to an embodiment of the present invention;
Figure 14 to Figure 22 is the schematic diagram for indicating testee's mood analysis Fang Ming according to an embodiment of the present invention.
Description of symbols
100: Analysis server 110: communication module
120: memory module 130: control module
200: virtual machine 300: analytical equipment
310: communication unit 320: image pickup part
330:3D sensor 330: audio portion
350: input unit 360: display unit
370: storage unit 380: control unit
Specific embodiment
Before the present invention is described in detail, need to be illustrated following situations, i.e. this explanation set forth below Term used in book and claims or word cannot only be defined in ordinary meaning or dictionary paraphrase goes to understand, should Based on " inventor can be suitably fixed to the progress of the concept of term in order to be illustrated by optimal method to the invention of its own The principle of justice ", explains according to the meaning and concept that meet technical thought of the invention.Therefore, the reality enumerated in this specification Applying example and composition shown in the drawings is only the optimal embodiment of the present invention, does not represent whole technical ideas of the invention. Therefore, it is to be understood that being, when proposing the application, it is understood that there may be their a variety of equivalents and variation can be replaced.
Desirable embodiment of the invention is described in detail next, with reference to attached drawing.In this case it is necessary to infuse It anticipates, same inscape can be embodied with identical symbol as far as possible in attached drawing.In addition, for the public affairs that may water down present subject matter Know function and composition, is just no longer described in detail here.Based on same reason, constituent element a part of in attached drawing is carried out Exaggeration is omitted or is schematically shown, the size of each constituent element simultaneously non-fully reflects its actual size.
Firstly, by being illustrated to testee's mood analysis system according to an embodiment of the present invention.Fig. 1 is to indicate foundation The schematic diagram of testee's mood analysis system of the embodiment of the present invention.
As shown in Figure 1, testee's mood analysis system (hereinafter referred to as " mood analysis system according to an embodiment of the present invention System "), comprising: Analysis server 100, virtual machine (Virtual Machine) 200 and analytical equipment 300.Unaccounted attached drawing Symbol 400 is analysis compartment (booth), and analytical equipment 300 can be set in this analysis compartment 400, and testee can be with Receive mood analysis or psychological test in analysis compartment 400.Be in an embodiment of the present invention, child with testee, It is illustrated in case where children.But the present invention is not only defined in this, even adult, can also execute according to this The mood of inventive embodiments is analyzed or psychological test.
Analysis server 100 and virtual machine 200 are the entities (entity) being present on network, and analytical equipment 300 is to set It sets and is carrying out the device in mood analysis or psychological test place to testee.
Mood analysis or the heart are provided in a manner of virtualizing in the desktop computer (desktop) based on cloud (cloud) technology In the case where reason assessment, the property of can choose virtual machine 200 is used.In this case, virtual machine 200 is by analytical equipment 300 It is converted to according to the data that HTTP (hypertext transfer protocol) is transmitted and meets RDP (remote des ktop Protocol data) and the data for being transmitted to Analysis server 100, and Analysis server 100 being transmitted according to RDP It is converted to the data for meeting HTTP and is transmitted to analytical equipment 300.
Substantially, Analysis server 100 according to an embodiment of the present invention will be used to analyze the image of testee's mood i.e. Stimulation image is supplied to analytical equipment 100, and stimulation image provides stimulation, to induce testee to express any one in a variety of moods Kind specific emotional (hereinafter referred to as " derived emotion ").
Stimulation image induces testee to be answered according to the instruction of image or by watching coherent video according to institute The problem of proposition, is answered.This image for psychological assessment can distinguish offer according to different problems.That is, will An evaluation problem for carrying out psychological assessment is fabricated to an assessment image.The image for carrying out psychological assessment is known as " commenting Estimate image ".
In addition, the image for being used to evaluate testee's psychology is assessed image by Analysis server 100 is supplied to analysis dress Set 300, this assessment image induction testee answered by viewing coherent video according to the instruction for assessing image or According to it is proposed the problem of answered.This assessment image for psychological assessment can be distinguished according to different problems It provides.That is, an evaluation problem for carrying out psychological assessment is fabricated to an assessment image.
Analytical equipment 300, which provides, assesses image provided by Analysis server 100, so that testee is it can be seen that divide Analysis apparatus 300 collects answer of the testee to assessment image, and provides it to Analysis server 100.Meanwhile analytical equipment 300 collect testee's reaction of viewing assessment image, and provide it to Analysis server 100.If according to testee Reaction or with setting rule meet as defined in condition, then Analysis server 100 by control analytical equipment 300 so that its The mode of conversion display assessment image, can induce testee to focus on carrying out psychological assessment.For this display side Formula is described in more details later.
Next, being carried out being constituted to the Analysis server 100 for being used for psychological assessment according to an embodiment of the present invention more Detailed description.Fig. 2 is the composition block diagram for indicating psychological assessment Analysis server according to an embodiment of the present invention.As shown in Fig. 2, It is used for the Analysis server 100 of psychological assessment according to an embodiment of the present invention, comprising: communication module 110, memory module 120 and control Molding block 130.
Communication module 110 with analytical equipment 300 for directly being communicated or for filling via virtual machine 200 and analysis 300 are set to be communicated.For example, communication module 110 can be communicated by network with analytical equipment 300.In order to pass through network Data are transmitted, communication module 110 includes modem (Modem), is modulated to the signal of transmission, and to received letter It number is demodulated.This communication module 110 is by the data transmitted by control module 130 by network transmission to analytical equipment 300. In addition, the data received are transferred to control module 130 by communication module 110.
Memory module 120 plays the role of storage Analysis server 100 and runs required program and data.In particular, depositing The image for being used for psychological assessment according to an embodiment of the present invention, i.e. assessment image can be stored by storing up module 120.It is saved in and deposits Various data in storage module 120 can be registered depending on the user's operation, delete, change, add.
Control module 130 can play 100 internal component of all operations and Analysis server to Analysis server 100 (block) signal flow between is controlled, and handles the data processing function of data.Control module 130 can be center Processor (CPU:Central Processing Unit), digital signal processor (DSP:Digital Sig nal Processor) etc..Later, the operation of this control module 130 will be described in more details.
Next, will be carried out to the composition for the analytical equipment 300 for being used for psychological assessment according to an embodiment of the present invention more detailed Thin explanation.Fig. 3 is to indicate that (remote meter reading) analytical equipment structure is read in long-range survey according to an embodiment of the present invention At block diagram.As shown in figure 3, analytical equipment 300 according to an embodiment of the present invention, comprising: communication unit 310, image pickup part 320,3D Sensor 330, audio portion 340, input unit 350, display unit 360, storage unit 370 and control unit 380.
Communication unit 310 is the unit communicated with Analysis server 100.Communication unit 310 can be taken by network and analysis Business device 100 is communicated.Communication unit 310, comprising: RF (Radio Frequency) transmitter Tx, by the signal frequency of transmission It carries out rising conversion and amplification;Received signal is carried out low noise amplification and frequency is carried out decline to turn by RF receiver Rx It changes.In addition, communication unit 310, comprising: modem is modulated the signal of transmission, and solves to received signal It adjusts.Received information (message), i.e. survey read request information are transferred to control unit 380 by communication unit 310.In addition, communication unit 310 receive the information sent by control unit 380, that is, survey and read response message, and be transmitted to Analysis server by network 100。
Image pickup part 320 includes at least imaging sensor for shooting testee.Imaging sensor is received from shooting pair As reflection light and convert thereof into electric signal, CCD (Charged Coupled Device), CMOS can be based on (Complementary Metal-Oxide Semiconductor) etc. is realized.The ministry of photography 320, further includes: analog to digital turns Parallel operation (Analog to Digital Converter), the analog signal exported by imaging sensor can be converted into counting Word signal is simultaneously transmitted to control unit 380.In particular, image pickup part 320, comprising: 3D sensor 330.3D sensor 330 exports The three-dimensional coordinate x, y, z of each pixel of the image of the shooting of the point CP on the basis of three-dimensional coordinate origin is simultaneously transmitted to control unit 380.3D sensor 330 can be using the sensor using various ways such as laser, infrared ray, visible lights.This 3D sensor Portion 330 can enumerate: utilize time-of-flight method (Time of Flight, TOP), phase shift (Phase-shift) and online waveform Analyze the laser mode spatial digitizer of any one in (Online Waveform Analysis);Utilize optic triangle method Laser mode spatial digitizer;Utilize white light or the optical mode spatial digitizer of modulation light;;Utilize graphic projection The optical mode or laser mode body scan of (Pattern Projection) or linear scan (Line Scanning) Instrument;Using the photographic means scanner of photogrammetry (Phot ogrammetry);Utilize the real-time of Kinect Fusion (Real Time) scanner etc..In addition, though show that 3D sensor 330 is included in image pickup part 320 in figure, but 3D is sensed Device 330 also may be constructed module isolated with image pickup part 320 outside.
Audio portion 340, comprising: microphone MIC and loudspeaker SPK.Audio portion 340 receives the sound of user by microphone MIC Then the sound received is supplied to control unit 380 by sound.In addition, audio portion 340 leads to the sound inputted by control unit 380 Cross loudspeaker SPK output.
Input unit 350 receives the operational order that user controls analytical equipment 300, generates input signal and is passed It is defeated by control unit 380.Input unit 350 includes: for controlling the various instructions (key) of analytical equipment 300.When input unit 350 is When being made of the touch screen of display unit 360, the function of various instructions can be realized in display unit 360, and only pass through touching Touch screen be just able to carry out institute it is functional in the case where, input unit 350 can also be omitted.
Display unit 360 leads to the menu of analytical equipment 300, the data of input, function set information and other much informations Visual means are crossed to provide a user.Display unit 360 executes start picture, standby picture, the menu screen of output analytical equipment 300 The function of equal pictures.In particular, display unit 360 executes the function for exporting assessment image according to an embodiment of the present invention by picture Energy.Display unit 360 can be both made of a display device (screen), can also be made of multiple display devices.It is this aobvious Show portion 360 can by liquid crystal display device (LCD, Liquid Crystal Displa y), Organic Light Emitting Diode (OLED, Organic Light Emitting Diodes), active organic light-emitting diode (AMOLED, Active Matrix Organic Light Emitting Diodes) etc. constitute.In addition, display unit 360 can be realized by touch screen.This In the case of, display unit 360 includes touch sensor.The touch input of touch sensor induction user.Touch sensor both can be with By capacitive way (capacitive overlay), pressure type, resistive film mode (resistive overlay), infrared ray sense The touch sensibles sensors such as mode (infrared beam) are answered to constitute, it can also be by pressure sensitive sensor (pressure Sensor it) constitutes.Other than the sensor, it is capable of the sensor device of the contact of sense object or all kinds of pressure It can be employed as touch sensor of the invention.Touch sensor incudes the touch input of user, generates inductive signal and is passed It is defeated by control unit 380.In particular, when display unit 360 is made of touch screen, some or all of input unit 350 function can be with It is realized by display unit 360.
Storage unit 370 plays the role of storage analytical equipment 300 and runs required program and data.In particular, storage unit 370 can store the image for psychological assessment.The various data being stored in storage unit 370 can all in accordance with the operation of user It is deleted, change, adds.
Control unit 380 can play the letter between 300 internal component of all operations and analytical equipment to analytical equipment 300 Number flowing is controlled, and handles the data processing function of data.In addition, control unit 380 essentially functionss as control analytical equipment The effect of 300 various functions.Control unit 380, comprising: central processing unit (CPU:Central P rocessing Unit), Digital signal processor (DSP:Digital Signal Processor) etc..Later, by the operation to this control unit 380 It is described in more details.
Next, by being illustrated to induction image according to an embodiment of the present invention.Fig. 4 to Figure 12 is indicated according to this hair The picture example of the induction image of bright embodiment.
Firstly, as shown in Fig. 4 to Figure 12, induction image according to an embodiment of the present invention, comprising: respectively with a variety of moods pair The performance image and sympathetic response image answered.That is, providing one group of performance image and sympathetic response image for a certain mood.Show image And sympathetic response image induction testee expresses specific emotional.
In particular, performance image, comprising: the cartoon character wanted induction testee and express mood is expressed in display by expression The image of object (character);And putd question to by cartoon figure to testee, to induce testee to the warp for experiencing mood Test the sound told about.In addition, performance image, further includes: utilized above in collection in the stipulated time after enquirement terminates The image of testee answered with reacted.For example, performance image can be cartoon figure at the appointed time in progress bar The image run above (Progress bar).
In addition, sympathetic response image, comprising: the image of situation when display cartoon figure experiences related emotional;And cartoon figure couple The sound that correlation circumstance is illustrated.Fig. 5, Fig. 6, Fig. 7, Fig. 8, Fig. 9, Figure 10 and Figure 11 are respectively illustrated and tranquil, happy, compassion Wound, frightened, surprised, detest, the corresponding example for showing image and sympathetic response image of indignation.
For example, (c) in Fig. 6 is an example for happy performance image, the performance image of (c) will block in Fig. 6 The mood that logical personage wants induction testee's expression is that happiness is expressed by expression.At the same time, wherein also including: for It tells about testee and experiences the sound that cartoon figure wants the mood i.e. experience of happiness of inducing expression and putd question to.This Kind performance image induces testee to experience happiness, and testee is made to tell about happiness by the happy expression of cartoon figure Experience, so that testee's natural terrain be induced to expose happy expression.
In addition, (d) in Fig. 6 is an example for happy sympathetic response image, and the sympathetic response image of (d) in Fig. 6, packet It includes: the image of situation when the mood of the desired induction of display impression is i.e. happy;And the sound that the case where when to impression happiness is illustrated Sound.This sympathetic response image provides cartoon figure's sound for showing the image with mood correlation circumstance and being illustrated to the situation, To induce testee to empathize correlation circumstance and experience the mood being consistent with correlation circumstance.
In addition, as shown in Fig. 4 and Figure 12, induction image according to an embodiment of the present invention, further includes: start image and end Image.It has been represented in Fig. 4 the picture example of beginning image according to an embodiment of the present invention, has illustrated the picture for terminating image in Figure 12 Face example.Start image and terminate image while prompt test starts with terminating, in order to allow testee to be familiar with cartoon character Object, to increase the number that cartoon figure is presented to testee.
Next, by being illustrated to the method using aforementioned induction image analysing computer testee mood.Figure 13 is foundation The flow chart of testee's mood analysis method of the embodiment of the present invention, Figure 14 to Figure 22 are indicated according to an embodiment of the present invention The schematic diagram of testee's mood analysis method.
As shown in figure 13, the control module 130 of Analysis server 100 is lured from the extraction of memory module 120 in step s 110 Image is led, and analytical equipment 300 is transmitted to by communication module 110.In this case, the induction image transmitted, Include: beginning image, terminate image and respectively performance image corresponding with a variety of moods and sympathetic response image.
After the control unit 380 of analytical equipment 300 receives induction image by communication unit 310, lead in step S120 Cross the display induction image of display unit 360.In this case, control unit 380 can successively show start image, respectively with it is a variety of The corresponding performance image of mood and sympathetic response image, and terminate image.
If display assessment image, testee will make corresponding reaction after watching assessment image.
Control unit 380 is in step s 130 by the inclusion of in the image pickup part 320 of 3D sensor 330 and audio portion 340 as a result, At least one device collect the stipulated time above testee reaction as observation data.For example, control unit 380 can lead to The image pickup part 320 comprising 3D sensor 330 is crossed to the three-dimensional coordinate of characteristic point in the image and testee's image of testee Displacement as observation data be collected.In particular, the image of testee can be comprising testee's facial image and Testee's Whole body images of pupil image.In addition, control unit 380 can collect sound as observation data by audio portion 340. In particular, control unit 380 can be received by audio portion 340 after providing the enquirement that performance image is included in induction image Collect related answers, that is, sound as observation data.
This observation data can distinguish receipts according to performance image corresponding with a variety of moods and sympathetic response image respectively Collection.For example, when exist with comprising tranquil, happy, sad, frightened, surprised, detest and the corresponding performance shadow of 7 kinds of angry moods When picture and sympathetic response image, so that it may distinguish collection observation data for 14 images respectively.
After the observation data for being collected into testee's reaction, control unit 380 passes through observation data in step S140 Communication unit 310 is transferred to Analysis server 100.It is received in the control module 130 of Analysis server 100 by communication module 110 To after observation data, the mood of testee is analyzed based on observation data in step S150.In implementation of the invention In example, control module 130 can be analyzed the mood of testee, thus to the Emotion expression power of testee and sympathetic response Ability is assessed.In addition, mood of the control module 130 by analysis testee, the mood for the testee that must send as an envoy to is generated The reason of change dramatically.
In this case, control module 130 utilizes action recognition, Expression Recognition, pupil tracing and voice recognition technology At least one of technology data analyze the mood of testee according to the observation.It is analyzed according to using the mood of Expression Recognition Embodiment, control module 130 are specifically used for determining the facial expression of testee in testee's image of data from Characteristic point, and according to the expression and a variety of moods corresponding with the expression of the position of specific characteristic point export testee Intensity.In addition, the highest Emotion identification of intensity in a variety of moods can be the mood of testee by control module 130.Example Such as, as shown in figure 14, an observation data include testee's image of shooting testee, and testee's image is by multiple frames Image construction.As shown in figure 15, each frame image that control module 130 is influenced according to testee is specific in testee's face Characteristic point FP.Next, as shown in figure 16, control module 130 exports the table of testee according to the position specific characteristic point FP The intensity of feelings and a variety of moods determined by its expression.The example for being directed to emotional intensity derived from a variety of moods respectively is shown in In bar chart shown in Figure 16.According to bar chart shown in Figure 16, control module 130 can be highest by intensity in a variety of moods Happy Emotion identification is the mood of testee.
As shown in figure 14, the observation data detected corresponding with any one performance image or any one sympathetic response image Middle testee's image includes multiple frame images.Therefore, control module 130 is just more for include in testee's image A frame image identifies the mood of testee's expression respectively.Then, control module 130 will recognize respectively from multiple frame images Mood accumulated, so as to watch any one performance image or any one sympathetic response image phase by testee Between reaction export testee express mood frequency.
In particular, control module 130 can from performance image show during embody testee react from data The Emotion expression power of middle export testee.That is, higher with the frequency number of the corresponding mood of performance image, then control module 130 The Emotion expression power for assessing testee is stronger.For example, as shown in (c) in Fig. 6, when display and happy corresponding performance image When, so that it may according to from the frequency number of derived happiness mood assesses the Emotion expression power of testee in data from collection Whether enrich.Figure 17 is to show the testee's mood for embodying and detecting during performance image show shown in (c) in Fig. 6 frequently The curve graph of rate.If (first) and (second) of Figure 17 is compared, it can be seen that the happy frequency of (first) of Figure 17 is higher, Therefore it can assess, testee's Emotion expression power of testee's Emotion expression power ratio (second) relevant to (first) of Figure 17 is more By force.
In addition, control module 130 can be from embodying testee's reaction in data during sympathetic response image is shown Export the sympathetic response ability of testee.That is, the frequency number of mood corresponding with sympathetic response image is higher, then control module 130 is assessed The sympathetic response ability of testee is stronger.For example, as shown in (f) in Fig. 7, when display is with sad corresponding sympathetic response image, just It can be according to from whether the sympathetic response ability of the frequency number assessment testee of derived sad mood is strong in data from collection. Figure 18 is (f) the shown curve graph that the testee's mood frequency detected is embodied during sympathetic response image shown in Fig. 7.Such as (fourth) and (third) of Figure 18 is compared by fruit, it can be seen that the sad frequency of (fourth) of Figure 18 is higher.Therefore, Ke Yiping Estimate, testee's sympathetic response ability of testee's sympathetic response ability ratio (third) relevant to (fourth) of Figure 18 is stronger.
In addition, if control module 130 is identified in data from and is induced in image comprising performance image and sympathetic response The different mood of the mood i.e. derived emotion that the induction image of image is induced, control module 130 will to derived emotion not With emotion expression service the reason of detected.
For example, as shown in figure 19, in the observation data being collected into corresponding with any one performance image or sympathetic response image Testee's image OM include multiple frame images.Assuming that multiple frame images shown in Figure 19 are, when display derived emotion is When happiness is sympathetic response image shown in performance image shown in (c) in Fig. 6 or (d) in Fig. 6, in the observation data that are collected into Testee's image OM.
Testee's image OM is split by control module 130 according to the chronomere of regulation, and each from segmentation image From multiple frame images in export the mood of testee, the i.e. frequency of mood.For example, control module 130 will as shown in Figure 19 Testee's image OM of multiple frame image constructions distinguished according to the chronomere of regulation, for example, according to the 1st to the 4th The image that hour T1, T2, T3 and T4 are distinguished divides into the 1st to the 4th segmentation image IM1, IM2, IM3, IM4.In addition, control mould Block 130 respectively from multiple frames segmentation image the i.e. the 1st to the 4th divide image I M1, in IM2, IM3, IM4 export mood (mood Frequency).PF1, PF2, PF3 and PF4 in Figure 20 are shown respectively divides the multiple of image IM1, IM2, IM3, IM4 from the 1st to the 4th Derived mood (frequency of mood) in frame image.Control module 130 is by the 1st to the 4th segmentation image IM1, IM2, IM3, IM4's The profile (profile) of 1st to the 4th mood PF1, PF2, PF3, PF4 is compared respectively, so that the difference for exporting profile is more than rule The segmentation image of fixed number value.For example, the profile of the 4th mood PF4 and other moods in the 1st to the 4th mood PF1, PF2, PF3, PF4 The difference of the profile of PF1, PF2, PF3 is more than specified value.Control module 130 calculates the difference of the profile of mood, and by its mood The segmentation image the i.e. the 4th having differences is divided image IM4 and is exported as identification and image VA the reason of derived emotion difference mood.
Illustrate that the reason of exporting from the OM of testee's image shown in Figure 19 image VA the i.e. the 4th divides image in Figure 21 IM4.Control module 130 can be respectively from multiple frame image f01~f13 of reason image VA:IM4 to the mood of testee It is identified.About the recognition result, all frame ... f01~f09, f11~f13 in addition to the 10th frame image f10 ... Recognition result such as Figure 22 in (X) shown in, although belonging to happiness identical with derived emotion, the 10th frame image f10's Shown in (Y) in recognition result such as Figure 22, it is assumed that it is identified as the mood different from derived emotion i.e. sadness.So, it controls Module 130 will just be identified as being set as analysis time with the time of derived emotion difference mood.For example, control module 130 is by 10 frame f10 are set as analysis time TA.In addition, control module 130 is broadcast at analysis time TA from export in testee's image The sound put is as reason sound CA.For example, as shown in figure 21, it is assumed that analysis time TA i.e. the 10th frame f10 was played when playing Sound is " mother ".Control module 130 can will be from the sound played at analysis time TA in testee's image as a result, " mother " is determined as reason sound CA.In this way, control module 130 can export the mood change dramatically for embodying and making testee Become and image VA and reason sound CA the reason of derived emotion difference mood reason.
As described above, control module 130 stores mood analysis in step S160 after having analyzed the mood of testee As a result.This mood analysis is as a result, Emotion expression power and sympathetic response ability comprising testee.In addition, mood analysis is as a result, packet Include: embodiment becomes the mood change dramatically of testee i.e. and image VA the reason of derived emotion difference mood reason and reason Sound CA.
Then, its mood analysis result is transferred to analysis in step S170 by communication module 110 by control module 130 Device 300.After the control unit 380 of analytical equipment 300 receives mood analysis result by communication unit 310, it is saved into and deposits In storage portion 370, later, if there is application mood analysis object command is entered, then control module 130 just passes through display unit 360 And audio portion 340 provides mood and analyzes result.
Up to the present, Analysis server 100 is analyzed according to the observation data being collected by analytical equipment 300 tested The method of person's mood is illustrated.Measure embodiment according to the present invention, the method that Analysis server 100 analyzes mood It can be executed by analytical equipment 300.For example, the observation data of collection can not be passed after analytical equipment 300 provides induction image Be defeated by Analysis server 100, and the observation data based on collection according in such a way that step S150 is identical to the feelings of testee Thread is analyzed.The control unit 380 of analytical equipment 300 can analyze the mood of testee as a result, and to tested The Emotion expression power and sympathetic response ability of person is assessed.In addition, the control unit 380 of analytical equipment 300 can be by tested The reason of mood of person is analyzed, and export makes the mood change dramatically of testee.
In addition, previously described method according to an embodiment of the present invention, can be can be read by a variety of computer equipments Program form is realized, and relevant information is recorded in the storage medium that can be read using computer.Herein, storage medium can Individually to include program instruction, data file, data structure etc. or include their combination.The journey being recorded in storage medium Sequence instruction, either being also possible to can be used known in computer software practitioner for the specially designed program instruction of the present invention Program instruction.For example, storage medium, comprising: hard disk, floppy disk and tape magnetic media (magnetic media), CD-ROM, Magnet-optical mediums (the magneto- such as the optical storage medias such as DVD (optical media), floptical disk (floptical disk) Optical media) and read-only memory (ROM), random access memory (RAM), flash memory (Flash Memory) etc. be storage And it executes program instructions and specifically configured hardware device.The example of program instruction not only includes passing through compiler (Compiler) the machine languages wire such as program instruction write, but also including using Command Interpreter (Interpreter) etc. to compile Write the high-level language wire that can be executed by computer.This hardware device can be by one in order to execute movement of the invention The above software module starting, domain are same.
Embodiment according to the present invention as a result, can induce image to the feelings of testee by induction specific emotional Thread carries out careful analysis, and can provide necessary measure and consulting based on this mood analysis result for testee.
More than, using several desirable embodiments, the present invention is described.But these embodiments are only said for convenience The bright and example enumerated, not delimit the scope of the invention.So there is the neck of technology belonging to the present invention by above description The technical staff of domain general knowledge can propose in without departing from technical idea and appended claims of the invention completely Under the premise of interest field, a variety of changes and modification are implemented according to doctrine of equivalents.

Claims (12)

1. a kind of Analysis server for mood analysis characterized by comprising
Communication module is communicated with analytical equipment;
Memory module, storage induction image, which, which provides, induces testee to express any one in a variety of moods The stimulation of kind mood;And
Control module transmits the induction image to the analytical equipment by the communication module, later from the analysis It is exported after device receives display testee to the observation data of the induction image reaction, then from described in data tested The frequency of examination person's expression mood.
2. the Analysis server according to claim 1 for mood analysis, it is characterised in that:
The induction image, comprising:
Image is showed, which includes: display with the image of the cartoon figure of expression performance mood, which is induction quilt Tester is with the mood to be expressed;And the experience of the mood is experienced in order to tell about the testee, the cartoon figure The sound putd question to the testee;And
Sympathetic response image, the sympathetic response image include: the image of situation when the display cartoon figure experiences the mood;And it is described The sound that cartoon figure is illustrated the situation.
3. the Analysis server according to claim 2 for mood analysis, it is characterised in that:
The control module exports in data according to from embodying testee's reaction during the performance image is shown Testee express mood frequency, the Emotion expression power of testee is assessed, and according to from the sympathetic response Image embodies the frequency that derived testee in the observation data of testee's reaction expresses mood during showing, to tested The sympathetic response ability of person is assessed.
4. the Analysis server according to claim 2 for mood analysis, it is characterised in that:
The control module, with the performance image or the sympathetic response image accordingly from data export be identified with The reason of inducing the mood difference mood reason of testee's expression image and reason sound.
5. a kind of analytical equipment for mood analysis characterized by comprising
Image pickup part, shoot testee and by the image of the testee, the testee image in characteristic point The pupil image of the displacement of three-dimensional coordinate and the testee are detected as observation data;
Audio portion obtains the sound of the testee as observation data;
Display unit accordingly shows with a variety of moods provide the stimulation for inducing the testee to express specific emotional respectively Induce image;And
Control unit accordingly extracts the frequency that testee expresses mood with the induction image from described in data, And it is analyzed according to mood of the frequency of extraction to the testee.
6. the analytical equipment according to claim 5 for mood analysis, it is characterised in that:
The induction image, comprising:
Image is showed, which includes: display with the image of the cartoon figure of expression performance mood, which is difference , induction testee corresponding with a variety of moods is with the mood to be expressed;And in order to tell about the testee described in impression The experience of mood, the sound that the cartoon figure puts question to the testee;And
Sympathetic response image, the sympathetic response image include: the image of situation when the display cartoon figure experiences the mood;And it is described The sound that cartoon figure is illustrated the situation.
7. the analytical equipment according to claim 6 for mood analysis, it is characterised in that:
The control unit, export is tested in data from embodying testee's reaction during the performance image is shown The Emotion expression power of person, and quilt is exported in data from embodying testee's reaction during the sympathetic response image is shown The sympathetic response ability of tester.
8. the analytical equipment according to claim 6 for mood analysis, it is characterised in that:
The control unit accordingly exports in data from the performance image or the sympathetic response image and is identified and lures The reason of leading the mood difference mood reason of testee's expression image and reason sound.
9. a kind of mood analysis method of Analysis server characterized by comprising
By provide respectively it is corresponding with a variety of moods, induction testee express specific emotional stimulation induction image transmission to The step of analytical equipment;
The step of embodying data from testee reacts the induction image is received from the analytical equipment;And
The frequency that testee expresses mood is extracted in data from described, and according to the frequency of extraction to the testee Mood the step of being analyzed.
10. a kind of mood analysis method of analytical equipment characterized by comprising
Display will provide the induction shadow for expressing the stimulation of specific emotional of, the induction testee corresponding with a variety of moods respectively The step of picture;
By the image of the testee corresponding with the induction image of display, embodying testee's reaction, institute State the displacement of the three-dimensional coordinate of characteristic point in the image of testee, the pupil image of the testee and the testee Sound as observation data be collected the step of;And
The frequency that testee expresses mood is extracted in data from described, and according to the frequency of extraction to the testee Mood the step of being analyzed.
11. a kind of machine readable storage medium, it is characterised in that:
It records the program for having the mood analysis method of Analysis server described in perform claim requirement 9.
12. a kind of machine readable storage medium, it is characterised in that:
It records the program for having the mood analysis method of analytical equipment described in perform claim requirement 10.
CN201711251334.6A 2017-11-13 2017-12-01 Mood analytical equipment, method and the machine readable storage medium for recording this method program Pending CN109770918A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2017-0150862 2017-11-13
KR1020170150862A KR102106517B1 (en) 2017-11-13 2017-11-13 Apparatus for analyzing emotion of examinee, method thereof and computer recordable medium storing program to perform the method

Publications (1)

Publication Number Publication Date
CN109770918A true CN109770918A (en) 2019-05-21

Family

ID=66495599

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711251334.6A Pending CN109770918A (en) 2017-11-13 2017-12-01 Mood analytical equipment, method and the machine readable storage medium for recording this method program

Country Status (2)

Country Link
KR (1) KR102106517B1 (en)
CN (1) CN109770918A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112669046A (en) * 2019-10-16 2021-04-16 辰光能源科技有限公司 Real food honesty and honour system

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102548970B1 (en) * 2020-07-07 2023-06-28 주식회사 유엑스팩토리 Method, system and non-transitory computer-readable recording medium for generating a data set on facial expressions
KR102670492B1 (en) * 2021-01-21 2024-05-30 주식회사 에스알유니버스 Method and apparatus for psychological counselingusing artificial intelligence
KR102277820B1 (en) * 2021-01-29 2021-07-16 전다정 The psychological counseling system and the method thereof using the feeling information and response information
KR102257427B1 (en) * 2021-01-29 2021-06-01 전다정 The psychological counseling system capable of real-time emotion analysis and method thereof
KR102381088B1 (en) * 2021-07-20 2022-03-30 양영준 Psychological test system based on artificial intelligence and operation method thereof

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008064431A1 (en) * 2006-12-01 2008-06-05 Latrobe University Method and system for monitoring emotional state changes
CN103565445A (en) * 2012-08-09 2014-02-12 英华达(上海)科技有限公司 Emotion assessment service system and emotion assessment service method
CN104000602A (en) * 2014-04-14 2014-08-27 北京工业大学 Emotional bandwidth determination method and emotional damage judgment method
CN104123545A (en) * 2014-07-24 2014-10-29 江苏大学 Real-time expression feature extraction and identification method
CN105310703A (en) * 2014-07-02 2016-02-10 北京邮电大学 Method for obtaining subjective satisfaction on basis of pupil diameter data of user
CN106236115A (en) * 2016-08-12 2016-12-21 渤海大学 A kind of psychological test system
US20170188927A1 (en) * 2014-05-27 2017-07-06 Nec Corporation Emotion recognition device, emotion recognition method, and storage medium for storing emotion recognition program

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4546767B2 (en) * 2004-06-09 2010-09-15 日本放送協会 Emotion estimation apparatus and emotion estimation program
KR101437186B1 (en) 2009-01-28 2014-09-05 경희대학교 산학협력단 Method for responding to user emotion with multiple sensors
JP5714411B2 (en) 2010-05-17 2015-05-07 株式会社光吉研究所 Behavior analysis method and behavior analysis device
KR20120105297A (en) * 2011-03-15 2012-09-25 고려대학교 산학협력단 Emotional response measurement apparatus and emotional response measurement method
KR20140053426A (en) 2012-10-25 2014-05-08 (주)휴노 The method and server for providing 3 dimensional psychological test service
JP2015229040A (en) 2014-06-06 2015-12-21 株式会社電通サイエンスジャム Emotion analysis system, emotion analysis method, and emotion analysis program

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008064431A1 (en) * 2006-12-01 2008-06-05 Latrobe University Method and system for monitoring emotional state changes
CN103565445A (en) * 2012-08-09 2014-02-12 英华达(上海)科技有限公司 Emotion assessment service system and emotion assessment service method
CN104000602A (en) * 2014-04-14 2014-08-27 北京工业大学 Emotional bandwidth determination method and emotional damage judgment method
US20170188927A1 (en) * 2014-05-27 2017-07-06 Nec Corporation Emotion recognition device, emotion recognition method, and storage medium for storing emotion recognition program
CN105310703A (en) * 2014-07-02 2016-02-10 北京邮电大学 Method for obtaining subjective satisfaction on basis of pupil diameter data of user
CN104123545A (en) * 2014-07-24 2014-10-29 江苏大学 Real-time expression feature extraction and identification method
CN106236115A (en) * 2016-08-12 2016-12-21 渤海大学 A kind of psychological test system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112669046A (en) * 2019-10-16 2021-04-16 辰光能源科技有限公司 Real food honesty and honour system

Also Published As

Publication number Publication date
KR102106517B1 (en) 2020-05-06
KR20190054501A (en) 2019-05-22

Similar Documents

Publication Publication Date Title
CN109770918A (en) Mood analytical equipment, method and the machine readable storage medium for recording this method program
Niehorster et al. GlassesViewer: Open-source software for viewing and analyzing data from the Tobii Pro Glasses 2 eye tracker
US20200012682A1 (en) Biometric-music interaction methods and systems
WO2017157272A1 (en) Information processing method and terminal
JP7440020B2 (en) Information processing method, terminal device, information processing device, and information processing system
EP3058873A1 (en) Device for measuring visual efficacy
US20220383389A1 (en) System and method for generating a product recommendation in a virtual try-on session
JP2021525424A (en) Computer implementation systems and methods that determine user attention
CN109523010A (en) Information processing unit, artificial intelligence selection method and recording medium
CN108475381A (en) The method and apparatus of performance for media content directly predicted
US20220318551A1 (en) Systems, devices, and/or processes for dynamic surface marking
CN109923529A (en) Information processing unit, information processing method and program
WO2022239793A1 (en) Subject analysis device
US10915740B2 (en) Facial mirroring in virtual and augmented reality
Palumbo et al. Visual exploration mediates the influence of personal traits on responses to artworks in an art gallery setting.
TWI478099B (en) Learning-based visual attention prediction system and mathod thereof
KR102383793B1 (en) Method, apparatus and system for managing and controlling concentration of user of registered extended reality device
JP6836877B2 (en) Wind instrument practice support device and practice support method
Scherr et al. Detecting user emotions with the true-depth camera to support mobile app quality assurance
CN110351326A (en) Information processing method, information processing unit and information processing system
US20220318550A1 (en) Systems, devices, and/or processes for dynamic surface marking
KR102516751B1 (en) Processing device, processing method, data processing device, data processing system, data processing method and program
JP2011239158A (en) User reaction estimation apparatus, user reaction estimation method and user reaction estimation program
KR20110028067A (en) Apparatus and method for scheduling contents reflecting engagement level of user
JP6687940B2 (en) Material evaluation method and material evaluation apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20190521