CN109923529A

CN109923529A - Information processing unit, information processing method and program

Info

Publication number: CN109923529A
Application number: CN201780067564.9A
Authority: CN
Inventors: 高桥修一
Original assignee: Sony Corp
Current assignee: Sony Corp
Priority date: 2016-11-08
Filing date: 2017-10-23
Publication date: 2019-06-21
Also published as: US10817057B2; US20200042090A1; WO2018088187A1

Abstract

Assessment information is generated based on the brain wave signal of the user of observation image, and obtains analysis information, such as to the interest level or area-of-interest of the image being presented to the user.Including transmitting the content transfer unit of picture material, the data transceiving unit for receiving transmitting content, the head-mounted display of presentation content and the content analysis unit of analysis content evaluation information.Data transceiving unit is generated in conjunction with the brain wave signal that obtains from the user and image reproducing control information to be set so that and can identify the assessment information for whether exporting the brain wave signal when specific image is presented, and the assessment information is output to content analysis devices.The content analysis devices analyze the interest level to the image for being presented to the user, area-of-interest etc. using the brain wave signal.

Description

Information processing unit, information processing method and program

Technical field

This disclosure relates to information processing unit, information processing method and program, relating more specifically to can be for example to user (viewer) image is presented and analyzed based on the E.E.G of user (user (viewer)) user to the area-of-interest of image, Information processing unit, information processing method and the program of interest level, intensity, degree of fatigue etc..

Background technique

In recent years, the various contents of such as game content and movie contents are mentioned for example, by network, broadcast or media Supply numerous users (viewer).

In many cases, content transmitter obtains user to the assessment of transmitting content to make in subsequent content development It is assessed with these.

For example, providing questionnaire as the general approach for obtaining assessment of the user to transmitting content.However, questionary handle exists The problem of be time or increased costs, and not necessarily each user can make honest assessment.

In addition, in the case where transmitting content is moving image contents, the problem is that being difficult to analyze by questionnaire Each user (viewer) is and difficult to including part (that is, interested region) interested to each frame in content Very interesting image-region is found with analysis or assessment user.

For example, the process of assessment image or content can be divided into objective evaluation process and subjective evaluation process.

Subjective evaluation process is the process that user (viewer) intuitively assesses object observing content.Objective evaluation process is The evaluation process executed by eliminating this personal subjectivity.

Currently, for example, carrying out the various researchs for improving image quality.To changing for the subjective evaluation of picture quality Kind is one of the factor to be considered when developing image quality improvement technology or Image Compression Coding Technology.

For example, the subjective scheme as image quality measure, is executed following jointly by the expert of image procossing or non-expert Multiple assessment scheme:

N Stage evaluation (MOS: Mean Opinion Score), (wherein n=5,7 etc.)；

Scoring assessment (magnitude estimation method etc.)；And

Introspection formula assesses (review record).

These schemes are the impressions by watching image by the expert of image procossing or non-expert with number or text instead To execute the subjective scheme of image quality measure process.

However, subjective evaluation process has the following problems:

(1) due to subjective evaluation, each individual the result is that irregular；

(2) due to specifying assessment axis, the project of off-axis is not assessed；

(3) assessment result is influenced very big by the experience or knowledge of user (viewer)；And

(4) there are many user (viewer) and the time must be needed and at the original precision for guaranteeing result.

For example, there are the above problems.

It solves these problems, it is necessary to objectively execute assessment.

Here, nonsensical when objective evaluation result deviates opinion score.

It is therefore important that generating the objective evaluation result without departing from opinion score.

As the objective scheme for image quality measure, Y-PSNR (PSNR) and structural similarity exponential metric It (SSIM) is known.

Both schemes are all the schemes exported image quality measure value as objective value.

However, indicating the numerical value obtained by aforementioned PSNR and SSIM according to image quality measure value and image-watching person The unmatched situation of practical impression, therefore subjective evaluation is not yet replaced completely.

In order to solve this problem, the E.E.G for picture quality or content using image observer has been carried out recently The research of objective evaluation scheme.

It is configured to detect viewing assessment target image by the variation of monitoring E.E.G using the evaluation scheme of E.E.G The impression of user (viewer).

Think by the way that the E.E.G for the image observer for objectively evaluating result will be used as to comment with the subjectivity based on image observer The practical impression of valence result connects, and the impression or certain stimulation for being presented to the people of image observer can be inferred from E.E.G.

However, the program has the following problems:

(1) it introduces and managing device needs cost and training；And

(2) program is more more complicated than above-mentioned objective evaluation scheme, because electrode is to be worn on user (viewer) at present With.

However, it is believed that can get the result hardly influenced by the knowledge or experience of user (viewer) and assessment axis.

In addition, the record Timing Synchronization that timing with E.E.G is presented by making image, can recorde the impression time of object And content.

As it is disclosed that the relevant technologies using the image evaluation structure of E.E.G example, for example, there is patent document 1 (JP 2013-258555A), patent document 2 (JP H07-061325B), patent document 3 (JP 5624512B).

Patent document 1 describes a kind of head-mounted display, and the head-mounted display obtains the use of observation game image The information of such as E.E.G at family (viewer), blood flow, pulse and sight determines the essence for playing the user of game based on the information The tensity of the user of game is played in refreshing state (state of mind during reflection game progress), or detection.

Patent document 1 discloses a kind of configuration, wherein based on the state of mind for obtaining and analyzing from user (viewer), when When sharing game between multiple game players, the process for updating game content to be shown is executed, or all game are played The control process that the game progress of family changes according to the state of mind moment of each user.

Patent document 2, which discloses, a kind of assesses the interest of the user (viewer) in visual stimulus in the following way Device: the visual stimulus of preset frequency (for example, 10Hz) is presented to the user (viewer) as image observer, and The variation of the size of the frequency of brain wave component of the measured user (viewer) of measurement.

More particularly, it is assessed by measuring the variation of Steady State Visual Evoked Potential during visual stimulus is presented to view Feel the response of stimulation.

Patent document 3 discloses a kind of device, and described device obtains the brain blood flow of user when user watches picture material Amount and eye position identify (interested in the interested degree of picture material in the psychological responses of picture material or calculating user Degree), and determine the assessment to picture material.Note that the variation of brain blood flow as the variation of E.E.G, indicates the change of cerebration Change.

Quote inventory

Patent document

Patent document 1:JP 2013-258555A

Patent document 2:JP H07-061325B

Patent document 3:JP 5624512B

Summary of the invention

Technical problem

Above patent document 1 is that only frontal region E.E.G is the configuration for obtaining and analyzing target, and there is the spirit to user The limited problem of the measurement accuracy of state.

In addition, patent document 1 discloses a kind of configuration, wherein to the frequency of the movement of the direction of visual lines, pupil of user, blink Rate etc. is detected, and the psychological condition index of user is converted thereof into according to transformed representation.It is examined using imaging sensor Survey direction of visual lines, the movement of pupil, frequency of blink etc., therefore the problem is that, it is difficult to for cost by image sensing Device is integrated in general user oriented viewing apparatus (for example, head-mounted display).

In addition, patent document 2 discloses a kind of configuration, wherein to the stable state vision during presentation visual stimulus (=image) Evoked ptential measures, and the interest of user (viewer) is assessed based on the variation of specific frequency components.However, at this In configuration, when the variation of the average brightness of stimulation (image) occurs as the variation of frequency component, user may not be assessed The interest of (viewer).Therefore, it is necessary to the average brightness of consistently maintaining stimulus (image).

However, prolonged live image also includes many scene changes.Accordingly, there exist be difficult to consistently remain averagely bright It spends and is difficult to the problem of obtaining accurate user assessment.

Patent document 3 discloses a kind of configuration, wherein being detected brain blood flow to measure cerebration.In the inspection of brain blood flow In survey, there are irradiating infrared light and analyze its reflected light mode scheme, and there is also use being referred to as the program close The device of infrared spectrometer (NIRS).However, NIRS is very expensive, and the problem is that, be difficult to for cost by NIRS is integrated in the general viewing apparatus (for example, head-mounted display) for being only oriented to user.

The disclosure is for example to design in view of the above problems, and purpose of this disclosure is to provide having cheap configuration, It can be coupled in general user oriented viewing apparatus (for example, head-mounted display), and user can be analyzed to being matched It is set to the information processing unit, information of area-of-interest, interest level, intensity, degree of fatigue of the image of content etc. Processing method and program.

Solution to the problem

The first aspect of the disclosure is a kind of information processing unit of head-mounted display, the information processing unit packet Include: image presentation unit is configured to that image is presented to user (viewer)；With E.E.G measuring unit, it is configured to survey Measure the E.E.G of user (viewer).The header area for wearing the user (viewer) of head-mounted display is arranged in E.E.G measuring electrode In domain.

The second aspect of the disclosure is a kind of information processing unit, and the information processing unit combines the use of the image from The reproduction control information and generating of brain wave signal and image that family (viewer) obtains, which is set so that, can identify when presenting Whether the assessment information of brain wave signal is exported when specific image.

The third aspect of the disclosure is a kind of information processing unit.Input user (viewer) acquisition of the image from Brain wave signal and assessment information, the assessment information are data corresponding with the reproduction control information of image and are configured to Make it possible to identify whether export brain wave signal when specific image is presented, and is come using the assessment information for including brain wave signal It executes and obtains interest level or assessment to the image for being presented to the user (viewer), in intensity and degree of fatigue The analytic process of at least one information.

The fourth aspect of the disclosure is a kind of information processing unit, wherein to be presented to the user in the image of (viewer) Appearance is transmitted, and is executed according to the analysis result of the brain wave signal obtained based on the user (viewer) of the image from Control to transmitting content.

5th aspect of the disclosure is a kind of information processing system, and the information processing system includes: user apparatus, to User (viewer) presentation content；And content analysis devices, the assessment information about content is received from user apparatus and is divided Analysis assessment information, wherein the user apparatus is in conjunction with the brain wave signal and image of user (viewer) acquisition of image from Reproduction control information and generating, which is set so that, can identify that whether when specific image is presented brain wave signal exported comments Estimate information, and the assessment information is output to the content analysis devices.

6th aspect of the disclosure is a kind of information processing method executed in information processing unit, wherein the information The reproduction of brain wave signal and image that the data processing unit of processing unit combines the user (viewer) of the image to obtain It controls information and generates the assessment letter for being set so that and capable of identifying whether brain wave signal is exported when specific image is presented Breath.

7th aspect of the disclosure is a kind of program for handling information processing unit execution information, and wherein described program makes The information processing unit data processing unit combine from from image user (viewer) obtain brain wave signal and The reproduction control information of image and generate and be set so that can identify whether brain wave signal defeated when specific image is presented Assessment information out.

Note that being for example to be supplied to be able to carry out various program codes with computer-readable format according to the program of the disclosure Information processing unit or computer system program, described program can provide by storage medium or communication media.By in terms of Calculation machine readable format provides such program, and place corresponding with described program is realized on information processing unit or computer system Reason.

The other purposes of the disclosure, feature and advantage will be by based on embodiment of the disclosure described below and attached drawings More detailed description is to illustrate.Note that in the present specification, term " system " refers to the logical collection configuration of multiple devices, and And each device in configuration is not limited in the same shell.

Advantageous effect of the invention

In accordance with an embodiment of the present disclosure, realize a kind of configuration, wherein based on observation image user brain wave signal come Image evaluation information is generated, and the analysis obtained to interest level, the area-of-interest of the image being presented to the user etc. is believed Breath.

Specifically, it may for example comprise transmit the content transfer unit of picture material, receive the data transmit-receive list of transmitting content The content analysis unit of member, the head-mounted display of presentation content and analysis content evaluation information.Data transceiving unit combines Image reproducing controls information and the brain wave signal that obtains from user and generating can identify whether export when specific image is presented The assessment information of brain wave signal, and the assessment information is output to content analysis devices.Content analysis devices use E.E.G Signal obtains analysis information, such as to the interest level or area-of-interest of the image being presented to the user.

In the configuration, such configuration is realized, wherein commenting based on the brain wave signal of the user of observation image to generate Estimate information, and obtain analysis information, such as to the interest level or area-of-interest of the image being presented to the user.

Note that advantageous effects described in this specification are just for the sake of for example and not limitation, and may be present other Advantageous effects.

Detailed description of the invention

[Fig. 1] Fig. 1 is the explanatory diagram for showing the profile instance of the information processing system according to the disclosure.

[Fig. 2] Fig. 2 is the explanatory diagram for showing the profile instance of the information processing system according to the disclosure.

[Fig. 3] Fig. 3 is the explanatory diagram for showing the arrangement examples for the electrode being worn on user (viewer) head.

[Fig. 4] Fig. 4 is the explanatory diagram for showing the profile instance of the information processing system according to the disclosure.

[Fig. 5] Fig. 5 is the explanation for showing the arrangement examples for the electrode being worn in the front surface on user (viewer) head Figure.

[Fig. 6] Fig. 6 is the configuration for showing content analysis unit and the explanatory diagram of process.

[Fig. 7] Fig. 7 is the explanatory diagram for showing the profile instance of the information processing system according to the disclosure.

[Fig. 8] Fig. 8 is the explanatory diagram for showing the profile instance of the information processing system according to the disclosure.

[Fig. 9] Fig. 9 is the configuration for showing content analysis unit and the explanatory diagram of process.

[Figure 10] Figure 10 is the explanatory diagram for showing the profile instance of the information processing system according to the disclosure.

[Figure 11] Figure 11 is the explanatory diagram for showing the profile instance of the information processing system according to the disclosure.

[Figure 12] Figure 12 is the explanatory diagram for showing the transmitting control example for the content for applying feedback information.

[Figure 13] Figure 13 is the explanatory diagram for showing the hardware configuration example of information processing unit.

[Figure 14] Figure 14 is the explanatory diagram for showing the hardware configuration example of information processing unit.

Specific embodiment

Hereinafter, it will be described with reference to the drawings according to the information processing unit of the disclosure, information processing method and program Details.Note that will be described according to following part.

1. according to the general introduction of the configuration of the information processing system of the disclosure and process

2. according to the configuration and process of the information processing system of embodiment 1

3. according to the configuration and process of the information processing system of embodiment 2

4. according to the configuration and process of the information processing system of embodiment 3

5. according to the configuration and process of the information processing system of embodiment 4

6. according to the configuration and process of the information processing system of embodiment 5

7. applying the process (embodiment 6) of feedback information

8. the hardware configuration example of information processing unit

9. the summary of the configuration of the disclosure

[1. according to the configuration of the information processing system of the disclosure and the general introduction of process]

Firstly, by description according to the configuration of the information processing system of the disclosure and the general introduction of process.

Fig. 1 is the figure for showing the profile instance of the information processing system 10 according to the disclosure.

Mainly by such as video content or game content live image configure content 70 via such as internet net Network is transmitted from content transfer unit 20 shown in FIG. 1.

Note that content 70 further includes rendering control signals, all other than the video and voice signal for being used as reproduce data Such as it is used as timing code, frame information or the chapters and sections information for reproducing timing information.

The content 70 transmitted by content transfer unit 20 by such as user (viewer) side PC data transceiving unit 30 Content receipt unit 31 receive.

Received content is output to the video of the head-mounted display (HMD) 40 of user (viewer) and voice signal is in Existing unit 41.

Video and voice signal display unit 41 are configured as display (display unit), loudspeaker etc..

In addition, the rendering control signals 71 of such as timing code, frame information or chapters and sections information are also supplied to assessment information hair Send unit 32.

Head-mounted display (HMD) 40 includes E.E.G measuring unit 42 and biometric information sensor 43.

E.E.G (the electroencephalogram of the user of content 70 is appreciated in E.E.G measuring unit 42 and the measurement of biometric information sensor 43 (EEG)) or biometric information, and by the data of measurement it is output to the assessment information transmitting unit of data transceiving unit 30 32。

The E.E.G and biometric for the user that the assessment information transmitting unit 32 of data transceiving unit 30 will acquire via network Determine information and is sent to content analysis unit 50.

Note that assessment information transmitting unit 32 generates the E.E.G or biometric information and as E.E.G or life of user Object measures information collection and sends, and enables to whether identification data are data corresponding with the specific image of content is reproduced, that is, quilt It is set to correspond to the data of frame or the data corresponding to the recovery time.

For the correspondence, it is used as the attribute letter of content 70 from the received reproduction control information 71 of content transfer servicer 20 Breath.

The information that reproduction control information 71 includes be for example as the timing code of reproduction time information, frame identification information and Chapters and sections information including scene change locations etc..

The assessment information transmitting unit 32 of data transceiving unit 30 combines the time for example obtained from reproduction control information 71 Code makes it possible to identify E.E.G and life with the E.E.G of user or biometric information obtained from head-mounted display 40 to generate The data of object measurement information whether be content the specific reproduction time data corresponding data collection, and by the corresponding data It is sent to content analysis unit 50.

The assessment information receiving unit 51 of content analysis unit 50 is received by such as user (viewer) side device The E.E.G or biometric information for the user that the data transceiving unit of PC is sent, and the E.E.G or biometric information is defeated Assessment storage unit 52 is arrived out.

Assessment storage unit 52 is analysed whether based on the E.E.G of user or biometric information about content 70 Specific image exports specific E.E.G or biometric information, and analyzes user to the area-of-interest (ROI) of content, interested Degree, assessment, intensity, degree of fatigue etc..

The analysis information of assessment storage unit 52 is output in response to determining that unit 53.

In response to determining that unit 53 generates instruction user to presentation based on the analysis result in assessment storage unit 52 To the response fixed number evidence really of the content 70 of user.Determine that data can be executed with a variety of data units, such as corresponding to entire interior Hold 70 data unit, chapters and sections unit or frame unit.

By in response to determining that unit 53, which generates fixed number really, is supplied to content transfer unit 20 according to can be used as feedback information 90.

Content transfer unit 20 can execute content-control based on feedback information 90, such as pass to the content 70 of user The change of details.

In the system according to the disclosure, such as content is configured to using in brain the content evaluation of the attraction of user E.E.G (electroencephalogram (EEG)) Lai Zhihang of the user (viewer) measured in wave measurement unit.

The measurement of E.E.G (electroencephalogram (EEG)) than use irradiating infrared light and analyze its reflected light mode near infrared light Spectrometer (NIRS) is more simple and relatively inexpensive, therefore cost is significantly inhibited, and it can easily be mounted on HMD.

Hereinafter, the configuration and process of multiple specific embodiments will be described in order.

The configuration and process of the information processing system of embodiment 1 [2. according to]

The configuration and process of information processing system according to embodiment 1 will be described with reference to Fig. 2 and subsequent attached drawing.

As described in by reference Fig. 1, Fig. 2 shows following four configurations:

Content transfer unit 120；

Data transceiving unit 130；

Head-mounted display (HMD) 140；With

Content analysis unit 150.

Content transfer unit 120 is via the network 110 of such as internet by content (video and voice signal+reproducing control Signal) 171 it is transmitted to the PC or data transceiving unit 130 as user (viewer) side device for being connected to network 110, such as Set-top box or stationary game device.

The video and voice signal 171 for including in content 171 are sent and are output to wear-type from data transceiving unit 130 Display (HMD) 140.

In addition, the rendering control signals 173 for including in content 171 are exported and maintain rendering control signals holding unit In 132.

The information that rendering control signals 173 include be for example as the timing code of reproduction time information, frame identification information with And the chapters and sections information including scene change locations etc..

The E.E.G measurement of the video and voice signal display unit 141 and measurement user's E.E.G of video and voice signal is presented Unit 142 is mounted on head-mounted display (HMD) 140.

E.E.G measuring unit 142 is measured user by the electrode (node) being worn on user (viewer) head and (seen The person of seeing) potential change on scalp.

The arrangement of electrode (node) is the standard configuration of referred to as world 10-20 system, but can be used it is distinguishing arrangement or The wherein limited arrangement of number of electrodes.

In addition, when electrode is worn, in some cases using the gel or electrolyte solution for improving electric conductivity, Or adhere to electrode seal by mechanically applying pressure in some cases.It may use any method.

Note that when recording E.E.G, it is necessary to when stimulation is presented that E.E.G is associated with stimulation (image).Therefore, will Information about the timing that stimulation (image) is presented records together with E.E.G.

The example of the arrangement for the electrode being worn on user (viewer) head is shown in Fig. 3.

It is the rostral anterior of user (viewer) on the upside of Fig. 3, is the back head of user (viewer) on the downside of Fig. 3.

Electrode is located at shown in Fig. 31 to 32 32 positions.

Head-mounted display (HMD) has such configuration, wherein the band for fastening HMD covers top in many cases Area or occipital region.By the way that electrode is arranged in the external band of the frontal region in addition to the region on the display unit side as HMD, can survey It measures the E.E.G of head all areas and more accurately determines the variation of E.E.G.

In this way, head-mounted display (HMD) 140 has such configuration, and wherein E.E.G measuring electrode setting exists In the head zone for wearing the user (viewer) of head-mounted display (HMD) 140.

E.E.G measuring unit 142 measures the signal obtained from least some of 32 electrodes shown in Fig. 3 electrode.

For example, the signal obtained from all 32 electrodes can be used.

Optionally, it can only configure and the electrode of E.E.G is measured (for example, electricity shown in Fig. 3 according to visual stimulus using from known Pole number 9,10,20 etc.) obtain E.E.G measuring signal.

Note that the brain wave signal in electrode unit can be used, or multiple E.E.Gs letter from multiple electrodes can be used Number quadrature components (weighting summation signal etc.), as the measuring signal of E.E.G measuring unit 142.

The E.E.G of the user of content 171 is appreciated in the measurement of E.E.G measuring unit 142, and the brain wave signal of measurement 174 is defeated The assessment information transmitting unit 133 of data transceiving unit 130 is arrived out.

The brain wave signal 174 for the user that the assessment information transmitting unit 133 of data transceiving unit 130 will acquire via network It is sent to content analysis unit 150.

Note that assessment information transmitting unit 133 sends the brain wave signal 174 measured from user as brain wave signal collection, Enable to whether identification data are data corresponding with the specific image of content is reproduced, that is, be configured to corresponding to frame Data or data corresponding to the recovery time.

For the correspondence, it is used as the category of content 171 from the received reproduction control information 173 of content transfer servicer 120 Property information.

Rendering control signals 173 are wherein as the timing code of reproduction time information, frame identification information and including scene The information that the chapters and sections information or similar information for changing position etc. are recorded.

The assessment information transmitting unit 133 of data transceiving unit 130 combines the timing code obtained from rendering control signals 173 With the brain wave signal 174 of the user obtained from head-mounted display 140 and generate for example make it possible to whether identify brain wave signal For the assessment information (brain wave signal+reproducing control of the user including corresponding data collection of the data of the specific reproduction time of content Signal) 175, and content analysis unit 150 is sent by the assessment information.

The assessment information receiving unit 151 of content analysis unit 150 is received by such as user (viewer) side device PC the assessment information (brain wave signal+rendering control signals) 175 of user that sends of data transceiving unit, and by institute's commentary Estimate information and is output to assessment storage unit 152.

Storage unit 152 is assessed to export based on the E.E.G analysis of user about the particular image frame of such as content 171 Which brain wave signal, and user is analyzed to the interest level of content, assessment, intensity, degree of fatigue etc..

Assessment storage unit 152 execute focus on the presentation of scene and the variation of E.E.G or current potential transient response it Between time relationship (for example, P300) analytic process, and focus on the frequency component (for example, α wave) for including in E.E.G Analytic process, etc..

Note that determined according to evaluation item when E.E.G is analyzed using head which region just enough.For example, working as When assessing the brightness change in presented vision signal, the variation of the E.E.G in initial optic cortex can be paid close attention to.When assessment is by regarding Caused by frequency signal when such as pleasant or uncomfortable mood, the variation of the E.E.G in the frontal region from top area can be paid close attention to.Work as assessment When voice signal, the variation of the E.E.G in temporo area can be paid close attention to.

The analysis information of assessment storage unit 152 is output in response to determining that unit 153.

In response to determining that unit 153 generates instruction user to being in based on the analysis result in assessment storage unit 152 Now to the response fixed number evidence really of the content 171 of user.Determine that data can be executed with a variety of data units, such as corresponding to entire Data unit, chapters and sections unit or the frame unit of content 171.

By in response to determining that unit 153, which generates fixed number really, is supplied to content transfer unit according to can be used as feedback information 176 210。

Content transfer unit 120 can execute content-control based on feedback information 176, such as pass to the content of user The change of 171 details.

The configuration and process of the information processing system of embodiment 2 [3. according to]

Next, the configuration and mistake that the information processing system according to embodiment 2 will be described with reference to Fig. 4 and subsequent attached drawing Journey.

The profile instance of information processing system 200 according to embodiment 2 is shown in Fig. 4.

Similar to the configuration of the embodiment 1 of reference Fig. 2 description, information processing system 200 shown in Fig. 4 has following four Configuration:

Content transfer unit 120；

Data transceiving unit 130；

Head-mounted display (HMD) 140；With

Content analysis unit 150.

The E.E.G measurement that the video and voice signal display unit 141 of video and voice signal is presented, measures user's E.E.G Unit 142 and eye muscle potential measurement unit 143 are mounted on head-mounted display (HMD) 140.

Similar to above-described embodiment 1, E.E.G measuring unit 142 passes through the electrode that is worn on user (viewer) head (node) measures the potential change on user (viewer) scalp.

For example, providing the electrode arrangement above with reference to Fig. 3 description.

Eye muscle potential measurement unit 143 is used to analyze the area-of-interest (ROI) of user (viewer).Specifically, it uses The movement for the eyes that movement by being connected to the muscle (eye muscle) of eyes generates.By electrode arrangement near eyes, and will be by In eye muscle movement and the electromyogram that generates measured as potential change.Eye motion is estimated according to the variation of current potential Amount, and further estimate the direction of eye motion respectively according to the positive or negative variation of current potential.

The setting example of eye muscle potentiometric detection electrode in eye muscle potential measurement unit 143 is shown in Fig. 5.

Fig. 5 is the figure for showing the example of E.E.G and eye muscle potentiometric detection electrode setting head-mounted display (HMD) 145.

E.E.G and eye muscle potentiometric detection electrode setting head-mounted display (HMD) 145 include E.E.G detecting electrode 146 and eye Myoelectric potential detecting electrode 147.

E.E.G detecting electrode 146 has the electrode arrangement for example above with reference to Fig. 3 description.

As shown in figure 5, eye muscle potentiometric detection electrode 147 is arranged in the display unit side as head-mounted display (HMD) Face front area in.As shown, including glabella electrode A, cheek electrode B and C, temples electrode D and E etc..

As shown in figure 5, head-mounted display (HMD) 140 includes the user (viewer) of head-mounted display (HMD) 140 Facial area in eye muscle potential-measuring electrode.

By eye muscle potentiometric detection electrode 147 shown in fig. 5, (electrode A to E) is arranged at eye muscle position, is connected to detection The movement of the muscle (eye muscle) of user (viewer) eyes.

At electrode position, electromyographic potentials are changed by the movement of eye muscle.Eye is estimated according to the variable quantity of current potential The amount of eyeball movement, and the direction of eye motion is further estimated from the positive or negative variation of current potential.

Note that using the (precision for the interesting region estimating result that electrode A to E) obtains of eye muscle potentiometric detection electrode 147 Less than using infrared light detection pupil and measuring the precision of oculomotor dedicated unit.However, it is possible to guarantee that accuracy reaches Estimate the degree of the specific viewing areas of screen.

Referring back to Fig. 4, description will be connected according to the configuration and process of the information processing system 200 of embodiment 2.

In E.E.G measuring unit 142 and eye muscle potential measurement unit 143 measurement of head-mounted display (HMD) 140 are appreciated Hold the E.E.G and eye muscle current potential of 171 user, and the brain wave signal of measurement 174 and eye muscle electric potential signal 177 are output to number According to the assessment information transmitting unit 133 of Transmit-Receive Unit 130.

The brain wave signal 174 for the user that the assessment information transmitting unit 133 of data transceiving unit 130 will acquire via network Content analysis unit 150 is sent to eye muscle electric potential signal 177.

Note that assessment information transmitting unit 133 makees the brain wave signal 174 measured from user and eye muscle electric potential signal 177 For data set transmission, enable to whether identification data are data corresponding with the specific image of content is reproduced, that is, be set At the data for corresponding to frame or corresponding to the data of recovery time.

For the correspondence, it is used as the category of content 170 from the received reproduction control information 171 of content transfer servicer 120 Property information.

The assessment information transmitting unit 133 of data transceiving unit 130 combines the timing code obtained from rendering control signals 173 With the brain wave signal 174 of user and eye muscle electric potential signal 177 that are obtained from head-mounted display 140 and generate and for example make it possible to Identification brain wave signal or electromyographic potentials signal whether be content the specific reproduction time data include corresponding data collection The assessment information (brain wave signal+eye muscle electric potential signal+rendering control signals) 178 of user, and the assessment information is sent To content analysis unit 150.

E.E.G is based on according to the content analysis unit 150 of embodiment 2 and generates content evaluation information, and such as above-described embodiment Analyze the area-of-interest of user (viewer) in 1 based on eye muscle electric potential signal like that.Note that dividing to area-of-interest In analysis, eye muscle electric potential signal not only can be used but also brain wave signal can be used.

The detailed configuration of content analysis unit 150 according to embodiment 2 is shown in Fig. 6.

The assessment information receiving unit 151 of content analysis unit 150 is received by such as user (viewer) side device PC data transceiving unit 130 send user assessment information (brain wave signal+eye muscle electric potential signal+rendering control signals) 178, and the assessment information is output to assessment storage unit 152.

As shown in fig. 6, rendering control signals 181, brain wave signal 182 and eye muscle electric potential signal 183 are from content analysis unit 150 assessment information receiving unit 151 is input to assessment storage unit 152.

Assessing storage unit 152 includes E.E.G analytical unit 201 and interesting region estimating unit 202.

E.E.G analytical unit 201 inputs rendering control signals 181, brain wave signal 182 and eye muscle electric potential signal 183, generates E.E.G and eye muscle potentiometric analysis result 191 for example including the brain wave signal as unit of picture frame, and by E.E.G and eye muscle Potentiometric analysis result 191 is output to interesting region estimating unit 202 and in response to determining that unit 153.

The brain that interesting region estimating unit 202 inputs rendering control signals 181 and exports from E.E.G analytical unit 201 Wave and eye muscle potentiometric analysis result 191 estimate the eye movement corresponding with each picture frame of user (viewer), and estimation The specific image region of the whether practical picture frame for watching each presentation of user (viewer).

That is, area-of-interest of the analysis user to each picture frame, and generate interesting region estimating result It 192 and is output in response to determining that unit 153.

Interesting region estimating unit 202 combines the timing code for including in rendering control signals 181 (that is, as each figure As the timing code of the reproduction time information of frame) reproduction of each picture frame is analyzed with E.E.G and eye muscle potentiometric analysis result 191 The variation of E.E.G at time, and estimate how eyeball moves, and generate every interested to instruction user (viewer) The interested area information in the specific image region of a picture frame.

As set forth above, it is possible to estimate the direction of motion and amount of exercise of eyes according to eye muscle current potential.According to the data, feel emerging The sense that interesting region estimation unit 202 generates the specific image region of each picture frame interested to instruction user (viewer) is emerging Interesting area information.Note that can be configured to further estimate by reference to brain wave signal to the interest level of area-of-interest Meter, to calculate horizontal (to the interest level of the image of area-of-interest) interested of user (viewer).

Note that in example 2, being similar to embodiment 1, what scene was focused in the assessment execution of storage unit 152 is in The now analytic process of the time relationship between the variation of E.E.G or the transient response of current potential (for example, P300), and focus on The analytic process, etc. for the frequency component (for example, α wave) for including in E.E.G.

Storage unit 152 is assessed by E.E.G and eye muscle potentiometric analysis result 191 and interesting region estimating result 192 are output to as analysis information in response to determining that unit 153.

The configuration and process of the information processing system of embodiment 3 [4. according to]

Next, by reference Fig. 7 description according to the configuration and process of the information processing system of embodiment 3.

The profile instance of information processing system 300 according to embodiment 3 is shown in Fig. 7.

Similar to the configuration of the embodiment 1 of reference Fig. 2 description, information processing system 300 shown in Fig. 7 has following four Configuration:

Content transfer unit 120；

Data transceiving unit 130；

Head-mounted display (HMD) 140；With

Content analysis unit 150.

Embodiment 3 provides a kind of configuration, describes wherein being added to posture detecting unit 301 according to above with reference to Fig. 2 Embodiment 1 information processing system 100 head-mounted display 140.

Posture detecting unit 301 includes such as sensor such as acceleration transducer or gyro sensor, and is had Detect the movement of user (viewer) or the function of attitudes vibration.

In some cases, it is superimposed upon as noise signal by brain by the electromyogram that the movement of user or attitudes vibration generate On the E.E.G that wave measurement unit 142 measures.

The movement of the user (viewer) detected based on posture detecting unit 301 or attitudes vibration, estimation are used as E.E.G Electromyogram (EMG) signal of noise component(s) in signal.

Noise component(s) (electromyogram letter is removed from the brain wave signal measured by E.E.G measuring unit 142 using estimated result Number), and high-precision brain wave signal is obtained to realize analysis.

Difference between embodiment 3 and embodiment 1 is that head-mounted display 140 includes posture detecting unit 301.It will retouch State the process in addition configuration.

As described above, the posture detecting unit 301 of head-mounted display 140 includes that for example (such as acceleration passes sensor Sensor or gyro sensor), and detect movement or the attitudes vibration of user (viewer).The signal detected is Fig. 7 institute The posture information 311 shown.

Content 171 is appreciated in E.E.G measuring unit 142 and posture detecting unit 301 detection of head-mounted display (HMD) 140 User E.E.G and posture, and the brain wave signal of measurement 174 and posture information 311 are output to data transceiving unit 130 Assessment information transmitting unit 133.

The brain wave signal 174 for the user that the assessment information transmitting unit 133 of data transceiving unit 130 will acquire via network Content analysis unit 150 is sent to posture information 311.

Note that assessment information transmitting unit 133 regard the brain wave signal 174 measured from user and posture information 311 as number Sent according to collection, enable to identification data whether be and the corresponding data of the reproduction specific image of content, that is, be configured to pair It should the data in frame or the data corresponding to the recovery time.

The assessment information transmitting unit 133 of data transceiving unit 130 combines the timing code obtained from rendering control signals 173 With the brain wave signal 174 of user and posture information 311 that are obtained from head-mounted display 140 and generate and for example make it possible to identify Brain wave signal or posture information whether be content the specific reproduction time data the user including corresponding data collection assessment Information (brain wave signal+posture information+rendering control signals) 312, and content analysis unit is sent by the assessment information 150。

Content analysis unit 150 in embodiment 3 generates content evaluation letter based on E.E.G like that as in example 1 above Breath, but electromyogram (EMG) signal generated by the movement of user or attitudes vibration is estimated using posture information in this process, The electromyogram signal being added on the E.E.G measured by E.E.G measuring unit 142 as noise signal is removed, and is generated high-precision The brain wave signal of degree executes content analysis.

As described above, electromyogram signal is added on the E.E.G measured by E.E.G measuring unit 142 as noise signal.

The assessment information receiving unit 151 of content analysis unit 150 is received by such as user (viewer) side device PC data transceiving unit send user assessment information (brain wave signal+posture information+rendering control signals) 312, and And the assessment information is output to assessment storage unit 152.

It assesses storage unit 152 and executes estimation by the movement of user or attitudes vibration generation using posture information first Electromyogram (EMG) signal composition, and remove and be added to the E.E.G measured by E.E.G measuring unit 142 as noise signal On electromyogram signal.

Next, based on the brain wave signal and user for therefrom removing noise to the interest level of content, assessment, concentration Degree, degree of fatigue etc. analyse whether that the specific image part about such as content 171 exports specific brain wave signal.

The configuration and process of the information processing system of embodiment 4 [5. according to]

Next, the configuration and mistake that the information processing system according to embodiment 4 will be described with reference to Fig. 8 and subsequent attached drawing Journey.

The profile instance of information processing system 400 according to embodiment 4 is shown in Fig. 8.

Similar to the configuration of the embodiment 1 of reference Fig. 2 description, information processing system 400 shown in Fig. 8 has following four Configuration:

Content transfer unit 120；

Data transceiving unit 130；

Head-mounted display (HMD) 140；With

Content analysis unit 150.

According to the head-mounted display (HMD) 140 of embodiment 4 not only including video and voice signal display unit 141, and It and further include E.E.G measuring unit 142, eye muscle potential measurement unit 143 and posture detecting unit 301.

Eye muscle potential measurement unit 143 executes and the information processing system according to the embodiment 2 described above with reference to Fig. 4 to 6 The identical process of eye muscle potential measurement unit 143 in system 200.Posture detecting unit 301 is executed to be retouched with according to above with reference to Fig. 7 The identical process of posture detecting unit 301 in the information processing system 300 for the embodiment 3 stated.

Eye muscle potential measurement unit 143 surveys the electromyogram generated due to the movement of eye muscle as potential change Amount.The amount of eye motion can be estimated according to the variable quantity of current potential, and further estimates eye from the positive or negative variation of current potential The direction of eyeball movement.

The present embodiment provides the configurations for the function of being combined with above-described embodiment 2 and embodiment 3.

That is, this embodiment offers a kind of configuration, the configuration can: held based on eye muscle electric potential signal 177 The process of row analysis point-of-interest, the eye muscle electric potential signal is the signal measured by eye muscle potential measurement unit 143；And base It to remove include the electromyogram in the E.E.G measured by E.E.G measuring unit 142 as noise signal in posture information 311 (EMG) for signal to obtain high-precision brain wave signal, the posture information is the detection information of posture detecting unit 301.

E.E.G measuring unit 142, eye muscle potential measurement unit 143 and the posture inspection of head-mounted display 140 shown in Fig. 8 Survey unit 301 detection appreciate content 171 user E.E.G, eye muscle current potential and posture, and by the brain wave signal of measurement 174, Eye muscle electric potential signal 177 and posture information 311 are output to the assessment information transmitting unit 133 of data transceiving unit 130.

The brain wave signal for the user that the assessment information transmitting unit 133 of data transceiving unit 130 will acquire via network 174, eye muscle electric potential signal 177 and posture information 311 are sent to content analysis unit 150.

Note that assessing information transmitting unit 133 for the brain wave signal 174 measured from user, eye muscle electric potential signal 177 and appearance State information 311 is sent as data set, enables to whether identification data are number corresponding with the specific image of content is reproduced According to, that is, it is configured to the data corresponding to the data of frame or corresponding to the recovery time.

The assessment information transmitting unit 133 of data transceiving unit 130 combines the timing code obtained from rendering control signals 173 It is generated with brain wave signal 174, eye muscle electric potential signal 177 and the posture information 311 of the user obtained from head-mounted display 140 Such as make it possible to identify that brain wave signal or posture information whether be the data of specific reproduction time of content include corresponding number According to the assessment information (brain wave signal+eye muscle electric potential signal+posture information+rendering control signals) 320 of the user of collection, and by institute Commentary estimates information and is sent to content analysis unit 150.

E.E.G is based on according to the content analysis unit 150 of embodiment 4 and generates content evaluation information, and such as above-described embodiment Analyze the area-of-interest of user (viewer) in 1 based on eye muscle electric potential signal like that.Note that dividing to area-of-interest In analysis, eye muscle electric potential signal not only can be used but also brain wave signal can be used.

In addition, the content analysis unit 150 in embodiment 4 estimates the fortune by user using posture information in this process Electromyogram (EMG) signal that dynamic or attitudes vibration generates, removal are added to as noise signal and are measured by E.E.G measuring unit 142 E.E.G on electromyogram signal, and generate high-precision brain wave signal to execute content analysis.

The detailed configuration of content analysis unit 150 according to embodiment 4 is shown in Fig. 9.

The assessment information receiving unit 151 of content analysis unit 150 is received by such as user (viewer) side device PC data transceiving unit 130 send user assessment information (brain wave signal+eye muscle electric potential signal+posture information+reproduction Control signal) 320, and the assessment information is output to assessment storage unit 152.

As shown in figure 9, rendering control signals 321, brain wave signal 322, electromyographic potentials signal 323 and posture information 324 Assessment storage unit 152 is input to from the assessment information receiving unit 151 of content analysis unit 150.

Assessing storage unit 152 includes E.E.G analytical unit 201 and interesting region estimating unit 202, and is gone back Electromyogram signal estimation unit 331 is corresponded to including posture.

Posture, which corresponds to electromyogram signal estimation unit 331, estimates movement or attitudes vibration by user using posture information Electromyogram (EMG) signal of generation generates electromyogram signal estimated result 332, and electromyogram signal estimated result 332 is defeated E.E.G analytical unit 201 is arrived out.

E.E.G analytical unit 201 inputs rendering control signals 321, brain wave signal 322 and electromyogram signal estimated result 332, and removal is first carried out and estimates the brain wave signal measured by E.E.G measuring unit 142 that can be added to as noise signal The process of electromyogram signal estimated result 332 on 322.

The specific image portion about such as content 171 is analysed whether subsequently, based on the brain wave signal of noise is therefrom removed Divide output specific brain wave signal, and such as generation includes the E.E.G and eye muscle current potential point of the brain wave signal as unit of picture frame Result 191 is analysed, and is output to interesting region estimating unit 202 and in response to determining that unit 153.

The brain that interesting region estimating unit 202 inputs rendering control signals 321 and exports from E.E.G analytical unit 201 Wave and eye muscle potentiometric analysis result 191 estimate the eye movement corresponding with each picture frame of user (viewer), and estimation The specific image region of the whether practical picture frame for watching each presentation of user (viewer).

Interesting region estimating unit 202 is for example in conjunction with the timing code for including in rendering control signals 321 (that is, as every The timing code of the reproduction time information of a picture frame) analyze each picture frame with E.E.G and eye muscle potentiometric analysis result 191 The variation of E.E.G at recovery time, and estimate how eyeball moves, and it is interested to generate instruction user (viewer) Each picture frame specific image region interested area information.

Note that in example 4, being similar to embodiment 1, what scene was focused in the assessment execution of storage unit 152 is in The now analytic process of the time relationship between the variation of E.E.G or the transient response of current potential (for example, P300), and focus on The analytic process, etc. for the frequency component (for example, α wave) for including in E.E.G.

The configuration and process of the information processing system of embodiment 5 [6. according to]

Next, by reference Figure 10 description according to the configuration and process of the information processing system of embodiment 5.

Embodiment 5 is configured to configure most of head-mounted displays 140 using the smart phone popularized recently, such as Shown in Figure 10.

That is, the display unit of smart phone 410 to be used as to the display unit of head-mounted display 140.

As shown in Figure 10, head-mounted display 140 includes E.E.G measuring unit 142 and eye muscle potential measurement unit 143.

Smart phone 410 includes not only content receipt unit 131 and vision signal display unit 141, but also including again Now control signal holding unit 132, assessment information transmitting unit 133 and posture detecting unit 301.

Note that Component units are identical to Component units described in embodiment 4 as above-described embodiment 1.

Common smart mobile phone has the communication function of such as LTE or Wi-Fi, and the content including reception content 171 connects It receives unit 131 or sends the assessment information transmitting unit 133 of assessment information using the communication function of such as LTE or Wi-Fi.

In addition, common smart mobile phone includes internal storage and internal storage can be used to keep single as control signal Member 132.

Note that for example, when use such as near field communication (NFC) function of bluetooth (registered trademark) when, 140 side of head-mounted display E.E.G measuring unit 142 or eye muscle potential measurement unit 143 and 410 side of smart phone assessment information transmitting unit 133 it Between can also be communicated.

By the way that near field communication (NFC) function is arranged in head-mounted display 140 and smart phone 410, can not execute it is wired Various signals are sent and received in the case where connection between two.

[7. apply the processing (embodiment 6) of feedback information]

Next, the process that will describe to apply feedback information with reference to Figure 11 and according to the subsequent attached drawing of embodiment 6 Example.

In the information processing system described in embodiment 1 to embodiment 5, based on content analysis as a result, content analysis list Feedback information 176 is output to content transfer unit 120 by member 150.

The embodiment 6 being described below is to apply the embodiment of feedback information.

As shown in figure 11, in all information processing systems described in embodiment 1 to embodiment 5, it is based on content analysis Content analysis in unit 150 is as a result, be output to content transfer unit 120 for feedback information 176.

Content transfer unit 120 can will be supplied to based on the feedback information 176 inputted from content analysis unit 150 to change The setting of the content 171 of user.

For example, selection estimation has height attraction to user A based on the feedback information A from user A (viewer A) Interior perhaps scene and pass it to user A.In addition, based on the feedback information B from user B (viewer B), selection estimation Have in height attraction to user B and perhaps scene and passes it to user B.In this way, also can be performed and user Corresponding content-control.

Figure 12 is the figure for showing content transmitting control example corresponding to the user.

Analysis knot of the content analysis unit 150 based on the respective brain wave signal of user U1 and U2 obtained from user U1 and U2 Fruit generates including having in height attraction the perhaps feedback letter of the information of scene to user U1 and U2 for specified estimation Breath 601 and feedback information 602, and feedback information 601 and feedback information 602 are output to content transfer unit 120.

Content transfer unit 120 selects estimation to have height to user U1 based on the feedback information 601 from user U1 The interior perhaps scene of attraction, and interior perhaps scene information is sent to user U1.

In addition, content transfer unit 120, which is estimated as height based on the selection of feedback information 602 from user U2, attracts user The interior perhaps scene information of U2, and interior perhaps scene information is sent to user U2.

It is main to configure for the video and voice signal being retained in content transfer unit 120 in example shown in Figure 12 Four scenario As, B, C and D.The recovery time of each scene is as follows:

In scenario A, time t1 to time t2；

In scenario B, time t2 to time t3；

In scene C, time t3 to time t4；And

In scene D, time t4 to time t5.

Set the above-mentioned recovery time.

In these scenes, scenario A only includes a scene, but scenario B includes sub-scene B1, B2 and B3, and scene C includes Sub-scene C1, C2 and C3, and scene D includes sub-scene D1 and D2.

Content transfer unit 120 is determined based on the feedback information 601 and 602 from each user in optional scenario B, C With sub-scene is selected in D.

It is respectively from time t1 to time t2 about field using user U1 and U2 during selecting the sub-scene of scenario B The feedback information of scape A.

Based on the respective feedback information from time t1 to time t2 about scenario A of user U1 and U2, from sub-scene B1 to B3 Middle selection estimation has the sub-scene of height attraction to each user, and the sub-scene for corresponding to each user is passed to Each user.

Select scene C sub-scene during, using user U1 and U2 respectively since time t1 to time t3 about field The feedback information of scape A and scenario B.

Based on each feedback information since time t1 to time t3 about scenario A and scenario B of user U1 and U2, from sub-scene Selection estimation has the sub-scene of height attraction, and the sub-scene that will correspond to each user to each user in C1 to C3 Pass to each user.

Select scene D sub-scene during, using user U1 and U2 respectively since time t1 to time t4 about field The feedback information of scape A, scenario B and scene C.

Based on each feedback information since time t1 to time t4 about scenario A, scenario B and scene C of user U1 and U2, from Selection estimation has the sub-scene of height attraction to each user in sub-scene D1 to D2, and will correspond to each user's Sub-scene passes to each user.

Note that can refer to the definitive result from time t2 to time t3 when selecting scene C.It, can when selecting scene D With reference to from time t3 to the definitive result of time t4.

Example shown in Figure 12 is such example, in this example, it is contemplated that user U1 from time t1 to time t2 Definitive result select sub-scene B1 as scenario B, it is contemplated that from time t1 select subfield to the definitive result of time t3 Scape C2 is as scene C, and in view of selecting sub-scene D2 as scene D from time t1 to the definitive result of time t4,

As a result, be presented to the user U1 video and voice signal be scenario A, B1, C2 and D2 combination.

Meanwhile about user U2, it is contemplated that definitive result from time t1 to time t2 selects the sub-scene B3 as field Scape B, it is contemplated that select sub-scene C3 as scene C to the definitive result of time t3 from time t1, and consider from the time T1 is selected with sub-scene D1 to the definitive result of time t4 as scene D.

As a result, be presented to the user U2 video and voice signal be scenario A, B3, C3 and D1 combination.

In this way, it is contemplated that response of each user to the scenario A initially presented can be wanted for each user adjustment The video and voice signal then presented.

That is, attraction or interest based on each user estimated according to the brain wave signal of user, alternative Estimation is more highly attracted in each user that perhaps scene passes to each user by ground.

[the hardware configuration examples of 8. information processing units]

Next, carrying out the hard of description information processing unit for described embodiment is described with reference to Figure 13 and subsequent attached drawing The profile instance of part configuration, the information processing unit be configured as head-mounted display (HMD) 140 in above-described embodiment, Each of data transceiving unit 130, content analysis unit 150, content transfer unit 120 device.

Figure 13 is the figure for showing the profile instance of hardware configuration of head-mounted display (HMD) 140.

Central processing unit (CPU) 701 be used as data processing unit, according to be stored in read-only memory (ROM) 702 or Program in storage unit 708 executes various processes.For example, CPU 701 described in above-described embodiment according to sequentially holding Row process.Random access memory (RAM) 703 is stored by the data executed of CPU 701 or program.CPU 701,702 and of ROM RAM 703 is connected to each other by bus 704.

CPU 701 is connected to input/output interface 705 via bus 704.Including it is a variety of switch any one of, keyboard, The input unit 706 of mouse, microphone etc., the output unit 707 including display, loudspeaker etc. are connected to input/output interface 705.Processing result, to execute various processes, and is output to example in response to the instruction that inputs from input unit 706 by CPU 701 Such as output unit 707.

Be connected to input/output interface 705 storage unit 708 include such as flash memory, and store will be by CPU 701 The various data or program executed.Communication unit 709 is used as data via the network of such as near-field communication, internet, local area network Transceiver communication unit, and and communication with external apparatus.

For example, E.E.G acquiring unit 710 obtains E.E.G via the electrode of the arrangement described above with reference to Fig. 3.

For example, eye muscle current potential acquiring unit 711 obtains to take eye muscle electric via the electrode of the arrangement described above with reference to Fig. 5 Position.

For example, posture information acquiring unit 712 includes the sensor of such as acceleration transducer or gyro sensor, and And have the function of detecting the movement of user (viewer) or attitudes vibration.

Next, by the profile instance for the hardware configuration for being described with reference to Figure 14 information processing unit, the information processing Device is configured as each of data transceiving unit 130, content analysis unit 150, content transfer unit 120 device.

Central processing unit (CPU) 801 be used as data processing unit, according to be stored in read-only memory (ROM) 802 or Program in storage unit 808 executes various processes.For example, CPU 801 described in above-described embodiment according to sequentially holding Row process.Random access memory (RAM) 803 is stored by the data executed of CPU 801 or program.CPU 801,802 and of ROM RAM 803 is connected to each other by bus 804.

CPU 801 is connected to input/output interface 805 via bus 804.Including it is a variety of switch any one of, keyboard, The input unit 806 of mouse, microphone etc., the output unit 807 including display, loudspeaker etc. are connected to input/output interface 805.Processing result, to execute various processes, and is output to example in response to the instruction that inputs from input unit 806 by CPU 801 Such as display unit 807.

Be connected to input/output interface 805 storage unit 808 include such as flash memory, and store will be by CPU 801 The various data or program executed.Communication unit 809 is used as data via the network of such as near-field communication, internet, local area network Transceiver communication unit, and and communication with external apparatus.

The driver 810 for being connected to input/output interface 805 drives removable medium 811, such as disk, CD, magneto-optic The semiconductor memory of disk or such as storage card, to execute data record or reading.

[summary of the configuration of 9. disclosure]

Therefore, content above is provided with reference to specific embodiment and is explained in detail to embodiment of the disclosure.However, it is aobvious and It is clear to, those skilled in the art can modify and replace to these embodiments in the case where not departing from the purport of the disclosure It changes.In other words, present disclosure is disclosed by way of example, and should not be construed in a limited manner.It should be Consider the purport that the disclosure is determined in the case where claim.

In addition, this technology can also configure as follows.

(1) a kind of information processing unit of head-mounted display, comprising:

Image presentation unit is configured to that image is presented to user (viewer)；And

E.E.G measuring unit is configured to measure the E.E.G of the user (viewer),

Wherein the head for wearing the user (viewer) of the head-mounted display is arranged in the E.E.G measuring electrode In portion region.

(2) information processing unit according to (1), further includes:

Voice output unit.

(3) information processing unit according to (1) or (2), further includes:

Eye muscle potential measurement unit is configured to detect the eye of the user (viewer) of the head-mounted display Myoelectric potential.

(4) information processing unit according to (3), wherein the eye muscle potential measurement unit, which is included in, wears the head Eye muscle potential-measuring electrode in the facial area of the user (viewer) of head mounted displays.

(5) information processing unit according to any one of (1) to (4), further includes:

Posture detecting unit is configured to detect the posture letter of the user (viewer) of the head-mounted display Breath.

(6) information processing unit according to (5), wherein the posture detecting unit includes acceleration transducer or top Spiral shell instrument.

(7) a kind of information processing unit, in conjunction with the brain wave signal of user (viewer) acquisition of image and institute from It states the reproduction control information of image and generates and be set so that can identify whether export the brain when specific image is presented The assessment information of wave signal.

(8) information processing unit according to (7), comprising:

Content receipt unit is configured to be presented to the image of the user (viewer) from external reception,

Wherein the received reproduction control information of institute is made together with through the received described image of the content receipt unit It is set so that for generating and can identify the assessment information for whether exporting brain wave signal when specific image is presented.

(9) information processing unit according to any one of (7) to (8), wherein further combined with the figure described from The reproduction control information of the eye muscle electric potential signal and described image that the user (viewer) of picture obtains and generate and set Determine into the assessment information for making it possible to identify whether the eye muscle electric potential signal is exported when specific image is presented.

(10) a kind of information processing unit,

Wherein input the brain wave signal and assessment information that the user (viewer) of the image from obtains, the assessment letter Breath is that data corresponding with the reproduction control information of described image and being set so that can be identified when specific image is presented When whether export the brain wave signal, and

It is obtained to execute to the image for being presented to the user (viewer) using including the assessment information of the brain wave signal The analytic process of at least one information in interest level or assessment, intensity and degree of fatigue.

(11) information processing unit of basis (10),

The eye muscle electric potential signal and assessment that wherein further the user (viewer) of input image from obtains Information, the assessment information are data corresponding with the reproduction control information of described image and are set so that and can identify When specific image is presented, whether the eye muscle electric potential signal is exported, and

Analyze the area-of-interest being presented in the described image of the user (viewer).

(12) information processing unit of basis (10) or (11),

The posture information and assessment that wherein further the user (viewer) of input described image from obtains Information, the assessment information are data corresponding with the reproduction control information of described image and are set so that and can identify When specific image is presented, whether the posture information is exported, and

Estimate the electromyogram signal based on the posture information, and

It is equivalent to the noise signal of electromyogram signal component by removing from the brain wave signal and generates high-precision brain Wave signal, and the analytic process is executed using high-precision brain wave signal generated.

(13) information processing unit according to any one of (10) to (12), wherein the brain wave signal will be used to obtain The analysis result obtained is further output to as feedback information passes the content that described image passes to the user (viewer) Pass unit.

(14) a kind of information processing unit,

Wherein transmitting will be presented to the user the picture material of (viewer), and

It is executed pair according to the analysis result of the brain wave signal obtained based on the user (viewer) of the image from The control of the transmitting content.

(15) information processing unit according to (14), wherein being held based on the feedback information of individual consumer (viewer) Transmitting content-control of the row to the individual consumer (viewer).

(16) a kind of information processing system, comprising:

User apparatus, to user (viewer) presentation content；With

Content analysis devices receive the assessment information about the content from the user apparatus and analyze institute's commentary Estimate information,

The brain wave signal and described image that wherein the user apparatus combines the user (viewer) of the image to obtain Reproduction control information and generate and be set so that can identify whether export the brain wave signal when specific image is presented Assessment information, and the assessment information is output to the content analysis devices.

(17) information processing system of basis (16),

Wherein the content analysis devices are obtained to being presented to execute using including the assessment information of the brain wave signal The interest level of the described image of the user (viewer) or in assessment, intensity and degree of fatigue at least one The analytic process of information, and

The result of the analytic process is output to as feedback information, described image is passed into the user (viewing Person) the content delivering apparatus.

(18) information processing system of basis (16) or (17),

Wherein the user apparatus combine from from described image user (viewer) obtain eye muscle electric potential signal and The reproduction control information of described image and generating, which is set so that, can identify the eye muscle when the specific image is presented The assessment information whether electric potential signal is exported, and the assessment information is output to the content analysis devices, and

The content analysis devices are analyzed described to being presented to using the assessment information including the eye muscle electric potential signal The area-of-interest of the described image of user (viewer).

(19) a kind of information processing method executed in information processing unit,

Wherein the data processing unit of the information processing unit combines the user (viewer) of the image to obtain The reproduction control information of brain wave signal and described image and generating is set so that and can identify when specific image is presented and be The assessment information of the no output brain wave signal.

(20) a kind of program for handling information processing unit execution information,

Wherein described program makes the data processing unit of the information processing unit that the user of the image from be combined (to watch Person) brain wave signal obtained and described image reproduction control information and generating be set so that can identify it is specific when presenting Whether the assessment information of the brain wave signal is exported when image.

In addition, a series of processes described in this specification can be matched by the combination of hardware, software or hardware and software It sets to execute.In the case where passing through software implementation procedure, the program of recording process sequence is mountable in insertion specialized hardware Computer memory in execute or program is mountable executes in the general purpose computer for being able to carry out various processes. For example, can be pre-recorded on the recording medium by program.It, can also be via all other than being installed on computer from recording medium Program is received such as the network of local area network (LAN) or internet, and the record that can attach it to such as built-in hard disk is situated between In matter.

In addition, various processes described in this specification can execute in chronological order as described above, and can be with root According to the device for executing these processes processing capacity or as needed concurrently or be executed separately.Note that in the present specification, Term " system " refers to the logical collection configuration of multiple devices, and each device in configuration is not limited in the same shell It is interior.

Industrial feasibility

As described above, such configuration is realized in accordance with an embodiment of the present disclosure, wherein the use based on observation image The brain wave signal at family generates assessment information, and obtains analysis information, such as to the journey interested for the image being presented to the user Degree or area-of-interest.

Specifically, it may for example comprise transmit the content transfer unit of picture material, receive the data transmit-receive list of transmitting content The content analysis unit of member, the head-mounted display of presentation content and analysis content evaluation information.Data transceiving unit combines From user obtain brain wave signal and image reproducing control information and generating can identify whether export when specific image is presented The assessment information of the brain wave signal, and the assessment information is output to content analysis devices.Content analysis devices use Brain wave signal obtains analysis information, such as to the interest level or area-of-interest of the image being presented to the user.

Reference signs list

10 information processing systems

20 content transfer units

30 data transceiving units

31 content receipt units

32 assessment information transmitting units

40 head-mounted displays (HMD)

41 videos and voice signal display unit

42 E.E.G measuring units

43 biometric informations obtain sensor

50 content analysis units

51 assessment information receiving units

52 assessment storage units

53 in response to determining that unit

100 information processing systems

120 content transfer units

130 data transceiving units

131 content receipt units

132 rendering control signals holding units

133 assessment information transmitting units

140 head-mounted displays (HMD)

141 videos and voice signal display unit

142 E.E.G measuring units

143 eye muscle potential measurement units

145 E.E.Gs and eye muscle potentiometric detection electrode setting head-mounted display (HMD)

150 content analysis units

151 assessment information receiving units

152 assessment storage units

153 in response to determining that unit

201 E.E.G analytical units

202 interesting region estimating units

301 posture detecting units

331 postures correspond to electromyogram signal estimation unit

701 CPU

702 ROM

703 RAM

704 buses

705 input/output interfaces

706 input units

707 output units

708 storage units

709 communication units

710 E.E.G acquiring units

711 eye muscle current potential acquiring units

712 posture information acquiring units

801 CPU

802 ROM

803 RAM

804 buses

805 input/output interfaces

806 input units

807 output units

808 storage units

809 communication units

810 drivers

811 removable mediums.

Claims (according to the 19th article of modification of treaty)

1. a kind of information processing unit, in conjunction with the brain wave signal and described image of user (viewer) acquisition of image from Reproduction control information and generate and be set so that can identify whether export the brain wave signal when specific image is presented Assessment information.

2. information processing unit according to claim 1, comprising:

3. information processing unit according to claim 1, wherein further combined with the user of the described image from (viewer) obtain eye muscle electric potential signal and described image reproduction control information and generate and be set so that and can identify The assessment information of the eye muscle electric potential signal whether is exported when specific image is presented.

4. a kind of information processing unit,

It wherein inputs the brain wave signal of user (viewer) acquisition of the image from and assesses information, the assessment information is Data corresponding with the reproduction control information of described image and being set so that can be identified when specific image is presented The no output brain wave signal, and

It is emerging to the sense for the image for being presented to the user (viewer) that acquisition is executed using the assessment information including the brain wave signal The analytic process of at least one information in interesting degree or assessment, intensity and degree of fatigue.

5. information processing unit according to claim 4,

The eye muscle electric potential signal and assessment information that wherein further the user (viewer) of input image from obtains, The assessment information is that data corresponding with the reproduction control information of described image and being set so that can be identified when being in The eye muscle electric potential signal whether is exported when existing specific image, and

6. information processing unit according to claim 4,

The posture information and assessment information that wherein further the user (viewer) of input described image from obtains, The assessment information is that data corresponding with the reproduction control information of described image and being set so that can be identified when being in Whether the posture information is exported when existing specific image, and

Estimate the electromyogram signal based on the posture information, and

It is equivalent to the noise signal of electromyogram signal component by being removed from the brain wave signal and generates high-precision E.E.G letter Number, and the analytic process is executed using high-precision brain wave signal generated.

7. information processing unit according to claim 4, wherein the analysis result for using the brain wave signal to obtain is made The content transfer unit that described image is passed to the user (viewer) is further output to for feedback information.

8. a kind of information processing unit,

It is executed according to the analysis result of the brain wave signal obtained based on the user (viewer) of the image to described Transmit the control of content.

9. information processing unit according to claim 8, wherein being held based on the feedback information of individual consumer (viewer) Transmitting content-control of the row to the individual consumer (viewer).

10. a kind of information processing system, comprising:

User apparatus, to user (viewer) presentation content；With

Content analysis devices receive the assessment information about the content from the user apparatus and analyze the assessment letter Breath,

The brain wave signal and described image that wherein the user apparatus combines the user (viewer) of the image to obtain are again It now controls information and generates and be set so that can identify whether export commenting for the brain wave signal when specific image is presented Estimate information, and the assessment information is output to the content analysis devices.

11. information processing system according to claim 10,

Wherein it is described to being presented to execute acquisition using the assessment information including the brain wave signal for the content analysis devices The interest level of the described image of user (viewer) or at least one information in assessment, intensity and degree of fatigue Analytic process, and

The result of the analytic process is output to as feedback information, described image is passed to the user's (viewer) The content delivering apparatus.

12. information processing system according to claim 10,

Wherein the user apparatus combine from from described image user (viewer) acquisition eye muscle electric potential signal with it is described The reproduction control information of image and generating be set so that can identify whether exported when the specific image is presented it is described The assessment information of eye muscle electric potential signal, and the assessment information is output to the content analysis devices, and

The content analysis devices are analyzed using including the assessment information of the eye muscle electric potential signal to being presented to the user The area-of-interest of the described image of (viewer).

13. a kind of information processing method executed in information processing unit,

The wherein E.E.G that the data processing unit of the information processing unit combines the user (viewer) of the image to obtain The reproduction control information of signal and described image and generating be set so that can identify it is whether defeated when specific image is presented The assessment information of the brain wave signal out.

14. a kind of program for handling information processing unit execution information,

Wherein described program makes the data processing unit of the information processing unit in conjunction with the user (viewer) of the image from The brain wave signal of acquisition and the reproduction control information of described image and generating, which is set so that, can identify when specific pattern is presented As when whether export the assessment information of the brain wave signal.

Claims

1. a kind of information processing unit of head-mounted display, comprising:

Image presentation unit is configured to that image is presented to user (viewer)；With

E.E.G measuring unit is configured to measure the E.E.G of the user (viewer),

Wherein E.E.G measuring electrode is arranged in the head zone for wearing the user (viewer) of the head-mounted display.

2. information processing unit according to claim 1, further includes:

Voice output unit.

3. information processing unit according to claim 1, further includes:

Eye muscle potential measurement unit is configured to detect the eye muscle electricity of the user (viewer) of the head-mounted display Position.

4. information processing unit according to claim 3, wherein the eye muscle potential measurement unit is included in described in wearing Eye muscle potential-measuring electrode in the facial area of the user (viewer) of head-mounted display.

5. information processing unit according to claim 1, further includes:

Posture detecting unit is configured to detect the posture information of the user (viewer) of the head-mounted display.

6. information processing unit according to claim 5, wherein the posture detecting unit include acceleration transducer or Gyroscope.

7. a kind of information processing unit, in conjunction with the brain wave signal and described image of user (viewer) acquisition of image from Reproduction control information and generate and be set so that can identify whether export the brain wave signal when specific image is presented Assessment information.

8. information processing unit according to claim 7, comprising:

9. information processing unit according to claim 7, wherein further combined with the user of the described image from (viewer) obtain eye muscle electric potential signal and described image reproduction control information and generate and be set so that and can identify The assessment information of the eye muscle electric potential signal whether is exported when specific image is presented.

10. a kind of information processing unit,

11. information processing unit according to claim 10,

12. information processing unit according to claim 10,

Estimate the electromyogram signal based on the posture information, and

13. information processing unit according to claim 10, wherein the analysis result that the brain wave signal will be used to obtain The content transfer unit that described image is passed to the user (viewer) is further output to as feedback information.

14. a kind of information processing unit,

15. information processing unit according to claim 14, wherein the feedback information based on individual consumer (viewer) come Execute the transmitting content-control to the individual consumer (viewer).

16. a kind of information processing system, comprising:

User apparatus, to user (viewer) presentation content；With

17. information processing system according to claim 16,

18. information processing system according to claim 16,

19. a kind of information processing method executed in information processing unit,

20. a kind of program for handling information processing unit execution information,