WO2017175432A1 - 情報処理装置、情報処理方法、およびプログラム - Google Patents
情報処理装置、情報処理方法、およびプログラム Download PDFInfo
- Publication number
- WO2017175432A1 WO2017175432A1 PCT/JP2016/089186 JP2016089186W WO2017175432A1 WO 2017175432 A1 WO2017175432 A1 WO 2017175432A1 JP 2016089186 W JP2016089186 W JP 2016089186W WO 2017175432 A1 WO2017175432 A1 WO 2017175432A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- information
- user
- processing apparatus
- information processing
- unit
- Prior art date
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 111
- 238000003672 processing method Methods 0.000 title claims abstract description 7
- 230000009471 action Effects 0.000 claims description 32
- 238000004364 calculation method Methods 0.000 claims description 21
- 230000006870 function Effects 0.000 claims description 19
- 230000008859 change Effects 0.000 claims description 7
- 239000000284 extract Substances 0.000 claims description 4
- 230000003247 decreasing effect Effects 0.000 claims description 2
- 230000006399 behavior Effects 0.000 description 23
- 238000004891 communication Methods 0.000 description 20
- 238000000034 method Methods 0.000 description 16
- 238000012986 modification Methods 0.000 description 16
- 230000004048 modification Effects 0.000 description 16
- 230000008569 process Effects 0.000 description 13
- 238000012545 processing Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 230000001133 acceleration Effects 0.000 description 5
- 230000015572 biosynthetic process Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 238000003786 synthesis reaction Methods 0.000 description 5
- 238000009434 installation Methods 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 238000012937 correction Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 230000036760 body temperature Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000001151 other effect Effects 0.000 description 2
- 230000035900 sweating Effects 0.000 description 2
- WZFUQSJFWNHZHM-UHFFFAOYSA-N 2-[4-[2-(2,3-dihydro-1H-inden-2-ylamino)pyrimidin-5-yl]piperazin-1-yl]-1-(2,4,6,7-tetrahydrotriazolo[4,5-c]pyridin-5-yl)ethanone Chemical class C1C(CC2=CC=CC=C12)NC1=NC=C(C=N1)N1CCN(CC1)CC(=O)N1CC2=C(CC1)NN=N2 WZFUQSJFWNHZHM-UHFFFAOYSA-N 0.000 description 1
- 241000272201 Columbiformes Species 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 230000004424 eye movement Effects 0.000 description 1
- 230000008921 facial expression Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 210000003205 muscle Anatomy 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000000284 resting effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000001308 synthesis method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L13/00—Speech synthesis; Text to speech systems
- G10L13/08—Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
Definitions
- the present disclosure relates to an information processing apparatus, an information processing method, and a program.
- the degree of interest is selected from a group of articles with conditions such as total voice time length, speech speed, number of essential playback articles, and the like.
- a speech synthesis method has been proposed in which high articles are selected in descending order of interest, and the selected articles are summarized into an appropriate amount and reproduced as synthesized speech.
- an information processing apparatus capable of controlling the information amount of voice information so as to finish listening within a time during which information presentation can be received and improving the convenience of voice information presentation. suggest.
- the estimation unit that estimates the duration of the state in which the user can receive the information presentation, and the estimated duration
- an adjustment unit that adjusts the amount of information presented to the user.
- the processor estimates the duration of the state where the information presentation can be received, and the estimated duration time In response to this, an information processing method is proposed, including adjusting the amount of information presented to the user.
- the estimation unit that estimates the duration of the state in which the user can receive the information presentation
- the estimated continuation A program functions as an adjustment unit that adjusts the amount of information presented to the user according to time.
- the present disclosure it is possible to control the information amount of the voice information so as to finish listening within the time when the information presentation can be received, thereby improving the convenience of the voice information presentation.
- FIG. 1 is a perspective view illustrating an example of an external configuration of the information processing apparatus 1 according to the present embodiment.
- the information processing apparatus 1 may be, for example, a neckband type information processing terminal hung on the user's neck.
- the neckband type information processing apparatus 1 has a mounting unit (a mounting portion) shaped to make a half turn from both sides of the neck to the back side (back side), and is mounted on the user by being hooked on the user's neck.
- FIG. 1 the perspective view in the state which the user mounted
- words indicating directions such as up, down, left and right, front and back are used, and these directions indicate directions viewed from the center of the user's body (for example, the position of the pigeon tail) in the user's upright posture.
- “right” indicates the direction of the user's right side
- “left” indicates the direction of the user's left side
- “up” indicates the direction of the user's head
- “down” Indicates the direction of the user's foot.
- “front” indicates a direction in which the user's body faces
- “rear” indicates a direction on the user's back side.
- the mounting unit may be mounted in close contact with the user's neck or may be mounted separately.
- Other shapes of the neck-mounted mounting unit include, for example, a pendant type mounted on the user by a neck strap, or a headset type having a neck band passing through the back of the neck instead of a head band applied to the head. Conceivable.
- the usage form of the wearing unit may be a form used by being directly worn on the human body.
- the form that is directly worn and used refers to a form that is used without any object between the wearing unit and the human body.
- the case where the mounting unit shown in FIG. 1 is mounted so as to contact the skin of the user's neck corresponds to this embodiment.
- various forms such as a headset type and a glasses type that are directly attached to the head are conceivable.
- wearing unit may be a form used by mounting
- the form that is used by being indirectly worn refers to a form that is used in the state where some object exists between the wearing unit and the human body. For example, when the wearing unit shown in FIG.
- the information processing apparatus 1 is provided with a plurality of microphones 12 (12A, 12B), cameras 13 (13A, 13B), and speakers 15 (15A, 15B).
- the microphone 12 acquires sound data such as user sound or ambient environmental sound.
- the camera 13 captures an image of the surroundings and acquires image data.
- the speaker 15 reproduces audio data.
- microphones 12A and 12B are provided at both ends of the information processing apparatus 1
- cameras 13A and 13B are provided in front of both ends of the information processing apparatus 1
- the speakers 15A and 15B are equipped with the information processing apparatus 1. It is provided in the location located near the user's both ears.
- the installation positions and the number of installations of the microphone 12, the camera 13, and the speakers 15 are examples, and are not limited to the example shown in FIG. For example, one or three or more microphones 12, cameras 13, and speakers 15 may be provided, or the installation positions may be different from those in FIG.
- auditory information presentation that is, information presentation by voice
- pull type and push type are assumed for the presented information.
- the pull type is information that is requested and presented when the user wants to know, and is activated by a button operation, a screen operation, or a voice operation.
- the push type is information that is automatically presented without being conscious of the user, and for example, e-mail notification, incoming call, call from application, notification, battery remaining amount warning, and the like are assumed.
- Push-type voice notification has the advantage that information is automatically presented, but has the disadvantage that information is presented even when the user cannot hear the information.
- information is presented even when the user cannot hear the information.
- an operation to stop the voice is necessary.
- FIG. 2 is a block diagram illustrating an example of an internal configuration of the information processing apparatus 1 according to the present embodiment.
- the information processing apparatus 1 includes a control unit 10, a communication unit 11, a microphone 12, a camera 13, a 9-axis sensor 14, a speaker 15, a position positioning unit 16, a storage unit 17, and a biological sensor 18. .
- the control unit 10 functions as an arithmetic processing device and a control device, and controls the overall operation in the information processing device 1 according to various programs.
- the control unit 10 is realized by an electronic circuit such as a CPU (Central Processing Unit) or a microprocessor, for example.
- the control unit 10 may include a ROM (Read Only Memory) that stores programs to be used, calculation parameters, and the like, and a RAM (Random Access Memory) that temporarily stores parameters that change as appropriate.
- control unit 10 includes a user situation recognition unit 10a, a surrounding situation recognition unit 10b, a discrimination unit 10c, an estimation unit 10d, an adjustment unit 10e, a presentation information acquisition unit 10f, and a voice. It functions as a combining unit 10g.
- the user situation recognition unit 10a has a function of recognizing a user situation based on various sensor information about the user.
- the user situation recognizing unit 10a includes a user voice picked up by the microphone 12, a user's face image picked up by the camera 13, an acceleration sensor included in the 9-axis sensor 14, a gyro sensor, a geomagnetic sensor, and the like. Based on the data and the position information measured by the position positioning unit 16, the user's action is recognized.
- the user's behavior recognition also grasps the situation of walking, running, and stopping, as well as detailed situations such as riding a bicycle / car / train, sitting, standing, and sleeping. obtain.
- the biosensor data is assumed to be, for example, a pulse, a heartbeat, a sweating amount, a body temperature, an electroencephalogram, and a line of sight (an image obtained by capturing an eye movement or a movement of a muscle around the eye).
- the surrounding situation recognition unit 10b has a function of recognizing the environment and situation around the user based on various sensor information related to the environment.
- the user situation recognition unit 10a is based on the environmental sound (noise, car sound, etc.) collected by the microphone 12, the surrounding scenery imaged by the camera 13, and the position information measured by the position measurement unit 16.
- the situation around the user is recognized.
- the determination unit 10c determines whether or not the user can receive voice information presentation based on at least one of the user's situation and the surrounding situation.
- the information processing apparatus 1 determines whether or not the user can receive information, and presents information by voice when the user can receive information. For example, the determination unit 10c calculates the degree of concentration based on the user situation. If the user concentrates on one thing, the information presentation is NG, and if the user is relaxed, the information presentation is OK. It is possible. Moreover, OK / NG of information presentation can be discriminate
- the information presentation is NG when running or riding a bicycle, and the information presentation is OK when sitting or walking. More specifically, the information presentation is NG when the user is stroking the bicycle with full power, and the information presentation is OK while the user stops at the intersection or the like. Further, the information presentation is NG while the user is running, and the information presentation is OK while the user is stopped due to a signal or the like.
- the determination unit 10c can determine whether or not information presentation can be received according to the surrounding situation. For example, the determination unit 10c calculates the surrounding danger level (a degree to which attention must be paid) from surrounding video and audio, and sets the information presentation NG when the danger level is high. For example, the determination unit 10c sets the information presentation NG because an intersection with a large amount of traffic has a high degree of danger. More specifically, for example, even when the user is driving a car, the information presentation is OK when the user is moving smoothly. However, when the user has to pay attention to the surroundings such as a crowded intersection, Is done. Further, the information presentation NG is used in places where the surrounding noise is troublesome.
- the surrounding situation receives the sensor data from the monitoring camera and the human sensor installed in the vicinity in addition to the microphone 12 and the camera 13 provided in the information processing apparatus 1 via the communication unit 11, and It may be used for recognition.
- the determination unit 10c can determine whether or not the user can receive voice information presentation by comprehensively considering the “user situation” and the “peripheral situation”. For example, the discriminating unit 10c discriminates each of “user situation” and “peripheral situation”, and outputs the information presentation OK and the discrimination result as a whole only when both can be discriminated as information presentation OK. In the case of presentation NG, the information presentation NG and the determination result may be output as a whole. Alternatively, the discriminating unit 10c discriminates each of the “user situation” and the “surrounding situation”, weights and adds a score indicating whether or not both information presentations are received, and comprehensive information is obtained when the threshold value is exceeded. It may be determined that the presentation is OK.
- the estimation unit 10d estimates the duration of the state in which the user can receive information.
- control is performed so that information presentation by voice is finished in a section (time) in which the user can receive information.
- the duration of the state in which the user can receive information is, for example, the time until the signal turns blue and starts moving when the user is riding a bicycle and stops waiting for a signal.
- FIG. 3 is a diagram for explaining audio information presentation control timing according to the present embodiment. Hereinafter, with reference to FIG. 3, a section (time) in which the user can receive information will be described.
- the recommended reading start timing is the timing t1 when the information presentation OK starts, and the recommended reading end timing is the end of the information presentation OK state. It is timing t3.
- a period from timing t1 to t3 is a section in which the user can receive information, that is, “readable time”.
- the information processing apparatus 1 starts reading (speech information presentation), for example, from timing t1, and reads “reading time” (so that timing t2 when reading ends is before timing t3 when reading-ready time ends. Adjust the audio information presentation time.
- the “read-out time” is adjusted mainly by controlling the amount of audio information to be presented, and will be described in detail later. Further, the time from the timing t2 when the reading is finished to the timing t4 when the next reading is started is referred to as a “reading interval”.
- the duration of a state in which the user can receive information can be estimated based on, for example, the past behavior history of the user himself or the past behavior history of all users.
- the user's action history (date, position, action) is routinely accumulated in the storage unit 17 according to the present embodiment.
- the estimation unit 10d sets the situation (position information, day / time information, behavior) when the user is in a “state where information can be received” and the “state where information cannot be received”. It is possible to statistically determine the trend of the relationship until the time until it becomes (readable time). That is, the estimation unit 10d can estimate the readable time from the average value of the readable time in a similar situation in the past when a certain situation occurs. Note that the estimation unit 10d can also determine the readable time using machine learning.
- FIG. 4 is a diagram for explaining the estimation of the readable time based on the user's own action history according to the present embodiment. As shown in FIG. 4, for example, based on the history of position information, day of the week, time, action, and readable time, the estimation unit 10d determines that “by bicycle” at “XX intersection” and “8:00 am on weekdays”. The time that can be read out when the vehicle stops is statistically estimated to be 42 seconds.
- the estimation unit 10d is not limited to the user's own action history, and can similarly estimate the readable time based on the past action history of all users.
- the past behavior history of all users can be acquired from a server on a network connected via the communication unit 11, for example.
- FIG. 5 is a diagram for explaining estimation of a possible reading time based on the action history of all users according to the present embodiment.
- the estimation unit 10d sets the “XX intersection” to “weekday morning 8: 1”.
- the time that can be read out when the bicycle is stopped is statistically estimated to be 42 seconds.
- the estimation unit 10d requests the server's action history of all users at the current position based on the current position information, and if sufficient data necessary for the estimation cannot be obtained (predetermined amount). If not, it may be switched to estimation based on the user's own action history accumulated in the storage unit 17.
- the estimation unit 10d may extract regularity from the behavior history of all users and use it for estimating the readable time. For example, the regularity of the timing at which the signal changes is calculated from the action history of people who have stopped within the last hour with a certain signal, and when the user stops with the signal, the information becomes “blue” and starts moving Estimate the “continuation time during which presentation can be received” (readable time).
- the estimation unit 10d determines the regularity of the timing when the signal changes from red to blue from the position information of all users and the movement start time. Can be estimated. As a result, it is possible to estimate how long the signal will turn blue, and to estimate the possible reading time.
- the estimation unit 10d receives control information from a stopped traffic light, grasps the time when the signal changes from red to blue, and more accurately. The possible reading time can be estimated.
- the estimation unit 10d performs estimation based on the behavior history of all users or estimation based on the behavior history of the users themselves, and then when the estimation has a high certainty level due to regular changes in traffic facilities, the estimation result is obtained. You may make it employ
- the adjustment unit 10e has a function of adjusting information to be presented to the user to an information amount at which voice output is completed within the readable time estimated by the estimation unit 10d.
- Information to be presented to the user is acquired by the presentation information acquisition unit 10f.
- the information presented to the user is information that is automatically presented to the user at an appropriate timing, such as a push notification. For example, in addition to e-mail notifications, incoming calls, calls from applications, notifications, battery level warnings, etc., it may be assumed that new information such as news sites registered in advance or SNS (Social Networking Service) is presented.
- SNS Social Networking Service
- the adjustment unit 10e can adjust the number of items to be read out, the content to be read out, or the speed of reading out. Moreover, the adjustment part 10e may combine these adjustment methods.
- the adjustment unit 10e calculates in advance the time taken to read out each piece of information to read out (news article, e-mail, etc., called "item"), and calculates how many items can be read out Then, the number of items to be read out is adjusted according to the readable time.
- the time required for reading out may be obtained from the average of the time taken in the past, or may be obtained by estimating from the number of characters of the text to be read out.
- the adjustment unit 10e can adjust the reading to read out 10 articles of news when the readable time is long, and to read out only 3 articles when it is short.
- the adjustment unit 10e calculates in advance the time required for reading for each granularity of information, such as only the title, only the first sentence, or the entire sentence, and the items that must be read out Adjust to the appropriate grain size according to the number. For example, the adjustment unit 10e reads out only the news title when the readable time is short, reads up to the first sentence when it is a little longer, reads up to the summary when it is longer, and if there is enough time Can be adjusted to read the full text.
- the adjusting unit 10e calculates the reading time at the normal speed from the amount of information to be read, and adjusts the reading speed to be completed within the time when the reading time is not enough. For example, the adjustment unit 10e can adjust the reading speed to be higher than usual when the readable time is slightly shorter.
- the presentation information acquisition unit 10f acquires information to be presented to the user.
- the presentation information may be received by the communication unit 11, may be extracted from the storage unit 17, or may be generated by an application that is activated on the information processing apparatus 1.
- the speech synthesis unit 10g has a function of performing speech synthesis based on the presentation information (text) adjusted by the adjustment unit 10e.
- the presentation information is voiced by the voice synthesizer 10g, the voice information is output from the speaker 15 and presented to the user.
- the communication unit 11 is a communication module for transmitting and receiving data to and from other devices by wire / wireless.
- the communication unit 11 is a system such as a wired LAN (Local Area Network), wireless LAN, Wi-Fi (Wireless Fidelity (registered trademark)), infrared communication, Bluetooth (registered trademark), short-range / non-contact communication, and the like. Wirelessly or directly via a network access point.
- the microphone 12 collects the user's voice and the surrounding environment, and outputs it to the control unit 10 as voice data.
- the camera 13 photoelectrically converts a lens system including an imaging lens, an aperture, a zoom lens, a focus lens, and the like, a drive system that causes the lens system to perform a focus operation and a zoom operation, and imaging light obtained by the lens system.
- a solid-state image pickup device array for generating an image pickup signal.
- the solid-state imaging device array may be realized by, for example, a CCD (Charge Coupled Device) sensor array or a CMOS (Complementary Metal Oxide Semiconductor) sensor array.
- the camera 13 is provided so that the front of the user can be imaged in a state where the information processing apparatus 1 (mounting unit) is mounted on the user.
- the camera 13 can capture the scenery around the user and the scenery in the direction in which the user is looking. Further, the camera 13 may be provided so that the user's face can be imaged in a state where the information processing apparatus 1 is worn by the user. In this case, the information processing apparatus 1 can specify the user's line-of-sight direction and facial expression from the captured image. In addition, the camera 13 outputs captured image data that is a digital signal to the control unit 10.
- the 9-axis sensor 14 includes a 3-axis gyro sensor (detection of angular velocity (rotational speed)), a 3-axis acceleration sensor (also referred to as G sensor, detection of acceleration during movement), and a 3-axis geomagnetic sensor (compass, absolute direction (azimuth) ) Detection).
- the 9-axis sensor 14 has a function of sensing the state of the user wearing the information processing apparatus 1 or the surrounding state.
- the 9-axis sensor 14 is an example of a sensor unit, and the present embodiment is not limited thereto.
- a speed sensor or a vibration sensor may be further used, or an acceleration sensor, a gyro sensor, and a geomagnetic sensor may be used. At least one of them may be used.
- the sensor unit may be provided in a device different from the information processing device 1 (mounting unit), or may be provided in a distributed manner in a plurality of devices.
- an acceleration sensor, a gyro sensor, and a geomagnetic sensor may be provided in a device (for example, an earphone) attached to the head, and a speed sensor or a vibration sensor may be provided in a smartphone.
- the 9-axis sensor 14 outputs information indicating the sensing result to the control unit 10.
- the speaker 15 reproduces the voice signal processed by the voice synthesizer 10 g under the control of the controller 10.
- the speaker 15 may have directivity.
- the position positioning unit 16 has a function of detecting the current position of the information processing apparatus 1 based on an externally acquired signal.
- the positioning unit 16 is realized by a GPS (Global Positioning System) positioning unit, receives a radio wave from a GPS satellite, detects a position where the information processing apparatus 1 exists, and detects the position.
- the position information is output to the control unit 10.
- the information processing apparatus 1 detects a position by, for example, Wi-Fi (registered trademark), Bluetooth (registered trademark), transmission / reception with a mobile phone / PHS / smartphone, or short-range communication. There may be.
- the storage unit 17 stores programs and parameters for the above-described control unit 10 to execute each function. Moreover, the memory
- Biosensor 18 The biometric sensor 18 detects various biometric information of the user and outputs it as biosensor data to the control unit 10. As described above, for example, a pulse, a heartbeat, a sweating amount, a body temperature, an electroencephalogram, and a line of sight are assumed as the biosensor data. Note that at least a part of the biosensor 18 may be provided in an external device. In this case, biosensor data detected by the biosensor of the external device can be received by the communication unit 11 via wireless communication and output to the control unit 10.
- FIG. 6 is a flowchart showing the read-out adjustment operation process according to the present embodiment.
- the determination unit 10c of the information processing apparatus 1 determines whether or not it is a readable timing (step S103). That is, the determination unit 10c determines whether or not the user is currently in a state of receiving voice information presentation according to the recognition result of the user situation or the surrounding situation.
- the presentation information acquisition unit 10f acquires the reading information (step S109). Since the read-out information is automatically prepared information such as push-type notification information, for example, the presentation information acquisition unit 10f searches for information to be presented to the user at the current time.
- step S115 when the read-out information exists (step S112 / Yes), the estimation unit 10d estimates the readable time (step S115). The process for estimating the readable time will be described in detail with reference to FIG.
- the adjustment unit 10e adjusts the reading contents (that is, generates the reading contents) so that the presentation information can be read within the estimated reading-ready time (step S118).
- the information processing apparatus 1 converts the content adjusted by the speech synthesizer 10g into speech, and reads out information (speech presentation) from the speaker 15 (step S121).
- step S115 the estimation process of the readable time shown in step S115 will be described with reference to FIG.
- FIG. 7 is a flowchart showing an operation process for estimating the readable time according to the present embodiment.
- the estimation unit 10d of the information processing device 1 acquires past histories of all users at the current position (step S130).
- the past histories of all users are on, for example, the server, and the estimation unit 10d requests the server to obtain the past histories of all users based on the current positions together with the current position information measured by the position positioning unit 16.
- step S133 when a predetermined amount of past histories of all users is accumulated (step S133 / Yes), a possible reading time is estimated based on the past histories of all users (step S136).
- step S133 when a predetermined amount of past histories of all users has not been accumulated (step S133 / No), a possible reading time is estimated based on the past histories of the users themselves (step S139).
- the estimation unit 10d determines whether or not the regularity can be calculated from the target past history (step S142).
- Regularity refers to regular changes in traffic facilities such as railroad crossings and traffic lights. When user conditions and surrounding conditions depend on surrounding traffic facilities, more reliable reading time is possible by considering these regularities. Can be estimated.
- the estimation unit 10d calculates the regularity, and updates the estimated value of the readable time based on the calculated regularity (step S145).
- FIG. 8 is a block diagram showing an example of the configuration of the information processing apparatus 1-1 according to the present modification.
- the information processing apparatus 1-1 includes a control unit 10-1, a communication unit 11, a microphone 12, a camera 13, a 9-axis sensor 14, a speaker 15, a position positioning unit 16, a storage unit 17, and a living body. It has a sensor 18.
- the control unit 10-1 includes a user situation recognition unit 10a, a surrounding situation recognition unit 10b, a discrimination unit 10c, an estimation unit 10d, an adjustment unit 10e, a presentation information acquisition unit 10f, a speech synthesis unit 10g, and related items. It functions as a degree calculation unit 10h, a forgetting degree calculation unit 10i, and a content change unit 10j.
- the relevance calculation unit 10h has a function of calculating the relevance between the content presented last time and the content presented this time.
- the relevance is, for example, information related to common matters (for example, news about the same incident) or the same type of information (for example, news, warnings, notifications, etc., information genre, information on the same corner in the program, etc.) ) Is calculated. If the degree of relevance is high, an introduction message is added so that the previous information is recalled according to the degree of forgetting described below, and if the degree of relevance is low, there is no need to remind the previous information. No information is presented about the previous information.
- the forgetting degree calculation unit 10i predicts how much the user has forgotten the content presented last time and calculates the forgetting degree. For example, the forgetting degree calculating unit 10i may calculate the forgetting degree according to the length of the reading interval, that is, the length of time from the end of the previous reading to the start of the current reading. In addition, the forgetting degree calculation unit 10i performed an action performed by the user within a time period from the end of the previous reading to the start of the current reading (i.e., talking with other people, watching TV, or exercising). The degree of forgetting may be calculated in consideration of, for example, working, resting, or acquiring other information. For example, as shown in the following formula 1, the forgetting degree (F) may basically increase in proportion to the time t from the previous information presentation, but the forgetting degree may increase due to user behavior during that time. .
- Equation 1 ⁇ is a coefficient related to the interval, and ⁇ i is a coefficient related to each user action.
- T is the length (time) of the interval from the previous information presentation, and A i is the user action during the interval T.
- the content changing unit 10j changes the content of information presented to the user according to the calculated degree of forgetting. For example, the content changing unit 10j adds an introduction message that refers to the relationship with the previous presentation information and the content of the previous presentation information to the beginning of the information presented to the user this time, according to the magnitude of the degree of forgetting. More specifically, when the forgetting degree is smaller than the first threshold value, the content changing unit 10j changes the content to a prelude only “continue”. In addition, the content changing unit 10j determines that the degree of forgetting is larger than the first threshold value and smaller than the second threshold value (here, the first threshold value is smaller than the second threshold value). I told you about XXX. "At the beginning, the keyword of the previous presentation information is changed to a description. If the degree of forgetting is greater than the second threshold value, it is “XX corner. The previous time is“ ... ”. Change to content.
- FIG. 9 is a flowchart showing a reading adjustment operation process according to this modification.
- the determination unit 10c of the information processing apparatus 1-1 determines whether or not it is a readable timing (step S203).
- Step S206 when it is determined that it is currently possible to read aloud (step S206 / Yes), the presentation information acquisition unit 10f acquires the reading information (step S209), and determines whether or not the reading information exists. (Step S212).
- the processes shown in steps S203 to S212 are the same as the processes shown in steps S103 to S112 described with reference to FIG.
- the relevance calculation unit 10h calculates the content relevance between the information presented this time and the information presented last time (step S215).
- step S218 / Yes when the degree of content relevance is higher than a predetermined value set in advance (step S218 / Yes), the forgetting degree calculating unit 10i calculates the forgetting degree (step S221).
- the content changing unit 10j changes the content of the presentation information according to the calculated degree of forgetting (step S224).
- step S218 / No when the content relevance is lower than a predetermined value set in advance (step S218 / No), the content of the presentation information is not changed.
- the estimation unit 10d estimates a possible reading time (step S227).
- the estimation process of the readable time is the same as the process described with reference to FIG. Note that the timing for performing the process of estimating the readable time is not limited to the processing order shown in FIG. 9, and may be performed before the content relevance calculation (step S ⁇ b> 215) or in parallel with the content relevance calculation.
- the adjustment unit 10e adjusts the reading contents so that the presentation information can be read within the estimated reading-ready time (step S230).
- the information processing apparatus 1 converts the content adjusted by the speech synthesizer 10g into speech, and reads out information (speech presentation) from the speaker 15 (step S233).
- FIG. 10 is a diagram illustrating an example of a system configuration according to the present modification.
- this embodiment may be configured by a client-server type system. That is, the information processing apparatus 1 (1A, 1B) is a system configuration that is connected to the server 4 via the network 3.
- the information processing apparatuses 1A and 1B are all examples of the information processing apparatus 1 according to the present embodiment.
- the information processing apparatus 1A is a terminal used by a user, for example, and the information processing apparatus 1B is a terminal used by another user.
- the information processing apparatus 1 ⁇ / b> B is realized by, for example, a smartphone, can be connected to the earphone 5 wirelessly or by wire, and can present audio information from the earphone 5.
- the information processing apparatuses 1A and 1B can be connected to the network 3 wirelessly or by wire and can transmit and receive data to and from the server 4 on the cloud. In the example shown in FIG. 10, two information processing apparatuses 1 are shown. However, the present embodiment is not limited to this, and a large number of information processing apparatuses 1 used by a large number of users are connected via a network 3. 4 can be connected.
- the server 4 has an action history DB (database) 42 for all users, accumulates action information transmitted from the information processing apparatuses 1A and 1B, and transmits it to an external apparatus as necessary.
- the configuration of the server 4 will be described with reference to FIG.
- FIG. 11 is a block diagram showing an example of the configuration of the server 4 according to the present embodiment.
- the server 4 includes a control unit 40, a communication unit 41, and an action history DB 42 for all users.
- the control unit 40 can function as the estimation unit 40a, the adjustment unit 40b, and the presentation information acquisition unit 40c.
- the function of each configuration is the same as the function of the same configuration of the information processing apparatus 1.
- the communication unit 41 can send and receive data to and from an external device via the network 3.
- the action history DB 42 of all users stores user action histories received from the information processing apparatuses 1 ⁇ / b> A and 1 ⁇ / b> B via the communication unit 41.
- the server 4 may extract and return a predetermined behavior history from the behavior history DB 42 of all users in response to a request from the information processing apparatus 1A, for example.
- the server 4 uses the estimation unit 40a to calculate the readable time from the average value of the readable time in a similar situation of all past users when a certain situation occurs in response to a request from the information processing apparatus 1A, for example. It may be estimated and returned.
- the server 4 acquires presentation information to the user by the presentation information acquisition unit 40c, and adjusts the reading to be finished within the possible reading time estimated by the estimation unit 40a. You may return the data.
- the server 4 may be provided with a configuration corresponding to the voice synthesis unit 10g, the relevance calculation unit 10h, the forgetting degree calculation unit 10i, and the content change unit 10j illustrated in FIG.
- the information processing apparatus 1 estimates the time during which information can be received (that is, the time that can be read out), and controls the information amount of the audio information so that it finishes listening within the time. It is possible to improve the convenience of presenting voice information.
- this technique can also take the following structures.
- An estimation unit that estimates a duration of a state in which information can be received when it is determined that the user is in a state in which information can be received by voice;
- An adjustment unit that adjusts the amount of information to be presented to the user according to the estimated duration time;
- An information processing apparatus comprising: (2) The information processing apparatus according to (1), wherein whether or not the information presentation is received is determined based on at least one of the user's situation and the surrounding situation.
- the user's situation includes the user's behavior, The information processing apparatus according to (2), wherein whether or not the user is in a state where information can be received is determined according to the action recognition result of the user.
- the situation of the user includes the concentration level of the user, The information processing apparatus according to (2) or (3), wherein whether or not the user can receive information is determined according to the calculation result of the degree of concentration.
- the user's situation includes the risk around the user, 5.
- the estimation unit estimates the duration using the behavior histories of all users when there is a predetermined amount of past behavior histories of all the users associated with the current position of the user.
- the information processing apparatus according to any one of (1) to (9), wherein the duration is estimated using the user action history.
- the estimation unit according to any one of (1) to (9), wherein the estimation unit extracts regularity of surrounding traffic facilities based on past behavior histories of all users and estimates the duration. Information processing device.
- the information processing apparatus according to any one of (1) to (13), wherein the estimation unit estimates the duration based on control information acquired from a traffic facility or a car.
- the information processing apparatus includes: A calculation unit for calculating the degree of forgetting of the user; A change unit that changes information to be presented to the user according to the calculated degree of forgetting, The information processing apparatus according to any one of (1) to (14), further including: (16) The information processing apparatus according to (15), wherein the changing unit adds an introduction message based on the previously presented information to the beginning of reading the presentation information. (17) The information processing apparatus according to (15) or (16), wherein the calculation unit calculates a forgetting degree based on at least one of an elapsed time from a previously presented time and a user behavior during that time.
- the information processing apparatus includes: An acquisition unit for acquiring real-time sensing data regarding the user's situation or the situation around the user; An output unit for outputting a reading voice of the presentation information, adjusted to finish reading within a duration of the state in which the user can receive information presentation;
- the information processing apparatus according to any one of (1) to (17), further including: (19) Processor Estimating a duration of a state in which the user can receive information when it is determined that the user is in a state in which information can be received by voice; Adjusting the amount of information presented to the user according to the estimated duration; Including an information processing method.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
1.本開示の一実施形態による情報処理装置の概要
2.内部構成例
3.動作処理
4.変形例
4-1.第1の変形例
4-2.第2の変形例
5.まとめ
まず、本開示の一実施形態による情報処理装置の概要について、図1を参照して説明する。図1は、本実施形態による情報処理装置1の外観構成の一例を示す斜視図である。
続いて、本実施形態による情報処理装置1の内部構成について図2を参照して説明する。図2は、本実施形態による情報処理装置1の内部構成の一例を示すブロック図である。図2に示すように、情報処理装置1は、制御部10、通信部11、マイクロホン12、カメラ13、9軸センサ14、スピーカ15、位置測位部16、記憶部17、および生体センサ18を有する。
制御部10は、演算処理装置および制御装置として機能し、各種プログラムに従って情報処理装置1内の動作全般を制御する。制御部10は、例えばCPU(Central Processing Unit)、マイクロプロセッサ等の電子回路によって実現される。また、制御部10は、使用するプログラムや演算パラメータ等を記憶するROM(Read Only Memory)、及び適宜変化するパラメータ等を一時記憶するRAM(Random Access Memory)を含んでいてもよい。
調整部10eは、読み上げる情報(ニュース記事やメール等、「アイテム」と称す)1件毎の読み上げにかかる時間を予め算出し、読み上げ可能時間に何件読み上げられるかを算出し、読み上げ可能時間に応じて読み上げるアイテム数を調整する。読み上げにかかる時間は、過去にかかった時間の平均から求めてもよいし、読み上げるテキストの文字数から推定して求めてもよい。例えば調整部10eは、読み上げ可能時間が長い場合はニュースを10記事読み上げて、短い時は3記事だけ読み上げるよう調整することができる。
調整部10eは、タイトルのみ、最初の1文のみ、または全文といったように、情報の粒度毎の読み上げにかかる時間を予め算出し、読み上げ可能時間と読み上げなくてならないアイテム数に応じて、適切な粒度に調整する。例えば調整部10eは、読み上げ可能時間が短い場合はニュースのタイトルだけを読み上げて、少し長い場合は最初の1文まで読み上げて、更に長い場合は要約文まで読み上げて、充分に時間がある場合は全文を読み上げるよう調整することができる。
調整部10eは、読み上げる情報量から通常スピード時の読み上げ時間を算出し、読み上げ可能時間に対して少し足りない場合、時間内に読み終わるよう速度を早めるよう調整する。例えば調整部10eは、読み上げ可能時間が少し短い場合は通常より読み上げる速度を上げるよう調整することができる。
通信部11は、有線/無線により他の装置との間でデータの送受信を行うための通信モジュールである。通信部11は、例えば有線LAN(Local Area Network)、無線LAN、Wi-Fi(Wireless Fidelity、登録商標)、赤外線通信、Bluetooth(登録商標)、近距離/非接触通信等の方式で、外部機器と直接、またはネットワークアクセスポイントを介して無線通信する。
マイクロホン12は、ユーザの音声や周囲の環境を収音し、音声データとして制御部10に出力する。
カメラ13は、撮像レンズ、絞り、ズームレンズ、及びフォーカスレンズ等により構成されるレンズ系、レンズ系に対してフォーカス動作やズーム動作を行わせる駆動系、レンズ系で得られる撮像光を光電変換して撮像信号を生成する固体撮像素子アレイ等を有する。固体撮像素子アレイは、例えばCCD(Charge Coupled Device)センサアレイや、CMOS(Complementary Metal Oxide Semiconductor)センサアレイにより実現されてもよい。例えば、カメラ13は、情報処理装置1(装着ユニット)がユーザに装着された状態で、ユーザの前方を撮像可能に設けられる。この場合、カメラ13は、ユーザの周囲の景色や、ユーザが見ている方向の景色を撮像することが可能となる。また、カメラ13は、情報処理装置1がユーザに装着された状態で、ユーザの顔を撮像可能に設けられてもよい。この場合、情報処理装置1は、撮像画像からユーザの視線方向や表情を特定することが可能となる。また、カメラ13は、デジタル信号とされた撮像画像のデータを制御部10へ出力する。
9軸センサ14は、3軸ジャイロセンサ(角速度(回転速度)の検出)、3軸加速度センサ(Gセンサとも称す。移動時の加速度の検出)、および3軸地磁気センサ(コンパス、絶対方向(方位)の検出)を含む。9軸センサ14は、情報処理装置1を装着したユーザの状態または周囲の状態をセンシングする機能を有する。なお9軸センサ14は、センサ部の一例であって、本実施形態はこれに限定されず、例えば速度センサまたは振動センサ等をさらに用いてもよいし、加速度センサ、ジャイロセンサ、および地磁気センサのうち少なくともいずれかを用いてもよい。また、センサ部は、情報処理装置1(装着ユニット)とは別の装置に設けられていてもよいし、複数の装置に分散して設けられていてもよい。例えば、加速度センサ、ジャイロセンサ、および地磁気センサが頭部に装着されたデバイス(例えばイヤホン)に設けられ、速度センサや振動センサがスマートフォンに設けられてもよい。9軸センサ14は、センシング結果を示す情報を制御部10へ出力する。
スピーカ15は、制御部10の制御に従って、音声合成部10gにより処理された音声信号を再生する。また、スピーカ15は、指向性を有していてもよい。
位置測位部16は、外部からの取得信号に基づいて情報処理装置1の現在位置を検知する機能を有する。具体的には、例えば位置測位部16は、GPS(Global Positioning System)測位部により実現され、GPS衛星からの電波を受信して、情報処理装置1が存在している位置を検知し、検知した位置情報を制御部10に出力する。また、情報処理装置1は、GPSの他、例えばWi-Fi(登録商標)、Bluetooth(登録商標)、携帯電話・PHS・スマートフォン等との送受信、または近距離通信等により位置を検知するものであってもよい。
記憶部17は、上述した制御部10が各機能を実行するためのプログラムやパラメータを格納する。また、本実施形態による記憶部17は、ユーザの行動履歴を蓄積し得る。
生体センサ18は、ユーザの各種生体情報を検知し、生体センサデータとして制御部10へ出力する。生体センサデータは、上述したように、例えば脈拍、心拍、発汗量、体温、脳波、視線等が想定される。なお、生体センサ18の少なくとも一部が、外部装置に設けられていてもよい。この場合、外部装置の生体センサにより検知された生体センサデータが無線通信を介して通信部11により受信され、制御部10に出力され得る。
続いて、本実施形態による情報処理装置1の動作処理について図6および図7を参照して説明する。図6は、本実施形態による読み上げ調整の動作処理を示すフローチャートである。
次に、現在、読み上げ可能タイミングであると判別された場合(ステップS106/Yes)、提示情報取得部10fは、読み上げ情報の取得を行う(ステップS109)。読み上げ情報は、例えばプッシュ型通知情報等、自動的に用意される情報であるため、提示情報取得部10fは、現時点でユーザへ提示すべき情報の探索を行う。
図7は、本実施形態による読み上げ可能時間推定の動作処理を示すフローチャートである。図7に示すように、まず、情報処理装置1の推定部10dは、現在位置における全てのユーザの過去履歴を取得する(ステップS130)。全てのユーザの過去履歴は、例えばサーバ上にあって、推定部10dは、位置測位部16により測位された現在位置情報と共に、当該現在位置による全ユーザの過去履歴をサーバに要求する。
<4-1.第1の変形例>
続いて、本実施形態による第1の変形例について図8~図9を参照して説明する。本変形例では、ユーザが情報を受けた後、次の情報を受けられるようになるまでの間隔(図3に示す「読み上げ間隔」)に応じて、次の情報の読み上げ方法を変更する。具体的には、読み上げ間隔に応じて、次の情報提示の際に前回の内容や前回の内容との関連性を示すことで、より心地よい情報提示を実現し得る。
図8は、本変形例による情報処理装置1-1の構成の一例を示すブロック図である。図8に示すように、情報処理装置1-1は、制御部10-1、通信部11、マイクロホン12、カメラ13、9軸センサ14、スピーカ15、位置測位部16、記憶部17、および生体センサ18を有する。
続いて、本変形例の動作処理について図9を参照して説明する。図9は、本変形例による読み上げ調整の動作処理を示すフローチャートである。
次に、現在、読み上げ可能タイミングであると判別された場合(ステップS206/Yes)、提示情報取得部10fは、読み上げ情報の取得を行い(ステップS209)、読み上げ情報が存在するか否かを判断する(ステップS212)。これらステップS203~S212に示す処理は、図6を参照して説明したステップS103~S112に示す処理と同様である。
次に、本実施形態による第2の変形例について図10~図11を参照して説明する。図10は、本変形例によるシステム構成の一例を示す図である。
上述したように、本開示の実施形態による情報処理装置1では、情報提示を受けられる時間(すなわち、読み上げ可能時間)を推定し、時間内に聞き終わるよう音声情報の情報量を制御することで、音声情報提示の利便性を向上させることを可能とする。
(1)
ユーザが音声による情報提示を受けられる状態であると判別された際に、当該情報提示を受けられる状態の継続時間を推定する推定部と、
前記推定された継続時間に応じて、前記ユーザに提示する情報量を調整する調整部と、
を備える、情報処理装置。
(2)
前記情報提示を受けられる状態であるか否かは、前記ユーザの状況または周囲の状況の少なくともいずれかに基づいて判別される、前記(1)に記載の情報処理装置。
(3)
前記ユーザの状況は、前記ユーザの行動を含み、
前記ユーザの行動認識結果に応じて、前記ユーザが情報提示を受けられる状態であるか否かが判別される、前記(2)に記載の情報処理装置。
(4)
前記ユーザの状況は、前記ユーザの集中度を含み、
前記集中度の算出結果に応じて、前記ユーザが情報提示を受けられる状態であるか否かが判別される、前記(2)または(3)に記載の情報処理装置。
(5)
前記ユーザの状況は、前記ユーザの周辺の危険度を含み、
前記危険度の算出結果に応じて、前記ユーザが情報提示を受けられる状態であるか否かが判別される、前記(2)~(4)のいずれか1項に記載の情報処理装置。
(6)
前記調整部は、前記ユーザに提示する情報を、前記継続時間内に音声出力が終了する情報量に調整する、前記(2)~(5)のいずれか1項に記載の情報処理装置。
(7)
前記調整部は、前記ユーザに提示する情報の数を増減することで調整する、前記(6)に記載の情報処理装置。
(8)
前記調整部は、前記ユーザに提示する情報の粒度を変更することで調整する、前記(6)または(7)に記載の情報処理装置。
(9)
前記調整部は、前記ユーザに提示する情報の読み上げ速度を変更することで調整する、前記(6)~(8)のいずれか1項に記載の情報処理装置。
(10)
前記推定部は、前記ユーザの過去の行動履歴に基づいて、前記情報提示を受けられる状態の継続時間を推定する、前記(1)~(9)のいずれか1項に記載の情報処理装置。
(11)
前記推定部は、全てのユーザの過去の行動履歴に基づいて、前記情報提示を受けられる状態の継続時間を推定する、前記(1)~(9)のいずれか1項に記載の情報処理装置。
(12)
前記推定部は、前記ユーザの現在位置に紐づく全てのユーザの過去の行動履歴が所定量ある場合は全てのユーザの行動履歴を用いて前記継続時間を推定し、所定量に満たない場合は前記ユーザの行動履歴を用いて前記継続時間を推定する、前記(1)~(9)のいずれか1項に記載の情報処理装置。
(13)
前記推定部は、全てのユーザの過去の行動履歴に基づいて、周辺の交通設備の規則性を抽出し、前記継続時間を推定する、前記(1)~(9)のいずれか1項に記載の情報処理装置。
(14)
前記推定部は、交通設備または自動車から取得した制御情報に基づいて前記継続時間を推定する、前記(1)~(13)のいずれか1項に記載の情報処理装置。
(15)
前記情報処理装置は、
前記ユーザの忘却度を算出する算出部と、
前記算出された忘却度に応じて、前記ユーザに提示する情報を変更する変更部と、
をさらに備える、前記(1)~(14)のいずれか1項に記載の情報処理装置。
(16)
前記変更部は、前回提示した情報に基づく導入メッセージを提示情報の読み上げ冒頭に付加する、前記(15)に記載の情報処理装置。
(17)
前記算出部は、前回提示した時刻からの経過時間およびその間のユーザ行動の少なくともいずれかに基づいて忘却度を算出する、前記(15)または(16)に記載の情報処理装置。
(18)
前記情報処理装置は、
前記ユーザの状況または前記ユーザの周囲の状況に関するリアルタイムのセンシングデータを取得する取得部と、
前記ユーザが情報提示を受けられる状態の継続時間内に読み上げが終了するよう調整された、提示情報の読み上げ音声を出力する出力部と、
をさらに備える、前記(1)~(17)のいずれか1項に記載の情報処理装置。
(19)
プロセッサが、
ユーザが音声による情報提示を受けられる状態であると判別された際に、当該情報提示を受けられる状態の継続時間を推定することと、
前記推定された継続時間に応じて、前記ユーザに提示する情報量を調整することと、
を含む、情報処理方法。
(20)
コンピュータを、
ユーザが音声による情報提示を受けられる状態であると判別された際に、当該情報提示を受けられる状態の継続時間を推定する推定部と、
前記推定された継続時間に応じて、前記ユーザに提示する情報量を調整する調整部と、
として機能させる、プログラム。
10、10-1 制御部
10a ユーザ状況認識部
10b 周辺状況認識部
10c 判別部
10d 推定部
10e 調整部
10f 提示情報取得部
10g 音声合成部
10h 関連度算出部
10i 忘却度算出部
10j 内容変更部
11 通信部
12 マイクロホン
13 カメラ
14 9軸センサ
15 スピーカ
16 位置測位部
17 記憶部
18 生体センサ
3 ネットワーク
4 サーバ
40 制御部
40a 推定部
40b 調整部
40c 提示情報取得部
41 通信部
42 全ユーザの行動履歴DB
5 イヤホン
Claims (20)
- ユーザが音声による情報提示を受けられる状態であると判別された際に、当該情報提示を受けられる状態の継続時間を推定する推定部と、
前記推定された継続時間に応じて、前記ユーザに提示する情報量を調整する調整部と、
を備える、情報処理装置。 - 前記情報提示を受けられる状態であるか否かは、前記ユーザの状況または周囲の状況の少なくともいずれかに基づいて判別される、請求項1に記載の情報処理装置。
- 前記ユーザの状況は、前記ユーザの行動を含み、
前記ユーザの行動認識結果に応じて、前記ユーザが情報提示を受けられる状態であるか否かが判別される、請求項2に記載の情報処理装置。 - 前記ユーザの状況は、前記ユーザの集中度を含み、
前記集中度の算出結果に応じて、前記ユーザが情報提示を受けられる状態であるか否かが判別される、請求項2に記載の情報処理装置。 - 前記ユーザの状況は、前記ユーザの周辺の危険度を含み、
前記危険度の算出結果に応じて、前記ユーザが情報提示を受けられる状態であるか否かが判別される、請求項2に記載の情報処理装置。 - 前記調整部は、前記ユーザに提示する情報を、前記継続時間内に音声出力が終了する情報量に調整する、請求項2に記載の情報処理装置。
- 前記調整部は、前記ユーザに提示する情報の数を増減することで調整する、請求項6に記載の情報処理装置。
- 前記調整部は、前記ユーザに提示する情報の粒度を変更することで調整する、請求項6に記載の情報処理装置。
- 前記調整部は、前記ユーザに提示する情報の読み上げ速度を変更することで調整する、請求項6に記載の情報処理装置。
- 前記推定部は、前記ユーザの過去の行動履歴に基づいて、前記情報提示を受けられる状態の継続時間を推定する、請求項1に記載の情報処理装置。
- 前記推定部は、全てのユーザの過去の行動履歴に基づいて、前記情報提示を受けられる状態の継続時間を推定する、請求項1に記載の情報処理装置。
- 前記推定部は、前記ユーザの現在位置に紐づく全てのユーザの過去の行動履歴が所定量ある場合は全てのユーザの行動履歴を用いて前記継続時間を推定し、所定量に満たない場合は前記ユーザの行動履歴を用いて前記継続時間を推定する、請求項1に記載の情報処理装置。
- 前記推定部は、全てのユーザの過去の行動履歴に基づいて、周辺の交通設備の規則性を抽出し、前記継続時間を推定する、請求項1に記載の情報処理装置。
- 前記推定部は、交通設備または自動車から取得した制御情報に基づいて前記継続時間を推定する、請求項1に記載の情報処理装置。
- 前記情報処理装置は、
前記ユーザの忘却度を算出する算出部と、
前記算出された忘却度に応じて、前記ユーザに提示する情報を変更する変更部と、
をさらに備える、請求項1に記載の情報処理装置。 - 前記変更部は、前回提示した情報に基づく導入メッセージを提示情報の読み上げ冒頭に付加する、請求項15に記載の情報処理装置。
- 前記算出部は、前回提示した時刻からの経過時間およびその間のユーザ行動の少なくともいずれかに基づいて忘却度を算出する、請求項15に記載の情報処理装置。
- 前記情報処理装置は、
前記ユーザの状況または前記ユーザの周囲の状況に関するリアルタイムのセンシングデータを取得する取得部と、
前記ユーザが情報提示を受けられる状態の継続時間内に読み上げが終了するよう調整された、提示情報の読み上げ音声を出力する出力部と、
をさらに備える、請求項1に記載の情報処理装置。 - プロセッサが、
ユーザが音声による情報提示を受けられる状態であると判別された際に、当該情報提示を受けられる状態の継続時間を推定することと、
前記推定された継続時間に応じて、前記ユーザに提示する情報量を調整することと、
を含む、情報処理方法。 - コンピュータを、
ユーザが音声による情報提示を受けられる状態であると判別された際に、当該情報提示を受けられる状態の継続時間を推定する推定部と、
前記推定された継続時間に応じて、前記ユーザに提示する情報量を調整する調整部と、
として機能させる、プログラム。
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018510230A JPWO2017175432A1 (ja) | 2016-04-05 | 2016-12-28 | 情報処理装置、情報処理方法、およびプログラム |
CN201680084237.XA CN109074237B9 (zh) | 2016-04-05 | 2016-12-28 | 信息处理装置、信息处理方法和计算机可读存储介质 |
US16/089,031 US10671340B2 (en) | 2016-04-05 | 2016-12-28 | Information processing apparatus and information processing method |
EP16897984.7A EP3441873A4 (en) | 2016-04-05 | 2016-12-28 | INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING PROCESS AND PROGRAM |
US16/866,043 US11016726B2 (en) | 2016-04-05 | 2020-05-04 | Information processing apparatus and information processing method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2016-076027 | 2016-04-05 | ||
JP2016076027 | 2016-04-05 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/089,031 A-371-Of-International US10671340B2 (en) | 2016-04-05 | 2016-12-28 | Information processing apparatus and information processing method |
US16/866,043 Continuation US11016726B2 (en) | 2016-04-05 | 2020-05-04 | Information processing apparatus and information processing method |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017175432A1 true WO2017175432A1 (ja) | 2017-10-12 |
Family
ID=60000998
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2016/089186 WO2017175432A1 (ja) | 2016-04-05 | 2016-12-28 | 情報処理装置、情報処理方法、およびプログラム |
Country Status (5)
Country | Link |
---|---|
US (2) | US10671340B2 (ja) |
EP (1) | EP3441873A4 (ja) |
JP (1) | JPWO2017175432A1 (ja) |
CN (1) | CN109074237B9 (ja) |
WO (1) | WO2017175432A1 (ja) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2019185077A (ja) * | 2018-03-31 | 2019-10-24 | Nl技研株式会社 | 認知支援システム、認知支援装置、および認知支援サーバ |
JP2019185470A (ja) * | 2018-04-12 | 2019-10-24 | 株式会社Nttドコモ | 情報処理装置 |
JP2020154356A (ja) * | 2019-03-18 | 2020-09-24 | コニカミノルタ株式会社 | 音声情報処理装置及びプログラム |
WO2021095832A1 (ja) * | 2019-11-15 | 2021-05-20 | Fairy Devices株式会社 | 首掛け型装置 |
JP7453193B2 (ja) | 2021-09-27 | 2024-03-19 | Kddi株式会社 | ユーザの周辺状況に連動して音声合成に基づく音声を制御する携帯装置、プログラム及び方法 |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11363953B2 (en) * | 2018-09-13 | 2022-06-21 | International Business Machines Corporation | Methods and systems for managing medical anomalies |
CN111724774B (zh) * | 2019-03-22 | 2024-05-17 | 斑马智行网络(香港)有限公司 | 语音交互及车载语音交互方法、装置、设备及存储介质 |
CN110085066B (zh) * | 2019-04-17 | 2021-12-21 | 北京小米移动软件有限公司 | 展示阅读信息的方法、装置及电子设备 |
US10904622B2 (en) * | 2019-05-29 | 2021-01-26 | Rovi Guides, Inc. | Learning activity duration for providing content during activity |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH05232982A (ja) * | 1992-02-24 | 1993-09-10 | Nippon Telegr & Teleph Corp <Ntt> | 時間長指定型記事読み上げ方法 |
JP2003083752A (ja) * | 2001-09-10 | 2003-03-19 | Nissan Motor Co Ltd | 車両用情報提供システム |
WO2005006199A1 (ja) * | 2003-07-14 | 2005-01-20 | Matsushita Electric Industrial Co., Ltd. | コンテンツ配信装置及びコンテンツ再生装置 |
JP2009168773A (ja) * | 2008-01-21 | 2009-07-30 | Nissan Motor Co Ltd | ナビゲーション装置および情報提供方法 |
JP2011221766A (ja) * | 2010-04-08 | 2011-11-04 | Toyota Motor Corp | 車両用危険度情報提供装置 |
JP2013538403A (ja) * | 2010-09-13 | 2013-10-10 | トムトム インターナショナル ベスローテン フエンノートシャップ | ポータブル処理装置の改良又はそれに関する改良 |
WO2016038798A1 (ja) * | 2014-09-10 | 2016-03-17 | 株式会社デンソー | 車両用制御装置 |
Family Cites Families (37)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3810463B2 (ja) * | 1995-07-31 | 2006-08-16 | 株式会社ニューズウオッチ | 情報フィルタリング装置 |
JPH11101652A (ja) * | 1997-09-26 | 1999-04-13 | Toyota Motor Corp | 電子メールデータ受信装置、電子メールホスト装置、これらのためのプログラムを記録した媒体、及び電子メールシステム |
JP3531445B2 (ja) * | 1997-11-19 | 2004-05-31 | 日産自動車株式会社 | 車載情報装置 |
JP3712325B2 (ja) * | 1998-09-10 | 2005-11-02 | 株式会社リコー | 文書読み上げ装置 |
JP2001014237A (ja) * | 1999-07-02 | 2001-01-19 | Nec Corp | 電子メール番組装置および電子メール番組用プログラムを記録した記録媒体 |
JP4421789B2 (ja) * | 2001-06-11 | 2010-02-24 | パイオニア株式会社 | 移動体用電子システムの制御装置及び制御方法、移動体用電子システム並びにコンピュータプログラム |
JP2003099080A (ja) * | 2001-09-25 | 2003-04-04 | Nissan Motor Co Ltd | 音声読み上げ装置、音声読み上げシステム、及び音声読み上げ方法 |
JP3705197B2 (ja) * | 2001-12-17 | 2005-10-12 | 日産自動車株式会社 | 車両情報提供装置 |
JP4073711B2 (ja) * | 2002-05-28 | 2008-04-09 | シャープ株式会社 | 操作補助方法、操作補助装置、プログラムおよびプログラムを記録した媒体 |
JP2005025619A (ja) * | 2003-07-04 | 2005-01-27 | Aisin Aw Co Ltd | 情報端末、情報配信装置及び情報配信システム |
JP4387148B2 (ja) * | 2003-09-04 | 2009-12-16 | 株式会社デンソーアイティーラボラトリ | コンテンツ配信システム及びコンテンツ受信再生装置 |
CN1893639A (zh) * | 2005-07-01 | 2007-01-10 | 英保达股份有限公司 | 回放广播节目的节目概要的系统及方法 |
JP4550688B2 (ja) * | 2005-08-12 | 2010-09-22 | シャープ株式会社 | 音声化装置、キャッシュレジスタ、音声化方法、音声化プログラム、および音声化プログラムを記録したコンピュータ読取り可能な記録媒体 |
US7717921B2 (en) | 2005-10-19 | 2010-05-18 | Warsaw Orthopedic, Inc. | Instruments and methods for delivering multiple implants in a surgical procedure |
JP2008046425A (ja) * | 2006-08-17 | 2008-02-28 | National Institute Of Information & Communication Technology | 印象表現出力装置及び方法 |
JP4871119B2 (ja) | 2006-12-27 | 2012-02-08 | 日本電信電話株式会社 | 音声合成方法、音声合成装置、プログラム、記録媒体 |
JP2008233345A (ja) * | 2007-03-19 | 2008-10-02 | Toshiba Corp | インタフェース装置及びインタフェース処理方法 |
WO2009072412A1 (ja) * | 2007-12-03 | 2009-06-11 | Nec Corporation | 読み上げシステム、読み上げ方法、読み上げプログラム、および記録媒体 |
JP5292941B2 (ja) * | 2008-06-24 | 2013-09-18 | 株式会社デンソー | ナビゲーション装置 |
US8990848B2 (en) * | 2008-07-22 | 2015-03-24 | At&T Intellectual Property I, L.P. | System and method for temporally adaptive media playback |
JP5255946B2 (ja) * | 2008-08-06 | 2013-08-07 | 株式会社日立製作所 | コンテンツスケジューリング装置 |
JP4864950B2 (ja) * | 2008-09-16 | 2012-02-01 | パイオニア株式会社 | 車載機器、情報通信システム、車載機器の制御方法およびプログラム |
US8379807B1 (en) * | 2009-06-02 | 2013-02-19 | Sprint Communications Company L.P. | Providing a customized voicemail-retrieval announcement |
US8035023B2 (en) * | 2009-08-25 | 2011-10-11 | Volkswagen Ag | Predictive environment music playlist selection |
US8769560B2 (en) * | 2009-10-13 | 2014-07-01 | At&T Intellectual Property I, L.P. | System and method to obtain content and generate modified content based on a time limited content consumption state |
JP5112479B2 (ja) * | 2010-07-23 | 2013-01-09 | 三菱電機インフォメーションシステムズ株式会社 | 文章作成システム及び文章作成プログラム |
JP5895258B2 (ja) * | 2011-12-22 | 2016-03-30 | 三洋テクノソリューションズ鳥取株式会社 | 移動体通信装置及び走行支援方法 |
JP2013186684A (ja) * | 2012-03-08 | 2013-09-19 | Hishiki Unso Kk | 信号機システムおよび信号情報受信端末 |
US9159313B2 (en) * | 2012-04-03 | 2015-10-13 | Sony Corporation | Playback control apparatus, playback control method, and medium for playing a program including segments generated using speech synthesis and segments not generated using speech synthesis |
JP2014174016A (ja) * | 2013-03-08 | 2014-09-22 | Panasonic Corp | 推定方法、表示方法、推定装置、表示装置 |
KR102064952B1 (ko) * | 2013-07-12 | 2020-01-10 | 삼성전자주식회사 | 수신 데이터를 이용하여 어플리케이션을 운영하는 전자 장치 |
KR101558656B1 (ko) * | 2013-07-30 | 2015-10-08 | 현대자동차주식회사 | 수신자 맞춤형 메시지 처리 장치 및 그 방법 |
JP6037026B2 (ja) * | 2013-09-11 | 2016-11-30 | 株式会社デンソー | 音声出力制御装置、プログラムおよび記録媒体 |
US10209853B2 (en) * | 2013-12-20 | 2019-02-19 | Robert Bosch Gmbh | System and method for dialog-enabled context-dependent and user-centric content presentation |
JP6481484B2 (ja) * | 2014-09-10 | 2019-03-13 | 株式会社デンソー | 車両用制御装置 |
JP2016062239A (ja) * | 2014-09-17 | 2016-04-25 | ソニー株式会社 | 情報処理装置、情報処理方法及びコンピュータプログラム |
JP6944360B2 (ja) * | 2017-12-11 | 2021-10-06 | 株式会社Nttドコモ | コンテンツの提示順位を制御する装置、方法、及び、プログラム |
-
2016
- 2016-12-28 CN CN201680084237.XA patent/CN109074237B9/zh not_active Expired - Fee Related
- 2016-12-28 JP JP2018510230A patent/JPWO2017175432A1/ja active Pending
- 2016-12-28 US US16/089,031 patent/US10671340B2/en not_active Expired - Fee Related
- 2016-12-28 EP EP16897984.7A patent/EP3441873A4/en not_active Withdrawn
- 2016-12-28 WO PCT/JP2016/089186 patent/WO2017175432A1/ja active Application Filing
-
2020
- 2020-05-04 US US16/866,043 patent/US11016726B2/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH05232982A (ja) * | 1992-02-24 | 1993-09-10 | Nippon Telegr & Teleph Corp <Ntt> | 時間長指定型記事読み上げ方法 |
JP2003083752A (ja) * | 2001-09-10 | 2003-03-19 | Nissan Motor Co Ltd | 車両用情報提供システム |
WO2005006199A1 (ja) * | 2003-07-14 | 2005-01-20 | Matsushita Electric Industrial Co., Ltd. | コンテンツ配信装置及びコンテンツ再生装置 |
JP2009168773A (ja) * | 2008-01-21 | 2009-07-30 | Nissan Motor Co Ltd | ナビゲーション装置および情報提供方法 |
JP2011221766A (ja) * | 2010-04-08 | 2011-11-04 | Toyota Motor Corp | 車両用危険度情報提供装置 |
JP2013538403A (ja) * | 2010-09-13 | 2013-10-10 | トムトム インターナショナル ベスローテン フエンノートシャップ | ポータブル処理装置の改良又はそれに関する改良 |
WO2016038798A1 (ja) * | 2014-09-10 | 2016-03-17 | 株式会社デンソー | 車両用制御装置 |
Non-Patent Citations (2)
Title |
---|
SAWHNEY , NITIN ET AL.: "Nomadic Radio: Speech and Audio Interaction for Contextual Messaging in Nomadic Environments", ACM TRANSCTION ON COMPUTER-HUMAN INTERACTION, vol. 7, no. 3, September 2000 (2000-09-01), pages 353 - 383, XP058105903 * |
See also references of EP3441873A4 * |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2019185077A (ja) * | 2018-03-31 | 2019-10-24 | Nl技研株式会社 | 認知支援システム、認知支援装置、および認知支援サーバ |
JP2019185470A (ja) * | 2018-04-12 | 2019-10-24 | 株式会社Nttドコモ | 情報処理装置 |
JP7098390B2 (ja) | 2018-04-12 | 2022-07-11 | 株式会社Nttドコモ | 情報処理装置 |
JP2020154356A (ja) * | 2019-03-18 | 2020-09-24 | コニカミノルタ株式会社 | 音声情報処理装置及びプログラム |
JP7318241B2 (ja) | 2019-03-18 | 2023-08-01 | コニカミノルタ株式会社 | 音声情報処理装置及びプログラム |
WO2021095832A1 (ja) * | 2019-11-15 | 2021-05-20 | Fairy Devices株式会社 | 首掛け型装置 |
JP2021082904A (ja) * | 2019-11-15 | 2021-05-27 | Fairy Devices株式会社 | 首掛け型装置 |
JP7453193B2 (ja) | 2021-09-27 | 2024-03-19 | Kddi株式会社 | ユーザの周辺状況に連動して音声合成に基づく音声を制御する携帯装置、プログラム及び方法 |
Also Published As
Publication number | Publication date |
---|---|
US20190107993A1 (en) | 2019-04-11 |
US20200264837A1 (en) | 2020-08-20 |
US10671340B2 (en) | 2020-06-02 |
JPWO2017175432A1 (ja) | 2019-03-22 |
US11016726B2 (en) | 2021-05-25 |
EP3441873A1 (en) | 2019-02-13 |
CN109074237A (zh) | 2018-12-21 |
CN109074237B9 (zh) | 2021-12-17 |
CN109074237B (zh) | 2021-10-22 |
EP3441873A4 (en) | 2019-03-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2017175432A1 (ja) | 情報処理装置、情報処理方法、およびプログラム | |
JP7167910B2 (ja) | 情報処理装置、情報処理方法、およびプログラム | |
US11626127B2 (en) | Systems and methods for processing audio based on changes in active speaker | |
JP6481210B2 (ja) | 情報処理装置、制御方法、およびプログラム | |
US20220312128A1 (en) | Hearing aid system with differential gain | |
US20220232321A1 (en) | Systems and methods for retroactive processing and transmission of words | |
JP6079566B2 (ja) | 情報処理装置、情報処理方法、及びプログラム | |
US11526590B2 (en) | Automatic low radiation mode for a wearable device | |
US20210350823A1 (en) | Systems and methods for processing audio and video using a voice print | |
WO2015083411A1 (ja) | 情報処理装置、情報処理方法、およびプログラム | |
US11929087B2 (en) | Systems and methods for selectively attenuating a voice | |
US20230005471A1 (en) | Responding to a user query based on captured images and audio | |
US20150124101A1 (en) | Information processing apparatus, information processing method, and program | |
JP6891879B2 (ja) | 情報処理装置、情報処理方法、およびプログラム | |
WO2019054086A1 (ja) | 情報処理装置、情報処理方法、およびプログラム | |
US11875791B2 (en) | Systems and methods for emphasizing a user's name | |
JP6256634B2 (ja) | ウェアラブルデバイス、ウェアラブルデバイスの制御方法、及びプログラム | |
US20220417677A1 (en) | Audio feedback for correcting sound degradation | |
US20230062598A1 (en) | Adjusting an audio transmission when a user is being spoken to by another person | |
JP6414313B2 (ja) | 携帯装置、携帯装置の制御方法、及びプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 2018510230 Country of ref document: JP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2016897984 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2016897984 Country of ref document: EP Effective date: 20181105 |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16897984 Country of ref document: EP Kind code of ref document: A1 |