CN109804358A - Reproducing terminal and reproducting method - Google Patents

Reproducing terminal and reproducting method Download PDF

Info

Publication number
CN109804358A
CN109804358A CN201780062302.3A CN201780062302A CN109804358A CN 109804358 A CN109804358 A CN 109804358A CN 201780062302 A CN201780062302 A CN 201780062302A CN 109804358 A CN109804358 A CN 109804358A
Authority
CN
China
Prior art keywords
information
reproducing terminal
distributor
user
distribution
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201780062302.3A
Other languages
Chinese (zh)
Other versions
CN109804358B (en
Inventor
江里口真朗
轟兼郎
山野郁男
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Sony Mobile Communications Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp, Sony Mobile Communications Inc filed Critical Sony Corp
Publication of CN109804358A publication Critical patent/CN109804358A/en
Application granted granted Critical
Publication of CN109804358B publication Critical patent/CN109804358B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/68Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6802Sensor mounted on worn items
    • A61B5/681Wristwatch-type devices
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/68Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6813Specially adapted to be attached to a specific body part
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024Detecting, measuring or recording pulse rate or heart rate
    • A61B5/02416Detecting, measuring or recording pulse rate or heart rate using photoplethysmograph signals, e.g. generated by infrared radiation
    • A61B5/02427Details of sensor
    • A61B5/02433Details of sensor for infrared radiation
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/48Other medical applications
    • A61B5/486Bio-feedback
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/163Wearable computers, e.g. on a belt
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/14Handling requests for interconnection or transfer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/29Arrangements for monitoring broadcast services or broadcast-related services
    • H04H60/33Arrangements for monitoring the users' behaviour or opinions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command

Abstract

It, can be by shirtsleeve operation to delivering message addition response using it in order to provide a kind of reproduction equipment and reproducting method.[solution] provides a kind of reproducing terminal, comprising: reproduction unit, for reproducing the delivery information of delivering;Sensor unit, for detecting the body kinematics of user;And control unit, for being handled based on the body kinematics detected by sensor unit about the operation to delivery information addition response.

Description

Reproducing terminal and reproducting method
Technical field
This disclosure relates to reproducing terminal and reproducting method.
Background technique
In recent years, network via such as internet and mobile communications network etc is provided extensively to many and not specified Target distribution information service.In addition, the reaction etc. to distribution information can be returned from target in this service.
For example, following patent document 1 discloses a kind of reaction investigation method, wherein commercial message is distributed to from wide The viewer at station is broadcast, and collects the reaction interval to the commercial message of distribution from viewer via the content etc. for data broadcasting Degree.
Reference listing
Patent document
Patent document 1:JP 2001-357191A
Summary of the invention
Technical problem
However, using method disclosed in above-mentioned patent document 1, the information of distribution be such as compiled image information it The commercial message of class, and do not stimulate sensitivity or the image of viewer consumingly.Therefore, in order to effectively utilize internet Amphicheirality and instantaneity etc., it is expected that efficiently obtaining the response to distribution information.
The present disclosure proposes a kind of reproducing terminal and reproducting methods, allow for easier operation and come to distribution Information provides response.
Solution to the problem
According to the disclosure, a kind of reproducing terminal is provided, comprising: reproduction unit is configured as reproducing distribution information;Sensing Device unit is configured as the body action of detection user;And control unit, it is configured as based on the detection at sensor unit To body action come handle about to distribution information provide response operation.
In addition, providing a kind of reproducting method according to the disclosure, comprising: reproduce distribution information;The body for detecting user is dynamic Make;And by arithmetic processing unit based on the body action detected, handles and provide the operation of response about to distribution information.
According to the disclosure, user, which can execute, provides the operation of response to distribution information by body action.
Advantageous effect of the invention
According to the present disclosure as described above, user, which can be easily performed, provides the operation of response to distribution information.
It should be noted that said effect be not necessarily it is restrictive.Using or instead of said effect, this explanation may be implemented Any one effect described in book or the other effects that can be grasped from this specification.
Detailed description of the invention
Fig. 1 is the explanation figure for explaining the summary of the information processing system according to first embodiment of the present disclosure.
Fig. 2A is netscape messaging server Netscape, the information processing unit explained in information processing system according to first embodiment With the block diagram of the concrete configuration of distribution terminal.
Fig. 2 B is netscape messaging server Netscape, the information processing unit explained in information processing system according to first embodiment With the block diagram of the concrete configuration of reproducing terminal.
Fig. 3 is the flow chart for explaining the operation of reproducing terminal side of information processing system according to first embodiment.
Fig. 4 is the flow chart for the concrete operations for " providing the processing of evaluation " in explanation figure 3.
Fig. 5 is the flow chart for the concrete operations for " providing the processing of comment " in explanation figure 3.
Fig. 6 is to illustrate the extraction group for wherein executing erroneous words processing to comment from the user in netscape messaging server Netscape The block diagram of part.
Fig. 7 be explain listen to again listened to primary distribution in the case where reproducing terminal side operation process Figure.
Fig. 8 is the explanation figure for the display example that diagram encourages user's wearing reproducing terminal.
Fig. 9 is the explanation figure for illustrating the display example for the list for having listened to primary distribution information.
Figure 10 is the flow chart for explaining the operation of distribution terminal side of information processing system according to first embodiment.
Figure 11 is the operation explained in the case where confirmation is from comment of the user to distribution information in distribution terminal side Flow chart.
Figure 12 is the explanation figure for illustrating wherein distribution information display example associated with to the comment of information is distributed.
Figure 13 is to illustrate the response wherein such as commented on and evaluated etc associated with the location information of user to show The explanation figure of example.
Figure 14 is the explanation figure for explaining the summary of the information processing system according to second embodiment of the present disclosure.
Figure 15 A is the schematic diagram of the specific example of the configuration of diagram distribution terminal according to the second embodiment.
Figure 15 B is the schematic diagram for illustrating the specific example of configuration of reproducing terminal according to the second embodiment.
Figure 16 is the block diagram for explaining the concrete configuration of information processing system according to the second embodiment.
Figure 17 is the curve graph for being schematically illustrated heartbeat waveform.
Figure 18 is the curve graph for the relationship being schematically illustrated between Δ t and a and heart rate shown in Figure 17.
Figure 19 is the flow chart for explaining the judgement in the case where the vibration for the heart rate to be reproduced is changed.
Figure 20 is the curve graph of the frequency band for being schematically illustrated voice and the frequency band of vibration.
Figure 21 is the exemplary schematic diagram for illustrating the specific gesture motion of user.
Figure 22 is the sequence chart for illustrating the first operation example of information processing system according to the second embodiment.
Figure 23 is the sequence chart for illustrating the second operation example of information processing system according to the second embodiment.
Figure 24 is the exemplary frame for illustrating the hardware configuration of netscape messaging server Netscape of each embodiment according to the disclosure Figure.
Specific embodiment
Hereinafter, (one or more) preferred embodiment of the invention will be described in detail with reference to the attached drawings.It should be noted that In the present description and drawings, the structural detail with essentially identical function and structure is presented with like reference characters, and And omission is to the repetition of explanation of these structural details.
It should be noted that description will be provided in the following order.
1. first embodiment
1.1. the summary of information processing system
1.2. the configuration of information processing system
1.3. the operation of information processing system
1.4. modified example
2. second embodiment
2.1. the summary of information processing system
2.2. the configuration of information processing system
2.3. the operation of information processing system
2.4. modified example
3. the hardware configuration of netscape messaging server Netscape
4. conclusion
<1. first embodiment>
[summary of 1.1. information processing system]
Firstly, by reference Fig. 1 description according to the summary of the information processing system of first embodiment of the present disclosure.Fig. 1 is solution Release the explanation figure of the summary of the information processing system according to first embodiment of the present disclosure.
Information processing system according to the present embodiment is to receive distribution information from distributor and distribution information is sent to use The information distribution system at family.In addition, in the information processing system according to the present embodiment, can also will such as from user to point The response of comment and the evaluation etc of photos and sending messages feeds back to distributor.It should be noted that distributor is such as idol, famous person, meaning See leader etc., and user is such as the bean vermicelli of distributor, follower.
In the present embodiment, distribution information can be the physical distribution information for example depending on distributor, Huo Zheke To be the voice messaging issued by distributor.Because voice messaging have depend on issue voice messaging distributor vocal cords and Different frequency spectrum, so voice messaging is the characteristic as distributor and has relatively strong concrete information.Therefore, in basis In the information processing system of the present embodiment, it is distributed, can be made to it as distribution information by the voice issued by distributor The user for having distributed information has stronger impression.
As shown in fig. 1, according to the information processing system of the present embodiment include the distribution terminal 30A that is possessed by distributor and Information processing unit 20A, the reproducing terminal 30B and information processing unit 20B, Yi Jijing possessed by the user for receiving distribution information The netscape messaging server Netscape 10 of information processing unit 20A and 20B are connected to by network 40.
Distributing terminal 30A and reproducing terminal 30B is for example worn in any part of the body of distributor or user Information processing unit.Distribution terminal 30A at least has the function of sound collecting, and reproducing terminal 30B at least has voice reproduction Function.
Specifically, distribution terminal 30A obtains the voice issued by distributor using sound collecting function.Sound collecting function It can use the sound collection device (such as microphone) and signal processing circuit (such as digital signal for for example collecting ambient sound Processor (DSP) Lai Shixian.In addition, it includes the voice in distribution information that reproducing terminal 30B is reproduced using voice reproduction function Information.Voice reproduction function (can such as be amplified with voice-output device (such as loudspeaker and earphone) and signal processing circuit Device) Lai Shixian.
In the information processing system according to the present embodiment, the voice issued by distributor is received in distribution terminal 30A Collection distributes information and is distributed to reproducing terminal 30B via network 40 as distribution information.In this way, Yong Huke To reproduce distribution information at reproducing terminal 30B, and the voice of distributor's sending can be listened to.
Distribution terminal 30A and reproducing terminal 30B can have any form, and can be the face for being for example worn on user On glasses type terminal, be worn on user wrist etc. on Wristwatch-type terminal, be worn on user's head earpiece type terminal, insert Ear inserting type terminal of access customer ear etc..But because the distribution information distributed in the present embodiment is voice messaging, point Hair terminal 30A and reproducing terminal 30B can be ear inserting type terminal as shown in Figure 1.
It should be noted that distribution terminal 30A and reproducing terminal 30B is via information processing unit 20A and 20B to/from information Information is distributed in 10 transmissions of processing server/reception.But distribution terminal 30A and reproducing terminal 30B can be directly to/from information Information is distributed in 10 transmissions of processing server/reception, and does not intervene information processing unit 20A and 20B.
Information processing unit 20A and information processing unit 20B is the communication device that distributor or user possess, and is had Function for executing and distributing the function of the communication of terminal 30A or reproducing terminal 30B and for being connected to network 40.At information Reason device 20A and information processing unit 20B may, for example, be smart phone, mobile phone, tablet terminal, personal digital assistant (PDA) etc..
Distributing specifically, information processing unit 20A is used for executing the function of communicating reception with distribution terminal 30A The voice messaging (that is, distribution information) collected at terminal 30A, and use and send out voice messaging for being connected to the function of network 40 It is sent to netscape messaging server Netscape 10.Meanwhile information processing unit 20B uses the function for being connected to network 40 from information processing Server 10 receives voice messaging (that is, distribution information), and using for executing the function of communicating for voice with reproducing terminal 30B Information is sent to reproducing terminal 30B.
For information processing unit 20A and information processing unit 20B and distribution terminal 30A and reproducing terminal 30B it Between execute the function of communication and can be realized with such as antenna and telecommunication circuit, the antenna and telecommunication circuit arrive about 100 at several meters Wirelessly transmit information in the distance of rice, and specifically, can with the antenna for supporting Bluetooth (registered trademark) etc. and Telecommunication circuit is realized.In addition, the function for link information processing unit 20A and information processing unit 20B and network 40 can With the antenna and telecommunication circuit being connect with support with Wireless LAN, Public Switched Telephone Network, mobile communications network or internet To realize.
Network 40 is in the communication network wherein sent and received information.Network 40 can be such as local area network (LAN), wide Domain net (WAN), internet, satellite communication network, telephone network, mobile communications network (such as, such as 3G or 4G network) or mutual Special fidonetFido-Virtual Private Network (IP-VPN) etc..
Netscape messaging server Netscape 10 receives distribution information from distribution terminal 30A, and whether dresses reproducing terminal based on user 30B distributes the transmission of information to reproducing terminal 30B to control.
Specifically, in the case where user wearing reproducing terminal 30B when receiving distribution information, information processing services Device 10 is sent to reproducing terminal 30B for information is distributed.Meanwhile reproducing terminal is not dressed when receiving distribution information in user In the case where 30B, netscape messaging server Netscape 10 does not send reproducing terminal 30B for distribution information, and dresses again in user later Reproducing terminal 30B is sent by distribution information in the case where existing terminal 30B.It should be noted that whether user dresses reproducing terminal 30B can be detected for example, by the various sensors provided at reproducing terminal 30B.Specifically, at reproducing terminal 30B The close proximity sensor of detection object is provided, the touch sensor of detection and the touch of object, detects reproducing terminal 30B's Posture and the acceleration transducer of direction etc., and reproducing terminal 30B can be judged again based on the information from these sensors Whether existing terminal 30B is worn on user.
Distribution information is the characteristic as distributor and has the strong concrete physical letter depending on distributor Breath.Therefore, netscape messaging server Netscape 10 is attempted in the state that user dresses reproducing terminal 30B through the hair of control distribution information Sending makes user directly listen to distribution information, to reproduce distribution information.In this way, netscape messaging server Netscape 10 can make User has stronger impression.
In addition, netscape messaging server Netscape 10 can will such as from user to distribution information comment and evaluation etc sound It should be stored in association with distribution information.In addition, netscape messaging server Netscape 10 can by from user to distribution information these Response is communicated to the distributor of distribution information.Accordingly, because netscape messaging server Netscape 10 can cause via distribution information Two-way communication between distributor and user, it is possible to activate the interaction between distributor and user.Particularly, according to this In the information processing system of embodiment, because distribution information is the physical information depending on distributor, it is possible to it is expected that More positive interaction may occur.
Therefore, according to the information processing system according to the present embodiment, the physics of distributor will can more effectively be depended on The distribution information (such as voice messaging) of property is distributed to user.
Although it should be noted that it includes distribution terminal 30A, information processing that information processing system has been described in Fig. 1 The example of device 20A, netscape messaging server Netscape 10, information processing unit 20B and reproducing terminal 30B, but according to the disclosure Technology is not limited to such example.For example, distribution terminal 30A and information processing unit 20A can be at an integrated information Device is managed, and reproducing terminal 30B and information processing unit 20B can be an integrated information processing unit.In addition, information Some or all of processing server 10 function can be at one in information processing unit 20A and information processing unit 20B It executes.In addition, for example, being stored in the portion in the distribution information memory cell 130 of the netscape messaging server Netscape of description 10 later Divide or all information can store at least one of information processing unit 20A or information processing unit 20B.
[configuration of 1.2. information processing system]
Next with reference to Fig. 2A and Fig. 2 B description according to the configuration of the information processing system of the present embodiment.Fig. 2A is to explain According to netscape messaging server Netscape 10, information processing unit 20A and the distribution terminal 30A in the information processing system of the present embodiment The block diagram of concrete configuration, Fig. 2 B are netscape messaging server Netscape 10 in the information processing system explained according to the present embodiment, information The block diagram of the concrete configuration of processing unit 20B and distribution terminal 30B.
As in figs. 2 a and 2b, distribution terminal 30A includes microphone unit 315, voice reproduction unit 313, control Unit 312 and communication unit 311, and information processing unit 20A includes input unit 212, communication unit 211, control unit 213, generation unit 214, display unit 215 and network connection unit 216 are shown.
In addition, netscape messaging server Netscape 10 includes network connection unit 110, distribution information receiving unit 120, distribution information Storage unit 130, distribution control unit 140, distribution information transmitting unit 150, response provide unit 160 and response transmission unit 170。
In addition, reproducing terminal 30B includes sensor unit 325, control unit 322, communication unit 321, leading question sound control Unit 324 and voice reproduction unit 323 processed, and information processing unit 20B includes input unit 222, communication unit 221, control Unit 223, display generation unit 224, display unit 225 and network connection unit 226 processed.
(distribution terminal 30A)
Microphone unit 315 includes such as sound collection device (such as microphone) and signal processing circuit (such as DSP), And collect the sound around distribution terminal 30A.Specifically, microphone unit 315, which can be collected, distributes terminal 30A by wearing Distributor issue voice, and can be generated will be used as distribution information voice messaging.
Voice reproduction unit 313 includes such as voice-output device (such as loudspeaker and earphone) and signal processing electricity Road (such as amplifier), and voice messaging is reproduced as voice.Specifically, voice reproduction unit 313 can be reproduced by wheat The voice messaging that gram wind unit 315 is collected so that distributor confirms the voice issued by distributor, or can reproduce and such as make The response of the comment that distribution information is provided by user for voice messaging etc.
Control unit 312 includes for example as the microprocessing unit of arithmetic processing unit (MPU), and storage control journey The memory of sequence, control parameter etc., and control each component of distribution terminal 30A.Specifically, control unit 312 controls Each component, so that the voice messaging collected by microphone unit 315 is sent to information processing unit as distribution information 20A.In addition, control unit 312 can control each component, to receive from information processing unit 20A such as from user couple Distribute the response of comment that information provides etc.
Communication unit 311 includes such as antenna and telecommunication circuit, and is believed to/from information processing unit 20A transmission/reception Breath.Specifically, communication unit 311 can distribute information to/from 211 transmissions of communication unit/reception of information processing unit 20A With about from user to distribution information response information etc..
It can by the communication that the communication plan that communication unit 311 executes can be for example with radius from several meters to about 100 meter The short distance communication scheme of energy range, and specifically, can be Wi-Fi (registered trademark), ZigBee (registered trademark), Bluetooth (registered trademark), Bluetooth Low Energy (registered trademark), ANT (registered trademark), ANT+ (registrar Mark) etc..But it is not limited to by the communication plan that communication unit 311 executes above-mentioned, and it can be such as such as 3G, 4G and length The mobile communication of phase evolution (LTE) etc.
(information processing unit 20A)
Communication unit 211 includes the antenna and telecommunication circuit of such as communication plan, the communication plan and above-mentioned distribution terminal The communication plan of the communication unit 311 of 30A is identical, and to/from distribution terminal 30A send/receive information.Specifically, logical Believe unit 211 can to/from distribution terminal 30A 311 transmissions of communication unit/reception distribution information and about from user to point The information etc. of the response of photos and sending messages.
The communication plan of communication unit 211 is identical as the communication plan of communication unit 311 of above-mentioned distribution terminal 30A, and And it can be such as Wi-Fi (registered trademark), ZigBee (registered trademark), Bluetooth (registered trademark), Bluetooth Low Energy (registered trademark), ANT (registered trademark), ANT+ (registered trademark) etc., and can be such as 3G, 4G and LTE Etc mobile communication.
Input unit 212 may include input equipment (such as touch panel, keyboard, button, the Mike that information is inputted to it Wind, switch and control-rod), and input based on user generates input signal and input signal is output to control unit 213 Input control circuit etc..
Control unit 213 includes the central processing unit (CPU) as arithmetic processing unit, the journey of storage control wherein The read-only memory (ROM) of sequence, control parameter etc., and used when being wherein temporarily stored in operation program, appropriate change Parameter etc. random access memory (RAM), and control each component of information processing unit 20A.
Display generation unit 214 generates the display that distributor is presented at display unit 215.For example, display generates Display can be generated in unit 214, which is the list in the distribution information of distribution terminal 30A place's generation and will be presented to point Originator.In addition, display generation unit 214, which can be generated for every distribution information to present associated with each other, distributes information and right Distribute the display of the response of information.
Display unit 215 is based on being presented image etc. from the display that display generation unit 214 generates to distributor.Display unit 215 may include the display dress of such as liquid crystal display (LCD) device, display of organic electroluminescence (OLED) device and lamp etc It sets.
Network connection unit 216 includes for example for being connected to the interface and telecommunication circuit of network 40, and via net Network 40 is to/from 10 transmissions of netscape messaging server Netscape/reception information.Specifically, network connection unit 216 will be in distribution terminal The voice messaging being collected at 30A is sent to netscape messaging server Netscape 10 as distribution information.In addition, network connection unit 216 The sound of comment and the evaluation etc of the distribution information such as from the user to transmission can be received from netscape messaging server Netscape 10 It answers.
Network connection unit 216 may include such as interface and telecommunication circuit, may be coupled to LAN, WAN, internet, Satellite communication network, telephone network, mobile communications network, IP-VPN etc., and may include may be coupled to such as 3G, 4G and The interface and telecommunication circuit of the mobile communications network of LTE etc.
(netscape messaging server Netscape 10)
Network connection unit 110 includes for example for being connected to the interface and telecommunication circuit of network 40, and via net Network 40 sends to/from information processing unit 20A and information processing unit 20B/receive information.For example, with network connection unit 216 Similar with 226, network connection unit 110 may include interface and telecommunication circuit, may be coupled to LAN, WAN, internet, defends Star communication network, telephone network, mobile communications network, IP-VPN etc..
Distribute information receiving unit 120 and receives the distribution letter generated at distribution terminal 30A via information processing unit 20A Breath.Distribution information is depending on the physical of distributor and as the microphone unit 315 etc. by using distribution terminal 30A The information of the voice messaging of generation.Netscape messaging server Netscape 10 can be distributed to use by the distribution information that will distribute from distributor The interaction between distributor and user is activated at family.
Distribution information memory cell 130 stores the distribution information distributed from distributor.Specifically, being received in distribution information In the case that user does not dress reproducing terminal 30B when unit 120 receives distribution information, distribution information memory cell 130 faces When storage be not yet distributed to the distribution information of reproducing terminal 30B.In addition, distribution information memory cell 130 can store and be sent to Every distribution information of reproducing terminal 30B.In this case, distribution information memory cell 130 can be deposited associated with each other Store up every distribution information and the response from user to distribution information.
Distribution control unit 140 controls distribution information to reproducing terminal 30B based on whether user dresses reproducing terminal 30B Transmission.Specifically, the distribution control of control unit 140 is for sending distribution in the case where user dresses reproducing terminal 30B The timing of information, so that reproducing distribution information at reproducing terminal 30B.Therefore, the feelings of reproducing terminal 30B are not dressed in user Under condition, distribution control unit 140, which is suspended to reproducing terminal 30B, sends distribution information, and be worn in confirmation reproducing terminal 30B Time point is sent to reproducing terminal 30B for information is distributed.In this way, because family can be used in distribution control unit 140 Directly listen to distribution information, it is possible to which making to listen to has strongly as the user for the voice of distribution information issued by distributor Impression.
Distribution information transmitting unit 150 is sent to reproduction for information is distributed based on the control that distribution control unit 140 carries out Terminal 30B.Specifically, distributing information transmitting unit 150 immediately to again in the case where user dresses reproducing terminal 30B Existing terminal 30B is sent in received distribution information at distribution information receiving unit 120.In this way, because of distribution information Transmission unit 150 can be used family and be listened in real time from the received distribution information of distributor, it is possible to enhance distributor and use The special impression of time is shared between family.In addition, for distributing in the case where user does not dress reproducing terminal 30B from distributor Distribution information, distribution information transmitting unit 150 can be confirmed user dress reproducing terminal 30B in the case where will distribute information It is sent to reproducing terminal 30B.In this way, distribution information transmitting unit 150 can be used family using reproducing terminal 30B can Distribution information is listened to by ground.
Response provides unit 160 will be associated with distribution information to comment, the evaluation of distribution information etc. from user.Specifically For, response provides unit 160 and receives the comment or feedback provided distribution information from the user for having listened to distribution information, and By comment or feed back associated with distribution information.In addition, response provides 160 pairs of unit instructions from relative users to distribution information The points of evaluation, approval, the hobby of offer etc. are counted, and the points of counting are associated with distribution information.By this Mode, response, which provides unit 160, can distribute information for content and the extent of reaction from user to distribution information for every It is associated.
Response transmission unit 170 will be such as communicated to point from response of the user to comment and the reaction etc of distribution information Originator.Specifically, response transmission unit 170 by such as by respond provide unit 160 information is associated comments with distribution By and the response of evaluation etc be communicated to and distributed the distributor of information.For example, response transmission unit 170 will be directed to The comment or feedback that distribution information provides are sent to the information processing unit 20A for having had sent the distributor of distribution information or divide Send out terminal 30A.It has been sent out in addition, response transmission unit 170 sends the points provided from relative users distribution information to The information processing unit 20A or distribution terminal 30A of the distributor of distribution information are sent.In this way, distributor can hold It changes places and confirms user to the anti-of the distribution information from the distributor's distribution for having information processing unit 20A or distribution terminal 30A on hand It answers.
(information processing unit 20B)
Network connection unit 226 includes for example for being connected to the interface and telecommunication circuit of network 40, and via net Network 40 is to/from 10 transmissions of netscape messaging server Netscape/reception information.Specifically, network connection unit 226 is from information processing services Device 10 receives the voice messaging to reproduce at reproducing terminal 30B as distribution information.In addition, network connection unit 226 can be with Will netscape messaging server Netscape 10 such as be sent to from response of the user to comment and the evaluation etc of distribution information.
Network connection unit 226 may include that for example may be coupled to LAN, WAN, internet, satellite communication network, phone The interface and telecommunication circuit of network, mobile communications network, IP-VPN etc., and may include may be coupled to such as 3G, 4G and The interface and telecommunication circuit of the mobile communications network of LTE etc.
Input unit 222 may include input equipment (such as touch panel, keyboard, button, the Mike that information is inputted to it Wind, switch and control-rod), the input based on user generates input signal and input signal is output to the defeated of control unit 223 Enter control circuit etc..
Control unit 223 includes the CPU as arithmetic processing unit, in wherein storage control program, control parameter etc. The RAM of ROM, and the program used when being wherein temporarily stored in operation, the parameter suitably changed etc., and control at information Manage each component of device 20B.
Display generation unit 224 generates the display to be presented to the user at display unit 225.For example, display generates list Display can be generated in member 224, which is the list of the distribution information reproduced at reproducing terminal 30B and will be presented to use Family.
Display unit 225 is based on being presented image etc. from the display that display generation unit 224 generates to user.Display unit 225 may include the display device of such as LCD device, OLED device and lamp etc.
Communication unit 221 includes the antenna and telecommunication circuit of such as communication plan, and the communication plan is with reproducing terminal 30B's The communication plan of communication unit 321 is identical, and send to/from reproducing terminal 30B/receive information.Specifically, communication unit 221 can believe distribution to/from 321 transmissions of communication unit/reception distribution information of reproducing terminal 30B and about from user The information etc. of the response of breath.
The communication plan of communication unit 221 is identical as the communication plan of communication unit 321 of reproducing terminal 30B, and can To be such as Wi-Fi (registered trademark), ZigBee (registered trademark), Bluetooth (registered trademark), Bluetooth Low Energy (registered trademark), ANT (registered trademark), ANT+ (registered trademark) etc., and can be such as 3G, 4G and LTE etc Mobile communication.
(reproducing terminal 30B)
Communication unit 321 includes such as antenna and telecommunication circuit, and is believed to/from information processing unit 20B transmission/reception Breath.Specifically, communication unit 321 can distribute information to/from 221 transmissions of communication unit/reception of information processing unit 20B With about to from user to distribution information response information etc..
It can by the communication that the communication plan that communication unit 321 executes can be for example with radius from several meters to about 100 meter The short distance communication scheme of energy range, and specifically, can be Wi-Fi (registered trademark), ZigBee (registered trademark), Bluetooth (registered trademark), Bluetooth Low Energy (registered trademark), ANT (registered trademark), ANT+ (registrar Mark) etc..But it is not limited to by the communication plan that communication unit 321 executes above-mentioned, and it can be such as such as 3G, 4G and LTE Etc mobile communication.
Sensor unit 325 is mounted in the various sensors on reproducing terminal 30B.Sensor unit 325 includes at least Obtain the sensor of the information to be used in the case where judging whether reproducing terminal 30B is worn on user.For example, sensing Device unit 325 may include detection object close to reproducing terminal 30B proximity sensor, detection reproducing terminal 30B and object it Between touch touch sensor, detect the posture and the acceleration transducer of direction etc. of reproducing terminal 30B, and can pass through Information from these sensors judges whether reproducing terminal 30B is worn on user.
It in addition, sensor unit 325 may include the microphone for collecting user speech, and may include detection user Acceleration transducer, gyro sensor or the vibrating sensor of gesture.According to such sensor unit 325, user can be with Intuitively execute the input to reproducing terminal 30B, without be inserted into such as touch panel, keyboard, button, microphone, switch and The input equipment of control-rod etc.
Control unit 322 include for example as the MPU of arithmetic processing unit, and wherein storage control program, control The memory of parameter etc., and control each component of reproducing terminal 30B.Specifically, control unit 322 controls each group Part, to reproduce from the received distribution information of information processing unit 20B.In addition, control unit 322 can control each component, To send information processing unit for the voice messaging of such as comment etc inputted from the user of sensor unit 325 20B。
The control of speech control unit 324 is guided to guide the output of the voice messaging of user in the operation of reproducing terminal 30B. For example, reproducing terminal 30B be do not include the ear inserting type terminal or earpiece type terminal of display unit in the case where, reproducing terminal 30B cannot indicate to the user that operating method by image etc..Therefore, at reproducing terminal 30B, speech control unit 324 is guided Reproduce voice messaging at voice reproduction unit 323, and how reproducing terminal 30B instruction user is reproduced by voice operating Terminal 30B.In this way, at reproducing terminal 30B, the operability of user can be improved.
It is issued and is received by distributor in addition, the voice messaging of user is guided to can be in the operation of reproducing terminal 30B The voice messaging of the voice of collection.The voice of these types can be prepared in advance by collecting the language of distributor.In addition, existing In the case where multiple distributors, the voice that user can be arbitrarily designated its sending will be used to guide user's operation reproducing terminal The distributor of 30B.
Voice reproduction unit 323 includes such as voice-output device (such as loudspeaker and earphone) and signal processing circuit (such as amplifier), and voice messaging is reproduced as voice.Specifically, voice reproduction unit 323 can reproduce as from The distribution information for the voice messaging that netscape messaging server Netscape 10 is sent.In addition, voice reproduction unit 323 can be by based on guidance The control reproducing speech information that speech control unit 324 carries out guides user's operation reproducing terminal 30B.
[operation of 1.3. information processing system]
Then, the behaviour of information processing system according to the present embodiment will be described with reference to Fig. 3 to Figure 13 using specific example Make.
(operation of reproducing terminal side)
Firstly, by reference Fig. 3 to Fig. 5 description according to the behaviour of the side reproducing terminal 30B of the information processing system of the present embodiment Make.Fig. 3 is the flow chart for explaining the operation of the side reproducing terminal 30B according to the information processing system of the present embodiment.Fig. 4 is to explain The flow chart of the concrete operations of " providing the processing of evaluation " in Fig. 3, Fig. 5 are " to provide the processing of comment " in explanation figure 3 The flow chart of concrete operations.
As shown in Figure 3, in the information processing system according to the present embodiment, the case where user listens to distribution information Under, firstly, detecting reproducing terminal 30B by sensor unit 325 is worn on user (S101).Then, it is confirmed whether exist The distribution information (S102) that user does not listen to.There is no the distribution information that do not listen to (S102: no), it is reproduced in and wears The predetermined wearing message (S106) reproduced when wearing.It should be noted that can be by being controlled to the distribution of netscape messaging server Netscape 10 Unit 140 asks whether the control unit 322 or information processing unit that have not via network 40 from such as reproducing terminal 30B The distribution information that the control unit 223 of 20B is listened to is confirmed whether there is the distribution information that do not listen to.
Predetermined wearing message is the voice messaging being stored in advance in reproducing terminal 30B etc..Predetermined wearing message can be The voice messaging of voice for being issued by distributor and being collected in advance, or can be the greeting of such as distributor, distributor couple Reading, predetermined message (for example, signature phrase of distributor) of distributor of time or date etc..Furthermore it is possible to suitably change Become predetermined wearing message.Specifically, can be according to the wearing time slot of reproducing terminal 30B, date and what day is predetermined to change Message is dressed, it can be according to the wearing history of reproducing terminal 30B (such as, for example, dressing the date of reproducing terminal 30B from last time With time elapsed time section) change predetermined wearing message, or predetermined wearing message can be changed at random.For example, pre- The content for determining message can be controlled as according to the time slot for dressing reproducing terminal 30B and what day usually asking from distributor It waits, and the signature phrase with low probability for distributor can be controlled as.
In the case where there is the distribution information that do not listen to (S102: yes), the message that notice has distribution information is reproduced (S103).The message made in the presence of the notice of distribution information can be the voice messaging etc. being stored in advance in reproducing terminal 30B, And it can be the voice messaging that distributor is issued in the mode similar with predetermined wearing message.Furthermore it is possible to according to not listening to Distribution information item number come change notice exist distribution information message.
Herein, to be reproduced to refer to other than above-mentioned predetermined wearing message and notice have the message of distribution information Show the state of reproducing terminal 30B or the voice (also referred to as guidance voice) of guidance user etc. is also possible to distributor's in operation Sound.In addition, guidance voice can be for example randomly selected from multiple distributors there are multiple distributors The voice of distributor, or can be the voice of the distributor (for example, the favorite distributor of user) specified by user.
It, can be interim there are multiple distributors and in the case that the voice of distributor that user specifies is guidance voice Change the distributor for issuing guidance voice, so that it is different from the distribution distributor of information is issued.In this case, it reproduces Terminal 30B can have distribution information by the guidance verbal announcement user with natural contents, and the guidance voice is from one point Originator introduction has distributed information from another distributor.Although it should be noted that giving notice drawing in the presence of distribution information The distributor of lead sound can be identical as the distribution distributor of information is issued, but in this case, reproducing terminal 30B can be with User is notified to there is distribution information by voice that distributor oneself is notified by guiding its content.
It should be noted that predetermined wearing message can be for example stored in netscape messaging server Netscape 10.For example, in sensor In the case that unit 325 detects that reproducing terminal 30B is worn on user, reproducing terminal 30B can be sent via network 40 10 reproducing terminal 30B of notification information processing server is worn on the information with user.In this way, by receiving to again Existing terminal 30B sends the netscape messaging server Netscape 10 of the information of predetermined wearing message, and reproducing terminal 30B can reproduce predetermined wearing Message.In addition, above-mentioned notice distribution information and the existing message of guidance voice can also be stored in information in a similar way In processing server 10.For example, reproducing terminal 30B is reproducing these message or is guiding the timing of voice via network 40 to information Processing server 10 requests these message or guidance voice, and receives these message or leading question from netscape messaging server Netscape 10 Sound.Accordingly, reproducing terminal 30B can reproduce from the received notice distribution information of netscape messaging server Netscape 10 and guide disappearing for voice Breath.
Then, the distribution information (S104) of transmission is reproduced.In this way, distribution information is listened to by user.
Then, it executes and provides the processing (S110) of evaluation to the distribution information listened to.It will describe with reference to Fig. 4 to distribution Information provides the processing of evaluation.Specifically, as shown in Figure 4, being confirmed whether firstly, reproducing to the distribution information listened to The guidance voice (S111) of evaluation is provided.
It should be noted that being confirmed whether that the guidance voice for providing evaluation may include about for selecting to provide the feelings evaluated The description of condition and the input operation for each of not providing the case where evaluation.In addition, reproducing the guidance speech period in user Between execute about whether the input operation for providing evaluation in the case where, the remaining of guidance voice can be skipped and reproduced.
Herein, evaluation instruction to the distribution agreement of information, evaluation, approval, it is favorite, like, and can be from each User provides to every distribution information.Therefore, distributor can be known by providing the confirmation to the item number for the evaluation for distributing information Which kind of distribution information of road can obtain higher evaluation.
Then judge whether to execute and provide the input operation (S112) of evaluation to the distribution information listened to.For example, In the case that reproducing terminal 30B is wearable terminal, it can be inputted and whether be mentioned to distribution information by the gesture motion of user For evaluation.It, can be by the user action nodded come defeated specifically, in the case where reproducing terminal 30B is ear inserting type terminal Enter and evaluation is provided, and can not provide evaluation by shaking the movement on his/her head to input.It should be noted that can also The input operation to reproducing terminal 30B is executed in other inputs by gesture motion as described above.It can be by various biographies Sensor (proximity sensor, acceleration transducer and the gyro sensor that such as, such as at reproducing terminal 30B provide) detection Input operation to these types of reproducing terminal 30B.
In the case where executing instruction the input not to the distribution information offer evaluation listened to from user (S112: It is no), reproducing terminal 30B completes to provide the processing (S110) of evaluation to distribution information, and handles and be transitioned into having listened to Distribute information and the processing (S120) of comment is provided.Meanwhile the distribution information offer listened to is commented being executed instruction from user In the case where the input of valence (S112: yes), reproducing terminal 30B will indicate that the information for providing distribution information evaluation is sent to information Processing server 10 (S113).
It should be noted that from user to distribution information provide evaluation in the case where, reproducing terminal 30B can reproduce from point The distributor of photos and sending messages expresses the voice messaging of thanks etc. to user.Meanwhile evaluation is not being provided to distribution information from user In the case where, reproducing terminal 30B can be reproduced from the distributor of information is distributed to the voice messaging of user's expression disappointment etc..Separately Outside, the history of evaluation can be provided based on user to change the content of the voice messaging of these types.For example, in user to a plurality of In the case that information offer evaluation is provided, the voice messaging of these types can change such as " to thanks as beforely " etc Content.In addition, the voice messaging of these types can be changed in the case where user seldom provides evaluation to distribution information The content of evaluation is provided for request.
The processing (S120) of comment is provided next, executing to the distribution information listened to.Will with reference to Fig. 5 describe to point Photos and sending messages provide the processing of comment.Specifically, as shown in Figure 5, firstly, reproducing the distribution letter being confirmed whether to having listened to Breath provides the guidance voice (S121) of comment.
It is confirmed whether that the guidance voice for providing comment may include about for the side similar with the processing for providing evaluation The description of the input operation of each of the case where formula selects the case where providing comment and do not provide comment.It is executed from user In the case where input operation, the reproduction of the guidance voice of these types can be cancelled.
Then judge whether to execute and provide the input operation (S122) of comment to the distribution information listened to.For example, such as It is upper described, in the case where reproducing terminal 30B is ear inserting type terminal, with the mode similar with the processing for providing evaluation, Ke Yitong It crosses the user action input nodded and comment is provided, and can be commented by shaking the movement on his/her head to input not provide By.
It executes from user not to (S122: no) in the case where the input for the distribution information offer comment listened to, then Existing terminal 30B completes to provide the processing (S120) of comment to distribution information, and is confirmed whether that there are still the distribution that do not listen to letters It ceases (S105).There are still the distribution information that do not listen to (S105: yes), processing returns to S103 is arrived, and reproduce Terminal 30B reproduces the distribution information that do not listen to.Meanwhile there is no the distribution information that do not listen to (S105: no), then Existing terminal 30B completes the reproduction of distribution information.
In the case where providing comment to the distribution information listened to from user (S122: yes), reproducing terminal 30B, which is collected, to be come From user to the comment of distribution information as voice messaging (S123).
Then, the guidance voice (S124) for being confirmed whether to listen to the collected voice messaging commented on is reproduced, and is judged Whether execution expectation, which is listened to, operates (S125) to the input of the voice messaging of the comment of distribution information offer by his/her.Example Such as, it as described above, in the case where reproducing terminal 30B is ear inserting type terminal, can be listened to by the user action input nodded The voice messaging of comment, and the voice messaging for not listening to comment is inputted by his/her head of shake.
User expectation listen to the voice messaging of comment in the case where (S125: yes), reproducing terminal 30B reproduce user to point The voice messaging (S126) for the comment that photos and sending messages provide.Hereafter, reproducing terminal 30B reproduces whether confirmation user it is expected to listen to again The guidance voice (S124) of the voice messaging of customer-furnished comment.
Meanwhile in the case where user does not expect to listen to the voice messaging of comment (S125: no), reproduction is confirmed whether to send The guidance voice (S127) of the voice messaging of customer-furnished comment judges whether to execute comment provided by transmission later Voice messaging input operate (S128).For example, as described above, in the case where reproducing terminal 30B is ear inserting type terminal, it can To send the comment provided distribution information by the user action nodded input, and can be by shaking his/her head Input does not send the comment provided distribution information.
It should be noted that reproducing terminal 30B can be from distribution information in the case where sending the comment to distribution information Distributor reproduces the voice messaging of expression thanks etc. to user.Meanwhile in the case where not sending the comment to distribution information, then Existing terminal 30B can reproduce the voice messaging of expression disappointment etc. from the distributor of distribution information to user.Furthermore it is possible to based on by User provides the history of comment to distribution information to change the content of the voice messaging of these types.For example, in user to a plurality of In the case where distributing information offer comment, the voice messaging of these types can be changed to such as " thank " it as beforely The content of class.Meanwhile in the case where user seldom provides comment to distribution information, the voice messaging of these types can be changed Become request and the content of comment is provided.
It, will be by user to distribution in the case where executing the input for sending the comment to distribution information and operating (S128: yes) The voice messaging for the comment that information provides is sent to netscape messaging server Netscape 10 (S129).Meanwhile it not sending executing to distribution In the case where the input operation of the comment of information (S128: no), complete to provide the processing (S120) of comment to distribution information, and It is confirmed whether that there are still the distribution information (S105) that do not listen to.There are still the distribution information that do not listen to (S105: yes), processing returns to arriving S103, and reproducing terminal 30B continues to reproduce the distribution information do not listened to.Meanwhile it depositing In the case where the distribution information that do not listen to (S105: no), reproducing terminal 30B completes the reproduction of distribution information.
According to operation as described above, in the information processing system according to the present embodiment, reproducing terminal is dressed in user In the case where 30B, the distribution information from distributor can be confirmed and user is made to listen to distribution information.
It herein, may include the content for being not suitable for being communicated to distributor from comment of the user to distribution information.Cause This, netscape messaging server Netscape 10 can execute voice recognition processing to each comment from the user, and it includes inappropriate for extracting Word (hereinafter, also referred to as erroneous words) comment.Due to include erroneous words and the comment that is extracted can such as being deleted, So as not to be communicated to distributor.
Reference Fig. 6 description is used to extract the configuration of such erroneous words.Fig. 6 is shown at netscape messaging server Netscape 10 The block diagram of the configuration of the extraction of erroneous words processing is executed to comment from the user.To simplify the explanation, figure is omitted in Fig. 6 The diagram of some components shown in 2A and Fig. 2 B.
As shown in Figure 6, in the case where executing erroneous words processing to comment from the user, netscape messaging server Netscape 10 Further include terminal management unit 181 and function restriction unit 182, and provides the speech recognition list in unit 160 including response Member 161, erroneous words processing unit 162 and erroneous words storage unit 163.
The comment provided from user distribution information is converted to text envelope from voice messaging by voice recognition unit 161 Breath.Specifically, voice recognition unit 161 is using its text data acoustic model associated with voice data and wherein Language model by statistical disposition accumulation about the information of the arrangement of word generates text corresponding with the waveform spectrum of voice messaging Information.It should be noted that can use widely-known technique as the speech recognition skill used in voice recognition unit 161 Art, and arbitrary data library can be used as above-mentioned acoustic model and language model.
Erroneous words processing unit 162 judges to comment on based on the text information for the comment converted by voice recognition unit 161 It whether include the predetermined word being stored in erroneous words storage unit 163.In addition, the extraction of erroneous words processing unit 162 is judged as packet Include the comment of predetermined word.In this way, erroneous words processing unit 162 can mechanically extract such comment, so that packet The comment for including scheduled unsuitable word is not communicated to distributor.
Predetermined word (that is, erroneous words) is to be not suitable for being communicated to the word of distributor, and predetermined word is stored in erroneous words storage In unit 163.The word being stored in erroneous words storage unit 163, which can be, for example opposes the word of public policy, abuses or abuse Other people word, etc..In addition, other than these words, can also individually store and should be in erroneous words storage unit 163 The word that distributor is handled with care.As the word being stored in erroneous words storage unit 163, for example, being often unsuitable in talk The word used can be set to erroneous words or erroneous words can be separately provided by distributor, etc..
The management of terminal management unit 181 receives each user of distribution information.Specifically, by erroneous words processing unit In the case that 162 extract the comment including erroneous words, terminal management unit 181, which obtains, provides the mark letter of the user of comment Breath, and the user of the comment including erroneous words is provided with other users separate management.In this way, terminal management unit 181 can for example apply the punishment of such as function restriction etc individually to the user for providing the comment including erroneous words.
The function that the limitation of function restriction unit 182 can be executed by the user that terminal management unit 181 manages.It is specific and Speech, terminal management unit 181 are limited in the information processing system according to the present embodiment by providing the comment including erroneous words The function that user can be performed.It provides for example, function restriction unit 182 can stop sending distribution information to including erroneous words The reproducing terminal 30B of the user of comment, or can limit to distribution information addition comment.
It should be noted that depending on the accuracy of the speech recognition executed by voice recognition unit 161, it is possible to extract go out Do not include erroneous words comment as the comment including erroneous words, or cannot all extract the comment including erroneous words.
Thus, for example, can make to comment in the case where including erroneous words by the judgement comment of erroneous words processing unit 162 Voice messaging actually listened to by third party and only third party judge comment include erroneous words in the case where just in terminal The identification information of user is managed at administrative unit 181.
In addition, receiving complaint from the user for being judged as providing the comment including mistake, and judge due to comment Voice messaging actually listened to by third party and mistakenly extract comment in the case where, user can be by terminal management unit 181 exclude except management.In addition, the comment for including the case where erroneous words is communicated to distributor due to extracting failure Under, it is also possible to cause distributor's report to include the comment of erroneous words, and providing the management of terminal management unit 181 includes erroneous words Comment user.
The configuration that extraction includes the comment of erroneous words is commented on for what is provided to distribution information although being described above, But these configurations also can be applied to distribution information.That is, to the distribution information from distributor also execute speech recognition it Afterwards, can be judged to distribute whether information includes erroneous words by erroneous words processing unit 162.In such a case, it is possible to prevent from wrapping The distribution information for including erroneous words is sent to user.
In addition, in the information processing system according to the present embodiment, because the distribution information from distributor is stored in point In photos and sending messages storage unit 130, so user can listen to again had listened to primary distribution information.In this case The operation of information processing system will be described with reference to Fig. 7 to Fig. 9.Fig. 7 is to explain listening to primary distribution information The flow chart of the operation of the side reproducing terminal 30B in the case where being listened to again.In addition, Fig. 8 is that diagram encourages user to dress reproduction The explanation figure of the display example of terminal 30B, and Fig. 9 is to illustrate the display of the list for having listened to primary distribution information to show The explanation figure of example.
As shown in Figure 7, firstly, user it is expected that the intention for the distribution information that confirmation has been listened to is input to information from user Processing unit 20B (S131).In this case, information processing unit 20B confirms whether reproducing terminal 30B is worn on user's body Upper (S132), and in the case where reproducing terminal 30B is not worn on user (S132: no) are generated and are encouraged user's wearing The display (S135) of reproducing terminal 30B.
The display for encouraging user to dress reproducing terminal 30B can be display for example as shown in Figure 8.Specifically, encouraging The display that user dresses reproducing terminal 30B can be the shape of instruction reproducing terminal 30B and dress reproducing terminal 30B on it Body a part image and text.For example, encouraging user to wear in the case where reproducing terminal 30B is ear inserting type terminal The display for wearing reproducing terminal 30B can be the display that instruction user dresses ear inserting type reproducing terminal 30B on ear.
Information processing unit 20B is standby with display shown in Fig. 8, until confirmation reproducing terminal 30B is worn on user Until, and in the case where reproducing terminal 30B is worn on user (S132: yes), generate the distribution that instruction has been listened to The display (S133) of the list of information.
Indicate that the display of the list for the distribution information listened to may, for example, be display as shown in Figure 9.Specifically, Indicate that the display of the list for the distribution information listened to can be using the date and time for sending distribution information from distributor And each item distribution letter for being distributed to reproducing terminal 30B as index such as name and icon for sending the distributor of distribution information The display of the list of breath.In addition, as shown in Figure 9, by using the change of background color, highlight, it can be to emphasize The distribution information that status display is currently reproduced by.In addition, it is current again to provide instruction in the bottom of the display of list The display (that is, so-called searching bar) of a part of the index and distribution information reproduced of existing distribution information.In addition, In the display for distributing the list of information, for each distribution information, it can dispose and such as indicate whether to comment to distribution information offer The display of valence or the check box of comment etc.The distribution that user can select user it is expected to listen to by checking such display Information.
In the case where selecting the distribution information to be reproduced in the display from the list of distribution information, information processing unit 20B makes reproducing terminal 30B reproduce selected distribution information (S134).Herein, do not believing from distribution of the user to reproduction In the case that breath provides evaluation or comment, it can execute with reference to the processing (S110) of Fig. 4 offer evaluation described and be retouched with reference to Fig. 5 The processing (S120) for the offer comment stated.In this way, user can provide the distribution information of reproduction evaluation or comment.
In the case where completing reproduction (S134) of selected distribution information, information processing unit 20B is shown again to be divided The list (S133) of photos and sending messages.In this way, user can choose the distribution information then to be reproduced.It should be noted that It is reproduced although being described above by reference to Fig. 7 to Fig. 9 in the case where listening to listened to primary distribution information again The operation of terminal 30B, but the operation of above-mentioned reproducing terminal 30B is not limited to such case.The aforesaid operations of reproducing terminal 30B can To be applied to the case where reproducing the distribution information listened to for the first time.
(operation of distribution terminal side)
Then, by with reference to figures 10 to Figure 12 description according to the side distribution terminal 30A of the information processing system of the present embodiment Operation.Figure 10 is the flow chart for explaining the operation of the side distribution terminal 30A according to the information processing system of the present embodiment.
As shown in Figure 10, in the information processing system according to the present embodiment, the feelings of distribution information are sent in distributor Under condition, firstly, detection distribution terminal 30A is worn on distributor (S201).Then, in response to the operation from distributor Deng distribution information (S202) of the beginning from the collection of microphone unit 315 as voice messaging.Complete determining for the collection of distribution information When can be for example since collect since after a predetermined period of time, or can be distributor distribution terminal 30A on hold Row completes the timing for the operation collected.
It is confirmed whether in the collection for completing distribution information and then now to listen to the guidance of the voice of collected distribution information Voice (S203).Herein, the guidance voice that reproduce at distribution terminal 30A is stored in advance in distribution terminal 30A etc. Voice messaging.Although the guidance voice to reproduce at distribution terminal 30A can be the voice issued by distributor, draw Lead sound is also possible to the voice issued by third party or synthesizes voice.In addition, with being confirmed whether that listening to collected distribution believes The above-mentioned guidance voice of the voice of breath is the same, and the state or guidance user to be reproduced to indicate distribution terminal 30A operates Deng voice (so-called guidance voice) can also be in a similar manner by distributor issue voice, by third party issue language Sound or synthesis voice.
Hereafter, judge whether that the input for executing the voice messaging that distributor listens to distribution information operates (S204).For example, In the case that distribution terminal 30A is ear inserting type terminal, the language for listening to distribution information can be inputted by the user action nodded Message breath, and the voice messaging for not listening to distribution information can be inputted by shaking the movement on his/her head.
In the case where executing the input operation for listening to the voice messaging of distribution information (S204: yes), collected by reproduction Distribute the voice (S205) of information.Hereafter, it reproduces to distributor and confirms whether distributor it is expected to listen to collected distribution again The guidance voice (S203) of the voice messaging of information.
Meanwhile in the case where executing the input operation for not listening to distribution information (S204: no), reproduction is confirmed whether to send The guidance voice (S206) of collected distribution information.Hereafter, judge whether that expectation is executed from distributor sends distribution information Input operation (S207).It, can be by nodding for example, as described above, in the case where reproducing terminal 30B is ear inserting type terminal User action sends distribution information to input, and can not send distribution by shaking the movement on his/her head to input Information.
In the case where executing the input operation for sending distribution information (S207: yes), in the distribution that will be issued by distributor Information is sent to after netscape messaging server Netscape 10 (S208), and distribution terminal 30A completes operation.Distribution information is not sent executing Input operation in the case where, do not send netscape messaging server Netscape 10 (S207: no) for distribution information, and distribute terminal 30A completes operation.
It should be noted that distributor is associated with distribution terminal 30A in advance.In this way, netscape messaging server Netscape 10 may determine that the distributor for the distribution information that transmitting and receiving arrives.
Further, it is possible to use other devices collect the voice of distributor instead of using distribution terminal 30A.For example, believing In the case that breath processing unit 20A includes microphone unit, information processing unit 20A can collect the voice of distributor and generation Distribute information.
Using operation as described above, in the information processing system according to the present embodiment, it can collect and be sent out by distributor Voice out is to generate distribution information.
In addition, in the information processing system according to the present embodiment, because of the response of comment such as from the user etc It is stored in association in distribution information memory cell 130 with distribution information, therefore distributor can also confirm that from user couple Distribute the response of information.It will be described with reference to FIG. 11 the operation of information processing system in this case.Figure 11 is explained true Recognize from user to distribution information comment in the case where distribution the side terminal 30A operation flow chart.
As shown in Figure 11, for example, detection distribution terminal 30A is worn on distributor (S211).Then, it is confirmed whether Comment (S212) from the user is provided to the nearest distribution information sent from the distributor of wearing distribution terminal 30A.Not In the case where providing comment from the user to nearest distribution information (S212: no), distribution terminal 30A completes to operate and enter Standby mode.It should be noted that can be by distributing the control unit 312 of terminal 30A or the control list of information processing unit 20A Member 213 is asked whether to exist and be commented distribution information via network 40 to the response transmission unit 170 of netscape messaging server Netscape 10 By being confirmed whether to provide comment from the user to distribution information.
Meanwhile in the case where providing comment from the user to nearest distribution information (S212: yes), reproducing confirmation is The no guidance voice (S213) that the comment provided to distribution information is provided.Hereafter, it is confirmed whether to execute instruction distributor's expectation again The input operation (S214) now commented on.For example, as described above, distribute terminal 30A be ear inserting type terminal in the case where, Ke Yitong It crosses the user action nodded and reproduces comment to input, and can not reproduced by shaking the movement on his/her head to input Comment.
In the case where executing instruction the undesirable input for reproducing comment of distributor and operating (S214: no), distribute terminal 30A It completes to operate and enters standby mode.Meanwhile in the case where executing instruction the input operation that distributor it is expected that reproduction is commented on (S214: yes), distribution terminal 30A reproduction include the voice messaging of the comment provided from user to nearest distribution information (S215)。
Hereafter, it is confirmed whether to provide multiple comments (S216) to distribution information.Multiple comments are not being provided to distribution information In the case where (S216: no), distribution terminal 30A complete operate simultaneously enter standby mode.Meanwhile it is multiple being provided to distribution information In the case where comment, processing returns to arriving S213, and the guidance voice for being confirmed whether to reproduce next comment is reproduced, and as above Described, reproduction includes the voice messaging of the comment provided to distribution information.Distribution terminal 30A repeats the behaviour of above-mentioned reproduction comment Make, until the reproduction for all comments for completing to provide to distribution information.
It can be according to the date and time of offer comment it should be noted that being supplied to reproducing for multiple comments of distribution information Chronological order execute, or can according to provide comment date and time reversed time order execute.
In addition, the comment that information processing unit 20A can be such that distributor provides from user distribution information by display Confirmation is executed with evaluation.The display presented at information processing unit 20A in this case will be described with reference to Figure 12. Figure 12 is the explanatory diagram for illustrating wherein distribution information display example associated with to the comment of information is distributed.
For example, shown in Figure 12 display in, using the date and time of transmission, sent distribution information distributor Name and icon etc. the list of each item distribution information sent from distribution terminal 30A is illustrated as index.In addition, instruction institute The image of the quantity of the item number and provided comment of the evaluation of offer is associated with every distribution information.For example, instruction is mentioned The image of the evaluation of confession can be the upward image of thumb, and indicate that the provided image commented on can be voice balloon Image.The item number of provided evaluation and comment can be shown such as using the number next to these images.
It should be noted that corresponding distributor can only be able to confirm that oneself there are multiple distributors The comment of distribution information and the distribution information for being supplied to oneself, or can further confirm that the distribution letter of other distributors Breath, or can further confirm that the distribution information of other distributors and be supplied to the comment of distribution information.
In addition, display is transitioned into the selected distribution information of display instruction in the case where selecting every distribution information Details.In the display of the details of instruction distribution information, instruction is supplied to the comment list of distribution information.It is, for example, possible to use The identification information and icon for providing the date and time commented on and the user for providing comment show corresponding as index The list of the comment of offer.Distributor can be by selecting the comment of each display to believe to listen to the voice of selected comment Breath.
It should be noted that by passing through the case where voice messaging of comment is converted to text information by speech recognition technology Under, in the display of the details of instruction distribution information, the text information of conversion is used as the index of each comment.
[1.4. modified example]
Although the information processing system according to the present embodiment is described above, for according to sheet as described below The information processing system of embodiment may exist various other modified examples.
(coordination with other application)
It can be (all with external information processing server or external application according to the information processing system of the present embodiment Such as, for example, social networking service) operation is executed in phase.
It, can be by by voice for example, in the information processing system according to the present embodiment while distribution information Identification technology is applied to the distribution information as voice messaging, distribution information is converted to text information, and can will convert Text information afterwards is distributed to external social networking service (SNS) etc..In addition, in the information processing system according to the present embodiment While sending distribution information, the notice that instruction sends distribution information can be carried out in external SNS etc..In addition, outside The text message of the distributor of portion SNS etc. publication can be converted into the voice for reading, and can be according to this reality It applies in the information processing system of example and is sent as distribution information.It should be noted that the example of outside SNS may include for example short Sentence issuing service.
(coordination with location information)
In addition, can be obtained with by information processing unit 20B or reproducing terminal 30B according to the information processing system of the present embodiment The location information taken executes operation in phase.
It should be noted that gain location letter can be carried out by using such as Global Navigation Satellite System (GNSS) sensor etc. Breath.Further, it is possible to use the signal strength of each base station in mobile communications network calculates location information, or can be with Location information is calculated using the signal strength of each access point from Wi-Fi (registered trademark).
Accordingly, for example, can control information processing system, so that entering in information processing unit 20B or reproducing terminal 30B Scheduled distribution information is reproduced in the case where the predetermined area.
For example, in the case where distributor is idol etc., the predetermined area can be nearest or past concert place, most Close or past playground, place relevant to distributor (such as, for example, local or unforgettable place) etc..In this feelings The distribution information reproduced under condition can be explanation, the guidance in surrounding place or the solution of memory of such as distributor to the predetermined area It releases.
Furthermore it is also possible to information processing system be controlled, so that passing through in information processing unit 20B or reproducing terminal 30B more Scheduled distribution information is reproduced in the case where a predetermined area.For example, passing through in information processing unit 20B or reproducing terminal 30B In the case where multiple predetermined areas, scheduled distribution information can be reproduced at reproducing terminal 30B as privilege or reward.
In addition, information processing system can also be with information processing unit 20B or reproducing terminal other than location information The user behaviors log etc. for the user that 30B is obtained executes operation in phase.In this case, for example, can control information processing system System, so that reproducing scheduled distribution information in the case that place takes predefined action in the predetermined area in user.
In addition, can be indicated such as according to the location information of user to distributor according to the information processing system of the present embodiment The response of comment or evaluation from the user etc.For example, as shown in Figure 13, it can according to the information processing system of the present embodiment To indicate wherein to provide the place point display disposed on map 500 such as 501 of the user of comment or evaluation to distribution information. Accordingly, information processing system can also be further increased point by indicating the specified place for the user that provide comment or evaluation Intimate sense between originator and user.
(being used as filtering function)
In addition, being made it possible to be located at the identical of such as concert place etc according to the information processing system of the present embodiment Distribution information between the distributor and user in place, and it is being located remotely from distribution minute between distributor and user a little Photos and sending messages.
For example, in the case where existing is multiple distributors of idol etc, it is also possible that at reproducing terminal 30B only The voice of particular dispensed person is reproduced as the distribution information in the concert place of distributor.That is, in this case, according to this The information processing system of embodiment can execute in multiple distributors extract particular dispensed person voice and using voice as Distribution information is sent to the filtering function of user.
(modified example of distribution information)
Although the distribution information that in the above description, distribute in the information processing system according to the present embodiment is all Such as the physical information depending on distributor of voice messaging etc, but above-mentioned show is not limited to according to the technology of the disclosure Example.For example, the distribution information distributed in the information processing system according to the present embodiment can be including such as music, image, The content information of the various contents of mobile image and text etc.
<2. second embodiment>
[summary of 2.1. information processing system]
Next, by reference Figure 14 description according to the summary of the information processing system of second embodiment of the present disclosure.Figure 14 It is the explanation figure for explaining the summary of the information processing system according to second embodiment of the present disclosure.
As in the first embodiment, being it according to the information processing system of the present embodiment receives distribution letter from distributor Cease and be sent to distribution information the information distribution system of user.It should be noted that distributor is such as idol, famous person, opinion Leader etc., and user is such as the bean vermicelli of distributor, follower.
In the present embodiment, distribution information can be the physical distribution information for example depending on distributor, Huo Zheke To be the vibration information for the sense of touch or heartbeat for conveying distributor.Because the sense of touch of distributor is touched depending on distributor is practical The information of object, and the heartbeat of distributor is the information of impression depending on distributor etc., therefore both has strong tool The information of body.Therefore, in the information processing system according to the present embodiment, by believing the information of these types as distribution Breath distribution, can cause the feeling as user and distributor's communal space.
It as shown in Figure 14, include the distribution terminal 32A possessed by distributor according to the information processing system of the present embodiment With information processing unit 20A, user the reproducing terminal 32B and information processing unit 20B that possess by receiving distribution information, and The netscape messaging server Netscape 12 of information processing unit 20A and 20B are connected to via network 40.
It should be noted that implementing because information processing unit 20A, information processing unit 20B and network 40 have with first Substantially similar configuration is configured described in example, therefore thereof will be omitted descriptions.
Distributing terminal 32A and reproducing terminal 32B is for example worn in any part of the body of distributor or user Information processing unit.Distribution terminal 32A at least has the function of heart rate measurement or sense of touch detection function, and reproducing terminal 32B is extremely It is few that there is vibration representational role.
Herein, distribution terminal 32A and reproducing terminal 32B will be more specifically described with reference to Figure 15 A and Figure 15 B.Figure 15 A is The schematic diagram of the specific example of the configuration of diagram distribution terminal 32A, and Figure 15 B is the tool for illustrating the configuration of reproducing terminal 32B The exemplary schematic diagram of body.
As shown in figure 15 a, distribution terminal 32A is the Wristwatch-type terminal in wrist for being worn on distributor etc., and is wrapped Include band part 340, pulsation sensor 343 and touch sensor 341.
Distribution terminal 32A is fixed on the body of distributor by the band part 340 in wrist for being wrapped in distributor etc.. Band part 340 can be made of any material, as long as band part 340 can wind in wrist of distributor etc., and band portion Divide 340 can be made of any one of leather, cloth, resin, metal or combinations thereof.
Touch sensor 341 is the sensor for detecting the sense of touch of distributor, and at band part 340 and towards distributor Wrist etc. the opposite face in face on provided (that is, the outside of band part 340).For example, touch sensor 341 may include Mike Wind etc..The sense of touch of the distributor of the available touching object of touch sensor 341 including microphone etc. etc. is as air vibration.
Pulse transducer 343 is the sensor for measuring the heart rate of distributor, and towards distributor's at band part 340 (that is, inside of band part 340) provides on the face of wrist etc..For example, pulse transducer 343 can be by the way that infrared light to be radiated Wrist of distributor etc. measures heart rate, and measures change of the change of blood flow as infrared absorption characteristic, or can lead to Over-voltage force snesor detects the pulsation of blood vessel to measure heart rate, etc..
As shown in Figure 15 B, reproducing terminal 32B is the Wristwatch-type terminal in wrist for being worn on user etc., and including Band part 340 and vibration reproduction unit 345.
As in distribution terminal 32A, by wrist that band part 340 is wrapped in user etc., by reproducing terminal 32B is fixed on the body of user.Band part 340 can be made of any material, as long as band part 340 can wind in user Wrist etc. on, and can be made of any one of leather, cloth, resin, metal or combinations thereof.
Vibration reproduction unit 345 is that will distribute information regeneration be the actuator vibrated, and band part 340 towards with (that is, inside of band part 340) provides on the face of the wrist at family etc..Vibration reproduction unit 345 may include such as eccentric motor, Voice coil motor, piezoelectric actuator etc..
In the information processing system according to the present embodiment, the vibration information of the sense of touch or heartbeat of conveying distributor is distributed Terminal 32A is obtained as distribution information, and is distributed to reproducing terminal 32B via network 40.By at reproducing terminal 32B Distribution information is reproduced, user can experience the sense of touch of the object of distributor's touch or the heartbeat of distributor in a pseudo manner.
It should be noted that the form of distribution terminal 32A and reproducing terminal 32B is not limited to above-mentioned Wristwatch-type, but can be Any form.For example, the form of distribution terminal 32A and reproducing terminal 32B can be glasses type, ring-shaped, earpiece type, ear inserting type Deng.But in order to efficiently obtain vibration information from distributor and acquired vibration information is efficiently communicated to user, The form of distribution terminal 32A and reproducing terminal 32B can be above-mentioned Wristwatch-type.
Distribute terminal 32A and reproducing terminal 32B via information processing unit 20A and 20B to/from netscape messaging server Netscape 12 Information is distributed in transmission/reception.But distribution terminal 32A and reproducing terminal 32B can be directly to/from netscape messaging server Netscape 12 Information is distributed in transmission/reception, and does not intervene information processing unit 20A and 20B.
Netscape messaging server Netscape 12 receives distribution information from distribution terminal 32A, and whether dresses reproducing terminal based on user 32B distributes the transmission of information to reproducing terminal 32B to control.
Specifically, in the case where user wearing reproducing terminal 32B when receiving distribution information, information processing services Device 12 is sent to reproducing terminal 32B for information is distributed.Meanwhile reproducing terminal is not dressed when receiving distribution information in user In the case where 32B, netscape messaging server Netscape 12 does not send reproducing terminal 32B for distribution information.But in reproducing terminal 32B In the case that whether place control user can receive distribution information, whether netscape messaging server Netscape 12 can be connect based on user Contracture photos and sending messages control transmission of the distribution information to reproducing terminal 32B.Accordingly, always dress reproducing terminal 32B's in user In the case of, user can control whether user can receive distribution information at reproducing terminal 32B.
Distribution information in the present embodiment is the sense of touch for conveying distributor or the vibration information of heartbeat.Netscape messaging server Netscape 12 can make to distribute the body that information is communicated directly to user by the transmission of control distribution information, reproduce to dress in user Distribution information is reproduced in the state of terminal 32B.In this way, netscape messaging server Netscape 12 allows users to body in a pseudo manner Test the feeling or impression of distributor.
Therefore, according to the information processing system according to the present embodiment, it will can more effectively convey and depend on distributor's The vibration information of physical sense of touch or heartbeat is distributed to user.
Although it should be noted that describing information processing system in Figure 14 includes distribution terminal 32A, information processing unit The example of 20A, netscape messaging server Netscape 12, information processing unit 20B and reproducing terminal 30B, but according to the technology of the disclosure It is not limited to such example.For example, distribution terminal 32A and information processing unit 20A can be an integrated information processing apparatus It sets, and reproducing terminal 32B and information processing unit 20B can be an integrated information processing unit.In addition, information processing Some or all of server 12 function can execute at one in information processing unit 20A and information processing unit 20B.
[configuration of 2.2. information processing system]
Next with reference to Figure 16 description according to the configuration of the information processing system of the present embodiment.Figure 16 is explained according to this The block diagram of the concrete configuration of the information processing system of embodiment.
As shown in Figure 16, distribution terminal 32A includes distribution information acquisition unit 314, control unit 312 and communication unit 311, and netscape messaging server Netscape 12 includes network connection unit 110, distribution information receiving unit 120, distribution control unit 140 and distribution information transmitting unit 150, and reproducing terminal 32B include sensor unit 325, it is playback control unit 326, logical Believe unit 321 and reproduction unit 327.
It should be noted that because information processing unit 20A, information processing unit 20B, network 40, communication unit 311, net Network connection unit 110 and communication unit 321 have and configure substantially similar configuration described in first embodiment, therefore here It is described omitting.
(distribution terminal 32A)
Distribute information acquisition unit 314 include such as touch sensor 341 or pulsation sensor 343, and obtain about The sense of touch of the distributor of wearing distribution terminal 32A or the information of heart rate.Specifically, distribution information acquisition unit 314 can be The sense of touch of distributor is obtained at touch sensor 341 as vibration, and the vibration letter for the sense of touch for conveying distributor can be generated Breath.In addition, distribution information acquisition unit 314 can obtain the heart rate of distributor at pulse transducer 343, and can be generated Convey the vibration information of the heartbeat of distributor.For example, vibration information is about vibration in the case where distributor's touching object Information, about information of heart rate of distributor etc..
For example, in the case where the information of the heart rate about distributor is distributed as distribution information, in addition to distributor's Except heart rate, distribution terminal 32A can be using the timing of the heartbeat of distribution person as distribution information.In such case Under, because reproducing terminal 32B can be vibrated with the reproduction in timing synchronization of the heartbeat of distributor, it is possible to make user more The impression etc. of distributor is specifically experienced in a pseudo manner.In this case, distribution terminal 32A can be pre- with such as every five seconds Fixed cycle sends distribution information.
Control unit 312 includes for example as MPU of arithmetic processing unit, and storage control program, control parameter etc. Memory, and control distribution terminal 32A each component.Specifically, control unit 312 controls each component, so that by The vibration information that distribution information acquisition unit 314 obtains is sent to information processing unit 20A as distribution information.
(netscape messaging server Netscape 12)
Distribute information receiving unit 120 and receives the distribution letter sent from distribution terminal 32A via information processing unit 20A Breath.Distribution information is the physical information depending on distributor, and is the distribution information acquisition unit in distribution terminal 32A The vibration information generated at 314.Netscape messaging server Netscape 12 can be communicated to use by the distribution information that will be sent from distributor Family and make user in a pseudo manner and have the experience of distributor or experience the impression of distributor.
Distribution control unit 140 controls distribution information to reproducing terminal 32B based on whether user dresses reproducing terminal 32B Transmission.Specifically, the distribution control of control unit 140 is for sending distribution in the case where user dresses reproducing terminal 32B The timing of information, so that reproducing distribution information at reproducing terminal 32B.Therefore, the feelings of reproducing terminal 32B are not dressed in user Under condition, distribution control unit 140 does not send reproducing terminal 32B for distribution information.In this way, distribute control unit 140 can make distribution information be conveyed directly to user by reproducing terminal 32B.In addition, not dressing reproducing terminal 32B in user In the case where, it can prevent from consuming electric power due to vibration of reproducing terminal 32B etc..
Distribution information transmitting unit 150 is sent to reproduction for information is distributed based on the control that distribution control unit 140 carries out Terminal 32B.Specifically, distributing information transmitting unit 150 immediately to again in the case where user dresses reproducing terminal 32B Existing terminal 32B is sent in received distribution information at distribution information receiving unit 120.In this way, because of distribution information The sense of touch that distributor is experienced at family in real time or heartbeat can be used as distribution information in transmission unit 150, it is possible to enhancing point Originator and user sharing experience or the special impression in space.In addition, in the case where user does not dress reproducing terminal 32B, point Photos and sending messages transmission unit 150 does not send the distribution information distributed from distributor to reproducing terminal 32B.
(reproducing terminal 32B)
Sensor unit 325 is mounted in the various sensors on reproducing terminal 32B.Sensor unit 325 includes at least Obtain the sensor of the information to be used in the case where judging whether reproducing terminal 32B is worn on user.For example, sensing Device unit 325 may include: the proximity sensor for judging reproducing terminal 32B and whether being worn on user, detection reproducing terminal The touch sensor etc. of touch between 32B and object, and can be reproduced based on the information judgement obtained by these sensors Whether terminal 32B is worn on user.
It in addition, sensor unit 325 may include the microphone for collecting user speech, and may include detection user Acceleration transducer, gyro sensor or the vibrating sensor of gesture.In the feelings that sensor unit 325 includes this sensor Under condition, user can intuitively execute the input to reproducing terminal 32B, without be inserted into such as touch panel, keyboard, button, The input equipment of microphone, switch and control-rod etc.
Reproduction unit 327 includes the actuator and signal processing circuit for for example generating vibration, and reproduces distribution information.Tool For body, the distribution information regeneration sent from netscape messaging server Netscape 12 is vibration by reproduction unit 327.
It should be noted that reproduction unit 327 may include the light source of such as light emitting diode (LED) etc.Reproduction unit 327 can be such that light source with Vibration Synchronization flashes.Accordingly, reproduction unit 327 can clearly indicate to the user that vibration.
Playback control unit 326 includes for example as the MPU of arithmetic processing device, and storage control program, control ginseng The memory of number etc., and control the reproduction from the received distribution information of information processing unit 20B.Specifically, reproducing control list Member 326 can be based on the information about vibration in the case where distributor's touching object, so that reproducing at reproduction unit 327 Convey the vibration of the sense of touch of distributor.In addition, playback control unit 326 can make reproduction unit 327 based on about distributor's Reproduce vibration to the heartbeat synchronization of the information of heart rate and distributor.It should be noted that playback control unit 326 can be at information It manages and is provided at device 20B, and the vibration of the control reproduction unit 327 such as communication can be passed through.
For example, making reproduction unit 327 and distributor based on the information of the heart rate about distributor in playback control unit 326 Heartbeat synchronization reproduce vibration in the case where, playback control unit 326 can be such that reproduction unit 327 reproduces closer to heartbeat Vibration.In this case, playback control unit 326, which can use, provides less jamais vu and looks like true vibration It is dynamic that the heartbeat of distributor is communicated to user.
Herein, reference Figure 17 and Figure 18 are more specifically described to the one aspect of heartbeat.Figure 17 is to be schematically illustrated The curve graph of the waveform of heartbeat, and Figure 18 is the relationship being schematically illustrated between Δ t and a and heart rate shown in Figure 17 Curve graph.
As shown in Figure 17, it shrinks in a heartbeat cardiac and then expands.Therefore, the waveform of a heartbeat mainly by Two waveforms are constituted.Specifically, the waveform of a heartbeat is made of waveform R and waveform T, waveform R has spike and and the heart Dirty contraction is corresponding, and waveform T has broad peak and corresponding with the expansion of heart.It should be noted that interval n and the heartbeat of waveform R Interval it is corresponding, and the value obtained and by one minute interval divided by heartbeat with one minute in heart rate it is corresponding.
Herein, heartbeat becomes much larger faster with the increase of heart rate.Therefore, in Figure 17, if waveform R and waveform The time interval at the peak between T is arranged to Δ t, and the difference in height at the peak between waveform R and waveform T is arranged to a, then The relationship shown in the curve graph in Figure 18 between Δ t and a can be considered.Specifically, as shown in Figure 18, increasing in heart rate In the case where adding, because heartbeat becomes larger, a becomes larger, and because the period needed for a heartbeat shortens, Δ t becomes It is small.
Therefore, playback control unit 326 can be by making reproduction unit 327 based on heart rate and the heart as shown in Figure 18 Relationship between Δ t and a in jump is vibrated and is not providing less jamais vu and looking like true square user oriented Convey the heartbeat of distributor.
In addition, for example, playback control unit 326 can in the case where distributing information includes the information about vibration timing With the reproduction of 327 pairs of the timing controlled reproduction unit vibrations based on vibration.But make reproduction unit in playback control unit 326 327 distribute information in include vibration timings place vibration and vibration become unnatural with heartbeat in the case where, reproducing control The timing of the adjustable vibration of unit 326, so that the vibration of reproduction unit 327 becomes more natural.
For example, changing the vibration period of reproduction unit 327 according to the alteration in heart rate of distributor in playback control unit 326 In the case where, the interval existed between the vibration after cyclomorphosis and the vibration before cyclomorphosis becomes very short feelings Condition.But heartbeat interval only at a part it is short be it is unnatural, in this case, user have jamais vu.Cause This, is in the case where playback control unit 326 changes the vibration period of reproduction unit 327 based on distribution information, reproducing control list The timing of the vibration of first 326 adjustable reproduction units 327, so that the change of vibration period becomes mild.
The details for the above-mentioned judgement that reference Figure 19 description is carried out by playback control unit 326.Figure 19 is to explain reproducing The flow chart of judgement in the case where the vibration change of the heart rate reproduced at unit 327.
It is assumed here that distribution information is the heart rate based on distributor by the vibration period of reproduction unit 327 from the heart rate x (heart Hopscotch, which is divided into, m) changes into the heart rate y (information of eartbeat interval n).In addition, t is the vibration timing for including in instruction distribution information Time.
As shown in Figure 19, firstly, the heart rate x before the judgement change of the playback control unit 326 or heart rate y after change Which bigger (S10).
For example, heart rate x before changing is greater than the heart rate y after changing (that is, the heartbeat after changing is slower) (x > y) In the case where, poor Δ and change between the vibration timing t and last heart time of the judgement instruction of playback control unit 326 Relationship (S11) between the interval m of the heartbeat of preceding heart rate x.
Poor Δ between vibration timing t and nearest heart time is equal to or more than the interval m of the heartbeat before change In the case where (that is, the interval of heartbeat is not shortened because of the change of heart rate) (Δ >=m), playback control unit 326 makes to reproduce single Member 327 vibrates (S21) in the vibration timing t of instruction.Meanwhile the poor Δ between vibration timing t and nearest heart time becomes In the case where interval m (that is, the interval of heartbeat is shortened because of the change of heart rate) (Δ < m) less than the heartbeat before change, reproduce Control unit 326 makes reproduction unit 327 in the Timing vibration postponed from the vibration timing t of instruction.Hereafter, playback control unit Heart rate is gradually changed into y (S22) from x by pre-determined number (about three times) by 326.
In addition, heart rate x and the heart rate y after changing before changing is identical (that is, heartbeat is before changing in S10 It is constant later) in the case where (x=y), the vibration timing t of the judgement instruction of playback control unit 326 and nearest heart time Between poor Δ and change after heart rate y heartbeat interval n between relationship (S12).
Vibration timing t and nearest heart time between poor Δ with change after the interval n of heartbeat it is different (that is, Heartbeat synchronization is lost) in the case where (Δ ≠ m), playback control unit 326 makes reproduction unit 327 in the vibration timing t with instruction Different Timing vibrations.Hereafter, heart rate is returned gradually to y by pre-determined number (about three times) by playback control unit 326 (S23).Meanwhile the poor Δ between vibration timing t and nearest heart time is identical as the interval n of heartbeat after changing In the case where (that is, synchronizing for heart rate is not lost) (Δ=m), playback control unit 326 makes reproduction unit 327 in the vibration of instruction Dynamic timing t vibration (S24).
In addition, heart rate x before changing is less than the heart rate y after changing (that is, the heartbeat after changing is more in S10 Poor Δ fastly) in the case where (x < y), between the vibration timing t and last heart time of the judgement instruction of playback control unit 326 Relationship (S13) between the interval n of the heartbeat of the heart rate y after change.
Poor Δ between vibration timing t and nearest heart time is equal to or more than the interval n of the heartbeat after changing In the case where (that is, the interval of heartbeat is not shortened because of the change of heart rate) (Δ >=n), playback control unit 326 makes to reproduce single Member 327 vibrates (S25) in the vibration timing t of instruction.Meanwhile the poor Δ between vibration timing t and nearest heart time becomes In the case where the interval n (that is, the interval of heartbeat is shortened because of the change of heart rate) (Δ < n) for obtaining the heartbeat being less than after changing, then Existing control unit 326 makes reproduction unit 327 in the Timing vibration postponed from the vibration timing t of instruction.Hereafter, playback control unit Heart rate is gradually changed into y (S26) from x by pre-determined number (about three times) by 326.
The vibration for controlling reproduction unit 327 by this judgement by playback control unit 326, can not provide footpath between fields Natural side's user oriented of raw sense conveys the heartbeat of distributor.
Herein, in the information processing system according to the present embodiment, other than vibration information, in distribution terminal 32A The voice messaging for locating the distributor collected may include in distribution information.
In this case, reproduction unit 327 can also include the voice-output device of such as loudspeaker and earphone etc. In this case, other than vibration information, reproducing terminal 32B can also be with reproducing speech information.
In addition, reproduction unit 327 may include the actuator that can reproduce both vibration and voice.It will be described with reference to Figure 20 This point.Figure 20 is the curve graph of the frequency band for being schematically illustrated voice and the frequency band of vibration.
Because voice is the vibration of air, the actuator for generating vibration can reproduce sound by making air vibration Sound.But as shown in Figure 20, although the frequency band of voice is about 200Hz to 40000Hz, the frequency band of vibration is about 0.1Hz to 500Hz, and frequency band mutual difference is very big.Therefore, reproduction unit 327 using single actuator reproduce vibration and In the case where voice the two, reproduction unit 327 is by that can reproduce broadband and can be with the frequency of the frequency band of reproducing speech and vibration Oscillation actuator with the two is constituted.
Herein, if including the voice messaging in distribution information, the voice reproduced using reproductions such as loudspeakers It is possible that the people etc. for being reproduced terminal surrounding listens to.It meanwhile including the vibration in distribution information using oscillation actuator reproduction In the case where dynamic information, the vibration of reproduction is only communicated to the user of wearing reproducing terminal 32B.Thus, for example, utilizing reproduction Terminal 32B is unable in the environment of reproducing speech information, and playback control unit 326, which can control reproduction unit 327 and only reproduce, includes Vibration information in distribution information is without reproducing speech information.
Specifically, the state in reproducing terminal 32B is arranged to mute state (that is, so-called politeness paradigm or peace and quiet Mode) in the case where, playback control unit 326 can control reproduction unit 327 only to reproduce including in distribution information Vibration information is without reproducing speech information.In this case, user can not have other people to know distribution letter around user Perception distribution information in the case where breath.
In addition, in the case where reproduction unit 327 reproduces vibration and voice using single actuator, playback control unit 326 can control reproduction unit 327, so as not to reproduce the frequency (such as, for example, 300Hz) for being equal to or higher than predetermined threshold.Cause It is equal to or higher than about 300Hz for the frequency of voice, and the frequency vibrated is less than 300Hz, so by being limited with this threshold value The frequency band for the distribution information that will be reproduced is made, reproduction unit 327 can only reproduce the vibration information in addition to voice messaging.
According to this control, for example, not reproduced such as in the case where distributor sends distribution information during running The statement of the distributor of " I is running now " etc, but the distribution caused by running only is reproduced at reproducing terminal 32B The heartbeat and vibration of person.
In addition, playback control unit 326 can be controlled based on specific gesture motion voice messaging reproduction, reproduce Volume etc..This point will be described with reference to Figure 21.Figure 21 is the exemplary schematic diagram for illustrating the specific gesture motion of user.
Specifically, as shown in Figure 21, executing in user 50 makes reproducing terminal 32B close to the gesture of his/her ear In the case where movement, playback control unit 326 can be to be less than normal volume reproducing speech information.In this case, it uses Family can be perceived including the voice messaging and both vibration informations in distribution information, and other people without allowing around user know Road voice messaging and vibration information.
For example, at the reproducing terminal 32B that state is arranged to mute state, playback control unit 326 can only with Family 50, which executes, makes reproducing terminal 32B reproduce language to be less than normal volume in the case where the gesture motion of his/her ear Message breath.Make reproducing terminal 32B close to the gesture of his/her ear in addition, playback control unit 326 can be executed in user 50 To be less than normal volume reproducing speech information in the case where movement, and language can be reproduced with normal quantity in other cases Message breath.It should be noted that playback control unit 326 can be the case where detecting ear of the reproducing terminal 32B close to user It is lower to execute above-mentioned control, but regardless of reproducing terminal 32B shown in Figure 21 form and gesture motion how.
It should be noted that can use at reproducing terminal 32B provide such as proximity sensor, acceleration transducer and The sensor of gyro sensor etc detects the gesture motion of user.In addition, though executing these types to voice messaging Reproducing control, but reproducing control as described above is not executed to vibration information.For example, no matter such as reproducing terminal 32B How is the setting of mute state, gesture motion etc., can reproduce vibration information with equal intensity.
[operation of 2.3. information processing system]
It is described using specific example next with reference to Figure 22 and Figure 23 according to the information processing system of the present embodiment Operation.The operation example of information processing system described below according to the present embodiment is the wherein heartbeat of such as distributor and divides The performance (such as, for example, concert) of originator (such as idol) is distributed to the operation example of reproducing terminal 32B in phase.
(the first operation example)
Reference Figure 22 is described to the first operation example of the information processing system according to the present embodiment first.Figure 22 is diagram According to the sequence chart of the first operation example of the information processing system of the present embodiment.It should be noted that the first operation example be Operation example in the case where the voice messaging of performance not being distributed to reproducing terminal 32B.
As shown in Figure 22, firstly, in the case where detecting that music starts at distribution terminal 32A (S301), distribution is eventually 32A is held to notify the beginning (S302) of music to netscape messaging server Netscape 12.It herein, can be at distribution terminal 32A or information The beginning of automatic detection music at device 20A is managed, or the beginning of music can be detected by the input of distributor etc..So Afterwards, beginning (S303) of the netscape messaging server Netscape 12 to information processing unit 20B notice music, and information processing unit 20B Start to reproduce the music (S304) for notifying it to start.It should be noted that being believed by the voice of the information processing unit 20B music reproduced Breath can store in information processing unit 20B, or can store in netscape messaging server Netscape 12, external server etc..
Meanwhile distribute the information (S401) for the heart rate that terminal 32A is obtained about distributor, and will acquire about heart rate Information is sent to netscape messaging server Netscape 12 (S402).Then, netscape messaging server Netscape 12 indicates that information processing unit 20B changes The heart rate to be reproduced (S403).Information processing unit 20B changes the heart rate (S404) to reproduce at reproducing terminal 32B, and Heart rate instruction reproducing terminal 32B vibration (S405) based on change.In this way, reproducing terminal 32B is based on carrying out self-information The vibration of processing unit 20B instructs and vibrates (S406).Therefore, information processing system can pass through (such as, example at a predetermined interval Such as, every five seconds) heartbeat of distributor is communicated to user by the operation that repeats above-mentioned S401 to S406.
In addition, distribute detect that music terminates at terminal 32A in the case where (S305), distribution terminal 32A is at information Manage the end (S306) that server 12 notifies music.It should be noted that can be in distribution terminal 32A or information processing unit 20A The end of the automatic detection music in place, or the end of music can be detected by input of distributor etc..Then, information processing End (S307) of the server 12 to information processing unit 20B notice music, and information processing unit 20B completion carries out it The reproduction (S308) of the music of notice.In this case, in the case where the intermediate completion of music reproduces, information processing unit 20B can complete the reproduction of music by fading out.
Herein, distribute detect the beginning of next music at terminal 32A in the case where, information processing system can be with By the way that the heartbeat of distributor is distributed to again in phase back to the processing of S301 and the above-mentioned sequence of repetition and the performance of distributor Existing terminal 32B.According to the information processing system according to the present embodiment, the user on the ground that can make to be absent from the scene experiences distribution in a pseudo manner The performance of person.
(the second operation example)
Next with reference to Figure 23 description according to the second operation example of the information processing system of the present embodiment.Figure 23 is figure Show the sequence chart of the second operation example of the information processing system according to the present embodiment.It should be noted that the second operation example is Operation example in the case where the voice messaging of performance is distributed to reproducing terminal 32B.
As shown in Figure 23, firstly, starting the live language from the distribution of netscape messaging server Netscape 12 as the performance of distributor Sound (S311), and information processing unit 20B starts to reproduce the Live voice (S312) of distribution.Live voice, which can be, to be distributed The voice collected at terminal 32A, or can be the voice that microphone of offer etc. is collected at the place for holding performance.
Meanwhile distribute the information (S401) for the heart rate that terminal 32A is obtained about distributor, and will acquire about heart rate Information is sent to netscape messaging server Netscape 12 (S402).Then, netscape messaging server Netscape 12 indicates that information processing unit 20B changes The heart rate to be reproduced (S403).Information processing unit 20B changes the heart rate (S404) to reproduce at reproducing terminal 32B, and Heart rate instruction reproducing terminal 32B vibration (S405) based on change.In this way, reproducing terminal 32B is based on carrying out self-information The vibration of processing unit 20B instructs and vibrates (S406).Therefore, information processing system can pass through (such as, example at a predetermined interval Such as, every five seconds) heartbeat of distributor is communicated to user by the operation that repeats above-mentioned S401 to S406.
In addition, in the case where completing the distribution of the Live voice from netscape messaging server Netscape 12 (S314), at information Manage the reproduction (S315) that device 20B completes Live voice.Herein, information processing unit 20B can be based in Live voice The heart rate of received distributor executes control (S313) during reproduction.For example, information processing unit 20B can execute control, So that the heart rate with distributor becomes larger, the volume of the music of Yao Zaixian becomes larger.
It should be noted that in both above-mentioned first operation example and the second operation example, in addition to (all at a predetermined interval Such as, for example, 30 seconds) it is sent except distribution information to information processing unit 20B or reproducing terminal 32B, netscape messaging server Netscape 12 The distributor that such as idol etc can also be sent holds the image in the place of performance (such as, for example, concert place).According to This, can make not experience distributor in depth in a pseudo manner in the user in performance place according to the information processing system of the present embodiment Performance.
In addition, the voice of distributor can be replaced the heartbeat of distributor as vibration information point by netscape messaging server Netscape 12 Issue reproducing terminal 32B.For example, the voice sung of distributor can be distributed to reproducing terminal 32B in performance, and can be with It is reproduced at reproducing terminal 32B as vibration.Accordingly, can be made not according to the information processing system of the present embodiment in performance place User in a pseudo manner in depth experience distributor performance.
[2.4. modified example]
Although the information processing system according to the present embodiment is described above, for according to sheet as described below The information processing system of embodiment may exist various other modified examples.
(storing vibration information in the medium)
The distribution information distributed in the information processing system according to the present embodiment can be made to be stored in storage medium etc.. In this case, vibration information is stored in the channel being provided separately with voice messaging.
For example, it is also possible to be changed by such as will wherein can store one of channel of 5.1 channel formats of voice etc For the channel for storing vibration information, and makes to distribute information using the format and be stored in a storage medium.Matched according to such It sets, by reproducing the distribution information that is stored in a storage medium, heartbeat or sense of touch and the distributor of distributor can be experienced The image and voice of performance.
In addition, the heartbeat of each distributor or the information of sense of touch can be with distributions there are multiple distributors The voice messaging and image information of the performance of person are collectively stored in storage medium.In the information that reproduction is stored in a storage medium In the case where, for example, the heartbeat or sense of touch of the distributor about appearing in image information can be reproduced together with image information Information, or the heartbeat about the distributor specified by user or the information of sense of touch can be reproduced.
(coordination with other application)
It can be (all with external information processing server or external application according to the information processing system of the present embodiment Such as, for example, SNS) operation is executed in phase.
For example, basis can be gone up the distribution issued in external SNS etc. in the information processing system according to the present embodiment The vibration of the text message of person is sent to reproducing terminal 32B.Specifically, the use of onomatopoeia database extraction including distributor's Onomatopoeia in text message, and reproducing terminal 32B can be sent by vibration information corresponding with the onomatopoeia extracted. In addition, executing text analyzing by the text message to distributor, it can be determined from text message and experience attribute (such as, example Such as, happy, angry, sad, pleasant, positive and passive), and vibration information corresponding with determining impression attribute can be sent out It is sent to reproducing terminal 32B.In addition, the vibration information of the reacting dose of the text message to distributor according to publication on SNS etc. Reproducing terminal 32B can be sent to.Accordingly, information processing system can be handed between distributor and user more initiatively Mutually.
(utilization of distribution information)
It is sent to information processing unit 20B in addition, can be used according to the information processing system of the present embodiment or reproduces eventually The vibration information of 32B is held to provide service.
For example, coordinating in the information processing system according to the present embodiment with the reproducing music at information processing unit 20B Ground can reproduce vibration information corresponding with the music reproduced at reproducing terminal 32B.In addition, information processing unit 20B The voice messaging of the music reproduced can be converted to vibration information, and reproduce the vibration after converting at reproducing terminal 32B Dynamic information.In addition, in the case where reproducing terminal 32B or information processing unit 20B include the function as clock, reproducing terminal 32B can reproduce transmitted distribution information as notifying the alarm of time.In addition, being received in information processing unit 20B In the case where Email, notice, incoming call etc., reproducing terminal 32B can reproduce transmitted distribution information and be used as notifying Receive the alarm of Email, notice or incoming call.In this case, reproducing terminal 32B can be directed to each type of electricity The changes such as sub- mail, notice, the incoming call distribution information to be reproduced.Accordingly, user can utilize transmitted point in various ways Photos and sending messages.
(utilization at performance)
In addition, can be used for distributor (idol or artist) and user's (powder according to the information processing system of the present embodiment Silk) performance etc. (such as concert and fact) when interaction.Accordingly, information processing system can be carried out with user more initiatively Interaction.
Specifically, in the case where reproducing terminal 32B can identify gesture motion, it, can be with base at reproducing terminal 32B In whether executing specific gesture motion and control the reproduction of voice messaging or vibration information.For example, can control reproducing terminal 32B, so that only reproducing speech information or vibration information in the case where the movement that execution shakes the head and (also referred to as " rams ").In addition, It can control reproducing terminal 32B, so that as the movement degree (such as the frequency and degree for the movement shaken the head) shaken the head becomes larger, language The reproduced volume of message breath becomes larger.In addition, reproducing terminal 32B can measure the degree for the movement shaken the head at performance site, and And can be controlled to integrated value based on the degree measured change performance distribution information or content (song such as played Quantity).
In addition, at performance site, it can be according to the dividing such as specific vibration and voice etc of corresponding region in place Photos and sending messages are sent to reproducing terminal 32B.For example, control can be executed in the information processing system according to the present embodiment, so that Distribution information including specifically vibrating is sent to the reproducing terminal in region pointed by the distributor at performance site 32B.Although should be noted that can for example distribute the movement for detecting at terminal 32A and being indicated by distributor, can also make With other methods of such as image recognition etc come detection operation.
In addition, control can be executed in the information processing system according to the present embodiment, so that only having before performance Reproducing terminal 32B is sent by special distribution information in limit predetermined period.For example, can control information processing system, so that only Reproducing terminal 32B is sent by the voice messaging of the normal life of distributor or vibration information in limited predetermined period.
(modified example of distribution information)
Although the distribution information in the above description, distributed in the information processing system according to the present embodiment is set For the physical information depending on distributor, the vibration information of sense of touch or heartbeat is such as conveyed, but according to the skill of the disclosure Art is not limited to above-mentioned example.For example, the distribution information distributed in the information processing system according to the present embodiment can be including The content information of the various contents of such as music, image, mobile image and text etc.
<hardware configurations of 3. netscape messaging server Netscapes>
Then, reference Figure 24 is described to be matched according to the hardware of the netscape messaging server Netscape 10 of each embodiment of the disclosure It sets.Figure 24 is the exemplary block diagram for illustrating the hardware configuration of netscape messaging server Netscape 10 of each embodiment according to the disclosure. It should be noted that by the information processing that netscape messaging server Netscape 10 executes realized by the cooperation between software and hardware 's.
As shown in Figure 24, netscape messaging server Netscape 10 includes such as central processing unit (CPU) 601, read-only memory (ROM) 603, random access memory (RAM) 605, bridge 611, internal bus 607 and 609, interface 613, input equipment 615, output equipment 617, storage equipment 619, driver 621, connectivity port 623 and communication equipment 625.
CPU 601 is used as arithmetic processing unit and control equipment, and is controlled according to the program being stored on ROM 603 etc. The whole operation of netscape messaging server Netscape 10.ROM 603 stores the program and operating parameter that CPU 601 is used, and RAM 605 It is temporarily stored in program used in the execution of CPU 601, the parameter suitably changed in its execution etc..CPU 601 can be used Make such as distribution information receiving unit 120, distribution control unit 140, distribution information transmitting unit 150, response and unit 160 is provided With response transmission unit 170.
Those CPU 601, ROM 603 and RAM 605 are connected with each other via bridge 611, internal bus 607 and 609 etc.. In addition, CPU 601, ROM 603 and RAM 605 are also connected to input equipment 615, output equipment 617, storage via interface 613 Equipment 619, driver 621, connectivity port 623 and communication equipment 625.
Input equipment 615 for example to its input information input equipment (such as touch screen, keyboard, button, microphone, Switch or control-rod) and for generating input signal based on input from the user and input signal being output to CPU 601 Input control circuit constitute.
Output equipment 617 includes for example showing equipment (such as liquid crystal display, organic EL display apparatus and lamp) and sound Frequency output equipment (such as loudspeaker and earphone).For example, the image that display equipment display generates, and audio output apparatus is by audio Data etc. are converted to audio and export audio.
Storage equipment 619 is configured as the exemplary data storage device of the storage unit of netscape messaging server Netscape 10. Storage equipment 619 may include storage medium, for the storage equipment of storing data on a storage medium, for from storage medium Read the reading equipment of data, and the sweep equipment for deleting stored data.For example, storage equipment 619 can be used Make distribution information memory cell 130.
Driver 621 is the reader/writer for storage medium.The reading of driver 621 is stored in insertion driver Information on 621 movable storage medium (various CDs, semiconductor memory etc.), and information is output to RAM 605.In addition, driver 621 can write information into movable storage medium.
Connectivity port 623 be for example be configurable for connection external connection apparatus connectivity port (such as USB port or Optical audio terminal) connecting interface.
Communication equipment 625 is the communication interface such as the communication equipment for being configured as network 40 to be connected to.In addition, logical Letter equipment 625 can be with wired or wireless LAN or the communication for executing the cable communication hardware compatibility that wire cable communicates Equipment.Communication equipment 625 may be used as network connection unit 110.
<4. conclusion>
As described above, can provide will distribute information according to the information processing system according to each embodiment of the disclosure It is distributed to user and there is the system of the response to distribution information provided from user.Accordingly, information processing system can make The user that distribution information is distributed to has stronger impression and can shorten the psychological distance between distributor and user.
In addition, can also prepare in the hardware of such as CPU, ROM and RAM etc for taking another information processing The configuration phase of the netscape messaging server Netscape for device performance and the formation first or second embodiments above-mentioned according to the disclosure of being engaged in Deng function computer program.In addition, additionally providing the storage medium for storing computer program on it.
(one or more) preferred embodiment of the disclosure is described by reference to attached drawing above, but the present disclosure is not limited to upper State example.Those skilled in the art can find various changes and modifications within the scope of the appended claims, and should manage Solution, they will naturally fall into scope of the presently disclosed technology.
In addition, effect described in this specification is merely illustrative or illustrative effect, rather than it is restrictive. That is, together with said effect or replacing said effect, the description pair according to this specification may be implemented according to the technology of the disclosure In the clear other effects of those skilled in the art.
In addition, this technology can also configure as follows.
(1) a kind of reproducing terminal, comprising:
Reproduction unit is configured as reproducing distribution information;
Sensor unit is configured as the body action of detection user;And
Control unit is configured as being handled based on the body action detected at sensor unit and be believed about to distribution Breath provides the operation of response.
(2) reproducing terminal according to (1),
Wherein distribution information is the voice messaging issued by distributor.
(3) reproducing terminal according to (1) or (2),
Wherein response includes the evaluation to distribution information.
(4) reproducing terminal according to any one of (1) to (3),
Wherein response includes the voice messaging issued by user response in distribution information.
(5) reproducing terminal according to (3) or (4),
Wherein response further includes the information in the place about reproducing terminal.
(6) reproducing terminal according to any one of (1) to (5), further includes:
Speech control unit is guided, the output of control guidance voice messaging is configured as, guidance voice messaging notice is used Family distribution information is distributed.
(7) reproducing terminal according to (6),
Wherein distribution information be distribute from multiple distributors, and
Guidance voice messaging is the voice messaging that the distributor specified in the multiple distributor by user issues.
(8) reproducing terminal according to (7),
Wherein guidance speech control unit control guidance voice messaging, so that the distributor of distribution information draws with sending The distributor for leading voice messaging is different.
(9) reproducing terminal according to any one of (1) to (8),
Wherein reproducing terminal is worn on the body of user, and
Reproduction unit is based on whether dress reproducing terminal to control the reproduction of distribution information.
(10) reproducing terminal according to (9),
Wherein whether sensor unit detection reproducing terminal is worn.
(11) reproducing terminal according to (10),
Wherein reproducing terminal is worn on the head of user, and
Sensor unit detects the movement on the head of user.
(12) reproducing terminal according to (1),
Wherein distribution information is the sense of touch for conveying distributor or the vibration information of heartbeat.
(13) reproducing terminal according to (12),
Wherein vibration information include the heart rate about distributor information and about with heart rate start vibration timing Information.
(14) reproducing terminal according to (13),
Wherein vibration information is distributed with predetermined period.
(15) reproducing terminal according to any one of (12) to (14),
Wherein, other than vibration information, distribution information further includes the voice messaging issued by distributor.
(16) reproducing terminal according to (15),
Wherein, in the case where the state of reproducing terminal is arranged to mute state, reproduction unit only makes vibration information quilt It reproduces.
(17) reproducing terminal according to (16),
Wherein, in the case where detecting ear of the reproducing terminal close to user by sensor unit, reproduction unit makes Voice messaging is reproduced.
(18) reproducing terminal according to any one of (15) to (17),
Wherein vibration information and voice messaging are reproduced by same actuator.
(19) reproducing terminal according to any one of (15) to (18),
Wherein, in the case where distributor holds performance, distribution information includes holding the voice of the distributor of performance The voice messaging of information or distributor corresponding with performance, and the vibration information of the distributor synchronous with voice messaging.
(20) a kind of reproducting method, comprising:
Reproduce distribution information;
Detect the body action of user;And
By arithmetic processing unit based on the body action detected, handles and provide the operation of response about to distribution information.
Reference signs list
10,12 netscape messaging server Netscapes
20A information processing unit
20B information processing unit
30A, 32A distribute terminal
30B, 32B reproducing terminal
40 networks
110 network connection units
120 distribution information receiving units
130 distribution information memory cells
140 distribution control units
150 distribution information transmitting units
160 responses provide unit
161 voice recognition units
162 erroneous words processing units
163 erroneous words storage units
170 response transmission units
181 terminal management units
182 function restriction units
311 communication units
312 control units
313 voice reproduction units
314 distribution information acquisition units
315 microphone units
321 communication units
322 control units
323 voice reproduction units
324 guidance speech control units
325 sensor units
326 playback control units
327 reproduction units

Claims (20)

1. a kind of reproducing terminal, comprising:
Reproduction unit is configured as reproducing distribution information;
Sensor unit is configured as the body action of detection user;And
Control unit, is configured as being handled based on the body action detected at sensor unit and mentions about to distribution information For the operation of response.
2. reproducing terminal as described in claim 1,
Wherein the distribution information is the voice messaging issued by distributor.
3. reproducing terminal as described in claim 1,
Wherein the response bag includes the evaluation to distribution information.
4. reproducing terminal as described in claim 1,
Wherein the response bag includes the voice messaging issued by user response in distribution information.
5. reproducing terminal as claimed in claim 3,
Wherein the response further includes the information in the place about reproducing terminal.
6. reproducing terminal as described in claim 1, further includes:
Speech control unit is guided, the output of control guidance voice messaging is configured as, the guidance voice messaging notifies user Distribution information is distributed.
7. reproducing terminal as claimed in claim 6,
Wherein the distribution information be distribute from multiple distributors, and
The guidance voice messaging is the voice messaging that the distributor specified in the multiple distributor by user issues.
8. reproducing terminal as claimed in claim 7,
The wherein leading question sound control unit control guidance voice messaging, so that the distributor of distribution information draws with sending The distributor for leading voice messaging is different.
9. reproducing terminal as described in claim 1,
Wherein the reproducing terminal is worn on the body of user, and
The reproduction unit is based on whether dress reproducing terminal to control the reproduction of distribution information.
10. reproducing terminal as claimed in claim 9,
Wherein whether the sensor unit detection reproducing terminal is worn.
11. reproducing terminal as claimed in claim 10,
Wherein the reproducing terminal is worn on the head of user, and
The movement on the head of the sensor unit detection user.
12. reproducing terminal as described in claim 1,
Wherein the distribution information is the sense of touch for conveying distributor or the vibration information of heartbeat.
13. reproducing terminal as claimed in claim 12,
Wherein the vibration information include the heart rate about distributor information and about with heart rate start vibration timing Information.
14. reproducing terminal as claimed in claim 13,
Wherein the vibration information is distributed with predetermined period.
15. reproducing terminal as claimed in claim 12,
Wherein, other than the vibration information, the distribution information further includes the voice messaging issued by distributor.
16. reproducing terminal as claimed in claim 15,
Wherein, in the case where the state of the reproducing terminal is arranged to mute state, the reproduction unit only makes the vibration Dynamic information is reproduced.
17. reproducing terminal as claimed in claim 16,
Wherein, in the case where detecting ear of the reproducing terminal close to user by sensor unit, the reproduction unit makes Voice messaging is reproduced.
18. reproducing terminal as claimed in claim 15,
Wherein the vibration information and the voice messaging are reproduced by same actuator.
19. reproducing terminal as claimed in claim 15,
Wherein, in the case where distributor holds performance, the distribution information includes holding the voice of the distributor of performance The voice messaging of information or distributor corresponding with performance, and the vibration information of the distributor synchronous with voice messaging.
20. a kind of reproducting method, comprising:
Reproduce distribution information;
Detect the body action of user;And
By arithmetic processing unit based on the body action detected, handles and provide the operation of response about to distribution information.
CN201780062302.3A 2016-11-11 2017-11-02 Reproduction terminal and reproduction method Active CN109804358B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2016220425 2016-11-11
JP2016-220425 2016-11-11
PCT/JP2017/039684 WO2018088319A1 (en) 2016-11-11 2017-11-02 Reproduction terminal and reproduction method

Publications (2)

Publication Number Publication Date
CN109804358A true CN109804358A (en) 2019-05-24
CN109804358B CN109804358B (en) 2023-06-20

Family

ID=62109739

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780062302.3A Active CN109804358B (en) 2016-11-11 2017-11-02 Reproduction terminal and reproduction method

Country Status (5)

Country Link
US (1) US11298080B2 (en)
EP (1) EP3540603B1 (en)
JP (1) JPWO2018088319A1 (en)
CN (1) CN109804358B (en)
WO (1) WO2018088319A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7131077B2 (en) * 2018-05-24 2022-09-06 カシオ計算機株式会社 CONVERSATION DEVICE, ROBOT, CONVERSATION DEVICE CONTROL METHOD AND PROGRAM
JP7189434B2 (en) * 2019-01-11 2022-12-14 ダイキン工業株式会社 Spatial control system
JP6871964B2 (en) * 2019-03-29 2021-05-19 株式会社コロプラ Distribution program, distribution method, and information terminal device
WO2022264203A1 (en) * 2021-06-14 2022-12-22 三菱電機株式会社 Signal generation device, signal processing system, and signal generation method
WO2023032266A1 (en) 2021-09-03 2023-03-09 ソニーグループ株式会社 Information processing device, information processing method, and program

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020019584A1 (en) * 2000-03-01 2002-02-14 Schulze Arthur E. Wireless internet bio-telemetry monitoring system and interface
JP2006154087A (en) * 2004-11-26 2006-06-15 Yamaha Corp Musical piece data exchange format and mobile terminal device
JP2007148884A (en) * 2005-11-29 2007-06-14 Mitsubishi Electric Corp Portable content data reproduction device and restriction release method therefor
CN101601292A (en) * 2007-01-22 2009-12-09 索尼株式会社 Information processor, information processing method and program
US20140052751A1 (en) * 2012-08-15 2014-02-20 Microsoft Corporation Smart user-centric information aggregation
JP2014147030A (en) * 2013-01-30 2014-08-14 Dwango Co Ltd Voice distribution system and recording method
CN105493477A (en) * 2013-08-29 2016-04-13 索尼公司 Wristband-type information processing device, information processing system, information processing method, and program
CN105934262A (en) * 2013-12-20 2016-09-07 X米特里克斯运动有限公司 Wearable detector for the detection of parameters related to a physical activity
US20160269510A1 (en) * 2013-11-29 2016-09-15 Co-Growth Inc. Content evaluator, content evaluation system, server unit and terminal unit to evaluate content
JP2016178662A (en) * 2016-04-28 2016-10-06 ソニー株式会社 On-vehicle unit, information processing method, and information processing system

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6415257B1 (en) * 1999-08-26 2002-07-02 Matsushita Electric Industrial Co., Ltd. System for identifying and adapting a TV-user profile by means of speech technology
JP2001357191A (en) 2000-06-12 2001-12-26 Toshiba Corp Method and system for commercial message response research and storage medium stored with program
JP2003240582A (en) * 2002-02-15 2003-08-27 Mitsubishi Electric Corp Vehicle location displaying device and method of acquiring speech information
US20030159567A1 (en) * 2002-10-18 2003-08-28 Morton Subotnick Interactive music playback system utilizing gestures
JP5208362B2 (en) * 2005-10-28 2013-06-12 ソニー株式会社 Electronics
US20110298829A1 (en) * 2010-06-04 2011-12-08 Sony Computer Entertainment Inc. Selecting View Orientation in Portable Device via Image Analysis
US7725547B2 (en) * 2006-09-06 2010-05-25 International Business Machines Corporation Informing a user of gestures made by others out of the user's line of sight
JP2010044808A (en) * 2008-08-08 2010-02-25 Olympus Corp Data reproducing device
US8428053B2 (en) * 2009-02-26 2013-04-23 Plantronics, Inc. Presence based telephony call signaling
US20130033971A1 (en) * 2011-08-05 2013-02-07 Jeffrey Stier System and Method for Managing and Distributing Audio Recordings
US9823742B2 (en) * 2012-05-18 2017-11-21 Microsoft Technology Licensing, Llc Interaction and management of devices using gaze detection
JP6042109B2 (en) * 2012-06-21 2016-12-14 株式会社ナビタイムジャパン Portable terminal device, information processing system, information processing method, and information processing program
US10146316B2 (en) * 2012-10-31 2018-12-04 Nokia Technologies Oy Method and apparatus for disambiguating a plurality of targets
JP6622588B2 (en) * 2012-11-29 2019-12-18 チェイス, スティーヴンCHASE, Stephen Video headphones, systems, platforms, methods, equipment, and media
WO2015166573A1 (en) * 2014-05-01 2015-11-05 貴弘 市橋 Live broadcast system
US11076763B2 (en) * 2014-10-15 2021-08-03 Atlasense Biomed Ltd. Remote physiological monitor
US20160330258A1 (en) 2015-05-08 2016-11-10 Charanjit Singh Sandhu Broadcasts among electronic devices of registered users via internet protocol

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020019584A1 (en) * 2000-03-01 2002-02-14 Schulze Arthur E. Wireless internet bio-telemetry monitoring system and interface
JP2006154087A (en) * 2004-11-26 2006-06-15 Yamaha Corp Musical piece data exchange format and mobile terminal device
JP2007148884A (en) * 2005-11-29 2007-06-14 Mitsubishi Electric Corp Portable content data reproduction device and restriction release method therefor
CN101601292A (en) * 2007-01-22 2009-12-09 索尼株式会社 Information processor, information processing method and program
US20140052751A1 (en) * 2012-08-15 2014-02-20 Microsoft Corporation Smart user-centric information aggregation
JP2014147030A (en) * 2013-01-30 2014-08-14 Dwango Co Ltd Voice distribution system and recording method
CN105493477A (en) * 2013-08-29 2016-04-13 索尼公司 Wristband-type information processing device, information processing system, information processing method, and program
US20160269510A1 (en) * 2013-11-29 2016-09-15 Co-Growth Inc. Content evaluator, content evaluation system, server unit and terminal unit to evaluate content
CN105934262A (en) * 2013-12-20 2016-09-07 X米特里克斯运动有限公司 Wearable detector for the detection of parameters related to a physical activity
JP2016178662A (en) * 2016-04-28 2016-10-06 ソニー株式会社 On-vehicle unit, information processing method, and information processing system

Also Published As

Publication number Publication date
EP3540603A4 (en) 2019-09-25
JPWO2018088319A1 (en) 2019-10-03
US11298080B2 (en) 2022-04-12
EP3540603A1 (en) 2019-09-18
EP3540603B1 (en) 2021-02-17
WO2018088319A1 (en) 2018-05-17
US20190223798A1 (en) 2019-07-25
CN109804358B (en) 2023-06-20

Similar Documents

Publication Publication Date Title
CN109804358A (en) Reproducing terminal and reproducting method
CN105379234B (en) For providing the application gateway for being directed to the different user interface of limited dispersion attention scene and untethered dispersion attention scene
CN106415721B (en) The coordination switching of audio data transmission
CN110024030A (en) Context aware hearing optimizes engine
CN105373464B (en) The charging reminding method and device of wearable device
CN102017585B (en) Method and system for notification and telecommunications management
CN109493849A (en) Voice awakening method, device and electronic equipment
CN106464571A (en) Coordination of message alert presentations across devices based on device modes
CN109243444A (en) Voice interactive method, equipment and computer readable storage medium
CN104133851A (en) Audio similarity detecting method, audio similarity detecting device and electronic equipment
CN109814952A (en) A kind of application interface quickly starting control processing method, device and mobile terminal
KR20180126474A (en) System, terminal device, method and recording medium
CN104200353B (en) A kind of information processing method and electronic equipment
CN106303018A (en) A kind of alarm clock control method and terminal
CN110430475A (en) A kind of interactive approach and relevant apparatus
CN110460721A (en) A kind of starting method, device and mobile terminal
CN106777115A (en) Song processing method and processing device
CN110493635A (en) Video broadcasting method, device and terminal
CN114008610A (en) Information processing system, information processing method, and recording medium
CN108476479A (en) Accidental access method and device, user equipment and computer readable storage medium
CN106462382B (en) More wave audio interface systems
JP2015185019A (en) External connection device of information communication device and program for external connection device of information communication device
CN101888439A (en) Cartoon image integrated display-based mobile phone device and method thereof
CN107027340A (en) Wearable electronic system
JP7294506B2 (en) VOICE MESSAGE SYSTEM, SERVER DEVICE, INFORMATION PROCESSING METHOD, AND PROGRAM

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant