CN105898487B - A kind of exchange method and device towards intelligent robot - Google Patents
A kind of exchange method and device towards intelligent robot Download PDFInfo
- Publication number
- CN105898487B CN105898487B CN201610272955.1A CN201610272955A CN105898487B CN 105898487 B CN105898487 B CN 105898487B CN 201610272955 A CN201610272955 A CN 201610272955A CN 105898487 B CN105898487 B CN 105898487B
- Authority
- CN
- China
- Prior art keywords
- information
- interbehavior
- user
- intelligent robot
- interaction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42201—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
- H04N21/4758—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data for providing answers, e.g. voting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/47815—Electronic shopping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for program selection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for program selection
- H04N21/4826—End-user interface for program selection using recommendation lists, e.g. of programs or channels sorted out according to their score
Abstract
The invention discloses a kind of television interaction method and device towards intelligent robot, belong to robotic technology field, solve that traditional TV interactive mode user experience is low and the single technical problem of mode.This method comprises: obtaining multi-modal input information and TV related data；The multi-modal input information is analyzed, the TV interbehavior triggering command for being directed to active user is obtained；According to the TV interbehavior triggering command and the TV related data, generates corresponding TV interbehavior multi-modal data and export.
Description
Technical field
The present invention relates to robotic technology fields, specifically, are related to a kind of TV interaction side towards intelligent robot
Method and device.
Background technique
With the continuous development of information technology, computer technology and artificial intelligence technology, intelligent robot has been entered into
It lives closely bound up field to medical treatment, health care, family, amusement and service industry etc. and people.People are for intelligence machine
The requirement of people is also higher and higher, and intelligent robot is needed to have more functions to provide more helps for human lives.
Currently, there is no intelligent robot exchange methods relevant to TV.
Summary of the invention
The purpose of the present invention is to provide a kind of exchange method and system towards intelligent robot, with the traditional of solution
TV interactive mode user experience is low and the single technical problem of mode.
The present invention provides a kind of exchange method towards intelligent robot, this method comprises:
Obtain multi-modal input information and TV related data；
The multi-modal input information is analyzed, the TV interbehavior triggering command for being directed to active user is obtained；
According to the TV interbehavior triggering command and the TV related data, corresponding TV interaction is generated
Behavior multi-modal data simultaneously exports.
Exchange method provided by the invention towards intelligent robot, further includes:
The multi-modal input information and the TV related data are analyzed, the TV interaction row towards active user is obtained
For active triggering command；
When determination needs to recommend TV interbehavior, the multi-modal data of TV interaction demand inquiry and output are generated.
Include: in the step of obtaining the TV interbehavior triggering command of active user
According to the analysis multi-modal input information as a result, confirmation subscriber identity information and current interaction scenarios information；
Corresponding TV viewing habits information is obtained according to user identity.
The TV related data includes one of following or combination: list of television programmes information, current program content information, electricity
Depending on the interaction platform link information of program, dancing synchronizing information, song synchronizing information, TV programme background information, shopping program
Merchandise news and shopping platform link information.
The present invention also provides a kind of interactive device towards intelligent robot, which includes:
Information acquisition unit is used to obtain multi-modal input information and TV related data；
First trigger unit is used to analyze the multi-modal input information, obtains the TV interaction for active user
Behavior triggering command；
First interaction output unit is used for related according to the TV interbehavior triggering command and the TV
Data generate corresponding TV interbehavior multi-modal data and export.
Interactive device provided by the invention towards intelligent robot, further includes:
Second trigger unit, is used to analyze the multi-modal input information and the TV related data, obtain towards
The TV interbehavior active triggering command of active user；
Second interacts output unit, is used to generate TV interaction demand when determination needs to recommend TV interbehavior
The multi-modal data of inquiry and output.
First trigger unit includes:
Analysis module is inputted, is used for according to the analysis multi-modal input information as a result, confirmation subscriber identity information
And current interaction scenarios information；
Habits information obtains module, is used to obtain corresponding TV viewing habits information according to user identity.
The TV related data includes one of following or combination: list of television programmes information, current program content information, electricity
Depending on the interaction platform link information of program, dancing synchronizing information, song synchronizing information, TV programme background information, shopping program
Merchandise news and shopping platform link information.The exchange method towards intelligent robot that there is provided through the embodiment of the present invention and
Device, intelligent robot can carry out interacting activity relevant with TV to user under tv scene, realize user, intelligent machine
The tripartite coalition of device people and TV interacts.Based on exchange method provided by the invention and device, intelligent robot is according to acquisition
TV related data can provide a user the interactive services such as prompting, memorandum and the advance notice of TV programme before televising,
The interactive service about the programme content in broadcasting can be provided a user in televising, and it is mutual with TV programme to build user
Dynamic bridge is realized user easily by intelligent robot and is interacted with TV programme, and broadcasts in TV programme
It can be provided a user after putting about interactive services such as investigation, the playback for having broadcast program.
Also, intelligent robot is interacted and can actively be touched according to the instruction of user or by intelligent robot with what user carried out
Hair, the appropriate opportunity before television broadcasting, in broadcast and after broadcasting issue the user with the interaction demand inquiry about TV, are
User provides the apt interactive service closer to human nature.At the same time, exchange method provided by the invention and dress are based on
It sets, intelligent robot carries out different mutual-action behaviors for the different viewing television habits of different user, for each user
Using features such as its interest, hobbies about TV as the foundation of mutual-action behavior, customized interaction is provided for each user
Behavior, to become the intimate partner and assistant of user.
The exchange method provided through the invention, intelligent robot, will more before television broadcasting, in broadcast and after broadcasting
Colourful, more deep TV interactive mode takes user at one's side, forms the comfortable man-machine interaction experience of nature, significantly
Improve the user experience of robot.Other features and advantages of the present invention will be illustrated in the following description, also, part
As will become apparent from the description, or understand through the implementation of the invention.The objectives and other advantages of the invention can lead to
Structure specifically noted in the specification, claims and drawings is crossed to be achieved and obtained.
Detailed description of the invention
It, below will be to required in embodiment description for the clearer technical solution illustrated in the embodiment of the present invention
Attached drawing does simple introduction:
Fig. 1 is the flow chart of the exchange method provided in an embodiment of the present invention towards intelligent robot；
Fig. 2 is the flow chart of the exchange method provided in an embodiment of the present invention towards intelligent robot；
Fig. 3 is the flow diagram provided in an embodiment of the present invention for obtaining TV interbehavior active triggering command；
Fig. 4 is the schematic diagram of the interactive device provided in an embodiment of the present invention towards intelligent robot.
Specific embodiment
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings and examples, how to apply to the present invention whereby
Technological means solves technical problem, and the realization process for reaching technical effect can fully understand and implement.It needs to illustrate
As long as not constituting conflict, each feature in each embodiment and each embodiment in the present invention can be combined with each other,
It is within the scope of the present invention to be formed by technical solution.
The embodiment of the present invention provides a kind of exchange method towards intelligent robot, as shown in Figure 1, the method comprising the steps of
101 to step 103.Step 101 is first carried out, obtains multi-modal input information and TV related data.Acquired multimode
State input information includes that external environment voice, vision and induction input information, including: the input of user indicates information,
Such as voice instruction, movement instruction, text instruction；The status information of user, movement and characteristic information such as user；The shape of TV
State information, such as the image and sound of TV；And other information relevant to user, TV and current interactive environment.
In invention, acquired TV related data includes but is not limited to one of following or combination: TV in this step
Program table information, current program content information, the interaction platform link information of TV programme, dancing synchronizing information, song are synchronous
Information, TV programme background information, shopping program merchandise news and shopping platform link information etc. and TV interbehavior
Relevant information.
Above-mentioned TV related data will be further explained and described in embodiments of the invention.It is right
It can be downloaded and be obtained by network in above-mentioned TV related data, obtained from smart television by smart home system, and
Other data acquiring modes based on intelligent robot.
Then, step 102 is executed, acquired multi-modal input information is analyzed, to obtain the electricity for being directed to active user
Depending on interbehavior triggering command.For active user TV interbehavior triggering command for triggering intelligent robot and current
The TV interbehavior of user, and triggered interbehavior mode is described, it is raw when being that user's instruction needs to carry out TV interaction
At triggering command.
In this step, multi-modal input information is analyzed, therefrom isolates the TV friendship about active user
The information that mutual behavior is intended to is intended to the matched TV interbehavior mode of institute to analyze acquisition and correspond to active user's interaction.
Such as whether wanted and intelligence according to the instruction of the voice of active user, movement instruction or text instruction input information analysis active user
Robot carries out TV interbehavior, and wants to carry out the TV interbehavior of what mode, and then obtain the associative mode
TV interbehavior triggering command.For example, if active user wants to check the TV guide of today by voice instruction,
By analyzing the multi-modal input acquisition of information indicated containing the voice to the interaction row to active user's display of television programmes list
For triggering command.
In above embodiment of the invention, the intelligent machine that can be triggered according to the multi-modal input information of active user
The TV interbehavior mode of device people includes but is not limited to following several: formulating the memorandum of viewing TV for user, assists user
Televised quiz or ballot are carried out, performance is synchronized according to content of TV program, the interactive voice about content of TV program is asked
It answers, user is assisted to carry out TV shopping, recommend TV programme to user, synchronize performance with TV programme.
Finally, executing step 103, according to TV interbehavior triggering command and TV related data, generate corresponding
TV interbehavior multi-modal data simultaneously exports.In this step, intelligence machine is triggered by TV interbehavior triggering command
The correspondence TV interbehavior mode of people, and the interaction content of this kind of mode is provided by acquired TV related data, into
And generate and export the TV interbehavior of the multi-modal data realization and active user of corresponding modes and content.For example, if
The interbehavior mode for the interbehavior triggering command triggering display of television programmes list that intelligent robot is got, and then will be obtained
The TV programme forms data got is shown by the multi-modal way of output such as image.
The exchange method towards intelligent robot provided through the embodiment of the present invention, user can pass through intelligent robot
Realize with the interaction of TV, intelligent robot can by the multi-modal input triggering interbehavior relevant to TV of user,
And the TV related data based on acquisition realizes the tripartite coalition interaction of user, intelligent robot and TV, it can be according to user
Demand provide a variety of services relevant to TV for user, assist user and TV programme progress deeper into interact.
More specifically, the TV viewing habits information and current interaction of active user are obtained according to multi-modal input data
Scene information.Firstly, according to the multi-modal input information of analysis as a result, confirmation subscriber identity information and current interaction scenarios are believed
Breath.It can be by analyzing the acoustic information or facial image information of multi-modal input information acquisition user, and correspond to and carry out vocal print knowledge
Other or recognition of face, and then match and obtain current user identities information.It can also be related by analyzing multi-modal input information acquisition
The information of user and tv state are identified and analyzed and obtain matched current interaction scenarios information.Then, according to user's body
Part obtains corresponding TV viewing habits information, and then combines TV viewing habits information and current interaction scenarios in step 103
Information generates the multi-modal data of corresponding TV interbehavior mode and output.
TV viewing habits information be used for describe individual subscriber viewing TV programme habit and taste, as like see it is assorted
The TV programme (news practical work, service for life, variety entertainment etc.) of type, habit see TV etc. at what time.Due to not
Same user often has different TV viewing habits, and parent and child have the interest of TV programme in one family
Institute is different, and male and female are also different for the interest of TV programme, and people often can only watch oneself interested section
Mesh, therefore, it is necessary to the different viewing television habits for different user to carry out different interbehaviors, friendship provided by the invention
Mutual method identifies the identity of user and current interactive environment, and the habit of user viewing TV is obtained for the identity of user
It is used, it is then based on the viewing habit of user and carries out corresponding interbehavior in different interactive environments.For example, user is to intelligence
Robot inquiry is said: " now with good-looking TV programme? ", intelligent robot identification user, which is intended to be matched to user, to be recommended
The interbehavior mode of program, while intelligent robot identifies that the habit for the viewing TV that user identity obtains the user (is liked
Watch animated films), be output by voice by from the list of television programmes of acquisition the channel that is playing cartoon and cartoon
Information (such as title collects number, plot outline etc.) recommends user, or knows that active user is not seeing according to current interactive environment
Then TV automatically opens television set by smart home system, TV is adjusted to the channel of playing animation piece.
Further, the exchange method provided in an embodiment of the present invention towards intelligent robot, as shown in Fig. 2, further including
Following steps 201 to 204.Wherein, in step 201, the multi-modal input information and the TV related data are analyzed, is obtained
Take the TV interbehavior active triggering command towards active user.Actively triggering refers to TV interbehavior towards active user
It enables for triggering the instruction for not needing active user, the interbehavior with active user that can be actively initiated by intelligent robot,
And triggered interbehavior mode and interbehavior content are described.
In one embodiment, this step can be specially first to TV related data and multi-modal input information into
Row analysis, determines whether there is the interbehavior mode that can actively trigger based on the analysis results.For example, current television program is
It is scanned two dimensional code and participates in movable interaction link, intelligent robot can be analyzed from multi-modal input information obtains TV
Picture image, and two-dimensional barcode information therein is obtained by carrying out image recognition to television picture image, know current television section
Mesh is being scanned the interaction link of two dimensional code, so that it is determined that can the movable interactive row of active driver sweep two dimensional code participation
For；Or TV announcer says: " be scanned below two dimensional code participation activity interaction link ", intelligent robot can be from
Analysis obtains the acoustic information of TV in multi-modal input information, and identifies that TV programme will be swept by semantic parsing
The interaction of two dimensional code is retouched, so that it is determined that can the movable interbehavior of active driver sweep two dimensional code participation；Or intelligent machine
Device people obtains current program content data from network, and analyzes and identify that current television program is being scanned the mutual of two dimensional code
It is dynamic, so that it is determined that can the movable interbehavior of active driver sweep two dimensional code participation.
Likewise, as shown in Figures 2 and 3, in step 201 further including obtaining to work as in one embodiment of the invention
The TV viewing habits information of preceding user and current interaction scenarios information.The multi-modal input information is analyzed in step 201
And the TV related data, the TV interbehavior that determination can be triggered actively, and according to the knot for analyzing multi-modal input information
Fruit confirms subscriber identity information and current interaction scenarios information, then obtains corresponding TV viewing habits letter according to user identity
Breath.And then the TV interbehavior that can actively trigger is combined, current interaction scenarios information and TV viewing habits letter
Breath obtains the TV interbehavior active triggering command towards active user, i.e., whether comprehensive four interact behavior pattern
What can actively be triggered considers.
For example, knowing currently there is channel to be playing animation in the list of television programmes information that intelligent robot analysis obtains
Piece, identification user identity obtains the habit (liking watching animated films) of the viewing TV of the user, so that it is determined that can actively trigger
Recommend the interbehavior of cartoon being played on to user.For another example, intelligent robot is identified by multi-modal input information
Current television program is being scanned the interaction of two dimensional code, but is known according to the TV viewing habits information of active user and worked as
Preceding user does not like the activity for participating in the type, it is determined that there is no the interbehaviors that can actively trigger.
After determining the interbehavior mode that exists and can actively trigger, active user's shape is determined according to multi-modal input information
State obtains the action message of active user, face if appropriate for behavior is interacted, by carrying out analysis to multi-modal input information
Portion's information, location information and other can be used for judging the environmental information of current user state, above- mentioned information are integrated
Analysis identification, judges current user state if appropriate for interacting behavior.If current user state is appropriate for interbehavior,
Obtain the active triggering command of above-mentioned corresponding TV interbehavior.If current user state is not suitable for interacting behavior, for example,
Know that user is in sleep state by identification user's face information, acoustic information and action message, is not suitable for interacting row
For the then acquisition without the active triggering command of TV interbehavior.
Then, in step 202, determine the need for pushing away to active user according to active TV interbehavior triggering command
TV interbehavior is recommended, for the judgement whether recommended to active user based on the current television interbehavior master to acquisition
It is obtained included in dynamic triggering command about the analysis of TV interbehavior mode and current interaction scenarios information.For example,
It analyzes current active triggering command and learns that current television interbehavior mode is to scan the two-dimensional code participation activity, current interaction field
Scape is that user just watches TV before television set, is determined based on above-mentioned condition and needs to recommend this to scan the two-dimensional code ginseng to active user
With movable TV interbehavior.
203 are thened follow the steps when determination needs to recommend TV interbehavior based on judging result, generates TV interaction
Demand inquiry multi-modal data and output.For example, corresponding based on the movable interbehavior schema creation of participation is scanned the two-dimensional code
Voice demand inquire output: " owner, it is desirable to scan the two-dimensional code participation interaction? ", user answers "Yes", then generate with it is current
User is scanned multi-modal data and the output that two dimensional code participates in the interbehavior interacted.When determining do not need that TV is recommended to hand over
When mutual behavior, 204 are thened follow the steps, correspondence is directly generated according to interbehavior mode and content described in active triggering command
With active user carry out TV interbehavior multi-modal data and output.For example, when occurring dancing in TV programme, and
And User Status is to watch TV, it may not be necessary to be inquired, directly export the interaction data danced with television synchronous.
Below with reference to specific TV interbehavior mode in the following embodiments to it is provided in an embodiment of the present invention towards
The exchange method of intelligent robot is further detailed.
Embodiment one:
In the present embodiment, TV interbehavior mode is instant question and answer or ballot.This kind of TV interbehavior mode
Triggering mode can be passive triggering mode, be also possible to active triggering mode.
Passive triggering mode, that is, user indicates this kind of TV interbehavior mode of triggering, and exports corresponding multi-modal TV and hand over
Mutual data.User when wanting to interact, intelligent robot is said or by text input: " I to participate in question and answer (or throw
Ticket) ".Intelligent robot obtains multi-modal input information and TV related data, analyzes multi-modal input information, obtains
It takes the voice instruction of wherein user or text to indicate information and carries out identification and learn that user's is intended to participate in question and answer (or ballot),
And then get the interbehavior mode triggering command for participating in question and answer (or ballot).
Active triggering mode, that is, intelligent robot actively triggers this kind according to multi-modal input information and TV related data
TV interbehavior mode, and export corresponding multi-modal TV interaction data.Intelligent robot passes through to multi-modal input information
It is analyzed, wherein television picture image information and sound of television information is obtained, to television picture image information or TV sound
Message breath carries out analysis identification, if showing in television image, current television is carrying out the text or TV of question and answer (or ballot)
Have host to say in sound: " carrying out question and answer (or ballot) now ", intelligent robot can recognize, and know current television
Program is carrying out question and answer (or ballot).At the same time, intelligent robot identifies current user identities, matched by analyzing
TV viewing habits information know that active user has the habit of participation question and answer (or ballot), so that it is determined that progress can be triggered actively
The interbehavior mode of question and answer (or ballot).
Intelligent robot can also obtain this kind of TV interbehavior mode by carrying out analysis to TV related data
Active triggering command.It in the present embodiment, include the content information of TV programme, the interaction of TV programme in TV related data
Platform link information.The content information of TV programme includes the flow content of TV programme, i.e., TV programme at what time into
Row is what link.The interaction platform link information of TV programme passes through network connection to the TV programme for intelligent robot
The transmission of interaction platform progress interactive information.Intelligent robot can be analyzed by the content information to TV programme, be obtained
Know that current point in time TV programme are carrying out question and answer (or ballot).And then determine currently can actively trigger carry out question and answer (or throw
Ticket) interbehavior mode.
Then, intelligent robot passes through (current to use about current user state to analyzing in multi-modal input information
TV is being watched at family) information judge that the state of active user is appropriate for the interbehavior mode of question and answer (or ballot), into
And get the interbehavior mode active triggering command for participating in question and answer (or ballot).Determine actively triggering participate in question and answer (or
Ballot) interbehavior mode after, judge that the interbehavior mode needs to recommend to active user.
Finally, passive triggering instruction and TV phase of the intelligent robot according to the interbehavior mode of question and answer (or ballot)
Data are closed, corresponding question and answer (or ballot) interbehavior multi-modal data is generated and are exported.Or the friendship according to question and answer (or ballot)
The active triggering command of mutual behavior pattern generates the multi-modal data of question and answer (or ballot) demand inquiry and output, logical in user
After crossing multi-modal instruction information representation affirmative wish, corresponding question and answer (or ballot) interbehavior multi-modal data and defeated is generated
Out.In this kind of interbehavior mode, intelligent robot obtains user for question and answer (or ballot) by multi-modal output information
Answer (or selection) as a result, and the interaction platform that (or selection) result data is sent to TV programme will be answered, to will return
(or selection) result is answered to return in TV programme.
Embodiment two:
In the present embodiment, TV interbehavior mode is to synchronize performance according to content of TV program.This kind of TV
The triggering mode of interbehavior mode can be passive triggering mode or active triggering mode.
The passive triggering mode of this kind of TV interbehavior mode is basically the same as the first embodiment, and details are not described herein.Its
Active triggering mode towards TV is specially that intelligent robot is actively touched according to multi-modal input information and TV related data
Root of hair synchronizes the TV interbehavior mode of performance according to content of TV program, and exports corresponding multi-modal TV interaction number
According to.
Intelligent robot obtains wherein television picture image information and TV by analyzing multi-modal input information
Acoustic information carries out analysis identification to television picture image information or sound of television information, if carrying out in television image
It dances and performs, intelligent robot can recognize, and determination can actively trigger the interbehavior mode for synchronizing performance of dancing.
If there is the sound of singing songs to occur in sound of television, intelligent robot can be recognized, and determination can actively trigger progress together
The interbehavior mode of step singing performance.
It in the present embodiment, include the content information of TV programme in TV related data, dancing synchronizing information, song is same
Walk information.It is the same as example 1, intelligent robot can be analyzed by the content information to TV programme, be known current
Time point TV programme are carrying out dancing or singing sow, and then determination currently can actively trigger the interaction for synchronizing performance
Behavior pattern.Dancing synchronizing information is the dance movement and the synchrodata at time point in actual program, and song synchronizing information is
The synchrodata of acoustic information (tone, pitch, tone color etc.) and time point of the song in actual program.
Then, determine current exchange scenario if appropriate for carrying out above-mentioned dancing or singing according to multi-modal input information
Synchronous performance interbehavior.It whether there is user in current exchange scenario by analyze and determine to multi-modal input information,
The current state of existing user synchronizes the interbehavior of the TV of performance if appropriate for intelligent robot.Use if it exists
The current state at family is suitble to intelligent robot to synchronize performance, then it is assumed that current exchange scenario be appropriate for above-mentioned dancing or
The synchronous performance interbehavior of singing, the current state of user if it exists are not suitable for intelligent robot and synchronize performance, then
Think that current exchange scenario is not suitable for carrying out the synchronous performance interbehavior of above-mentioned dancing or singing.
The active triggering command of above-mentioned synchronous performance interbehavior is obtained when exchange scenario is suitble to.It is actively triggered according to this
Described interbehavior mode and content are instructed, the synchronous performance interbehavior multi-modal data that generation dances or sings is simultaneously defeated
Out, i.e., intelligent robot and TV programme synchronize danced or sung performance.
Embodiment three:
In the present embodiment, TV interbehavior mode is the interactive voice question and answer in relation to programme content.This kind of TV is handed over
The triggering mode of mutual behavior pattern is passive triggering mode, i.e. user is mentioned based on the content in relation to TV programme to intelligent robot
It asks, intelligent robot is answered.
The passive triggering mode of this kind of TV interbehavior mode is basically the same as the first embodiment, and details are not described herein.?
Content information, list of television programmes information and TV programme back in the present embodiment, in TV related data including TV programme
Scape information.It wherein, include TV programme biographical information (such as name of the program welcome guest, age, a in TV programme background information
People's resume etc.), program material (director of such as film, shooting time, prize-winning situation) and other back relevant to TV programme
Scape data.
After the triggering command for obtaining interactive voice question and answer interbehavior, according to the triggering command and acquired TV
Content information, list of television programmes information and the TV programme background information of program, generate corresponding TV interbehavior multimode
State data simultaneously export, i.e., intelligent robot is carried out accordingly about the enquirement of content of TV program by sound or image according to user
Answer.
Example IV:
In the present embodiment, TV interbehavior mode is TV interactive mode relevant to TV shopping.This kind of TV
The triggering mode of interbehavior mode can be passive triggering mode or user oriented active triggering mode.
In the passive triggering mode of this kind of TV interbehavior mode, by indicating that use is known in the identification of information to user
Family is intended to buy commodity or needs intelligent robot Recommendations.And then get the interaction of purchase commodity or Recommendations
Behavior pattern triggering command.
The user oriented active triggering mode of the mode is specially intelligent robot according to multi-modal input information and TV
Related data actively triggers the TV interbehavior mode of TV shopping recommendation, generates the corresponding interaction row recommended or buy commodity
It for multi-modal data and exports, the recommendation exported in recommendation pattern is to meet active user in shopping program to buy habit
Being discussed in detail of used commodity buys evaluation etc..
Intelligent robot obtains wherein television picture image information and TV by analyzing multi-modal input information
Acoustic information carries out analysis identification to television picture image information or sound of television information, if the picture of TV shopping program
In showing certain part commodity, intelligent robot is you can learn that current television program is TV shopping program and to pass through image recognition
To the commodity, and determination can actively trigger the interbehavior mode for recommend the commodity.If shopping program salesman to
Everybody introduces commodity, and intelligent robot can be by speech recognition to the commodity introduced, and determination can be triggered actively and be pushed away
Recommend the interbehavior mode of the commodity.
In the present embodiment, the content information in TV related data including TV programme, shopping program merchandise news, purchase
The shopping platform link information of object program.The content information of TV programme includes the flow content of shopping program, i.e. shopping program
The recommendation of what commodity is carried out at what time.It include the detailed of the commodity recommended in shopping program in shopping program merchandise news
Thin introduction, purchase evaluation etc..Shopping platform link information is purchased for intelligent robot by being connected to the network to shopping platform
Buy equal relevant operations.
Intelligent robot can also be analyzed by the content information to shopping program, know current point in time shopping section
Mesh is carrying out the recommendation of what kind of commodity, and then determination currently can actively trigger the interbehavior mode for recommend the commodity.
In an embodiment of the present embodiment, also to be determined whether actively to trigger according to user's buying habit information
Recommend the interbehavior mode of the commodity.User's buying habit information is used to describe the habit that user bought commodity in the past,
Such as like buying what kind of commodity, the price range etc. that can receive different type commodity.If current commodity
Type is the commodity that active user likes purchase, and price is in the range of receiving of active user, it is determined that currently can be actively
Triggering recommend the interbehavior mode of the commodity.
Then, intelligent robot is by sentencing the information about current user state analyzed in multi-modal input information
The state of disconnected active user is appropriate for the interbehavior recommended of actively doing shopping, and the active interbehavior mode is needed to current
User recommends, and deterministic process is basically the same as the first embodiment, and details are not described herein.
Finally, intelligent robot or the multimode inquired according to active triggering command, certain part demand for commodity of generation recommendation purchase
State data simultaneously export, and after user affirms wish by multi-modal instruction information representation, generate the interaction row for buying the commodity
For multi-modal data and export.
The embodiment of the present invention also provides a kind of interactive device towards intelligent robot, as shown in figure 4, the device includes:
Information acquisition unit 1, the first trigger unit 2 and the first interaction output unit 3.Wherein, information acquisition unit 1 is more for obtaining
Mode inputs information and TV related data.For analyzing the multi-modal input information, acquisition is directed to first trigger unit 2
The TV interbehavior triggering command of active user.First interaction output unit 3 is used to be triggered according to the TV interbehavior
Instruction and the TV related data, generate corresponding TV interbehavior multi-modal data and export.
Further, the interactive device provided in an embodiment of the present invention towards intelligent robot further include: the second triggering is single
Member and the second interaction output unit.
Second trigger unit obtains the electricity towards active user for analyzing multi-modal input information and TV related data
Depending on interbehavior active triggering command；
Second interaction output unit be used for when determine need to recommend TV interbehavior when, generate TV interaction demand inquiry
Multi-modal data and output.
Further, in embodiments of the present invention, include in the first trigger unit and the second trigger unit: input analysis
Module and habits information obtain module.Analysis module is inputted to be used for according to the analysis multi-modal input information as a result, confirmation
Subscriber identity information and current interaction scenarios information.Habits information obtains module and is used to obtain corresponding TV sight according to user identity
See habits information.
TV related data includes one of following or combination: list of television programmes information, current program content information, TV Festival
Purpose interaction platform link information, dancing synchronizing information, song synchronizing information, TV programme background information, shopping program commodity
Information and shopping platform link information.
The exchange method and device towards intelligent robot provided through the embodiment of the present invention, intelligent robot can be
Interacting activity relevant with TV is carried out to user under tv scene, realizes the tripartite coalition of user, intelligent robot and TV
Interaction.Based on exchange method provided by the invention and device, intelligent robot can be in electricity according to the TV related data of acquisition
The interactive services such as prompting, memorandum and advance notice depending on providing a user TV programme before playing, can be to user in televising
Interactive service about the programme content in broadcasting is provided, and builds the bridge of user and television program interaction, allows user
Easily realized by intelligent robot and interacted with TV programme, and can provide a user after TV programme play about
The interactive services such as investigation, the playback of program are broadcast.
Also, intelligent robot is interacted and can actively be touched according to the instruction of user or by intelligent robot with what user carried out
Hair, the appropriate opportunity before television broadcasting, in broadcast and after broadcasting issue the user with the interaction demand inquiry about TV, are
User provides the apt interactive service closer to human nature.At the same time, exchange method provided by the invention and dress are based on
It sets, intelligent robot carries out different mutual-action behaviors for the different viewing television habits of different user, for each user
Using features such as its interest, hobbies about TV as the foundation of mutual-action behavior, customized interaction is provided for each user
Behavior, to become the intimate partner and assistant of user.
The exchange method provided through the invention, intelligent robot, will more before television broadcasting, in broadcast and after broadcasting
Colourful, more deep TV interactive mode takes user at one's side, forms the comfortable man-machine interaction experience of nature, significantly
Improve the user experience of robot.
While it is disclosed that embodiment content as above but described only to facilitate understanding the present invention and adopting
Embodiment is not intended to limit the invention.Any those skilled in the art to which this invention pertains are not departing from this
Under the premise of the disclosed spirit and scope of invention, any modification and change can be made in the implementing form and in details,
But scope of patent protection of the invention, still should be subject to the scope of the claims as defined in the appended claims.
Claims (6)
1. a kind of exchange method towards intelligent robot characterized by comprising
Obtain multi-modal input information and TV related data；
TV related data and the multi-modal television picture image information inputted in information and sound of television information are analyzed,
The interbehavior mode that can actively trigger is determined whether there is based on the analysis results, and if it does not exist, then: analysis is described multi-modal defeated
Enter information, obtain the TV interbehavior triggering command for being directed to active user, which is that user indicates to need to carry out electricity
Depending on the triggering command generated when interaction；According to the TV interbehavior triggering command and the TV related data, generate
Corresponding TV interbehavior multi-modal data simultaneously exports；
The interbehavior mode that can actively trigger if it exists, then obtaining the TV interbehavior towards active user, actively triggering refers to
It enables, which is not need the instruction of active user, the interaction row with active user actively initiated by intelligent robot
For instruction；When determination needs to recommend TV interbehavior, the multi-modal data of TV interaction demand inquiry and output are generated.
2. the exchange method according to claim 1 towards intelligent robot, which is characterized in that obtaining active user's
Include: in the step of TV interbehavior triggering command
According to the analysis multi-modal input information as a result, confirmation subscriber identity information and current interaction scenarios information；
Corresponding TV viewing habits information is obtained according to user identity.
3. the exchange method according to claim 1 towards intelligent robot, which is characterized in that the TV related data
Including one of following or combination: the interaction platform connection letter of list of television programmes information, current program content information, TV programme
Breath, dancing synchronizing information, song synchronizing information, TV programme background information, shopping program merchandise news and shopping platform connect
Connect information.
4. a kind of interactive device towards intelligent robot characterized by comprising
Information acquisition unit is used to obtain multi-modal input information and TV related data；
First trigger unit is used for the television picture image information and electricity in TV related data and multi-modal input information
It is analyzed depending on acoustic information, determines whether there is the interbehavior mode that can actively trigger based on the analysis results, if it does not exist,
Then: the analysis multi-modal input information obtains the TV interbehavior triggering command for being directed to active user, which is
User's instruction needs to carry out the triggering command generated when TV interaction；
First interaction output unit, is used for according to the TV interbehavior triggering command and the TV related data,
It generates corresponding TV interbehavior multi-modal data and exports；
The interactive device further include:
Second trigger unit is used to then obtain towards active user's when there is the interbehavior mode that can actively trigger
TV interbehavior active triggering command, the triggering command are not need the instruction of active user, are actively sent out by intelligent robot
The instruction with the interbehavior of active user risen；
Second interacts output unit, is used to generate the inquiry of TV interaction demand when determination needs to recommend TV interbehavior
Multi-modal data and output.
5. the interactive device according to claim 4 towards intelligent robot, which is characterized in that first trigger unit
Include:
Analysis module is inputted, is used for according to the analysis multi-modal input information as a result, confirming subscriber identity information and working as
Preceding interaction scenarios information；
Habits information obtains module, is used to obtain corresponding TV viewing habits information according to user identity.
6. the interactive device according to claim 4 towards intelligent robot, which is characterized in that the TV related data
Including one of following or combination: the interaction platform connection letter of list of television programmes information, current program content information, TV programme
Breath, dancing synchronizing information, song synchronizing information, TV programme background information, shopping program merchandise news and shopping platform connect
Connect information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610272955.1A CN105898487B (en) | 2016-04-28 | 2016-04-28 | A kind of exchange method and device towards intelligent robot |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610272955.1A CN105898487B (en) | 2016-04-28 | 2016-04-28 | A kind of exchange method and device towards intelligent robot |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105898487A CN105898487A (en) | 2016-08-24 |
| CN105898487B true CN105898487B (en) | 2019-02-19 |
Family
ID=56701729
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610272955.1A Active CN105898487B (en) | 2016-04-28 | 2016-04-28 | A kind of exchange method and device towards intelligent robot |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105898487B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108932167B (en) * | 2017-05-22 | 2023-08-08 | 中兴通讯股份有限公司 | Intelligent question-answer synchronous display method, device and system and storage medium |
| CN107705793B (en) * | 2017-09-22 | 2023-01-31 | 百度在线网络技术（北京）有限公司 | Information pushing method, system and equipment based on voiceprint recognition |
| CN107583291B (en) * | 2017-09-29 | 2023-05-02 | 深圳希格玛和芯微电子有限公司 | Toy interaction method and device and toy |
| CN107610705A (en) * | 2017-10-27 | 2018-01-19 | 成都常明信息技术有限公司 | One kind is according to age intelligence tone color speech robot people |
| CN110609943A (en) * | 2018-05-28 | 2019-12-24 | 九阳股份有限公司 | Active interaction method of intelligent equipment and service robot |
| CN108763495B (en) * | 2018-05-30 | 2019-09-20 | 苏州思必驰信息科技有限公司 | Interactive method, system, electronic equipment and storage medium |
| CN110839175A (en) * | 2018-08-15 | 2020-02-25 | Tcl集团股份有限公司 | Interaction method based on smart television, storage medium and smart television |
| CN110121077B (en) * | 2019-05-05 | 2021-05-07 | 广州方硅信息技术有限公司 | Question generation method, device and equipment |
| CN110278477A (en) * | 2019-05-28 | 2019-09-24 | 王东 | A kind of control document generating method, control method of electronic device and electronic equipment |
| CN113726951B (en) * | 2020-05-25 | 2023-08-01 | 深圳Tcl新技术有限公司 | Automatic response method, terminal and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102348094A (en) * | 2011-08-23 | 2012-02-08 | 深圳市中科睿成智能科技有限公司 | Robot-television communication system |
| CN103517130A (en) * | 2012-07-18 | 2014-01-15 | Tcl集团股份有限公司 | Method and system for obtaining television program expanded information of smart television |
| CN103812851A (en) * | 2012-11-05 | 2014-05-21 | 纬创资通股份有限公司 | Interactive system and investigation method |
| CN104618816A (en) * | 2015-02-26 | 2015-05-13 | 北京奇艺世纪科技有限公司 | Cross-screen interaction method, device and system |
| CN104918094A (en) * | 2014-03-15 | 2015-09-16 | 杨曜骏 | Program associated information obtaining and releasing method based on playing program synchronization time axis |
| CN104951077A (en) * | 2015-06-24 | 2015-09-30 | 百度在线网络技术（北京）有限公司 | Man-machine interaction method and device based on artificial intelligence and terminal equipment |
| CN105093986A (en) * | 2015-07-23 | 2015-11-25 | 百度在线网络技术（北京）有限公司 | Humanoid robot control method based on artificial intelligence, system and the humanoid robot |
| CN105511608A (en) * | 2015-11-30 | 2016-04-20 | 北京光年无限科技有限公司 | Intelligent robot based interaction method and device, and intelligent robot |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4181590B2 (en) * | 2006-08-30 | 2008-11-19 | 株式会社東芝 | Interface device and interface processing method |
| CN101370122A (en) * | 2007-08-14 | 2009-02-18 | 深圳Tcl新技术有限公司 | Method for reserving TV program and television set |
| KR101568347B1 (en) * | 2011-04-12 | 2015-11-12 | 한국전자통신연구원 | Computing device with robotic functions and operating method for the same |
| CN102790907A (en) * | 2012-07-13 | 2012-11-21 | 李映红 | Interactive system and method aiming at television program |
| CN103517142B (en) * | 2012-12-17 | 2017-04-05 | Tcl集团股份有限公司 | A kind of interaction comment information processing method and system based on intelligent television |
| CN105046186B (en) * | 2015-08-27 | 2018-06-29 | 北京恒华伟业科技股份有限公司 | A kind of recognition methods of Quick Response Code and device |
| CN105263055B (en) * | 2015-09-02 | 2018-10-12 | 康佳集团股份有限公司 | A kind of interactive approach and system of live telecast |
| CN105512228B (en) * | 2015-11-30 | 2018-12-25 | 北京光年无限科技有限公司 | A kind of two-way question and answer data processing method and system based on intelligent robot |
-
2016
- 2016-04-28 CN CN201610272955.1A patent/CN105898487B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102348094A (en) * | 2011-08-23 | 2012-02-08 | 深圳市中科睿成智能科技有限公司 | Robot-television communication system |
| CN103517130A (en) * | 2012-07-18 | 2014-01-15 | Tcl集团股份有限公司 | Method and system for obtaining television program expanded information of smart television |
| CN103812851A (en) * | 2012-11-05 | 2014-05-21 | 纬创资通股份有限公司 | Interactive system and investigation method |
| CN104918094A (en) * | 2014-03-15 | 2015-09-16 | 杨曜骏 | Program associated information obtaining and releasing method based on playing program synchronization time axis |
| CN104618816A (en) * | 2015-02-26 | 2015-05-13 | 北京奇艺世纪科技有限公司 | Cross-screen interaction method, device and system |
| CN104951077A (en) * | 2015-06-24 | 2015-09-30 | 百度在线网络技术（北京）有限公司 | Man-machine interaction method and device based on artificial intelligence and terminal equipment |
| CN105093986A (en) * | 2015-07-23 | 2015-11-25 | 百度在线网络技术（北京）有限公司 | Humanoid robot control method based on artificial intelligence, system and the humanoid robot |
| CN105511608A (en) * | 2015-11-30 | 2016-04-20 | 北京光年无限科技有限公司 | Intelligent robot based interaction method and device, and intelligent robot |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105898487A (en) | 2016-08-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105898487B (en) | A kind of exchange method and device towards intelligent robot | |
| US9848244B2 (en) | Method of providing user specific interaction using device and digital television (DTV), the DTV, and the user device | |
| US10345897B2 (en) | Spectator interactions with games in a specatating system | |
| US10632372B2 (en) | Game content interface in a spectating system | |
| US10390064B2 (en) | Participant rewards in a spectating system | |
| US10376795B2 (en) | Game effects from spectating community inputs | |
| US11071919B2 (en) | Joining games from a spectating system | |
| CN104756514B (en) | TV and video frequency program are shared by social networks | |
| Wilson | Understanding media users: From theory to practice | |
| US20170006074A1 (en) | Spectating data service for a spectating system | |
| US20170001122A1 (en) | Integrating games systems with a spectating system | |
| EP3316980A1 (en) | Integrating games systems with a spectating system | |
| CN105247879A (en) | Client device, control method, system and program | |
| CN102346898A (en) | Automatic customized advertisement generation system | |
| CN102595212A (en) | Simulated group interaction with multimedia content | |
| CN102129636A (en) | System and method for providing viewer identification-based advertising | |
| CN105934769A (en) | Media synchronized advertising overlay | |
| CN109829064A (en) | Media resource shares and playing method and device, storage medium and electronic device | |
| KR101530122B1 (en) | A method for providing of social networking service, and a server therefor | |
| Epelde et al. | Providing universally accessible interactive services through TV sets: implementation and validation with elderly users | |
| CN111583415A (en) | Information processing method and device and electronic equipment | |
| CN109085917A (en) | Prompting message playing method and system | |
| CN107483391A (en) | The method for pushing and device of multimedia file | |
| JP2017130170A (en) | Conversation interlocking system, conversation interlocking device, conversation interlocking method, and conversation interlocking program | |
| WO2019181537A1 (en) | Processing device, processing method, data processing device, data processing system, data processing method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |