CN107122040A - A kind of interactive system between artificial intelligence robot and intelligent display terminal - Google Patents
A kind of interactive system between artificial intelligence robot and intelligent display terminal Download PDFInfo
- Publication number
- CN107122040A CN107122040A CN201710157932.0A CN201710157932A CN107122040A CN 107122040 A CN107122040 A CN 107122040A CN 201710157932 A CN201710157932 A CN 201710157932A CN 107122040 A CN107122040 A CN 107122040A
- Authority
- CN
- China
- Prior art keywords
- robot
- information
- terminal
- interactive
- main
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Toys (AREA)
Abstract
The present invention relates to MR and artificial intelligence field, specifically provide the interactive system between a kind of artificial intelligence robot and intelligent display terminal, including artificial intelligence robot and intelligent display terminal, the artificial intelligence robot includes a main robot or a main robot and its from robot；Each main robot is parsed and respond module and servomotor module provided with robot main control module and connected robot radio receiving transmitting module, sound identification module, audio per capita from machine；The intelligent display terminal is provided with terminal main control module and connected terminal wireless transceiver module, video parsing and respond module.A kind of interactive system between artificial intelligence robot and intelligent display terminal that the present invention is provided, it can be widely applied in more scenes such as family parlor, cinema, meeting room, public place, it is also applied to entertain, educates, in the more very powerful and exceedingly arrogant field such as public service, is that numerous customer groups bring the MR of fashion to enjoy.
Description
Technical field
The present invention relates to MR (mixed reality) and field of artificial intelligence, more particularly to a kind of artificial intelligence robot with
Interactive system between intelligent display terminal.
Background technology
VR (Vitual Reality, virtual reality), is to produce a three-dimensional virtual world using computing device simulation,
There is provided user the simulation on sense organs such as vision, the sense of hearings, all things that you see all are computer generations, pure virtual picture
Face.AR (Augmented Reality, augmented reality), is that virtual digit picture is real plus bore hole, typical AR equipment is
Google Glass.MR (Mediated Reality, mediation reality), by " father of Intelligent hardware " University of Toronto professor
Steve Mann are proposed, are digitlization reality+virtual digit pictures.
MR (Mixed Reality, mixed reality technology) is the further development of virtual reality technology, the technology by
Virtual scene information is presented in reality scene, and the information of an interaction feedback is set up between real world, virtual world and user
Loop, to strengthen the sense of reality of Consumer's Experience.So as to realize the application more much broader than AR, VR.
Robot be it is a kind of programmable and multi-functional, for materials hauling, part, instrument operation machine, or in order to
Perform different tasks and there is the specialized system that can change and may be programmed action.Intelligent robot is then one in perception-think of
The machine system of comprehensive simulated people in terms of dimension-effect, profile is not necessarily as people.It is the comprehensive testing ground of artificial intelligence technology,
The technology of artificial intelligence every field can be comprehensively investigated, their relations each other are studied.One intelligent robot should
This possesses the ability of three aspects：The ability of perception environment, the ability for performing certain task and being exerted one's influence to environment and a perception
The ability connected with taking action.
There are many companies to be absorbed at present to combine the technologies such as VR, AR, MR with intelligent robot, but it is applied
It is main in VR game, VR shopping, VR films and to experience above, at present also to family parlor, cinema, meeting room, public
The application in the place such as place is strided forward, and the present invention is exactly that under this overall situation or main trend, intelligent robot is combined with MR,
The interactive system between a kind of artificial intelligence robot and intelligent display terminal is studied to be applied to family parlor, cinema, meeting
In more scenes such as room, public place, it is also applied to entertain, educates, in the more very powerful and exceedingly arrogant field such as public service, is wide
Big customer colony brings more fashionable MR to enjoy.
The content of the invention
The present invention provides the interactive system between a kind of artificial intelligence robot and intelligent display terminal, solves by UNICOM
Artificial intelligence robot and intelligent display terminal, and by the participation of artificial intelligence robot combination intelligent display terminal and people,
A kind of technical problem of predetermined MR application environments is built jointly to preset interactive information according to program.
To solve above technical problem, the present invention provides a kind of artificial intelligence robot and interacting between intelligent display terminal
System, including artificial intelligence robot and intelligent display terminal, the artificial intelligence robot include a main robot or one
Individual main robot and its from robot；Each main robot connects provided with robot main control module and with it per capita from machine
Robot radio receiving transmitting module, sound identification module, audio parsing and respond module and the servomotor module connect；The intelligence
Display terminal is provided with terminal main control module and connected terminal wireless transceiver module, video parsing and respond module；It is described
The robot radio receiving transmitting module of main robot and the terminal wireless transceiver module and/or the robot from robot
Radio receiving transmitting module is wirelessly connected；
Pre-set programs interactive information is provided with the robot main control module of the main robot；The machine of the main robot
People's main control module retains the main robot interactive information of itself, and the machine for passing through itself after parsing the pre-set programs interactive information
Device people radio receiving transmitting module sends terminal program interactive information, to described from robot in real time to the terminal wireless transceiver module
Send in real time from robot program interaction information；
The terminal main control module sends corresponding video information to institute in real time after receiving the terminal program interactive information
State video parsing and respond module, the main robot or the robot main control module parsing main robot journey from robot
Sequence interactive information from robot program interaction information and sends corresponding voice messaging and motor activation bit to the sound of itself
Frequency parsing and respond module and servomotor module, the audio parsing and respond module and servomotor module parsing institute predicate
Corresponding voice is sent after message breath and motor activation bit and makes corresponding action；
The main robot is used to recognizing voice operating order that human body sends simultaneously from the sound identification module of robot
Generate corresponding voice operation information and be sent to the robot main control module of itself in real time, the robot main control module parses institute
State in the main robot program interaction information after voice operation information or found correspondingly from robot program interaction information
Voice process instruction and according to the voice process instruction respond.
Further, the terminal program interactive information includes terminal program interactive instruction and terminal MR video files,
The main robot program interaction information or from robot program interaction information include main robot program interaction instruction or from
Robot program's interactive instruction and applied to the audio parse and respond module robot audio file or robot audio
Learn generation program；
In different pre-set programs interactive information, the main robot is not limited to be only main robot, described from master
Robot is not limited to be only from robot, is only limited in same pre-set programs interactive information, provided with a main robot, if
Have zero or more than zero from robot.
Further, the intelligent display terminal includes intelligent television, smart mobile phone, computer, projection or motion picture screen.
Further, when the intelligent display terminal is intelligent television, the intelligent display terminal can also be received
The MR interactive program information that TV station sends in real time, the terminal MR that the intelligent television retains in the MR interactive programs information is mutual
Dynamic programme information simultaneously sends the principal and subordinate robot interactive program information in the MR interactive programs information to the master machine in real time
People, the main robot receives the principal and subordinate robot interactive program information.
Further, when provided with from robot, the main robot is by the principal and subordinate robot interactive program received
Being sent in real time from robot interactive program information in information is described from robot.
Further, the wireless mode includes WIFI, ZigBee, 2.4G, bluetooth, 4G, 5G.
Further, when the pre-set programs interactive information is electronic game interactive information, the artificial intelligence machine
People is provided with the game emulation tool and ancillary hardware system for being connected to the robot main control module, and the intelligent display terminal is set
There are the hardware systems corresponding with the game emulation tool and ancillary hardware system for being connected to the terminal main control module.
Further, the game data real time automatic update produced in game process is in the electronic game interactive information
In.
Further, the robot main control module is provided with robot USB interface, and the terminal main control module is provided with eventually
Hold USB interface.
Further, when lacking the terminal wireless transceiver module in the intelligent display terminal, the terminal USB
The external terminal wireless transceiver module of interface, or connect the robot USB interface and terminal USB interface progress is wired
The UNICOM of mode.
A kind of interactive system between artificial intelligence robot and intelligent display terminal that the present invention is provided, UNICOM's artificial intelligence
Robot and intelligent display terminal, and by the participation of artificial intelligence robot combination intelligent display terminal and people, according to pre-
If program interaction information builds a kind of predetermined MR application environments jointly, according to pre-set programs interactive information (i.e. the demand of user)
Difference, selects different artificial intelligence robots and intelligent display terminal, can be widely applied for family parlor, cinema, meeting
Discuss in room, more scenes such as public place, be also applied to entertain, educate, in the more very powerful and exceedingly arrogant field such as public service, being
Numerous customer groups bring the MR of fashion to enjoy.
Brief description of the drawings
Fig. 1 is the interactive system between a kind of artificial intelligence robot and intelligent display terminal that the embodiment of the present invention 1 is provided
Function structure chart；
Fig. 2 is the interactive system between a kind of artificial intelligence robot and intelligent display terminal that the embodiment of the present invention 2 is provided
Function structure chart.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described.Following component is only preferred embodiment, does not constitute limiting the scope of the invention.
Embodiment 1
It is a kind of artificial intelligence robot and interacting between intelligent display terminal that the embodiment of the present invention 1 is provided referring to Fig. 1
The function structure chart of system.Dotted line represents wireless connection in Fig. 1, and solid line represents electrical connection.In the present embodiment, it is of the invention
A kind of interactive system between artificial intelligence robot and intelligent display terminal is provided, including artificial intelligence robot 1 shows with intelligence
Show terminal 2, the artificial intelligence robot 1 includes a main robot 10；The main robot 10 is provided with robot master control mould
Block 101 and connected robot radio receiving transmitting module 102, sound identification module 103, audio parsing and respond module 104
With servomotor module 105；The intelligent display terminal 2 is received provided with terminal main control module 201 and connected terminal wireless
Send out module 202, video parsing and respond module 203；The robot radio receiving transmitting module 102 of the main robot 10 with it is described
Terminal wireless transceiver module 202 is wirelessly connected；
Pre-set programs interactive information is provided with the robot main control module 101 of the main robot 10；The main robot
10 robot main control module 101, which is parsed, retains the main robot interactive information of itself after the pre-set programs interactive information, and
Terminal program is sent in real time by the robot radio receiving transmitting module 102 of itself to the terminal wireless transceiver module 202 to interact
Information；
The terminal main control module 201 sends corresponding video information in real time after receiving the terminal program interactive information
(including audio-frequency information in video) is parsed and respond module 203 to the video, the robot master control of the main robot 10
Module 101 parse the main robot program interaction information and send corresponding voice messaging and motor activation bit to itself
Audio is parsed and respond module 104 and servomotor module 105, the audio parsing and respond module 104 and servomotor mould
Block 105, which is parsed, to be sent corresponding voice and makes corresponding action after the voice messaging and motor activation bit；
The sound identification module 103 of the main robot 10 is used for the voice operating order and generation pair for recognizing that human body is sent
The voice operation information answered is sent to the robot main control module 101 of itself in real time, and the robot main control module 101 parses institute
State after voice operation information and corresponding voice process instruction is found in the main robot program interaction information and according to institute
State the response of voice process instruction.
In the present embodiment, the terminal program interactive information includes terminal program interactive instruction and terminal MR videos
File, the main robot program interaction information or from robot program interaction information include main robot program interaction instruction
Or from robot program interaction instruction and applied to audio parsing and the robot audio file or machine of respond module 104
Device people audio learns generation program.
Specifically, the intelligent display terminal 2 includes intelligent television, smart mobile phone, computer, projection or motion picture screen；Institute
It can be any of WIFI, ZigBee, 2.4G, bluetooth, 4G, 5G to state wireless mode；In actual applications, it is contemplated that cost
And compatibility, the robot main control module 101 is provided with robot USB interface, and the terminal main control module 201 is provided with terminal
USB interface, when lacking the terminal wireless transceiver module 202 in the intelligent display terminal 2, outside the terminal USB interface
The terminal wireless transceiver module 202 is connect, or connects the robot USB interface and carries out wired side with the terminal USB interface
The UNICOM of formula.
When the intelligent display terminal 2 is intelligent television, it is real-time that the intelligent display terminal 2 can also receive TV station
The MR interactive program information of transmission, the intelligent television retains the terminal MR interactive program information in the MR interactive programs information
And the interactive program information of main robot 10 in the MR interactive programs information is sent in real time to the main robot 10, it is described
Main robot 10 receives the interactive program information of main robot 10.
Generally speaking, the pre-set programs interactive information includes embodying artificial intelligence robot 1 (main robot 10), intelligence
Interaction function between energy display terminal 2, user (one or more spectators and participant) three, one can be completed jointly
Item task (such as cartoon or instruction film or game shows), fully shows virtual and real blending scene.
Special instruction, the interaction between user and intelligent display terminal 2 is also to be transmitted by main robot 10, and non-user with
Intelligent display terminal 2 is directly interactive.
Name one be applied to education in simply example, come help to understand the intelligent display terminal 2 with it is described
The interaction of artificial intelligence robot 1.In the present example, the intelligent display terminal 2 is intelligent liquid-crystal TV, described artificial
The only one of which main robot 10 of intelligent robot 1 (inside sets topic information, the subject information is the pre-set programs interaction letter
Breath), " Apple squad leader " is named as, " Apple squad leader " is connected with intelligent liquid-crystal TV by WIFI, and " Apple
The VR video informations and its inherent operational order that squad leader " has sent correlation wait until the intelligent liquid-crystal TV, carry out now
The operation of program, the Lesson One of selected pinyin learning is played out.
There is teacher in video in picture in religion child's study phonetic alphabet, Apple squad leader is used as child in reality
Paying attention to the class.Teacher just sermonizes：" I teaches how single vowel a pronounces now, and a words are to magnify, and everybody follows me to read one
Time." child in unison with read road：" magnifying ", teacher says：" we first allow robot Apple squad leader to read through,
See that he pronounces just incorrect." teacher and children look at Apple squad leader outside television set in earnest, Apple squad leader is understandingly
Read：", may I ask teacher, I reads to obtain standard" the obviously child in video robs and say：" squad leader, you read very
Rod ", teacher says：" uh, it is to read all well and good, piece american sage herb of reward squad leader ", rewarding and punishing pond (in video) the inside of Apple squad leader
Just there is first american sage herb, Apple squad leader speakings an agitated tone：" it thanks teacher！" and happy must dance for joy ..., like this
The Lesson One of pinyin learning finishes in happy, harmonious atmosphere.
Certainly, in the above example, the people in reality can also participate in into, it is assumed that have the small friend in a reality herein
Friend, is named as little Hua, and she goes to say with Apple squad leader：" squad leader, I also wants to add you learns together ", Apple squad leader is to teacher
Report：" teacher, our classes have carried out a new classmate, and she is little Hua, we learn together " (Apple squad leader is to intelligence later
LCD TV sends information in real time, and intelligent liquid-crystal TV can be responded in the default scope of program), it is this when, small
Flower can also participate in study, as the student of teacher, can answer a question, can ask questions, can be with squad leader
Exchange can also be exchanged with the teacher in video with other children, and whole environment virtually with reality, combines together, so
Study for little Hua, more sensual pleasure and cyclopentadienyl and have robot squad leader to be accompanied in reality, loneliness will not be also felt, to small
Colored study and mental health is all very helpful, and is that teacher father and mother has saved many hearts.Certainly, above topic information also may be used
To be mathematics, English, music etc., it is not restricted, robot Apple squad leader is not limited to that class is humanoid or cartoon
Personage, animal, or an electronic product shape.
When the MR interactive program information that the intelligent liquid-crystal television reception to TV station is sent in real time, and broadcast by user
When putting, the intelligent liquid-crystal TV retains the terminal MR interactive programs information in the MR interactive programs information and sends institute in real time
The interactive program information of main robot 10 in MR interactive program information is stated to the main robot 10 i.e. Apple squad leader, Apple classes
Long to receive the interactive program information of main robot 10, then whole program is brought into operation, and its running is retouched with above-mentioned example
Situation about stating is consistent.Generally speaking, either what kind of program, Apple squad leader is well understood by the content in program,
Enquirement for people in reality can be answered at any time, and the order to people in reality can make reply, in regarding for teaching class
In frequency program, the effect of robot is particularly important.
When the pre-set programs interactive information is electronic game interactive information, then the artificial intelligence robot is required
1 provided with the game emulation tool and ancillary hardware system for being connected to the robot main control module 101, the game emulation tool
Such as the ancillary hardware system of simulated pistol combination robot in itself such as coordinate-system, photosensitive system, luminescence system and robot master
The master control effect of module 101 is controlled, the pistol possesses the functions such as aiming, fixed point, the acousto-optic-electric of pistol, also requires the intelligent display
Terminal 2, which is provided with, is connected to the corresponding with the game emulation tool and ancillary hardware system hard of the terminal main control module 201
Part system, coordinate-system such as corresponding with the simulated pistol, photosensitive system, luminescence system.And luminescence system and photoreceptor
System can be infrared light, laser, visible ray etc., it would however also be possible to employ camera is caught, and is not restricted herein, coordinate body
System has XYZ three-dimensional numerical values, disclosure satisfy that requirement is shot in game to death.
A robot is named to play the example for the shooting game for merging MR to help to understand：
In the present example, the intelligent display terminal 2 is intelligent liquid-crystal TV, and the artificial intelligence robot 1 only has one
Individual main robot 10 (inside setting default electronic game interactive information), is named as " A ", and robot A and intelligent liquid-crystal TV are
Connected by WIFI, and robot A has sent the MR video informations and its inherent operational order of correlation and has waited until described
Intelligent liquid-crystal TV, now game starts.
Robot A is playing pistol against video screen and is shooting strange beast game to death, and at the beginning, picture is with background music for game
Sound, miscellaneous strange beast appears in multiple positions in picture successively one by one, and robot A lifts pistol in hand, opposite
The target (strange beast) of screen oneself concern is shot at.Because robot A has random selection to goal, target is hit
Occur various reactions in picture afterwards, (program has carried out multiple possible combinations in advance for the different action of simultaneous and cry
Design), it is accordingly required in particular to explanation, if the position that robot A is beaten is not the critical position (heart or head etc.) of strange beast, and
If being secondary position (trick), strange beast will not fall down, and can be struggled, or even have other companions and come to sb's aid, when you beat
Behind close to home position, strange beast can just fall down, and achievement can carry out bonus point plus reward.New strange beast just occurs in picture, so alternately
Carry out until your bullet is used up or energy is finished, game just terminates, and announces robot A achievement, so completes a wheel
The deduction of shooting game program.The game data real time automatic update produced in game process is in the electronic game interactive information
In, treat that next round game starts to be since the place of last round of game over, except non-user manually returns to history
Game level in.
It should be strongly noted that above-mentioned principle can be extended to spectators (or user) arbitrarily uses voice command at the scene
Robot command A, is their name and is ordered to them and go some strange beast in strike picture, can also specifically command and beat strange beast
The different parts such as head, heart, hand, pin, so that more rich and varied, exciting, novel and unique of playing.And robot
A profile is not limited to humanoid class or cartoon figure, animal, or an electronic product shape.
If also, it is contemplated that the people in reality is added in game to carry out double or many people with robot A swims
Play is also allowed.
It should be noted that MR described in the present embodiment includes single VR or AR, the VR and AR of mixing, or combine
Single VR or AR or the VR and AR of mixing MR.
Embodiment 2
It is a kind of artificial intelligence robot and interacting between intelligent display terminal that the embodiment of the present invention 2 is provided referring to Fig. 2
The function structure chart of system.Dotted line represents wireless connection in detail in this figure, and solid line represents electrical connection.In the present embodiment, this hair
A kind of bright interactive system provided between artificial intelligence robot 1 and intelligent display terminal 2, including artificial intelligence robot 1 and intelligence
Can display terminal 2, the artificial intelligence robot 1 include a main robot 10 and its from robot 11 (from robot 11-1,
From robot 11-2, from robot 11-3 ... ...)；Each main robot 10 is equipped with robot master from robot 11
Control module 101 or 111 and connected robot radio receiving transmitting module 102 or 112, sound identification module 103 or 113, sound
Frequency parsing and respond module 104 or 114 and servomotor module 105 or 115；The intelligent display terminal 2 is provided with terminal master control
Module 201 and connected terminal wireless transceiver module 202, video parsing and respond module 203；The main robot 10
Robot radio receiving transmitting module 102 and the terminal wireless transceiver module 202, the robot wireless receiving and dispatching from robot 11
Module 112 is wirelessly connected；It is intended merely to the differentiation that upper module is marked to the main robot 10 in same system
With being distinguished from robot 11, for a single main robot 10 or from robot 11, these modules are identical structure.
Pre-set programs interactive information is provided with the robot main control module 101 of the main robot 10；The main robot
10 robot main control module 101, which is parsed, retains the main robot interactive information of itself after the pre-set programs interactive information, and
Terminal program is sent in real time by the robot radio receiving transmitting module 102 of itself to the terminal wireless transceiver module 202 to interact
Information, send in real time from robot program interaction information to the radio receiving transmitting module 112 from robot 11；
The terminal main control module 201 sends corresponding video information in real time after receiving the terminal program interactive information
(including audio-frequency information in video) is parsed and respond module 203 to the video, the main robot 10 or from robot 11
Robot main control module 101 or 111 parse the main robot program interaction information or from robot program interaction information simultaneously
Send audio parsing and respond module 104 or 114 and servomotor of corresponding voice messaging and the motor activation bit to itself
Module 105 or 115, the audio parsing and respond module 104 or 114 and servomotor module 105 or 115 parse the voice
Corresponding voice is sent after information and motor activation bit and corresponding action is made；
The main robot 10 is used to recognize the language that human body is sent from the sound identification module 103 or 113 of robot 11
Sound operational order simultaneously generates corresponding voice operation information and is sent to the robot main control module 101 or 111 of itself in real time, described
Robot main control module 101 or 111 is parsed after the voice operation information in the main robot program interaction information or slave
Corresponding voice process instruction is found in device people's program interaction information and is responded according to the voice process instruction.
The terminal program interactive information includes terminal program interactive instruction and terminal MR video files, the master machine
People's program interaction information includes the instruction of the program interaction of main robot 10 or from robot 11 from robot program interaction information
Program interaction is instructed and applied to audio parsing and the robot audio file or robot sound of respond module 104 or 114
Frequency study generation program；
In different pre-set programs interactive information, the main robot 10 is not limited to be only main robot 10, described
It is not limited to be only from robot 11 from robot 11, is only limited in same pre-set programs interactive information, provided with a main frame
Device people 10, more than zero from robot 11.
Specifically, the intelligent display terminal 2 includes intelligent television, smart mobile phone, computer, projection or motion picture screen；Institute
It can be any of WIFI, ZigBee, 2.4G, bluetooth, 4G, 5G to state wireless mode；In actual applications, it is contemplated that cost
And compatibility, the robot main control module 101 is provided with robot USB interface, and the terminal main control module 201 is provided with terminal
USB interface, when lacking the terminal wireless transceiver module 202 in the intelligent display terminal 2, outside the terminal USB interface
The terminal wireless transceiver module 202 is connect, or connects the robot USB interface and carries out wired side with the terminal USB interface
The UNICOM of formula.
Generally speaking, the pre-set programs interactive information include embody artificial intelligence robot 1 (main robot 10 and its
From robot 11), intelligent display terminal 2, the interaction function between user (one or more spectators and participant) three,
Can jointly be accomplished a task (such as cartoon or instruction film or game shows), fully show virtual and real blending field
Scape.
Special instruction, the interaction between user and intelligent display terminal 2 is also to be transmitted by main robot 10, and non-user with
Intelligent display terminal 2 is directly interactive.
A simply example being applied in public tourist service is named, specifically, applied in tourist industry
In video annotation, to help the interaction for understanding the intelligent display terminal 2 and the artificial intelligence robot 1.In this example
In son, the intelligent display terminal 2 is intelligent liquid crystal display (or projector equipment, throw on the wall Jing Guo specially treated), institute
State in artificial intelligence robot 1 and (inside to set tourism video information, the tourism video information is described provided with main robot K
Pre-set programs interactive information) and from robot M, from robot N (can also set more certainly, two are only set herein),
Main robot K is connected with intelligent liquid crystal display by WIFI, and main robot K has sent the MR trips of correlation
Trip video information and its inherent operational order wait until the intelligent liquid crystal display, from robot K and from robot N, existing
Entering the operation of line program, sight spot --- BS is played out for selection, and set from robot M as guide (explain content and
Question and answer content is only for example reference).
Video frequency program beginning is the scenic spot BS taken photo by plane, the treated MR video informations of the video frequency program, audience
Corresponding MR equipment can be equipped with, makes audience for example on the spot in person, also can use high accuracy to catch a good shot the portrait of audience
It is Hi-Fi to be entered into real time in video, bring spectators unprecedented sense organ grand banquet.At the beginning, robot M is to big for program
Family's explanation：" BS, she is embedded in mountain MT mountain range stage casing such as a jewel, and this is that a grandness is beautiful unique and magical
Mountain.”
With Shot change, visitor enters BS pictures, has individual spadger (in picture) to ask:" BS is how many grades of scenic spot
" robot M answers：" being national 4A grades of scenic spot, level authentication was obtained in 2005 " scene has spectators to ask robot M：
" height above sea level that may I ask this mountain is how high" robot M replies：“1889.5m." scene have television set spectators fall over each other enquirement, this
When robot N step come, the gesture of " peace and quiet " is made in face of spectators, and say in face of spectators：" everybody takes it easy, you the problem of
Corresponding answer can be obtained, we come one by one.”
Different from usual video frequency program, this program is not announcer's explanation in video, but the robot M outside video carrys out root
Putd question to according to spectators outside video scene and video, carry out on-site commentary.But in this program, robot M or even robot K, machine
People N is well understood by the content in program, enquirement for spectators, is answered at any time, because setting robot M as explanation
Member, in general, the enquirement of the non-designated answer object of audience, all by robot, M is answered, and specifies answer object
Then by specify object (such as robot N) answer.Here robot K mainly serves as the effect of active atmosphere, and robot N is mainly carried on a shoulder pole
Appoint the effect of order keeping.Robot M, robot K, robot N are not limited to humanoid class or cartoon figure, moved
Thing, or an electronic product shape.
It the above is only a demonstration citing, the limitation in description do not constituted to the present invention.
In the present embodiment, generally, setting is preset with program interaction information in main robot 10, but when the intelligence
When energy display terminal 2 is intelligent television, the intelligent display terminal 2 can also receive the MR interactive programs that TV station sends in real time
Information, the intelligent television retains the terminal MR interactive programs information in the MR interactive programs information and sends the MR in real time
Principal and subordinate robot interactive program information in interactive program information is to the main robot 10, and the main robot 10 receives described
Being sent in real time from robot interactive program information in principal and subordinate robot interactive program information is described from robot.Because TV
Platform has the ability to carry out copyright control to TV programme.
Also a kind of situation, when the pre-set programs interactive information is electronic game interactive information, is then required described
Artificial intelligence robot 1 is provided with the game emulation tool and ancillary hardware system for being connected to the robot main control module 101, institute
State the game emulation tool such as ancillary hardware system of simulated pistol combination robot in itself such as coordinate-system, photosensitive system, light
The master control effect of system and robot main control module 101, the pistol possesses the functions such as aiming, fixed point, the acousto-optic-electric of pistol, also
Ask the intelligent display terminal 2 to be provided with and be connected to the hard with the game emulation tool and auxiliary of the terminal main control module 201
The corresponding hardware systems of part system, coordinate-system such as corresponding with the simulated pistol, photosensitive system, luminescence system.And send out
Body of light system and photosensitive system can be infrared light, laser, visible ray etc., it would however also be possible to employ camera is caught, herein
It is not restricted, coordinate-system has XYZ three-dimensional numerical values, disclosure satisfy that requirement is shot in game to death.
The example of a playing video game together with from robot 11 of main robot 10 is named to help to understand：
In the present example, the intelligent display terminal 2 is intelligent liquid-crystal TV, and the artificial intelligence robot 1 includes
One robot P (inside setting default electronic game interactive information), two from robot E and F, main robot 10P and intelligent liquid
Brilliant TV, main robot 10P between robot E and F by WIFI respectively with being connected, and main robot 10P is
The MR video informations and its inherent operational order for sending correlation wait until the intelligent liquid-crystal TV, the MR related to having sent
Video information and its inherent operational order wait until the robot E and robot F, and game now starts.
Robot P, robot E, robot F are playing pistol against video screen and are shooting strange beast game to death, play at the beginning,
Picture sounds with background music, and miscellaneous strange beast appears in multiple positions in picture successively one by one, robot P,
Robot E, robot F lift pistol in hand, and the target (strange beast) for being respectively toward to screen oneself concern is shot at.Due to all
Robot has random selection to goal, and target, which is hit, various reactions occurs in rear picture, and simultaneous is different
Action and cry (program has carried out multiple possible Combination Designs in advance), it is accordingly required in particular to explanation, if robot is beaten
Position be not strange beast critical position (heart or head etc.), but if secondary position (trick), strange beast will not fall down, meeting
Struggled, or even have other companions and come to sb's aid, after you deal a blow at the heart position, strange beast can just be fallen down, and achievement can be carried out
Bonus point plus reward.New strange beast just occurs in picture, so alternately until the bullet of all robots is used up or energy is used
Complete, game just terminates, and announces the achievement of all robots, so completes the deduction of a wheel shooting game program.Played
The game data real time automatic update produced in journey in the electronic game interactive information, treat next round game start be from
The place of last round of game over starts, in the game level that history is manually returned to except non-user.
It should be strongly noted that above-mentioned principle can be extended to spectators (or user) arbitrarily uses voice command at the scene
Any robot is commanded, their name is and is ordered to them and go some strange beast in strike picture, can also specifically command and beat
The different parts such as head, heart, hand, the pin of strange beast, so that more rich and varied, exciting, novel and unique of playing.And machine
Device people P, robot E, robot F profile are not limited to humanoid class or cartoon figure, animal, or an electricity
Sub- shape of product.
If also, it is contemplated that the people in reality is added in game to come and robot P, robot E, robot F
To carry out multiplayer or be played instead of robot to be also allowed.
It the above is only another demonstration citing, the limitation in description do not constituted to the present invention.
In the present embodiment, the wireless mode can be any in WIFI, ZigBee, 2.4G, bluetooth, 4G, 5G
Kind；In actual applications, it is contemplated that cost and compatibility, the robot main control module 101 is provided with robot USB interface, institute
Terminal main control module 201 is stated provided with terminal USB interface, is received and dispatched when lacking the terminal wireless in the intelligent display terminal 2
During module 202, the external terminal wireless transceiver module 202 of terminal USB interface, or connect the robot USB interface
The UNICOM of wired mode is carried out with the terminal USB interface.
It should be noted that MR described in the present embodiment includes single VR or AR, the VR and AR of mixing, or combine
Single VR or AR or the VR and AR of mixing MR.
Described above is the preferred embodiment of the present invention, it is noted that for those skilled in the art
For, under the premise without departing from the principles of the invention, some improvements and modifications can also be made, these improvements and modifications are also considered as
Protection scope of the present invention.
Claims (10)
1. the interactive system between a kind of artificial intelligence robot and intelligent display terminal, it is characterised in that including artificial intelligence machine
Device people and intelligent display terminal, the artificial intelligence robot include a main robot or a main robot and its from machine
People；Each main robot is provided with robot main control module and connected robot wireless receiving and dispatching mould per capita from machine
Block, sound identification module, audio parsing and respond module and servomotor module；The intelligent display terminal is provided with terminal master control
Module and connected terminal wireless transceiver module, video parsing and respond module；The robot of the main robot is wireless
Transceiver module and the terminal wireless transceiver module and/or it is described pass through from the robot radio receiving transmitting module of robot it is wireless
Mode is connected；
Pre-set programs interactive information is provided with the robot main control module of the main robot；The robot master of the main robot
Control module retains the main robot interactive information of itself, and the robot for passing through itself after parsing the pre-set programs interactive information
Radio receiving transmitting module sends terminal program interactive information, to described real-time from robot in real time to the terminal wireless transceiver module
Send from robot program interaction information；
Corresponding video information is sent in real time after the terminal main control module reception terminal program interactive information to regard described in
Frequency parsing and respond module, the main robot or the robot main control module parsing main robot program friendship from robot
Mutual information from robot program interaction information and sends corresponding voice messaging and motor activation bit to the audio solution of itself
Analysis and respond module and servomotor module, the audio parsing and respond module and servomotor module parse the voice letter
Corresponding voice is sent after breath and motor activation bit and makes corresponding action；
The main robot is used to recognizing voice operating order that human body is sent from the sound identification module of robot and generated
Corresponding voice operation information is sent to the robot main control module of itself in real time, and the robot main control module parses the people
After sound operation information corresponding people is found in the main robot program interaction information or from robot program interaction information
Sonication is instructed and responded according to the voice process instruction.
2. the interactive system as claimed in claim 1 between a kind of artificial intelligence robot and intelligent display terminal, its feature exists
In：The terminal program interactive information includes terminal program interactive instruction and terminal MR video files, the main robot journey
Sequence interactive information includes the instruction of main robot program interaction or from robot program interaction from robot program interaction information
Instruct and applied to audio parsing and the robot audio file or robot audio study generation program of respond module；
In different pre-set programs interactive information, the main robot is not limited to be only main robot, described from master machine
People is not limited to be only from robot, is only limited in same pre-set programs interactive information, provided with a main robot, provided with zero
Or more than zero from robot.
3. the interactive system as claimed in claim 1 between a kind of artificial intelligence robot and intelligent display terminal, its feature exists
In：The intelligent display terminal includes intelligent television, smart mobile phone, computer, projection or motion picture screen.
4. the interactive system as claimed in claim 3 between a kind of artificial intelligence robot and intelligent display terminal, its feature exists
In：When the intelligent display terminal is intelligent television, the intelligent display terminal can also receive what TV station sent in real time
MR interactive program information, the intelligent television retains the terminal MR interactive programs information in the MR interactive programs information and real-time
Principal and subordinate robot interactive program information in the MR interactive programs information is sent to the main robot, the main robot connects
Receive the principal and subordinate robot interactive program information.
5. the interactive system as claimed in claim 4 between a kind of artificial intelligence robot and intelligent display terminal, its feature exists
In：When provided with from robot, the main robot by the principal and subordinate robot interactive program information received from robot
Interactive program information is sent to described from robot in real time.
6. the interactive system as claimed in claim 1 between a kind of artificial intelligence robot and intelligent display terminal, its feature exists
In：The wireless mode includes WIFI, ZigBee, 2.4G, bluetooth, 4G, 5G.
7. the interactive system as claimed in claim 1 between a kind of artificial intelligence robot and intelligent display terminal, its feature exists
In：When the pre-set programs interactive information is electronic game interactive information, the artificial intelligence robot is provided with and is connected to institute
The game emulation tool and ancillary hardware system of robot main control module are stated, the intelligent display terminal is provided with and is connected to the end
Hold the hardware systems corresponding with the game emulation tool and ancillary hardware system of main control module.
8. the interactive system as claimed in claim 7 between a kind of artificial intelligence robot and intelligent display terminal, its feature exists
In：The game data real time automatic update produced in game process is in the electronic game interactive information.
9. the interactive system as claimed in claim 1 between a kind of artificial intelligence robot and intelligent display terminal, its feature exists
In：The robot main control module is provided with robot USB interface, and the terminal main control module is provided with terminal USB interface.
10. the interactive system between a kind of artificial intelligence robot and intelligent display terminal as described in claim 1 or 9, it is special
Levy and be：When lacking the terminal wireless transceiver module in the intelligent display terminal, the terminal USB interface is external described
Terminal wireless transceiver module, or the connection robot USB interface carry out the UNICOM of wired mode with the terminal USB interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710157932.0A CN107122040A (en) | 2017-03-16 | 2017-03-16 | A kind of interactive system between artificial intelligence robot and intelligent display terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710157932.0A CN107122040A (en) | 2017-03-16 | 2017-03-16 | A kind of interactive system between artificial intelligence robot and intelligent display terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107122040A true CN107122040A (en) | 2017-09-01 |
Family
ID=59717515
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710157932.0A Pending CN107122040A (en) | 2017-03-16 | 2017-03-16 | A kind of interactive system between artificial intelligence robot and intelligent display terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107122040A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107678743A (en) * | 2017-09-27 | 2018-02-09 | 北京酷思倍科技有限公司 | A kind of method for intelligent robot programming |
| CN107817799A (en) * | 2017-11-03 | 2018-03-20 | 北京光年无限科技有限公司 | The method and system of intelligent interaction are carried out with reference to virtual maze |
| CN108198559A (en) * | 2018-01-26 | 2018-06-22 | 上海萌王智能科技有限公司 | A kind of voice control robot system for learning action |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101391147A (en) * | 2008-11-06 | 2009-03-25 | 北京中星微电子有限公司 | Remote control robot game system |
| JP2013099823A (en) * | 2011-11-09 | 2013-05-23 | Panasonic Corp | Robot device, robot control method, robot control program and robot system |
| CN103631221A (en) * | 2013-11-20 | 2014-03-12 | 华南理工大学广州学院 | Teleoperated service robot system |
| CN104385273A (en) * | 2013-11-22 | 2015-03-04 | 嘉兴市德宝威微电子有限公司 | Robot system and synchronous performance control method thereof |
| CN106249711A (en) * | 2016-08-03 | 2016-12-21 | 海南警视者科技开发有限公司 | A kind of Multifunctional intelligent robot |
| US20160379107A1 (en) * | 2015-06-24 | 2016-12-29 | Baidu Online Network Technology (Beijing) Co., Ltd. | Human-computer interactive method based on artificial intelligence and terminal device |
| CN106335058A (en) * | 2016-10-12 | 2017-01-18 | 北京光年无限科技有限公司 | Multi-mode interacting method applied to intelligent robot system and intelligent robots |
| CN106406119A (en) * | 2016-11-15 | 2017-02-15 | 福州大学 | Service robot based on voice interaction, cloud technology and integrated intelligent home monitoring |
-
2017
- 2017-03-16 CN CN201710157932.0A patent/CN107122040A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101391147A (en) * | 2008-11-06 | 2009-03-25 | 北京中星微电子有限公司 | Remote control robot game system |
| JP2013099823A (en) * | 2011-11-09 | 2013-05-23 | Panasonic Corp | Robot device, robot control method, robot control program and robot system |
| CN103631221A (en) * | 2013-11-20 | 2014-03-12 | 华南理工大学广州学院 | Teleoperated service robot system |
| CN104385273A (en) * | 2013-11-22 | 2015-03-04 | 嘉兴市德宝威微电子有限公司 | Robot system and synchronous performance control method thereof |
| US20160379107A1 (en) * | 2015-06-24 | 2016-12-29 | Baidu Online Network Technology (Beijing) Co., Ltd. | Human-computer interactive method based on artificial intelligence and terminal device |
| CN106249711A (en) * | 2016-08-03 | 2016-12-21 | 海南警视者科技开发有限公司 | A kind of Multifunctional intelligent robot |
| CN106335058A (en) * | 2016-10-12 | 2017-01-18 | 北京光年无限科技有限公司 | Multi-mode interacting method applied to intelligent robot system and intelligent robots |
| CN106406119A (en) * | 2016-11-15 | 2017-02-15 | 福州大学 | Service robot based on voice interaction, cloud technology and integrated intelligent home monitoring |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107678743A (en) * | 2017-09-27 | 2018-02-09 | 北京酷思倍科技有限公司 | A kind of method for intelligent robot programming |
| CN107678743B (en) * | 2017-09-27 | 2020-11-03 | 北京酷思倍科技有限公司 | Method for intelligent programming of robot |
| CN107817799A (en) * | 2017-11-03 | 2018-03-20 | 北京光年无限科技有限公司 | The method and system of intelligent interaction are carried out with reference to virtual maze |
| CN108198559A (en) * | 2018-01-26 | 2018-06-22 | 上海萌王智能科技有限公司 | A kind of voice control robot system for learning action |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Vasilevski et al. | Analysing construction student experiences of mobile mixed reality enhanced learning in virtual and augmented reality environments | |
| Hughes et al. | Mixed reality in education, entertainment, and training | |
| JP5416057B2 (en) | Augmented reality providing terminal and method | |
| CN106875764A (en) | Network virtual reality foreign language learning system and control method | |
| CN106781755A (en) | A kind of tutoring system and method based on virtual reality | |
| CN109333544B (en) | Doll interaction method for marionette performance participated by audience | |
| US20080268408A1 (en) | Method for improving the emotional quotient in infants and children | |
| Baranauskas et al. | Tangible and shared storytelling: Searching for the social dimension of constructionism | |
| Donally | Learning transported: Augmented, virtual and mixed reality for all classrooms | |
| Aidinlou et al. | Applications of robot assisted language learning (RALL) in language learning and teaching | |
| CN111862711A (en) | Entertainment and leisure learning device based on 5G internet of things virtual reality | |
| CN107122040A (en) | A kind of interactive system between artificial intelligence robot and intelligent display terminal | |
| Parmar | Evaluating the effects of immersive embodied interaction on cognition in virtual reality | |
| Eden | Technology Makes Things Possible | |
| Dow | Understanding user engagement in immersive and interactive stories | |
| Pell | Envisioning holograms: design breakthrough experiences for mixed reality | |
| Posada et al. | A socio-constructionist environment to create stories using tangible interfaces | |
| Gwynne | Co-Creating with the Senses: Towards an Embodiment Grammar for Conceptualising Virtual Reality (VR) Narrative Design | |
| Swander | In our time: Such audiences we wish him | |
| Jo et al. | Development and utilization of projector-robot service for children's dramatic play activities based on augmented reality | |
| Beever | Exploring Mixed Reality Level Design Workflows | |
| Bazalgette | How Toddlers Learn the Secret Language of Movies | |
| TWI470474B (en) | Teaching apparatus and teaching method based on digital board game | |
| MAFESSONI | Educational cooperative play in wearable virtual reality for persons with neurodevelopmental disorders | |
| Wang et al. | Design and Evaluation of a Virtual Simulation System for Huangmei Opera |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200922 Address after: No.86, shenta Shenlong Road, Lili Town, Wujiang District, Suzhou City, Jiangsu Province Applicant after: SUZHOU AOGUAN INTELLIGENT EQUIPMENT Co.,Ltd. Address before: 311121 room 101-37, building, No. 1399, Hao Rong Road, Yuhang District, Zhejiang, China Applicant before: HANGZHOU DEBAOWEI INTELLIGENT TECHNOLOGY Co.,Ltd. |