CN106182006B - Chess and card interaction data processing method towards intelligent robot and device - Google Patents

Chess and card interaction data processing method towards intelligent robot and device Download PDF

Info

Publication number
CN106182006B
CN106182006B CN201610648281.0A CN201610648281A CN106182006B CN 106182006 B CN106182006 B CN 106182006B CN 201610648281 A CN201610648281 A CN 201610648281A CN 106182006 B CN106182006 B CN 106182006B
Authority
CN
China
Prior art keywords
card
chess
decision
user
scene
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610648281.0A
Other languages
Chinese (zh)
Other versions
CN106182006A (en
Inventor
黄钊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Guangnian Wuxian Technology Co Ltd
Original Assignee
Beijing Guangnian Wuxian Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Guangnian Wuxian Technology Co Ltd filed Critical Beijing Guangnian Wuxian Technology Co Ltd
Priority to CN201610648281.0A priority Critical patent/CN106182006B/en
Publication of CN106182006A publication Critical patent/CN106182006A/en
Application granted granted Critical
Publication of CN106182006B publication Critical patent/CN106182006B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1694Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697Vision controlled systems
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00Manipulators not otherwise provided for
    • B25J11/003Manipulators for entertainment
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1656Programme controls characterised by programming, planning systems for manipulators
    • B25J9/1661Programme controls characterised by programming, planning systems for manipulators characterised by task planning, object-oriented languages

Abstract

The present invention provides a kind of chess and card interaction data processing method and device towards intelligent robot, and this approach includes the following steps:Chess and card scene obtaining step, obtain in face of chess and card and participate in the corresponding image information of chess and card shown of user of chess/card game, and carry out image recognition to obtain current chess and card scene;Decision generates step, and decision of playing a card is carried out based on the chess and card scene information received and in conjunction with chess and card rule base;Decision executes step, and decision of playing a card described in execution simultaneously exports corresponding multi-modal expression.The present invention can make robot imitate all kinds of chess/card games of mankind's progress, to can more meet the needs of user especially old man is to company.

Description

Chess and card interaction data processing method towards intelligent robot and device
Technical field
The present invention relates to field in intelligent robotics, specifically, being related to a kind of chess and card interaction number towards intelligent robot According to processing method and processing device.
Background technology
Current robot industry development is rapid, various family lives occurs and accompanies class robot.There is one kind Accompany robot that can achieve the purpose that company by playing all kinds of chess/card games with user.For example, for the old man of China, have The hobby for equal chess and card games project of playing Mah-Jong.And this kind of game needs more people to participate in carry out.
Thus, it is necessary to which a kind of technical solution that can imitate the tangible machine people that the mankind carry out all kinds of chess/card games is set Meter, so that this kind of tangible machine people can more meet the needs of user especially old man is to company.
Invention content
Prior art problem to be solved by this invention is to need offer one kind that robot can be made to imitate the mankind to carry out respectively The solution of class chess/card game.
To solve the above-mentioned problems, the embodiment of the present invention provides firstly a kind of chess and card interaction number towards intelligent robot According to processing method, the described method comprises the following steps:Chess and card scene obtaining step, obtain in face of chess and card and participate in chess and card trip The corresponding image information of chess and card that the user of play shows, and image recognition is carried out to obtain current chess and card scene;Decision generates step Suddenly, decision of playing a card is carried out based on chess and card scene information and in conjunction with chess and card rule base;Decision executes step, decision of playing a card described in execution And export corresponding multi-modal expression.
Preferably, after identifying the chess and card image information, the voice that the user to participating in chess/card game sends out carries out Identification, is corrected with the image recognition result of the chess and card shown the user.
Preferably, the method further includes user's identification step, and the image for capturing each user for participating in chess/card game is special It seeks peace orientation, is collected simultaneously the voice that the user sends out, and carry out speech recognition to obtain the intention of the user.
Preferably, in decision executes step, the multi-modal expression exported includes one of the following or combination:
It is output by voice the content for decision of playing a card;
The conversation sentence corresponding with chess and card scene being output by voice in conjunction with specific dialogue library;
Decision of playing a card is exported by showing the action of chess and card.
Preferably, the method further includes playing board step before chess and card scene obtaining step, in this step, identification Go out the position for the chess and card piled up in public domain, and chess and card are obtained by kinetic control system control machinery arm.
According to a further aspect of the invention, a kind of chess and card interaction data processing unit towards intelligent robot is additionally provided, Described device includes:Chess and card scene input unit, the chess and card being used in face of acquisition and the user for participating in chess/card game show The corresponding image information of chess and card, and carry out image recognition to obtain current chess and card scene;Decision generates unit, is used to be based on Chess and card scene information simultaneously carries out decision of playing a card in conjunction with chess and card rule base;Decision execution unit is used to execute the decision of playing a card And export corresponding multi-modal expression.
Preferably, the chess and card scene input unit is after identifying the chess and card image information, to participating in chess/card game The voice that sends out of user be identified, corrected with the image recognition result of the chess and card shown the user.
Preferably, described device further includes user identification unit, is used to capture each user's for participating in chess/card game Image characteristics and orientation are collected simultaneously the voice that the user sends out, and carry out speech recognition to obtain the intention of the user.
Preferably, in decision execution unit, the multi-modal expression exported includes one of the following or combination:
It is output by voice the content for decision of playing a card;
The conversation sentence corresponding with chess and card scene being output by voice in conjunction with specific dialogue library;
Decision of playing a card is exported by showing the action of chess and card.
Preferably, described device has further included board unit, goes out the position for the chess and card piled up in public domain for identification It sets, and chess and card is obtained by kinetic control system control machinery arm.
Compared with prior art, one or more of said program embodiment can have the following advantages that or beneficial to effect Fruit:
The embodiment of the present invention is corresponding by the chess and card that the user of chess and card and participation chess/card game in face of acquisition shows Image information, and carry out image recognition to obtain current chess and card scene, be then based on received chess and card scene information and tie It closes chess and card rule base and carries out decision of playing a card, finally execute and play a card decision and export corresponding multi-modal expression, robot can be made It imitates the mankind and carries out all kinds of chess/card games, to can more meet the needs of user especially old man is to company.
Other features and advantages of the present invention will be illustrated in the following description, also, partly becomes from specification It obtains it is clear that understand through the implementation of the invention.The purpose of the present invention and other advantages can be by specification, rights Specifically noted structure is realized and is obtained in claim and attached drawing.
Description of the drawings
Attached drawing is used to provide further understanding of the present invention, and a part for constitution instruction, the reality with the present invention It applies example and is used together to explain the present invention, be not construed as limiting the invention.In the accompanying drawings:
Fig. 1 is that the flow of the according to embodiments of the present invention one chess and card interaction data processing method towards intelligent robot is shown It is intended to;
Fig. 2 is that the flow of the according to embodiments of the present invention two chess and card interaction data processing method towards intelligent robot is shown It is intended to;
Fig. 3 is the structural frames of the according to embodiments of the present invention three chess and card interaction data processing unit towards intelligent robot Figure.
Specific implementation mode
To make the object, technical solutions and advantages of the present invention clearer, the embodiment of the present invention is made below in conjunction with attached drawing Further it is described in detail.
(embodiment one)
Fig. 1 is that the flow of the according to embodiments of the present invention one chess and card interaction data processing method towards intelligent robot is shown It is intended to, each step of the present embodiment is illustrated below with reference to Fig. 1.
In step s 110, the corresponding image of chess and card that the user of chess and card and participation chess/card game in face of obtaining shows Information, and image recognition is carried out to obtain current chess and card scene.
This step is to obtain the currently owned chess and card information of robot and participate in the use of chess/card game on the table The chess and card information that family has shown.
Specifically, it when robot each time plays board, obtains robot by using the camera of robot and rises Chess and card picture and parsed to obtain the currently owned chess and card information of robot.And it is every in the user for participating in chess/card game It is secondary when show chess and card, and obtain corresponding picture by using the camera of robot and parsed to obtain phase The chess and card information answered.Finally it is input to the chess and card information got as current chess and card scene in robot.
It should be noted that generally will include other objects in addition to the chess and card figure for needing to identify in the picture obtained, Therefore it needs to parse the picture.When carrying out image recognition, picture is carried out analysis to obtain only including the chess that need to be identified Then the picture of board figure determines the board formula representated by the chess and card figure for needing identification in picture.Generally to the chess and card in picture The board formula of figure need to be related to during being determined image preprocessing, image segmentation, Feature selection and extraction and Be identified and etc..
Then, matching picture is searched from the picture base area of the related chess and card of storage, acquisition need to identify chess and card figure Picture and the similarity of each section of each picture determine whether the matching figure to be searched according to the similarity of each section Piece.Similarity is higher, then matching degree is higher, therefore, using the highest picture of matching degree as the picture with chess and card figure to be identified The picture to match.
Chess and card when after finding matched chess and card graphic pictures in picture base area, obtaining robot and currently playing board Board formula or participate in the corresponding board formula of chess and card currently shown of user of chess/card game.For example, carrying out mahjong class chess/card game In, the board formula of similar " east wind ", " x cakes ", " x items ", " x ten thousand " etc. can be obtained.
Finally, it is current that the board formula for the chess and card in face of robot that can be identified according to this and before obtains robot All chess and card information possessed, and participate in the board formula of chess and card that the user of chess/card game has shown.
In the step s 120, decision of playing a card is carried out based on chess and card scene information and in conjunction with chess and card rule base.
Specifically, the purpose of this step is:Robot how to judge after the board for taking oneself oneself will with how Mode come the maximum probability won.By taking mahjong as an example, " triumph " at this time refers to " winning the game ", i.e., according to the board in oneself hand, certainly The board etc. that oneself and opponent have thrown and (shown), to determine oneself to stay what board and what board gone out, if this is touched or thick stick etc. Deng.
When carrying out mahjong chess/card game, by using high in the clouds mahjong AI decision systems, according to the chess and card scene received Information carries out decision of playing a card.Beyond the clouds in mahjong AI decision systems, it can generally store to win the game and judge the basic structure of basic boom, hands Frame, eat the ephemeral data framework for touching thick stick Hu, standard wins the game and judges that algorithm and mahjong kind figure method etc..Receiving chess and card scene letter After breath, decision of suitably playing a card is selected from the mahjong AI decision systems of high in the clouds.
In step s 130, it executes and plays a card decision and export corresponding multi-modal expression.
Specifically, in this step, the multi-modal expression exported includes one of the following or combination:(1) pass through language Sound is played a card the content of decision;(2) specific dialogue library is combined to be output by voice corresponding with chess and card scene to language Sentence;(3) decision of playing a card is exported by showing the action of chess and card.Below by taking mahjong as an example, illustrate respectively above-mentioned three kinds it is multi-modal Expression-form.
In (1) multi-modal expression-form, robot can bark out the content of policy decision of oneself, such as robot by voice It can say " beat XX, eat, touch, recklessly " etc..
In (2) multi-modal expression-form, it is relevant can to say some mahjong occasions in conjunction with mahjong question and answer/dialogue library The voice of the conversation sentence of user, such as " playing a card as soon as possible, I thanks at equal flower " etc of talking in professional jargon.Can certainly be one As property chat conversations or information inquiries such as weather etc..
It, can be in conjunction with (1) and (2), while carrying out voice output, with matching in (3) multi-modal expression-form The action of set exports, and when it is to win the game state that current chess and card, which are presented, robot can pass through voice mode output " Hu on one side " sound, chess and card in front are pushed over mechanical arm on one side.
It certainly, can also be by the picture (head portrait) of some relatives and friends, oral for truer, interesting user experience Buddhist, sound effect etc. carry out individual cultivation.Or robot can be by head screen (or mechanical type) eyes, face Deng, express the expression emotion of oneself, such as win bridge queen happiness and defeated bridge queen it is dejected.
The embodiment of the present invention can make robot imitate all kinds of chess/card games of mankind's progress, to more meet user especially It is demand of the old man to company.For example, when playing Mah-Jong, due to needing 4 people, when gathering uneven number, machine when amusement Device people can accompany old man to entertain by executing above-mentioned steps, produce absorbing Product Experience effect.
(embodiment two)
Fig. 2 is that the flow of the according to embodiments of the present invention two chess and card interaction data processing method towards intelligent robot is shown It is intended to, which is the preferred embodiment of the present invention.
As shown in Fig. 2, other than the present embodiment two is in addition to embodiment one to be executed the step of, it is also necessary to execute step S200, Step S220 and step S240.Since step S110, step S120 and step S130 have been illustrated in embodiment one, Details are not described herein again, and only step S200, step S220 and step S240 are described in detail.
It is readily appreciated that, has further included board step S200 before chess and card scene obtaining step S110, in step s 200, know Do not go out the position for the chess and card piled up in public domain, and chess and card are obtained by kinetic control system control machinery arm.
Specifically, by taking mahjong chess and card as an example, present embodiment assumes that chess and card are good by code, by the camera of robot come Identify that the position for the chess and card piled up in public domain, robot can pick up chess and card by mechanical arm and palm, and It is erect according to common rule and places.
In this step, position that chess and card are piled up is judged using machine vision technique.Specifically, it can will be ingested Target is converted into picture signal, sends dedicated image processing system to, according to the information such as pixel distribution and brightness, color, turns Become digitized signal;Picture system carries out various operations to extract clarification of objective, and then according to differentiation to these signals As a result the action of robot is controlled.In addition, in other embodiments, if mahjong chess and card are not good by code, the machine of the present invention Device people oneself can also shuffle and code board.Technology contents are similar used by the technical principle specifically used plays board with robot, this Place repeats no more.
After identifying chess and card image information, step S220 is also carried out.
In step S220, in order to obtain accurately current chess and card scene information, also the user for participating in chess/card game is sent out The voice gone out is identified, and is corrected with the image recognition result of the chess and card shown the user.
Under normal circumstances, during chess and card games, user can also export while showing chess and card about the chess Some information of board.For example, when playing Mah-Jong, user can say " east wind ", " x cakes ", " x items ", " x ten thousand " simultaneously when throwing away board Equal voice messagings.
If only identifying the information of chess and card that user shows by the method for image recognition, when being thrown due to chess and card State and generate the error in image recognition result.Speech recognition is carried out by the voice to user, it can be to the chess and card of mistake Image recognition result is corrected.In this way, to robot later according to current chess and card scene information combination chess and card rule base into Row play a card decision when, increase in accuracy, so improve user recreation experience degree.
Further, the present embodiment further includes step S240.
In step S240, the image characteristics and orientation of each user for participating in chess/card game are captured, user is collected simultaneously The voice sent out, and speech recognition is carried out to obtain the intention of the user.
Specifically, image characteristics (especially face), the side of current every participant are captured by the camera of robot Position.Meanwhile every participant's one's voice in speech information is collected by the microphone of robot, and utilize local+high in the clouds voice Identification and semantic understanding process, can understand the intention of each participant.
The content of the current chess and card scene information of acquisition can be made more abundant by the step, based on being received Chess and card scene information and in conjunction with chess and card rule base play a card decision when, more accurately.
The embodiment of the present invention can make robot imitate all kinds of chess/card games of mankind's progress, more when play a card decision Accurately, so as to improve the recreation experience of user, can more meet the needs of user especially old man is to company.
The method using the present embodiment is illustrated how by taking mahjong as an example below to realize that robot imitates the mankind and user It plays Mah-Jong.
1) placement mahjong robot.Mahjong robot is put on the seat of vacancy, and adjusts height so that robot head Portion's (screen or mechanical type) is highly as true man.
2) board is played.Assuming that mahjong table is automatic Mah-jongg machine, robot identifies the position of mahjong by camera, passes through machinery Arm and palm are placed to pick up mah-jong pieces according to common rule setting.If mahjong table is not automatic Mah-jongg machine, machine People oneself can also shuffle, code board and play board.
3) mahjong information is identified.By camera, robot can identify the current mah-jong pieces oneself gathered around information and The information for the mah-jong pieces that others gets on desktop.In addition, in the process, it is synchronous to identify everybody word (sound), Zhen Renyong Family very maximum probability can say the content of mah-jong pieces, can rectify a deviation whereby to the result of mah-jong pieces identification.
4) recognition user information.By camera, robot can identify image (the especially face of current every participant Portion), orientation.By microphone, robot can collect every participant's one's voice in speech information.Known by local+high in the clouds voice Not+semantic understanding process can understand the intention of corresponding participant.
5) it plays a card decision.By the mahjong information identified in 3) and 4) pass through the user information combination cloud identified in The mahjong algorithm and mahjong AI systems at end, the decision of output system are intended to, such as play what board, eat, touch, recklessly etc..
6) it is played Mah-Jong according to decision of playing a card.According to decision conclusions, robot is by mechanical arm come (mobile fiber crops of playing card By board)
7) anthropomorphic multi-modal expression is carried out according to decision of playing a card.
A) in terms of voice.Robot can bark out the content of policy decision of oneself, for example, beat XX, eat, touch, recklessly etc.);It says The language of the relevant user that talks in professional jargon of mahjong occasion (these language come from mahjong question and answer/dialogue library);Carry out general chat pair The information inquiries such as words or weather.
B) in terms of expression.Robot can express oneself by the eyes, face etc. of head screen (or mechanical type) Expression emotion.
C) act, in conjunction with A), B), can have mating action output.
D) for truer, interesting user experience, can also by the picture (head portrait) of some relatives and friends, pet phrase, Sound effect etc. carries out individual cultivation.
(embodiment three)
Fig. 3 is the structural frames of the according to embodiments of the present invention three chess and card interaction data processing unit towards intelligent robot Figure, each structure and function of the present apparatus is described in detail below with reference to Fig. 3.The chess and card towards intelligent robot of the present embodiment Interaction data processing unit 300 includes mainly:Chess and card scene acquiring unit 310, decision generate unit 320, decision execution unit 330, user identification unit 340 and board unit 350.
Board unit 350 is played, goes out the position for the chess and card piled up in public domain for identification, and pass through motion control system Control machinery arm of uniting obtains chess and card.By taking mahjong chess and card as an example, present embodiment assumes that chess and card are good by code, board unit 350 is played The position for identifying the chess and card piled up in public domain, allows the robot to pick up chess and card by mechanical arm and palm, And it is erect according to common rule and places.Board unit 350 judges the position that chess and card are piled up using machine vision technique.
What chess and card scene acquiring unit 310, the chess and card being used in face of acquisition and the user for participating in chess/card game showed The corresponding image information of chess and card, and image recognition is carried out to obtain current chess and card scene.
Specifically, when robot each time plays board, chess and card scene acquiring unit 310 obtains robot and acts the chess of going out The picture of board simultaneously is parsed to obtain the currently owned chess and card information of robot.And go out every time in the user for participating in chess/card game When showing chess and card, chess and card scene acquiring unit 310 also obtains corresponding picture and is parsed to obtain corresponding chess and card Information.Finally, the chess and card information got is input to robot by chess and card scene acquiring unit 310 In.
When carrying out image recognition, analysis is carried out to picture and is obtained only including the picture for the chess and card figure that need to be identified, then Determine the board formula representated by the chess and card figure for needing identification in picture.Generally it is determined in the board formula to the chess and card figure in picture During need to be related to image preprocessing, image segmentation, Feature selection and extraction and be identified.
Then, matching picture is searched from the picture base area of the related chess and card of storage, acquisition need to identify chess and card figure Picture and the similarity of each section of each picture determine whether the matching figure to be searched according to the similarity of each section Piece.Similarity is higher, then matching degree is higher, therefore, using the highest picture of matching degree as the picture with chess and card figure to be identified The picture to match.
Chess and card when after finding matched chess and card graphic pictures in picture base area, obtaining robot and currently playing board Board formula or participate in the corresponding board formula of chess and card currently shown of user of chess/card game.For example, carrying out mahjong class chess/card game In, the board formula of similar " east wind ", " x cakes ", " x items ", " x ten thousand " etc. can be obtained.
Finally, the chess and card in face of robot that chess and card scene acquiring unit 310 can be identified according to this and before Board formula obtain the currently owned all chess and card information of robot, and participate in the board for the chess and card that the user of chess/card game has shown Formula.
In order to obtain accurately current chess and card scene information, chess and card scene acquiring unit 310 is in identification chess and card image information Later, the voice sent out to the user for participating in chess/card game is identified, with the image recognition knot of the chess and card shown the user Fruit is corrected.
Chess and card scene acquiring unit 310 carries out speech recognition by the voice to user, can be to the chess and card image of mistake Recognition result is corrected.In this way, being gone out according to current chess and card scene information combination chess and card rule base to robot later It when board decision, increases in accuracy, and then improves the recreation experience degree of user.
User identification unit 340 is used to capture the image characteristics and orientation of each user for participating in chess/card game, simultaneously The voice that the user sends out is collected, and carries out speech recognition to obtain the intention of the user.User identification unit 340 can make The content of the current chess and card scene information obtained is more abundant, based on the chess and card scene information and combination chess and card rule received Library play a card decision when, more accurately.
Decision generates unit 320, is used to carry out decision of playing a card based on chess and card scene information and in conjunction with chess and card rule base.
When carrying out mahjong chess/card game, decision generates unit 320 by using high in the clouds mahjong AI decision systems, according to institute The chess and card scene information of reception carries out decision of playing a card.Beyond the clouds in mahjong AI decision systems, it is basic generally to store judgement of winning the game Framework, hands basic boom, eat the ephemeral data framework for touching thick stick Hu, standard wins the game and judges that algorithm and mahjong kind figure method etc..Certainly Plan generates unit 320 after receiving chess and card scene information, and decision of suitably playing a card is selected from the mahjong AI decision systems of high in the clouds.
Decision execution unit 330 is used to execute and plays a card decision and export corresponding multi-modal expression.
In decision execution unit 330, the multi-modal expression exported includes one of the following or combination:Pass through voice The content for decision of playing a card;The conversation sentence corresponding with chess and card scene being output by voice in conjunction with specific dialogue library;It is logical It crosses and shows the action of chess and card to export decision of playing a card.
The embodiment of the present invention can make robot imitate all kinds of chess/card games of mankind's progress, to more meet user especially It is demand of the old man to company.For example, when playing Mah-Jong, due to needing 4 people, when gathering uneven number, machine when amusement Device people can accompany old man to entertain.
While it is disclosed that embodiment content as above but described only to facilitate understanding the present invention and adopting Embodiment is not limited to the present invention.Any those skilled in the art to which this invention pertains are not departing from this Under the premise of the disclosed spirit and scope of invention, any modification and change can be made in the implementing form and in details, But the scope of patent protection of the present invention, still should be subject to the scope of the claims as defined in the appended claims.

Claims (8)

1. a kind of chess and card interaction data processing method towards intelligent robot, which is characterized in that the method includes following steps Suddenly:
Chess and card scene obtaining step, obtain in face of chess and card and participate in the corresponding image of chess and card that shows of user of chess/card game Information, and image recognition is carried out to obtain current chess and card scene, after identifying the chess and card image information, to participating in chess and card trip The voice that the user of play sends out is identified, and is corrected with the image recognition result of the chess and card shown the user;
Decision generates step, and decision of playing a card is carried out based on the chess and card scene information and in conjunction with chess and card rule base;
Decision executes step, and decision of playing a card described in execution simultaneously exports corresponding multi-modal expression.
2. the chess and card interaction data processing method towards intelligent robot as described in claim 1, which is characterized in that the side Method further includes user's identification step, captures the image characteristics and orientation of each user for participating in chess/card game, is collected simultaneously described The voice that user sends out, and speech recognition is carried out to obtain the intention of the user.
3. the chess and card interaction data processing method towards intelligent robot as described in claim 1, which is characterized in that in decision It executes in step, the multi-modal expression exported includes one of the following or combination:
It is output by voice the content for decision of playing a card;
The conversation sentence corresponding with chess and card scene being output by voice in conjunction with specific dialogue library;
Decision of playing a card is exported by showing the action of chess and card.
4. the chess and card interaction data processing method as claimed in any one of claims 1-3 towards intelligent robot, feature It is, the method further includes that the board step that rises before chess and card scene obtaining step identifies public domain in this step The position of middle piled up chess and card, and chess and card are obtained by kinetic control system control machinery arm.
5. a kind of chess and card interaction data processing unit towards intelligent robot, which is characterized in that described device includes:
The chess and card that chess and card scene input unit, the chess and card being used in face of acquisition and the user for participating in chess/card game show correspond to Image information, and image recognition is carried out to obtain current chess and card scene, after identifying the chess and card image information, to participating in The voice that the user of chess/card game sends out is identified, and is corrected with the image recognition result of the chess and card shown the user;
Decision generates unit, is used to carry out decision of playing a card based on the chess and card scene information and in conjunction with chess and card rule base;
Decision execution unit is used to execute described play a card and decision and exports corresponding multi-modal expression.
6. the chess and card interaction data processing unit towards intelligent robot as claimed in claim 5, which is characterized in that the dress It further includes user identification unit to set, and is used to capture the image characteristics and orientation of each user for participating in chess/card game, receives simultaneously Collect the voice that the user sends out, and carries out speech recognition to obtain the intention of the user.
7. the chess and card interaction data processing unit towards intelligent robot as claimed in claim 5, which is characterized in that in decision In execution unit, the multi-modal expression exported includes one of the following or combination:
It is output by voice the content for decision of playing a card;
The conversation sentence corresponding with chess and card scene being output by voice in conjunction with specific dialogue library;
Decision of playing a card is exported by showing the action of chess and card.
8. the chess and card interaction data processing unit towards intelligent robot as described in any one of claim 5-7, feature It is, described device has further included board unit, goes out the position for the chess and card piled up in public domain for identification, and passes through fortune Autocontrol system control machinery arm obtains chess and card.
CN201610648281.0A 2016-08-09 2016-08-09 Chess and card interaction data processing method towards intelligent robot and device Active CN106182006B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610648281.0A CN106182006B (en) 2016-08-09 2016-08-09 Chess and card interaction data processing method towards intelligent robot and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610648281.0A CN106182006B (en) 2016-08-09 2016-08-09 Chess and card interaction data processing method towards intelligent robot and device

Publications (2)

Publication Number Publication Date
CN106182006A CN106182006A (en) 2016-12-07
CN106182006B true CN106182006B (en) 2018-07-27

Family

ID=57514676

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610648281.0A Active CN106182006B (en) 2016-08-09 2016-08-09 Chess and card interaction data processing method towards intelligent robot and device

Country Status (1)

Country Link
CN (1) CN106182006B (en)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107019901B (en) * 2017-03-31 2020-10-20 北京大学深圳研究生院 Method for establishing chess and card game automatic gaming robot based on image recognition and automatic control
CN107729983B (en) * 2017-09-21 2021-06-25 北京深度奇点科技有限公司 Method and device for realizing man-machine chess playing by using machine vision and electronic equipment
CN107875625A (en) * 2017-11-23 2018-04-06 东华大学 A kind of voice-based Chinese chess is played chess device
CN108079570B (en) * 2017-12-29 2021-04-30 重庆柚瓣家科技有限公司 Endowment robot based on suitable old game
CN108764447A (en) * 2018-05-16 2018-11-06 西安交通大学 A kind of group robot Majiang game intelligence dynamicization system and mahjong identification learning algorithm
CN111376248B (en) * 2018-12-28 2022-04-15 深圳市优必选科技有限公司 Robot, robot decision method and terminal equipment
CN109760067B (en) * 2019-01-22 2021-05-07 中国科学院大学 Intelligent robot system and equipment capable of playing cards
CN110570851A (en) * 2019-07-31 2019-12-13 中至数据集团股份有限公司 voice recognition card playing control method and system, mobile terminal and storage medium
CN110569900A (en) * 2019-09-05 2019-12-13 苏州大禹网络科技有限公司 game AI decision-making method and device
CN112843670A (en) * 2021-01-08 2021-05-28 成都雀豪机电设备有限公司 Intelligent chess and card information prompting method
CN113101673B (en) * 2021-03-30 2024-02-09 北京达佳互联信息技术有限公司 Live interaction processing method, device and server
CN113546399B (en) * 2021-07-30 2024-01-23 重庆五诶科技有限公司 Chess and card game data acquisition system and method based on artificial intelligence algorithm

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2897353Y (en) * 2006-03-31 2007-05-09 上海科技馆 Man-machine chessing device
KR20090125885A (en) * 2008-06-03 2009-12-08 표성백 The robot arm and system have a fucntion which is able to play board games with person
DE102009008914A1 (en) * 2009-02-13 2010-08-19 Gärtner, Fabian Arrangement for replacing human team-mates for playing e.g. chess, has computer with program for calculating game movement of robot and evaluating and displaying game movements of other human team-mates
US7893646B2 (en) * 2003-02-26 2011-02-22 Silverbrook Research Pty Ltd Game system with robotic game pieces
CN103252077A (en) * 2012-10-26 2013-08-21 上海未来伙伴机器人有限公司 Chess playing robot
CN103802111A (en) * 2013-12-23 2014-05-21 北京晨鑫意科技有限公司 Chess playing robot
CN104290097A (en) * 2014-08-19 2015-01-21 白劲实 Learning type intelligent home social contact robot system and method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7893646B2 (en) * 2003-02-26 2011-02-22 Silverbrook Research Pty Ltd Game system with robotic game pieces
CN2897353Y (en) * 2006-03-31 2007-05-09 上海科技馆 Man-machine chessing device
KR20090125885A (en) * 2008-06-03 2009-12-08 표성백 The robot arm and system have a fucntion which is able to play board games with person
DE102009008914A1 (en) * 2009-02-13 2010-08-19 Gärtner, Fabian Arrangement for replacing human team-mates for playing e.g. chess, has computer with program for calculating game movement of robot and evaluating and displaying game movements of other human team-mates
CN103252077A (en) * 2012-10-26 2013-08-21 上海未来伙伴机器人有限公司 Chess playing robot
CN103802111A (en) * 2013-12-23 2014-05-21 北京晨鑫意科技有限公司 Chess playing robot
CN104290097A (en) * 2014-08-19 2015-01-21 白劲实 Learning type intelligent home social contact robot system and method

Also Published As

Publication number Publication date
CN106182006A (en) 2016-12-07

Similar Documents

Publication Publication Date Title
CN106182006B (en) Chess and card interaction data processing method towards intelligent robot and device
CN108900920B (en) Live broadcast processing method, device, equipment and storage medium
JP7253570B2 (en) Contextual in-game element recognition, annotation and interaction based on remote user input
CN102947777B (en) Usertracking feeds back
CN105413198B (en) AR children's early education modular systems
JP5827007B2 (en) Game program, image processing apparatus, image processing system, and image processing method
US8210945B2 (en) System and method for physically interactive board games
CN108245891B (en) Head-mounted equipment, game interaction platform and table game realization system and method
CN106710590A (en) Voice interaction system with emotional function based on virtual reality environment and method
CN102449576A (en) Gesture shortcuts
CN105169697A (en) Mahjong tile winning control method and system based on mobile terminal
CN105854289A (en) Suspended projection game and study system
CN109286822A (en) Interactive approach, device, equipment and storage medium based on live video identification
CN103405911A (en) Method and system for prompting mahjong draws
JP7344948B2 (en) system
KR101879059B1 (en) Board game tool
CN110308787A (en) The AR interaction systems and method of a kind of multidimensional interactive identification in conjunction with chess/card game
CN206400471U (en) A kind of virtual puzzle system based on AR technologies
CN107145230A (en) A kind of Gamecontrol system and method based on face with speech recognition
CN113347400B (en) Interesting projection system for children dance match and using method thereof
JP5318016B2 (en) GAME SYSTEM, GAME SYSTEM CONTROL METHOD, AND PROGRAM
Rinman et al. Ghost in the cave–An interactive collaborative game using non-verbal communication
CN112560872A (en) Multimode perception mahjong assisting method based on artificial intelligence
CN113209599A (en) Playing method and system based on robot interaction, equipment and readable medium
CN108057246A (en) Hand based on deep neural network study swims augmented reality method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant