CN109920347A - A kind of movement or expression simulator and method based on magnetic liquid - Google Patents

A kind of movement or expression simulator and method based on magnetic liquid Download PDF

Info

Publication number
CN109920347A
CN109920347A CN201910162342.6A CN201910162342A CN109920347A CN 109920347 A CN109920347 A CN 109920347A CN 201910162342 A CN201910162342 A CN 201910162342A CN 109920347 A CN109920347 A CN 109920347A
Authority
CN
China
Prior art keywords
magnetic liquid
area
expression
movement
host computer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910162342.6A
Other languages
Chinese (zh)
Other versions
CN109920347B (en
Inventor
谢磊
张永浩
邓嘉阳
罗萱
李兵
王聿浩
杨涛
李佩
廖昌荣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing University
Original Assignee
Chongqing University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing University filed Critical Chongqing University
Priority to CN201910162342.6A priority Critical patent/CN109920347B/en
Publication of CN109920347A publication Critical patent/CN109920347A/en
Application granted granted Critical
Publication of CN109920347B publication Critical patent/CN109920347B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The invention discloses a kind of movement based on magnetic liquid or expression simulator and methods, wherein simulator includes video camera, for shooting human action or expression;Magnetic liquid demonstrator, including act the leading role show area and it is multiple around it is described protagonist show circumferentially equally distributed external presentation area, area;Host computer, signal connect the controller of the video camera Yu magnetic liquid demonstrator;Analogy method is the following steps are included: s1. shoots the image of human action or expression by the video camera, and image is passed to the host computer;S2. the movement or facial expression image, the movement or expression that will identify that host computer identification takes are encoded, and by coding transmission to the controller of magnetic liquid demonstrator;S3. the controller of the magnetic liquid demonstrator generates corresponding control signal according to the coding, and the protagonist is made to show that the magnetic liquid in area and external presentation area generates the fluctuations for characterizing movement corresponding to the coding or expression.

Description

A kind of movement or expression simulator and method based on magnetic liquid
Technical field
The present invention relates to demonstration instrument field more particularly to a kind of movement or expression simulator based on magnetic liquid and Method.
Background technique
Artificial intelligence is a branch of computer science, it sounds out intelligent essence, and is produced a kind of new The intelligence machine that can be made a response in such a way that human intelligence is similar, the research in the field include robot, language identification, image Identification, natural language processing and expert system etc..With the development of intelligence machine and artificial intelligence, computer sentiment analysis has been got over Come more important.The perception means that wherein facial expression recognition is exchanged as emotion information have in fields such as teaching cognitive state analyses Potentiality are widely applied.Currently, expression and action identification method based on deep learning reach its maturity, it can be achieved that higher identification Rate.
Magnetic liquid is a kind of novel functional material, it is usually by nanoscale magnetic-particle, additive and carrier fluid The colloidal solution of composition.When applying magnetic field, magnetic liquid is magnetized rapidly, and the solid phase transformation from liquid to class occurs, removes magnetic After, and it is restored to original state (i.e. liquid).Magnetic liquid is on " the magnetic mound " for macroscopically forming class solid-state cone-shaped structure (also known as " mountain shape structure ").Because its mangneto phase-change characteristic, magnetic liquid have a wide range of applications in practice, theoretically With very high learning value.It is had excellent performance, be can be widely applied to various with the magnetic fluid that nano metal and alloy powder produce The fields such as the magnetic fluid seals of harsh conditions, damping, medical instrument, sound adjust, light is shown, magnetic fluid ore dressing.
The method passes through magnetic liquid by intelligent algorithm identification maneuver and expression, and by the movement recognized or expression The fluctuating of body shows, and is suitable for science popularization demonstration, high-end entertainment device.Image recognition algorithm of the method based on deep learning With intellectual material technology, realize science popularization device and the real-time interactive of user, facilitate user's direct feel and understand this two Kind advanced technology, has good science popularization demonstrating effect, helps to improve China's youngsters and children and general public in the field Scientific literacy.In addition, fluctuating regular movements of the magnetic liquid in the case where magnetic field controls has unique form, ornamental value and amusement are had both Property, it can be used for high-end amusement.
Summary of the invention
In view of this, the purpose of the present invention is realize that a kind of interaction of magnetic liquid demonstrator is drilled using facial recognition techniques Show, magnetic liquid demonstrator is corresponded to by the human action or expression that identify different and makes different demonstrating effects.
Of the invention movement or expression simulator based on magnetic liquid, comprising:
Video camera, for shooting human action or expression;
Magnetic liquid demonstrator, including act the leading role show area and it is multiple around it is described protagonist show area circumferentially equally distributed outside Demonstrate area;
Host computer, signal connect the controller of the video camera Yu magnetic liquid demonstrator.
Further, the protagonist shows that the magnetic liquid relief height in area is controllable.
The invention also discloses a kind of methods for carrying out movement or expression simulation using above-mentioned apparatus, comprising the following steps:
S1. the image of human action or expression is shot by the video camera, and image is passed into the host computer;
S2. the movement or facial expression image, the movement or expression that will identify that the host computer identification takes are encoded, And by coding transmission to the controller of magnetic liquid demonstrator;
S3. the controller of the magnetic liquid demonstrator generates corresponding control signal according to the coding, makes the master The magnetic liquid for demonstrating area and external presentation area generates the fluctuations for characterizing movement corresponding to the coding or expression.
Further, when the movement that host computer identifies is to shake the head, described act the leading role shows that the magnetic liquid in area rises and falls, while each The magnetic liquid in a external presentation area shows that area successively back and forth rises and falls around protagonist;
When the movement that host computer identifies is to nod, described act the leading role shows that the magnetic liquid in area rises and falls, while each outside Demonstrate the synchronous fluctuating of magnetic liquid in area;
When the movement that host computer identifies is blink, the protagonist shows that the magnetic liquid in area and each external presentation area is same Step rises and falls.
Further, when the expression that host computer identifies is happy, the protagonist shows that the magnetic liquid in area quickly rises and falls, together When each external presentation area magnetic liquid random fluctuation;
When the expression that host computer identifies is indignation, the protagonist shows that the magnetic liquid in area and each external presentation area is same Step quickly rises, and simultaneously and rapidly falls after maintaining the setting period;
When the expression that host computer identifies is sad, the protagonist shows that the magnetic liquid in area and each external presentation area is same Step slowly rises and falls;
When the expression that host computer identifies is frightened, the protagonist is shown fast after the magnetic liquid in area is raised up to setting height Speed shake, while the magnetic liquid in each external presentation area all rises and keeps.
Further, when the movement that host computer identifies is blink, the magnetic liquid in area and external presentation area is shown in the protagonist The synchronous frequency to rise and fall of body and the frequency of blink movement are positively correlated.
Further, described to act the leading role the PWM for showing that the relief height of the magnetic liquid in area acts the leading role the electromagnetic coil for showing area by passing through The control of current waveform duty ratio.
Further, one or more human actions or expression can be preset;When the host computer recognizes the dynamic of setting When work or expression, by the controller of coding transmission corresponding with the movement or expression to magnetic liquid demonstrator.
Further, the host computer is once identified every the setting period, takes in multiple recognition result frequency of occurrence most More expressions or movement are final recognition result, and by final result coding transmission to the controller of magnetic liquid demonstrator.
The beneficial effects of the present invention are: the movement or expression simulator of the invention based on magnetic liquid, existing Magnetic liquid demonstrator on the basis of, increase small-sized undulating region around Demonstration table, original biggish area of display of area is Area is shown in protagonist, is located at Demonstration table center, shows that several small magnetic liquid being evenly distributed are arranged around area to be risen acting the leading role Region, referred to as external presentation area are lied prostrate, by showing that the magnetic liquid movement in area and external presentation area is combined to different protagonists, Can image simulate human body difference movement or expression, greatly improve the interest of magnetic liquid demonstrator.
Detailed description of the invention
The invention will be further described with reference to the accompanying drawings and examples:
Fig. 1 is the schematic diagram that demonstrator demonstrates area in the present invention;
Fig. 2 is magnetic liquid rolling shape schematic diagram corresponding to " head shaking movement " in the present invention;
Fig. 3 is magnetic liquid rolling shape schematic diagram corresponding to " nodding action " in the present invention;
Fig. 4 is magnetic liquid rolling shape schematic diagram corresponding to " blink movement " in the present invention;
Fig. 5 is magnetic liquid rolling shape schematic diagram corresponding to " happy expression " in the present invention;
Fig. 6 is magnetic liquid rolling shape schematic diagram corresponding to " angry facial expression " in the present invention;
Fig. 7 is magnetic liquid rolling shape schematic diagram corresponding to " sad expression " in the present invention;
Fig. 8 is magnetic liquid rolling shape schematic diagram corresponding to " frightened expression " in the present invention.
Specific embodiment
Embodiment one:
The human action of the present embodiment or the simulator of expression, comprising:
Video camera, for shooting the expression and movement of user;
Magnetic liquid demonstrator, including act the leading role show area and it is multiple around it is described protagonist show area circumferentially equally distributed outside Area is demonstrated, shows that the area in area is larger wherein acting the leading role, is located at Demonstration table center, external presentation area shows in protagonist to be arranged around area The several and distribution that is centrosymmetric.Protagonist shows that area can control the relief height of magnetic liquid, and external presentation area can only Realize the control for falling, rising two states.The detailed configuration of magnetic liquid demonstrator is the prior art, and this will not be repeated here.
Host computer is handled the image that video camera takes using the image processing algorithm based on deep learning, is known Other expression and movement, and the coding of expression and movement is sent to the controller of demonstrator.
Embodiment two:
The human action of the present embodiment or the analogy method of expression, comprising the following steps:
S1. using the movement and expression of video camera shooting people, and the image taken is transmitted to host computer;
S2. host computer is handled image using the image recognition algorithm based on deep learning, and demonstrator has movement Simulation or expression simulate both of which, and user can independently select Expression Recognition mode or action recognition mode, Expression Recognition Mode can identify that " happiness, sorrow, is feared anger " four kinds of expressions, action recognition mode can identify that three kinds of " shake the head, nod, blinking " is dynamic Make.Image recognition algorithm handles the image taken in real time, can export a recognition result within every 0.25 second, takes four results to be One group, with the most expression of frequency of occurrence in one group or movement for final recognition result, final result is encoded, magnetism is transferred to Controller of the control section of liquid demonstrator, i.e. host computer the output first encoding per second to demonstrator.
S3. after the controller of magnetic liquid demonstrator detects movement or expression coding, corresponding control signal is generated.It drills Show that the area of display schematic diagram of instrument is as shown in Figure 1.Protagonist shows that area by a biggish solenoid controlled, passes through PWM current wave Shape duty ratio controls the magnetic field strength of electromagnetic coil, and magnetic field strength controls magnetic liquid lifting heights.PWM wave duty ratio is bigger, The magnetic field strength of corresponding electromagnetic coil is bigger, and corresponding magnetic liquid lifting heights are higher, and PWM wave duty ratio is smaller, corresponding electromagnetism The magnetic field strength of coil is smaller, and corresponding magnetic liquid lifting heights are lower.External presentation area is 8, by one-to-one 8 Compact electromagnetic coil control below carrier fluid disk, when applying DC voltage to electromagnetic coil, magnetic liquid is risen, and is not applied When making alive, magnetic liquid is fallen.
S4. magnetic liquid demonstrator Demonstration table part is upon the reception of control signals, synchronous to generate corresponding magnetic liquid Fluctuations.
By taking " head shaking movement " as an example, magnetic liquid rolling shape schematic diagram corresponding to " head shaking movement " is as shown in Fig. 2, main Demonstrate the magnetic liquid dipping and heaving in area, the circumferential reciprocal fluctuating in external presentation area.
Case study on implementation two:
In the present embodiment, pass through magnetic liquid simulation human action or the method for expression, comprising the following steps:
S1. using the movement and expression of video camera shooting people, and the image taken is transmitted to host computer;
S2. host computer is handled image using the image recognition algorithm based on deep learning.User needs preparatory The expression or movement of the desired identification of selection, including " happiness, sorrow, is feared anger " four kinds of expressions, and three kinds of " shake the head, nod, blinking " are dynamic Make, after selecting a certain expression or movement, output is that the expression is not detected or acts defeated if detecting the expression or movement It is no out.Image recognition algorithm handles the image taken in real time, can export a recognition result within every 0.25 second, take four results It is one group, with the most result of frequency of occurrence in one group for final recognition result, final result is encoded, magnetic liquid is transferred to The control section of demonstrator, i.e. host computer output first encoding per second are to the control section of demonstrator.
S3. after the control section of magnetic liquid demonstrator detects movement or expression coding, corresponding control signal is generated. The area of display schematic diagram of demonstrator is as shown in Figure 1.Protagonist shows that area by a biggish solenoid controlled, passes through PWM electric current Waveform duty cycle controls the magnetic field strength of electromagnetic coil, and magnetic field strength controls magnetic liquid lifting heights.PWM wave duty ratio is got over Greatly, the magnetic field strength of corresponding electromagnetic coil is bigger, and corresponding magnetic liquid lifting heights are higher, and PWM wave duty ratio is smaller, corresponding electricity The magnetic field strength of magnetic coil is smaller, and corresponding magnetic liquid lifting heights are lower.External presentation area is small by eight below carrier fluid disk The control of type permanent magnet, when magnet under the drive of the motor close to carrier fluid disk when, magnetic liquid rises, magnetic when far from carrier fluid disk Liquid is fallen.
S4. magnetic liquid demonstrator Demonstration table part is upon the reception of control signals, synchronous to generate corresponding magnetic liquid Fluctuations.
By taking " nodding action " as an example, magnetic liquid rolling shape schematic diagram corresponding to " nodding action " is as shown in figure 3, main Demonstrate the magnetic liquid dipping and heaving in area, the fully synchronized fluctuating in external presentation area.
Finally, it is stated that the above examples are only used to illustrate the technical scheme of the present invention and are not limiting, although referring to compared with Good embodiment describes the invention in detail, those skilled in the art should understand that, it can be to skill of the invention Art scheme is modified or replaced equivalently, and without departing from the objective and range of technical solution of the present invention, should all be covered at this In the scope of the claims of invention.

Claims (9)

1. a kind of movement or expression simulator based on magnetic liquid characterized by comprising
Video camera, for shooting human action or expression;
Magnetic liquid demonstrator, including act the leading role show area and it is multiple around it is described protagonist show area's circumferentially equally distributed external presentation Area;
Host computer, signal connect the controller of the video camera Yu magnetic liquid demonstrator.
2. simulator according to claim 1, it is characterised in that: the protagonist shows that the magnetic liquid relief height in area can Control.
3. a kind of method for carrying out movement or expression simulation using device described in as claimed in claim 1 or 22, which is characterized in that including Following steps:
S1. the image of human action or expression is shot by the video camera, and image is passed into the host computer;
S2. the movement or facial expression image, the movement or expression that will identify that the host computer identification takes are encoded, and will Controller of the coding transmission to magnetic liquid demonstrator;
S3. the controller of the magnetic liquid demonstrator generates corresponding control signal according to the coding, shows the protagonist The magnetic liquid in area and external presentation area generates the fluctuations for characterizing movement corresponding to the coding or expression.
4. according to the method described in claim 3, it is characterized by: when the movement that host computer identifies be shake the head when, the master The magnetic liquid for demonstrating area rises and falls, while the magnetic liquid in each external presentation area shows that area successively back and forth rises and falls around protagonist;
When the movement that host computer identifies is to nod, described act the leading role shows that the magnetic liquid in area rises and falls, while each external presentation The magnetic liquid in area is synchronous to rise and fall;
When the movement that host computer identifies is blink, the magnetic liquid synchronization onwards in area and each external presentation area are shown in the protagonist Volt.
5. according to the method described in claim 3, it is characterized by: when the expression that host computer identifies is happy, the master The magnetic liquid in demonstration area quickly rises and falls, while the magnetic liquid random fluctuation in each external presentation area;
When the expression that host computer identifies is indignation, the protagonist shows that area is synchronous with the magnetic liquid in each external presentation area fast Speed rises, and simultaneously and rapidly falls after maintaining the setting period;
When the expression that host computer identifies is sad, the protagonist shows that area and the magnetic liquid in each external presentation area are synchronous slow It is slow to rise and fall;
When the expression that host computer identifies is frightened, the protagonist is shown quickly trembles after the magnetic liquid in area is raised up to setting height It is dynamic, while the magnetic liquid in each external presentation area all rises and keeps.
6. according to the method described in claim 4, it is characterized by: when the movement that host computer identifies be blink when, the master The frequency of the synchronous frequency to rise and fall of magnetic liquid and blink movement of demonstrating area and external presentation area is positively correlated.
7. according to the method described in claim 3, it is characterized by: the relief height for showing the magnetic liquid in area of acting the leading role is by leading to Cross the duty ratio control for acting the leading role the PWM current waveform for showing the electromagnetic coil above area.
8. according to the method described in claim 3, it is characterized by: one or more human actions or expression can be preset; When the host computer recognizes the movement or expression of setting, will coding transmission corresponding with the movement or expression to magnetic liquid The controller of demonstrator.
9. according to the method described in claim 3, it is characterized by: the host computer every setting the period once identified, Taking frequency of occurrence is most in multiple recognition result expression or movement is final recognition result, and final result coding transmission is given The controller of magnetic liquid demonstrator.
CN201910162342.6A 2019-03-05 2019-03-05 Motion or expression simulation device and method based on magnetic liquid Expired - Fee Related CN109920347B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910162342.6A CN109920347B (en) 2019-03-05 2019-03-05 Motion or expression simulation device and method based on magnetic liquid

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910162342.6A CN109920347B (en) 2019-03-05 2019-03-05 Motion or expression simulation device and method based on magnetic liquid

Publications (2)

Publication Number Publication Date
CN109920347A true CN109920347A (en) 2019-06-21
CN109920347B CN109920347B (en) 2020-12-04

Family

ID=66963207

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910162342.6A Expired - Fee Related CN109920347B (en) 2019-03-05 2019-03-05 Motion or expression simulation device and method based on magnetic liquid

Country Status (1)

Country Link
CN (1) CN109920347B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201638526U (en) * 2010-03-05 2010-11-17 上海未来伙伴机器人有限公司 Device for simulating human expressions and robot comprising the same
CN103339926A (en) * 2011-11-24 2013-10-02 株式会社Ntt都科摩 Expression output device and expression output method
CN106737745A (en) * 2017-01-05 2017-05-31 珠海市横琴麒翔科技有限公司 Intelligent robot
CN106919899A (en) * 2017-01-18 2017-07-04 北京光年无限科技有限公司 The method and system for imitating human face expression output based on intelligent robot
CN107316546A (en) * 2017-08-03 2017-11-03 重庆大学 Magnetic liquid demonstrator and its control method
CN108326878A (en) * 2017-01-18 2018-07-27 王怀亮 A kind of limb action electronic switching equipment, instruction identification method and recording/playback method
CN208358753U (en) * 2018-04-26 2019-01-11 昆山塔米机器人有限公司 A kind of apery expression display device and robot
CN109345634A (en) * 2018-10-26 2019-02-15 重庆大学 Magnetic field demenstration method and device based on magnetic liquid and mixed reality

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201638526U (en) * 2010-03-05 2010-11-17 上海未来伙伴机器人有限公司 Device for simulating human expressions and robot comprising the same
CN103339926A (en) * 2011-11-24 2013-10-02 株式会社Ntt都科摩 Expression output device and expression output method
CN106737745A (en) * 2017-01-05 2017-05-31 珠海市横琴麒翔科技有限公司 Intelligent robot
CN106919899A (en) * 2017-01-18 2017-07-04 北京光年无限科技有限公司 The method and system for imitating human face expression output based on intelligent robot
CN108326878A (en) * 2017-01-18 2018-07-27 王怀亮 A kind of limb action electronic switching equipment, instruction identification method and recording/playback method
CN107316546A (en) * 2017-08-03 2017-11-03 重庆大学 Magnetic liquid demonstrator and its control method
CN208358753U (en) * 2018-04-26 2019-01-11 昆山塔米机器人有限公司 A kind of apery expression display device and robot
CN109345634A (en) * 2018-10-26 2019-02-15 重庆大学 Magnetic field demenstration method and device based on magnetic liquid and mixed reality

Also Published As

Publication number Publication date
CN109920347B (en) 2020-12-04

Similar Documents

Publication Publication Date Title
Ribeiro et al. The illusion of robotic life: principles and practices of animation for robots
Zhu et al. AutoGami: a low-cost rapid prototyping toolkit for automated movable paper craft
Ruffaldi et al. Feedback, affordances, and accelerators for training sports in virtual environments
WO2020151273A1 (en) System and method for automatically generating virtual reality scene that stimulates emotions
Jacobson Ex machina in the garden
Pan et al. Realistic and interactive robot gaze
CN107316546B (en) Magnetic liquid demonstrator and its control method
Zhang et al. Magicavatar: Multimodal avatar generation and animation
Magnenat-Thalmann et al. Context aware human-robot and human-agent interaction
CN109920347A (en) A kind of movement or expression simulator and method based on magnetic liquid
Saerbeck et al. Design guidelines and tools for creating believable motion for personal robots
Hertzmann et al. Physics-based characters
Knight et al. Acting lesson with robot: Emotional gestures
Kyffin et al. Exploring expression of form, action and interaction
Hobye et al. Behavioral complexity as a computational material strategy
Wachsmuth et al. Introduction to embodied communication: why communication needs the body
Row et al. Understanding lifelike characteristics in interactive product design
Li Using Surrealist Aesthetics to Explore a Personal Visual Narrative about Air Pollution
CN109345634A (en) Magnetic field demenstration method and device based on magnetic liquid and mixed reality
Meng Intelligent Animation Creation Method Based on Spatial Separation Perception Algorithm
Soler-Adillon et al. Self-organization and novelty: pre-configurations of emergence in early British Cybernetics
Ye Application of Interaction between Art and Intelligence Technology in Modern Exhibition Halls
Ye Immersive VR IS Based on Virtual Reality Technology
Lestel How Machines Force Us to Rethink What It Means
Sieradzka AMachine LIKE A HUMAN BEING—TRANSHUMANISM AS NEW HUMANISM IN THE MOVIE EX MACHINA

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20201204

CF01 Termination of patent right due to non-payment of annual fee