CN109920347B - A magnetic liquid-based action or expression simulation device and method - Google Patents

A magnetic liquid-based action or expression simulation device and method Download PDF

Info

Publication number
CN109920347B
CN109920347B CN201910162342.6A CN201910162342A CN109920347B CN 109920347 B CN109920347 B CN 109920347B CN 201910162342 A CN201910162342 A CN 201910162342A CN 109920347 B CN109920347 B CN 109920347B
Authority
CN
China
Prior art keywords
magnetic liquid
demonstration area
action
host computer
main
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201910162342.6A
Other languages
Chinese (zh)
Other versions
CN109920347A (en
Inventor
谢磊
张永浩
邓嘉阳
罗萱
李兵
王聿浩
杨涛
李佩
廖昌荣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing University
Original Assignee
Chongqing University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing University filed Critical Chongqing University
Priority to CN201910162342.6A priority Critical patent/CN109920347B/en
Publication of CN109920347A publication Critical patent/CN109920347A/en
Application granted granted Critical
Publication of CN109920347B publication Critical patent/CN109920347B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Magnetic Treatment Devices (AREA)
  • Image Analysis (AREA)

Abstract

本发明公开了一种基于磁性液体的动作或表情模拟装置和方法,其中,模拟装置包括摄像机,用于拍摄人体动作或表情;磁性液体演示仪,包括主演示区和多个围绕所述主演示区沿环向均匀分布的外部演示区;上位机,其信号连接所述摄像机与磁性液体演示仪的控制器;模拟方法包括以下步骤:s1.通过所述摄像机拍摄人体动作或表情的图像,并将图像传到所述上位机;s2.所述上位机识别拍摄到的动作或表情图像,将识别出的动作或表情进行编码,并将编码传输到磁性液体演示仪的控制器;s3.所述磁性液体演示仪的控制器根据所述编码产生相应的控制信号,使所述主演示区和外部演示区的磁性液体产生表征该编码所对应的动作或表情的起伏变化。

Figure 201910162342

The invention discloses a magnetic liquid-based action or expression simulation device and method, wherein the simulation device includes a camera for photographing human movements or expressions; a magnetic liquid demonstration device includes a main demonstration area and a plurality of surrounding areas for the main demonstration an external demonstration area uniformly distributed along the circumferential direction; the upper computer, whose signal is connected to the controller of the camera and the magnetic liquid demonstration device; the simulation method includes the following steps: s1. Send the image to the upper computer; s2. The upper computer recognizes the captured action or expression image, encodes the recognized movement or expression, and transmits the code to the controller of the magnetic liquid demonstration device; s3. The controller of the magnetic liquid demonstration instrument generates corresponding control signals according to the code, so that the magnetic liquid in the main demonstration area and the external demonstration area generates fluctuations representing the action or expression corresponding to the code.

Figure 201910162342

Description

一种基于磁性液体的动作或表情模拟装置和方法A magnetic liquid-based action or expression simulation device and method

技术领域technical field

本发明涉及演示仪器领域,尤其涉及一种基于磁性液体的动作或表情模拟装置和方法。The invention relates to the field of demonstration instruments, in particular to an action or expression simulation device and method based on magnetic liquid.

背景技术Background technique

人工智能是计算机科学的一个分支,它试图了解智能的实质,并生产出一种新的能以人类智能相似的方式做出反应的智能机器,该领域的研究包括机器人、语言识别、图像识别、自然语言处理和专家系统等。随着智能机器和人工智能的发展,计算机情感分析已越来越重要。其中人脸表情识别作为情感信息交流的感知手段在教学认知状态分析等领域有广泛应用潜力。目前,基于深度学习的表情及动作识别方法日趋成熟,可实现较高的识别率。Artificial intelligence is a branch of computer science that attempts to understand the essence of intelligence and produce a new type of intelligent machine that can respond in a similar way to human intelligence. Research in this field includes robotics, language recognition, image recognition, Natural language processing and expert systems, etc. With the development of intelligent machines and artificial intelligence, computer sentiment analysis has become more and more important. Among them, facial expression recognition as a perception method for emotional information exchange has wide application potential in the fields of teaching cognitive state analysis and so on. At present, expression and action recognition methods based on deep learning are becoming more and more mature and can achieve a high recognition rate.

磁性液体是一种新型的功能材料,它通常是由纳米级的磁性颗粒、添加剂和载液组成的胶体溶液。施加磁场时,磁性液体迅速被磁化,发生从液态到类固态的相变,去掉磁场后,又恢复到原来的状态(即液态)。磁性液体在宏观上形成类固态圆锥状结构的“磁丘”(又名“山状结构”)。因为它的磁致相变特性,磁性液体在实际中有着广泛的应用,在理论上具有很高的学术价值。用纳米金属及合金粉末生产的磁流体性能优异,可广泛应用于各种苛刻条件的磁性流体密封、减震、医疗器械、声音调节、光显示、磁流体选矿等领域。Magnetic liquid is a new type of functional material, which is usually a colloidal solution composed of nano-scale magnetic particles, additives and carrier liquid. When a magnetic field is applied, the magnetic liquid is rapidly magnetized and undergoes a phase transition from a liquid state to a solid-like state. After the magnetic field is removed, it returns to its original state (ie, a liquid state). The magnetic liquid forms a "magnetic hill" (also known as a "mountain-like structure") of a solid-like conical structure on a macroscopic scale. Because of its magneto-induced phase transition properties, magnetic liquids are widely used in practice and have high academic value in theory. The magnetic fluid produced by nano-metal and alloy powder has excellent performance and can be widely used in various harsh conditions such as magnetic fluid sealing, shock absorption, medical equipment, sound adjustment, optical display, magnetic fluid beneficiation and other fields.

此方法通过人工智能算法识别动作与表情,并将识别到的动作或表情通过磁性液体的起伏表现出来,适用于科普演示、高端娱乐装置。此方法基于深度学习的图像识别算法和智能材料技术,实现了科普装置与用户的实时互动,有助于使用者直观感受和理解这两种先进技术,具有良好的科普演示效果,有助于提高我国青少年儿童和普通民众在该领域的科学素养。此外,磁性液体在磁场控制下的起伏律动具有独特的形态,兼具观赏性与娱乐性,可用于高端娱乐。This method recognizes actions and expressions through artificial intelligence algorithms, and expresses the recognized actions or expressions through the ups and downs of magnetic liquid, which is suitable for popular science demonstrations and high-end entertainment devices. This method is based on the deep learning image recognition algorithm and intelligent material technology, which realizes the real-time interaction between the popular science device and the user, helps the user to intuitively feel and understand these two advanced technologies, has a good popular science demonstration effect, and helps to improve the The scientific literacy of Chinese adolescents and ordinary people in this field. In addition, the undulating rhythm of the magnetic liquid under the control of the magnetic field has a unique shape, which is both ornamental and entertaining, and can be used for high-end entertainment.

发明内容SUMMARY OF THE INVENTION

有鉴于此,本发明的目的是利用面部识别技术实现一种磁性液体演示仪的互动演示,通过识别不同的人体动作或表情对应磁性液体演示仪做出不同的演示效果。In view of this, the purpose of the present invention is to use facial recognition technology to realize an interactive demonstration of a magnetic liquid demonstrator, and to make different demonstration effects corresponding to the magnetic liquid demonstrator by recognizing different human actions or expressions.

本发明的基于磁性液体的动作或表情模拟装置,包括:The magnetic liquid-based action or expression simulation device of the present invention includes:

摄像机,用于拍摄人体动作或表情;Cameras, used to capture human movements or expressions;

磁性液体演示仪,包括主演示区和多个围绕所述主演示区沿环向均匀分布的外部演示区;A magnetic liquid demonstration instrument, including a main demonstration area and a plurality of outer demonstration areas evenly distributed in the circumferential direction around the main demonstration area;

上位机,其信号连接所述摄像机与磁性液体演示仪的控制器。The upper computer, the signal of which connects the camera and the controller of the magnetic liquid demonstrator.

进一步,所述主演示区的磁性液体起伏高度可控。Further, the fluctuation of the magnetic liquid in the main demonstration area is highly controllable.

本发明还公开了一种利用上述装置进行动作或表情模拟的方法,包括以下步骤:The present invention also discloses a method for simulating actions or expressions by using the above-mentioned device, comprising the following steps:

s1.通过所述摄像机拍摄人体动作或表情的图像,并将图像传到所述上位机;s1. Shoot images of human movements or expressions through the camera, and transmit the images to the host computer;

s2.所述上位机识别拍摄到的动作或表情图像,将识别出的动作或表情进行编码,并将编码传输到磁性液体演示仪的控制器;s2. The upper computer recognizes the captured action or facial expression image, encodes the recognized action or facial expression, and transmits the code to the controller of the magnetic liquid demonstrator;

s3.所述磁性液体演示仪的控制器根据所述编码产生相应的控制信号,使所述主演示区和外部演示区的磁性液体产生表征该编码所对应的动作或表情的起伏变化。s3. The controller of the magnetic liquid demonstration instrument generates corresponding control signals according to the code, so that the magnetic liquid in the main demonstration area and the external demonstration area produces fluctuations that represent the action or expression corresponding to the code.

进一步,当上位机识别出的动作为摇头时,所述主演示区的磁性液体起伏,同时各个外部演示区的磁性液体绕主演示区依次往复起伏;Further, when the action recognized by the host computer is shaking his head, the magnetic liquid in the main demonstration area fluctuates, and at the same time, the magnetic liquid in each external demonstration area reciprocates and fluctuates around the main demonstration area in turn;

当上位机识别出的动作为点头时,所述主演示区的磁性液体起伏,同时各个外部演示区的磁性液体同步起伏;When the action recognized by the host computer is nodding, the magnetic liquid in the main demonstration area fluctuates, and the magnetic liquid in each external demonstration area fluctuates synchronously;

当上位机识别出的动作为眨眼时,所述主演示区和各个外部演示区的磁性液体同步起伏。When the action recognized by the host computer is blinking, the magnetic liquid in the main demonstration area and each external demonstration area fluctuates synchronously.

进一步,当上位机识别出的表情为喜悦时,所述主演示区的磁性液体快速起伏,同时各个外部演示区的磁性液体随机起伏;Further, when the expression recognized by the host computer is joy, the magnetic liquid in the main demonstration area fluctuates rapidly, while the magnetic liquid in each external demonstration area fluctuates randomly;

当上位机识别出的表情为愤怒时,所述主演示区和各个外部演示区的磁性液体同步快速升起,维持设定时段后同步快速落下;When the facial expression recognized by the host computer is anger, the magnetic liquid in the main demonstration area and each external demonstration area rises synchronously and rapidly, and falls synchronously and quickly after maintaining a set period of time;

当上位机识别出的表情为哀伤时,所述主演示区和各个外部演示区的磁性液体同步缓慢起伏;When the expression recognized by the host computer is sad, the magnetic liquid in the main demonstration area and each external demonstration area fluctuates slowly and synchronously;

当上位机识别出的表情为恐惧时,所述主演示区的磁性液体升起至设定高度后快速抖动,同时各个外部演示区的磁性液体全部升起并保持。When the facial expression recognized by the host computer is fear, the magnetic liquid in the main demonstration area rises to the set height and then shakes rapidly, and at the same time, the magnetic liquid in each external demonstration area is all raised and maintained.

进一步,当上位机识别出的动作为眨眼时,所述主演示区和外部演示区的磁性液体同步起伏的频率与眨眼动作的频率正相关。Further, when the action recognized by the host computer is eye blinking, the frequency of the synchronous fluctuation of the magnetic liquid in the main demonstration area and the external demonstration area is positively correlated with the frequency of eye blinking action.

进一步,所述主演示区的磁性液体的起伏高度由通过主演示区的电磁线圈的PWM电流波形占空比控制。Further, the fluctuation height of the magnetic liquid in the main demonstration area is controlled by the duty cycle of the PWM current waveform passing through the electromagnetic coil of the main demonstration area.

进一步,可预先设定一个或多个人体动作或表情;当所述上位机识别到设定的动作或表情时,将与该动作或表情对应的编码传输到磁性液体演示仪的控制器。Further, one or more human body movements or expressions can be preset; when the host computer recognizes the set movements or expressions, it transmits the code corresponding to the movements or expressions to the controller of the magnetic liquid demonstration instrument.

进一步,所述上位机每隔设定时段进行一次识别,取多次识别结果中出现次数最多的表情或动作为最终识别结果,并将最终结果编码传输给磁性液体演示仪的控制器。Further, the host computer performs recognition once every set period of time, takes the expression or action with the most occurrences among the multiple recognition results as the final recognition result, and transmits the final result code to the controller of the magnetic liquid demonstrator.

本发明的有益效果是:本发明的基于磁性液体的动作或表情模拟装置,其在现有的磁性液体演示仪基础上,围绕演示台增加小型起伏区域,原有的面积较大的演示区域为主演示区,位于演示台中心位置,在主演示区周围设置数个呈均匀分布的小型磁性液体起伏区域,称为外部演示区,通过对不同的主演示区和外部演示区的磁性液体动作进行组合,可形象的模拟出人体不同动作或表情,大大提高磁性液体演示仪的趣味性。The beneficial effects of the present invention are: the magnetic liquid-based action or expression simulation device of the present invention adds a small undulating area around the demonstration stage on the basis of the existing magnetic liquid demonstration device, and the original demonstration area with a larger area is The main demonstration area, located in the center of the demonstration stage, is set around the main demonstration area with several small undulating areas of magnetic liquid evenly distributed, called the external demonstration area. The combination can vividly simulate different movements or expressions of the human body, which greatly improves the fun of the magnetic liquid demonstration instrument.

附图说明Description of drawings

下面结合附图和实施例对本发明作进一步描述:Below in conjunction with accompanying drawing and embodiment, the present invention is further described:

图1为本发明中演示仪演示区的示意图;Fig. 1 is the schematic diagram of the demonstration area of the demonstrator among the present invention;

图2为本发明中“摇头动作”所对应的磁性液体起伏形态示意图;Fig. 2 is the schematic diagram of the undulating shape of the magnetic liquid corresponding to the "shaking motion" in the present invention;

图3为本发明中“点头动作”所对应的磁性液体起伏形态示意图;3 is a schematic diagram of the undulating shape of the magnetic liquid corresponding to the “nodding action” in the present invention;

图4为本发明中“眨眼动作”所对应的磁性液体起伏形态示意图;Fig. 4 is a schematic diagram of the undulating shape of the magnetic liquid corresponding to "eye blinking action" in the present invention;

图5为本发明中“喜悦表情”所对应的磁性液体起伏形态示意图;5 is a schematic diagram of the undulating shape of the magnetic liquid corresponding to the “joy expression” in the present invention;

图6为本发明中“愤怒表情”所对应的磁性液体起伏形态示意图;6 is a schematic diagram of the undulating shape of the magnetic liquid corresponding to "angry expression" in the present invention;

图7为本发明中“哀伤表情”所对应的磁性液体起伏形态示意图;7 is a schematic diagram of the undulating shape of the magnetic liquid corresponding to "sad expression" in the present invention;

图8为本发明中“恐惧表情”所对应的磁性液体起伏形态示意图。FIG. 8 is a schematic diagram of the undulating shape of the magnetic liquid corresponding to the "fear expression" in the present invention.

具体实施方式Detailed ways

实施例一:Example 1:

本实施例的人体动作或表情的模拟装置,包括:The simulation device of human action or expression of this embodiment includes:

摄像机,用于拍摄使用者的表情及动作;A camera, used to capture the user's expressions and actions;

磁性液体演示仪,包括主演示区和多个围绕所述主演示区沿环向均匀分布的外部演示区,其中主演示区的面积较大,位于演示台中心位置,外部演示区在主演示区周围设置数个并呈中心对称分布。主演示区可以对磁性液体的起伏高度进行控制,外部演示区只能实现落下、升起两种状态的控制。磁性液体演示仪的详细构造为现有技术,在此不赘述。The magnetic liquid demonstration instrument includes a main demonstration area and a plurality of outer demonstration areas evenly distributed in the circumferential direction around the main demonstration area, wherein the main demonstration area has a larger area and is located in the center of the demonstration stage, and the outer demonstration area is in the main demonstration area Several are arranged around and distributed symmetrically around the center. The main demonstration area can control the undulating height of the magnetic liquid, and the external demonstration area can only control the falling and rising states. The detailed structure of the magnetic liquid demonstrator is in the prior art and will not be repeated here.

上位机,利用基于深度学习的图像处理算法,对摄像机拍摄到的图像进行处理,识别表情及动作,并将表情及动作的编码传送给演示仪的控制器。The host computer uses the image processing algorithm based on deep learning to process the images captured by the camera, recognize expressions and actions, and transmit the codes of the expressions and actions to the controller of the demonstrator.

实施例二:Embodiment 2:

本实施例的人体动作或表情的模拟方法,包括以下步骤:The method for simulating human action or expression of the present embodiment includes the following steps:

s1.利用摄像机拍摄人的动作与表情,并将拍摄到的图像传给上位机;s1. Use the camera to capture people's movements and expressions, and transmit the captured images to the host computer;

s2.上位机利用基于深度学习的图像识别算法对图像进行处理,演示仪具有动作模拟或表情模拟两种模式,使用者可以自主选择表情识别模式或动作识别模式,表情识别模式可以识别“喜、怒、哀、惧”四种表情,动作识别模式可以识别“摇头、点头、眨眼”三种动作。图像识别算法实时处理拍摄到的图像,每0.25秒可以输出一次识别结果,取四次结果为一组,以一组中出现次数最多的表情或动作为最终识别结果,将最终结果编码,传输给磁性液体演示仪的控制部分,即上位机每秒输出一次编码到演示仪的控制器。s2. The upper computer uses the image recognition algorithm based on deep learning to process the image. The demonstrator has two modes of action simulation or expression simulation. The user can choose the expression recognition mode or the action recognition mode independently. There are four expressions of anger, sadness, and fear, and the action recognition mode can recognize three actions of "shaking his head, nodding, and blinking." The image recognition algorithm processes the captured images in real time, and can output a recognition result every 0.25 seconds. Take four results as a group, and take the expression or action that occurs most frequently in a group as the final recognition result, encode the final result, and transmit it to The control part of the magnetic liquid demonstrator, that is, the upper computer outputs a code to the controller of the demonstrator every second.

s3.磁性液体演示仪的控制器检测到动作或表情编码后,产生相应的控制信号。演示仪的演示区域示意图如图1所示。主演示区由一个较大的电磁线圈控制,通过PWM电流波形占空比控制电磁线圈的磁场强度,磁场强度控制磁性液体升起高度。PWM波占空比越大,对应电磁线圈的磁场强度越大,对应磁性液体升起高度越高,PWM波占空比越小,对应电磁线圈的磁场强度越小,对应磁性液体升起高度越低。外部演示区为8个,其由一一对应的8个位于载液盘下方的小型电磁线圈控制,当对电磁线圈施加直流电压时,磁性液体升起,未施加电压时,磁性液体落下。s3. After the controller of the magnetic liquid demonstrator detects the action or expression code, it generates a corresponding control signal. The schematic diagram of the demonstration area of the demonstrator is shown in Figure 1. The main demonstration area is controlled by a larger electromagnetic coil, and the magnetic field strength of the electromagnetic coil is controlled by the PWM current waveform duty cycle, and the magnetic field strength controls the height of the magnetic liquid. The larger the duty cycle of the PWM wave, the greater the magnetic field strength of the corresponding electromagnetic coil, the higher the corresponding magnetic liquid rising height, the smaller the PWM wave duty cycle, the smaller the magnetic field strength of the corresponding electromagnetic coil, and the higher the corresponding magnetic liquid rising height. Low. There are 8 external demonstration areas, which are controlled by 8 small electromagnetic coils located under the liquid carrier tray in one-to-one correspondence. When DC voltage is applied to the electromagnetic coils, the magnetic liquid rises, and when no voltage is applied, the magnetic liquid falls.

s4.磁性液体演示仪演示台部分在接收到控制信号后,同步产生相应的磁性液体的起伏变化。s4. After receiving the control signal, the demonstration stand part of the magnetic liquid demonstrator synchronously generates fluctuations of the corresponding magnetic liquid.

以“摇头动作”为例,“摇头动作”所对应的磁性液体起伏形态示意图如图2所示,主演示区的磁性液体上下起伏,外部演示区周向往复起伏。Taking the "shaking motion" as an example, the schematic diagram of the undulating shape of the magnetic liquid corresponding to the "shaking motion" is shown in Figure 2. The magnetic liquid in the main demonstration area undulates up and down, and the outer demonstration area undulates in the circumferential direction.

实施案例二:Implementation case two:

本实施例中,通过磁性液体模拟人体动作或表情的方法,包括以下步骤:In this embodiment, the method for simulating human action or expression by magnetic liquid includes the following steps:

s1.利用摄像机拍摄人的动作与表情,并将拍摄到的图像传给上位机;s1. Use the camera to capture people's movements and expressions, and transmit the captured images to the host computer;

s2.上位机利用基于深度学习的图像识别算法对图像进行处理。使用者需要预先选择想要识别的表情或动作,包括“喜、怒、哀、惧”四种表情,和“摇头、点头、眨眼”三种动作,选择某一表情或动作后,若检测到该表情或动作则输出是,未检测到该表情或动作则输出否。图像识别算法实时处理拍摄到的图像,每0.25秒可以输出一次识别结果,取四次结果为一组,以一组中出现次数最多的结果为最终识别结果,将最终结果编码,传输给磁性液体演示仪的控制部分,即上位机每秒输出一次编码到演示仪的控制部分。s2. The upper computer uses the image recognition algorithm based on deep learning to process the image. The user needs to pre-select the expression or action to be recognized, including four expressions of "joy, anger, sadness, fear" and three movements of "shaking, nodding, and blinking". The expression or action is output as yes, and the expression or action is not detected, the output is no. The image recognition algorithm processes the captured images in real time, and can output a recognition result every 0.25 seconds, take four results as a group, take the result with the most occurrences in a group as the final recognition result, encode the final result and transmit it to the magnetic liquid The control part of the demonstration instrument, that is, the control part of the upper computer that outputs the code to the demonstration instrument once per second.

s3.磁性液体演示仪的控制部分检测到动作或表情编码后,产生相应的控制信号。演示仪的演示区域示意图如图1所示。主演示区由一个较大的电磁线圈控制,通过PWM电流波形占空比控制电磁线圈的磁场强度,磁场强度控制磁性液体升起高度。PWM波占空比越大,对应电磁线圈的磁场强度越大,对应磁性液体升起高度越高,PWM波占空比越小,对应电磁线圈的磁场强度越小,对应磁性液体升起高度越低。外部演示区由载液盘下方的八个小型永磁铁控制,当磁铁在电机的驱动下接近载液盘时,磁性液体升起,远离载液盘时,磁性液体落下。s3. After the control part of the magnetic liquid demonstrator detects the action or expression code, it generates a corresponding control signal. The schematic diagram of the demonstration area of the demonstrator is shown in Figure 1. The main demonstration area is controlled by a larger electromagnetic coil, and the magnetic field strength of the electromagnetic coil is controlled by the PWM current waveform duty cycle, and the magnetic field strength controls the height of the magnetic liquid. The larger the duty cycle of the PWM wave, the greater the magnetic field strength of the corresponding electromagnetic coil, the higher the corresponding magnetic liquid rising height, the smaller the PWM wave duty cycle, the smaller the magnetic field strength of the corresponding electromagnetic coil, and the higher the corresponding magnetic liquid rising height. Low. The external demo area is controlled by eight small permanent magnets below the liquid carrier pan. When the magnets approach the liquid carrier pan driven by the motor, the magnetic liquid rises and when it moves away from the liquid carrier pan, the magnetic liquid falls.

s4.磁性液体演示仪演示台部分在接收到控制信号后,同步产生相应的磁性液体的起伏变化。s4. After receiving the control signal, the demonstration stand part of the magnetic liquid demonstrator synchronously generates fluctuations of the corresponding magnetic liquid.

以“点头动作”为例,“点头动作”所对应的磁性液体起伏形态示意图如图3所示,主演示区的磁性液体上下起伏,外部演示区全部同步起伏。Taking the "nodding action" as an example, the schematic diagram of the undulating shape of the magnetic liquid corresponding to the "nodding action" is shown in Figure 3. The magnetic liquid in the main demonstration area undulates up and down, and all the external demonstration areas undulate synchronously.

最后说明的是,以上实施例仅用以说明本发明的技术方案而非限制,尽管参照较佳实施例对本发明进行了详细说明,本领域的普通技术人员应当理解,可以对本发明的技术方案进行修改或者等同替换,而不脱离本发明技术方案的宗旨和范围,其均应涵盖在本发明的权利要求范围当中。Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and not to limit them. Although the present invention has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be Modifications or equivalent substitutions without departing from the spirit and scope of the technical solutions of the present invention should be included in the scope of the claims of the present invention.

Claims (6)

1.一种利用基于磁性液体的动作或表情模拟装置进行模拟的方法,其特征在于:所述基于磁性液体的动作或表情模拟装置包括:1. a kind of method that utilizes the action or expression simulation device based on magnetic liquid to carry out simulation, it is characterized in that: described action or expression simulation device based on magnetic liquid comprises: 摄像机,用于拍摄人体动作或表情;Cameras, used to capture human movements or expressions; 磁性液体演示仪,包括主演示区和多个围绕所述主演示区沿环向均匀分布的外部演示区;A magnetic liquid demonstration instrument, including a main demonstration area and a plurality of outer demonstration areas evenly distributed in the circumferential direction around the main demonstration area; 上位机,其信号连接所述摄像机与磁性液体演示仪的控制器;a host computer, the signal of which is connected to the camera and the controller of the magnetic liquid demonstrator; 主演示区由一个电磁线圈控制,通过PWM电流波形占空比控制电磁线圈的磁场强度,磁场强度控制磁性液体升起高度;外部演示区为8个,其由一一对应的8个位于载液盘下方的电磁线圈控制;The main demonstration area is controlled by an electromagnetic coil, the magnetic field strength of the electromagnetic coil is controlled by the duty ratio of the PWM current waveform, and the magnetic field strength controls the height of the magnetic liquid; Solenoid control under the disc; 所述方法包括以下步骤:The method includes the following steps: s1.通过所述摄像机拍摄人体动作或表情的图像,并将图像传到所述上位机;s1. Shoot images of human movements or expressions through the camera, and transmit the images to the host computer; s2.所述上位机识别拍摄到的动作或表情图像,将识别出的动作或表情进行编码,并将编码传输到磁性液体演示仪的控制器;s2. The upper computer recognizes the captured action or facial expression image, encodes the recognized action or facial expression, and transmits the code to the controller of the magnetic liquid demonstrator; s3.所述磁性液体演示仪的控制器根据所述编码产生相应的控制信号,使所述主演示区和外部演示区的磁性液体产生表征该编码所对应的动作或表情的起伏变化;s3. The controller of the magnetic liquid demonstration instrument generates corresponding control signals according to the encoding, so that the magnetic liquid in the main demonstration area and the external demonstration area is produced to characterize the fluctuations of the corresponding actions or expressions of the encoding; 当上位机识别出的动作为摇头时,所述主演示区的磁性液体起伏,同时各个外部演示区的磁性液体绕主演示区依次往复起伏;When the motion recognized by the host computer is shaking the head, the magnetic liquid in the main demonstration area fluctuates, and at the same time, the magnetic liquid in each external demonstration area fluctuates in turn around the main demonstration area; 当上位机识别出的动作为点头时,所述主演示区的磁性液体起伏,同时各个外部演示区的磁性液体同步起伏;When the action recognized by the host computer is nodding, the magnetic liquid in the main demonstration area fluctuates, and the magnetic liquid in each external demonstration area fluctuates synchronously; 当上位机识别出的动作为眨眼时,所述主演示区和各个外部演示区的磁性液体同步起伏。When the action recognized by the host computer is blinking, the magnetic liquid in the main demonstration area and each external demonstration area fluctuates synchronously. 2.根据权利要求1所述的方法,其特征在于:当上位机识别出的表情为喜悦时,所述主演示区的磁性液体快速起伏,同时各个外部演示区的磁性液体随机起伏;2. The method according to claim 1, wherein: when the facial expression recognized by the host computer is joy, the magnetic liquid in the main demonstration area fluctuates rapidly, while the magnetic liquid in each external demonstration area fluctuates randomly; 当上位机识别出的表情为愤怒时,所述主演示区和各个外部演示区的磁性液体同步快速升起,维持设定时段后同步快速落下;When the facial expression recognized by the host computer is anger, the magnetic liquid in the main demonstration area and each external demonstration area rises synchronously and rapidly, and falls synchronously and quickly after maintaining a set period of time; 当上位机识别出的表情为哀伤时,所述主演示区和各个外部演示区的磁性液体同步缓慢起伏;When the expression recognized by the host computer is sad, the magnetic liquid in the main demonstration area and each external demonstration area fluctuates slowly and synchronously; 当上位机识别出的表情为恐惧时,所述主演示区的磁性液体升起至设定高度后快速抖动,同时各个外部演示区的磁性液体全部升起并保持。When the facial expression recognized by the host computer is fear, the magnetic liquid in the main demonstration area rises to the set height and then shakes rapidly, and at the same time, the magnetic liquid in each external demonstration area is all raised and maintained. 3.根据权利要求2所述的方法,其特征在于:当上位机识别出的动作为眨眼时,所述主演示区和外部演示区的磁性液体同步起伏的频率与眨眼动作的频率正相关。3 . The method according to claim 2 , wherein when the action recognized by the host computer is eye blinking, the frequency of the synchronous fluctuation of the magnetic liquid in the main demonstration area and the external demonstration area is positively correlated with the frequency of eye blinking action. 4 . 4.根据权利要求3所述的方法,其特征在于:所述主演示区的磁性液体的起伏高度由通过主演示区上方的电磁线圈的PWM电流波形的占空比控制。4. The method according to claim 3, wherein the undulating height of the magnetic liquid in the main demonstration area is controlled by the duty cycle of the PWM current waveform passing through the electromagnetic coil above the main demonstration area. 5.根据权利要求4所述的方法,其特征在于:可预先设定一个或多个人体动作或表情;当所述上位机识别到设定的动作或表情时,将与该动作或表情对应的编码传输到磁性液体演示仪的控制器。5. The method according to claim 4, wherein: one or more human body movements or expressions can be preset; when the host computer recognizes the set movements or expressions, it will correspond to the movements or expressions The code is transmitted to the controller of the magnetic fluid demonstrator. 6.根据权利要求5所述的方法,其特征在于:所述上位机每隔设定时段进行一次识别,取多次识别结果中出现次数最多的表情或动作为最终识别结果,并将最终结果编码传输给磁性液体演示仪的控制器。6. method according to claim 5, is characterized in that: described host computer carries out identification once every set time period, takes the facial expression or the action that appears the most times in multiple identification results as final identification result, and final result The code is transmitted to the controller of the magnetic fluid demonstrator.
CN201910162342.6A 2019-03-05 2019-03-05 A magnetic liquid-based action or expression simulation device and method Expired - Fee Related CN109920347B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910162342.6A CN109920347B (en) 2019-03-05 2019-03-05 A magnetic liquid-based action or expression simulation device and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910162342.6A CN109920347B (en) 2019-03-05 2019-03-05 A magnetic liquid-based action or expression simulation device and method

Publications (2)

Publication Number Publication Date
CN109920347A CN109920347A (en) 2019-06-21
CN109920347B true CN109920347B (en) 2020-12-04

Family

ID=66963207

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910162342.6A Expired - Fee Related CN109920347B (en) 2019-03-05 2019-03-05 A magnetic liquid-based action or expression simulation device and method

Country Status (1)

Country Link
CN (1) CN109920347B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201638526U (en) * 2010-03-05 2010-11-17 上海未来伙伴机器人有限公司 Device for simulating human expressions and robot comprising the same
CN103339926A (en) * 2011-11-24 2013-10-02 株式会社Ntt都科摩 Expression output device and expression output method
CN106737745A (en) * 2017-01-05 2017-05-31 珠海市横琴麒翔科技有限公司 Intelligent robot
CN106919899A (en) * 2017-01-18 2017-07-04 北京光年无限科技有限公司 The method and system for imitating human face expression output based on intelligent robot
CN107316546A (en) * 2017-08-03 2017-11-03 重庆大学 Magnetic liquid demonstrator and its control method
CN108326878A (en) * 2017-01-18 2018-07-27 王怀亮 A kind of limb action electronic switching equipment, instruction identification method and recording/playback method
CN208358753U (en) * 2018-04-26 2019-01-11 昆山塔米机器人有限公司 A kind of apery expression display device and robot
CN109345634A (en) * 2018-10-26 2019-02-15 重庆大学 Magnetic field demonstration method and device based on magnetic liquid and mixed reality

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201638526U (en) * 2010-03-05 2010-11-17 上海未来伙伴机器人有限公司 Device for simulating human expressions and robot comprising the same
CN103339926A (en) * 2011-11-24 2013-10-02 株式会社Ntt都科摩 Expression output device and expression output method
CN106737745A (en) * 2017-01-05 2017-05-31 珠海市横琴麒翔科技有限公司 Intelligent robot
CN106919899A (en) * 2017-01-18 2017-07-04 北京光年无限科技有限公司 The method and system for imitating human face expression output based on intelligent robot
CN108326878A (en) * 2017-01-18 2018-07-27 王怀亮 A kind of limb action electronic switching equipment, instruction identification method and recording/playback method
CN107316546A (en) * 2017-08-03 2017-11-03 重庆大学 Magnetic liquid demonstrator and its control method
CN208358753U (en) * 2018-04-26 2019-01-11 昆山塔米机器人有限公司 A kind of apery expression display device and robot
CN109345634A (en) * 2018-10-26 2019-02-15 重庆大学 Magnetic field demonstration method and device based on magnetic liquid and mixed reality

Also Published As

Publication number Publication date
CN109920347A (en) 2019-06-21

Similar Documents

Publication Publication Date Title
Marinoiu et al. 3d human sensing, action and emotion recognition in robot assisted therapy of children with autism
CN102354349B (en) Human-machine interaction multi-mode early intervention system for improving social interaction capacity of autistic children
CN106236115A (en) A kind of psychological test system
CN107030691A (en) A kind of data processing method and device for nursing robot
Takacs Special education and rehabilitation: teaching and healing with interactive graphics
Chen et al. CreativeBioMan: a brain-and body-wearable, computing-based, creative gaming system
Pan et al. Realistic and interactive robot gaze
CN112734946A (en) Vocal music performance teaching method and system
CN113053492A (en) Self-adaptive virtual reality intervention system and method based on user background and emotion
Takács et al. The virtual human interface: A photorealistic digital human
Luz Maria et al. Enrichment of Human‐Computer Interaction in Brain‐Computer Interfaces via Virtual Environments
Wang Application of artificial intelligence and virtual reality technology in the construction of university physical education
CN109920347B (en) A magnetic liquid-based action or expression simulation device and method
McDaniel et al. Therapeutic haptics for mental health and wellbeing
CN108908353B (en) Robot expression imitation method and device based on smooth constraint inverse mechanical model
CN114967937A (en) Virtual human motion generation method and system
CN109410683A (en) A kind of power grid augmented reality training system
CN111399662B (en) Human-robot interaction simulation device and method based on high-realistic virtual avatar
Swaminathan et al. Study on Intelligent Facial Expressions of Humanoid Robot
Matthias et al. Adaptive generation of emotional impact using enhanced virtual environments
CN118664618B (en) Robot simulation eyeball control method, device, equipment and storage medium
Cruse et al. Getting cognitive
Wang et al. Research on Application of Perceptive Human-computer Interaction Based on Computer Multimedia
Birringer Performance and science
CN109986573A (en) An intelligent robot for assisted treatment of children with autism

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20201204

CF01 Termination of patent right due to non-payment of annual fee