WO2015124050A1 - 一种基于自然人机交互技术的喷泉控制方法及系统 - Google Patents

一种基于自然人机交互技术的喷泉控制方法及系统 Download PDF

Info

Publication number
WO2015124050A1
WO2015124050A1 PCT/CN2015/071171 CN2015071171W WO2015124050A1 WO 2015124050 A1 WO2015124050 A1 WO 2015124050A1 CN 2015071171 W CN2015071171 W CN 2015071171W WO 2015124050 A1 WO2015124050 A1 WO 2015124050A1
Authority
WO
WIPO (PCT)
Prior art keywords
fountain
control
natural human
computer interaction
instruction
Prior art date
Application number
PCT/CN2015/071171
Other languages
English (en)
French (fr)
Inventor
王晖
Original Assignee
北京传翼四方科技发展有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京传翼四方科技发展有限公司 filed Critical 北京传翼四方科技发展有限公司
Publication of WO2015124050A1 publication Critical patent/WO2015124050A1/zh

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B05—SPRAYING OR ATOMISING IN GENERAL; APPLYING FLUENT MATERIALS TO SURFACES, IN GENERAL
    • B05B—SPRAYING APPARATUS; ATOMISING APPARATUS; NOZZLES
    • B05B12/00—Arrangements for controlling delivery; Arrangements for controlling the spray area
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B05—SPRAYING OR ATOMISING IN GENERAL; APPLYING FLUENT MATERIALS TO SURFACES, IN GENERAL
    • B05B—SPRAYING APPARATUS; ATOMISING APPARATUS; NOZZLES
    • B05B12/00—Arrangements for controlling delivery; Arrangements for controlling the spray area
    • B05B12/02—Arrangements for controlling delivery; Arrangements for controlling the spray area for controlling time, or sequence, of delivery
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B05—SPRAYING OR ATOMISING IN GENERAL; APPLYING FLUENT MATERIALS TO SURFACES, IN GENERAL
    • B05B—SPRAYING APPARATUS; ATOMISING APPARATUS; NOZZLES
    • B05B12/00—Arrangements for controlling delivery; Arrangements for controlling the spray area
    • B05B12/08—Arrangements for controlling delivery; Arrangements for controlling the spray area responsive to condition of liquid or other fluent material to be discharged, of ambient medium or of target ; responsive to condition of spray devices or of supply means, e.g. pipes, pumps or their drive means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B05—SPRAYING OR ATOMISING IN GENERAL; APPLYING FLUENT MATERIALS TO SURFACES, IN GENERAL
    • B05B—SPRAYING APPARATUS; ATOMISING APPARATUS; NOZZLES
    • B05B17/00—Apparatus for spraying or atomising liquids or other fluent materials, not covered by the preceding groups
    • B05B17/08—Fountains

Definitions

  • the invention relates to the field of control systems based on human-computer interaction technology, in particular to a fountain control method and system based on natural human-computer interaction technology.
  • the common fountain forms are: musical fountains, inductive fountains, and program-controlled fountains.
  • the program-controlled fountain technology is the main realization of the modern fountain system, that is, according to the preset procedure, the water spray shape and the color intensity change of the light are changed.
  • the inductive programmable fountain controls the opening and closing of the fountain through inductive switches such as sound and infrared.
  • the fountain's jet shape is the same as the conventional fountain, according to the preset procedure.
  • the current fountain control system can be divided into two parts: the fountain control part and the stage special effect control part, including the fountain water scene, fireworks, lighting, laser and water curtain projection.
  • the control system part of the fountain is generally controlled by an industrial computer, a PLC controller (programmable logic controller) or a micro-computing unit, and the driving and executing part of the electric circuit is realized by using a self-contained program or an external expansion program. control.
  • This type of control determines that the representation of the fountain is fixed.
  • the operator only watches the fountain, can't manipulate the fountain, and can't interact with the fountain. It fundamentally restricts the innovation of the fountain waterscape expression form, and it has become more and more difficult to meet the higher performance requirements of the large-scale integrated fountain waterscape.
  • the Chinese patent No. 201220631840.4 provides a fountain with a reminding function, including a fountain body, which is equipped with a reminder device, which includes a sensor that can sense an object passing through and a reminder that connects the high sensor.
  • the inductor is mounted on the fountain body.
  • the fountain is equipped with a reminding device, and the reminding device can sense the object passing by, and will remind the reminder to make the function of the fountain crafts richer.
  • the fountain of the utility model can only sense whether an object exists or not, and cannot interact with a person.
  • the Chinese patent with the application number 201320347509.4 provides a fountain that automatically opens and closes using a microwave human body sensing switch, including a water pump, a nozzle, a relay, and a microwave human body sensing switch module and a single chip module disposed in the equipment box.
  • the microwave human body sensing switch module and the single chip module are connected, the single chip module and the relay are connected, and the relay is connected with the water pump.
  • the microwave human body sensor switch module detects someone in a public place, send a signal to the MCU module, and the MCU module controls the relay.
  • the focus device changes the working state of the control circuit, and the fountain is turned on.
  • the microwave human body sensor switch sends a signal to the single chip microcomputer, the single chip module controls the relay, the relay changes the working state of the control circuit, and the fountain is powered off.
  • the beneficial effect is that the microwave human body sensing switch mainly utilizes the Doppler effect principle. When the person is in the sensing range, the switch is always turned on, and the automatic closing is not performed until the person leaves, thereby eliminating the trouble of artificially opening and closing the fountain. Similarly, the fountain of the utility model only senses whether the person is in the sensing range, and cannot meet the higher demand for interacting with people.
  • the invention adopts natural human-computer interaction technology to make the operator an organic part of the fountain waterscape.
  • the operator can directly participate in controlling the fountain through the natural human-machine interaction device.
  • the operator can also be a viewer, so that the present invention brings a new sense of audience participation into the fountain world.
  • a first aspect of the invention relates to a fountain control method based on natural human-computer interaction technology, comprising:
  • the control command packet is converted into a control signal that conforms to the fountain system.
  • the natural human-computer interaction data includes data of a limb movement, a facial expression, a voice, and a gesture.
  • control instruction packet includes control category information, control region information, instruction category information, instruction data information, and verification information.
  • control category information is used to specify a source of the control instruction.
  • control area information is used to specify a fountain modeling area that needs to be controlled.
  • the instruction type information is used to specify whether the instruction data is an analog instruction or a digital instruction.
  • the instruction data information includes a specific control instruction.
  • the fountain system comprises a fountain, a firework, a light, a spray, a laser, a water curtain projection.
  • the second aspect of the present invention also provides a fountain control system based on natural human-computer interaction technology, comprising: a natural human-computer interaction data acquisition unit, configured to collect natural human-computer interaction data of the operator;
  • a natural human-computer interaction data processing unit configured to parse the collected natural human-computer interaction data into a control instruction packet output
  • the control instruction packet conversion unit is configured to convert the control instruction packet into a control signal conforming to the fountain system to complete control of the fountain device.
  • the natural human-computer interaction data acquisition unit is configured with means for collecting data of a limb movement, a facial expression, a voice, and a gesture.
  • control instruction packet includes control category information, control region information, instruction category information, instruction data information, and verification information.
  • control category information is used to specify a source of control instructions.
  • control area information is used to specify a fountain modeling area that needs to be controlled.
  • the instruction category information is used to specify whether the instruction data is an analog instruction or a digital instruction.
  • the instruction data information includes a specific control instruction.
  • the fountain system comprises a fountain, a firework, a light, a spray, a laser, a water curtain projection.
  • control system of the invention is not only suitable for the fountain system, but also for separately controlling the lighting system, the fireworks system, the spray system, and also for separately controlling the stage special effect system.
  • FIG. 1 is a schematic diagram of a fountain control method based on natural human-computer interaction technology in accordance with the present invention.
  • FIG. 2 is a structural diagram of a control instruction packet in a fountain control method based on natural human-computer interaction technology according to the present invention.
  • FIG. 3 is a block diagram of a fountain control system based on natural human-computer interaction technology of the present invention.
  • FIG. 4 is a structural diagram of an embodiment of a fountain control system based on natural human-computer interaction technology according to the present invention.
  • FIG. 5 is a block diagram of a program of a fountain control system based on natural human-computer interaction technology of FIG.
  • FIG. 6 is a structural diagram of another embodiment of a fountain control system based on natural human-computer interaction technology according to the present invention.
  • the present invention provides a fountain control method based on natural human-computer interaction technology. Law, including:
  • the natural human-computer interaction data 10 includes data of limb movements, facial expressions, voices, gestures.
  • the fountain system includes a fountain, a firework, a light, a laser, and a water curtain projection.
  • control instruction packet includes control category information, control region information, instruction category information, instruction data information, and verification information.
  • the control category information is used to distinguish the source of the control command, such as from a limb movement, a gesture, a facial expression, or a voice.
  • the purpose of natural human-computer interaction is to maximize the convenience of human use of the product, rather than letting humans change their original habits for the product.
  • Human communication through language, gestures, facial expressions, body movements, etc. the direction of natural human-computer interaction is to achieve human-computer interaction through the most natural habits of human beings. Therefore, limb movement recognition technology, gesture recognition technology, facial expression technology, and speech recognition technology have become an important part of natural human-computer interaction technology.
  • Limb motion recognition is the recognition of the limbs and movement processes for human-computer interaction. Limb motion recognition interacts through human body language, and input devices are relatively inexpensive.
  • Gesture recognition is a combination of hands and hands and arms to create a variety of gestures and actions for human-computer interaction. It can be divided into digital glove-based recognition and vision-based gesture recognition.
  • the digital glove-based gesture recognition recognition rate is high but the equipment is expensive.
  • the vision-based gesture recognition input device is relatively inexpensive, allowing the user to perform human-computer interaction more naturally.
  • Facial expression recognition is the use of a computer to analyze a person's facial expressions and changes, to achieve a more natural and intelligent interaction between human and machine. Facial expression recognition is to analyze facial images or video sequence images, extract facial motion features and facial deformation features, and classify them into different abstract classes.
  • the image acquisition equipment has low cost, conforms to human recognition habits, and has strong interactivity.
  • Speech recognition is a technique that allows a machine to turn a speech signal into a corresponding text or command through an identification and understanding process.
  • Speech recognition technology includes three aspects: feature extraction technology, pattern matching criteria and model training technology.
  • the speech recognition technology does not need to give special instructions to the user, and the human interaction in the most natural way is convenient to use and the equipment cost is low.
  • human limb movements can be used to control the fountain's spray and lighting system.
  • Human gestures can be used to control the spray system, and facial expressions are displayed in water curtain projection.
  • Voice commands can be applied to small fountains indoors.
  • control relationship between the various components of the above-described natural human-computer interaction technology and the various components of the fountain system can be arbitrarily configured as needed.
  • the control area is used to distinguish between fountain shaped areas that need to be controlled.
  • the instruction category information is used to distinguish whether the instruction data is an analog instruction or a digital instruction.
  • the control instruction obtained by processing the relative position data of the opponent's bone node and the head bone node is a number.
  • the control command obtained by processing the angle data formed between the arm bone and the upper body bone is an analog command.
  • the instruction data information includes specific control instructions.
  • the present invention also provides a fountain control system based on natural human-computer interaction technology, including:
  • the natural human-computer interaction data collecting unit 101 is configured to collect natural human-computer interaction information of the operator
  • the natural human-computer interaction data processing unit 102 is configured to parse the collected natural human-computer interaction data and process the output into a control instruction packet:
  • the control instruction conversion unit 103 is configured to convert the control instruction packet into a control signal conforming to the fountain system; and complete control of the fountain device.
  • the fountain device includes a frequency converter, a relay, a solenoid valve, a water pump, and a lantern.
  • Embodiment 1 is a diagrammatic representation of Embodiment 1:
  • the 13 fountain nozzles on the left side are sprayed; when the bone node of the right hand is higher than the bone node of the human brain, the 13 fountain nozzles on the right side are sprayed.
  • the angle of the bone of the left arm and the bone of the upper body controls the jet height of the 13 fountain heads on the left side; the angle of the bones of the right arm and the bones of the upper body controls the jet height of the 13 fountain heads on the right side.
  • the control system of this embodiment includes a limb sensing device 110, a computer 111, a PCL controller 112, and a fountain device 113.
  • the limb sensing device 110 uses infrared and visible light cameras to acquire human body image information, and can capture three-dimensional whole body data of the human body.
  • the hardware configuration of the computer 111 is as follows.
  • PLC programmable logic controller
  • the software configuration of the computer 111 is as follows.
  • Operating system Windows 7 or Windows Embedded Standard 7 or Windows 8 Developer Preview.
  • the data is received by the limb sensing device 110 and sent to the computer 111.
  • the computer analyzes the processing, a specific control command is sent to the PLC control device 112, which in turn controls the injection of the fountain nozzle.
  • the control software has two subsystems: PC-side control software and PLC-side control software.
  • PC-side control software After the system is initialized, the PC is responsible for analyzing and processing the data returned by the limb sensing sensor, and parsing the specific action, and sending the corresponding control command to the PLC.
  • the PLC is responsible for receiving the control command data sent from the PC, and controlling the fountain to perform different effects according to different control commands.
  • Step 120 Initialize the limb sensing device
  • Step 121 Initialize a data transmission end of the computer and the PLC control device
  • Step 122 The computer receives the operator's limb motion and parses
  • Step 123 Determine whether the limb motion of step 122 belongs to the command action. If it is an instruction action, proceed to step 124; otherwise, proceed to step 122;
  • Step 124 The computer sends an instruction to the PLC control device.
  • the operator performs real-time monitoring of the operator's actions and feedbacks the data without wearing any peripherals.
  • the system analyzes and processes the data fed back by the limb sensing sensor to analyze whether there is an action to be monitored. If there is an action that the system wants to monitor, use the RS-485 serial protocol to send the corresponding control command to the PLC terminal system.
  • the data sent from the PC end system is fed back to the actual jetting effect of the fountain.
  • the system initializes the PLC to the RS-485 communication mode, and then configures certain parameters to start receiving data cyclically.
  • different injection modes are arranged for different control commands. After processing, send it to the corresponding nozzle of the fountain.
  • Embodiment 2 is a diagrammatic representation of Embodiment 1:
  • the large fountain system includes a stage effect section in addition to the fountain.
  • Stage effects include a light show system, a fireworks display system, a projection performance system, a spray show system, a laser show system, and a music performance system.
  • the execution system of the fountain is required to be driven by digital and analog quantities; the implementation includes inverters, solenoid valves, pumps, and lanterns.
  • the system is divided into a natural human-computer interaction sensor, a data processing upper computer, a control fountain lower computer, an analog output unit, an analog execution unit, a digital output unit, and a digital execution unit.
  • the natural human-computer interaction sensor uses the depth-sensing camera technology to perform infrared and optical scanning on the operator, collects the three-dimensional information of the limb movement, and outputs the information to the upper computer for data processing; and obtains the depth of the operator's body through the data processing using the upper computer.
  • Information is given to the skeleton model; database comparison is performed to identify dynamic characters in the system's field of view; actions are defined by the three-dimensional coordinates of the dynamic characters, and control commands are output to control the system as a whole.
  • the control fountain uses the lower computer to convert the data processing with the control command of the upper computer into a control signal suitable for various control protocols of the fountain system.
  • the control protocol includes the DMX512 protocol.
  • the natural human-computer interaction sensor outputs the collected data to the upper computer for data processing through a serial communication protocol and a signal amplifier.
  • the data processing upper computer is responsible for analyzing and processing the data returned by the limb sensing sensor, and parsing the specific action, and sending the corresponding command to the lower computer.
  • the control fountain uses the lower computer to receive the command data sent by the host computer, and sends it to the analog output unit to drive the analog execution unit according to different instructions, or sends it to the digital output unit to drive the digital execution unit. Thereby controlling the fountain to spray different effects.
  • the communication between the upper computer for data processing and the lower computer for controlling the fountain can be wired or wireless.

Landscapes

  • User Interface Of Digital Computer (AREA)
  • Special Spraying Apparatus (AREA)

Abstract

一种基于自然人机交互技术的喷泉控制方法，包括：采集自然人机交互数据（10）；解析所述自然人机交互数据，输出控制指令包（20）；所述控制指令包转换成符合喷泉系统的控制信号（30）。还提供一种基于自然人机交互技术的喷泉控制系统，包括：自然人机交互数据采集单元（101），用于采集操作者的自然人机交互数据；自然人机交互数据处理单元（102），用于解析所述采集的自然人机交互数据，处理成控制指令包输出；控制指令包转换单元（103），用于将所述控制指令包转换成符合喷泉系统的控制信号，以完成对喷泉设备的控制。本发明可将一种全新的操作者参与感带入到喷泉世界。

Description

一种基于自然人机交互技术的喷泉控制方法及系统 技术领域
本发明涉及一种基于人机交互技术的控制系统领域，特别是一种基于自然人机交互技术的喷泉控制方法与系统。
背景技术
目前常见的喷泉形式主要有：音乐喷泉、感应式喷泉、程控喷泉等。其中程控喷泉技术是现代喷泉系统的主要实现方式，即按照预先设置的程序变换喷水造型和灯光色彩强弱变化。
感应式程控喷泉是通过声音、红外等感应式开关来控制喷泉的开启和关闭。而喷泉的喷射造型与灯光效果和常规喷泉一样都是按照预先设置的程序表现的。
目前的喷泉控制系统可分为两大部分：喷泉控制部分及舞台特效控制部分，其中具体包括喷泉水景、焰火、灯光、激光及水幕投影等。就喷泉的控制系统部分而言，一般使用工控计算机、PLC控制器(可编程逻辑控制器)或者微型计算单元进行控制，利用自带程序或者外部扩展程序来实现对电气电路的驱动和执行部分的控制。
这种控制方式，决定了喷泉的表现形式是固定的。操作者只是观看喷泉，不能操纵喷泉，不能与喷泉实现互动。它从根本上制约了喷泉水景表现形式的创新，已经越来越难以满足大型综合性喷泉水景更高的表现要求。
申请号为201220631840.4的中国专利，提供了一种具有提醒功能的喷泉，包括喷泉主体，该喷泉主体装配有提醒装置，该提醒装置包括可感应物体经过的感应器以及连接高感应器的提醒器，该感应器装设于该喷泉主体上。该喷泉装配有提醒装置，提醒装置可以感知从旁边经过的物体，并将以一定的提醒方式作出提醒，使得喷泉工艺品的功能更丰富。该实用新型的喷泉只能感应物体是否存在，而不能与人进行互动。
申请号为201320347509.4的中国专利，提供了一种利用微波人体感应开关自动开启和关闭的喷泉，包括水泵、喷管、继电器、还包括设置在设备盒内的微波人体感应开关模块和单片机模块，所述微波人体感应开关模块和单片机模块连接，所述单片机模块和继电器连接，所述的继电器与水泵连接。工作时，当微波人体感应开关模块检测到公共场所有人时，发送信号到单片机模块，单片机模块控制继电 器，焦点器改变控制电路工作状态，喷泉开启，当无人时，微波人体感应开关发送信号给单片机，单片机模块控制继电器，继电器改变控制电路工作状态，喷泉断电。有益效果是，微波人体感应开关，主要利用多普勒效应原理，当人在感应范围活动，开关始终接通，直到人离开后才自动关闭，免去人为开启和关闭喷泉的麻烦。同样，该实用新型的喷泉也只是感应人是否在感应范围中，而不能满足与人互动的更高需求。
发明内容
本发明采用自然人机交互技术，使操作者成为喷泉水景的一个有机部分。操作者通过自然人机交互设备，可以直接参与控制喷泉。操作者也可以是观众，从而本发明将一种全新的观众参与感带入喷泉世界。
本发明的具体技术方案如下。
本发明的第一方面涉及基于自然人机交互技术的喷泉控制方法，包括：
采集自然人机交互数据；
解析所述自然人机交互数据，输出控制指令包；
所述控制指令包转换成符合喷泉系统的控制信号。
优选的是，所述自然人机交互数据包括肢体动作，面部表情，语音、手势的数据。
优选的是，控制指令包中包括控制类别信息、控制区域信息、指令类别信息、指令数据信息和校验信息。
在上述任一方案中优选的是，所述控制类别信息用于指定控制指令的来源。
在上述任一方案中优选的是，所述控制区域信息用于指定需要控制的喷泉造型区域。
在上述任一方案中优选的是，所述指令类别信息用于指定指令数据是模拟指令还是数字指令。
优选的是，所述指令数据信息中包含具体的控制指令。
优选的是，所述喷泉系统包括喷泉、焰火、灯光、喷雾、激光、水幕投影。
本发明的第二方面还提出一种基于自然人机交互技术的喷泉控制系统，包括：自然人机交互数据采集单元，用于采集操作者的自然人机交互数据；
自然人机交互数据处理单元，用于解析所述采集的自然人机交互数据处理成控制指令包输出；
控制指令包转换单元，用于将所述控制指令包转换成符合喷泉系统的控制信号，完成对喷泉设备的控制。
优选的是，所述自然人机交互数据采集单元配置有包括采集肢体动作，面部表情，语音、手势的数据的装置。
优选的是，控制指令包中包括控制类别信息、控制区域信息、指令类别信息、指令数据信息和校验信息。
优选的是，所述控制类别信息用于指定控制指令的来源。
优选的是，所述控制区域信息用于指定需要控制的喷泉造型区域。
优选的是，所述指令类别信息用于指定指令数据是模拟指令还是数字指令。
优选的是，所述指令数据信息中包含具体的控制指令。
优选的是，所述喷泉系统包括喷泉、焰火、灯光、喷雾、激光、水幕投影。
本发明的控制系统不仅适用与喷泉系统，也适用于单独控制灯光系统、焰火系统、喷雾系统，也适用于单独控制舞台特效系统。
附图说明
图1为按照本发明的基于自然人机交互技术的喷泉控制方法的示意图。
图2为本发明基于自然人机交互技术的喷泉控制方法中控制指令包的结构图。
图3为本发明基于自然人机交互技术的喷泉控制系统的框图。
图4为本发明基于自然人机交互技术的喷泉控制系统的一实施例结构图。
图5为基于图3的基于自然人机交互技术的喷泉控制系统的一程序结构图。
图6为本发明基于自然人机交互技术的喷泉控制系统的另一实施例结构图。
具体实施方式
为了能够更加清楚地理解本发明，下面结合附图和具体实施例对本发明做进一步说明。
如图1所示，本发明给出了基于自然人机交互技术的喷泉控制方 法，包括：
采集自然人机交互数据10；
解析自然人机交互数据，输出控制指令包20；
转换成符合喷泉系统的控制信号30。
所述自然人机交互数据10包括肢体动作，面部表情，语音、手势的数据。
所述喷泉系统包括喷泉、焰火、灯光、激光、水幕投影。
如图2所示，控制指令包中包括控制类别信息、控制区域信息、指令类别信息、指令数据信息和校验信息。
所述控制类别信息用于区分控制指令的来源，如来源于肢体动作、手势、面部表情、还是语音。
自然人机交互的目的，就是要最大限度地方便人类对产品的使用，而不是让人类为了产品而改变原有的习惯。人类交流通过语言、手势、面部表情、肢体动作等，自然人机交互发展方向就是通过人的最自然的习惯来实现人机交互。因此，肢体动作识别技术、手势识别技术、面部表情技术、语音识别技术成为自然人机交互技术的重要组成部分。
肢体动作识别是通过肢体和动作过程的识别，进行人机交互。肢体动作识别通过人的肢体语言进行交互，输入设备比较便宜。
手势识别是通过手或手和手臂结合所产生的各种姿势和动作，进行人机交互，可分为基于数字手套的识别和基于视觉的手势识别。基于数字手套的手势识别识别率高但设备昂贵。基于视觉的手势识别输入设备比较便宜，使用户更加自然地进行人机交互。
面部表情识别是利用计算机分析特定人的脸部表情及变化，实现人机之间更自然更智能化的交互。面部表情识别是对包含面部静止图像或视频序列图像进行分析，从中提取面部运动特征和面部变形特征，并进行分类划分到各个不同的抽象类中。其图像采集设备成本低，符合人类的识别习惯，交互性强。
语音识别是让机器通过识别和理解过程把语音信号变为相应的文本或命令的技术。语音识别技术包括特征提取技术、模式匹配准则及模型训练技术3个方面。语音识别技术不需要对用户进行特殊的说明，人以最自然的方式进行人机交互，使用方便，设备造价低廉。
在喷泉系统中，人的肢体动作可以用来控制喷泉的喷射和灯光系统，人的手势姿势可以用来控制喷雾系统，面部表情以水幕投影方式展现。而语音命令可应用在室内的小型喷泉上。
上述自然人机交互技术的各个组成部分与喷泉系统的各个组成部分之间的控制关系,根据需要可以任意配置。
所述控制区域用于区分需要控制的喷泉造型区域。
所述指令类别信息用于区分指令数据是模拟指令还是数字指令，如下面谈到的实施例1中所示，对手的骨骼节点与头部骨骼节点的相对位置数据进行处理而得到的控制指令是数字指令，而对手臂骨骼与上身骨骼的之间形成的角度数据进行处理而得到的控制指令是模拟指令。
所述指令数据信息中包含具体的控制指令。
如图3所示，本发明还提出一种基于自然人机交互技术的喷泉控制系统，包括：
自然人机交互数据采集单元101：用于采集操作者的自然人机交互信息；
自然人机交互数据处理单元102：用于解析所述采集的自然人机交互数据，处理成控制指令包输出：
控制指令转换单元103：用于将所述控制指令包转换成符合喷泉系统的控制信号；完成对喷泉设备的控制。
所述喷泉设备包括变频器、继电器、电磁阀、水泵、彩灯。
下面列举2个应用例子来具体说明本发明。
实施例一：
给出本发明应用于具有25个喷泉喷头的小型喷泉系统的例子。
当左手的骨骼节点高于人脑的骨骼节点时，左侧的13个喷泉喷头喷射；当右手的骨骼节点高于人脑的骨骼节点时，右侧的13个喷泉喷头喷射。当左手的骨骼节点低于人脑的骨骼节点时，左侧的13个喷泉喷头停止喷射；当右手的骨骼节点低于人脑的骨骼节点时，右侧的13个喷泉喷头停止喷射。
左手臂的骨骼与上身骨骼的角度来控制左侧的13个喷泉喷头的喷射高度；右手臂的骨骼与上身骨骼的角度来控制右侧的13个喷泉喷头的喷射高度。
本实施例的控制系统如图4所示，包括肢体感应设备110、计算机111、PCL控制器112、喷泉设备113。
其中，肢体感应设备110使用红外及可见光摄像头来获取人体影像信息，可捕捉人体三维全身数据。
计算机111的硬件配置如下，
计算机32位(x86)或64位(x64)处理器；双核2.66-GHz或更快的处理器；USB 2.0专用总线；2GB内存；肢体感应设备、可编程逻辑控制器(PLC)、变频器、中间继电器、通用串行总线信号放大器、RS-485数据线。
计算机111的软件配置如下，
操作系统：Windows 7或Windows Embedded Standard 7或Windows 8Developer Preview。
首先通过肢体感应设备110接收数据发送到计算机111，计算机分析处理后，发送特定控制指令给PLC控制设备112，PLC控制设备继而控制喷泉喷头的喷射。
控制软件共有两个子系统，分别是：PC端控制软件，以及PLC端控制软件。当系统初始化之后，PC端负责分析处理肢体感应传感器返回的数据，并解析特定动作，发送相应的控制指令给PLC端。PLC端负责接收PC端发送来的控制指令数据，并根据不同控制指令，控制喷泉进行不同效果的喷射。
其中PC端的软件流程如图5所示。
步骤120：初始化肢体感应设备；
步骤121：初始化计算机与PLC控制设备的数据传输端；
步骤122：计算机接收操作者的肢体动作并解析；
步骤123：判断步骤122的肢体动作是否属于指令动作。如果是指令动作，则进入步骤124；否则进入步骤122；
步骤124：计算机发送指令到PLC控制设备。
本实施例中，操作者无需佩戴任何外设的情况下，对操作者的动作进行实时监控并将数据反馈。系统对肢体感应传感器反馈的数据进行分析处理，解析出是否存在想要监控的动作。如果存在系统想要监控的动作，则使用RS-485串口协议发送相应的控制指令到PLC端子系统。
对PC端系统发送来的数据反馈到喷泉实际喷射效果上，本系统采用将PLC初始化为RS-485通讯模式，而后配置一定参数后，开始循环接收数据。对接收到的数据指令处理，对不同控制指令，编排不同喷射方式。处理完后，发送给喷泉的相应喷头。
实施例二：
给出本发明应用于大型喷泉系统的例子。
大型喷泉系统除了喷泉以外还包括舞台特效部分。舞台特效部分包括灯光表演系统、焰火表演系统、投影表演系统、喷雾表演系统、激光表演系统、音乐表演系统。
对于大型喷泉系统需要用数字量和模拟量驱动喷泉的执行系统；执行部分包括变频器、电磁阀、水泵、彩灯。
如图6所示本系统分为自然人机交互传感器、数据处理用上位机、控制喷泉用下位机、模拟输出单元、模拟执行单元、数字输出单元、以及数字执行单元。
自然人机交互传感器采用深度感知摄像技术对操作者进行红外及光学扫描，将肢体动作的三维信息进行采集，并将信息输出到数据处理用上位机；通过数据处理用上位机获得操作者身体的深度信息并赋予骨骼模型；进行数据库比对，以识别系统视野内的动态人物；通过动态人物的三维坐标来定义动作，并输出控制指令，对系统进行整体控制。
控制喷泉用下位机将数据处理用上位机的控制指令实时转换成适用于喷泉系统的各种控制协议的控制信号。控制协议包括DMX512协议。自然人机交互传感器通过串行通讯协议及信号放大器将采集到的数据输出给数据处理用上位机。
数据处理用上位机负责分析处理肢体感应传感器返回的数据，并解析特定动作，发送相应的指令给下位机。
控制喷泉用下位机负责接收上位机发送来的指令数据，并根据不同指令，发送到模拟输出单元驱动模拟执行单元，或者发送到数字输出单元驱动数字执行单元。从而控制喷泉进行不同效果的喷射。
数据处理用上位机与控制喷泉用下位机的通讯可采用有线方式或无线方式。
尽管具体地参考其优选实施例来示出并描述了本发明，但本领域的技术人员可以理解，可以做出形式和细节上的各种改变而不脱离所附权利要求书中所述的本发明的范围。以上结合本发明的具体实施例做了详细描述，但并非是对本发明的限制。凡是依据本发明的技术实质对以上实施例所做的任何简单修改，均仍属于本发明技术方案的范围。

Claims (16)

  1. 一种基于自然人机交互技术的喷泉控制方法，包括采集自然人机交互数据，其特征在于：解析所述自然人机交互数据，输出控制指令包；将所述控制指令包转换成符合喷泉系统的控制信号。
  2. 根据权利要求1所述的基于自然人机交互技术的喷泉控制方法，其特征在于，所述自然人机交互数据包括肢体动作，面部表情，语音、手势的数据。
  3. 根据权利要求1所述的基于自然人机交互技术的喷泉控制方法，其特征在于，所述控制指令包中包括控制类别信息、控制区域信息、指令类别信息、指令数据信息和校验信息。
  4. 根据权利要求3所述的基于自然人机交互技术的喷泉控制方法，其特征在于，所述控制类别信息用于指定控制指令的来源。
  5. 根据权利要求3所述的基于自然人机交互技术的喷泉控制方法，其特征在于，所述控制区域信息用于指定需要控制的喷泉造型区域。
  6. 根据权利要求3所述的基于自然人机交互技术的喷泉控制方法，其特征在于，所述指令类别信息用于指定指令数据是模拟指令还是数字指令。
  7. 根据权利要求3所述的基于自然人机交互技术的喷泉控制方法，其特征在于，所述指令数据信息中包含具体的控制指令。
  8. 根据权利要求1所述的基于自然人机交互技术的喷泉控制方法，其特征在于，所述喷泉系统包括喷泉、焰火、灯光、喷雾、激光、水幕投影。
  9. 一种基于自然人机交互技术的喷泉控制系统，包括用于采集操作者的自然人机交互数据的自然人机交互数据采集单元，其特征在于，还包括：
    自然人机交互数据处理单元，用于解析所述采集的自然人机交互数据，并将其处理成控制指令包输出；
    控制指令包转换单元，用于将所述控制指令包转换成符合喷泉系统的控制信号，以完成对喷泉设备的控制。
  10. 根据权利要求9所述的基于自然人机交互技术的喷泉控制系统，其特征在于，所述自然人机交互数据采集单元配置有采集肢体动作，面部表情，语音、手势的数据的装置。
  11. 根据权利要求9所述的基于自然人机交互技术的喷泉控制系统，其特征在于，控制指令包中包括控制类别信息、控制区域信息、指令类别信息、指令数据信息和校验信息。
  12. 根据权利要求11所述的基于自然人机交互技术的喷泉控制系统，其特征在于，所述控制类别信息用于指定控制指令的来源。
  13. 根据权利要求11所述的基于自然人机交互技术的喷泉控制系统，其特征在于，所述控制区域信息用于指定需要控制的喷泉造型区域。
  14. 根据权利要求11所述的基于自然人机交互技术的喷泉控制系统，其特征在于，所述指令类别信息用于指定指令数据是模拟指令还是数字指令。
  15. 根据权利要求11所述的基于自然人机交互技术的喷泉控制系统，其特征在于，所述指令数据信息中包含具体的控制指令。
  16. 根据权利要求9所述的基于自然人机交互技术的喷泉控制系统，其特征在于，所述喷泉系统包括喷泉、焰火、灯光、喷雾、激光、水幕投影。
PCT/CN2015/071171 2014-02-24 2015-01-21 一种基于自然人机交互技术的喷泉控制方法及系统 WO2015124050A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410061461.X 2014-02-24
CN201410061461.XA CN103769339A (zh) 2014-02-24 2014-02-24 一种基于自然人机交互技术的喷泉控制方法及系统

Publications (1)

Publication Number Publication Date
WO2015124050A1 true WO2015124050A1 (zh) 2015-08-27

Family

ID=50562365

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/071171 WO2015124050A1 (zh) 2014-02-24 2015-01-21 一种基于自然人机交互技术的喷泉控制方法及系统

Country Status (2)

Country Link
CN (1) CN103769339A (zh)
WO (1) WO2015124050A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108514969A (zh) * 2018-04-14 2018-09-11 东莞市科学技术博物馆 一种频率可调的水帘控制器
CN113741563A (zh) * 2021-09-11 2021-12-03 无锡联友塑业有限公司 应用区块链的出水控制平台

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103769339A (zh) * 2014-02-24 2014-05-07 北京传翼四方科技发展有限公司 一种基于自然人机交互技术的喷泉控制方法及系统
CN105045176A (zh) * 2015-07-08 2015-11-11 北京传翼四方科技发展有限公司 一种基于自然人机交互技术的电子水幕控制方法及系统
CN107138339A (zh) * 2017-07-12 2017-09-08 深圳奥雅设计股份有限公司 一种实现与人互动的水柱控制方法
CN107991893A (zh) * 2017-11-14 2018-05-04 美的集团股份有限公司 实现通信的方法、手势识别模组、主控模块及家电设备
CN108319193A (zh) * 2018-01-26 2018-07-24 浙江圣火智远文化发展有限公司 一种舞台设备综合智能控制系统
CN108335343A (zh) * 2018-03-15 2018-07-27 北京中科水景科技有限公司 喷泉预演仿真方法、系统及服务器
CN110394270A (zh) * 2019-07-03 2019-11-01 秦培钧 一种3d互动水幕的控制装置及控制方法
CN112286101A (zh) * 2020-10-29 2021-01-29 王银芝 基于串联控制总线的喷泉控制系统及其方法
CN114849959B (zh) * 2022-04-17 2023-09-29 深圳市天悦水景设备有限公司 一种互动式喷泉装置

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0614321A (ja) * 1992-06-29 1994-01-21 Kubota Corp 制御システム
JP2001029856A (ja) * 1999-07-19 2001-02-06 Kubota Corp 噴水装置
CN102711315A (zh) * 2012-04-16 2012-10-03 东莞光阵显示器制品有限公司 基于视频动态识别的智能室内照明控制方法及系统
CN203012518U (zh) * 2012-11-03 2013-06-19 西安天动数字科技有限公司 一种人与激光互动表演系统
CN103369795A (zh) * 2013-07-22 2013-10-23 中国地质大学（武汉） 一种互动型灯光智能控制系统
KR20130117186A (ko) * 2012-04-18 2013-10-25 한국산업기술대학교산학협력단 모션 인식을 통한 자동 분수 제어 시스템 및 방법
CN203437260U (zh) * 2013-05-31 2014-02-19 北京农学院 一种控制型喷泉
CN103769339A (zh) * 2014-02-24 2014-05-07 北京传翼四方科技发展有限公司 一种基于自然人机交互技术的喷泉控制方法及系统

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101071752B1 (ko) * 2009-07-23 2011-10-11 (주)셈투유 공원 등에 적용하는 스마트 분수 및 그 제어 장치
KR100951003B1 (ko) * 2009-08-17 2010-04-02 플러스파운틴(주) 관람자 참여형 음악분수 연출 장치
JP2013139031A (ja) * 2011-12-09 2013-07-18 Juco:Kk 噴水システム
CN103279048A (zh) * 2013-06-05 2013-09-04 北京农学院 一种景观远程控制装置

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0614321A (ja) * 1992-06-29 1994-01-21 Kubota Corp 制御システム
JP2001029856A (ja) * 1999-07-19 2001-02-06 Kubota Corp 噴水装置
CN102711315A (zh) * 2012-04-16 2012-10-03 东莞光阵显示器制品有限公司 基于视频动态识别的智能室内照明控制方法及系统
KR20130117186A (ko) * 2012-04-18 2013-10-25 한국산업기술대학교산학협력단 모션 인식을 통한 자동 분수 제어 시스템 및 방법
CN203012518U (zh) * 2012-11-03 2013-06-19 西安天动数字科技有限公司 一种人与激光互动表演系统
CN203437260U (zh) * 2013-05-31 2014-02-19 北京农学院 一种控制型喷泉
CN103369795A (zh) * 2013-07-22 2013-10-23 中国地质大学（武汉） 一种互动型灯光智能控制系统
CN103769339A (zh) * 2014-02-24 2014-05-07 北京传翼四方科技发展有限公司 一种基于自然人机交互技术的喷泉控制方法及系统

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108514969A (zh) * 2018-04-14 2018-09-11 东莞市科学技术博物馆 一种频率可调的水帘控制器
CN113741563A (zh) * 2021-09-11 2021-12-03 无锡联友塑业有限公司 应用区块链的出水控制平台
CN113741563B (zh) * 2021-09-11 2022-02-22 无锡联友塑业有限公司 应用区块链的出水控制平台

Also Published As

Publication number Publication date
CN103769339A (zh) 2014-05-07

Similar Documents

Publication Publication Date Title
WO2015124050A1 (zh) 一种基于自然人机交互技术的喷泉控制方法及系统
CN106440192B (zh) 一种家电控制方法、装置、系统及智能空调
CN101474481B (zh) 情感机器人系统
CN208013692U (zh) 一种基于语音交互方式的智慧展厅控制系统
CN107544266A (zh) 家庭健康服务机器人
CN107632699B (zh) 基于多感知数据融合的人机自然交互系统
CN102831380A (zh) 一种基于深度图像感应的肢体动作识别方法及系统
CN109240682B (zh) 基于ar的交互编程系统、方法、介质及智能设备
CN111726921B (zh) 一种体感交互灯光控制系统
CN102932212A (zh) 一种基于多通道交互方式的智能家居控制系统
CN104102183A (zh) 一种智能家居手势控制方法及装置
JP2019063479A (ja) 身体情報分析装置およびその眉型比較補助方法
CN206029912U (zh) 交互式vr的智能机器人
CN107942695A (zh) 情感智能音响系统
KR20060079832A (ko) 임베디드 시스템기반의 감정표현 휴먼노이드 로봇
WO2017101707A1 (zh) 一种无线控制的美甲彩绘系统
CN106214163B (zh) 一种下肢畸形矫正术后康复的人工心理辅导装置
CN106737736A (zh) 一种智能画像机器人
CN109597531A (zh) 一种基于平面手势操作的照明设备控制装置及控制系统
CN208240026U (zh) 一种实验室智能型通风柜控制装置
Zhang et al. Robotic control of dynamic and static gesture recognition
CN109814722A (zh) 一种多模态人机交互系统及交互方法
CN101753872A (zh) 能控制电视机的手套和控制方法以及受控的电视机装置
CN202584048U (zh) 一种基于dsp图像定位、语音识别的智能鼠标
CN206426108U (zh) 一种智能画像机器人

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15751358

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15751358

Country of ref document: EP

Kind code of ref document: A1