WO2018170790A1 - Zigbee-based wireless continuous image transmission system - Google Patents

Zigbee-based wireless continuous image transmission system Download PDF

Info

Publication number
WO2018170790A1
WO2018170790A1 PCT/CN2017/077681 CN2017077681W WO2018170790A1 WO 2018170790 A1 WO2018170790 A1 WO 2018170790A1 CN 2017077681 W CN2017077681 W CN 2017077681W WO 2018170790 A1 WO2018170790 A1 WO 2018170790A1
Authority
WO
WIPO (PCT)
Prior art keywords
subsystem
node
image
data
image sensor
Prior art date
Application number
PCT/CN2017/077681
Other languages
French (fr)
Chinese (zh)
Inventor
邹霞
Original Assignee
邹霞
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 邹霞 filed Critical 邹霞
Priority to PCT/CN2017/077681 priority Critical patent/WO2018170790A1/en
Publication of WO2018170790A1 publication Critical patent/WO2018170790A1/en

Links

Definitions

  • the present invention relates to a ZigBee-based wireless continuous image transmission system, which belongs to the field of wireless communication and imaging.
  • ZigBee is an emerging short-range, low-rate wireless network technology, which is based on a group
  • the IEEE802.15.4 wireless standard has developed technical standards for networking, security, and application software. It is mainly suitable for use in the fields of automatic control and remote control, and can be embedded in various devices.
  • ZigBee technology has the following characteristics:
  • Carrier Sense Multiple Access with Collision Avoidance (CSMA/CA) technology avoids competition and conflicts in sending data ;; use transmission mode with acknowledgment and weight Transmission mechanism; use Cyclic Redundancy Check (CRC) to ensure the correctness of the data.
  • CSMA/CA Carrier Sense Multiple Access with Collision Avoidance
  • CRC Cyclic Redundancy Check
  • ZigBee provides a three-level security mode, including no security settings, the use of access control lists to prevent illegal access to data and the use of advanced encryption standards (Advanced Encryption Standard with 128-bit key, AES-128 A symmetric cipher to flexibly determine its security attributes.
  • advanced encryption standards Advanced Encryption Standard with 128-bit key, AES-128 A symmetric cipher to flexibly determine its security attributes.
  • ⁇ delay communication delay and delay from the dormant state are very short, the typical search device delay is 30ms, sleep activation delay is 15ms, active device channel access delay is 15ms.
  • Each ZigBee network can support up to 65,535 devices.
  • ZigBee technology Compared with existing wireless communication technologies, ZigBee technology has the characteristics of low power consumption and low cost, and is suitable for carrying services with small data traffic.
  • FIG. 1 Schematic diagram of the ZigBee protocol stack architecture is shown in Figure 1, with reference to the open system interconnection (Open System) Interconnect, OSI) model, from top to bottom, Application Layer (APL) ⁇ Network Layer (NWK:), Medium Access Layer (MAC), and Physical Layer (Physical Layer, PHY) ), wherein the application layer is composed of an application object (up to 240), a ZigBee Device Object (ZDO), and an Application Support Sub-layer (APS).
  • a security service layer has been developed to provide security services for NWK and APS.
  • ZigBee is very suitable for control applications at low data rates and IoT-related applications for sensing signal transmission.
  • ZigBee technology has gradually moved to the field of practical application after years of development. , becoming a major standard for short-range wireless transmission, and is moving toward miniaturization, multi-functionality, intelligence, and low power consumption.
  • the original purpose of ZigBee technology development is not to transmit multimedia information such as voice, image and video.
  • the traditional ZigBee technology is to implement simple environmental data (such as temperature, humidity, light intensity) on micro nodes with severe energy constraints. Acquisition, transmission and processing.
  • simple environmental data such as temperature, humidity, light intensity
  • an object of the present invention is to provide a ZigBee-based wireless continuous image transmission system, including a host computer application subsystem, a convergence node subsystem, and an image sensor subsystem.
  • the upper computer subsystem is connected to the sink node subsystem, and the sink node subsystem is wirelessly connected to the image sensor subsystem.
  • the sink node subsystem and the image sensor subsystem each include a wireless communication module, and the image sensor subsystem further includes a camera module.
  • the upper computer subsystem and the aggregation node subsystem are connected through a serial port.
  • the upper computer subsystem implements serial port initialization, command transmission, data receiving and verification, and image storage of the upper computer, and the upper computer and the aggregation node are connected through a serial port, and send instructions to the aggregation node through the RS-232 serial port.
  • the foregoing aggregation node subsystem implements aggregation node initialization, data reception, and data transmission;
  • the aggregation of the aggregation node includes initialization of the protocol stack and initialization of the peripheral circuit of the wireless communication module;
  • data reception includes wirelessly receiving data sent from the image sensor node, and receiving an instruction from the upper computer through the serial port;
  • the data transmission includes wirelessly transmitting the instruction to the image sensor node wirelessly.
  • the communication module and send data to the host computer through the serial port.
  • the image sensor subsystem includes image sensor node initialization, data reception, and data transmission; image sensor node initialization refers to protocol stack initialization and initialization of wireless communication peripheral circuits; and data reception includes wireless reception from a sink node. Commands, and receiving data from the camera through the serial port; data transmission includes wirelessly transmitting data to the aggregation node, and sending commands to the camera through the serial port.
  • the upper computer application subsystem includes a serial communication module and an image storage module.
  • the serial communication module includes an initialization serial port, and sends a command frame for controlling the initialization and photographing of the camera to the aggregation node through the RS-232 serial cable, and also receives the camera response frame and the image data frame from the aggregation node.
  • the image storage module saves the image to a disk file system in JPEG file format.
  • the sink node in the sink node subsystem implements relay forwarding, and the host computer sends a command frame for controlling camera initialization and photographing to the sink node through the RS-232 serial line, and the sink node forwards the command frame to the sink node without a trade-off.
  • the image sensor node receives the response frame and the image data frame wirelessly transmitted by the image sensor node, and determines the type of the frame. If it is an image data frame, the frame header is removed, and the payload is forwarded to the upper position through the RS-232 serial cable. If it is another type of data frame, it will be forwarded directly to the host computer. After receiving the image data frame, the sink node also determines whether the received image data frame is the last frame.
  • the ZigBee-based wireless continuous image transmission system provided by the present invention can adapt to a long transmission distance, is not susceptible to image pixel size and transmission distance, and has high image quality and continuous image frames. The rate is also higher.
  • FIG. 1 is a schematic diagram of a ZigBee protocol stack architecture
  • 2 is a schematic diagram of a ZigBee-based wireless continuous image transmission system according to the present invention
  • FIG. 3 is a schematic diagram of the operation of a ZigBee-based wireless continuous image transmission system according to the present invention.
  • FIG. 4 is a schematic diagram of a working process of a host computer of a ZigBee-based wireless continuous image transmission system according to the present invention
  • FIG. 5 is a schematic diagram of a workflow of a convergence node of a ZigBee-based wireless continuous image transmission system according to the present invention
  • FIG. The invention is based on the ZigBee-based wireless continuous image transmission system image sensor node workflow diagram.
  • the present invention provides a wireless continuous image transmission system based on ZigBee.
  • the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
  • the ZigBee-based wireless continuous image transmission system includes:
  • the host computer subsystem includes the host computer serial port initialization, command transmission, data receiving and verification, and image saving.
  • the upper computer and the aggregation node are connected through the serial port, and send instructions to the aggregation node through the RS-232 serial port, such as a reset instruction, setting a photo picture compression rate command, reading a picture data command, etc., receiving and checking the instruction confirmation data from the aggregation node.
  • image data and save the image data, mainly to achieve camera initialization and camera taking.
  • the wireless communication module in the aggregation node includes: aggregation node initialization, data reception, and data transmission.
  • Aggregation node initialization refers to protocol stack initialization and initialization of wireless communication peripheral circuits.
  • the data receiving includes wirelessly receiving data sent from the image sensor node, and receiving an instruction from the host computer through the serial port.
  • the data transmission includes wirelessly transmitting an instruction to the image sensor node wireless communication module, and transmitting data to the upper computer through the serial port.
  • the wireless communication module in the image sensor node subsystem includes image sensor node initialization, data reception, and data transmission.
  • Image sensor node initialization refers to protocol stack initialization and initialization of peripheral circuits of the wireless communication module; data reception includes wirelessly receiving an instruction sent from the aggregation node, and receiving data from the camera through the serial port; and data transmission includes wirelessly transmitting data to the aggregation node, and Send commands to the camera through the serial port.
  • Each module in the continuous image transmission system needs to coordinate with other modules in sequence, and the system software working diagram is shown in FIG. 3.
  • the user can send commands through the host computer application software to control the serial port baud rate of the camera, the size and compression ratio of the captured image, the number of consecutive photographs, etc., and can save the captured image in the JPEG format on the host computer.
  • the upper computer application software flow chart is shown in Figure 4.
  • the internal communication of the entire non-continuous image transmission system is performed in accordance with a frame structure.
  • the host computer defines the communication protocol.
  • the response frame indicates the response data returned by the camera after receiving the camera command sent by the host computer.
  • the upper computer checks the response frame. If it is correct, it continues to execute. If it is wrong, it resends the corresponding command frame.
  • the upper computer application software is composed of two parts: a serial communication module and an image storage module.
  • the serial communication module includes an initialization serial port, and sends a command frame for controlling the initialization and photographing of the camera to the aggregation node through the RS-232 serial cable, and also receives the camera response frame and the image data frame from the aggregation node.
  • the image storage module saves the image to a disk file system in JPEG file format.
  • the sink node plays the role of relay forwarding throughout the system.
  • the host computer sends a command frame for controlling camera initialization and photographing to the sink node through the RS-232 serial line, and the sink node forwards the command frame to the image sensor node without retreat; the sink node receives the response frame and the image data frame wirelessly transmitted by the image sensor node. And determine the type of the frame. If it is an image data frame, the frame header is removed, and the payload is forwarded to the upper computer through the RS-232 serial cable. If it is another type of data frame, it is directly forwarded to the upper computer. After receiving the image data frame, the sink node also determines whether the received image data frame is the last frame.
  • the aggregation node software flow chart is shown in Figure 5.
  • the specific operation flow of the image sensor node is as follows:
  • the image sensor node is powered on, receives a command frame wirelessly sent by the sink node, parses and strips the frame header portion, sends the image to the camera through the serial port, initializes the camera, and periodically performs an image. collection.
  • the wireless communication module reads the image data collected by the camera through the serial port. Each time it receives 100 bytes from the camera, it is encapsulated into an image data frame, and the frame header indicates whether the image data frame is the last frame.
  • the wireless communication module of the image sensor node is wirelessly transmitted to the wireless communication module of the aggregation node every time an image data frame is encapsulated.
  • the software flow chart of the image sensor node is shown in Figure 6.
  • the ZigBee-based wireless continuous image transmission system provided by the invention can adapt to a long transmission distance, is not easily affected by image pixel size and transmission distance, and has high image quality, and the frame rate of continuous images is also Higher.

Abstract

The present invention provides a Zigbee-based wireless continuous image transmission system, comprising an upper computer application subsystem, an aggregation node subsystem, and an image sensor subsystem; the upper computer subsystem being connected to the aggregation node subsystem; the aggregation node subsystem being wirelessly connected to the image sensor subsystem; the aggregation node subsystem and the image sensor subsystem both comprising a wireless communication module; the image sensor subsystem further comprising a camera module; and the upper computer subsystem being connected, by means of a serial port, to the aggregation node subsystem. Compared with the prior art, the Zigbee-based wireless continuous image transmission system provided by the present invention is able to cope with longer transmission distances, is not easily affected by the image pixel size and transmission distance, produces images of a relatively high quality, and has a relatively high frame rate for continuous images.

Description

基于 ZigBee的无线连续图像传输系统 技术领域  ZigBee-based wireless continuous image transmission system
[0001] 本发明涉及一种基于 ZigBee的无线连续图像传输系统, 属于无线通信和图像领 域。  [0001] The present invention relates to a ZigBee-based wireless continuous image transmission system, which belongs to the field of wireless communication and imaging.
背景技术  Background technique
[0002] ZigBee是一种新兴的短距离、 低速率无线网络技术, 它是一组基于  [0002] ZigBee is an emerging short-range, low-rate wireless network technology, which is based on a group
IEEE802.15.4无线标准研制幵发的, 有关组网、 安全和应用软件方面的技术标准 , 主要适合用于自动控制和远程控制领域, 可以嵌入各种设备。  The IEEE802.15.4 wireless standard has developed technical standards for networking, security, and application software. It is mainly suitable for use in the fields of automatic control and remote control, and can be embedded in various devices.
[0003] ZigBee技术具有如下特点:  [0003] ZigBee technology has the following characteristics:
[0004] 1、 高可靠性: 采用载波监听多路访问 /冲突避免 (Carrier Sense Multiple Access with Collision Avoidance , CSMA/CA)技术避免了发送数据吋的竞争和冲突; 使 用带应答的传输方式和重传机制; 使用循环冗余校验 (Cyclical Redundancy Check , CRC)确保数据的正确性。  [0004] 1, high reliability: Carrier Sense Multiple Access with Collision Avoidance (CSMA/CA) technology avoids competition and conflicts in sending data ;; use transmission mode with acknowledgment and weight Transmission mechanism; use Cyclic Redundancy Check (CRC) to ensure the correctness of the data.
[0005] 2、 低功耗: 终端设备通信状态下为几十毫瓦, 睡眠模式下为几十微瓦。 在低 耗电待机模式下 2节 5号干电池可支持 1个节点工作 6个月〜 24个月。  [0005] 2. Low power consumption: tens of milliwatts in the communication state of the terminal device, and several tens of microwatts in the sleep mode. In the low-power standby mode, the No. 5 dry battery can support 1 node work for 6 months to 24 months.
[0006] 3、 低成本: ZigBee芯片成本只有两美元左右, 而且 ZigBee协议是免专利费的  [0006] 3, low cost: ZigBee chip cost only about two dollars, and ZigBee agreement is free of patent fees
[0007] 4、 高安全性: ZigBee提供了三级安全模式, 包括无安全设定、 使用接入控制 清单防止非法获取数据以及采用高级加密标准 (Advanced Encryption Standard with 128-bit key , AES-128)的对称密码, 以灵活确定其安全属性。 [0007] 4, high security: ZigBee provides a three-level security mode, including no security settings, the use of access control lists to prevent illegal access to data and the use of advanced encryption standards (Advanced Encryption Standard with 128-bit key, AES-128 A symmetric cipher to flexibly determine its security attributes.
[0008] 5、 吋延短: 通信吋延和从休眠状态激活的吋延都非常短, 典型的搜索设备吋 延是 30ms, 休眠激活的吋延是 15ms, 活动设备信道接入的吋延是 15ms。  [0008] 5, 吋 delay: communication delay and delay from the dormant state are very short, the typical search device delay is 30ms, sleep activation delay is 15ms, active device channel access delay is 15ms.
[0009] 6、 网络容量大: 每个 ZigBee网络最多可支持 65535个设备。  [0009] 6. Large network capacity: Each ZigBee network can support up to 65,535 devices.
[0010] 相对于现有的各种无线通信技术, ZigBee技术具有低功耗和低成本的特点, 适 合于承载数据流量较小的业务。  [0010] Compared with existing wireless communication technologies, ZigBee technology has the characteristics of low power consumption and low cost, and is suitable for carrying services with small data traffic.
[0011] ZigBee协议栈体系结构示意图如图 1所示, 参照幵放式系统互联 (Open System Interconnect, OSI)模型, 从上到下依次为应用层 (Application Layer, APL) ^ 网络 层 (Network Layer, NWK:)、 媒体访问控制层 (Medium Access Layer, MAC)和物 理层 (Physical Layer, PHY) , 其中应用层由应用对象 (至多 240个)、 ZigBee设备 对象 (ZigBee Device Object, ZDO)和应用支持子层 (Application Support Sub-layer , APS)组成。 此外还制定了安全服务层, 为 NWK和 APS提供安全服务。 [0011] Schematic diagram of the ZigBee protocol stack architecture is shown in Figure 1, with reference to the open system interconnection (Open System) Interconnect, OSI) model, from top to bottom, Application Layer (APL) ^ Network Layer (NWK:), Medium Access Layer (MAC), and Physical Layer (Physical Layer, PHY) ), wherein the application layer is composed of an application object (up to 240), a ZigBee Device Object (ZDO), and an Application Support Sub-layer (APS). In addition, a security service layer has been developed to provide security services for NWK and APS.
[0012] ZigBee非常适合于低数据速率下的控制应用以及传感信号传输的物联网相关应 用, 在各国学者和工程技术人员的努力下, 经过多年的发展, ZigBee技术逐渐走 向了实际应用的领域, 成为短距离无线传输的一个主要标准, 并且朝着微型化 、 多功能化、 智能化、 低功耗的方向发展。 [0012] ZigBee is very suitable for control applications at low data rates and IoT-related applications for sensing signal transmission. With the efforts of scholars and engineers in various countries, ZigBee technology has gradually moved to the field of practical application after years of development. , becoming a major standard for short-range wireless transmission, and is moving toward miniaturization, multi-functionality, intelligence, and low power consumption.
技术问题  technical problem
[0013] ZigBee技术发展的最初目的并不是用来传输语音、 图像和视频等多媒体信息, 传统的 ZigBee技术是在能量严重受限的微型节点上实现简单的环境数据 (如温度 、 湿度、 光强等)的采集、 传输和处理。 但随着环境全面监测需求的不断提升, 人们迫切需要传输更多的数据量, 如语音、 图像、 视频等信息, 以实现更加精 细的环境监测, 例如在山区、 矿井等没有公网信号的地方, 需要实吋数据采集 和环境监控, 并在必要吋也需要进行工作人员之间的联络。  [0013] The original purpose of ZigBee technology development is not to transmit multimedia information such as voice, image and video. The traditional ZigBee technology is to implement simple environmental data (such as temperature, humidity, light intensity) on micro nodes with severe energy constraints. Acquisition, transmission and processing. However, as the demand for comprehensive monitoring of the environment continues to increase, people urgently need to transmit more data, such as voice, images, video, etc., to achieve more sophisticated environmental monitoring, such as in mountainous areas, mines and other places where there is no public network signal. , need to implement data collection and environmental monitoring, and also need to communicate between staff when necessary.
问题的解决方案  Problem solution
技术解决方案  Technical solution
[0014] 鉴于上述现有技术的不足之处, 本发明的目的在于提供一种基于 ZigBee的无线 连续图像传输系统, 包括包括上位机应用子系统、 汇聚节点子系统、 图象传感 器子系统, 所述上位机子系统与汇聚节点子系统连接, 汇聚节点子系统与图像 传感器子系统无线连接, 所述汇聚节点子系统和图像传感器子系统均包括无线 通信模块, 所述图像传感器子系统还包括摄像头模块, 所述上位机子系统与汇 聚节点子系统之间通过串口连接。  [0014] In view of the above-mentioned deficiencies of the prior art, an object of the present invention is to provide a ZigBee-based wireless continuous image transmission system, including a host computer application subsystem, a convergence node subsystem, and an image sensor subsystem. The upper computer subsystem is connected to the sink node subsystem, and the sink node subsystem is wirelessly connected to the image sensor subsystem. The sink node subsystem and the image sensor subsystem each include a wireless communication module, and the image sensor subsystem further includes a camera module. The upper computer subsystem and the aggregation node subsystem are connected through a serial port.
[0015] 优选的, 上述上位机子系统实现上位机串口初始化、 指令发送、 数据接收和检 验以及图像保存, 上位机与汇聚节点通过串口相连, 通过 RS-232串口向汇聚节 点发送指令。  [0015] Preferably, the upper computer subsystem implements serial port initialization, command transmission, data receiving and verification, and image storage of the upper computer, and the upper computer and the aggregation node are connected through a serial port, and send instructions to the aggregation node through the RS-232 serial port.
[0016] 优选的, 上述汇聚节点子系统实现汇聚节点初始化、 数据接收和数据发送; 汇 聚节点初始化包括协议栈初始化和无线通信模块外围电路的初始化; 数据接收 包括无线接收来自图像传感器节点发送的数据, 及通过串口接收来自上位机的 指令; 数据发送包括无线发送指令给图像传感器节点无线通信模块, 及通过串 口发送数据给上位机。 [0016] Preferably, the foregoing aggregation node subsystem implements aggregation node initialization, data reception, and data transmission; The aggregation of the aggregation node includes initialization of the protocol stack and initialization of the peripheral circuit of the wireless communication module; data reception includes wirelessly receiving data sent from the image sensor node, and receiving an instruction from the upper computer through the serial port; the data transmission includes wirelessly transmitting the instruction to the image sensor node wirelessly. The communication module, and send data to the host computer through the serial port.
[0017] 优选的, 上述图像传感器子系统包括图像传感器节点初始化、 数据接收和数据 发送; 图像传感器节点初始化是指协议栈初始化和无线通信外围电路的初始化 ; 数据接收包括无线接收来自汇聚节点发送的指令, 及通过串口接收来自摄像 头的数据; 数据发送包括无线发送数据给汇聚节点, 及通过串口发送指令给摄 像头。  [0017] Preferably, the image sensor subsystem includes image sensor node initialization, data reception, and data transmission; image sensor node initialization refers to protocol stack initialization and initialization of wireless communication peripheral circuits; and data reception includes wireless reception from a sink node. Commands, and receiving data from the camera through the serial port; data transmission includes wirelessly transmitting data to the aggregation node, and sending commands to the camera through the serial port.
[0018] 优选的, 上述上位机应用子系统包括串口通信模块和图像存储模块。 串口通信 模块包括初始化串口, 通过 RS-232串口线向汇聚节点发送控制摄像头初始化和 拍照的命令帧, 同吋也要接收来自汇聚节点的摄像头应答帧及图像数据帧。 图 像存储模块将图像以 JPEG文件格式保存到磁盘文件系统。  [0018] Preferably, the upper computer application subsystem includes a serial communication module and an image storage module. The serial communication module includes an initialization serial port, and sends a command frame for controlling the initialization and photographing of the camera to the aggregation node through the RS-232 serial cable, and also receives the camera response frame and the image data frame from the aggregation node. The image storage module saves the image to a disk file system in JPEG file format.
[0019] 优选的, 上述汇聚节点子系统中汇聚节点实现中继转发, 上位机通过 RS-232串 口线发送控制摄像头初始化及拍照的命令帧到汇聚节点, 汇聚节点没有取舍地 将命令帧转发给图像传感器节点; 汇聚节点接收图像传感器节点无线发送的应 答帧及图像数据帧, 并判断帧的类型, 如果是图像数据帧, 则将帧头去除, 通 过 RS-232串口线将有效载荷转发到上位机, 如果是其他类型的数据帧, 则直接 转发到上位机。 在接收图像数据帧吋, 汇聚节点还要判断接收到的图像数据帧 是否为最后一帧。  [0019] Preferably, the sink node in the sink node subsystem implements relay forwarding, and the host computer sends a command frame for controlling camera initialization and photographing to the sink node through the RS-232 serial line, and the sink node forwards the command frame to the sink node without a trade-off. The image sensor node receives the response frame and the image data frame wirelessly transmitted by the image sensor node, and determines the type of the frame. If it is an image data frame, the frame header is removed, and the payload is forwarded to the upper position through the RS-232 serial cable. If it is another type of data frame, it will be forwarded directly to the host computer. After receiving the image data frame, the sink node also determines whether the received image data frame is the last frame.
发明的有益效果  Advantageous effects of the invention
有益效果  Beneficial effect
[0020] 相比现有技术, 本发明提供的基于 ZigBee的无线连续图像传输系统, 能够适应 较长的传输距离, 不易受到图像像素大小、 传输距离的影响, 图像质量较高, 连续图像的帧率也较高。  Compared with the prior art, the ZigBee-based wireless continuous image transmission system provided by the present invention can adapt to a long transmission distance, is not susceptible to image pixel size and transmission distance, and has high image quality and continuous image frames. The rate is also higher.
对附图的简要说明  Brief description of the drawing
附图说明  DRAWINGS
[0021] 图 1为 ZigBee协议栈体系结构示意图; [0022] 图 2为本发明基于 ZigBee的无线连续图像传输系统示意图; [0021] FIG. 1 is a schematic diagram of a ZigBee protocol stack architecture; 2 is a schematic diagram of a ZigBee-based wireless continuous image transmission system according to the present invention;
[0023] 图 3为本发明基于 ZigBee的无线连续图像传输系统工作示意图; 3 is a schematic diagram of the operation of a ZigBee-based wireless continuous image transmission system according to the present invention;
[0024] 图 4为本发明基于 ZigBee的无线连续图像传输系统上位机工作流程示意图; [0025] 图 5为本发明基于 ZigBee的无线连续图像传输系统汇聚节点工作流程示意图; [0026] 图 6为本发明基于 ZigBee的无线连续图像传输系统图像传感器节点工作流程示 意图。 4 is a schematic diagram of a working process of a host computer of a ZigBee-based wireless continuous image transmission system according to the present invention; [0025] FIG. 5 is a schematic diagram of a workflow of a convergence node of a ZigBee-based wireless continuous image transmission system according to the present invention; [0026] FIG. The invention is based on the ZigBee-based wireless continuous image transmission system image sensor node workflow diagram.
本发明的实施方式 Embodiments of the invention
[0027] 本发明提供一种基于 ZigBee的无线连续图像传输系统, 为使本发明的目的、 技 术方案及效果更加清楚、 明确, 以下参照附图并举实施例对本发明进一步详细 说明。 应当理解, 此处所描述的具体实施例仅用以解释本发明, 并不用于限定 本发明。  [0027] The present invention provides a wireless continuous image transmission system based on ZigBee. The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
[0028] 如图 2所示, 本发明提供的基于 ZigBee的无线连续图像传输系统, 包括:  [0028] As shown in FIG. 2, the ZigBee-based wireless continuous image transmission system provided by the present invention includes:
[0029] 上位机子系统: 包括上位机串口初始化、 指令发送、 数据接收和检验以及图像 保存。 上位机与汇聚节点通过串口相连, 通过 RS-232串口向汇聚节点发送指令 , 例如复位指令、 设置拍照图片压缩率指令、 读取所拍图片数据指令等, 接收 和检验来自汇聚节点的指令确认数据和图像数据, 并对图像数据进行保存, 主 要实现摄像头初始化和摄像头拍照功能。 [0029] The host computer subsystem: includes the host computer serial port initialization, command transmission, data receiving and verification, and image saving. The upper computer and the aggregation node are connected through the serial port, and send instructions to the aggregation node through the RS-232 serial port, such as a reset instruction, setting a photo picture compression rate command, reading a picture data command, etc., receiving and checking the instruction confirmation data from the aggregation node. And image data, and save the image data, mainly to achieve camera initialization and camera taking.
[0030] 汇聚节点中无线通信模块的: 包括汇聚节点初始化、 数据接收和数据发送。 汇 聚节点初始化是指协议栈初始化和无线通信外围电路的初始化。 数据接收包括 无线接收来自图像传感器节点发送的数据, 及通过串口接收来自上位机的指令 。 数据发送包括无线发送指令给图像传感器节点无线通信模块, 及通过串口发 送数据给上位机。 [0030] The wireless communication module in the aggregation node includes: aggregation node initialization, data reception, and data transmission. Aggregation node initialization refers to protocol stack initialization and initialization of wireless communication peripheral circuits. The data receiving includes wirelessly receiving data sent from the image sensor node, and receiving an instruction from the host computer through the serial port. The data transmission includes wirelessly transmitting an instruction to the image sensor node wireless communication module, and transmitting data to the upper computer through the serial port.
[0031] 图像传感器节点子系统中无线通信模块: 包括图像传感器节点初始化、 数据接 收和数据发送。 图像传感器节点初始化是指协议栈初始化和无线通信模块外围 电路的初始化; 数据接收包括无线接收来自汇聚节点发送的指令, 及通过串口 接收来自摄像头的数据; 数据发送包括无线发送数据给汇聚节点, 及通过串口 发送指令给摄像头。 [0032] 连续图像传输系统中的各个模块需要与其他模块在吋序上相互协调, 系统软件 工作示意图如图 3所示。 [0031] The wireless communication module in the image sensor node subsystem: includes image sensor node initialization, data reception, and data transmission. Image sensor node initialization refers to protocol stack initialization and initialization of peripheral circuits of the wireless communication module; data reception includes wirelessly receiving an instruction sent from the aggregation node, and receiving data from the camera through the serial port; and data transmission includes wirelessly transmitting data to the aggregation node, and Send commands to the camera through the serial port. [0032] Each module in the continuous image transmission system needs to coordinate with other modules in sequence, and the system software working diagram is shown in FIG. 3.
[0033] 用户可以通过上位机应用软件发送指令去控制摄像头的串口波特率、 采集图像 的大小及压缩率、 连续拍照的数量等, 能够在上位机端以 JPEG的格式保存已拍 图像。 上位机应用软件流程图如图 4所示。  [0033] The user can send commands through the host computer application software to control the serial port baud rate of the camera, the size and compression ratio of the captured image, the number of consecutive photographs, etc., and can save the captured image in the JPEG format on the host computer. The upper computer application software flow chart is shown in Figure 4.
[0034] 整个无连续图像传输系统的内部通信, 都是按照帧结构进行的。 上位机对通信 协议进行了定义, 一共有三种帧结构: 命令帧、 应答帧和图像数据帧。  [0034] The internal communication of the entire non-continuous image transmission system is performed in accordance with a frame structure. The host computer defines the communication protocol. There are three frame structures: command frame, response frame, and image data frame.
[0035] 应答帧表示摄像头在接收到上位机发送的摄像头指令后返回的应答数据。 上位 机接收到应答帧后, 对应答帧进行检验, 如果正确, 则继续执行, 如果错误, 则重新发送对应的命令帧。  [0035] The response frame indicates the response data returned by the camera after receiving the camera command sent by the host computer. After receiving the response frame, the upper computer checks the response frame. If it is correct, it continues to execute. If it is wrong, it resends the corresponding command frame.
[0036] 上位机应用软件由两部分组成: 串口通信模块和图像存储模块。 串口通信模块 包括初始化串口, 通过 RS-232串口线向汇聚节点发送控制摄像头初始化和拍照 的命令帧, 同吋也要接收来自汇聚节点的摄像头应答帧及图像数据帧。 图像存 储模块将图像以 JPEG文件格式保存到磁盘文件系统。  [0036] The upper computer application software is composed of two parts: a serial communication module and an image storage module. The serial communication module includes an initialization serial port, and sends a command frame for controlling the initialization and photographing of the camera to the aggregation node through the RS-232 serial cable, and also receives the camera response frame and the image data frame from the aggregation node. The image storage module saves the image to a disk file system in JPEG file format.
[0037] 汇聚节点在整个系统中, 扮演着中继转发的角色。 上位机通过 RS-232串口线 发送控制摄像头初始化及拍照的命令帧到汇聚节点, 汇聚节点没有取舍地将命 令帧转发给图像传感器节点; 汇聚节点接收图像传感器节点无线发送的应答帧 及图像数据帧, 并判断帧的类型, 如果是图像数据帧, 则将帧头去除, 通过 RS- 232串口线将有效载荷转发到上位机, 如果是其他类型的数据帧, 则直接转发到 上位机。 在接收图像数据帧吋, 汇聚节点还要判断接收到的图像数据帧是否为 最后一帧。 汇聚节点软件流程图如图 5所示。  [0037] The sink node plays the role of relay forwarding throughout the system. The host computer sends a command frame for controlling camera initialization and photographing to the sink node through the RS-232 serial line, and the sink node forwards the command frame to the image sensor node without retreat; the sink node receives the response frame and the image data frame wirelessly transmitted by the image sensor node. And determine the type of the frame. If it is an image data frame, the frame header is removed, and the payload is forwarded to the upper computer through the RS-232 serial cable. If it is another type of data frame, it is directly forwarded to the upper computer. After receiving the image data frame, the sink node also determines whether the received image data frame is the last frame. The aggregation node software flow chart is shown in Figure 5.
[0038] 图像传感器节点的具体操作流程如下: 图像传感器节点上电初始化, 接收汇聚 节点无线发送的命令帧, 解析并剥离帧头部分, 通过串口发送到摄像头, 对摄 像头初始化和周期性地进行图像采集。 无线通信模块通过串口读取摄像头采集 到的图像数据, 每从摄像头接收 100个字节, 就封装为一个图像数据帧, 帧头表 示这个图像数据帧是否为最后一帧。 图像传感器节点的无线通信模块每封装完 一个图像数据帧, 就立即无线发送给汇聚节点的无线通信模块。 图像传感器节 点的软件流程图如图 6所示。 [0039] 通过实验证明, 本发明提供的基于 ZigBee的无线连续图像传输系统, 能够适应 较长的传输距离, 不易受到图像像素大小、 传输距离的影响, 图像质量较高, 连续图像的帧率也较高。 [0038] The specific operation flow of the image sensor node is as follows: The image sensor node is powered on, receives a command frame wirelessly sent by the sink node, parses and strips the frame header portion, sends the image to the camera through the serial port, initializes the camera, and periodically performs an image. collection. The wireless communication module reads the image data collected by the camera through the serial port. Each time it receives 100 bytes from the camera, it is encapsulated into an image data frame, and the frame header indicates whether the image data frame is the last frame. The wireless communication module of the image sensor node is wirelessly transmitted to the wireless communication module of the aggregation node every time an image data frame is encapsulated. The software flow chart of the image sensor node is shown in Figure 6. [0039] It is proved by experiments that the ZigBee-based wireless continuous image transmission system provided by the invention can adapt to a long transmission distance, is not easily affected by image pixel size and transmission distance, and has high image quality, and the frame rate of continuous images is also Higher.
[0040]  [0040]
[0041] 可以理解的是, 对本领域普通技术人员来说, 可以根据本发明的技术方案及其 发明构思加以等同替换或改变, 而所有这些改变或替换都应属于本发明所附的 权利要求的保护范围。  [0041] It is to be understood that those skilled in the art can make equivalent substitutions or changes in accordance with the technical solutions of the present invention and the inventive concept thereof, and all such changes or substitutions should belong to the appended claims. protected range.

Claims

权利要求书 Claim
一种基于 ZigBee的无线连续图像传输系统, 其特征在于: 所述系统包 括上位机应用子系统、 汇聚节点子系统、 图象传感器子系统, 所述上 位机子系统与汇聚节点子系统连接, 汇聚节点子系统与图像传感器子 系统无线连接, 所述汇聚节点子系统和图像传感器子系统均包括无线 通信模块, 所述图像传感器子系统还包括摄像头模块, 所述上位机子 系统与汇聚节点子系统之间通过串口连接。 A wireless continuous image transmission system based on ZigBee, characterized in that: the system comprises a host computer application subsystem, a convergence node subsystem, an image sensor subsystem, and the upper computer subsystem is connected with a sink node subsystem, and the aggregation node The subsystem is wirelessly connected to the image sensor subsystem, the sink node subsystem and the image sensor subsystem each include a wireless communication module, and the image sensor subsystem further includes a camera module, between the upper computer subsystem and the sink node subsystem Connect through the serial port.
如权利要求 1所述的基于 ZigBee的无线连续图像传输系统, 其特征在 于: 所述上位机子系统实现上位机串口初始化、 指令发送、 数据接收 和检验以及图像保存, 上位机与汇聚节点通过串口相连, 通过 RS-232 串口向汇聚节点发送指令。 The ZigBee-based wireless continuous image transmission system according to claim 1, wherein: said upper computer subsystem implements serial port initialization, command transmission, data reception and verification, and image storage of the upper computer, and the upper computer and the aggregation node are connected through a serial port. Send an instruction to the aggregation node through the RS-232 serial port.
如权利要求 1所述的基于 ZigBee的无线连续图像传输系统, 其特征在 于: 所述汇聚节点子系统实现汇聚节点初始化、 数据接收和数据发送 ; 汇聚节点初始化包括协议栈初始化和无线通信模块外围电路的初始 化; 数据接收包括无线接收来自图像传感器节点发送的数据, 及通过 串口接收来自上位机的指令; 数据发送包括无线发送指令给图像传感 器节点无线通信模块, 及通过串口发送数据给上位机。 The ZigBee-based wireless continuous image transmission system according to claim 1, wherein: the aggregation node subsystem implements aggregation node initialization, data reception, and data transmission; and the aggregation node initialization includes protocol stack initialization and a peripheral circuit of the wireless communication module. The data reception includes wirelessly receiving data sent from the image sensor node, and receiving an instruction from the host computer through the serial port; the data transmission includes wirelessly transmitting the command to the image sensor node wireless communication module, and transmitting the data to the upper computer through the serial port.
如权利要求 1所述的基于 ZigBee的无线连续图像传输系统, 其特征在 于: 所述图像传感器子系统包括图像传感器节点初始化、 数据接收和 数据发送; 图像传感器节点初始化是指协议栈初始化和无线通信外围 电路的初始化; 数据接收包括无线接收来自汇聚节点发送的指令, 及 通过串口接收来自摄像头的数据; 数据发送包括无线发送数据给汇聚 节点, 及通过串口发送指令给摄像头。 The ZigBee-based wireless continuous image transmission system according to claim 1, wherein: said image sensor subsystem includes image sensor node initialization, data reception, and data transmission; and image sensor node initialization refers to protocol stack initialization and wireless communication. Initialization of the peripheral circuit; data reception includes wirelessly receiving an instruction sent from the aggregation node, and receiving data from the camera through the serial port; the data transmission includes wirelessly transmitting data to the aggregation node, and sending the instruction to the camera through the serial port.
如权利要求 1-4之一所述的基于 ZigBee的无线连续图像传输系统, 其 特征在于: 所述上位机应用子系统包括串口通信模块和图像存储模块 串口通信模块包括初始化串口, 通过 RS-232串口线向汇聚节点发送控 制摄像头初始化和拍照的命令帧, 同吋也要接收来自汇聚节点的摄像 头应答帧及图像数据帧; The ZigBee-based wireless continuous image transmission system according to any one of claims 1 to 4, wherein: the upper computer application subsystem comprises a serial communication module and an image storage module, and the serial communication module comprises an initialization serial port, through RS-232. The serial line sends a command frame for controlling the initialization and photographing of the camera to the sink node, and also receives the camera from the sink node. Head response frame and image data frame;
图像存储模块将图像以 JPEG文件格式保存到磁盘文件系统。  The image storage module saves the image to a disk file system in JPEG file format.
[权利要求 6] 如权利要求 1-4之一所述的基于 ZigBee的无线连续图像传输系统, 其 特征在于: 所述汇聚节点子系统中汇聚节点实现中继转发, 上位机通 过 RS-232串口线发送控制摄像头初始化及拍照的命令帧到汇聚节点, 汇聚节点没有取舍地将命令帧转发给图像传感器节点; 汇聚节点接收 图像传感器节点无线发送的应答帧及图像数据帧, 并判断帧的类型, 如果是图像数据帧, 则将帧头去除, 通过 RS-232串口线将有效载荷转 发到上位机, 如果是其他类型的数据帧, 则直接转发到上位机; 在接收图像数据帧吋, 汇聚节点还要判断接收到的图像数据帧是否为 最后一帧。 [Claim 6] The ZigBee-based wireless continuous image transmission system according to any one of claims 1 to 4, wherein: the aggregation node in the aggregation node subsystem implements relay forwarding, and the upper computer passes the RS-232 serial port. The line sends a command frame for controlling the initialization and photographing of the camera to the sink node, and the sink node forwards the command frame to the image sensor node without a trade-off; the sink node receives the response frame and the image data frame wirelessly transmitted by the image sensor node, and determines the type of the frame. If it is an image data frame, the frame header is removed, and the payload is forwarded to the upper computer through the RS-232 serial cable. If it is another type of data frame, it is directly forwarded to the upper computer; after receiving the image data frame, the aggregation node Also determine if the received image data frame is the last frame.
PCT/CN2017/077681 2017-03-22 2017-03-22 Zigbee-based wireless continuous image transmission system WO2018170790A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/077681 WO2018170790A1 (en) 2017-03-22 2017-03-22 Zigbee-based wireless continuous image transmission system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/077681 WO2018170790A1 (en) 2017-03-22 2017-03-22 Zigbee-based wireless continuous image transmission system

Publications (1)

Publication Number Publication Date
WO2018170790A1 true WO2018170790A1 (en) 2018-09-27

Family

ID=63584895

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/077681 WO2018170790A1 (en) 2017-03-22 2017-03-22 Zigbee-based wireless continuous image transmission system

Country Status (1)

Country Link
WO (1) WO2018170790A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10666735B2 (en) 2014-05-19 2020-05-26 Auerbach Michael Harrison Tretter Dynamic computer systems and uses thereof

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201897884U (en) * 2010-11-25 2011-07-13 山西大学 Intelligent parking lot management device based on ZigBee wireless sensor network
CN102368811A (en) * 2011-06-27 2012-03-07 苏州中研纺织科技有限公司 Monitoring sensing device
CN202310119U (en) * 2011-10-10 2012-07-04 上海企想信息技术有限公司 Internet of things experimental system based on ZigBee wireless sensor network (WSN)
CN203057366U (en) * 2013-01-16 2013-07-10 昆明理工大学 Wireless image transmission system based on Zigbee network
CN205486724U (en) * 2016-01-13 2016-08-17 华侨大学 Wireless sensor network data acquisition monitoring system based on zigBee
CN106251603A (en) * 2016-09-10 2016-12-21 洛阳理工学院 A kind of wireless sensor system and wireless sensor device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201897884U (en) * 2010-11-25 2011-07-13 山西大学 Intelligent parking lot management device based on ZigBee wireless sensor network
CN102368811A (en) * 2011-06-27 2012-03-07 苏州中研纺织科技有限公司 Monitoring sensing device
CN202310119U (en) * 2011-10-10 2012-07-04 上海企想信息技术有限公司 Internet of things experimental system based on ZigBee wireless sensor network (WSN)
CN203057366U (en) * 2013-01-16 2013-07-10 昆明理工大学 Wireless image transmission system based on Zigbee network
CN205486724U (en) * 2016-01-13 2016-08-17 华侨大学 Wireless sensor network data acquisition monitoring system based on zigBee
CN106251603A (en) * 2016-09-10 2016-12-21 洛阳理工学院 A kind of wireless sensor system and wireless sensor device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10666735B2 (en) 2014-05-19 2020-05-26 Auerbach Michael Harrison Tretter Dynamic computer systems and uses thereof
US11172026B2 (en) 2014-05-19 2021-11-09 Michael H. Auerbach Dynamic computer systems and uses thereof

Similar Documents

Publication Publication Date Title
CN107786967A (en) L oRa mobile device for directly accessing L oRa information packet and data transmission method thereof
US9648561B2 (en) Access point device with wakeup mode
CN102448194A (en) Multimedia intelligent home network based on Zigbee
WO2012058845A1 (en) Method for processing reported data from wsn terminals, wsn gateway and combination network thereof
US10869218B2 (en) Information processing devices and communication system for controlling transmission of acknowledgement and data
US11445397B2 (en) Method and apparatus for measurement processing in wireless communication system
KR101764135B1 (en) The wireless self-governing community communication net system and its way to build by CCTV Intranet
CN204031464U (en) A kind of things-internet gateway
WO2011157003A1 (en) Method, management network element and network node for managing wireless sensor network terminal
AU2017352540A1 (en) Communication apparatus, communication control method, and program
CN107466003A (en) Internet of Things Bluetooth gateway equipment
CN106127998A (en) A kind of infrared remote warning system based on Cloud Server terminal and photovoltaic generation
CN110111524A (en) A kind of fire-fighting Internet of Things wireless acquisition system
CN101635996A (en) Wireless medical management system
CN106961582A (en) Wireless consecutive image Transmission system based on ZigBee
WO2018170790A1 (en) Zigbee-based wireless continuous image transmission system
CN202334914U (en) Adaptive bidirectional automatic switching wireless communication device
Yang Design and implementation of intelligent home wireless gateway based on STM32
WO2012152070A1 (en) Method for communication between gateways in wsn, initiator gateway, and target gateway
CN104348523A (en) Data transmission method for wireless sensor node
TWI549450B (en) Surveillance method
US20220104163A1 (en) Method and apparatus for connection management in wireless communication system
CN108449094B (en) Method for realizing ZigBee and Wifi interoperation based on GNU Radio
CN207249894U (en) A kind of school environment's data acquisition and monitoring platform based on WSN
CN202143065U (en) Heterogeneous wireless network transmission system based on Bluetooth and ZigBee

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17901996

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 24.01.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 17901996

Country of ref document: EP

Kind code of ref document: A1