KR100990311B1 - Implementation of context-aware healthcare system through Interoperability between AV network based on UPnP/OSGi and ZigBee wireless sensor network - Google Patents

Abstract

The present invention includes A / V including the home appliance environment data of the control electronic sensor group of the bit data level through the existing PLC network and the biometric data of the byte data level and the environmental sensor group through the Zigbee network. (Audio / Video) Provides an embedded bundle of home network cameras for digital camcorder convergence at the multimedia data level over the network.

In the present invention, the main processing function is to receive the biometric data and the environmental data data about the access rights for each user device from the user manager (User Manager) through the user ID, the ID of the home appliance to the device manager (Device Manager) if access is permitted And the rest of the Device Functions to send data on the most appropriate device through the ID to change the function value and to control the Service Bundle through the Service Bundle Management Server again. Media Services for Digital Camcorder Convergence We present an embedded bundle of home network cameras and a bundle that processes personal biometric and environmental data.

Ubiquitous, Home Network, OSGi / UPnP Platform, OSGi Bundle, Camcorder Controller, ZigBee

Description

Development of context-aware healthcare system through Interoperability between AV network based on UPnP / OSGi and ZigBee wireless sensor network}

The present invention relates to design and implementation of an OSGi / UPnP based AV network bundle capable of media services, and to an implementation of a UPnP-ZigBee bridge and a wireless biometric sensor module to enable interoperability with a Zigbee wireless sensor network. More specifically, the home network camera embedded bundle and ZigBee wireless sensor network for the convergence of digital camcorders at the level of multimedia data through the AV network in the home care field that can monitor the safety status of elderly people living alone in the home network using Zigbee. It's about interlocking.

Middleware bridges the gap between various hardware, network protocols, applications, and operating systems within a network environment, and enables seamless communication between applications and operating systems in complex heterogeneous environments. Typical middlewares include Jini, UPnP, LonWorks, and HAVi. In addition, researches on the Open Service Gateway initiative (OSGi) have been actively conducted to bundle various middlewares to provide compatibility of electrical appliances and value-added services in the home network.

(Table 1) Middleware Technology Status and Features

Standard summary Status and Features

UPnP Automatic configuration management and mutual recognition of devices in IP-based home network environment Consortium formed in June 1999 (20 companies including MS)
V1.0 specification released in June 2000, V2.0 4 enacted
524 members (MS, IBM, HP, Sun, Sony, LG, Samsung, etc.)
Adopted as standard by DHWG

Jini Defined infrastructure to provide home resource sharing platform and spread service in Java based distributed environment March 1999 Consortium Formation (Sun-led Jini Community)
June 1999 V1.0, 2001 V1.2 released
20,000 members (HP, IBM, AOL Ericsson, Nokia)
Ideal for ubiquitous applications over home networks
HAVi is used as the basic concept and model of OSGi
LonWorks / LonMark Configure and control lights, sensors, and white goods in buildings and premises based on low-speed media such as power lines and TP In 1994, LonMa formed a consortium (36 companies including Echelon)
October 1999 ANSNEIA 709.1 standard was established
Developed by 4000 companies
Over 50% share in global buildings, factories and automation
HAVi Definition of middleware standard to provide interoperability of in-house IEEE1394 based AV equipment 1997 Consortium (8 companies including Sony and Thomson)
November 1998 V1.0 2001 V.1.1 released
20 members (Sun, HP, LG, Samsung, etc.)
We choose HAVi UI in DVB-MHP, DASE-HN
HnCP Define power line protocol that can control connected sensors, actuators, home appliances, etc. based on home power line December 200 Consortium Formation
10 companies (LG Electronics, Planet, etc.)
June 2003 V1.0 specification released (excluding physical layer)

OSGi ISP provides an open framework based on Java to enable the download of services in the home from a remote location March 2000 Consortium (Motorola, etc.)
October 2001 V2.0 2003 V3.0 Specification Work
44 members (Motorola, Sun, Ericsson, NTT, IBM, etc.)
Expanding applications such as telematics
Adopted as a model for service providers to provide services

Home Networking means that all the devices in the home can be connected and communicate with each other, while the Zigbee Wireless Sensor Network can be used to protect the elderly person living alone (family, hospital, public officials) It is a technology that enables the elderly to control or communicate with the household equipment of the elderly living alone, regardless of the location in the home or outside the home, and monitors the status of the elderly living through the Zigbee wireless sensor network. In other words, the elderly who live alone have fallen into the living room due to a sudden accident through the camera to inform the guardian and the current status of the elderly living alone through the ZigBee wireless sensor network. Let me know In particular, when the environmental sensor information through Zigbee goes out and the city gas valve is opened, it is immediately applied to daily life such as operating the gas circuit breaker through a mobile terminal or the Internet, or checking the outside temperature to automatically adjust the indoor temperature. It is an advanced technology that includes the complex functions of the ubiquitous concept of technology that can be done.

The scope of development in the present invention includes a control appliance group controlled by an actuator or a relay for elderly people living alone, and a group of biological and environmental sensors through a sensor group and a Zigbee network, and for the digital camcorder convergence of multimedia data level through an AV network. The goal is to develop a technology that works with home network camera embedded bundles and ZigBee wireless sensor networks.

However, in the conventional home networking, monitoring is performed through a group of control home appliances at the bit data level through a conventional PLC network for elderly people living alone and a group of bio and environment sensors at a byte data level through the Zigbee network. Each of them is provided at an individual level, and there is a problem in that the home care function for the elderly and the like cannot be properly performed.

The present invention is to solve the above-mentioned problems of the prior art, an object of the present invention is a home care system using home networking, the specific situation of the user living alone in the home where the elderly living alone (for example, family, hospital It is possible to monitor and manage the status and environment of senior citizens living alone, monitor the current biometric information of senior citizens living alone through the ZigBee wireless sensor network, and provide environmental monitoring information for senior citizens living alone. In addition, it provides home network camera embedded bundle for digital camcorder convergence and ZigBee wireless sensor network interworking function to prepare for emergency in a short time in case of emergency.

As a technical idea for achieving the object of the present invention, in the present invention, the main processing function is received from the user manager through the user ID data about the access rights for each device of the user and if the access is allowed, the device management unit (Device) Send the data about the appliance ID and the rest of the device functions to the manager to access the most appropriate device through the ID, change the function value, and then re-use the service bundle (Service Bundle Management Server) We present a home network camera embedded bundle for digital camcorder convergence that enables control of the bundle.

In addition, we develop a system that can realize home network and home care system using wireless sensor network using Zigbee method.The implementation of ubiquitous wireless sensor network using Zigbee is low cost, low power consumption, easy system continuity and maintenance, It is possible to measure unrestrained and involuntary in various biosensors, suggesting suitable technology for implementing healthcare system for elderly people living alone.

ZigBee-based Non-UPnP devices and services of the present invention can be discovered in the UPnP network using the UPnP-ZigBee bridge, and can be implemented as a device that can be integrated and managed with UPnP devices, and UPnP middleware According to the wireless sensor network implementation based on the IEEE 802.15.4 MAC-based dynamic routing technology and the home network camera embedded bundle for digital camcorder convergence, the multimedia data through the AV network in the home care field of the home network can be controlled. There is an effect that can provide a level of service, and can interoperate with the Zigbee node to provide a variety of services.

Hereinafter, a configuration of an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

As shown in FIG. 1, the present invention stores a service history (12) for storing a UML sent from a mobile terminal for controlling each device, and generates a device-specific table, and each user. User storage 24 for storing device information and giving device control access by granting ID for each user, and Device Driver Storage for storing drivers for each device ( Storage means comprising 42);

As a service bundle management means, a network service unit for accessing a service bundle manager and controlling the service bundle 50 through HTTP and TCP / IP, and a service bundle A service bundle management server for managing (loading, starting, stopping, updating, and unloading) execution life cycles of service bundles, and collecting information on service bundle management and other management by users accessing the network. It is provided from the bundle management server (10), the service bundle unit 50 and the device manager (Device Manager) 30, or a service deployment manager (Service Deployment Manager) for managing by connecting the appropriate service bundle to the driver (20) ), Add / modify / remove drivers for each device and add / modify / remove services for each device A device manager 30 including a driver selector 40 to find a service in the driver storage 42, and add / modify / remove users (store basic user information) and user A service bundle management means including a user manager 22 for performing device access restriction for each user (using a user level); It includes a service bundle (Service Bundle) 50, the remote monitoring camera 60 and the camcorder 70 is connected to the service bundle (50).

delete

2 is a block diagram of an OSGi / UPnP based home network camera system employed in a home network camera embedded bundle for digital camcorder convergence of the present invention. As shown in FIG. 2, the OSGi / UPnP-based home network camera system of the present invention includes a photographing apparatus 100 including a camera 102 and 104 for a home network composed of at least one MCU or CCD sensor;

A drive including an image processor 112 and a control I / O 114, an Ethernet (IEEE 802.11x) communication means 116, and a driver 118 for receiving and processing a video image from the photographing apparatus 100. Apparatus 200;

A platform 120 comprising a Linux / Windows based Java VM 122 and an OSGi / UPnP protocol 124;

A bundle 130; OSGi service network 140 is included.

The photographing apparatus 100 is equipped with a 1 / 4-inch color CCD image sensor and uses a device capable of processing 25 frames / sec, and is configured to remotely control a 2-axis Pen / Tilt CCD camera. . The bundle unit 130 is configured to monitor the UPnP service camera in an RG (Residential Gateway) environment. That is, it is possible to monitor the media information of UPnP service camera through RG in the home network at a remote location (using WAN). In addition, the system is configured to remotely control two axes of UPnP service cameras from the outside of the home network through the RG inside the home network, and to remotely control the digital camcorder and to establish an MPEG4 video transmission server. It is configured to control zooming in, zooming out, recording, and the like. In addition, the system has been built a Web PVR function with real-time recording and motion detection of the image of the UPnP service camera using the RG.

3 is a block diagram of an OSGi service bundle as an open service platform of the present invention.

The OSGi service bundle is connected to various information appliances and the like on the home side of the home network to perform short-range wireless communication, and is connected to the zigbee node 202 to communicate with the bundle unit 300 of the present invention. ZigBee PAN coordinator unit 204 for receiving, ZigBee PAN coordinator unit 204 receives the ZigBee data from the UPnP-ZigBee bridge 310 to convert to UPnP, and the UPnP-ZigBee bridge 310 and UPnP protocol Communication to receive data and receive image data from the camera and camcorder 320 or data from the UPnP device 360 to transmit to the external management server 500 through the user interface 400, and from the external management server A gateway 330 for receiving a control signal and transmitting the control signal to the various control appliances, a camera and a camcorder 320, and a UPnP device 360. The lure is.

The gateway 330 is connected to the camera, camcorder 320, and UPnP device 360 to receive data or control signals to control actions of the camera, camcorder 320, and UPnP device 360. The UPnP action bundle unit 342 and the FLEX remote object bundle unit 346 and UPnP which receive data from the UPnP action bundle 342, transmit the received data to the management server, and are connected to the media data storage unit 350. The OSGi framework 330 is located between the action bundle 342 and the FLEX remote object bundle unit 346 and includes a UPnP service bundle unit 344 for performing a UPnP communication service.

4 is a block diagram of a camcorder controller of the present invention. As shown in FIG. 4, the camcorder controller of the present invention is constructed as a PCB, and includes a microprocessor 600 for controlling overall driving of the controller, converting an analog image signal into digital image data, and compressing the image. A control signal received from the image processing module 602, the LAN controller 604, the flash memory 606 for storing various control data, and the output module 608 from the microprocessor 600, , A lamp for controlling driving of an alarm, an alarm controller 610, an internet communication module 612 for transmitting compressed image data or a control signal, and an RS232 communication module 614 with an external device. It is made to include.

The OSGi service bundle is configured to understand OSGi operation structure in LINUX / Windows environment and run in each middleware, but one service is implemented as a device bundle that can be called from multiple control points at the same time. Consists of a device bundle that can be connected to a single control point at the same time.

In addition, the OSGi service bundle consists of control points that search for media devices such as media servers and media renderers, and exchange information related to transmission and media data between media servers and media renderers through UPnP actions. It is configured to use SOAP to send messages to the media device and to return the results and error content to the control point. In other words, the control pointer functions as a media renderer control pointer and a media server control pointer.

In addition, the image processing technology is configured to be used in the OSGi environment.

In addition, it includes a device drive that facilitates the development of multimedia application services based on middleware, and a highly scalable and scalable device for devices developed by various middleware and vendors. In addition, it is configured to assign an address that uniquely identifies an information device connected to a home network (TCP / IP), and automatically configures and updates the device in a home server without user intervention, and provides a service provided by the device. Information about is also managed.

5 is a configuration of the zigbee node 202 of the present invention is composed of a body fat sensor 721, a body temperature sensor 722, oxygen saturation sensor 723, blood pressure sensor 723, ECG sensor 724, The blood glucose sensor 726 may be used to transmit data measured by each Zigbee node 202 to the Zigbee PAN coordinator 204. The transmitted information of the Zigbee PAN coordinator unit 204 is managed through the UPnP-ZigBee bridge 310 and the obtained information is communicated with the bundle unit 300 of the present invention and transmitted to the UPnP action bundle unit 342. The design of the present invention is also designed using the PSoC in order to miniaturize and light weight, and is designed with a Zigbee node 202 and on-board.

In addition, as an environmental sensor attached to the zigbee node 202, the environment measured by the zigbee node 202 by a gas sensor 710, a temperature sensor 711, a humidity sensor 712, an illuminance sensor 713, and the like. The data is also transmitted to the Zigbee PAN coordinator unit 204 to communicate with the bundle unit 300 of the present invention to the UPnP Action bundle 342 unit. The design of the ZigBin node 202 for performing short-range wireless communication is measured by miniaturization and light weight using a PSoC, and is mounted as a ZigBin node 202 module and an on-board. The design of the present invention is also designed using the PSoC in order to miniaturize and lightweight, and is designed with the ZigBino node 202 and on-board.

In addition, the other actuator of the Zigbee node 202, a relay capable of controlling the power of the general household appliances 700, a motor-driven actuator such as the door device 701, a motor-controlled actuator such as the water valve 702 A device, a gas valve 703, and the like, the command received from the UPnP action bundle unit 342 is transmitted to the Zigbee PAN coordinator unit 204 through the UPnP-Zigbee bridge 310 to perform short-range wireless communication. Actuator attached to node 202 will be driven remotely. In order to further reduce the size and weight of the Zigbee node 202 for performing the short-range wireless communication, the actuator is designed using PSoC, the Zigbee node 202 module and the on-board, and commands from the Zigbee node 202 module. Receive and operate.

(Industrial availability)

According to the present invention, the wireless sensor network of the ZigBee method can be used to wirelessly control and monitor the sensors and devices for the home network, thereby enabling the use of portable terminals that can be moved by administrators or users. Can be.

If the network implementation does not support sufficient resources or is not suitable for operating TCP / IP, the device cannot support UPnP. Therefore, the UPnP device can be used as a device that can interoperate with the UPnP device by using the UPnP-ZigBee bridge.

The development of UPnP-ZigBee Bridge enables sensors and devices in ZigBee networks that are not equipped with UPnP to use various functions of UPnP middleware, so that they can automatically configure, manage, and control sensors and devices without user intervention. This can be facilitated.

As a specific field of use, it can be used for monitoring the status of elderly people living alone among home networking fields, and it can be extended to the field of information appliances of healthcare services, and the expansion of information appliances devices to sensor networks. It is easy to develop and is applicable to the development of a wearable healthcare system by the introduction of PSoC technology.

1 is a server bundle management system diagram of a home network camera embedded bundle of the present invention.

2 is an OSGi / UPnP based home network camera system of the present invention.

3 is a block diagram of a home network camera embedded bundle for digital camcorder convergence of the present invention.

4 is a PCB configuration diagram of a camcorder controller of the present invention.

FIG. 5 is a diagram schematically illustrating an individual configuration diagram combined with the PSoC module and the Zigbee module of the present invention.

Claims (8)

In the Home Network Camera Embedded Bundle for Digital Camcorder Convergence, which enables ZigBee-based Non-UPnP devices and services to be managed with UPnP devices, A zig-bin node for short-range wireless communication connected to various information appliances on the home side of the home network; A Zigbee PAN coordinator unit connected to the Zigbee node to communicate with a gateway including an OSGi framework; A UPnP-ZigBee bridge unit for receiving ZigBee data from the ZigBee PAN coordinator unit, communicating with a gateway unit using the UPnP protocol, and converting ZigBee communication data received from an information device in a home network into UPnP communication data; Receives data by communicating with the UPnP-Zigbee Bridge and UPnP protocol, receives image data from camera and camcorder, or receives data from UPnP device and transmits to external management server through user interface, and receives control signal from external management server. And a gateway for transmitting the control signal to the various control appliances, cameras and camcorders, and UPnP devices. The gateway includes an OSGi framework, the OSGi framework, A flex remote object bundle unit which receives data from a UPnP action bundle, transmits the data to the management server, and receives a control signal from an external management server; And It is connected through a flex remote object bundle unit and a UPnP service bundle unit, and is connected to the camera and camcorder to receive image data from the camera and camcorder, transmit the image data to the flex remote object bundle unit, and control from the flex remote object bundle unit. A UPnP action bundle unit for receiving a signal; It is located between the UPnP action bundle and the flex remote object bundle portion, characterized in that it comprises a UPnP service bundle for performing a UPnP communication service Home network camera embedded bundle for digital camcorder convergence. delete The method of claim 1, The UPnP action bundle unit is connected to UPnP devices in the home network. Home network camera embedded bundle for digital camcorder convergence. A network camera embedded bundle for digital camcorder convergence according to claim 1, A service bundle management server connected to the home network camera embedded bundle for the digital camcorder convergence; Including a service history storage unit for connecting to the service bundle management server to store the UML sent from the mobile terminal, etc. to control each device and to create a device-specific table Home network system using a home network camera embedded bundle for digital camcorder convergence. delete delete delete delete

Images