WO2017130360A1 - Appareil terminal portable ainsi que procédé et programme de gestion de dispositif - Google Patents

Appareil terminal portable ainsi que procédé et programme de gestion de dispositif Download PDF

Info

Publication number
WO2017130360A1
WO2017130360A1 PCT/JP2016/052547 JP2016052547W WO2017130360A1 WO 2017130360 A1 WO2017130360 A1 WO 2017130360A1 JP 2016052547 W JP2016052547 W JP 2016052547W WO 2017130360 A1 WO2017130360 A1 WO 2017130360A1
Authority
WO
WIPO (PCT)
Prior art keywords
wireless communication
portable terminal
communication device
estimated location
unit
Prior art date
Application number
PCT/JP2016/052547
Other languages
English (en)
Japanese (ja)
Inventor
昌平 飯島
Original Assignee
三菱電機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱電機株式会社 filed Critical 三菱電機株式会社
Priority to PCT/JP2016/052547 priority Critical patent/WO2017130360A1/fr
Publication of WO2017130360A1 publication Critical patent/WO2017130360A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W24/00—Supervisory, monitoring or testing arrangements

Definitions

  • the present invention relates to management of wireless communication devices.
  • a multi-hop wireless mesh network In the future, in a wireless M2M (Machine to Machine) system (metering system, remote management system, etc.) whose needs are expected to be expanded, use of a multi-hop wireless mesh network is expected.
  • M2M Machine to Machine
  • each wireless node transfers data in a bucket relay manner. For this reason, a multi-hop wireless mesh network has a wider communicable range than a star network that takes a communication form centered on one base station.
  • it is possible to construct a detour route so that communication reliability is improved.
  • Patent Documents 1 to 4 disclose techniques for managing maintenance information using a camera or a non-contact IC (Integrated Circuit) tag for managing articles.
  • the main object of the present invention is to solve such a problem, and to make it possible to efficiently collect maintenance information.
  • the portable terminal device is: A portable terminal device, An imaging unit for imaging at least one of a wireless communication device and an installation location of the wireless communication device; A position estimation unit that calculates either the estimated location of the portable terminal device at the time of shooting or the estimated location of the wireless communication device; A communication unit that receives device attribute information that is attribute information of the wireless communication device by wireless communication with the wireless communication device; A data integration unit that associates the captured image, the estimated location of the portable terminal device and the estimated location of the wireless communication device, and the device attribute information with each other and stores them in a memory;
  • device attribute information is acquired by wireless communication with a wireless communication device, and a captured image, an estimated location, and device attribute information are stored in association with each other. Therefore, according to the present invention, it is possible to efficiently collect maintenance information.
  • FIG. 3 shows a configuration example of a portable terminal device according to the first embodiment.
  • FIG. 6 shows a display example on the portable terminal device according to the first embodiment.
  • FIG. 6 shows a display example on the portable terminal device according to the first embodiment.
  • FIG. 3 is a flowchart showing an operation example of the portable terminal device according to the first embodiment.
  • FIG. 6 shows an example of a photographing method according to Embodiment 2. The flowchart figure which shows the operation example of the portable terminal device which concerns on Embodiment 2.
  • FIG. 3 is a flowchart showing an operation example of the portable terminal device according to the first embodiment.
  • FIG. 6 shows an example of a photographing method according to Embodiment 2.
  • the flowchart figure which shows the operation example of the portable terminal device which concerns on Embodiment 2.
  • FIG. 3 shows a configuration example of a portable terminal device according to the first embodiment.
  • FIG. 6 shows a display example on the portable terminal device according to the first embodiment.
  • FIG. 3 is
  • FIG. *** Explanation of configuration *** FIG. 1 shows a hardware configuration example and a functional configuration example of a portable terminal device 10 according to the present embodiment.
  • the portable terminal device 10 is a portable computer, specifically, a tablet terminal or a personal computer.
  • the portable terminal device 10 includes a data collection display device 11, a wireless communication device 12, a photographing device 13, a GPS (Global Positioning System) receiver 14, an acceleration sensor 15, an electronic compass 16, and a display device 17 as hardware.
  • GPS Global Positioning System
  • the wireless communication device 12 is configured by hardware such as a processor and a memory.
  • the wireless communication device 12 includes a communication unit 121 as a functional configuration.
  • the communication unit 121 performs wireless communication with a wireless communication device (hereinafter also referred to as a wireless device) included in the multi-hop wireless mesh network. Then, the communication unit 121 receives device attribute information that is attribute information of the wireless communication device by wireless communication with the wireless communication device.
  • the communication unit 121 is realized by a program.
  • a program for realizing the communication unit 121 is stored in the memory, and the processor executes the program to realize the function of the communication unit 121.
  • the operation of the communication unit 121 corresponds to communication processing.
  • the photographing device 13 is also configured by hardware such as a processor and a memory.
  • the photographing apparatus 13 includes a photographing unit 131 as a functional configuration.
  • the imaging unit 131 captures at least one of the wireless communication device and the installation location of the wireless communication device.
  • the photographing unit 131 is realized by a program.
  • a program for realizing the photographing unit 131 is stored in the memory, and the processor executes the program to realize the function of the photographing unit 131.
  • the operation of the photographing unit 131 corresponds to photographing processing.
  • the GPS receiver 14, the acceleration sensor 15, and the electronic compass 16 provide the data collection display device 11 with information for estimating the location of the portable terminal device 10.
  • the GPS receiver 14, the acceleration sensor 15, and the electronic compass 16 are collectively referred to as a sensor device.
  • the display device 17 displays the display data on the display screen.
  • the display device 17 displays map data on a display screen, for example.
  • the data collection / display device 11 collects information about the wireless communication device from the wireless communication device 12, the imaging device 13, and the sensor device, integrates the collected information, and outputs the integration result to the display device 17.
  • the data collection and display device 11 is also configured by hardware such as a processor and a memory.
  • the data collection display device 11 includes a display unit 111, a data integration unit 112, an installed wireless device information collection unit 113, a captured image collection unit 114, a sensor processing unit 115, a position estimation unit 116, and a storage unit 117 as functional configurations. It is.
  • the installed wireless device information collection unit 113 acquires device attribute information from the communication unit 121.
  • the captured image collection unit 114 acquires a captured image from the imaging unit 131.
  • the sensor processing unit 115 acquires information from the sensor device, and converts the acquired information into information that can be used for position estimation.
  • the position estimation unit 116 estimates the location of the portable terminal device 10 based on the information converted by the sensor processing unit 115.
  • the data integration unit 112 stores the captured image, the estimated location of the portable terminal device 10, and the device attribute information in the storage unit 117 in the memory in association with each other. In addition, the data integration unit 112 transfers the captured image, the estimated location, and the device attribute information to the display unit 111.
  • the operation of the data integration unit 112 corresponds to data integration processing.
  • the display unit 111 generates display data including a captured image, an estimated location, and device attribute information, and outputs the display data to the display device 17.
  • a map of an area including the estimated location of the portable terminal device 10 is displayed.
  • a device position mark indicating the location of the wireless communication device is displayed at a location corresponding to the estimated location of the portable terminal device 10 in the map, and device attribute information is displayed in association with the device location mark.
  • the storage unit 117 stores the captured image, the estimated location of the portable terminal device 10, and device attribute information in association with each other.
  • Display unit 111, data integration unit 112, installed wireless device information collection unit 113, captured image collection unit 114, sensor processing unit 115, and position estimation unit 116 are realized by a program.
  • Programs that realize the display unit 111, the data integration unit 112, the installed wireless device information collection unit 113, the captured image collection unit 114, the sensor processing unit 115, and the position estimation unit 116 are stored in the storage unit 117 and executed by the processor.
  • the wireless communication device 12, the photographing device 13, and the sensor device are connected to the data collection and display device 11.
  • the wireless communication device 12, the photographing device 13, and the sensor device are connected to the data collection and display device 11, respectively. It may be built in.
  • the operation of the portable terminal device 10 according to the present embodiment will be described.
  • the portable terminal device 10 is a tablet terminal.
  • An example of the operation of the portable terminal device 10 will be described using the flowchart of FIG.
  • the operation procedure shown in FIG. 4 corresponds to a device management method and a device management program.
  • the display unit 111 displays map information (floor map in FIG. 2) stored in advance in the storage unit 117 on the display device 17.
  • the position estimating unit 116 estimates the location of the portable terminal device 10 based on information from the sensor device, and the display unit 111 displays the estimated location of the portable terminal device 10 on the map information (step). S401). Any method can be used as the position estimation method.
  • the holder (also referred to as a user) of the portable terminal device 10 moves to the installation position of the wireless communication device, and presses the photographing button prepared in the portable terminal device 10 (step S402).
  • the imaging unit 131 captures at least one of the wireless communication device and the installation location of the wireless communication device, triggered by pressing of the shooting button (step S403).
  • the photographed image is input from the photographing unit 131 to the photographed image collecting unit 114 and further input from the photographed image collecting unit 114 to the data integration unit 112.
  • the communication unit 121 starts wireless communication with the wireless communication device, triggered by pressing of the shooting button, and acquires device attribute information from the wireless communication device (step S404).
  • the device attribute information is, for example, information such as an identification number of a wireless communication device, a type, a connection sensor connected to the wireless communication device, and the like.
  • the device attribute information is input from the communication unit 121 to the installed wireless device information collection unit 113, and further input from the installed wireless device information collection unit 113 to the data integration unit 112.
  • the position estimation unit 116 estimates the location of the portable terminal device 10 at the time of shooting with the pressing of the shooting button as a trigger.
  • the estimated location of the portable terminal device 10 is input from the position estimation unit 116 to the data integration unit 112.
  • the data integration unit 112 registers the estimated location of the portable terminal device 10 as the position of the wireless communication device in the storage unit 117 together with the captured image and the device attribute information (step S405). Further, the data integration unit 112 transfers the registered position, captured image, and device attribute information to the display unit 111.
  • the display unit 111 displays the registered position, captured image, and device attribute information on the display device 17 (step S406).
  • step S406 as shown in FIG. 3, the display unit 111 locates the wireless communication device at a location corresponding to the estimated location of the portable terminal device 10 (the location of the holder of the portable terminal device 10) in the map. A device position mark representing the position is displayed, and device attribute information is displayed in association with the device position mark.
  • the user collects maintenance information of all the wireless communication devices by repeating the above procedure for each wireless communication device.
  • Embodiment 2 shows the installation position of the wireless communication device.
  • the user since the estimated location of the portable terminal device 10 is registered as the installation position of the wireless communication device, the user holds the portable terminal device 10 and directly above or below the installation location of the wireless communication device.
  • the correct installation position of the wireless communication device cannot be registered without moving to.
  • an accurate installation position of a wireless communication device can be registered without moving directly above or below the installation location of the wireless communication device.
  • the installation position of the wireless communication device is corrected by allowing the user to photograph at least one of the installation location of the wireless communication device and the wireless communication device from a plurality of directions. For example, as shown in FIG.
  • the user uses the portable terminal device 10 to photograph the wireless communication device from a plurality of directions and a plurality of angles. Then, the acceleration sensor 15 measures the direction (shooting direction) of the portable terminal device 10 with respect to the wireless communication device and the angle (shooting angle) of the portable terminal device 10 with respect to the wireless communication device at the time of shooting, and the position estimation unit position estimation unit 116 estimates the installation position of the wireless communication device based on the measurement result of the acceleration sensor 15. In other words, in the present embodiment, the position estimation unit 116 calculates the estimated location of the portable terminal device 10, and also includes a plurality of captured images, the capturing direction and the capturing angle at the time of capturing each captured image, and the transportability.
  • the estimated location of the terminal device 10 is analyzed to calculate the estimated location of the wireless communication device. Further, in the present embodiment, the data integration unit 112 obtains at least one captured image of the plurality of captured images, the estimated location of the wireless communication device calculated by the position estimation unit 116, and device attribute information. The data are stored in the storage unit 117 in the memory in association with each other.
  • the functional configuration and hardware configuration of the portable terminal device 10 are the same as those shown in FIG. Hereinafter, differences from the first embodiment will be mainly described. Matters not described below are the same as those in the first embodiment.
  • the user's operation is only an increase in the number of times of photographing at one installation position of the wireless device.
  • step S601 the photographing unit 131 photographs at least one of the wireless communication device and the installation location of the wireless communication device, triggered by pressing of the photographing button.
  • the acceleration sensor 15 measures the shooting direction and the shooting angle.
  • the photographed image is input from the photographing unit 131 to the photographed image collecting unit 114 and further input from the photographed image collecting unit 114 to the data integration unit 112. Further, information on the shooting direction and the shooting angle (hereinafter referred to as shooting direction information) is input from the acceleration sensor 15 to the position estimation unit 116 via the sensor processing unit 115.
  • step S ⁇ b> 602 the position estimation unit 116 stores the shooting direction information in the storage unit 117.
  • the next S404 is the same as S404 in FIG.
  • the position estimation unit 116 estimates the location of the portable terminal device 10 at the time of shooting, triggered by pressing of the shooting button.
  • the estimated location of the portable terminal device 10 is input from the position estimation unit 116 to the data integration unit 112.
  • the data integration unit 112 determines whether shooting has been completed. Specifically, the data integration unit 112 determines that shooting has been completed when the specified time has elapsed since the last time the shooting button was pressed. If the shooting has been completed, in step S604, the data integration unit 112 determines whether the number of shootings is one.
  • the data integration unit 112 determines that the number of times of capturing is one. If the number of times of shooting is one, the data integration unit 112 uses the estimated location of the portable terminal device 10 as the position of the wireless communication device in step S606, as in the first embodiment. The information is registered in the storage unit 117 together with the information. Further, the data integration unit 112 transfers the registered position, captured image, and device attribute information to the display unit 111. Further, the data integration unit 112 discards the shooting direction information stored in step S602.
  • step S607 the position estimation unit 116, the plurality of shot images, the shooting direction and shooting angle at the time of shooting indicated in the shooting direction information, and the portable terminal device 10 And the estimated location of the wireless communication device is calculated.
  • the position estimation unit 116 can calculate the estimated location of the wireless communication device using an existing position estimation method. For example, the position estimation unit 116 calculates the estimated location of the wireless communication device using a three-point positioning method using three or more captured images and three or more capturing direction information.
  • step S608 the data integration unit 112 stores the estimated location of the wireless communication device calculated in step S607 in the storage unit 117 together with at least one captured image of the plurality of captured images and device attribute information.
  • step S406 the display unit 111 displays a device position mark on the map and displays device attribute information in association with the device position mark. If YES in step S604, an equipment position mark is displayed at a position corresponding to the estimated location of portable terminal device 10 as in the first embodiment. On the other hand, if NO in step S604, a device position mark is displayed at a position corresponding to the estimated location of the wireless communication device calculated in step S607.
  • the installation position of the wireless communication device is estimated using the attitude of the portable terminal device at the time of shooting, so that the user moves directly above or below the installation location of the wireless communication device. Even if it does not, the exact installation position of the wireless communication device can be registered.
  • the processor shown in FIG. 1 is an IC (Integrated Circuit) that performs processing.
  • the processor is a CPU (Central Processing Unit), a DSP (Digital Signal Processor), or the like.
  • the memory is a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, a HDD (Hard Disk Drive), or the like.
  • the display unit 111, the data integration unit 112, the installed wireless device information collection unit 113, the captured image collection unit 114, the sensor processing unit 115, the position estimation unit 116, the communication unit 121, and the imaging unit 131 (these are collectively referred to as “parts” ”) May be stored in a portable storage medium such as a magnetic disk, flexible disk, optical disk, compact disk, Blu-ray (registered trademark) disk, or DVD.
  • a portable storage medium such as a magnetic disk, flexible disk, optical disk, compact disk, Blu-ray (registered trademark) disk, or DVD.
  • the portable terminal device 10 may be realized by an electronic circuit such as a logic IC (Integrated Circuit), a GA (Gate Array), an ASIC (Application Specific Integrated Circuit), or an FPGA (Field-Programmable Gate Array).
  • each “unit” is realized as part of an electronic circuit.
  • the processor and the electronic circuit are also collectively referred to as a processing circuit.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Economics (AREA)
  • General Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Telephone Function (AREA)
  • Telephonic Communication Services (AREA)

Abstract

Une unité d'imagerie (131) met en image un dispositif de radiocommunication et/ou la position d'installation dudit dispositif de radiocommunication. Une unité d'estimation de position (116) calcule la position estimée d'un appareil terminal portable (10) au moment de l'imagerie ou la position estimée du dispositif de radiocommunication. Une unité de communication (121) reçoit, par le biais d'une radiocommunication avec un dispositif de radiocommunication, des informations d'attribut de dispositif, qui sont des informations d'attribut concernant le dispositif de radiocommunication. Une unité d'intégration de données (112) associe l'image capturée, la position estimée du dispositif terminal portable (10) ou la position estimée du dispositif de radiocommunication et les informations d'attribut de dispositif et mémorise ces dernières dans une mémoire.
PCT/JP2016/052547 2016-01-28 2016-01-28 Appareil terminal portable ainsi que procédé et programme de gestion de dispositif WO2017130360A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2016/052547 WO2017130360A1 (fr) 2016-01-28 2016-01-28 Appareil terminal portable ainsi que procédé et programme de gestion de dispositif

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2016/052547 WO2017130360A1 (fr) 2016-01-28 2016-01-28 Appareil terminal portable ainsi que procédé et programme de gestion de dispositif

Publications (1)

Publication Number Publication Date
WO2017130360A1 true WO2017130360A1 (fr) 2017-08-03

Family

ID=59399111

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/052547 WO2017130360A1 (fr) 2016-01-28 2016-01-28 Appareil terminal portable ainsi que procédé et programme de gestion de dispositif

Country Status (1)

Country Link
WO (1) WO2017130360A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011065028A1 (fr) * 2009-11-30 2011-06-03 パナソニック株式会社 Appareil de communication
JP2012080403A (ja) * 2010-10-04 2012-04-19 Panasonic Corp 情報取得装置、情報取得機能付き撮影機器、情報取得用集積回路、画像表示システム、情報取得プログラム、及び情報取得方法
JP2013120581A (ja) * 2011-12-09 2013-06-17 Kyocera Document Solutions Inc 通信装置、画像形成装置、画像形成システム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011065028A1 (fr) * 2009-11-30 2011-06-03 パナソニック株式会社 Appareil de communication
JP2012080403A (ja) * 2010-10-04 2012-04-19 Panasonic Corp 情報取得装置、情報取得機能付き撮影機器、情報取得用集積回路、画像表示システム、情報取得プログラム、及び情報取得方法
JP2013120581A (ja) * 2011-12-09 2013-06-17 Kyocera Document Solutions Inc 通信装置、画像形成装置、画像形成システム

Similar Documents

Publication Publication Date Title
US9565534B2 (en) Apparatus and method for identifying point of interest in contents sharing system
US8031238B2 (en) Image-capturing apparatus, image-capturing method, and computer program product
US9369677B2 (en) Image assistance for indoor positioning
KR20090019184A (ko) 전자지도에 포함된 이미지 파일을 이용한 이미지 재생장치, 이의 재생 방법 및 상기 방법을 실행하기 위한프로그램을 기록한 기록매체.
JP2016018463A (ja) 状態変化管理システム及び状態変化管理方法
CN107193820B (zh) 位置信息获取方法、装置及设备
JP2007129407A (ja) カメラシステム、地図情報表示システム
JP2016038703A (ja) センサ制御装置、センサ制御方法およびセンサ制御プログラム
JP6504896B2 (ja) 情報処理装置、情報処理方法及び画像転送システム
JP6146464B2 (ja) 撮影装置、情報取得装置、情報取得システム、送信制御方法、情報取得方法及びプログラム
EP3241036B1 (fr) Crowdsourcing de données visuelles avec des infromations de signal sans fil
JP2010129032A (ja) 画像検索装置および画像検索プログラム
JPH10239055A (ja) 携帯型情報収集装置
CN111566639A (zh) 一种图像分类方法及设备
WO2017130360A1 (fr) Appareil terminal portable ainsi que procédé et programme de gestion de dispositif
JP2009124254A (ja) 撮影装置
JP2011082770A (ja) データ生成装置及びその制御方法、プログラム
JP5910729B2 (ja) 位置判定システム、位置判定方法、コンピュータプログラム及び位置判定装置
JP2016021707A (ja) 道路画像管理システム
JP2007020054A (ja) 画像管理方法及び装置
JP6299800B2 (ja) 制御装置、制御方法及び制御プログラム
KR101212317B1 (ko) 비컨을 구비한 마커를 포함하는 음원 위치 측정 장치 및 이를 이용한 음원 위치 오차 개선 방법
JP2014500958A (ja) 位置補正方法及びその装置
JP6391006B2 (ja) 資材検査装置、資材検査方法、及び資材検査システム
JP2006178804A (ja) 被写体オブジェクト情報提供方法および被写体オブジェクト情報提供サーバ

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16887947

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16887947

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP