TW202020735A - Intelligent information reading method, intelligent reader and system thereof - Google Patents
Intelligent information reading method, intelligent reader and system thereof Download PDFInfo
- Publication number
- TW202020735A TW202020735A TW107141051A TW107141051A TW202020735A TW 202020735 A TW202020735 A TW 202020735A TW 107141051 A TW107141051 A TW 107141051A TW 107141051 A TW107141051 A TW 107141051A TW 202020735 A TW202020735 A TW 202020735A
- Authority
- TW
- Taiwan
- Prior art keywords
- image
- information reading
- intelligent information
- reading device
- intelligent
- Prior art date
Links
Images
Abstract
Description
一種資訊讀取的技術,特別是指以影像辨識分析技術讀取特定資訊呈現裝置上的資訊的方法、智能資訊讀取裝置與相關系統。 An information reading technology, in particular, a method, an intelligent information reading device, and a related system for reading information on a specific information presentation device using image recognition analysis technology.
生活上有許多量測數據的裝置,例如量測家庭或公司用電的電錶、量測用水量的水錶,以及瓦斯使用量的瓦斯錶,還有量測四周環境溫度、濕度、空氣品質等數據的量測裝置,讓我們可以從這些資訊讀取裝置上得出整體生活的需要與變化,並可作為改變生活方式或是節約能源的參考。 There are many devices for measuring data in daily life, such as electricity meters for measuring household or company electricity, water meters for measuring water consumption, and gas meters for gas consumption, as well as data for measuring ambient temperature, humidity, and air quality around The measurement device allows us to derive the needs and changes of the overall life from these information reading devices, and can be used as a reference for changing lifestyles or saving energy.
而其中量測得到的數據部份是有關使用者付費的數據,例如電力公司需要根據電錶的數據向用戶收取電費,傳統的方式之一是電力公司派人來抄錶,將電錶上的數據回報公司系統後,才能得出一定期間內的用量來計算費用;另有方式是讓用戶上網或是用電話系統回報電錶數據,讓電力公司計算電費。對於水費而言,同樣地,自來水公司需要派員來抄水表,並根據水錶讀數向用戶收取水費;瓦斯公司也是根據瓦斯錶的讀數來收費,傳統得到讀數的方式包括派員抄錶,或是由用戶自己上網或是打電話登錄數據。 The part of the measured data is the data about the user's payment. For example, the power company needs to charge users based on the data of the electricity meter. One of the traditional methods is that the power company sends someone to read the meter and return the data on the meter. Only after the company's system can it calculate the cost within a certain period of time; another way is to allow users to surf the Internet or use the telephone system to report meter data and let the power company calculate the electricity cost. Regarding water charges, the water company also needs to send staff to read the water meter and charge the user based on the water meter reading; the gas company also charges based on the gas meter reading. The traditional way to get the reading includes sending a staff member to read the meter. Or the user logs on the data by going online or calling.
如此可知,在所謂智慧城市或智慧家庭等尚未完整建制的多數環境中,習知技術中並未對上述水錶、電錶、瓦斯錶等資訊呈 現裝置上的顯示資訊提出有效取得資訊的解決方案。 It can be seen that in most environments where so-called smart cities or smart homes have not yet been fully established, the above-mentioned information such as water meters, electricity meters, and gas meters is not presented in the conventional technology. The displayed information on the device presents a solution to obtain the information effectively.
說明書公開一種智能資訊讀取方法、裝置與系統,所提出的智能資訊讀取裝置較佳地是裝設在傳統資訊呈現裝置上的讀取裝置,通過其中影像擷取的功能取得資訊呈現裝置上顯示的內容,進而通過影像辨識分析技術取得其中資訊,達到遠距讀取資訊的目的,解決相關人員不易到達資訊呈現裝置裝設位置而無法取得讀數的問題。 The description discloses an intelligent information reading method, device and system. The proposed intelligent information reading device is preferably a reading device installed on a traditional information presentation device, and the information presentation device is obtained by the function of image capture The displayed content can be obtained through image recognition analysis technology to achieve the purpose of reading the information remotely, and solve the problem that the relevant personnel cannot easily reach the installation position of the information presentation device and cannot obtain the reading.
根據實施例,提出一智能資訊讀取裝置,用於讀取一資訊呈現裝置的顯示內容,智能資訊讀取裝置連接資訊呈現裝置,並將資訊呈現裝置的顯示內容安排於智能資訊讀取裝置可取得一影像的位置,智能資訊讀取裝置的主要電路元件包括照相單元、儲存單元、通訊單元,以及一微控制單元,裝置中執行一智能資訊讀取方法。 According to an embodiment, an intelligent information reading device is proposed for reading the display content of an information presentation device, the intelligent information reading device is connected to the information presentation device, and the display content of the information presentation device is arranged on the intelligent information reading device To obtain the location of an image, the main circuit components of the intelligent information reading device include a camera unit, a storage unit, a communication unit, and a micro-control unit. The device executes an intelligent information reading method.
根據智能資訊讀取方法的實施例,方法中,智能資訊讀取裝置先自一休眠狀態被喚起,通過照相單元取得資訊呈現裝置的顯示內容形成的影像,接著對對此影像執行影像辨識分析,辨識與分析影像中的資訊,形成的內容可以傳送到管理平台系統。 According to an embodiment of the intelligent information reading method, in the method, the intelligent information reading device is first awakened from a sleep state, an image formed by the display content of the information presentation device is obtained through the camera unit, and then image recognition analysis is performed on the image, Identify and analyze the information in the image, and the content formed can be sent to the management platform system.
進一步地,在智能資訊讀取裝置中,可以先評估一通訊品質,而使得傳送經辨識分析影像後產生具有意義的內容或是該影像,可以根據這個通訊品質動態調影像切割傳送封包的方式,傳送經過辨識分析的內容時,可加上影像,也可加上智能資訊讀取裝置的裝置資訊。 Further, in the intelligent information reading device, a communication quality can be evaluated first, so that the transmission of the identified content or the image after the identification and analysis of the image can be dynamically adjusted according to the communication quality. When transmitting the content after identification and analysis, the image can be added, or the device information of the intelligent information reading device can be added.
進一步地,可以在智能資訊讀取裝置中的微控制單元中,或是在智能資訊讀取裝置連接網路的連網裝置中,或是在管理平台系統上,可以一人工智能程序執行影像辨識分析,以判斷影像中的數字、文字、符號、圖形、顏色、指針方向、物件分類、物件 型態、物件位置或物件方向等,形成經辨識分析影像後產生具有相關對應意義的關聯內容。 Further, the image recognition can be performed by an artificial intelligence program in the micro control unit in the intelligent information reading device, or in the networked device where the intelligent information reading device is connected to the network, or on the management platform system Analysis to determine the number, text, symbol, graphic, color, pointer direction, object classification, object in the image The type, object position or object direction, etc. form related content with relevant corresponding meaning after the image is identified and analyzed.
在智能資訊讀取系統的實施例中,提出一管理平台系統,並包括設於終端連接資訊呈現裝置的至少一智能資訊讀取裝置,資訊呈現裝置的顯示內容可安排於智能資訊讀取裝置可取得影像的位置。 In an embodiment of the intelligent information reading system, a management platform system is proposed, and includes at least one intelligent information reading device provided on the terminal connected to the information presentation device, and the display content of the information presentation device can be arranged on the intelligent information reading device. Get the location of the image.
為了能更進一步瞭解本發明為達成既定目的所採取之技術、方法及功效,請參閱以下有關本發明之詳細說明、圖式,相信本發明之目的、特徵與特點,當可由此得以深入且具體之瞭解,然而所附圖式僅提供參考與說明用,並非用來對本發明加以限制者。 In order to understand the technology, method and effect of the present invention to achieve the intended purpose, please refer to the following detailed description and drawings of the present invention. I believe the purpose, features and characteristics of the present invention can be deepened and specific For the sake of understanding, the attached drawings are provided for reference and explanation only, and are not intended to limit the present invention.
10‧‧‧網路 10‧‧‧ Internet
12‧‧‧連網裝置 12‧‧‧Connected device
101‧‧‧資訊呈現裝置一 101‧‧‧Information Presentation Device 1
102‧‧‧智能資訊讀取裝置一 102‧‧‧Intelligent information reading device 1
103‧‧‧資訊呈現裝置二 103‧‧‧Information presentation device 2
104‧‧‧智能資訊讀取裝置二 104‧‧‧Intelligent information reading device 2
14‧‧‧伺服器裝置 14‧‧‧Server device
20‧‧‧管理平台系統 20‧‧‧Management platform system
210‧‧‧監視器 210‧‧‧Monitor
201‧‧‧連網裝置一 201‧‧‧Connected device 1
211‧‧‧智能資訊讀取裝置 211‧‧‧Intelligent information reading device
212‧‧‧資訊呈現裝置 212‧‧‧Information presentation device
202‧‧‧連網裝置二 202‧‧‧Connected device 2
213‧‧‧智能資訊讀取裝置 213‧‧‧Intelligent information reading device
214‧‧‧資訊呈現裝置 214‧‧‧Information presentation device
215‧‧‧智能資訊讀取裝置 215‧‧‧Intelligent information reading device
216‧‧‧資訊呈現裝置 216‧‧‧Information presentation device
30‧‧‧智能資訊讀取裝置 30‧‧‧Intelligent information reading device
301‧‧‧微控制單元 301‧‧‧Micro control unit
311‧‧‧影像處理模組 311‧‧‧Image processing module
312‧‧‧數據處理模組 312‧‧‧Data processing module
313‧‧‧人工智能模組 313‧‧‧Artificial intelligence module
314‧‧‧介面模組 314‧‧‧Interface module
303‧‧‧照相單元 303‧‧‧ camera unit
305‧‧‧儲存單元 305‧‧‧storage unit
307‧‧‧通訊單元 307‧‧‧Communication unit
309‧‧‧電源管理單元 309‧‧‧Power Management Unit
步驟S401~S407‧‧‧智能資訊讀取流程之一 Steps S401~S407‧‧‧One of the intelligent information reading process
步驟S501~S511‧‧‧智能資訊讀取流程之二 Steps S501~S511‧‧‧Intelligent information reading process 2
步驟S601~S613‧‧‧智能資訊讀取流程之三 Steps S601~S613‧‧‧Intelligent information reading process 3
步驟S701~S715‧‧‧智能資訊讀取流程之四 Steps S701~S715‧‧‧Intelligent information reading process 4
步驟S801~S807‧‧‧管理平台系統設定智能資訊讀取裝置的流程 Steps S801~S807 ‧‧‧ Management platform system setting process of intelligent information reading device
圖1顯示使用智能資訊讀取裝置的情境示意圖;圖2顯示智能資訊讀取系統的系統架構實施例示意圖;圖3顯示智能資訊讀取裝置的電路方塊實施例圖;圖4顯示智能資訊讀取方法的實施例之一流程圖;圖5顯示智能資訊讀取方法的實施例之二流程圖;圖6顯示智能資訊讀取方法的實施例之三流程圖;圖7顯示智能資訊讀取方法的實施例之四流程圖;圖8顯示管理平台系統設定智能資訊讀取裝置的方法實施例流程圖。 Fig. 1 shows a schematic diagram of a situation where a smart information reading device is used; Fig. 2 shows a schematic diagram of an embodiment of a system architecture of a smart information reading system; Fig. 3 shows an embodiment of a circuit block diagram of a smart information reading device; Fig. 4 shows a smart information reading device A flowchart of one embodiment of the method; FIG. 5 shows a second flowchart of the embodiment of the intelligent information reading method; FIG. 6 shows a third flowchart of the embodiment of the intelligent information reading method; FIG. 7 shows a diagram of the intelligent information reading method Fourth flowchart of the embodiment; FIG. 8 shows a flowchart of an embodiment of a method for setting an intelligent information reading device by a management platform system.
說明書公開一種智能資訊讀取方法、智能資訊讀取裝置與相關系統,其中智能資訊讀取裝置的設計是要讀取特定資訊呈現裝置所顯示的內容,所述資訊呈現裝置可為顯示量測使用量的裝置,如電錶、水錶與瓦斯錶,也可為量測環境數據的裝置,如溫 濕度計、空氣品質量測器、七段顯示器、各式數位顯示器,另也不排除可以為燈號、符號顯示以及實際且可具體表述實際意義的資訊呈現裝置或相關資訊顯示看板,智能資訊讀取裝置可透過裝置內照相模組取得這些資訊呈現裝置顯示的內容,取得影像表徵,通過影像辨識分析技術得出資訊呈現裝置上的數字、文字、符號、圖形、顏色或指針方向、物件分類、物件型態、物件位置或物件方向等,形成經辨識分析影像後產生具有相關對應意義的關聯內容。因此,所述智能資訊讀取裝置的主要目的是將傳統資訊呈現裝置顯示的資訊內容影像及/或影像中的內容其所代表的關聯意義轉化為對應的簡單資訊,並通過網路傳送到後端平台系統,活化數據的使用。 The specification discloses an intelligent information reading method, an intelligent information reading device, and a related system, wherein the intelligent information reading device is designed to read the content displayed by a specific information presentation device, which can be used for display measurement Measurement devices, such as electric meters, water meters and gas meters, can also be devices for measuring environmental data, such as temperature Hygrometer, air quality measuring device, seven-segment display, various types of digital displays, it also excludes the display of lights, symbols, and actual and specific information presentation devices or related information display boards, intelligent information reading The fetching device can obtain the content displayed by these information presentation devices through the camera module in the device, obtain the image representation, and obtain the numbers, words, symbols, graphics, colors or pointer directions on the information presentation device through image recognition analysis technology, object classification, The object type, object position or object direction, etc. form related content with relevant corresponding meaning after the image is identified and analyzed. Therefore, the main purpose of the intelligent information reading device is to convert the information content image displayed by the traditional information presentation device and/or the related meaning of the content in the image into corresponding simple information, and send it to the End-platform system to activate the use of data.
根據所述的智能資訊讀取裝置實施例,這是一個以影像辨識分析技術為設計基礎的的讀取裝置,主要目的是讀取資訊呈現裝置所顯示的內容,這類內容主要來自量測、偵測與讀取的結果,但也可為其他類型的顯示裝置,如七段顯示器。特別的是,根據智能資訊讀取裝置的主要應用中,可能是需要長時間待機、非必要全時開啟、使用電池、僅須應用低頻寬通訊技術的環境,因此,在這樣的條件下運作的智能資訊讀取裝置可以隨時被喚起、節省不必要的電力消耗,以及使用如物聯網應用的低耗電通訊協定,並能配合遠距管理的需求。 According to the described embodiment of the intelligent information reading device, this is a reading device based on image recognition analysis technology. The main purpose is to read the content displayed by the information presentation device. Such content mainly comes from measurement, Detection and reading results, but can also be other types of display devices, such as seven-segment displays. In particular, according to the main application of the intelligent information reading device, it may be an environment that requires long-time standby, non-essential full-time turn-on, battery use, and only low-frequency wideband communication technology. Therefore, operation under such conditions The intelligent information reading device can be evoked at any time, save unnecessary power consumption, and use low-power communication protocols such as Internet of Things applications, and can meet the needs of remote management.
實施例可參考圖1顯示使用智能資訊讀取裝置的情境示意圖,圖中顯示設於終端的智能資訊讀取裝置一102,裝設在資訊呈現裝置一101上,另有智能資訊讀取裝置二104,裝設在對應的資訊呈現裝置二103上,智能資訊讀取裝置一102與智能資訊讀取裝置二104皆設有通訊電路,可為WiFiTM、BluetoothTM、LoRa、Zigbee、BLE、GPRS、NB-IoT、SigFox或3G/4G/5G等各種無線通訊電路進行資料傳輸至近端的連網裝置12,並在連網裝置12上的管理平台進行資料呈現,亦不排除可以有線網路方式,可以
通過近端的連網裝置12連接網路10,將收到的資訊根據網路路由傳送到到網路上指定伺服器裝置14。
For an embodiment, refer to FIG. 1 to show a schematic diagram of a situation where a smart information reading device is used. The figure shows a smart
根據所述實施例,從資訊呈現裝置一101或資訊呈現裝置二103上顯示的內容可知,可以為數字、文字、符號、圖形、顏色或指針位置等樣式,用以表示各種數值或文字資訊,智能資訊讀取裝置一102與智能資訊讀取裝置二104中設有照相電路以及數值處理的電路,可以取得資訊呈現裝置一101或資訊呈現裝置二103,並進行影像處理後,辨識其中資訊,甚至採用人工智能技術來辨識與分析影像,可以判讀出有意義的資訊。在另一實施例中,可將這些影像與辨識得到的資訊傳送到特定電腦裝置執行判讀,如智能資訊讀取裝置連接網路的線路上的連網裝置,連網裝置可以一電腦裝置、嵌入式系統、現場可程式化邏輯閘陣列(Field Programmable Gate Array,FPGA)、或任何具有計算能力及網路傳輸能力的裝置來實現,可以根據所連接的一或多個智能資訊讀取裝置所產生的影像進行辨識與判讀。再有實施例是將影像或加上辨識得出的內容傳送到管理平台系統,由管理平台系統執行判讀。 According to the embodiment, it can be known from the content displayed on the information presentation device one 101 or the information presentation device two 103 that they can be numbers, words, symbols, graphics, colors or pointer positions, etc., used to represent various numerical values or text information, The intelligent information reading device one 102 and the intelligent information reading device two 104 are provided with a camera circuit and a numerical processing circuit, which can obtain the information presentation device one 101 or the information presentation device two 103, and after image processing, recognize the information therein. Even using artificial intelligence technology to identify and analyze images can interpret meaningful information. In another embodiment, these images and recognized information can be sent to a specific computer device for interpretation, such as a networked device on the line where the intelligent information reading device is connected to the network. The networked device can be a computer device, embedded System, Field Programmable Gate Array (FPGA), or any device with computing capability and network transmission capability, can be generated based on one or more connected intelligent information reading devices Identification and interpretation of the images. In another embodiment, the image or the content obtained by identification is transmitted to the management platform system, and the interpretation is performed by the management platform system.
如此,所提出的智能資訊讀取裝置可以將傳統的資訊呈現裝置上的資訊經影像化,再經影像辨識與分析,形成一些可以在網路上傳播的數位封包,更能有效地被後端系統運用,產生更大的功效。舉例來說,經此系統可以遠距取得各個家庭的水、電與瓦斯用量後,除了降低人力需求外,還可直接計算費用外,當經過數據分析後,可以得出區域性能源的使用,進而提供電力分配的建議,優化能源的使用。 In this way, the proposed intelligent information reading device can image the information on the traditional information presentation device, and then perform image recognition and analysis to form some digital packets that can be propagated on the network, which can be more effectively used by the back-end system Use to produce greater efficacy. For example, after this system can obtain the water, electricity and gas consumption of each household from a distance, in addition to reducing manpower requirements, it can also directly calculate the cost. After data analysis, it can be obtained that the regional energy use, It then provides recommendations for power distribution and optimizes the use of energy.
圖2顯示智能資訊讀取系統的系統架構實施例示意圖。 FIG. 2 shows a schematic diagram of an embodiment of a system architecture of an intelligent information reading system.
圖中顯示的系統主要包括管理平台系統20,這是一個電腦系統叢集、伺服器所實現的後台系統,用以儲存終端傳送的數據,可進行數據分析、產生報表,也提供管理介面,可用於即時監控以及遠距設備管理的用途,系統包括至少一智能資訊讀取裝置
(211,213,215),通過網路10連線管理平台系統20,每個智能資訊讀取裝置(211,213,215)對應連接一資訊呈現裝置(212,214,216),並將資訊呈現裝置(212,214,216)的顯示內容安排於智能資訊讀取裝置(211,213,215)可取得影像的位置,用以將傳統的顯示資訊數位化,或加上影像辨識分析得出資訊,可立即傳送到管理平台系統20。
The system shown in the figure mainly includes a
在終端有多個智能資訊讀取裝置,如智能資訊讀取裝置211,連接資訊呈現裝置212,並能取得資訊呈現裝置212顯示內容的影像,智能資訊讀取裝置211進一步連接連網裝置一201,可以將取得的影像,或是經過辨識得出的內容,可以通過網路10傳送到特定目的地,如管理平台系統20。此例中,在另一個由連網裝置二202形成的子網路中,智能資訊讀取裝置213用以拍攝資訊呈現裝置214的影像,也可經過辨識後取得當中的資訊,智能資訊讀取裝置215用以取得資訊呈現裝置216顯示的資訊,同樣地,智能資訊讀取裝置213與215都可通過連網裝置二202經網路10傳送到管理平台系統20。在此實施例中,管理平台系統20亦可以內置於連網裝置一201或連網裝置二202的管理介面中,並透過監視器210連線至連網裝置一201或連網裝置二202進行操作。
There are multiple intelligent information reading devices on the terminal, such as the intelligent
所述連網裝置一201與連網裝置二202根據應用的無線通訊技術(如WiFiTM、BluetoothTM、LoRa、Zigbee、BLE、GPRS、NB-IoT、SigFox或3G/4G/5G)而可運作為網路存取點(Access Point,AP)、閘道器(Gateway)、集合器(Concentrator)或為基地台(Base station)等。 The networked device one 201 and the networked device two 202 can operate according to the applied wireless communication technology (such as WiFi ™ , Bluetooth ™ , LoRa, Zigbee, BLE, GPRS, NB-IoT, SigFox or 3G/4G/5G) It is an access point (Access Point, AP), gateway, gateway, or base station.
在一實施例中,管理平台系統20取得各終端資訊呈現裝置的顯示內容後,以量測數據為例,相關人員可以通過監視器210立即監視、管理、分析、以及操作各種數據,改善過去需要派員前往抄錶或是通報的方式。
In one embodiment, after the
圖3接著顯示智能資訊讀取裝置的電路方塊實施例圖。 FIG. 3 then shows an embodiment of the circuit block of the intelligent information reading device.
圖中顯示的智能資訊讀取裝置30的主要元件包括微控制單元301、照相單元303、儲存單元305、通訊單元307與電源管理單元309等電路元件,以及運行在微控制單元301中的軟體程序,依照一實施例的功能可以區分為影像處理模組311、數據處理模組312、人工智能模組313與介面模組314,其中介面模組314用於連接照相單元303、儲存單元305、通訊單元307與電源管理單元309等電路元件,讓微控制單元301與這些電路元件通訊。
The main components of the intelligent
其中,智能資訊讀取裝置30中的照相單元303可以涵蓋鏡頭、影像感測器等硬體元件,用以取得資訊呈現裝置的影像,特別的是,為了取得較好的影像,智能資訊讀取裝置30連接資訊呈現裝置時,可設計將資訊呈現裝置的顯示內容安排於智能資訊讀取裝置30可取得影像的位置,也就是照相單元303要能順利取得資訊呈現裝置的影像,其中可以配合資訊呈現裝置的樣式而搭配智能資訊讀取裝置30的結構設計。
Among them, the
智能資訊讀取裝置30中的儲存單元305用以儲存通過照相單元303取得的影像,若在裝置中直接執行影像辨識與分析,儲存裝置305也擔任儲存經辨識與分析影像後產生的內容的工作。
The storage unit 305 in the intelligent
智能資訊讀取裝置30的通訊單元307執行特定通訊協定,能夠傳送影像或加上經辨識與分析影像後產生的內容至特定的目的地。若智能資訊讀取裝置30由電池供電,通訊單元307以及智能資訊讀取裝置30會根據省電設定而在沒有工作時進入休眠狀態,或被關閉。
The
智能資訊讀取裝置30的電源管理單元309能夠根據省電運作的策略控制裝置進入休眠、被喚起,以及提供運行時的電力。
The power management unit 309 of the intelligent
智能資訊讀取裝置30的微控制單元301電性連接上述照相單元303、儲存單元305、通訊單元307以及電源管理單元309,智能資訊讀取裝置30可以由微控制單元301執行智能資訊讀取方法。
The
而微控制單元301中運行了幾個軟體程序,分別以影像處理模組311、數據處理模組312、人工智能模組313與介面模組314實施。
The
當智能資訊讀取裝置30通過電源管理單元309的控制,在未工作時,智能資訊讀取裝置30可以一最小電流待機,當有資訊產生或是得到特定指令,可以自一休眠狀態被喚起。電源管理單元309用於管理智能資訊讀取裝置30使用電池或外接電源(如通過USB連接外部電源,或AC電源)的運行。
When the smart
一開始,即通過照相單元303取得資訊呈現裝置的顯示內容形成的影像,接著可以通過影像處理模組311處理通過照相單元303拍攝的內容,形成影像,並可以判斷得出影像中有興趣的區域(Region of Internet,ROI);接著可以對影像執行影像辨識分析,除了使用光學文字辨識技術(Optical Character Recognition,OCR),更可以此例顯示的人工智能模組313辨識與分析影像中的資訊,如辨識出影像中的文字、圖形與這種有意義的資訊,以形成經辨識與分析影像後產生的內容。
At the beginning, the
智能資訊讀取裝置30的數據處理模組312為處理各種資訊的軟體程序,包括可以將影像分割成多個區段影像、形成網路封包等,更可以根據一通訊品質,產生適合播送的網路封包,以通過通訊單元307傳送經辨識與分析影像後產生的內容,或可加上影像本身,或加上智能資訊讀取裝置30的裝置資訊。
The
圖4顯示智能資訊讀取方法的實施例之主要流程圖。 FIG. 4 shows a main flowchart of an embodiment of an intelligent information reading method.
一開始,智能資訊讀取裝置可以根據定時器(timer)設定的時間或管理平台系統的指令自一休眠狀態被喚起,通過智能資訊讀取裝置之一照相單元取得一資訊呈現裝置的顯示內容,形成顯示資訊的影像(步驟S401),其中可以通過事先設定出當中有興趣的區域(ROI),也可為智能資訊讀取裝置中運行的影像辨識分析技術根據一些預設樣板(template)或模型(model)判斷出有興 趣的區域。 At the beginning, the intelligent information reading device can be called from a sleep state according to the time set by the timer or the instruction of the management platform system, and the display content of an information presentation device can be obtained through a camera unit of the intelligent information reading device. Form an image displaying information (step S401), in which the area of interest (ROI) can be set in advance, or the image recognition analysis technology running in the intelligent information reading device can be based on some preset templates or models (model) judged that there is interest Interesting area.
接著,對所拍攝的資訊影像進行影像辨識與分析(步驟S403),以辨識與分析影像中的資訊,形成經辨識與分析影像後產生的內容(步驟S405),之後可以通過智能資訊讀取裝置的通訊單元將經過辨識與分析影像後產生的內容(步驟S407),另仍可傳送所產生的影像,其中決策是可以根據通訊品質決定傳送策略,例如:第一,僅傳送識別後內容,如數字、文字、符號、圖形、顏色以及/或指針位置;第二,可同時傳送影像與辨識後內容;第三,決定特定傳送影像的方式,如分區段傳送;以及,第四,同時傳送影像、識別後內容、裝置識別資訊(用以識別用戶、位置)以及相關裝置資訊等。 Next, perform image recognition and analysis on the captured information image (step S403) to identify and analyze the information in the image to form the content generated after the image is recognized and analyzed (step S405), and then the device can be read by an intelligent information reader The communication unit will identify and analyze the content generated by the image (step S407), and can still transmit the generated image. The decision is to determine the transmission strategy based on the communication quality, for example: first, only the identified content is transmitted, such as Numbers, text, symbols, graphics, colors, and/or pointer positions; second, the image and the recognized content can be transmitted at the same time; third, determine the specific method of transmitting the image, such as segmented transmission; and, fourth, transmit the image at the same time , Content after recognition, device identification information (used to identify users, location), and related device information.
根據圖5所示智能資訊讀取方法的另一實施例流程圖,此流程圖顯示在步驟S501中,當智能資訊讀取裝置被喚起,如步驟S503,其預設的工作即通過照相單元拍攝資訊呈現裝置中的資訊,以取得資訊影像,其中,可以如步驟S505,智能資訊讀取裝置中軟體程序判斷出有興趣區域,而讓擷取的範圍僅包括有興趣區域的影像,這樣是可以縮小傳送影像的大小。 According to another embodiment of the flowchart of the smart information reading method shown in FIG. 5, this flowchart is shown in step S501, when the smart information reading device is called, as in step S503, its preset work is to shoot through the camera unit Information in the information presentation device to obtain the information image, wherein, in step S505, the software process in the intelligent information reading device determines the area of interest, and the captured range includes only the image of the area of interest, which is possible Reduce the size of the transmitted image.
在進一步實施方式中,如步驟S507,運行於智能資訊讀取裝置的軟體程序可以在傳送內容(影像、辨識後內容)前先取得當下無線通訊的品質,包括取得接收信號強度(Received Signal Strength Indicator,RSSI)或信噪比(Signal-to-noise ratio,SNR),若以有線網路傳送內容,另可通過封包取得有線網路的傳輸狀態,如此,可判斷通訊品質,使得處理影像時,可以將影像切割為多個區段,這些資料區段可為固定大小,或是在一實施例中,可以根據通訊品質動態決定區段大小以切割影像為多個區段影像,再如步驟S509,通過通訊單元傳送這些多個區段影像,或加上裝置資訊,包括電池電量、電池運作資訊、裝置運作狀態、錯誤碼以及/或裝置資訊等。之後,智能資訊讀取裝置再次進入休眠 狀態(步驟S511)。 In a further embodiment, as in step S507, the software program running on the intelligent information reading device can obtain the quality of the current wireless communication before transmitting the content (image, content after recognition), including obtaining the received signal strength indicator (Received Signal Strength Indicator) , RSSI) or Signal-to-noise ratio (SNR), if the content is transmitted through a wired network, the transmission status of the wired network can also be obtained through the packet. In this way, the communication quality can be judged so that when processing images, The image can be cut into multiple segments, and these data segments can be of a fixed size, or in one embodiment, the segment size can be dynamically determined according to the communication quality to cut the image into multiple segment images, and then step S509 , Send these multiple segment images through the communication unit, or add device information, including battery power, battery operation information, device operation status, error codes, and/or device information. After that, the intelligent information reading device goes to sleep again Status (step S511).
在此一提的是,智能資訊讀取裝置傳送資訊的方式可以在傳送到管理平台系統後,需要取得管理平台系統的回應(如ACK封包),確認傳送成功後才進入休眠狀態;或是,智能資訊讀取裝置傳送後可以不用確認管理平台系統是否接收到這個資訊。 It is mentioned here that after the information is sent to the management platform system by the intelligent information reading device, it needs to obtain a response (such as an ACK packet) from the management platform system to confirm that the transmission is successful before entering the sleep state; or, After the intelligent information reading device is transmitted, it is not necessary to confirm whether the management platform system receives this information.
圖6顯示智能資訊讀取方法的再一實施例流程圖。 FIG. 6 shows a flowchart of yet another embodiment of the intelligent information reading method.
同樣地,一開始,根據定時設定或是管理平台系統的指令讓智能資訊讀取裝置被喚起(步驟S601),並開始從資訊呈現裝置上取得資訊影像(步驟S603),也可以針對有興趣區域取得影像(步驟S605)。此例中,特別是由智能資訊讀取裝置本身內部硬體與軟體程序執行影像辨識與分析(步驟S607),因此產生影像與辨識後內容(步驟S609)。 Similarly, at the beginning, the intelligent information reading device is called up according to the timing setting or the instruction of the management platform system (step S601), and the information image is obtained from the information presentation device (step S603). Acquire video (step S605). In this example, in particular, the image recognition and analysis is performed by the internal hardware and software programs of the intelligent information reading device itself (step S607), so the image and the recognized content are generated (step S609).
根據一實施例,在裝置內執行影像辨識分析,其目的是先針對資訊影像通過影像辨識分析技術判斷出資訊呈現裝置所顯示資訊中的表徵資訊,可透過內建比對樣板資訊進行分析,轉化成有意義的資訊,其中特別可以引用人工智能的影像辨識分析技術。例如,智能資訊讀取裝置內的運算電路(如上述微控制單元)中設有人工智能模組以進行人工智能運算(如圖3,313),其中核心程序為事先在智能資訊讀取裝置設計時,事先在外部計算機通過機器學習以及深度學習等人工智能演算法的方式,學習一般資訊呈現裝置上顯示資訊的樣式,如數字、文字、符號、圖形、顏色指針、指針方向、物件分類、物件型態、物件位置以及/或物件方向等,形成人工智能數學模型,該模型可能為權重值、比對樣板等,以可用來快速辨識分析影像後產生具有相關對應意義的關聯內容。當這些人工智能數學模型置入人工智能模組中,該核心程序可以通過人工智能的技術,透過運算該事先分析出的人工智能數學模型快速辨識分析影像中包括的資訊。此做法可在有限的終端計算環境中,快速的辨識分析出影像所代表關聯內容,以達到 快速分析並省電的功效。此方法同時亦可運作於連網裝置已及雲端伺服器環境。 According to an embodiment, the image recognition analysis is performed in the device, the purpose of which is to first determine the characterization information in the information displayed by the information presentation device through the image recognition analysis technology for the information image, and the template information can be analyzed and converted through the built-in comparison Into meaningful information, which can particularly use artificial intelligence image recognition analysis technology. For example, the arithmetic circuit (such as the above-mentioned micro-control unit) in the intelligent information reading device is provided with an artificial intelligence module to perform artificial intelligence operations (see Figure 3, 313), in which the core program is designed in advance in the intelligent information reading device At the time, learn the style of displaying information on general information presentation devices, such as numbers, text, symbols, graphics, color pointers, pointer directions, object classification, objects on external computers through artificial intelligence algorithms such as machine learning and deep learning. The shape, object position, and/or object direction form an artificial intelligence mathematical model. The model may be weight values, comparison templates, etc., which can be used to quickly identify and analyze images and generate related content with relevant corresponding meanings. When these artificial intelligence mathematical models are placed in the artificial intelligence module, the core program can quickly identify and analyze the information included in the image through the artificial intelligence technology and the artificial intelligence mathematical model analyzed in advance. This approach can quickly identify and analyze the related content represented by the image in a limited terminal computing environment to achieve Quickly analyze and save power. This method can also be used in networked devices and cloud server environments.
之後,在步驟S611中,智能資訊讀取裝置將根據通訊品質傳送經辨識與分析影像後產生的內容,或包括原本影像,或加上電池電量、電池運作資訊、裝置運作狀態、錯誤碼以及/或裝置資訊等的裝置資訊至管理平台系統。完成之後,裝置將重新進入休眠狀態(步驟S613)。 Then, in step S611, the intelligent information reading device will transmit the content generated after the image is identified and analyzed according to the communication quality, or include the original image, or add the battery power, battery operation information, device operation status, error code, and/or Or device information to the management platform system. After completion, the device will re-enter the sleep state (step S613).
接著,如圖7所示顯示智能資訊讀取方法的實施例流程圖,此例綜合了上述圖5與圖6的實施例流程。在流程開始前,智能資訊讀取裝置一般是在休眠狀態,僅提供支持待機所需的電力,其中微控制單元將依據定時器的設定定時被喚起,或可由遠距管理平台系統下達指令被喚起。 Next, as shown in FIG. 7, a flowchart of an embodiment of a method for reading an intelligent information is displayed. This example integrates the above-mentioned flowcharts of the embodiments of FIGS. 5 and 6. Before the process starts, the intelligent information reading device is generally in the sleep state, and only provides the power required to support the standby. The micro control unit will be awakened according to the timer setting, or it can be awakened by the remote management platform system by issuing instructions .
流程開始,智能資訊讀取裝置被喚起(步驟S701),並開始取得資訊影像(步驟703),並能選擇性地擷取有興趣區域的影像(步驟S705),再由裝置內處理程序執行影像辨識與分析(步驟S707),影像辨識分析技術可以採用光學文字辨識技術或人工智能技術,之後產生影像與辨識後內容(步驟S709)。 At the beginning of the process, the intelligent information reading device is evoked (step S701), and starts to obtain information images (step 703), and can selectively capture images of the area of interest (step S705), and then execute the image by the in-device processing program Recognition and analysis (step S707), the image recognition analysis technology may use optical character recognition technology or artificial intelligence technology, and then generate images and post-recognition content (step S709).
所產生的資訊影像可以根據需求分割(步驟S711),特別是能根據通訊品質決定分割影像的方式,並包括決定傳送的方式,傳送的影像可以為整個資訊呈現裝置面板的影像,或是有興趣區域的影像。接著傳送分割影像以及/或辨識分析後產生具有意義的文字,或加上裝置資訊至管理平台系統(步驟S713),之後裝置重新進入休眠狀態(步驟S715)。 The generated information image can be divided according to demand (step S711), in particular, the method of dividing the image can be determined according to the communication quality, and including the method of transmission. The transmitted image can be the image of the entire information presentation device panel, or interested Image of the area. Next, the segmented image and/or recognition analysis is sent to generate meaningful text, or the device information is added to the management platform system (step S713), and then the device enters the sleep state again (step S715).
根據一實施例,如上述內容,智能資訊讀取裝置的休眠時間可為預定設定值,或可以由管理平台系統通過無線通訊技術傳送設定休眠時間的指令,其中遠距設定智能資訊讀取裝置的參數的技術可以參考圖8所示管理平台系統設定智能資訊讀取裝置的方法實施例流程圖,如此可知,智能資訊讀取裝置可以具備兩種休 眠狀態的設定方法。 According to an embodiment, as described above, the sleep time of the smart information reading device may be a predetermined setting value, or a command to set the sleep time may be transmitted by the management platform system through wireless communication technology, wherein the remote setting of the smart information reading device For the parameter technology, please refer to the flowchart of the method embodiment of the method for setting the intelligent information reading device in the management platform system shown in FIG. 8. How to set the sleep state.
採用管理平台系統的系統架構可以參考圖2的示意圖,管理平台系統用以接收複數個智能資訊讀取裝置傳送的已經辨識分析影像後產生的內容;或是由特定裝置執行影像分析辨識,如上述連網裝置,再將經辨識與分析影像後產生的內容傳送至管理平台系統;另外,或是由管理平台系統接收影像後才由管理平台系統進行影像辨識與分析。 The system architecture of the management platform system can refer to the schematic diagram of FIG. 2. The management platform system is used to receive the content generated by the multiple intelligent information reading devices after the identification and analysis of the image; or the specific device performs image analysis and identification, as described above The networked device transmits the content generated after the image recognition and analysis to the management platform system; in addition, the image recognition and analysis is performed by the management platform system only after the image is received by the management platform system.
如圖8顯示流程,由於管理平台系統掌握了所有終端智能資訊讀取裝置的識別資訊與運行狀態,裝置內更設有軟體程序處理來自管理平台系統的指令。此例流程開始如步驟S801,管理平台系統運行一個管理多端智能資訊讀取裝置的管理平台,能針對個別、部分或是全部的智能資訊讀取裝置產生設定參數(步驟S801),可包括設定裝置內人工智能模組的運作參數、電源管理單元的定時參數、影像取得的參數、網路設定等,並建立傳播於網路上的設定封包(步驟S803)。 As shown in the flow shown in FIG. 8, since the management platform system has grasped the identification information and operating status of all terminal intelligent information reading devices, a software program is further provided in the device to process the commands from the management platform system. The flow of this example starts as step S801. The management platform system runs a management platform that manages multi-terminal intelligent information reading devices, and can generate setting parameters for individual, partial, or all intelligent information reading devices (step S801), which may include setting devices The operation parameters of the internal artificial intelligence module, the timing parameters of the power management unit, the parameters of the image acquisition, the network settings, etc., and create a setting packet propagated on the network (step S803).
接著,如步驟S805,根據智能資訊讀取裝置的識別資訊、網路位址與傳送路徑,設定封包將通過網路、連網裝置傳送設定封包至智能資訊讀取裝置,並可以透過指令喚醒智能資訊讀取裝置,以能接收設定封包並執行設定(步驟S807)。 Then, in step S805, according to the identification information, network address and transmission path of the intelligent information reading device, the setting packet will be sent to the intelligent information reading device via the network or networked device, and the intelligent can be awakened by the command The information reading device can receive the setting packet and perform the setting (step S807).
是以,根據以上描述智能資訊讀取裝置的實施例,這是用於讀取會顯示資訊的各式資訊呈現裝置的智能裝置,本身可以具備影像擷取、影像辨識、分析與通訊能力的裝置,可以將顯示資訊轉換成具有意義的資訊,進而使得遠端管理平台系統可以進行數據收集、產生報表、數據分析,產生傳統一般顯示器無法達到的功效。 Therefore, according to the embodiment of the intelligent information reading device described above, this is an intelligent device for reading various types of information presentation devices that display information, which can itself have devices for image capture, image recognition, analysis, and communication capabilities , It can convert the display information into meaningful information, so that the remote management platform system can perform data collection, report generation, and data analysis, resulting in functions that cannot be achieved by traditional general monitors.
惟以上所述僅為本發明之較佳可行實施例,非因此即侷限本發明之專利範圍,故舉凡運用本發明說明書及圖示內容所為之等效結構變化,均同理包含於本發明之範圍內,合予陳明。 However, the above is only a preferred and feasible embodiment of the present invention, and therefore does not limit the scope of the patent of the present invention. Therefore, any equivalent structural changes using the description and illustrations of the present invention are equally included in the present invention. Within the scope, it is agreed with Chen Ming.
10‧‧‧網路 10‧‧‧ Internet
20‧‧‧管理平台系統 20‧‧‧Management platform system
210‧‧‧監視器 210‧‧‧Monitor
201‧‧‧連網裝置一 201‧‧‧Connected device 1
211‧‧‧智能資訊讀取裝置 211‧‧‧Intelligent information reading device
212‧‧‧資訊呈現裝置 212‧‧‧Information presentation device
202‧‧‧連網裝置二 202‧‧‧Connected device 2
213‧‧‧智能資訊讀取裝置 213‧‧‧Intelligent information reading device
214‧‧‧資訊呈現裝置 214‧‧‧Information presentation device
215‧‧‧智能資訊讀取裝置 215‧‧‧Intelligent information reading device
216‧‧‧資訊呈現裝置 216‧‧‧Information presentation device
Claims (20)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW107141051A TWI722338B (en) | 2018-11-19 | 2018-11-19 | Intelligent information reading method, intelligent reader and system thereof |
JP2018247967A JP2020087397A (en) | 2018-11-19 | 2018-12-28 | Method, device and system for reading intelligence information |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW107141051A TWI722338B (en) | 2018-11-19 | 2018-11-19 | Intelligent information reading method, intelligent reader and system thereof |
Publications (2)
Publication Number | Publication Date |
---|---|
TW202020735A true TW202020735A (en) | 2020-06-01 |
TWI722338B TWI722338B (en) | 2021-03-21 |
Family
ID=70908503
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW107141051A TWI722338B (en) | 2018-11-19 | 2018-11-19 | Intelligent information reading method, intelligent reader and system thereof |
Country Status (2)
Country | Link |
---|---|
JP (1) | JP2020087397A (en) |
TW (1) | TWI722338B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116781867A (en) * | 2023-07-08 | 2023-09-19 | 深圳市恺恩科技有限公司 | Method and system for monitoring transmission line in signal-free area |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100364078B1 (en) * | 1999-12-21 | 2002-12-12 | 주식회사 블루맥스 커뮤니케이션 | System and method for wireless automatic meter reading |
JP2002257612A (en) * | 2001-02-27 | 2002-09-11 | Osaka Gas Co Ltd | Remote monitoring device for gas meter and remote meter device for gas meter |
JP2003272076A (en) * | 2002-03-14 | 2003-09-26 | Osaka Gas Co Ltd | Meter inspection method |
JP2012208763A (en) * | 2011-03-30 | 2012-10-25 | Fuji Telecom Kk | Integrated meter reading information system |
US10168181B2 (en) * | 2016-08-17 | 2019-01-01 | Arnon MAMAN | Meter reading device and system |
JP6452665B2 (en) * | 2016-12-05 | 2019-01-16 | Kddi株式会社 | Flight apparatus and communication method |
JP6707178B2 (en) * | 2017-03-17 | 2020-06-10 | 株式会社Pfu | Image processing device, control method, and control program |
-
2018
- 2018-11-19 TW TW107141051A patent/TWI722338B/en active
- 2018-12-28 JP JP2018247967A patent/JP2020087397A/en active Pending
Also Published As
Publication number | Publication date |
---|---|
TWI722338B (en) | 2021-03-21 |
JP2020087397A (en) | 2020-06-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN112180193B (en) | Non-invasive load identification system and method based on track image identification | |
CN107328437A (en) | Towards the wearable device of electric power safety inspection operation | |
CN105590336B (en) | Information displaying method and device | |
CN103914992A (en) | Intelligent parking detection system based on wireless sensor network | |
CN103759387A (en) | Air conditioner unit/device controller capable of controlling quality of indoor air, and system | |
US11276292B2 (en) | Recording activity detection | |
CN104571034A (en) | Intelligent management and control equipment for cold and hot joint supply of heating ventilating and air conditioning system and control method thereof | |
CN102545098A (en) | Power transmission line inspection system and implementation method thereof | |
CN105071996A (en) | Terminal on-line detection method, terminal and server | |
Chen et al. | Design of greenhouse environment monitoring system based on NB-IoT and edge computing | |
CN108444056A (en) | Central air-conditioning monitoring system and its monitoring method | |
CN114234374B (en) | Split air conditioning electric control system, power saving controller and power saving amount calculation method thereof | |
TWI722338B (en) | Intelligent information reading method, intelligent reader and system thereof | |
US10643450B1 (en) | Magnetic sensor batteries | |
CN115899991A (en) | Air conditioner operation control method and device, electronic equipment and storage medium | |
Englert et al. | Electricity-metering in a connected world: Virtual sensors for estimating the electricity consumption of iot appliances | |
CN106292610B (en) | Intelligent home control system | |
CN116184851A (en) | Sleep mode adjusting method, device, terminal and storage medium | |
CN210570822U (en) | Multimode communication temperature and humidity monitoring equipment | |
CN106909105A (en) | Intelligent energy-saving terminal based on RFID and Zigbee technology | |
CN113298489A (en) | Big-arch shelter automatic system based on degree of depth study | |
CN210298094U (en) | Water quality environment remote monitoring system based on wireless sensor network | |
CN210952919U (en) | Indoor and outdoor environment monitoring system | |
CN105739576A (en) | Museum cultural relic monitoring system based on ZigBee and Android | |
TWI536282B (en) | Campus energy conservation neural network decision spport system and method thereof |