TWI722338B - Intelligent information reading method, intelligent reader and system thereof - Google Patents
Intelligent information reading method, intelligent reader and system thereof Download PDFInfo
- Publication number
- TWI722338B TWI722338B TW107141051A TW107141051A TWI722338B TW I722338 B TWI722338 B TW I722338B TW 107141051 A TW107141051 A TW 107141051A TW 107141051 A TW107141051 A TW 107141051A TW I722338 B TWI722338 B TW I722338B
- Authority
- TW
- Taiwan
- Prior art keywords
- information reading
- image
- intelligent information
- intelligent
- management platform
- Prior art date
Links
Images
Landscapes
- Arrangements For Transmission Of Measured Signals (AREA)
- Selective Calling Equipment (AREA)
- Telephone Function (AREA)
- Telephonic Communication Services (AREA)
- Image Analysis (AREA)
Abstract
Description
一種資訊讀取的技術,特別是指以影像辨識分析技術讀取特定資訊呈現裝置上的資訊的方法、智能資訊讀取裝置與相關系統。 An information reading technology, in particular, refers to a method for reading information on a specific information presentation device using image recognition and analysis technology, an intelligent information reading device and related systems.
生活上有許多量測數據的裝置,例如量測家庭或公司用電的電錶、量測用水量的水錶,以及瓦斯使用量的瓦斯錶,還有量測四周環境溫度、濕度、空氣品質等數據的量測裝置,讓我們可以從這些資訊讀取裝置上得出整體生活的需要與變化,並可作為改變生活方式或是節約能源的參考。 There are many devices for measuring data in life, such as electricity meters for measuring household or company electricity consumption, water meters for measuring water consumption, gas meters for measuring gas consumption, and data such as ambient temperature, humidity, and air quality. The measurement device of the, allows us to obtain the needs and changes of the overall life from these information reading devices, and can be used as a reference for changing lifestyles or saving energy.
而其中量測得到的數據部份是有關使用者付費的數據,例如電力公司需要根據電錶的數據向用戶收取電費,傳統的方式之一是電力公司派人來抄錶,將電錶上的數據回報公司系統後,才能得出一定期間內的用量來計算費用;另有方式是讓用戶上網或是用電話系統回報電錶數據,讓電力公司計算電費。對於水費而言,同樣地,自來水公司需要派員來抄水表,並根據水錶讀數向用戶收取水費;瓦斯公司也是根據瓦斯錶的讀數來收費,傳統得到讀數的方式包括派員抄錶,或是由用戶自己上網或是打電話登錄數據。 Among them, the measured data part is the data related to the user's payment. For example, the power company needs to charge the user the electricity bill based on the data of the meter. One of the traditional methods is that the power company sends someone to read the meter and report the data on the meter. Only after the company's system can the consumption in a certain period of time be calculated to calculate the cost; another way is to let the user go online or use the telephone system to report the meter data so that the power company can calculate the electricity bill. For water bills, similarly, the water company needs to send staff to read the water meter and charge the user the water bill based on the meter reading; the gas company also charges based on the gas meter reading. The traditional way to get the reading includes sending a meter to read the meter. Or users can log in to the data by going online or calling.
如此可知,在所謂智慧城市或智慧家庭等尚未完整建制的多數環境中,習知技術中並未對上述水錶、電錶、瓦斯錶等資訊呈 現裝置上的顯示資訊提出有效取得資訊的解決方案。 It can be seen that in most environments where the so-called smart cities or smart homes are not yet fully established, the conventional technology does not provide information on the above-mentioned water meters, electricity meters, and gas meters. The display information on the current device proposes an effective solution for obtaining information.
說明書公開一種智能資訊讀取方法、裝置與系統,所提出的智能資訊讀取裝置較佳地是裝設在傳統資訊呈現裝置上的讀取裝置,通過其中影像擷取的功能取得資訊呈現裝置上顯示的內容,進而通過影像辨識分析技術取得其中資訊,達到遠距讀取資訊的目的,解決相關人員不易到達資訊呈現裝置裝設位置而無法取得讀數的問題。 The manual discloses an intelligent information reading method, device and system. The proposed intelligent information reading device is preferably a reading device installed on a traditional information presentation device, and the information presentation device is obtained through the function of image capture. The displayed content is then obtained through the image recognition and analysis technology to achieve the purpose of remote reading of the information, and solve the problem that the relevant personnel cannot easily reach the installation location of the information display device and cannot obtain the reading.
根據實施例,提出一智能資訊讀取裝置,用於讀取一資訊呈現裝置的顯示內容,智能資訊讀取裝置連接資訊呈現裝置,並將資訊呈現裝置的顯示內容安排於智能資訊讀取裝置可取得一影像的位置,智能資訊讀取裝置的主要電路元件包括照相單元、儲存單元、通訊單元,以及一微控制單元,裝置中執行一智能資訊讀取方法。 According to an embodiment, an intelligent information reading device is provided for reading the display content of an information presentation device. The intelligent information reading device is connected to the information presentation device, and the display content of the information presentation device is arranged on the intelligent information reading device. To obtain the position of an image, the main circuit components of the intelligent information reading device include a camera unit, a storage unit, a communication unit, and a micro-control unit. The device executes an intelligent information reading method.
根據智能資訊讀取方法的實施例,方法中,智能資訊讀取裝置先自一休眠狀態被喚起,通過照相單元取得資訊呈現裝置的顯示內容形成的影像,接著對對此影像執行影像辨識分析,辨識與分析影像中的資訊,形成的內容可以傳送到管理平台系統。 According to the embodiment of the intelligent information reading method, in the method, the intelligent information reading device is first awakened from a dormant state, the image formed by the display content of the information presentation device is obtained through the camera unit, and then image recognition analysis is performed on the image, Identify and analyze the information in the image, and the formed content can be sent to the management platform system.
進一步地,在智能資訊讀取裝置中,可以先評估一通訊品質,而使得傳送經辨識分析影像後產生具有意義的內容或是該影像,可以根據這個通訊品質動態調影像切割傳送封包的方式,傳送經過辨識分析的內容時,可加上影像,也可加上智能資訊讀取裝置的裝置資訊。 Furthermore, in the intelligent information reading device, a communication quality can be evaluated first, so that meaningful content is generated after the image is transmitted after identification and analysis, or the image can be dynamically adjusted according to the communication quality. When sending content that has been identified and analyzed, images can be added, or device information from smart information reading devices can be added.
進一步地,可以在智能資訊讀取裝置中的微控制單元中,或是在智能資訊讀取裝置連接網路的連網裝置中,或是在管理平台系統上,可以一人工智能程序執行影像辨識分析,以判斷影像中的數字、文字、符號、圖形、顏色、指針方向、物件分類、物件 型態、物件位置或物件方向等,形成經辨識分析影像後產生具有相關對應意義的關聯內容。 Furthermore, an artificial intelligence program can be used to perform image recognition in the micro-control unit in the intelligent information reading device, or in the networked device where the intelligent information reading device is connected to the network, or on the management platform system. Analyze to determine the numbers, text, symbols, graphics, colors, pointer direction, object classification, and objects in the image The shape, object position or object direction, etc., are formed after the identification and analysis of the image to produce related content with relevant corresponding meanings.
在智能資訊讀取系統的實施例中,提出一管理平台系統,並包括設於終端連接資訊呈現裝置的至少一智能資訊讀取裝置,資訊呈現裝置的顯示內容可安排於智能資訊讀取裝置可取得影像的位置。 In the embodiment of the intelligent information reading system, a management platform system is proposed, and includes at least one intelligent information reading device connected to the information display device at the terminal, and the display content of the information display device can be arranged on the intelligent information reading device. Get the location of the image.
為了能更進一步瞭解本發明為達成既定目的所採取之技術、方法及功效,請參閱以下有關本發明之詳細說明、圖式,相信本發明之目的、特徵與特點,當可由此得以深入且具體之瞭解,然而所附圖式僅提供參考與說明用,並非用來對本發明加以限制者。 In order to further understand the technology, methods and effects of the present invention to achieve the intended purpose, please refer to the following detailed descriptions and drawings about the present invention. I believe that the purpose, features and characteristics of the present invention can be thoroughly and concretely obtained from this. It is understood that, however, the accompanying drawings are only provided for reference and illustration, and are not intended to limit the present invention.
10‧‧‧網路 10‧‧‧Internet
12‧‧‧連網裝置 12‧‧‧Connected device
101‧‧‧資訊呈現裝置一 101‧‧‧Information Presentation Device One
102‧‧‧智能資訊讀取裝置一 102‧‧‧Intelligent Information Reading Device One
103‧‧‧資訊呈現裝置二 103‧‧‧Information Presentation Device 2
104‧‧‧智能資訊讀取裝置二 104‧‧‧Intelligent Information Reading Device 2
14‧‧‧伺服器裝置 14‧‧‧Server device
20‧‧‧管理平台系統 20‧‧‧Management Platform System
210‧‧‧監視器 210‧‧‧Monitor
201‧‧‧連網裝置一 201‧‧‧Connected Device One
211‧‧‧智能資訊讀取裝置 211‧‧‧Intelligent Information Reading Device
212‧‧‧資訊呈現裝置 212‧‧‧Information Presentation Device
202‧‧‧連網裝置二 202‧‧‧Connected Device Two
213‧‧‧智能資訊讀取裝置 213‧‧‧Intelligent Information Reading Device
214‧‧‧資訊呈現裝置 214‧‧‧Information Presentation Device
215‧‧‧智能資訊讀取裝置 215‧‧‧Intelligent Information Reading Device
216‧‧‧資訊呈現裝置 216‧‧‧Information Presentation Device
30‧‧‧智能資訊讀取裝置 30‧‧‧Intelligent Information Reading Device
301‧‧‧微控制單元 301‧‧‧Micro control unit
311‧‧‧影像處理模組 311‧‧‧Image Processing Module
312‧‧‧數據處理模組 312‧‧‧Data Processing Module
313‧‧‧人工智能模組 313‧‧‧Artificial Intelligence Module
314‧‧‧介面模組 314‧‧‧Interface Module
303‧‧‧照相單元 303‧‧‧Photographic Unit
305‧‧‧儲存單元 305‧‧‧Storage Unit
307‧‧‧通訊單元 307‧‧‧Communication Unit
309‧‧‧電源管理單元 309‧‧‧Power Management Unit
步驟S401~S407‧‧‧智能資訊讀取流程之一 Steps S401~S407‧‧‧One of the intelligent information reading process
步驟S501~S511‧‧‧智能資訊讀取流程之二 Steps S501~S511‧‧‧Intelligent Information Reading Process 2
步驟S601~S613‧‧‧智能資訊讀取流程之三 Steps S601~S613‧‧‧Intelligent Information Reading Process 3
步驟S701~S715‧‧‧智能資訊讀取流程之四 Steps S701~S715‧‧‧Intelligent Information Reading Process 4
步驟S801~S807‧‧‧管理平台系統設定智能資訊讀取裝置的流程 Steps S801~S807‧‧‧The process of setting the intelligent information reading device in the management platform system
圖1顯示使用智能資訊讀取裝置的情境示意圖;圖2顯示智能資訊讀取系統的系統架構實施例示意圖;圖3顯示智能資訊讀取裝置的電路方塊實施例圖;圖4顯示智能資訊讀取方法的實施例之一流程圖;圖5顯示智能資訊讀取方法的實施例之二流程圖;圖6顯示智能資訊讀取方法的實施例之三流程圖;圖7顯示智能資訊讀取方法的實施例之四流程圖;圖8顯示管理平台系統設定智能資訊讀取裝置的方法實施例流程圖。 Fig. 1 shows a schematic diagram of a scenario using an intelligent information reading device; Fig. 2 shows a schematic diagram of an embodiment of the system architecture of an intelligent information reading system; Fig. 3 shows an embodiment diagram of a circuit block of the intelligent information reading device; Fig. 4 shows an intelligent information reading Fig. 5 shows a flowchart of the second embodiment of the intelligent information reading method; Fig. 6 shows a flowchart of the third embodiment of the intelligent information reading method; Fig. 7 shows the flowchart of the intelligent information reading method Flow chart of the fourth embodiment; FIG. 8 shows a flow chart of an embodiment of a method for the management platform system to set an intelligent information reading device.
說明書公開一種智能資訊讀取方法、智能資訊讀取裝置與相關系統,其中智能資訊讀取裝置的設計是要讀取特定資訊呈現裝置所顯示的內容,所述資訊呈現裝置可為顯示量測使用量的裝置,如電錶、水錶與瓦斯錶,也可為量測環境數據的裝置,如溫 濕度計、空氣品質量測器、七段顯示器、各式數位顯示器,另也不排除可以為燈號、符號顯示以及實際且可具體表述實際意義的資訊呈現裝置或相關資訊顯示看板,智能資訊讀取裝置可透過裝置內照相模組取得這些資訊呈現裝置顯示的內容,取得影像表徵,通過影像辨識分析技術得出資訊呈現裝置上的數字、文字、符號、圖形、顏色或指針方向、物件分類、物件型態、物件位置或物件方向等,形成經辨識分析影像後產生具有相關對應意義的關聯內容。因此,所述智能資訊讀取裝置的主要目的是將傳統資訊呈現裝置顯示的資訊內容影像及/或影像中的內容其所代表的關聯意義轉化為對應的簡單資訊,並通過網路傳送到後端平台系統,活化數據的使用。 The manual discloses an intelligent information reading method, an intelligent information reading device, and related systems. The intelligent information reading device is designed to read the content displayed by a specific information presentation device, which can be used for display measurement Measurement devices, such as electricity meters, water meters, and gas meters, can also be devices that measure environmental data, such as temperature Hygrometers, air quality measuring devices, seven-segment displays, various digital displays, and other information display devices or related information display boards that can display light signals, symbols, and actual and specific actual meanings or related information display boards, intelligent information reading The fetching device can obtain the content displayed by these information presentation devices through the camera module in the device, obtain the image representation, and obtain the numbers, characters, symbols, graphics, colors or pointer directions, object classification, and object classification on the information presentation device through image recognition and analysis technology. The object type, object position or object direction, etc., are formed after identification and analysis of the image to produce related content with relevant corresponding meanings. Therefore, the main purpose of the intelligent information reading device is to convert the associated meaning of the information content image displayed by the traditional information presentation device and/or the content in the image into corresponding simple information, and then send it to the back through the network. The end platform system activates the use of data.
根據所述的智能資訊讀取裝置實施例,這是一個以影像辨識分析技術為設計基礎的的讀取裝置,主要目的是讀取資訊呈現裝置所顯示的內容,這類內容主要來自量測、偵測與讀取的結果,但也可為其他類型的顯示裝置,如七段顯示器。特別的是,根據智能資訊讀取裝置的主要應用中,可能是需要長時間待機、非必要全時開啟、使用電池、僅須應用低頻寬通訊技術的環境,因此,在這樣的條件下運作的智能資訊讀取裝置可以隨時被喚起、節省不必要的電力消耗,以及使用如物聯網應用的低耗電通訊協定,並能配合遠距管理的需求。 According to the embodiment of the intelligent information reading device, this is a reading device based on image recognition and analysis technology. The main purpose is to read the content displayed by the information display device. This type of content mainly comes from measurement, The result of detection and reading, but can also be other types of display devices, such as a seven-segment display. In particular, according to the main application of the intelligent information reading device, it may be an environment that requires a long standby time, is not necessary to be turned on all the time, uses a battery, and only needs to apply low-bandwidth communication technology. Therefore, it operates under such conditions. Smart information reading devices can be awakened at any time, save unnecessary power consumption, and use low-power communication protocols such as Internet of Things applications, and can meet the needs of remote management.
實施例可參考圖1顯示使用智能資訊讀取裝置的情境示意圖,圖中顯示設於終端的智能資訊讀取裝置一102,裝設在資訊呈現裝置一101上,另有智能資訊讀取裝置二104,裝設在對應的資訊呈現裝置二103上,智能資訊讀取裝置一102與智能資訊讀取裝置二104皆設有通訊電路,可為WiFiTM、BluetoothTM、LoRa、Zigbee、BLE、GPRS、NB-IoT、SigFox或3G/4G/5G等各種無線通訊電路進行資料傳輸至近端的連網裝置12,並在連網裝置12上的管理平台進行資料呈現,亦不排除可以有線網路方式,可以
通過近端的連網裝置12連接網路10,將收到的資訊根據網路路由傳送到到網路上指定伺服器裝置14。
The embodiment can refer to FIG. 1 showing a schematic diagram of a scenario in which an intelligent information reading device is used. The figure shows an intelligent
根據所述實施例,從資訊呈現裝置一101或資訊呈現裝置二103上顯示的內容可知,可以為數字、文字、符號、圖形、顏色或指針位置等樣式,用以表示各種數值或文字資訊,智能資訊讀取裝置一102與智能資訊讀取裝置二104中設有照相電路以及數值處理的電路,可以取得資訊呈現裝置一101或資訊呈現裝置二103,並進行影像處理後,辨識其中資訊,甚至採用人工智能技術來辨識與分析影像,可以判讀出有意義的資訊。在另一實施例中,可將這些影像與辨識得到的資訊傳送到特定電腦裝置執行判讀,如智能資訊讀取裝置連接網路的線路上的連網裝置,連網裝置可以一電腦裝置、嵌入式系統、現場可程式化邏輯閘陣列(Field Programmable Gate Array,FPGA)、或任何具有計算能力及網路傳輸能力的裝置來實現,可以根據所連接的一或多個智能資訊讀取裝置所產生的影像進行辨識與判讀。再有實施例是將影像或加上辨識得出的內容傳送到管理平台系統,由管理平台系統執行判讀。
According to the described embodiment, it can be known from the content displayed on the
如此,所提出的智能資訊讀取裝置可以將傳統的資訊呈現裝置上的資訊經影像化,再經影像辨識與分析,形成一些可以在網路上傳播的數位封包,更能有效地被後端系統運用,產生更大的功效。舉例來說,經此系統可以遠距取得各個家庭的水、電與瓦斯用量後,除了降低人力需求外,還可直接計算費用外,當經過數據分析後,可以得出區域性能源的使用,進而提供電力分配的建議,優化能源的使用。 In this way, the proposed intelligent information reading device can image the information on the traditional information display device, and then through the image recognition and analysis, form some digital packets that can be transmitted on the Internet, and can be more effectively used by the back-end system. Use, produce greater effect. For example, after the system can remotely obtain the water, electricity and gas consumption of each household, in addition to reducing manpower requirements, it can also directly calculate the cost. After data analysis, regional energy use can be obtained. In turn, it provides suggestions on power distribution and optimizes energy use.
圖2顯示智能資訊讀取系統的系統架構實施例示意圖。 FIG. 2 shows a schematic diagram of an embodiment of the system architecture of the intelligent information reading system.
圖中顯示的系統主要包括管理平台系統20,這是一個電腦系統叢集、伺服器所實現的後台系統,用以儲存終端傳送的數據,可進行數據分析、產生報表,也提供管理介面,可用於即時監控以及遠距設備管理的用途,系統包括至少一智能資訊讀取裝置
(211,213,215),通過網路10連線管理平台系統20,每個智能資訊讀取裝置(211,213,215)對應連接一資訊呈現裝置(212,214,216),並將資訊呈現裝置(212,214,216)的顯示內容安排於智能資訊讀取裝置(211,213,215)可取得影像的位置,用以將傳統的顯示資訊數位化,或加上影像辨識分析得出資訊,可立即傳送到管理平台系統20。
The system shown in the figure mainly includes a
在終端有多個智能資訊讀取裝置,如智能資訊讀取裝置211,連接資訊呈現裝置212,並能取得資訊呈現裝置212顯示內容的影像,智能資訊讀取裝置211進一步連接連網裝置一201,可以將取得的影像,或是經過辨識得出的內容,可以通過網路10傳送到特定目的地,如管理平台系統20。此例中,在另一個由連網裝置二202形成的子網路中,智能資訊讀取裝置213用以拍攝資訊呈現裝置214的影像,也可經過辨識後取得當中的資訊,智能資訊讀取裝置215用以取得資訊呈現裝置216顯示的資訊,同樣地,智能資訊讀取裝置213與215都可通過連網裝置二202經網路10傳送到管理平台系統20。在此實施例中,管理平台系統20亦可以內置於連網裝置一201或連網裝置二202的管理介面中,並透過監視器210連線至連網裝置一201或連網裝置二202進行操作。
There are multiple intelligent information reading devices in the terminal, such as the intelligent
所述連網裝置一201與連網裝置二202根據應用的無線通訊技術(如WiFiTM、BluetoothTM、LoRa、Zigbee、BLE、GPRS、NB-IoT、SigFox或3G/4G/5G)而可運作為網路存取點(Access Point,AP)、閘道器(Gateway)、集合器(Concentrator)或為基地台(Base station)等。
The first
在一實施例中,管理平台系統20取得各終端資訊呈現裝置的顯示內容後,以量測數據為例,相關人員可以通過監視器210立即監視、管理、分析、以及操作各種數據,改善過去需要派員前往抄錶或是通報的方式。
In one embodiment, after the
圖3接著顯示智能資訊讀取裝置的電路方塊實施例圖。 FIG. 3 then shows an embodiment diagram of the circuit block of the intelligent information reading device.
圖中顯示的智能資訊讀取裝置30的主要元件包括微控制單元301、照相單元303、儲存單元305、通訊單元307與電源管理單元309等電路元件,以及運行在微控制單元301中的軟體程序,依照一實施例的功能可以區分為影像處理模組311、數據處理模組312、人工智能模組313與介面模組314,其中介面模組314用於連接照相單元303、儲存單元305、通訊單元307與電源管理單元309等電路元件,讓微控制單元301與這些電路元件通訊。
The main components of the smart
其中,智能資訊讀取裝置30中的照相單元303可以涵蓋鏡頭、影像感測器等硬體元件,用以取得資訊呈現裝置的影像,特別的是,為了取得較好的影像,智能資訊讀取裝置30連接資訊呈現裝置時,可設計將資訊呈現裝置的顯示內容安排於智能資訊讀取裝置30可取得影像的位置,也就是照相單元303要能順利取得資訊呈現裝置的影像,其中可以配合資訊呈現裝置的樣式而搭配智能資訊讀取裝置30的結構設計。
Among them, the
智能資訊讀取裝置30中的儲存單元305用以儲存通過照相單元303取得的影像,若在裝置中直接執行影像辨識與分析,儲存裝置305也擔任儲存經辨識與分析影像後產生的內容的工作。
The storage unit 305 in the intelligent
智能資訊讀取裝置30的通訊單元307執行特定通訊協定,能夠傳送影像或加上經辨識與分析影像後產生的內容至特定的目的地。若智能資訊讀取裝置30由電池供電,通訊單元307以及智能資訊讀取裝置30會根據省電設定而在沒有工作時進入休眠狀態,或被關閉。
The
智能資訊讀取裝置30的電源管理單元309能夠根據省電運作的策略控制裝置進入休眠、被喚起,以及提供運行時的電力。
The power management unit 309 of the smart
智能資訊讀取裝置30的微控制單元301電性連接上述照相單元303、儲存單元305、通訊單元307以及電源管理單元309,智能資訊讀取裝置30可以由微控制單元301執行智能資訊讀取方法。
The
而微控制單元301中運行了幾個軟體程序,分別以影像處理模組311、數據處理模組312、人工智能模組313與介面模組314實施。
The
當智能資訊讀取裝置30通過電源管理單元309的控制,在未工作時,智能資訊讀取裝置30可以一最小電流待機,當有資訊產生或是得到特定指令,可以自一休眠狀態被喚起。電源管理單元309用於管理智能資訊讀取裝置30使用電池或外接電源(如通過USB連接外部電源,或AC電源)的運行。
When the intelligent
一開始,即通過照相單元303取得資訊呈現裝置的顯示內容形成的影像,接著可以通過影像處理模組311處理通過照相單元303拍攝的內容,形成影像,並可以判斷得出影像中有興趣的區域(Region of Internet,ROI);接著可以對影像執行影像辨識分析,除了使用光學文字辨識技術(Optical Character Recognition,OCR),更可以此例顯示的人工智能模組313辨識與分析影像中的資訊,如辨識出影像中的文字、圖形與這種有意義的資訊,以形成經辨識與分析影像後產生的內容。
At the beginning, the image formed by the display content of the information presentation device is obtained by the
智能資訊讀取裝置30的數據處理模組312為處理各種資訊的軟體程序,包括可以將影像分割成多個區段影像、形成網路封包等,更可以根據一通訊品質,產生適合播送的網路封包,以通過通訊單元307傳送經辨識與分析影像後產生的內容,或可加上影像本身,或加上智能資訊讀取裝置30的裝置資訊。
The
圖4顯示智能資訊讀取方法的實施例之主要流程圖。 FIG. 4 shows the main flow chart of the embodiment of the intelligent information reading method.
一開始,智能資訊讀取裝置可以根據定時器(timer)設定的時間或管理平台系統的指令自一休眠狀態被喚起,通過智能資訊讀取裝置之一照相單元取得一資訊呈現裝置的顯示內容,形成顯示資訊的影像(步驟S401),其中可以通過事先設定出當中有興趣的區域(ROI),也可為智能資訊讀取裝置中運行的影像辨識分析技術根據一些預設樣板(template)或模型(model)判斷出有興 趣的區域。 At the beginning, the intelligent information reading device can be awakened from a dormant state according to the time set by the timer or the command of the management platform system, and obtain the display content of an information presentation device through a camera unit of the intelligent information reading device. An image for displaying information is formed (step S401), in which the region of interest (ROI) can be set in advance, or the image recognition and analysis technology running in the intelligent information reading device can be based on some preset templates or models (model) Judging that there is interest Interesting area.
接著,對所拍攝的資訊影像進行影像辨識與分析(步驟S403),以辨識與分析影像中的資訊,形成經辨識與分析影像後產生的內容(步驟S405),之後可以通過智能資訊讀取裝置的通訊單元將經過辨識與分析影像後產生的內容(步驟S407),另仍可傳送所產生的影像,其中決策是可以根據通訊品質決定傳送策略,例如:第一,僅傳送識別後內容,如數字、文字、符號、圖形、顏色以及/或指針位置;第二,可同時傳送影像與辨識後內容;第三,決定特定傳送影像的方式,如分區段傳送;以及,第四,同時傳送影像、識別後內容、裝置識別資訊(用以識別用戶、位置)以及相關裝置資訊等。 Next, perform image recognition and analysis on the captured information image (step S403) to identify and analyze the information in the image to form the content generated after the image is recognized and analyzed (step S405), which can then be used by the intelligent information reading device The communication unit will identify and analyze the content generated after the image (step S407), and can still transmit the generated image. The decision is to determine the transmission strategy based on the communication quality. For example, first, only transmit the identified content, such as Numbers, characters, symbols, graphics, colors, and/or pointer positions; second, the image and the recognized content can be transmitted at the same time; third, determining the specific method of transmitting the image, such as segment transmission; and, fourth, transmitting the image at the same time , Recognized content, device identification information (used to identify the user, location), and related device information, etc.
根據圖5所示智能資訊讀取方法的另一實施例流程圖,此流程圖顯示在步驟S501中,當智能資訊讀取裝置被喚起,如步驟S503,其預設的工作即通過照相單元拍攝資訊呈現裝置中的資訊,以取得資訊影像,其中,可以如步驟S505,智能資訊讀取裝置中軟體程序判斷出有興趣區域,而讓擷取的範圍僅包括有興趣區域的影像,這樣是可以縮小傳送影像的大小。 According to the flowchart of another embodiment of the intelligent information reading method shown in FIG. 5, this flowchart is shown in step S501. When the intelligent information reading device is awakened, as in step S503, its preset work is to take pictures by the camera unit. The information in the information display device is used to obtain the information image. In step S505, the software program in the intelligent information reading device can determine the region of interest, and the captured range only includes the image of the region of interest. Reduce the size of the transmitted image.
在進一步實施方式中,如步驟S507,運行於智能資訊讀取裝置的軟體程序可以在傳送內容(影像、辨識後內容)前先取得當下無線通訊的品質,包括取得接收信號強度(Received Signal Strength Indicator,RSSI)或信噪比(Signal-to-noise ratio,SNR),若以有線網路傳送內容,另可通過封包取得有線網路的傳輸狀態,如此,可判斷通訊品質,使得處理影像時,可以將影像切割為多個區段,這些資料區段可為固定大小,或是在一實施例中,可以根據通訊品質動態決定區段大小以切割影像為多個區段影像,再如步驟S509,通過通訊單元傳送這些多個區段影像,或加上裝置資訊,包括電池電量、電池運作資訊、裝置運作狀態、錯誤碼以及/或裝置資訊等。之後,智能資訊讀取裝置再次進入休眠 狀態(步驟S511)。 In a further embodiment, in step S507, the software program running on the intelligent information reading device can obtain the current wireless communication quality before transmitting the content (image, recognized content), including obtaining the received signal strength indicator (Received Signal Strength Indicator). , RSSI) or signal-to-noise ratio (Signal-to-noise ratio, SNR). If the content is transmitted through a wired network, the transmission status of the wired network can be obtained through packets. In this way, the communication quality can be judged so that when processing images, The image can be divided into multiple segments, and these data segments can have a fixed size, or in one embodiment, the segment size can be dynamically determined according to the communication quality to cut the image into multiple segment images, and then step S509 , Through the communication unit to transmit these multiple segment images, or add device information, including battery power, battery operation information, device operation status, error code and/or device information, etc. After that, the smart information reading device goes to sleep again Status (step S511).
在此一提的是,智能資訊讀取裝置傳送資訊的方式可以在傳送到管理平台系統後,需要取得管理平台系統的回應(如ACK封包),確認傳送成功後才進入休眠狀態;或是,智能資訊讀取裝置傳送後可以不用確認管理平台系統是否接收到這個資訊。 It is mentioned here that the way that the intelligent information reading device transmits information can be sent to the management platform system, and needs to obtain a response (such as an ACK packet) from the management platform system, and enter the sleep state after confirming that the transmission is successful; or, After the intelligent information reading device transmits, there is no need to confirm whether the management platform system has received this information.
圖6顯示智能資訊讀取方法的再一實施例流程圖。 Fig. 6 shows a flowchart of another embodiment of a method for reading intelligent information.
同樣地,一開始,根據定時設定或是管理平台系統的指令讓智能資訊讀取裝置被喚起(步驟S601),並開始從資訊呈現裝置上取得資訊影像(步驟S603),也可以針對有興趣區域取得影像(步驟S605)。此例中,特別是由智能資訊讀取裝置本身內部硬體與軟體程序執行影像辨識與分析(步驟S607),因此產生影像與辨識後內容(步驟S609)。 Similarly, at the beginning, the intelligent information reading device is awakened according to the timing setting or the instruction of the management platform system (step S601), and starts to obtain information images from the information presentation device (step S603), which can also target the area of interest Obtain an image (step S605). In this example, in particular, the internal hardware and software programs of the intelligent information reading device itself perform image recognition and analysis (step S607), thereby generating images and recognized content (step S609).
根據一實施例,在裝置內執行影像辨識分析,其目的是先針對資訊影像通過影像辨識分析技術判斷出資訊呈現裝置所顯示資訊中的表徵資訊,可透過內建比對樣板資訊進行分析,轉化成有意義的資訊,其中特別可以引用人工智能的影像辨識分析技術。例如,智能資訊讀取裝置內的運算電路(如上述微控制單元)中設有人工智能模組以進行人工智能運算(如圖3,313),其中核心程序為事先在智能資訊讀取裝置設計時,事先在外部計算機通過機器學習以及深度學習等人工智能演算法的方式,學習一般資訊呈現裝置上顯示資訊的樣式,如數字、文字、符號、圖形、顏色指針、指針方向、物件分類、物件型態、物件位置以及/或物件方向等,形成人工智能數學模型,該模型可能為權重值、比對樣板等,以可用來快速辨識分析影像後產生具有相關對應意義的關聯內容。當這些人工智能數學模型置入人工智能模組中,該核心程序可以通過人工智能的技術,透過運算該事先分析出的人工智能數學模型快速辨識分析影像中包括的資訊。此做法可在有限的終端計算環境中,快速的辨識分析出影像所代表關聯內容,以達到 快速分析並省電的功效。此方法同時亦可運作於連網裝置已及雲端伺服器環境。 According to one embodiment, the purpose of performing image recognition analysis in the device is to first determine the representative information in the information displayed by the information display device through the image recognition analysis technology for the information image, and then analyze and transform the built-in template information. To become meaningful information, in particular, the image recognition and analysis technology of artificial intelligence can be used. For example, the arithmetic circuit in the intelligent information reading device (such as the above-mentioned micro-control unit) is equipped with an artificial intelligence module to perform artificial intelligence calculations (Figure 3, 313), and the core program is designed in advance in the intelligent information reading device. When using artificial intelligence algorithms such as machine learning and deep learning on an external computer in advance, learn the styles of information displayed on general information presentation devices, such as numbers, text, symbols, graphics, color pointers, pointer directions, object classifications, and objects. The shape, object location, and/or object direction, etc. form an artificial intelligence mathematical model, which may be a weight value, a comparison template, etc., which can be used to quickly identify and analyze images and generate related content with relevant corresponding meanings. When these artificial intelligence mathematical models are placed in the artificial intelligence module, the core program can quickly identify and analyze the information included in the image through the calculation of the artificial intelligence mathematical model analyzed in advance through artificial intelligence technology. This approach can quickly identify and analyze the associated content represented by the image in a limited terminal computing environment, so as to achieve Quickly analyze and save power. This method can also work in networked devices and cloud server environments.
之後,在步驟S611中,智能資訊讀取裝置將根據通訊品質傳送經辨識與分析影像後產生的內容,或包括原本影像,或加上電池電量、電池運作資訊、裝置運作狀態、錯誤碼以及/或裝置資訊等的裝置資訊至管理平台系統。完成之後,裝置將重新進入休眠狀態(步驟S613)。 After that, in step S611, the intelligent information reading device will transmit the content generated after the identification and analysis of the image according to the communication quality, or include the original image, or add battery power, battery operation information, device operation status, error code, and/ Or device information such as device information to the management platform system. After completion, the device will enter the sleep state again (step S613).
接著,如圖7所示顯示智能資訊讀取方法的實施例流程圖,此例綜合了上述圖5與圖6的實施例流程。在流程開始前,智能資訊讀取裝置一般是在休眠狀態,僅提供支持待機所需的電力,其中微控制單元將依據定時器的設定定時被喚起,或可由遠距管理平台系統下達指令被喚起。 Next, as shown in FIG. 7, a flowchart of an embodiment of the intelligent information reading method is shown. This example combines the above-mentioned embodiments of FIG. 5 and FIG. 6. Before the start of the process, the intelligent information reading device is generally in a dormant state and only provides the power required to support standby. The micro-control unit will be awakened according to the timer setting, or can be awakened by the remote management platform system. .
流程開始,智能資訊讀取裝置被喚起(步驟S701),並開始取得資訊影像(步驟703),並能選擇性地擷取有興趣區域的影像(步驟S705),再由裝置內處理程序執行影像辨識與分析(步驟S707),影像辨識分析技術可以採用光學文字辨識技術或人工智能技術,之後產生影像與辨識後內容(步驟S709)。 At the beginning of the process, the intelligent information reading device is awakened (step S701), and starts to obtain information images (step 703), and can selectively capture images of the region of interest (step S705), and then execute the image by the processing program in the device Recognition and analysis (step S707), the image recognition and analysis technology can use optical character recognition technology or artificial intelligence technology, and then generate images and recognized content (step S709).
所產生的資訊影像可以根據需求分割(步驟S711),特別是能根據通訊品質決定分割影像的方式,並包括決定傳送的方式,傳送的影像可以為整個資訊呈現裝置面板的影像,或是有興趣區域的影像。接著傳送分割影像以及/或辨識分析後產生具有意義的文字,或加上裝置資訊至管理平台系統(步驟S713),之後裝置重新進入休眠狀態(步驟S715)。 The generated information image can be segmented according to requirements (step S711), in particular, the method of segmenting the image can be determined according to the communication quality, and the transmission method can be determined. The transmitted image can be the image of the entire information presentation device panel, or if you are interested The image of the area. Then send the segmented image and/or identify and analyze to generate meaningful text, or add device information to the management platform system (step S713), and then the device enters the sleep state again (step S715).
根據一實施例,如上述內容,智能資訊讀取裝置的休眠時間可為預定設定值,或可以由管理平台系統通過無線通訊技術傳送設定休眠時間的指令,其中遠距設定智能資訊讀取裝置的參數的技術可以參考圖8所示管理平台系統設定智能資訊讀取裝置的方法實施例流程圖,如此可知,智能資訊讀取裝置可以具備兩種休 眠狀態的設定方法。 According to an embodiment, as described above, the sleep time of the smart information reading device may be a predetermined set value, or the management platform system may transmit a command to set the sleep time through wireless communication technology, wherein the remote setting of the smart information reading device The parameter technology can refer to the flow chart of the embodiment of the method for setting the intelligent information reading device by the management platform system shown in FIG. 8. It can be seen that the intelligent information reading device can have two types of rest. How to set sleep state.
採用管理平台系統的系統架構可以參考圖2的示意圖,管理平台系統用以接收複數個智能資訊讀取裝置傳送的已經辨識分析影像後產生的內容;或是由特定裝置執行影像分析辨識,如上述連網裝置,再將經辨識與分析影像後產生的內容傳送至管理平台系統;另外,或是由管理平台系統接收影像後才由管理平台系統進行影像辨識與分析。 The system architecture of the management platform system can refer to the schematic diagram in Figure 2. The management platform system is used to receive the content generated after the image has been identified and analyzed from a plurality of intelligent information reading devices; or a specific device performs image analysis and identification, as described above The connected device then transmits the content generated after the image is identified and analyzed to the management platform system; in addition, the management platform system performs image identification and analysis only after the image is received by the management platform system.
如圖8顯示流程,由於管理平台系統掌握了所有終端智能資訊讀取裝置的識別資訊與運行狀態,裝置內更設有軟體程序處理來自管理平台系統的指令。此例流程開始如步驟S801,管理平台系統運行一個管理多端智能資訊讀取裝置的管理平台,能針對個別、部分或是全部的智能資訊讀取裝置產生設定參數(步驟S801),可包括設定裝置內人工智能模組的運作參數、電源管理單元的定時參數、影像取得的參數、網路設定等,並建立傳播於網路上的設定封包(步驟S803)。 Figure 8 shows the flow. Since the management platform system has mastered the identification information and operating status of all terminal intelligent information reading devices, there is a software program in the device to process commands from the management platform system. The process of this example starts as step S801. The management platform system runs a management platform that manages multi-terminal intelligent information reading devices, and can generate setting parameters for individual, part or all of the intelligent information reading devices (step S801), which may include setting devices The operating parameters of the internal artificial intelligence module, the timing parameters of the power management unit, the parameters of the image acquisition, the network settings, etc., and the establishment of a configuration packet that is propagated on the network (step S803).
接著,如步驟S805,根據智能資訊讀取裝置的識別資訊、網路位址與傳送路徑,設定封包將通過網路、連網裝置傳送設定封包至智能資訊讀取裝置,並可以透過指令喚醒智能資訊讀取裝置,以能接收設定封包並執行設定(步驟S807)。 Then, in step S805, according to the identification information, network address and transmission path of the intelligent information reading device, the configuration packet will be sent to the intelligent information reading device through the network and connected devices, and the intelligence can be awakened by commands The information reading device can receive the setting packet and execute the setting (step S807).
是以,根據以上描述智能資訊讀取裝置的實施例,這是用於讀取會顯示資訊的各式資訊呈現裝置的智能裝置,本身可以具備影像擷取、影像辨識、分析與通訊能力的裝置,可以將顯示資訊轉換成具有意義的資訊,進而使得遠端管理平台系統可以進行數據收集、產生報表、數據分析,產生傳統一般顯示器無法達到的功效。 Therefore, according to the embodiments of the intelligent information reading device described above, this is an intelligent device used to read various information presentation devices that display information. It is a device capable of image capture, image recognition, analysis, and communication. , Can convert the displayed information into meaningful information, so that the remote management platform system can collect data, generate reports, and analyze data, which can produce effects that cannot be achieved by traditional general displays.
惟以上所述僅為本發明之較佳可行實施例,非因此即侷限本發明之專利範圍,故舉凡運用本發明說明書及圖示內容所為之等效結構變化,均同理包含於本發明之範圍內,合予陳明。 However, the above descriptions are only the preferred and feasible embodiments of the present invention. Therefore, the patent scope of the present invention is not limited. Therefore, all equivalent structural changes made by using the description of the present invention and the contents of the diagrams are included in the present invention in the same way. Within the scope, he Yu Chen Ming.
10‧‧‧網路 10‧‧‧Internet
20‧‧‧管理平台系統 20‧‧‧Management Platform System
210‧‧‧監視器 210‧‧‧Monitor
201‧‧‧連網裝置一 201‧‧‧Connected Device One
211‧‧‧智能資訊讀取裝置 211‧‧‧Intelligent Information Reading Device
212‧‧‧資訊呈現裝置 212‧‧‧Information Presentation Device
202‧‧‧連網裝置二 202‧‧‧Connected Device Two
213‧‧‧智能資訊讀取裝置 213‧‧‧Intelligent Information Reading Device
214‧‧‧資訊呈現裝置 214‧‧‧Information Presentation Device
215‧‧‧智能資訊讀取裝置 215‧‧‧Intelligent Information Reading Device
216‧‧‧資訊呈現裝置 216‧‧‧Information Presentation Device
Claims (4)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW107141051A TWI722338B (en) | 2018-11-19 | 2018-11-19 | Intelligent information reading method, intelligent reader and system thereof |
JP2018247967A JP2020087397A (en) | 2018-11-19 | 2018-12-28 | Method, device and system for reading intelligence information |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW107141051A TWI722338B (en) | 2018-11-19 | 2018-11-19 | Intelligent information reading method, intelligent reader and system thereof |
Publications (2)
Publication Number | Publication Date |
---|---|
TW202020735A TW202020735A (en) | 2020-06-01 |
TWI722338B true TWI722338B (en) | 2021-03-21 |
Family
ID=70908503
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW107141051A TWI722338B (en) | 2018-11-19 | 2018-11-19 | Intelligent information reading method, intelligent reader and system thereof |
Country Status (2)
Country | Link |
---|---|
JP (1) | JP2020087397A (en) |
TW (1) | TWI722338B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116781867A (en) * | 2023-07-08 | 2023-09-19 | 深圳市恺恩科技有限公司 | Method and system for monitoring transmission line in signal-free area |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1421026A (en) * | 1999-12-21 | 2003-05-28 | 布鲁马克斯通讯有限公司 | System and method for wireless automatic meter reading |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002257612A (en) * | 2001-02-27 | 2002-09-11 | Osaka Gas Co Ltd | Remote monitoring device for gas meter and remote meter device for gas meter |
JP2003272076A (en) * | 2002-03-14 | 2003-09-26 | Osaka Gas Co Ltd | Meter inspection method |
JP2012208763A (en) * | 2011-03-30 | 2012-10-25 | Fuji Telecom Kk | Integrated meter reading information system |
SG11201901332TA (en) * | 2016-08-17 | 2019-03-28 | Arnon MAMAN | Meter reading device and system |
JP6452665B2 (en) * | 2016-12-05 | 2019-01-16 | Kddi株式会社 | Flight apparatus and communication method |
JP6707178B2 (en) * | 2017-03-17 | 2020-06-10 | 株式会社Pfu | Image processing device, control method, and control program |
-
2018
- 2018-11-19 TW TW107141051A patent/TWI722338B/en active
- 2018-12-28 JP JP2018247967A patent/JP2020087397A/en active Pending
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1421026A (en) * | 1999-12-21 | 2003-05-28 | 布鲁马克斯通讯有限公司 | System and method for wireless automatic meter reading |
Also Published As
Publication number | Publication date |
---|---|
TW202020735A (en) | 2020-06-01 |
JP2020087397A (en) | 2020-06-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103914992B (en) | A kind of intelligent parking detecting system based on wireless sensor network | |
CN105590336B (en) | Information displaying method and device | |
CN109951363B (en) | Data processing method, device and system | |
CN101832753A (en) | On-line detection system and method of lithium ion battery pole piece CCD | |
CN109686049A (en) | Children fall single based reminding method, device, medium and electronic equipment in public place | |
CN103559781A (en) | Distributive real-time energy consumption monitoring and analyzing system based on camera | |
CN208672025U (en) | A kind of mine geological environment data acquisition device and system based on Internet of Things | |
CN110401927A (en) | A kind of Internet of Things monitoring water environment system based on ZigBee | |
CN107246959B (en) | A kind of diagnostic system and method for the equipment fault based on wireless sensor | |
CN102545098A (en) | Power transmission line inspection system and implementation method thereof | |
CN109555977A (en) | The equipment and recognition methods of leak noise measuring | |
TWI722338B (en) | Intelligent information reading method, intelligent reader and system thereof | |
CN107493377B (en) | Thermotechnical parameter acquisition device and method based on mobile terminal application | |
CN104166416A (en) | Internet-of-things system for controlling indoor light illumination temperature | |
CN108230803A (en) | A kind of internet of things experimental device based on artificial intelligence | |
CN206236178U (en) | Industrial and mining enterprises' intelligent patrol detection management system | |
CN110191281B (en) | Image recognition meter reading terminal and system, image recognition engine server and intelligent meter | |
CN117850306A (en) | Intelligent sensing and control system for Internet of things in intelligent park | |
CN110751055A (en) | Intelligent manufacturing system | |
CN117146385A (en) | Ventilation system and method based on Internet of things | |
CN115100507A (en) | Intelligent identification system and method for air conditioner pipeline pointer instrument in dark environment | |
CN116092113A (en) | Gesture recognition method, gesture recognition device, electronic equipment and computer readable storage medium | |
CN114363123B (en) | Intelligent deformation monitoring gateway, system and method based on digital image correlation technology | |
CN219612038U (en) | Wireless environment data acquisition terminal | |
Wu et al. | Design of an Intelligent Granary Monitoring System |