TWI823204B - Voice interactive internet of things system and method thereof - Google Patents

Voice interactive internet of things system and method thereof Download PDF

Info

Publication number
TWI823204B
TWI823204B TW110145569A TW110145569A TWI823204B TW I823204 B TWI823204 B TW I823204B TW 110145569 A TW110145569 A TW 110145569A TW 110145569 A TW110145569 A TW 110145569A TW I823204 B TWI823204 B TW I823204B
Authority
TW
Taiwan
Prior art keywords
information
voice
iot
controlled
iot device
Prior art date
Application number
TW110145569A
Other languages
Chinese (zh)
Other versions
TW202324187A (en
Inventor
朱瑞琪
廖勝廉
連啟宏
邱仲毅
林逸修
Original Assignee
中華電信股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中華電信股份有限公司 filed Critical 中華電信股份有限公司
Priority to TW110145569A priority Critical patent/TWI823204B/en
Publication of TW202324187A publication Critical patent/TW202324187A/en
Application granted granted Critical
Publication of TWI823204B publication Critical patent/TWI823204B/en

Links

Images

Abstract

A voice interactive Internet of Things system and method thereof, which is applied to a telecommunication network and a plurality IoT devices, including a transceiver, a storage media and a processor. The storage media stores an IoT control module, a voice conversion module and a setting module. The transceiver receives an user’s first and second voice signals via the telecommunication network. The IoT control module receives device information and operable item information of the IoT device. The voice conversion module converts the device information and operable item information of the IoT device into voice information. The setting module sets the IoT device to be controlled and the operable items according to the voice information and the user’s first voice signal, and the IoT control module controls the IoT device to be controlled according to the user’s second voice signal and the corresponding voice signal of the IoT device to be controlled.

Description

語音互動物聯網的系統及其方法 System and method for voice interactive Internet of Things

本發明是有關於物聯網技術，且特別是有關於一種語音互動物聯網的系統及其方法。 The present invention relates to Internet of Things technology, and in particular, to a system and method for voice interactive Internet of Things.

目前絕大多數的物聯網(Internet of Things，IoT)服務都是基於網際網路，需直接連線網際網路，經由網際網路再控制IoT裝置，通常易受網路攻擊，安全性較差。 Currently, the vast majority of Internet of Things (IoT) services are based on the Internet. They need to be connected directly to the Internet and then control IoT devices through the Internet. They are usually vulnerable to network attacks and have poor security.

即使是用電話撥入的方式控制IoT裝置，仍須中央伺服器服務或IoT裝置需支援窄頻物聯網(Narrowband Internet of Things，NB-IoT)模組，並且在初始化設定IoT服務的過程需經由網頁或是App進行操作，上手門檻較高、操作較複雜。 Even if you use a phone call to control the IoT device, you still need a central server service or the IoT device needs to support the Narrowband Internet of Things (NB-IoT) module, and the process of initializing the IoT service needs to go through To operate on the web or App, the threshold to get started is high and the operation is complicated.

本發明提供一種語音互動物聯網(Internet of Things，IoT)的系統，安全性較佳，讓使用者快速且簡易的達成個人化控制IoT裝置。 The present invention provides a voice interactive Internet of Things (IoT) system, which has better security and allows users to quickly and easily achieve personalized control of IoT devices.

本發明的一種語音互動物聯網(Internet of Things，IoT)的系統，其應用於電信網路及多個IoT裝置中，包括收發器、儲存媒體以及處理器。儲存媒體儲存多個模組。處理器耦接儲存媒體和收發器，並且存取和執行該些模組。其中該些模組包括IoT控制模組、語音轉換模組以及設定模組。其中，收發器經電信網路接收使用者的第一語音訊號以及第二語音訊號。IoT控制模組與該些IoT裝置通訊連接，以接收該些IoT裝置的裝置資訊及可操作項目資訊。語音轉換模組將經由IoT控制模組傳送的該些IoT裝置的裝置資訊及可操作項目資訊轉換為多個語音資訊並儲存於儲存媒體。設定模組依據該些語音資訊以及使用者的第一語音訊號設定待管控的IoT裝置及可操作項目並且獲取待管控的IoT裝置的裝置資訊及可操作項目資訊，待管控的IoT裝置的裝置資訊及可操作項目資訊經由語音轉換模組轉換為對應待管控的IoT裝置的語音資訊並儲存於儲存媒體，將使用者的第二語音訊號以及對應待管控的IoT裝置的語音資訊經由語音轉換模組轉換為待管控的IoT裝置的裝置資訊及可操作項目資訊，並且經由該IoT控制模組依據該待管控的IoT裝置的裝置資訊及可操作項目資訊來控制待管控的IoT裝置執行操作項目。 The present invention is a voice interactive Internet of Things (IoT) system, which is used in telecommunications networks and multiple IoT devices, including a transceiver, a storage medium and a processor. Storage media stores multiple modules. The processor couples the storage medium and the transceiver and accesses and executes the modules. These modules include IoT control modules, voice conversion modules and setting modules. Wherein, the transceiver receives the first voice signal and the second voice signal of the user through the telecommunications network. The IoT control module communicates with the IoT devices to receive device information and operable item information of the IoT devices. The voice conversion module converts the device information and operable item information of the IoT devices transmitted through the IoT control module into a plurality of voice information and stores them in the storage medium. The setting module sets the IoT device and operable items to be controlled based on the voice information and the user's first voice signal, and obtains the device information and operable item information of the IoT device to be controlled, and the device information of the IoT device to be controlled. And the operable item information is converted into voice information corresponding to the IoT device to be controlled through the voice conversion module and stored in the storage medium, and the user's second voice signal and the voice information corresponding to the IoT device to be controlled are converted through the voice conversion module Convert to the device information and operable item information of the IoT device to be controlled, and control the IoT device to be controlled to execute the operation item according to the device information and operable item information of the IoT device to be controlled through the IoT control module.

在本發明的一實施例中，上述的語音互動物聯網的系統，其中儲存媒體更用以儲存來電號碼資訊以及待管控的IoT裝置的裝置資訊及可操作項目資訊。 In an embodiment of the present invention, in the above-mentioned voice interactive IoT system, the storage medium is further used to store caller number information, device information and operable item information of the IoT device to be controlled.

在本發明的一實施例中，上述的語音互動物聯網的系 統，其中該些模組更包括認證模組，依據收發器接收的使用者的來電號碼資訊與來電號碼資訊進行比對驗證。 In an embodiment of the present invention, the above-mentioned voice interactive Internet of Things system System, these modules also include authentication modules, which compare and verify the user's caller number information received by the transceiver with the caller number information.

在本發明的一實施例中，上述的語音互動物聯網的系統，其中語音互動物聯網的系統經電信網路與電話裝置通訊連接，且語音互動物聯網的系統經由區域網路與該些IoT裝置通訊連接。 In an embodiment of the present invention, the above-mentioned voice interactive IoT system is communicatively connected to the telephone device via a telecommunications network, and the voice interactive IoT system is connected to the IoT via a local area network. Device communication connection.

在本發明的一實施例中，上述的語音互動物聯網的系統，其中語音轉換模組為採用自然語言處理(Natural Language Processing，NLP)技術將該些IoT裝置的裝置資訊及可操作項目資訊轉換為該些語音資訊，並且採用NLP技術將待管控的IoT裝置的裝置資訊及可操作項目資訊轉換為對應待管控的IoT裝置的語音資訊。 In an embodiment of the present invention, in the above-mentioned voice interactive IoT system, the voice conversion module uses natural language processing (NLP) technology to convert the device information and operable item information of the IoT devices. For these voice information, NLP technology is used to convert the device information and operable item information of the IoT device to be controlled into voice information corresponding to the IoT device to be controlled.

本發明的一種語音互動物聯網(Internet of Things，IoT)的方法，其應用於電信網路及多個IoT裝置中，包括：經電信網路接收使用者的第一語音訊號以及第二語音訊號；接收該些IoT裝置的裝置資訊及可操作項目資訊；將該些IoT裝置的裝置資訊及可操作項目資訊轉換為多個語音資訊並儲存於儲存媒體；依據該些語音資訊以及使用者的第一語音訊號設定待管控的IoT裝置及可操作項目並且獲取待管控的IoT裝置的裝置資訊及可操作項目資訊；將待管控的IoT裝置的裝置資訊及可操作項目資訊轉換為對應待管控的IoT裝置的語音資訊並儲存；將使用者的第二語音訊號以及對應待管控的IoT裝置的語音資訊轉換為待管控的IoT 裝置的裝置資訊及可操作項目資訊；以及依據使用者的第二語音訊號以及對應待管控的IoT裝置的語音資訊來控制待管控的IoT裝置執行操作項目。 A voice interaction method of the Internet of Things (IoT) of the present invention is applied to a telecommunications network and multiple IoT devices, including: receiving a user's first voice signal and a second voice signal through the telecommunications network. ; Receive the device information and operable item information of these IoT devices; convert the device information and operable item information of these IoT devices into multiple voice information and store it in the storage medium; based on the voice information and the user's third A voice signal sets the IoT device and operable items to be controlled and obtains the device information and operable item information of the IoT device to be controlled; converts the device information and operable item information of the IoT device to be controlled into the corresponding IoT to be controlled and store the voice information of the device; convert the user's second voice signal and the voice information corresponding to the IoT device to be controlled into the IoT to be controlled The device information and operable item information of the device; and controlling the IoT device to be controlled to execute the operation items based on the user's second voice signal and the voice information corresponding to the IoT device to be controlled.

在本發明的一實施例中，上述的語音互動物聯網的方法，其中該方法更包括儲存來電號碼資訊以及待管控的IoT裝置的裝置資訊及可操作項目資訊。 In an embodiment of the present invention, the above-mentioned voice interaction method for the Internet of Things further includes storing caller number information, device information and operable item information of the IoT device to be controlled.

在本發明的一實施例中，上述的語音互動物聯網的方法，其中該方法更包括依據使用者的來電號碼資訊與儲存的來電號碼資訊進行比對驗證。 In an embodiment of the present invention, the above-mentioned voice interaction method for the Internet of Things further includes performing comparison and verification based on the user's caller number information and the stored caller number information.

在本發明的一實施例中，上述的語音互動物聯網的方法，其中將該些IoT裝置的裝置資訊及可操作項目資訊轉換為該些語音資訊的步驟中更包括：採用自然語言處理(Natural Language Processing，NLP)技術將該些IoT裝置的裝置資訊及可操作項目資訊轉換為該些語音資訊。 In an embodiment of the present invention, in the above-mentioned voice interaction method for the Internet of Things, the step of converting device information and operable item information of the IoT devices into the voice information further includes: using natural language processing (Natural Language Processing). Language Processing (NLP) technology converts the device information and operable item information of the IoT devices into the voice information.

在本發明的一實施例中，上述的語音互動物聯網的方法，其中將待管控的IoT裝置的裝置資訊及可操作項目資訊轉換為對應待管控的IoT裝置的語音資訊並儲存的步驟中更包括：採用自然語言處理(Natural Language Processing，NLP)技術將待管控的IoT裝置的裝置資訊及可操作項目資訊轉換為對應待管控的IoT裝置的語音資訊並儲存。 In an embodiment of the present invention, in the above-mentioned voice interaction method for the Internet of Things, the step of converting the device information and operable item information of the IoT device to be controlled into voice information corresponding to the IoT device to be controlled and storing the information is more Including: using natural language processing (NLP) technology to convert the device information and operable item information of the IoT device to be controlled into voice information corresponding to the IoT device to be controlled and store it.

基於上述，本發明的語音互動物聯網的系統及其方法，僅需連線區域網路及電信網路，不用直接連線網際網路，安全性 較佳，且使用語音互動操作即可初始化設定到管控IoT裝置，讓使用者快速且簡易的達成個人化控制IoT裝置。 Based on the above, the system and method of the voice interactive Internet of Things of the present invention only need to connect to the local network and telecommunications network, without directly connecting to the Internet, and are safe. Better, and the settings can be initialized to the managed IoT device using voice interactive operations, allowing users to quickly and easily achieve personalized control of IoT devices.

10:語音互動物聯網的系統 10: Voice interactive IoT system

110:收發器 110:Transceiver

120:儲存裝置 120:Storage device

130:處理器 130: Processor

20:電話裝置 20: Telephone device

30:IoT裝置 30:IoT device

40:電信網路 40:Telecom network

50:區域網路 50:Local area network

1201:認證模組 1201: Authentication module

1202:IoT控制模組 1202:IoT control module

1203語音轉換模組 1203 voice conversion module

1204:設定模組 1204: Setting module

S201、S202、S203、S204、S205:步驟 S201, S202, S203, S204, S205: steps

圖1是依照本發明的一實施例的一種語音互動物聯網的系統的示意圖。 Figure 1 is a schematic diagram of a voice interactive Internet of Things system according to an embodiment of the present invention.

圖2是依照本發明的一實施例的一種語音互動物聯網的方法的示意圖。 Figure 2 is a schematic diagram of a voice interaction method for the Internet of Things according to an embodiment of the present invention.

本發明的部份實施例接下來將會配合附圖來詳細描述，以下的描述所引用的元件符號，當不同附圖出現相同的元件符號將視為相同或相似的元件。這些實施例只是本發明的一部份，並未揭示所有本發明的可實施方式。更確切的說，這些實施例只是本發明的專利申請範圍中的方法、電子裝置以及電腦可讀取儲存媒體的範例。 Some embodiments of the present invention will be described in detail with reference to the accompanying drawings. The component symbols cited in the following description will be regarded as the same or similar components when the same component symbols appear in different drawings. These embodiments are only part of the present invention and do not disclose all possible implementations of the present invention. Rather, these embodiments are only examples of methods, electronic devices, and computer-readable storage media within the scope of the patent application of the present invention.

圖1是依照本發明的一實施例的一種語音互動物聯網的系統的示意圖。 Figure 1 is a schematic diagram of a voice interactive Internet of Things system according to an embodiment of the present invention.

請參照圖1，語音互動物聯網的系統10包括收發器110、儲存裝置120以及處理器130。語音互動物聯網的系統10適用於於電信網路40中，經電信網路40與電話裝置20通訊連接，且語 音互動物聯網的系統10經由區域網路50與IoT裝置30通訊連接。電話裝置20可以是市話、行動電話裝置或VoIP電話，本發明對此並不限制。在一實施例中，市話及行動電話裝置會直接與電信網路40通訊連接，而VoIP電話會經由區域網路與電信網路40通訊連接，且此區域網路與區域網路50屬於不同的網段，從而電話裝置20與語音互動物聯網的系統10通訊連接。 Referring to FIG. 1 , a voice interactive Internet of Things system 10 includes a transceiver 110 , a storage device 120 and a processor 130 . The system 10 of the voice interactive Internet of Things is suitable for use in the telecommunications network 40, and communicates with the telephone device 20 through the telecommunications network 40, and the voice interaction system 10 is applicable to the telecommunications network 40. The system 10 of the audio interactive Internet of Things is communicatively connected with the IoT device 30 via the local area network 50 . The telephone device 20 may be a local phone, a mobile phone device or a VoIP phone, and the present invention is not limited thereto. In one embodiment, the local phone and mobile phone devices will be directly connected to the telecommunications network 40, and the VoIP phone will be connected to the telecommunications network 40 through a local area network, and this local area network and the local area network 50 belong to different network segment, so that the telephone device 20 communicates with the system 10 of the voice interactive Internet of Things.

收發器110以無線或有線的方式傳送及接收訊號。收發器110還可以執行例如低噪聲放大、阻抗匹配、混頻、向上或向下頻率轉換、濾波、放大以及類似的操作。 The transceiver 110 transmits and receives signals in a wireless or wired manner. Transceiver 110 may also perform, for example, low noise amplification, impedance matching, mixing, up or down frequency conversion, filtering, amplification, and similar operations.

儲存媒體120例如是任何型態的固定式或可移動式的隨機存取記憶體(random access memory，RAM)、唯讀記憶體(read-only memory，ROM)、快閃記憶體(flash memory)、硬碟(hard disk drive，HDD)、固態硬碟(solid state drive，SSD)或類似元件或上述元件的組合，儲存裝置102用以記錄可由處理器130執行的多個指令，更用於儲存可由處理器130執行的多個模組或各種應用程式。在本實施例中，儲存媒體120可儲存包括語音轉換模組、語意識別模組、頻道資訊介接模型、時間矩陣權重排程模組以及頻道切換模組等多個模組，其功能將於後續說明。在本實施例中，儲存媒體120可儲存包括認證模組1201、IoT控制模組1202、語音轉換模組1203以及設定模組1204等多個模組，其功能將於後續說明。在一實施例中，儲存媒體120更用以儲存使用者為合法名單內的來電號碼資訊以及待管控的IoT裝置的裝 置資訊及可操作項目資訊。 The storage medium 120 is, for example, any type of fixed or removable random access memory (RAM), read-only memory (ROM), or flash memory. , hard disk drive (HDD), solid state drive (SSD) or similar components or a combination of the above components, the storage device 102 is used to record multiple instructions that can be executed by the processor 130, and is also used to store Multiple modules or various applications that can be executed by the processor 130 . In this embodiment, the storage medium 120 can store multiple modules including a speech conversion module, a semantic recognition module, a channel information interface model, a time matrix weight scheduling module, and a channel switching module, and their functions will be Explained later. In this embodiment, the storage medium 120 can store multiple modules including an authentication module 1201, an IoT control module 1202, a voice conversion module 1203, and a setting module 1204, the functions of which will be described later. In one embodiment, the storage medium 120 is further used to store the caller number information of the user in the legal list and the device of the IoT device to be controlled. configuration information and operable item information.

處理器130例如是中央處理單元(central processing unit，CPU)，或是其他可程式化之一般用途或特殊用途的微控制單元(micro control unit，MCU)、微處理器(microprocessor)、數位信號處理器(digital signal processor，DSP)、可程式化控制器、特殊應用積體電路(application specific integrated circuit，ASIC)、圖形處理器(graphics processing unit，GPU)、算數邏輯單元(arithmetic logic unit，ALU)、複雜可程式邏輯裝置(complex programmable logic device，CPLD)、現場可程式化邏輯閘陣列(field programmable gate array，FPGA)或其他類似元件或上述元件的組合。處理器130可耦接至儲存媒體120以及收發器110，並且存取和執行儲存於儲存媒體120中的多個模組和各種應用程式，以控制語音互動物聯網的系統10的整體運作。 The processor 130 is, for example, a central processing unit (CPU), or other programmable general-purpose or special-purpose micro control unit (MCU), microprocessor, or digital signal processing unit. Digital signal processor (DSP), programmable controller, application specific integrated circuit (ASIC), graphics processing unit (GPU), arithmetic logic unit (ALU) , complex programmable logic device (CPLD), field programmable gate array (FPGA) or other similar components or a combination of the above components. The processor 130 can be coupled to the storage medium 120 and the transceiver 110, and access and execute multiple modules and various applications stored in the storage medium 120 to control the overall operation of the voice interactive Internet of Things system 10.

認證模組1201依據收發器110接收的使用者的來電號碼資訊與儲存於儲存媒體120內的使用者為合法名單內的來電號碼資訊進行比對驗證，以確認來電號碼的使用者是否在合法名單內。若來電號碼的使用者不在合法名單內，則語音互動物聯網的系統10拒接或切斷電話裝置20的來電。 The authentication module 1201 compares and verifies the user's caller number information received by the transceiver 110 with the caller number information stored in the storage medium 120 as a legitimate list of users to confirm whether the user of the caller number is on the legitimate list. within. If the user of the incoming call number is not in the legal list, the voice interactive Internet of Things system 10 rejects or cuts off the incoming call from the telephone device 20 .

若來電號碼的使用者在合法名單內，則IoT控制模組1202與IoT裝置30通訊連接，以接收IoT裝置30的裝置資訊及可操作項目資訊。其中，IoT控制模組1202對區域網路50內的IoT裝置30進行掃描，以對所有可連到的IoT裝置30發出連線需求指 令，IoT裝置30收到連線需求指令後，與語音互動物聯網的系統10執行驗證，並且回傳IoT裝置30的裝置資訊及可操作項目資訊至IoT控制模組1202，從而IoT控制模組1202通過區域網路50控制IoT裝置30。在一實施例中，IoT裝置30的裝置資訊可以是IoT裝置30的裝置名稱、標籤或裝置識別碼，而標籤裡可能包含開關(True、False)或是一段區間數值(0~Max)，或是其他預先定義的裝置的規格。可操作項目資訊可包括打開、關閉、回上一層等IoT裝置30等各種操作選項。 If the user of the calling number is in the legal list, the IoT control module 1202 communicates with the IoT device 30 to receive the device information and operable item information of the IoT device 30 . Among them, the IoT control module 1202 scans the IoT devices 30 in the local network 50 to issue connection requirement instructions to all connectable IoT devices 30 . After receiving the connection request command, the IoT device 30 performs verification with the voice interaction IoT system 10 and returns the device information and operable item information of the IoT device 30 to the IoT control module 1202, so that the IoT control module 1202 controls the IoT device 30 through the local area network 50 . In one embodiment, the device information of the IoT device 30 may be the device name, label or device identification code of the IoT device 30, and the label may include a switch (True, False) or a range value (0~Max), or are other predefined device specifications. The operable item information may include various operation options for the IoT device 30 such as opening, closing, and returning to the previous level.

語音轉換模組1203，將經由IoT控制模組1202傳送的IoT裝置30的裝置資訊及可操作項目資訊轉換為多個語音資訊。 The voice conversion module 1203 converts the device information and operable item information of the IoT device 30 transmitted through the IoT control module 1202 into a plurality of voice information.

設定模組1204，依據語音資訊以及使用者的第一語音訊號設定待管控的IoT裝置30及可操作項目，將待管控的IoT裝置30的裝置資訊及可操作項目資訊經由語音轉換模組1203轉換為對應待管控的IoT裝置30的語音資訊並儲存於儲存媒體120，並且經由IoT控制模組1202依據使用者的第二語音訊號以及儲存於儲存媒體120的對應待管控的IoT裝置30的語音資訊來控制待管控的IoT裝置30執行操作項目。 The setting module 1204 sets the IoT device 30 to be controlled and the operable items according to the voice information and the user's first voice signal, and converts the device information and operable item information of the IoT device 30 to be controlled through the voice conversion module 1203 The voice information corresponding to the IoT device 30 to be controlled is stored in the storage medium 120, and the IoT control module 1202 is based on the user's second voice signal and the voice information corresponding to the IoT device 30 to be controlled and stored in the storage medium 120. To control the IoT device 30 to be managed to execute the operation item.

更具體而言，語音轉換模組1203為採用自然語言處理(Natural Language Processing，NLP)技術將IoT裝置30的裝置資訊及可操作項目資訊轉換為語音資訊，並且採用NLP技術將待管控的IoT裝置30的裝置資訊及可操作項目資訊轉換為對應待管控的IoT裝置30的語音資訊。並且，上述語音資訊儲存於儲存媒 體120內。 More specifically, the voice conversion module 1203 uses natural language processing (NLP) technology to convert device information and operable item information of the IoT device 30 into voice information, and uses NLP technology to convert the IoT device to be controlled The device information and operable item information of 30 are converted into voice information corresponding to the IoT device 30 to be controlled. Moreover, the above voice information is stored in the storage medium Within body 120.

在一實施例中，在驗證來電號碼的使用者在合法名單內之後，語音互動物聯網的系統10播放IoT裝置30的語音資訊，使用者說出要管控的IoT裝置30(即第一語音訊號)，則語音互動物聯網的系統10依據語音資訊以及使用者的第一語音訊號設定待管控的IoT裝置30及可操作項目，將待管控的IoT裝置30的裝置資訊及可操作項目資訊經由語音轉換模組1203轉換為對應待管控的IoT裝置30的語音資訊，其中，待管控的IoT裝置30可以是1鐵捲門，2冷氣等待管控的IoT裝置選項，可操作項目可以是1打開，2關閉等可操作項目選項，並且將對應待管控的IoT裝置30的語音資訊儲存至儲存媒體120內，以完成使用者初始化設定IoT裝置流程。 In one embodiment, after verifying that the user of the calling number is on the legal list, the voice interactive IoT system 10 plays the voice information of the IoT device 30, and the user speaks the IoT device 30 to be controlled (i.e., the first voice signal ), the system 10 of the voice interactive Internet of Things sets the IoT device 30 to be controlled and the operable items based on the voice information and the user's first voice signal, and uses the device information and operable items of the IoT device 30 to be controlled via voice. The conversion module 1203 converts the voice information corresponding to the IoT device 30 to be managed, where the IoT device 30 to be managed can be 1 iron rolling door, 2 air conditioner waiting to be controlled IoT device options, and the operable items can be 1 open, 2 Close other operable item options, and store the voice information corresponding to the IoT device 30 to be controlled in the storage medium 120 to complete the user initialization and setting of the IoT device process.

在一實施例中，在使用者初始化設定IoT裝置流程之後，使用者利用市話或行動電話經由電信網路40撥打電話至語音互動物聯網的系統10，在驗證來電號碼的使用者在合法名單內之後，語音互動物聯網的系統10播放已設定好的待管控的IoT裝置30的語音資訊，例如：1鐵捲門2冷氣等待管控的IoT裝置選項，使用者說出想要待管控的IoT裝置選項(即第二語音訊號)，例如："1"或"鐵捲門"，語音轉換模組1203將例如"1"或"鐵捲門"的語音訊號轉換為待管控的IoT裝置30的裝置資訊，並且語音互動物聯網的系統10播放待管控的IoT裝置30的可操作項目選項的語音資訊，例如：1打開，2關閉等可操作項目選項，使用者說出想要的可操作 項目選項(即第二語音訊號)，例如：“1”或“打開”，語音轉換模組1203將使用者說出的動作“1”或"打開"轉換為待管控的IoT裝置30的可操作項目資訊，從而IoT控制模組1202經由區域網路50來控制待管控的IoT裝置30，以執行對應的操作指令，例如打開鐵捲門指令。 In one embodiment, after the user initializes the IoT device setting process, the user uses a local phone or mobile phone to make a call to the voice interactive IoT system 10 through the telecommunications network 40, and then verifies that the user with the calling number is on the legal list. After that, the voice interactive IoT system 10 plays the set voice information of the IoT devices 30 to be controlled, for example: 1 iron rolling door 2 air conditioners waiting to be controlled IoT device options, the user says the IoT devices they want to be controlled. The device option (i.e., the second voice signal), for example: "1" or "Iron rolling door", the voice conversion module 1203 converts the voice signal such as "1" or "Iron rolling door" into the IoT device 30 to be controlled. device information, and the voice interactive IoT system 10 plays the voice information of the operable item options of the IoT device 30 to be controlled, such as: 1 open, 2 close and other operable item options, and the user speaks the desired operable Item option (i.e. second voice signal), for example: "1" or "open", the voice conversion module 1203 converts the action "1" or "open" spoken by the user into an operable operation of the IoT device 30 to be controlled Project information, so that the IoT control module 1202 controls the IoT device 30 to be controlled through the local network 50 to execute corresponding operation instructions, such as opening an iron rolling door instruction.

在另一實施例中，語音互動物聯網的系統10可對同一個IoT裝置30執行操作指令或是回到上一層可再對其他的IoT裝置30執行操作指令，以此滿足使用者對IoT裝置30不同的操作需求。 In another embodiment, the voice interactive IoT system 10 can execute operating instructions on the same IoT device 30 or return to the previous layer and execute operating instructions on other IoT devices 30 to satisfy the user's requirements for the IoT devices. 30 different operational needs.

再請參考圖2。圖2是依照本發明的一實施例的一種語音互動物聯網的方法的示意圖。 Please refer to Figure 2 again. Figure 2 is a schematic diagram of a voice interaction method for the Internet of Things according to an embodiment of the present invention.

在步驟S201中，認證模組1201依據收發器110接收的使用者的來電號碼資訊與儲存於儲存媒體的來電號碼資訊進行比對驗證，以確認來電號碼的使用者是否在合法名單內。 In step S201, the authentication module 1201 performs comparison verification based on the user's caller number information received by the transceiver 110 and the caller number information stored in the storage medium to confirm whether the user of the caller number is in the legal list.

在步驟S209中，若確認來電號碼的使用者不在合法名單內，則結束。 In step S209, if it is confirmed that the user of the incoming call number is not in the legal list, the process ends.

在步驟S202中，若確認來電號碼的使用者在合法名單內，收發器110經電信網路40接收使用者的第一語音訊號。 In step S202, if it is confirmed that the user of the calling number is in the legal list, the transceiver 110 receives the user's first voice signal through the telecommunications network 40.

在步驟S203中，IoT控制模組1202接收IoT裝置30的裝置資訊及可操作項目資訊。 In step S203, the IoT control module 1202 receives the device information and operable item information of the IoT device 30.

在步驟S204中，語音轉換模組1203將經由IoT控制模組1202傳送的IoT裝置30的裝置資訊及可操作項目資訊轉換為多個語音資訊。 In step S204, the voice conversion module 1203 converts the device information and operable item information of the IoT device 30 transmitted via the IoT control module 1202 into a plurality of voice information.

在步驟S205中，設定模組1204依據語音資訊以及使用者的第一語音訊號設定待管控的IoT裝置30及可操作項目並且獲取待管控的IoT裝置30的裝置資訊及可操作項目資訊。 In step S205, the setting module 1204 sets the IoT device 30 to be controlled and the operable items according to the voice information and the user's first voice signal, and obtains the device information and operable item information of the IoT device 30 to be controlled.

在步驟S206中，語音轉換模組1203將待管控的IoT裝置30的裝置資訊及可操作項目資訊轉換為對應待管控的IoT裝置30的語音資訊。 In step S206, the voice conversion module 1203 converts the device information and operable item information of the IoT device 30 to be managed into voice information corresponding to the IoT device 30 to be managed.

在步驟S207中，收發器110經電信網路40接收使用者的第二語音訊號，語音轉換模組1203將使用者的第二語音訊號以及對應待管控的IoT裝置30的語音資訊轉換為待管控的IoT裝置30的裝置資訊及可操作項目資訊。 In step S207, the transceiver 110 receives the user's second voice signal through the telecommunications network 40, and the voice conversion module 1203 converts the user's second voice signal and the voice information corresponding to the IoT device 30 to be controlled into the voice information to be controlled. The device information and operable item information of the IoT device 30.

在步驟S208中，IoT控制模組1202依據使用者的第二語音訊號以及對應待管控的IoT裝置30的語音資訊來控制待管控的IoT裝置30執行操作項目。 In step S208, the IoT control module 1202 controls the IoT device 30 to be managed to execute the operation item based on the user's second voice signal and the voice information corresponding to the IoT device 30 to be managed.

在一實施例中，語音互動物聯網的方法更包括：儲存來電號碼資訊、待管控的IoT裝置30的裝置資訊及可操作項目資訊以及上述語音資訊。 In one embodiment, the voice interaction method of the Internet of Things further includes: storing caller number information, device information and operable item information of the IoT device 30 to be controlled, and the above-mentioned voice information.

本發明的語音互動物聯網的系統及其方法，僅需連線區域網路及電信網路，不用直接連線網際網路，安全性較佳，且使用語音互動操作即可初始化設定到管控IoT裝置，讓使用者快速且簡易的達成個人化控制IoT裝置。 The system and method of the voice interactive Internet of Things of the present invention only need to connect the local network and the telecommunications network, without directly connecting to the Internet, and have better security, and can be initialized and set to manage and control the IoT using voice interactive operations. device, allowing users to quickly and easily achieve personalized control of IoT devices.

10:語音互動物聯網的系統 10: Voice interactive IoT system

110:收發器 110:Transceiver

120:儲存裝置 120:Storage device

130:處理器 130: Processor

20:電話裝置 20: Telephone device

30:IoT裝置 30:IoT device

40:電信網路 40:Telecom network

50:區域網路 50:Local area network

1201:認證模組 1201: Authentication module

1202:IoT控制模組 1202:IoT control module

1203:語音轉換模組 1203: Voice conversion module

1204:設定模組 1204: Setting module

Claims (10)

一種語音互動物聯網(Internet of Things，IoT)的系統，其應用於電信網路及多個IoT裝置中，包括：收發器，經該電信網路接收使用者的第一語音訊號以及第二語音訊號；儲存媒體，儲存多個模組；以及處理器，耦接該儲存媒體和該收發器，並且存取和執行該些模組，其中該些模組包括：IoT控制模組，與該些IoT裝置通訊連接，以接收該些IoT裝置的裝置資訊及可操作項目資訊；語音轉換模組，將經由該IoT控制模組傳送的該些IoT裝置的裝置資訊及可操作項目資訊轉換為多個語音資訊並儲存於該儲存媒體；以及設定模組，依據該些語音資訊以及該使用者的第一語音訊號設定待管控的IoT裝置及可操作項目，以完成該使用者初始化設定該IoT裝置的該可操作項目，並且獲取該待管控的IoT裝置的裝置資訊及可操作項目資訊，其中，該語音轉換模組將該待管控的IoT裝置的裝置資訊及可操作項目資訊轉換為對應該待管控的IoT裝置的語音資訊並儲存於該儲存媒體，並且該語音轉換模組將該使用者的第二語音訊號以及對應該待管控的IoT裝置的語音資訊轉換為該待管控的IoT裝置的裝置資訊及可操作項目資訊， 其中，該IoT控制模組依據該使用者的第二語音訊號以及對應該待管控的IoT裝置的語音資訊來控制該待管控的IoT裝置執行該可操作項目，其中該語音轉換模組為採用自然語言處理(Natural Language Processing，NLP)技術將該些IoT裝置的裝置資訊及可操作項目資訊轉換為該些語音資訊。 A voice interactive Internet of Things (IoT) system, which is used in a telecommunications network and multiple IoT devices, including: a transceiver that receives the user's first voice signal and second voice through the telecommunications network signals; a storage medium that stores a plurality of modules; and a processor that couples the storage medium and the transceiver, and accesses and executes the modules, where the modules include: IoT control modules, and the The IoT device communication connection is to receive the device information and operable item information of the IoT devices; the voice conversion module converts the device information and operable item information of the IoT devices sent through the IoT control module into multiple The voice information is stored in the storage medium; and the setting module sets the IoT device to be controlled and the operable items based on the voice information and the user's first voice signal to complete the user's initialization of the IoT device. The operable item is obtained, and the device information and operable item information of the IoT device to be controlled are obtained, wherein the voice conversion module converts the device information and operable item information of the IoT device to be controlled into the corresponding information of the IoT device to be controlled. The voice information of the IoT device is stored in the storage medium, and the voice conversion module converts the user's second voice signal and the voice information corresponding to the IoT device to be controlled into the device information of the IoT device to be controlled. and actionable project information, Among them, the IoT control module controls the IoT device to be controlled to execute the operable item based on the user's second voice signal and the voice information corresponding to the IoT device to be controlled, wherein the voice conversion module uses natural Natural Language Processing (NLP) technology converts the device information and operable item information of the IoT devices into the voice information. 如請求項1所述的語音互動物聯網的系統，其中該儲存媒體更用以儲存來電號碼資訊以及該待管控的IoT裝置的裝置資訊及可操作項目資訊。 The system of voice interactive Internet of Things as described in claim 1, wherein the storage medium is further used to store caller number information, device information and operable item information of the IoT device to be controlled. 如請求項2所述的語音互動物聯網的系統，其中該些模組更包括：認證模組，依據該收發器接收的使用者的來電號碼資訊與該來電號碼資訊進行比對驗證。 As for the voice interactive Internet of Things system described in claim 2, the modules further include: an authentication module, which performs comparison and verification based on the user's caller number information received by the transceiver and the caller number information. 如請求項1所述的語音互動物聯網的系統，其中該語音互動物聯網的系統經該電信網路與電話裝置通訊連接，且該語音互動物聯網的系統經由區域網路與該些IoT裝置通訊連接。 The system of voice interactive Internet of Things as described in claim 1, wherein the system of voice interactive Internet of Things is communicatively connected to the telephone device through the telecommunications network, and the system of voice interactive Internet of Things is connected to the IoT devices through the local area network. Communication connection. 如請求項1所述的語音互動物聯網的系統，其中該語音轉換模組採用該NLP技術將該待管控的IoT裝置的裝置資訊及可操作項目資訊轉換為對應該待管控的IoT裝置的語音資訊。 The system of voice interactive Internet of Things as described in claim 1, wherein the voice conversion module uses the NLP technology to convert the device information and operable item information of the IoT device to be controlled into the voice corresponding to the IoT device to be controlled. information. 一種語音互動物聯網(Internet of Things，IoT)的方法，其應用於電信網路及多個IoT裝置中，包括：經該電信網路接收使用者的第一語音訊號以及第二語音訊號； 接收該些IoT裝置的裝置資訊及可操作項目資訊；將該些IoT裝置的裝置資訊及可操作項目資訊轉換為多個語音資訊並儲存於該儲存媒體；依據該些語音資訊以及該使用者的第一語音訊號設定待管控的IoT裝置及可操作項目，以完成該使用者初始化設定該IoT裝置的該可操作項目，並且獲取該待管控的IoT裝置的裝置資訊及可操作項目資訊；將該待管控的IoT裝置的裝置資訊及可操作項目資訊轉換為對應該待管控的IoT裝置的語音資訊並儲存；將該使用者的第二語音訊號以及對應該待管控的IoT裝置的語音資訊轉換為該待管控的IoT裝置的裝置資訊及可操作項目資訊；以及依據該使用者的第二語音訊號以及對應該待管控的IoT裝置的語音資訊來控制該待管控的IoT裝置執行該可操作項目，其中該將該些IoT裝置的裝置資訊及可操作項目資訊轉換為該些語音資訊的步驟中更包括：採用自然語言處理(Natural Language Processing，NLP)技術將該些IoT裝置的裝置資訊及可操作項目資訊轉換為該些語音資訊。 A voice interactive Internet of Things (IoT) method, which is applied to a telecommunications network and multiple IoT devices, including: receiving a user's first voice signal and a second voice signal through the telecommunications network; Receive the device information and operable item information of these IoT devices; convert the device information and operable item information of these IoT devices into a plurality of voice information and store it in the storage medium; based on the voice information and the user's The first voice signal sets the IoT device to be controlled and the operable items to complete the user's initialization of the operable items of the IoT device and obtain the device information and operable item information of the IoT device to be controlled; The device information and operable item information of the IoT device to be controlled are converted into voice information corresponding to the IoT device to be controlled and stored; the user's second voice signal and the voice information corresponding to the IoT device to be controlled are converted into The device information and operable item information of the IoT device to be controlled; and controlling the IoT device to be controlled to execute the operable item based on the user's second voice signal and the voice information corresponding to the IoT device to be controlled, The step of converting the device information and operable item information of the IoT devices into the voice information further includes: using natural language processing (Natural Language Processing, NLP) technology to convert the device information and operable items of the IoT devices. Project information is converted into these voice information. 如請求項6所述的語音互動物聯網的方法，其中該方法更包括： 儲存來電號碼資訊以及該待管控的IoT裝置的裝置資訊及可操作項目資訊。 The voice interaction method for the Internet of Things as described in request item 6, wherein the method further includes: Store the caller number information as well as the device information and operable item information of the IoT device to be controlled. 如請求項7所述的語音互動物聯網的方法，其中該方法更包括：依據該使用者的來電號碼資訊與該儲存的來電號碼資訊進行比對驗證。 The voice interactive Internet of Things method as described in claim 7, wherein the method further includes: comparing and verifying the user's caller number information with the stored caller number information. 如請求項6所述的語音互動物聯網的方法，其中該方法更包括：經該電信網路與電話裝置通訊連接；以及經由區域網路與該些IoT裝置通訊連接。 The method for voice interaction with the Internet of Things as described in claim 6, wherein the method further includes: communication connection with the telephone device via the telecommunications network; and communication connection with the IoT devices via the local area network. 如請求項6所述的語音互動物聯網的方法，其中該將該待管控的IoT裝置的裝置資訊及可操作項目資訊轉換為對應該待管控的IoT裝置的語音資訊並儲存的步驟中更包括：採用該自然語言處理(Natural Language Processing，NLP)技術將該待管控的IoT裝置的裝置資訊及可操作項目資訊轉換為對應該待管控的IoT裝置的語音資訊並儲存。 The method for voice interaction with the Internet of Things as described in claim 6, wherein the step of converting the device information and operable item information of the IoT device to be controlled into voice information corresponding to the IoT device to be controlled and storing it further includes : Use the Natural Language Processing (NLP) technology to convert the device information and operable item information of the IoT device to be controlled into voice information corresponding to the IoT device to be controlled and store it.
TW110145569A 2021-12-07 2021-12-07 Voice interactive internet of things system and method thereof TWI823204B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW110145569A TWI823204B (en) 2021-12-07 2021-12-07 Voice interactive internet of things system and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW110145569A TWI823204B (en) 2021-12-07 2021-12-07 Voice interactive internet of things system and method thereof

Publications (2)

Publication Number Publication Date
TW202324187A TW202324187A (en) 2023-06-16
TWI823204B true TWI823204B (en) 2023-11-21

Family

ID=87803596

Family Applications (1)

Application Number Title Priority Date Filing Date
TW110145569A TWI823204B (en) 2021-12-07 2021-12-07 Voice interactive internet of things system and method thereof

Country Status (1)

Country Link
TW (1) TWI823204B (en)

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102882752A (en) * 2012-10-19 2013-01-16 天津光宏科技有限公司 Internet-of-things and android system based intelligent home system and control method
CN206117700U (en) * 2016-08-31 2017-04-19 深圳市轻生活科技有限公司 A intelligent router for speech control of family center
US20170322687A1 (en) * 2011-09-26 2017-11-09 Tal Lavian Systems and methods for electronic communications
TWM552965U (en) * 2017-08-15 2017-12-11 陳長宏 Intelligent portable survival lamp with internet-of-thing function
US20180041856A1 (en) * 2016-08-08 2018-02-08 At&T Intellectual Property I, L.P. Software defined iot service network architecture
TWI614676B (en) * 2016-08-26 2018-02-11 Walton Advanced Eng Inc Digital voice guiding device and method thereof
CN108958698A (en) * 2018-07-20 2018-12-07 珠海格力电器股份有限公司 A kind of method, apparatus, storage medium and terminal for adding equipment
CN109725961A (en) * 2017-10-31 2019-05-07 百度（美国）有限责任公司 The system and method that execution task is inputted based on user using natural language processing
US20190295547A1 (en) * 2018-03-20 2019-09-26 Voice of Things, Inc. SYSTEMS AND METHODS TO SEAMLESSLY CONNECT INTERNET OF THINGS (IoT) DEVICES TO MULTIPLE INTELLIGENT VOICE ASSISTANTS
TWI688872B (en) * 2018-12-28 2020-03-21 中華電信股份有限公司 System and method for voice control iot device
TWI714212B (en) * 2019-08-14 2020-12-21 緯創資通股份有限公司 Cross-platform communication method, server apparatus and electronic apparatus
US20210359985A1 (en) * 2020-05-14 2021-11-18 T-Mobile Innovations Llc Technical Layer for Portable Electronic Assistant

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170322687A1 (en) * 2011-09-26 2017-11-09 Tal Lavian Systems and methods for electronic communications
CN102882752A (en) * 2012-10-19 2013-01-16 天津光宏科技有限公司 Internet-of-things and android system based intelligent home system and control method
US20180041856A1 (en) * 2016-08-08 2018-02-08 At&T Intellectual Property I, L.P. Software defined iot service network architecture
TWI614676B (en) * 2016-08-26 2018-02-11 Walton Advanced Eng Inc Digital voice guiding device and method thereof
CN206117700U (en) * 2016-08-31 2017-04-19 深圳市轻生活科技有限公司 A intelligent router for speech control of family center
TWM552965U (en) * 2017-08-15 2017-12-11 陳長宏 Intelligent portable survival lamp with internet-of-thing function
CN109725961A (en) * 2017-10-31 2019-05-07 百度（美国）有限责任公司 The system and method that execution task is inputted based on user using natural language processing
US20190295547A1 (en) * 2018-03-20 2019-09-26 Voice of Things, Inc. SYSTEMS AND METHODS TO SEAMLESSLY CONNECT INTERNET OF THINGS (IoT) DEVICES TO MULTIPLE INTELLIGENT VOICE ASSISTANTS
CN108958698A (en) * 2018-07-20 2018-12-07 珠海格力电器股份有限公司 A kind of method, apparatus, storage medium and terminal for adding equipment
TWI688872B (en) * 2018-12-28 2020-03-21 中華電信股份有限公司 System and method for voice control iot device
TWI714212B (en) * 2019-08-14 2020-12-21 緯創資通股份有限公司 Cross-platform communication method, server apparatus and electronic apparatus
US20210359985A1 (en) * 2020-05-14 2021-11-18 T-Mobile Innovations Llc Technical Layer for Portable Electronic Assistant

Also Published As

Publication number Publication date
TW202324187A (en) 2023-06-16

Similar Documents

Publication Publication Date Title
US10482880B2 (en) Command and control of devices and applications by voice using a communication base system
US20220180873A1 (en) Methods, systems, and media for voice-based call operations
US7400712B2 (en) Network provided information using text-to-speech and speech recognition and text or speech activated network control sequences for complimentary feature access
US8600013B2 (en) Real time automatic caller speech profiling
US8452347B2 (en) Headset and audio gateway system for execution of voice input driven applications
WO2016184119A1 (en) Volume adjustment method, system and equipment, and computer storage medium
CN108182944A (en) Control the method, apparatus and intelligent terminal of intelligent terminal
CN108476256A (en) A kind of volume adjusting method and terminal
WO2019077347A1 (en) Secure voice biometric authentication
US9236048B2 (en) Method and device for voice controlling
CN103760969A (en) Mobile terminal and method for controlling application program through voice
CN105393302A (en) Multi-level speech recognition
US9077802B2 (en) Automated response system
US20130246051A1 (en) Method and mobile terminal for reducing call consumption of mobile terminal
US7583959B2 (en) One button access to network services from a remote control device
CN105682008A (en) Method and device for controlling terminal through earphone
TWI823204B (en) Voice interactive internet of things system and method thereof
EP3059731B1 (en) Method and apparatus for automatically sending multimedia file, mobile terminal, and storage medium
US10433081B2 (en) Consumer electronics device adapted for hearing loss compensation
US20060077967A1 (en) Method to manage media resources providing services to be used by an application requesting a particular set of services
US11056106B2 (en) Voice interaction system and information processing apparatus
JP2015100054A (en) Voice communication system, voice communication method and program
CN104113578B (en) Pass through method that water heater receives calls and the system to receive calls by water heater
CN105681581B (en) Audio communication method and system, intelligent terminal
WO2021077245A1 (en) Voice control method and apparatus, and terminal and storage medium